With the sale of Calvin Klein, look for Barry Schwartz to spend far more time around his passion: horses.