The New York Racing Association lost nearly $20 million last year, in part due to government fines and other expenses to cope with ongoing legal problems. But the association expects to greatly reduce the deficit in 2004.