Do I need a sport to get into an Ivy League university?

Not at all. As long as you're involved in the school community -- and you certainly are -- it's fine. Princeton and Harvard will understand that not everyone is varsity athletics material :) Just remain dedicated and try to stay in those clubs and services for all 4 years...