Hobbes,
I wholeheartedly believe, and preach about getting a non-aviation degree. However, I also believe that it is imperatively important to get a degree in something you enjoy. If you don't, your doing yourself a grave injustice that will catch up with you someday. If Aviation Management is what really spikes your interest, then by all means pursue it!
Good Luck!