As a former college athlete and semi-pro player I find it amusing. If people want to call it a sport then let them - no skin off my (oft-broken) nose.
I do draw the line at quidditch, however. It didn't even make internal sense within the books and when people take away the main skill - flying - and just run around with a stick between their legs it just gets sillier. No, that is not a sport.
