Ted Bishop has suggested it doesn't count in his case because both his children are female and they've both made their careers in the golf industry and he's always been "a great advocate for women and girls in golf."
Feminist psycholinguists tell us that when men resort to gender-loaded insults there's more than a hint that those men not entirely comfortable with women as equals, but I'm not confident that the psycholinguists are widely read outside fairly narrow academic circles.
Still, is calling another guy a "L'il Girl" or saying he sounds "like a little school girl squealing at recess" insulting? And if it's insulting, who's being insulted? The guy who got called "L'il Girl"? Little school girls? All women? All men? The cosmos?