Do I have grounds for a discrimination lawsuit?

I'm a dude. I walked into the ladies' locker room at my gym because I wanted a locker that was a bit closer to the machines. No biggie because we're all equal and abhor discriminatory practices like segregation, right? Well guess what happens next! The women, several of whom were in various states of undress, cover their bodies with the nearest piece of cloth and begin screaming at me to leave! ummmm....Ok. So I just ignore them and start claiming my locker when in walks some big dude who throws me out of the gym (I'm still not sure why the women couldn't do it because women are as strong as men because we're all equal)! Well now they cancelled my membership. Can I sue for -based discrimination? I'm so upset!