I think it's a fair point. Anyone could be either person so no one instance of this is directly offensive, but I agree memes like this seem to routinely put down women.
I don't think op is pissing and shitting and crying over it, there's just no place to talk about it other than the meme itself. Anyone could criticise your comment in the same way, and it's just a strawman argument.
I think it's a big reason why there's a lot of people are watching hundreds of hours long campaigns online. People are just vicariously playing DnD because so few can get a group together and sustain it. You're not alone by any stretch!