When does it stop?

About a year after giving a talk in country X I am told by a friend I trust that one of the (junior) organizers of the conference at which I gave the talk found my talk “scandalizing.” I found that very puzzling, given that my talk was in a mainstream area and was received well at the time (if you judge by the Q/A and the subsequent feedback and the publication of a written version of the talk in a top mainstream journal). I was chocked to hear it. Unfortunately, my friend didn’t have any further details about the alleged scandal that occurred as I was giving my talk (also, he wasn’t present at the conference but heard about it only about 1 year later). I have thought about confronting the person who made the comment. I might still do that. But it did occur to me that while I have heard similar derogatory (and unsubstantiated) comments about the talks of female speakers, I have never heard these kinds of unsubstantiated claims about the talks of male philosophers. I definitely have strong feelings of indignation and sadness now. Seriously: do I still need to put up with this as a very senior professor? When does it ever stop?