I read the whole thing. Sorry there are several things that do not match.
First, you kicked out a female speaker because some people contacted you saying that they weren't 'comfortable with her and her partner. What the partner has to do in all of this? I think she was right in taking it badly, don't you think?
Second, you saw her in another conference just a day after that. How is that possible? that cannot be a coincidence. Do you realize that if she finds you in another conference, you would look like a stalker to her. What she was doing in this conference? What were you doing? you don't specify that.
Third, and most important. Who were those persons that contacted you at first? are they trustworthy? are they anonymous persons? because this smells too much like a smear campaign by a bunch of women and you are being played like a pawn.
EDIT: Fourth: you seem to imply that you are being attacked by someone with knowledge of the Signal messenger. Do you really think that someone would use an attack like that on you? those attacks are very valuable. Sorry but it all points to you being very paranoid.
BINGO!