There's this TV show in the UK, and I believe it's in the US and Australia as well. It's called The Traitors. And the wallflowers sometimes get suspected as being the traitors for exactly this reason. People wonder if they're hiding something, unsociable because they've got something to hide, judging, or just not as open as the big mouths.