Maybe they just don't want to associate with person who deciding for them with who they are should associate.
Don't speak about people behind their backs if you have something to say then do it to their face.
>Would you have told?
Depends on circumstances. If I want to somehow harm a person, than yes. Otherwise no, because it's not my problem.
>Do you hang around with people like that, just because they have a fursuit?
I don't hang around anyone just because of fursuit.
>Am I really bad for not wanting to associate with such people? Seemingly I am the only one who cares about such things.
No, you bad because you want to manipulate people into doing something you prefer and not doing something that you don't like.