Doesn't make somebody a bad person to choose not to wear it, I don't think everyone should be forced to actively protest for somebody else's cause. But also if you choose not to wear it you should be ok with the ramifications (isolating a group of people who will dislike you or call you homophobic or whatever).
Don't think it's a big deal ultimately. If you want to actively support the cause, then do it. Don't fake do it just because of social pressure. If you don't want to do it because of your personal or religious beliefs or just because you don't want to take part in a protest, that's your choice. Not like every person who is complaining about it goes to every (or any) pro Palestine protest, or BLM protests, or LGBT+ protest, or whatever else that is going on in the world.