Don't know why you were downvoted. I've noticed this too. Someone who works out a lot (noticeably muscular) is stereotyped in academia or STEM professions.
I can understand there being an issue for being overly muscular, but I also don't think that being overly muscular equals being good looking. This is probably a very common mistake that men make when pursuing better looks.
I'm a pretty good looking man by conventional standards. In my n=1 experience the benefits far outweigh any downside. I actually can't think about any downside.
I know this sounds cocky, but I thought it might add to the discussion.
Being good looking is fucking awesome. So is being smart. Both are a combination of genetics and hard work.
Good looks during young age remove the incentive to communicate well, so when the looks inevitably expire one might end up not as well-adjusted as their average-looking peers.
You might get deported like that Saudi guy for being too handsome.
You can also be targeted by other men (of a different race for example) that feel threatened by you - or women too, the bitter type, in all seriousness.
To make it easier for your probable world view: being a very good looking tall black man for example, won't necessarily have everyone open up to you with smiles on their faces (especially if you don't necessarily want to assimilate into their 'culture'/social structure).
Being a very good looking asian (yes they exist, haha) guy myself - I would say I have experienced many instances in my life where white men have attempted to sabotage me.
People like things that make them feel/seem more powerful, and hate things that tend to do the opposite.
No guarantee's there, but I can say that it works both ways. Xenophobia and these sorts of biases exist and are normal parts of being a human being.
I would say, it's better to accept that these biases exist, so that you can take them into account when reasoning - rather than trying to delude yourself into thinking you are in entire control of all that is going on in your mind (and body).
I mean, what caused you to believe they were sabotaging you based on looks?
I'm sure there are all kinds of odd reasons why somebody might do that, but it seems like an odd one to assume unless there's a reason for it.