The system should be designed in a way that punishes just them not everyone.

I'm not getting downvoted when someone downvotes junk and shady behavior. As a matter of fact, I see a TINY increase in my rewards.