A majority is 50+%, a 'vast' majority? Gimme a number. Something to work with here.
I enjoy some prolific authors that serialize content here, and on days when I catch up on their work, most of my votes can go to them.
Thus the time frame considered for a penalty is also relevant. Is this per day? Per week? Month? The only week for which I have data, last week, I hit over 150 unique accounts with upvotes.
This idea may be more complex in practice than in theory.