If you vote for anothers early it goes to a pool where those who are the whales will get the unfair share? Is this along the right lines?

Yes. If you vote for a post or comment in the first fifteen minutes a portion of your vote and all the votes after yours will be distributed to all of the posts on the site in proportion to how many votes they have.