You probably get a downvote from them if you get an upvote from someone they don't like. There are boring WhaleWars that go on. The downvotes are probably automatic run by a bot that follows the person they hate downvoting whatever they upvote. Try not to take it personally, I doubt your post would have even been seen by either of them.