I have noticed that one account has recently stopped posting due to downvotes from a large orca account, and I just noticed another account being downvoted a few days ago. I believe it will be the same MO; the latest account to receive downvotes will eventually be forced to stop posting because they can not take it any longer.
I've seen this happening every once in a while. It has an impact on how active some people are on the blockchain, and on their sentiments. And that's especially hard for newcomers.
However, I do see a case where I agree with a downvoter, even if I rarely downvote myself (but I can skip upvoting). That's when someone uses alt accounts to mine rewards through comments, sometimes commenting with multiple alts on posts where they are likely to receive upvotes, and withdrawing most of the rewards regularly. And here I'm thinking more about the fact that these kind of comments rarely bring any value to the post they are commenting on, even though others may dislike the deceptive farming operation more.
I have downvoted some type of comments here and there, in the past because like you, I didn't find them useful and that's just about it. Also, I'm in full support of going after malicious intents and accounts and abuse as well as they pollute the chain.
I've been seeing it a lot and I won't really think it's good, I think we should find a way to mitigate it. We should go after outright abuse but limit other forms of downvotes. I'd rather not support a person than downvote them. I think when you constantly do this, they'll get the memo
That what I generally prefer to do.