You're spot on, garbage in garbage out. I was saying the same when Chart GPT went viral. It will be a race to the bottom, destroying a free and open internet.

It also demonstrates the limitations of AI. It cannot create on it's own and requires human input as it has no will or motivation of it's own as it is an algorithm.

As you pointed out in your article, then there's the biases of the data model it is trained on, plus the initial learning rules.