yes, I am very sure, I work directly with this tech. It's very good at making something that looks impressive but falls apart with any level of scrutiny.

My favourite part right now is that AI doesn't actually translate, it is just constantly dreaming up text that looks like what you might expect, and it's trained on a model that hopefully will impact that text to make it be valid.

but it's often not, so it will hallucinate something totally untrue, or just absolutely made up and then make all the following text entirely about that thing. You might have some text about the fall of the soviet union. but the AI hallucinates the existence of a clown at some point because of some bias in the model maybe, now suddenly the fall of the soviet union was because of a vast clown plot.

Often it just gets totally screwed over by it's own biases, like counting. god forbid your input text has something to do with counting, the AI's will get stuck on counting things that don't exist on that kind of thing so easily

all of this absolutely misses the fact that all the nuance is lost and the institutional knowledge is lost too.

To be absolutely clear, the current state of AI is very good at fooling middle managers and decision makers that it is good, because it's built to look good. but it's not even 5% the quality that we can have real people do things. and there is a mountain to get it there.