Just to be clear my issue with it is how commercialised it is, not the tech itself which is actually kind of interesting. This 'wall' though should have always been obvious and the solution isn't just more llms or more training data, for actual advancements people need to be putting money into other areas of research.