Except we can't build what we can't comprehend that also works.

The problem here is that people with power to direct funds are, more often than not, utterly ignorant in building anything.

I think where all this is generally directed is a society, like in Asimov's Foundation or Plato's Republic (with additional step), where people competent in building something are reduced to a small caste, most of them with local, not professional, competencies, like priests, and with a techno-religion centered on that "AI". This is a hierarchical structure very vulnerable to, well, that kind of powerful people.

The majority will work non-essential jobs (like in Heinlein's Door Into Summer), which do not give them any kind of power, the soldier caste will work the military, and the builder caste will work the technology, and the philosopher caste will be those powerful people. The difference with Plato is in having that first group of people which does not fit into any main caste. By Plato they would all be builder (worker) caste, but that would create a problem with the attempt to make it a religion and a hierarchical monopolized structure. The builder caste should be small.

You might see a whole lot of problems with that idea (which still seems to be attempted), that's because the people from whom it comes don't understand how civilization works and that instruments change the rules constantly, not just to the point they can understand.