I like your comment regarding the (usually) thoughtful effort that goes into creative endeavours. I know that there are those who claim that deliberate effort is antithetical to the creative process, but even serendipitous results have to be deliberately examined and refined. Until a system can say "oh, that's interesting enough to investigate further" I'm not convinced that it can be called creative. In the context of LLMs, I think that means giving them access to their own outputs in some way.

As for the dangers, I'm pretty sure that most of us, even those of us looking for danger, will not recognize it until we see it. That doesn't mean we should just barrel ahead, though. Just the opposite. That's why we need to move slowly. Our reflexes and analytical capabilities are pretty slow in comparison to the potential rate of development.