Not true anymore. You can create a reasonable voice clone with like 30 seconds of audio now (11labs for example doesn't do any kind of authentication). The results are good enough for this kind of thing, especially in a lower bandwidth situation like a phone call.