I'm not sure if regular libs have been migrating to Lemmy leaving only the worst posters or if they are just becoming shittier.

They don't have to necessarily migrate to Lemmy. There's plenty of other social media sites. My guess is most people who are fed up with Reddit won't bother with a shitty Reddit clone but move on to a different social media.