You can whitelist channels to not replace their thumbnails.

Imo the cursed part is that only some do that and not all.