I wish there was a setting to only allow Face ID or your full AppleID password.

Not to discount this frustration, but you can absolutely access the hidden photos with just the passcode. Try it.