He means it's not up to him to make sure the person serving him makes a decent wage. That's up to the employer.

Everyone who works for a company is a 'slave' we are all being exploited, some more than others. But if you make less than minimum wage without tips then yes maybe look for another job.