The public 'are your real bosses’, PM tells public servants