The TV host and actor admitted he engaged in ‘friendly, consensual and warm’ interactions with fans