Palmer was dismissed soon after Tottenham broke the deadlock through a Mike Penders own goal