The prime minister has pushed back against early election rumours amid the rising support