As the former mayor of Greater Manchester prepares for his first conference as PM, his main problem is not that he has no mandate from voters - or even from Labour members.