The prime minister made the remarks during a speech at the Lord Mayor’s banquet at The Guildhall