The new prime minister vowed to end rough sleeping in his first address to the nation