The prime minister apologised to those ‘holding a threadbare system together’