The former chancellor said that Brexit has been “a mess” and that Britain’s economy has “gone off a cliff” as a result