The Prime Minister has not ruled out Britain going "all the way" and re-joining the bloc.