The former president took issue with how President Donald Trump responded to his joke about "the White House looking like Saddam Hussein opened a Cheesecake Factory."