He took to his podcast with wife Julie to address the haters.