The Reform UK leader said his loved ones 'would rather I packed it up and walked away'.