The new prime minister will kill off a policy that ignited fierce controversy as he strives to show he is in touch with everyday concerns