The justice does not give a timeline about when he would step aside