The House will only work four days before the midterm elections after it took a monthlong recess