As he ducked into a Senate Republican lunch