Harp was spotted Saturday with the president at his Virginia golf course ahead of his appearance at Sunday’s Indy grand prix