The High Speed Rail CEO refused to answer questions at a public hearing Friday as the board voted to strip him of spending power.