He said that the trio of Smith, Warner and Bancroft were the "victims" of the fiasco since they took blame for the whole team