"This is a terribly pernicious system. It's gone on for too long," Vice President JD Vance said on Thursday.