Fears are growing that hard-working Britons are being left behind as ministers face backlash over the nation's reliance on overseas labour.