Labour cancelled the Conservative's asylum agreement with the east African nation as one of its first acts in office.