Green leader facing calls to quit from within his own party