"Irresponsible" statements made by people who have been in a position of power can act as a deterrent for ordinary people to fight for their rights, Abdullah told reporters outside his private office