There is clear data showing that voter confidence in elections has fallen, but it's not so simple