I had time to reflect on our relationship and realise my children needed to know their grandmother