In her book of his unseen archives and handwritten lyrics alongside memories of his personal and creative life, the singer's one-time fiancée and lifelong friend paints a revealing portrait