Elrich Daudet said the woman acted as a muse for his poetry and songwriting