The former X Factor judge, 74, has had a longstanding feud with the singer, 43, since he managed Girls Aloud from 2002 to 2004.