The actor was appearing on ‘The Graham Norton Show’ alongside his ‘Fatal Attraction’ co-star Glenn Close