The city may never sleep, but its strangest relics of the past refuse to disappear.