“Few buildings in the world carry more cultural weight and architectural provenance” than this tower, a real estate broker said.