The architectural gem is now vacant and deteriorating.