Today, the desert festival is known for drawing ultra-wealthy attendees