The first ever inaugural ball took place the evening after James Madison was sworn in on March 4, 1809. The party took place at Long's Hotel, and tickets cost $4.
Credit: National Archives/Newsmakers