Hiram "Hiller" Nutt was born in Virginia in 1804 and later moved to Louisiana, where he became a successful planter and businessman. He owned several plantations and was involved in the cotton trade, becoming one of the wealthiest men in the region.

In 1836, Nutt married Ann Elizabeth Davis, and the couple had ten children. Nutt was known for his generosity and philanthropy, contributing to local churches and schools and supporting his community.

Unfortunately, Nutt died suddenly in 1864 before completing Longwood, his dream home. He died of pneumonia, leaving his family with an unfinished house and significant debt.

The Nutt family struggled to maintain their wealth after Hiram's death, and eventually, the family had to sell off their properties, including Longwood, purchased by a cousin in 1881.

There were some tragedies in the Nutt family. Haller and Julia Nutt's daughter Caroline Routh Nutt died in infancy, and their son Haller Nutt Jr. died at 13 in 1861. In addition, Haller Nutt himself died of pneumonia in 1864, leaving his family to continue living at Longwood plantation.