Samuel Elam, one of the owners of Vaucluse, dressed as a Quaker yet lived in opulent style. He was a banker who traveled between his Portsmouth farm and his Newport home. He had been rejected by Miss Redwood, and he turned to Petrarch’s poetry to soothe him. The name “Vaucluse “comes from the “Fontaine de Vaucluse” in Provence, France where Petrarch retreated after the death of the woman he loved. Elam also adopted the melancholy mood of Petrarch. In 1793 Elam had a miniature Roman temple built on the precipice of the ravine that led to the river. His garden was a boxwood maze. By1803 Elam was building a grand mansion with classical temple columns.

After Elam’s death Vaucluse was purchased by Charles de Wolfe, but when he went bankrupt Vaucluse was purchase in 1838 by Thomas Robinson Hazard and Frances Minturn his wife. The Hazards were from the West Bay of Rhode Island, but at age 40 he moved to Portsmouth to devote himself to sheep farming. He was known as “Shepherd Tom” Hazard. Hazard revived the mansion and grounds. He busied himself with tending to his farm and advocating for abolition and compassionate care of the insane. He visited “poor farms” across the state and worked with Dorothea Dix to advocate for the needs of the poor and mentally ill.

For a while Hazard and his wife had a blissful existence at Vaucluse. In 1854, however, Frances died suddenly. At that time the Hazards had five children under twelve. Shepherd Tom was wracked with grief. He invited guests like Julia Ward Howe and her children to come and enjoy the grounds. After his tea-parties the adults would gather on the porch to talk about Spiritualism which was popular at the time.

Tragedy again haunted them when daughter Anna died of consumption at age twenty-two. Daughter Fanny also died of consumption at age thirty five. Her twin sister Gertrude drowned herself in a pool on the grounds. At this point Shepherd Tom immersed himself in Spiritualism. He believed that the spirits of his wife and daughters visited him for hours at Vaucluse. He brought in mediums for seances. Although his wife had been dead for over twenty-five years, he could feel her spirit in the gardens.

Shepherd Tom died in 1886 and the property was left to Barclay, his only son. Barclay abandoned Vaucluse to the ruins of time. It was left vacant and untended.