Built in 1762 as a wedding present, the Derby House was the home of Elias Hasket and Elizabeth Crowninshield Derby for the first twenty years of their marriage. The Derbys raised seven children in this house. Hasket, Elizabeth, and their children lived here during most of the Revolutionary War. As part of the war effort, Hasket converted many of his family’s cargo vessels to privateers. The wealth that the Derbys amassed from privateering was the foundation of the great East India trade that Hasket and others pioneered after the Revolution. The Derbys sold the “little brick house” as Hasket called it, in 1796, to Capt. Henry Prince, who built the West India Goods Store next to the house around 1800. The Princes lived in the house until 1827. After that time, the house had numerous owners during the remainder of the 19th century. For a while, it was used as a tenement house, and multiple families lived in the building. Many of those families were members of the Polish community who came to work in the nearby mills.