The Castle escaped harm during the Civil War, but in January 1865 experienced a fire on the third floor resulting in structural damage to the building, and loss of collections, including many items owned by James Smithson and records of Secretary Henry’s scientific research.