After the MacKenzies ousted the MacLeods from Ardvreck Castle in 1672, they took control of Assynt. Calda House, a more modern residence, was built in 1726. Unfortunately it burnt down in 1737. Before it could be rebuilt, the MacKenzies suffered by being on the losing side at Culloden.
Calda House is also said to be haunted by a ghostly woman and strange lights have also been seen.