| Raimond de Calmont d'Olt - Bishop of Rodez and last lord | End of lineage in 1297. |
| Hugues III de Castelnau-Bretenoux - Baron de Calmont (1315-1350) | Strengthens the castle during the Hundred Years War. |
| Jean Ier de Castelnau - Governor of Guyenne (XIVe) | Captain General in Languedoc, faithful to the king. |
| Thierry Plume - Owner since 1987 | Restores and enhances the site. |
| Guillaume de Calmont d'Olt - Bishop of Cahors (XIIe) | Founded Bonneval Abbey in 1144. |
| Alexandre de Castelnau-Clermont-Lodève - Last resident baron (1580-1621) | Murdered in Espalion in 1621. |