| Nicolas Petitdé - Commander of the castle | Argentier of John II, Duke of Bourbon. |
| Anne de Bretagne - Queen of France | Stayed at the castle in 1495. |
| Guillaume Antoine du Broc de Segange - Owner under the Revolution | Death in prison in Moulins. |
| Jean Charles du Broc de Segange - Former emigrant and mayor | Mayor of Avermes (1807-1817). |
| Louis du Broc de Segange - Local scholar | Work on the Nivernais and Bourbonnais. |
| Gaston du Broc de Segange - Historian and Archivist | Author of*Extracts from the archives of the castle*. |