| Guillaume Ier de Chauvigny - Founder of the castle | Sponsor of construction in 1250. |
| Françoise de Montmorin - Inheritance by marriage | Wife Jean Motier de La Fayette. |
| Jean Motier de La Fayette - Highsheet Lord | Acquire the castle in 1543. |
| Madame de La Fayette - Wife of François de La Fayette | It was there in the 17th century. |
| Duc de Morny - Owner under the Second Empire | Turns him into a hunting lodge. |
| Jean-Louis Rufenacht - Former owner ( 1930s) | Aborted bed and breakfast project. |