| Simon Le Gras de Vaubercey - Secretary of Command of Anne of Austria | First owner of the land offered by Henry IV. |
| Nicolas Le Gras - Secretary of Commandments, son of Simon | Have the current hotel built. |
| François Gaspard de Montmorin - Marquis de Saint Hérem, a great owl | Husband of Anne Le Gras, gives his name to the hotel. |
| Nicolas Huguet de Sémonville - Counsellor at the Paris Parliament | Owner in the early 18th century. |
| Jean-Claude Brialy - French actor | Lived there until 1984. |
| Rémi Brissiaud - Mathematician | Lived there from 1949 to 2020. |