Bess will disappear forever if the Chosen One goes down into the Modoc caves (this includes the well and outhouse).
It's actually possible to have Bess join the Chosen One permanently throughout the game. After she has been slaughtered by Grisham or after one has had the Bess encounter they have to return to a point in the game where Bess' broken leg has not been healed yet. This can be done by temporarily removing the file Modocmain.sav in the player's current savegame slot and replacing it with one that was made prior to healing Bess' broken leg. In this file variables regarding Modoc's main street are saved after visiting the area. When one now heals her leg again, she will follow the Chosen One for good. The player can even initiate dialogue with her, allowing them to alter her combat options.