The Regulator's main base of operation is Regulator HQ. It is only accessible with the Lawbringer perk in posession.
Unlike their bad Karma counterparts, Regulators target the Lone Wanderer if their Karma ever goes to "Evil". It is also likely for a "Good" player character to encounter hostile Regulators if their Karma has previously dipped into evil territory. This can result in squads of Regulators appearing alongside squads of Talon Company mercs seeking to fight them.
Regulators carry bounty notices against the Lone Wanderer, regardless of Karma.
If you have evil Karma, the Regulators will come for you. They will usually spawn nearby your location. Below is a list of where they may appear if you fast-travel to that location. Regulators will not respawn after they have spawned in one of these locations, their bodies will also lie there indefinitely.
Regulator is the actual term for an official who maintains control and supervision of an area of public interest.  As a result, many armed groups, both vigilante and official, have been named "Regulators" throughout American history. One of the most notable groups in American history were the Regulators of the Carolinas around the time of the American Revolution.
The following is based on Fallout 3 cut content and has not been confirmed by canon sources.
pcps3xbox360 If the PC has access to the Regulator HQ and murders all of its Regulator inhabitants, Sonora Cruz will still remain friendly towards you as if nothing had happened. [verified]
ps3xbox360 Sometimes the Regulators will go through their dialogue as if they are hostile, but upon completion, they do not fire and appear friendly. They do not move or in any way pursue the player. If fired upon they do turn hostile and open fire. [verified]
ps3xbox360 The regulators sent out after the player can have skin problems where the face is of a Caucasian and the arms are of an African American. [verified]