Actually there is only one booster (amplifier) and its in the antenna itself. The plate with the light on it just controls the booster and does some switching.
That control plate contains a splitter. One output goes to the front of the plate where you connect your main TV. The other splitter output goes to your other TV outlets (thru more splitters if you have more than 2 total). It sounds like there is something wrong with the wiring on the back of the control plate.
Here are a couple of pictures that may help.