Without knowing what model, year, etc., of your unit is difficult to help you. What I know is that some units like mine has two switches. One inside in the normal panel and another outside where the hoses connect. When the outside is on, it overrides the inside one. I need to make sure that the outside is off in order to have control from the inside one. However, as I said, without having more information about your unit this might not apply to yours.
2017 Leprechaun 311 FS
Jeep Patriot and Cherokee as toad.