Looking at your photo, you have 2 leads on the "Battery" side of the switch and 1 on the "Load" side that feeds that distribution bus. So the battery is still connected to something even when the switch is off.
Look at the left terminal on the back of the battery switch. Is the lead that comes in from the top the wire to the battery? What does that wire and the one that goes down to the self-resetting breaker go to? One of those must be your parasitic load causing the battery to drain (unless the battery is old and just self-discharging).
I have one that ran directly off my battery feed like that from the factory and it went to a slide out.