It could also be that the ground wire may have come off the back of the switch which would keep both the switch light and aisle lights from coming on. One of my compartment light switches had a wire just barely hanging on. I found it while looking for a junction box when I experienced other electrical issues. I have also had the bulb within the switch burn out. Switch still functions but there's no indicator light showing the switch is on. Those switches are available in different colors. I'm now using Amber for my Arctic Pack and Red for the outside porch light. You can switch the fronts with a jewelers screwdriver.
Sigma A1 Series Rocker Switches.pdf This is the manufacturers catalog. I found mine on eBay but it's a good reference. Your Blue switch would be the A1-36.