That sound like a thermostat problem. I have camped in very cold areas in the mountains and never had a problem like that. That final click, when pushing the lever to the left, is supposed to totally turn off the furnace.
And those factory thermostats are noted to be troublesome at times.
Here's some info on the operation....
http://robertssales.com/articles_tut...is_not_on.html