I have had a few of these with a dodgy on/off button, can only advise you persevere with pressing in the button until it eventually stays on. Alternative is a pcb replacement.
Once you have it on, use the fused spur to turn it off in future.
Carefree
December 2010