Hi Jo,
I suspect you mean its switching itself on...not off (maybe its colloquial)
It will be one of two things
1. The microswitch itself (replace)
2. Flame rectification not being sensed
I'm not very familiar with this model but they all use a similar but may be (variable) principle.
You'll need a corgi engineer to sort it out as you're not allowed to work on gas.
Gareth
January 2007