main medway water boiler 55/54 not combi stays on when water is turned off?

The cold water pipe came apart [burst] at the joint after the boiler stayed on when the tap was turned off. Iv repaired the water feed and lit the boiler but it still stayed fired up with no tap turned on????
Iv now turned off the gas and water feed to the boiler until i know what part may be needed.