Sounds like the float is set to high, so it is not cutting off the water supply at the correct level. Look to see if there is an adjusting screw on the float valve. If worse comes to worse you may be able to bend the arm of the float ball down, so that the float does not come up so high.
Rob
November 2008