Faulty diverter valve. When you turn on the taps the valve should close off the heating port going out to the radiators.
If they get hot while the tap is running you will need a new valve or a re-build.
Call a local service company for quotes for both jobs(full valve or repair).
howtomendit.com for free repair help, information and advice.
Try fixfault.com to fix home heating systems.