It may be that some of the old wall lights were operated by a remote, separate switch on the wall but others (the ones you're unable to turn off) had their own on off switches mounted on the lamps themselves - and that your new badly behaving lamps do not have their own on/off switches.
Key question - How did you control the old wall lights - the ones that are playing up - before you removed them?
You may benefit from the services of a sparky.
Good luck...
Peccavi
May 2009