cant remove upvc barrel?

hi peeps, i've got a problem with a new upvc door lock, the keys just keep spinning round on both sides freely not macking the lock operate at all, so i assume the barrel is broke, i got a new barrel tested it first thats fine, the problem i have is that i can't remove the old barrel as the locking pin will not move into neutral position so i can slide it out, does anybody have any ideas how i can get it out? or will i have to resort to the drill?.

please help

Thanks Gary Simpson