I had the same problem and Harry d's answer helped. I used two small screw drivers between the yellow filter housing and the purple plastic outer working around the edge little by little to force the yellow filter case up. Also put a large screwdriver inside (via the hole in the purple outer) to twist the centre of the yellow case upward.
This took me ages! Just be patient and keep working around the edge, forcing it up (without breaking the outer, of course!)
I too am about to find some very fine sandpaper to smooth both the yellow filter case and the purple outer.
Lesley
October 2016