Preparing wall for painting once dado rail removed?

I have taken off a wooden dado rail that was attached with adhesive. I have caused minimal damage to the wall but where this has probably been affixed for a while, there is a build up of a couple of coats of paint either side of the space where the rail used to be. This would clearly be visible once repainted and is evident to the touch when you run your hand down the surface. Is it easy enough to use polyfiller to even out this surface....????