Hi, got a similar issue with my 1.8tdci 2003. Lucky you know where your switch is, when they made mine they either didn't fit one, or they put it else where!
I tried a spare key on mine and it started 1st time. I'm hoping that mine is going to prove to be the chip gone in my key (for the immobiliser).
You don't say what fuel yours runs on, or if you have tried a spare key. Yes it might be the fuel pump, but it may also be an immobiliser issue.
If it's an immobiliser problem you will need to find some one who has the kit to do the diagnostics. Hope this helps a bit, as I too am looking for answers to this problem.
Chris
May 2008