water pump replaced tube leeking?

I replaced the water pump on my 97 Grand Cherokee and the tube with the o ring that inserts in to the water pump is leaking. Was the o ring suppose to go in that the tI replaced the water pump on my 97 grand Cherokee and the tube with the o ring that inserts’ in to the water pump is leaking tube . How dose this fit in with the tube is there something other I can use instead of the ring it did not seem to have one when I removed the water pump.