Having to hold the card in is realy NOT normal as there is a retaining mechanism. It may be broken in your reader OR the retaining notch on the card can be broken.
If the notch IS broken, the broken bit may still be in the camera, preventing you from properly inserting the card in.
Hold the camera so that the card slot is oriented down and gently tap on the camera with your fingers. Do that in several directions. Any small bit of plastic the same colour as the card falls off?
The card is still useable as long as there is something, like a cover or your finger, holding it in place.
You should prepare to get a new card as this one may potentialy degrade further over time.
The formating may be damaged.
You retreived the images, fine, you have no material left on it to loose. The following will erase anything left on it. It may not be necessary if the problem was a debrit preventing you from correctly inserting the card in the camera.
In windows, or any other OS, try to format the card just as if it was a regular disk. You probably need to format it as FAT 32.
If everything fails, the card is dead and need to be replaced.
Electro
December 2011
howtomendit.com for free repair help, information and advice.
Try fixfault.com to fix memory cards.