Connect a multimeter to car battery with engine running.
Turn headlights on and check voltage. More than 12.8 volts shows that the alternator is providing a charge to the battery. The dim warning light may just be a poor connection at the alternator.
Dann
September 2007