Then your starter is getting some juice. Maybe not enough. It's also getting a control signal. I'd clean all the power connections to the starter/solenoid, before anything else.