Dualshock 3 Won't Charge after replacing battery

One of my Dualshock 3 controllers wouldn't charge no matter what it was plugged into or how long it was plugged in.

I replaced the battery on it, and now when I plug it in, all 4 player lights flash once, then nothing.

If I plug it into my PS3 and hit the home button, it will connect and work fine but it won't be charging. Tried holding the reset button but no luck. Since the new battery has a charge, If I unplug the controller from my PS3, it connects and everything is fine, so I know the battery is able to supply power.

I know it's not the battery, I know it's not the cable, I know it's not the USB port, I'm at a loss. Any ideas?