Can I solder my laptop power supply to my battery terminals?

Not a good idea, it is very easy to damage the battery by soldering it. Just replace those terminals.