My phone boots incompletely after charging. What solutions can I try?

When I plug the phone into a charger it starts to boot with the Nokia logo on the screen but then it just returns to a black screen (with the LCD backlight still on) when I unplug it the screen turns off completely after a few minutes.

When I try to boot it without it being connected to a charger it does the same thing but with the low battery icon and then it turns off.

I think the phone needs a new battery or other component, but I'm also unsure if it's software-related