Use an opening tool or a nylon spudger to carefully remove the battery. Make sure you pry upward.

Once that is removed, make sure you peel off the sticker where the battery is placed if it stuck to the battery.

If it is, then place it back where it belongs in the headphones.