This is not a plug to be pulled in the direction of the cables but vertically off the board. Putting it back in you simply plug the contacts down first, then the cable side of the plug.

Actually, on my device one lock was colored faun (beige). Lift them seen from the edge of the Note, not on the cable side.