How do I remove innermost battery?

Hi all,

Bit of a problem here: I received my ‘new’ Atari Portfolio today. Popped in a set of AA’s, then not realizing that the battery didn’t go smooth all the way in, but needed a gently push.
Now that I’m removing the batteries: the left-most (deepest) battery doesn’t come out! I’ve already tried gentle shaking and gentle banging on a soft surface, hoping the battery will slide, but it doesn’t seem to budge…

Is there any way to get this battery out anyway? Any tips?