You're right, I think you may be able to remove the plastic interior panel without breaking it. You first need to remove both phillips screw holding it and then, maybe you can pry it out even if the door is closed. Once it's removed, you will see the door ketch at the botton. There's a metal lever which is normally pulled by a rod to unlock the door, but the rod is probably not connected anymore to the lever.