I've changed-out several axles, both sides, and never removed the ball joint (the three bolts). 19mm open wrench will remove the nut off the BJ stud. As it pushes up against the axle stub you can put a lot of force on the joint bolt . Then, with a big punch and hammer, whack the side of the A-arm near the bolt joint a few times. It will break loose. Then, knock the end of the axle to push it out of the bearing. Then, you can finish removing the 19mm nut off the BJ stud. Then, pry up on the axle to push the ball joint stud out of the A-arm end. ........ axle can be worked out from there. No need to remove the caliper. I did remove the sway bar end.
I did an axle change-out this past Monday evening in about an hour and half.
Good info about the axle nut. Although I had a pair, I reused the old one with lock-tite.