Thanks for all the tips guys!! After some practice, I've gotten better. I also just mark all of the holes in the leather with the punch before I actually punch them.
I'm going to make a tool to do this though. I just ordered these parts from Tandy and I'll get a small steel plate made at my local machine shop that will allow me to screw in 4 of those tips in a row. Then I can just align this new tool and hammer the steel plate a few times to punch the holes.