It definitely has to do with thickness, density and hardness of the leather. It is gripping the needle and rising with the needle.
Moistening the leather will make it softer, easier to pierce and retract. It will also leave more machine marks.
Are you using a leather point needle? It looks like you are, and should be better than a conical point.