Have you tried stropping the skiver blades? I strop everything, even the tiny strap cutter blades. It makes a difference.
I haven't done much skiving myself.
When I think back, it did take awhile for me to gain consistency with sharpening.
Don't give up. Keep trying. Sharp tools make all the difference.