I know of the hand cleaner you write of, or at least a local version. It doesn't have pumice in it though but something else as grit. Although the grit can be felt on the hands its not serious enough to damage leather, unless you use a lot of it and really scrub it in.
I've used the hand cleaner to clean the insides of mugs of tea stains. Its less rougher than a pot scrubber