I have very few rivet problems anymore, since I bought a rivet press. Mine is from Tandy when it was on sale a year or two ago, as well as most of my dies on sale. Knowing what I know now, though, I'd probably buy a Goldstar, since the dies are much cheaper.
That being said, there are still occasions when I have to set with a setter and anvil, when the rivet is too deep for the throat of the press. For those, I put the anvil on my granite slab, placed on the floor for the most solid striking surface that I can muster. A nice big dead blow hammer helps to insure that as much force as possible is transmitted to the operation.
Bill