Digit

I've got a similar issue with an old piece of riveted leather. In the past I've tried to scrape off that sticky green stuff, but it keeps coming back. Since recently I have a spindle press for setting rivets, so I'd like to replace all the nickel-plated brass rivets with new ones (either nickel-plated brass again or nickle-plated iron, wdyt?). What's the best way to remove rivets? Drill through them? (I do have a press drill).