I have some old machinist polishing stones of all different shapes - round, round tapered, trialgle, square, etc. These do a heck of a job on small tools. You can usually pick them upm on eBay from time to time, or buy them new - if new, they are not cheap!
Some of the woodworking sites have wet and dry stone set ups like the strop described above.