I have some old machinist polishing stones of all different shapes - round, round tapered, trialgle, square, etc.  These do a heck of a job on small tools.  You can usually pick them upm on eBay from time to time, or buy them new  - if new, they are not cheap! 
Some of the woodworking sites have wet and dry stone set ups like the strop described above.