If you have a drill motor or drill press with a 1/2” chuck you could chuck the shaft and turn it with the motor and then use the emery to work the shaft down.

Another method is to strip the...