You might get lucky and find one with the right dimensions. Other than that you could go with your idea of a rubber bushing then stainless steel washer but I'd use a lock nut if you do that since you won't get as much torque on the nut which reduces the torque required to back it off.

http://www.mcmaster.com/#beveled-washers/=myk00r