I've pretty much done the same as KC with a few wheels. I have a tracking wheel on my old Square Wheel that is a retrofitted caster. The grinder runs way better after adding that wheel.
Many of these wheels seem to have a bore that fits ball bearings well with no modification. I have three that do. I forget what OD bearing fits them, 1-1/8" or something.
With metal hub casters, they will often be out of round slightly, a little non-concentric, and unbalanced. Out-of-round and non-concentric can be taken care of by mounting them on bearings and running them out front on the grinder with a narrow belt, and truing them up with a rasp. At the same time, if the wheel will be an idler, I put a little crown on it.
Balance issues that remain after truing will be in the hub metal. Often these wheels have a grease zerk in the hub, it helps to take that off and use a lathe (in my case a mill) to remove the extra metal that the zerk screws into.
After doing these things, casters often work very nicely.