The urethane would not make the core wobble.
Your bearings are not in all the way and/or they are not in straight. You have to PRESS them in evenly in a vice, arbor, hydraulic press or with a bolt and some washers (as a last resort). You need to install them ONE at a time also. If you try...