Headset Spacer Stuck In Headset

So I was really stupid and put a threadless headset with threaded forks (it can be done) temporarily whilst I ordered in new threadless forks and other misc parts. Now the spacer that slides on last when fitting the forks on. Its a ring with a lip on that stops the forks from wobbling forward and back. Well the thread on the forks is stopping that from coming out, I have hit the forks really hard with a hammer to no avail. I really cant remove it and the two biggest problems are that I CANNOT get a replacement spacer set as I have literally spent every last free penny I have on new bars and forks (I didn't foresee this issue) and the current spacer is plastic meaning I dont wanna break it. Anyone got any ideas on how to remove it?
 
Top