It's not a bad idea at all if your bars are really snug against the headset (REALLY snug) and the clamps are cranked down hard.
Just ride it for a few days, if it gets too loose just.. throw the nut on, or tighten it up and crank the clamps down harder.
Oh, and I deleted squid's replies and...