Yeah especially after riding stairs and drops. It's not as bad as it used to be though, back when everyone rode stock bars the height adjustment clamp was right in the spot for your knee to hit every time you bent down on a landing.
Just keep riding and eventually it'll stop. We'll probably...