Where do you go?

The first lines of the famous song came to my mind. (dont remember any of the rest of the song though) . August 2005 is when i moved to my current job. Though i have moved up and have started managing people since then, its still the same area. As I calculate exactly, I find its about 2 years and 9 months now. The reason its freaking me out probably is because I have never spent so much time in one place in my entire career. My entire career by the way is a little less than 6 years long now.
In my earlier organization I spent 2.5 years. In those 2.5 years I changed my job profile 3 times over. Is that the reason I am feeling uneasy now? Really, I dont think that is the point.
Am I scared I would stop learning if I go on like this. In the first two years I learnt a lot, and at an amazing pace. Since last 6-9 months, I am spending more time leveraging my knowledge. I have been learning but that learning's of a different kind. The subtle kind where you really do not see anything tangible. Is that it?
Probably, this is also a strange time in one's career. In the first few years one can try anything one wants. However, once the career is 5-6 years old, you've got to lock in somewhere. Its not very easy to continue to move freely. One would have developed specialised skills and would need to continue to develop those skills or grow in that particular area.
I have stopped comparing myself with my MBA peers. Have got over that. Ambition still remains. Ambition is not just about earning more money. Its about something else. Dont know what.
Is this what would help me get where I want to be 5-10 years from now. I think that is the question in my mind. Should I be patient and hang around? Should I look for a change within the Organization or outside?