... When people find out we are retired, the immediate question is "So do you travel a lot?", followed by surprise/disappointment that we don't.
.... But I am getting to the point where I feel comfortable telling people I just don't care to travel...
You shouldn't feel that you have to make excuses for your choices, just explain your preferences and let it go. We are not all cookie-cutter, travel (or fill-in-the-blank) isn't for everyone.
As far as the original question, I'd say it's a double edged sword. Some people can bore you with their travel stories, so travel makes them boring. If the travel brings some insights that they are good at communicating, it can be very interesting.
But certainly the implied converse is not true - that if you don't travel you must be boring. There are many things outside of travel that are interesting. And I bet that some people who study an area or civilization in depth through reading, films, or some in-depth conversations with people from that region could provide more interesting insights than the traveler who saw the tourist sights and never went any deeper.
A couple things I like to ask interesting travelers, and think about myself on my limited travels are:
1) What did you observe that was very different from what you expected (it doesn't have to be a 'big' thing, just some funny little thing is interesting to me).
2) What did you observe that you didn't expect, it wasn't mentioned in any guide or from other travelers (again, could be some small detail)?
3 What did you expect to observe, but didn't (some stereo-type that just didn't pan out)? This might overlap with #1
4) What did you think you would never see, but did?
On a business trip to Korea, two things like that stick out for me. One was that teenage girls would walk hand-in-hand or arms around each other as they walked around the city. As one of the locals explained 'It's not what you think - it is just friendly'. Just different from what you would see here, and nobody ever mentioned it to me.
I had heard a lot about the food (seems people either love it or hate it - I loved it). There are many shared side dishes with the meal - but what I wasn't prepared for was all the 'double-dipping'. Everyone's chopsticks went from mouth to shared dish to mouth to next shared dish. I'm with George Constanza on this, so I just had to grit my teeth and take the "when in Rome..." approach.
In Budapest, a local started a conversation with us on the bus when he heard us speaking English (he spoke a little English). When we said we were from the Chicago area, he said "Oh, Al Capone!". Cracked me up - I know it's a stereo-type that people associate Chicago and Al Capone, I was surprised to actually hear it in these times (though this guy was probably in his 60's).
I hope I didn't bore you with that little story
-ERD50