I would take a look at your expenses and work out how much of that is being spent compensating for the fact that you don't have time.
For example, a lot of people in high-pressure, high-status jobs don't get to spend much time on vacation, but when they do, it's high-end stuff all the way. It's very easy to burn through a ton of money like that. Having more frugal vacations is a necessity of retirement, but also makes for far more meaningful experiences. (Many of our best family vacations were home exchanges. Imagine a 3-week trip to Europe with hotel bill=$0, car hire=$0, and when you tire of restaurants, you have a full kitchen to cook something nice, or just have some salt and pepper to put on a sandwich. And you learn way more about a country from one trip to the supermarket than you do from sitting by yet another cookie-cutter pool in some tropical resort.)
You might also find that a sort of inverse-keeping-up-with-the-Joneses sets in, even without moving. Sure, they've got all this cool stuff and a new Benz every year. But do they really get satisfaction from all that, driving to the office every day at age 52 (hmmm, Doc says it's almost certainly nothing but he still recommends a colonoscopy), 55 (Did you hear about Jerry in Finance? Dropped dead of a heart attack in a meeting. He was barely 10 pounds overweight, too), 58 (this knee is really not getting any better by itself, and they want me to tour five regional offices next month)? Imagine their faces when they drive home, exhausted, and you're sitting on the front porch with your second cocktail of the evening...