Yes, that is the core dilemma. But there are solutions:
First, thank you for the thoughtful reply. If any of my responses below look like rebuttals, I'm not trying to be argumentative. This is just the method that I often use for grappling with challenging questions.
1. Are you fundamentally disaffected by the idea of full-time work, or is it more a case of wishing to feel like a classical aristocrat, for whom employment is a gentleman's occasional hobby? If the former, then retire as soon as pecuniary considerations allow. If the latter, then OMY isn't so nettlesome.
Mostly we're starting to feel burned out, and stressed about w*rk more frequently. I could easily imagine taking on some sort of low-stress PT w*rk in the future to stave off boredom (should that manifest), ease concerns about a prolonged down market, get health insurance if ACA goes sideways, etc. I could also imagine pursuing a small side hustle related to one of my hobbies.
2. Are you already settled in your eventual retirement location? If so, then again OMY is fine. Why? Because you are already "there", where you're going to be.
We are very likely where we intend to stay indefinitely. Future state tax policy changes could cause us to reconsider, but otherwise we're happy where we are. This doesn't seem like a good reason to OMY to me though. It's frustrating to have our time constrained by j*bs, regardless of where we are.
3. Do you foresee any future scenario where you'd like to return to work?
Full-time? I really don't think so. The only way I see that happening is if I find a passion project that turns into something I get paid for. But regular, full-time employment where I don't have nearly full autonomy? That's the opposite of what I want.
4. Have you formed an engaging life outside of w*rk? If not, do OMY while you figure that out.
Not really, but I put a lot of the blame for that on my j*b for leaving me stressed out and tired even when I'm not w*rking. I can think of a thousand things I'd rather be doing than w*rking, from puttering around the garden, to hiking with my wife and/or kids, to baking a loaf of sourdough every day, to tackling my backlog of unread books, to going out for a coffee and a stroll on a nice day, to continuing my heretofore fruitless pursuit of playing guitar halfway decently before arthritis makes it too painful, to finally organizing the garage and basement...etc. Maybe that doesn't sound particularly engaging to some people, but I guess I'm mostly satisfied with simple things.
Here's the best part: you're only 50! You can spin the OMY hamster wheel for another 5-7 years, and still be able to proudly say that you've retired early!
I acknowledge that retiring well before sixty, likely with top 1 percentile retirement assets, is still an excellent result. Yet to me the opportunity cost is wasting of my remaining prime years. I view hanging on until 55 for easier access to pre-tax savings as the worst realistic case scenario for us.