I was there. I retired at 55 (last year) and had a lot of concerns that it was the right thing to do. Like you, finances were not really a concern for me, it was something else — heading off into the unknown and releasing myself from a career of multiple degrees, certifications, long hours...