I've run into three kinds of people:
1) "How is it possible?" people. It doesn't matter how much they earn. Folks 10 years my senior, making high six and low seven figure salaries for a couple of decades, have asked me how I could possibly afford to leave work. Another told me, very sternly, that I should keep working so I can 'retire for real' someday - presumably to a rocking chair. These people tend to be the most openly hostile. While they think they'd like to do the same thing they ultimately aren't willing to make any sacrifices. They often wrongly assume that I haven't sacrificed either.
2) Puritanical work ethic people. Some have told me that work is a virtue. When I ask how working in finance, which produces no visible good to society - in pursuit of ever large piles of cash and things, is virtuous I'm always met with blank stares. I think there is an intuitive feeling among some people that suffering is good for your character. When I promise them I'll self flagellate instead of returning to work it doesn't seem to satisfy them, though.
3) "What will you do all day?" people. Some people can't imagine life without an overlord telling them how to spend their hours. They're not caught in the Matrix, they want to be there. They can't understand why anyone would ever leave.
One of the things I learned in college is that most of the great 'Romantic' poets, those who advanced the idea of breaking with societal norms, died early and miserably. Going your own way is hard, and standing out from the crowd often makes you a target. Your mere existence calls into question what everyone else takes as a matter of faith. It's not a path for everyone. And those who walk it should expect to be especially thick-skinned.
