OP,
What is your mortgage balance? I personally would be more comfortable if I had no mortgage before I entertain the thought of retiring. It would reduce your expenses to ~$73K from $90K.
I would work for 3 to 5 more years and reevaluate if the job is not stressful and killing you.