I understand the challenge. I would absolutely retire from your primary job. Is being a part-time charter pilot an option for you? I know very little about the industry, but it seems like that would be a little less stressful with lower pay,
I don't have any suggestions regarding the house...