You are doing great. Being able to put away close to 50k per year is impressive. However, ER at 40, may be risky as the math won't add up (unless you somehow double your savings rate). I think 50, at the earliest, would seem possible.
As a family, I'm not sure you can lower your yearly...