SG, you seem like a smart guy, so I'm curious about something. How can you use FIREcalc with even a smidgen of confidence knowing that for your term of interest (presumably 30 years), there are only 4 independent (i.e., non-overlapping) data subsets in the data set?
In my case, I'd have to guess that either my wife or I will live another 50 years, in which case relying on historical data only two "epochs" deep seems like folly.
A lot can happen in 50 (or even 30) years, including events that might make the Great Depression look like a party. How can anybody, especially somebody with a background in archaeology, think that the worst is behind us?
First, I have not defended the 4% result of the FIRECALC simulator in a single one of my posts. Come on, guys, read them. I simply point out the logical and mathematical conclusions you have to come to in order to be consistent. If you don't like 6.2% today, then you better re-think 4.1% ever. There seem to be a lot of posters on this board who want to believe in a 4% SWR while not believing that amt came to a logical conclusion. People should re-think that position because it makes no sense.
Now . . . regarding other points in your post:
I don't have that much confidence that the worst is behind us. I can believe we'll see some period in the future that is as difficult to overcome as either the 1929 - 19xx period or as difficult as the 1965 - xxxx period. It could be the period that began in 2000, but I certainly haven't seen any quantifiable argument that leads me to believe that is a high probability. And if the period that began in 2000 is going to be worse than anything in the past, how much worse should we expect? 10%? 20%? 50%? I don't hear anyone providing quantifiable answers. In general, I have seen no analysis by anyone that would lead me to believe that they might be able to predict how much worse the next 40+ years is going to be than the two worst cases we've seen so far.
From a mathematical perspective, the number of independent data sets is of little concern to me. If I want to empirically answer the question, "What is the minimum number of heads I will see if I flip a coin 30 times in a row?" I don't need to start 100 different series of 30 tosses (ie. 3000 tosses) to answer the question. I can simply flip the coin 130 times and look at the 100 different series of 30 that are represented in those tosses. Of course the correct answer to the coin toss question is "zero" -- a result that you would have a very small probability of ever seeing in practice (forgive me if I don't compute the odds against seeing that event). And the same is true for SWR. No SWR is guaranteed.
But even more important, if I had more data, I question it's value. Based on all the law and regulation changes that took place after the Great Depression, I question how valid pre-1929 data is to my situation toady. Do you really want to trust your retirement on calculations dating to the Paleolithic Period?
So we all agree that you could retire using a result from a historical simulation and still run into trouble. Now what do you suggest we do? Here are some choices:
Should we comitt suicide? This insures that any withdrawal rate is safe for us.
Should we just arbitrarily decide that 6.2% today sounds unreasonable to us and use faulty logic to back up our decision? Meanwhile we can steadfastly believe in the 4.1% SWR and ignore the inconsistency in our logic.
Should we develop new models based on unproven hypothesis and shaky mathematical analysis and believe in them? If no one has bothered to prove the new models wrong yet, maybe they're right.
Should we throw out all of the complex correlations built into historical data sets and trust arbitarily calibrated monte carlo simulations?
My answer is that we should make every effort to understand the implications and limitations of all the models available to us. I think once you've done that, you decide that if you start with a generous post-retirement budget (one you can cut back on if you need it), plan for a long life, discount your social security benefits, choose a reasonable allocation plan, and keep your initial withdrawal rate a little below 4%, you are probably going to be okay.