Join Early Retirement Today
Reply
 
Thread Tools Display Modes
***** question about monte carlo versus historicals
Old 01-09-2015, 11:26 AM   #1
Recycles dryer sheets
 
Join Date: May 2014
Posts: 109
***** question about monte carlo versus historicals

I ran ***** with about $3MM in assets, SS for me and the spouse out a ways, $130k/yr spending, 36 year span, 50/50 stocks/bonds. I chose to run it using Historical Data - All Years. It came back at a 92.6% success rate.

Then I ran it using Monte Carlo. I just used the default values (6.4% equity gain/1% st dev, 1.8% bond gains/5.1% st dev). The success rate dropped all the way down to 40%.

I'm not smart enough to know what that means and if that means my plan is a bust. Can anybody help?
bulbar is offline   Reply With Quote
Join the #1 Early Retirement and Financial Independence Forum Today - It's Totally Free!

Are you planning to be financially independent as early as possible so you can live life on your own terms? Discuss successful investing strategies, asset allocation models, tax strategies and other related topics in our online forum community. Our members range from young folks just starting their journey to financial independence, military retirees and even multimillionaires. No matter where you fit in you'll find that Early-Retirement.org is a great community to join. Best of all it's totally FREE!

You are currently viewing our boards as a guest so you have limited access to our community. Please take the time to register and you will gain a lot of great new features including; the ability to participate in discussions, network with our members, see fewer ads, upload photographs, create a retirement blog, send private messages and so much, much more!

Old 01-09-2015, 11:28 AM   #2
Give me a museum and I'll fill it. (Picasso)
Give me a forum ...
Big_Hitter's Avatar
 
Join Date: May 2013
Location: Les Bois
Posts: 5,761
monte carlo simulation probably doesn't have mean reversion programmed - you can get some wacky results with monte carlos - even just going 10 years out
__________________
You can't be a retirement plan actuary without a retirement plan, otherwise you lose all credibility...
Big_Hitter is offline   Reply With Quote
Old 01-09-2015, 01:18 PM   #3
Full time employment: Posting here.
 
Join Date: Feb 2014
Posts: 731
Be sure to run any Monte Carlo sims several times as you can get a range of results.


If using MC, get an idea of the range of % success results - you can get a false sense of security if, by chance, you run it once and it shows 100% success, cuz the next time you run it, the results may be shockingly low.
BBQ-Nut is offline   Reply With Quote
Old 01-09-2015, 01:22 PM   #4
Recycles dryer sheets
 
Join Date: May 2014
Posts: 109
It's back to 97% success under MC. I had some large "other incomes" coming in one year later later in the simulation that I think screwed it up. I simplified it to just one portfolio in year 1 and MC always comes back over 90%
bulbar is offline   Reply With Quote
Old 01-09-2015, 01:57 PM   #5
Recycles dryer sheets
 
Join Date: Jun 2014
Posts: 406
I'd use Flexible Retirement Planner for MC simulations. It will run 2000 (I think) and give you the 10/90% bands as well as the number of times money actually ran out in those simulations and the %age in each year.
__________________
If money is the root of all evil I want to be a bad man
nuke_diver is offline   Reply With Quote
Old 01-10-2015, 03:54 AM   #6
Give me a museum and I'll fill it. (Picasso)
Give me a forum ...
 
Join Date: Jul 2005
Posts: 6,115
Quote:
Originally Posted by bulbar View Post
I ran ***** with about $3MM in assets, SS for me and the spouse out a ways, $130k/yr spending, 36 year span, 50/50 stocks/bonds. I chose to run it using Historical Data - All Years. It came back at a 92.6% success rate.

Then I ran it using Monte Carlo. I just used the default values (6.4% equity gain/1% st dev, 1.8% bond gains/5.1% st dev). The success rate dropped all the way down to 40%.

I'm not smart enough to know what that means and if that means my plan is a bust. Can anybody help?
the problem with historical is alot of it depends on time frames playing out in the same order.

each 30 year period is really dependent on exactly how the time frames before it and intersecting with it behaved.

as an example 1987 to 2003 saw the greates bull market ever . 17 years of almost 14% returns.

as pfau said "

Between 1926 and 2010, there are only 56 rolling 30-year periods. And as is about to be discussed, these 56 periods are not independent of one another. Meanwhile, it is not uncommon to see a Monte Carlo simulation study based on 10,000 simulated paths of financial market returns"


"because of the way that overlapping periods are formed with historical simulations, the middle part of the historical record plays an overly important role in the analysis. With data since 1926 and for 30-year retirement durations, 1926 appears in one rolling historical simulation, while 1927 appears in two (for the 1926 and 1927 retirees). This pattern continues until 1955, which appears in 30 simulations (the last year for the 1926 retiree through the first year for the 1955 retiree). The years 1955 through 1981 all appear in 30 simulated retirements"


wade pfau looked into this in one of his studies


http://wpfau.blogspot.com/2012/05/mo...istorical.html
mathjak107 is offline   Reply With Quote
Old 01-10-2015, 08:59 AM   #7
Give me a museum and I'll fill it. (Picasso)
Give me a forum ...
 
Join Date: Sep 2005
Location: Northern IL
Posts: 26,821
Quote:
Originally Posted by mathjak107 View Post
the problem with historical is alot of it depends on time frames playing out in the same order.

each 30 year period is really dependent on exactly how the time frames before it and intersecting with it behaved.

as an example 1987 to 2003 saw the greates bull market ever . 17 years of almost 14% returns.

as pfau said "

Between 1926 and 2010, there are only 56 rolling 30-year periods. And as is about to be discussed, these 56 periods are not independent of one another. ...
IMO, this is the value of historical analysis, not a problem at all. I don't think market cycles are independent, that's why they are called cycles, so why use a model that treats them as independent?

We get bubbles, bubbles burst. Bad periods followed by recovery. Recovery followed by a slow down. Of course, a 'near-end-of-the-world' type scenario could occur, and there would be no recovery (in our lifetimes at least), but you can only plan for so much before you decide to work until you die.

I think MonteCarlo is the problem - it does not account for these cycles, or does so artificially in some way often only known to the programmer (and maybe not even to the programmer).

An ironic justification of MonteCarlo is when it is mentioned that the results are in-line with historical analysis! Then why not just use the historical analysis?

-ERD50
ERD50 is offline   Reply With Quote
Old 01-10-2015, 09:28 AM   #8
Thinks s/he gets paid by the post
 
Join Date: Jan 2008
Posts: 1,495
Quote:
Originally Posted by ERD50 View Post

...

An ironic justification of MonteCarlo is when it is mentioned that the results are in-line with historical analysis! Then why not just use the historical analysis?

-ERD50
As I understand it, and someone correct me if I'm wrong, the reason for using MC with historical is to account for sequence of returns. Pfau, Cotton, or Kitces (or someone) talks about this somewhere but I'm too lazy to search for it . I think it was Pfau that talks about fat tails accounted for in MC simulations, but I'm not sure. Dirk Cotton addresses strategies for overcoming SOR risk here:

The Retirement Cafe: RIIA Webinar -- Sequence of Returns Risk

To all of this, I personally would never be comfortable with a mere 100% success rate in any calculator. All calculators I use provide for generous heaping of $$ left over at end of plan, aka, "padding" (in addition to the padding in my budget).

Remember, we are engineering for the absolute worst case scenario. RIP provides results accounting or average, below average, and signficantly below average (which I use), as does Financial Engines, which I use free through VG. ESPlanner, if you use the most conservative mode, can provide results for earning returns just keeping with inflation in Monte Carlo, or complete loss of risk assets in upside planning (I model both of these modes as they are the most conservative in ESP). Firecalc uses historical, while you can fiddle with ******** to produce all kinds of juicy results.

In all probability, if we model conservatively, we will probably have more money than we know what to do with in later years. Visited the folks over the holidays and this is precisely the "predicament" they are in.
Options is offline   Reply With Quote
Old 01-10-2015, 09:03 PM   #9
Recycles dryer sheets
robertf57's Avatar
 
Join Date: Jun 2014
Posts: 337
I find it intriguing how revered these probablaistic calculators seem to be. These are mere models of what we might expect. They are flawed from the outset in several important way:


1) They are based on historical data (either directly in historical methods or through estimating the paramets of a MC simulation)

2) That they don't model rational retiree behaviour. I don't think any reasonable person will continue to spend themselves into poverty as is depicted in these models.

These tools are rough measuring instruments. The give you some confidence that you are in the ballpark. Seeking 100% success in the model and lamenting anything less is a bit over the top IMHO. I rather like the idea of insuring your basic needs through pension/SS. etc as much as possible as the "padding" in the retirement plan and following a variable spending approach..
robertf57 is offline   Reply With Quote
Old 01-11-2015, 01:47 AM   #10
Give me a museum and I'll fill it. (Picasso)
Give me a forum ...
 
Join Date: Jul 2005
Posts: 6,115
you do not want to introduce the variables of spending patterns into the equation. then you cannot compare or identify mathamatically what any of the results mean.

it is spending patterns that can make things better while the numbers themselves are based ON WORST CASE SCENARIOS.

that is kind of like having a built in buffer for those big unexpected expenses.

the fact we do not generally need anywhere near all that inflation adusting every year as we age on top of human spending patterns that have us cuting back by comfort level when markets are down help imorove success rates.


if anything if we have average markets and inflation it will be a pleasent upside surprice instead of a big disapointment if we don't and possibly catastrophic consequences.
mathjak107 is offline   Reply With Quote
Old 01-11-2015, 11:34 AM   #11
Thinks s/he gets paid by the post
 
Join Date: Jan 2008
Posts: 1,495
Quote:
Originally Posted by mathjak107 View Post
you do not want to introduce the variables of spending patterns into the equation.

...
Yes you can, and many do:

Jonathan Guyton on Combining Dynamic Withdrawals and Dynamic Asset Allocation

******** just happens to provide an ability to model this type of spending approach, whereas FIRECAL does not.
Options is offline   Reply With Quote
Old 01-11-2015, 04:31 PM   #12
Give me a museum and I'll fill it. (Picasso)
Give me a forum ...
 
Join Date: Jul 2005
Posts: 6,115
the traditional studies did not take human spending into consideration.
many planners today use lifestyle planning . after taking the results from studies like the trinity software adjusts thing to fit your lifestyle.

want more early on for travel and less later? the sofware can give you a road map.
mathjak107 is offline   Reply With Quote
Old 01-11-2015, 06:12 PM   #13
Thinks s/he gets paid by the post
 
Join Date: Jan 2008
Posts: 1,495
Quote:
Originally Posted by mathjak107 View Post
the traditional studies did not take human spending into consideration.

...
This is known. In fact the author of either the original Trinity study or Bengan's follow up study (forget which) later advised that one should be flexible and not take inflation adjusted withdrawals blindly. And yes, ******** can model this and other spending approaches (I particularly like this feature). I agree with your excellent way (IMO) of viewing spending in your above post:

Quote:
it is spending patterns that can make things better while the numbers themselves are based ON WORST CASE SCENARIOS.

that is kind of like having a built in buffer for those big unexpected expenses.

the fact we do not generally need anywhere near all that inflation adusting every year as we age on top of human spending patterns that have us cuting back by comfort level when markets are down help imorove success rates.


if anything if we have average markets and inflation it will be a pleasent upside surprice instead of a big disapointment if we don't and possibly catastrophic consequences.
Options is offline   Reply With Quote
Old 01-11-2015, 07:59 PM   #14
Recycles dryer sheets
 
Join Date: Jan 2014
Location: St. Louis
Posts: 90
Where can I find *****?
Raymond01 is offline   Reply With Quote
Old 01-11-2015, 08:46 PM   #15
Recycles dryer sheets
 
Join Date: Mar 2014
Posts: 197
Quote:
Originally Posted by Raymond01 View Post
Where can I find *****?
Google would find it.

Here it is...
Crowdsourced Financial Independence and Early Retirement Simulator/Calculator
user5027 is offline   Reply With Quote
Old 01-11-2015, 08:46 PM   #16
Recycles dryer sheets
killingme's Avatar
 
Join Date: Apr 2013
Posts: 98
Quote:
Originally Posted by Raymond01 View Post
Where can I find *****?
There is a link at the bottom of this page to FIREcalc
killingme is offline   Reply With Quote
Old 01-12-2015, 08:59 AM   #17
Recycles dryer sheets
 
Join Date: Jan 2014
Location: St. Louis
Posts: 90
I had done a Google search but did not see it so thanks for the link.

I have used FIRECalc in the past, but ***** appears to be different.
Raymond01 is offline   Reply With Quote
Old 01-12-2015, 09:04 AM   #18
Give me a museum and I'll fill it. (Picasso) Give me a forum ...
REWahoo's Avatar
 
Join Date: Jun 2002
Location: Texas: No Country for Old Men
Posts: 50,004
Quote:
Originally Posted by Raymond01 View Post
I have used FIRECalc in the past, but ***** appears to be different.
You might find this interesting: http://www.early-retirement.org/foru...alc-73393.html
__________________
Numbers is hard
REWahoo is offline   Reply With Quote
Old 01-12-2015, 01:54 PM   #19
Thinks s/he gets paid by the post
 
Join Date: Jan 2008
Posts: 1,495
Thanks for the post, REW. I hadn't used ***** in a while, and when I went back to it, noticed it had improved a great deal. I believe the improvements in modelling were added after the 3/14 thread as I posted there and would have mentioned the improvements (which I really like), but did not at the time.
Options is offline   Reply With Quote
Old 01-15-2015, 03:46 AM   #20
Recycles dryer sheets
killingme's Avatar
 
Join Date: Apr 2013
Posts: 98
Quote:
Originally Posted by Raymond01 View Post
I had done a Google search but did not see it so thanks for the link.

I have used FIRECalc in the past, but ***** appears to be different.
Sorry Raymond , Crowdsourced Financial Independence and Early Retirement Simulator/Calculator , hope this is what you were looking for.
killingme is offline   Reply With Quote
Reply


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
Question on Firecalc Monte Carlo macnjus FIRECalc support 15 11-24-2006 11:17 AM
Monte Carlo question modlair FIRECalc support 2 05-26-2006 06:51 PM
monte carlo Mysto FIRE and Money 5 04-18-2006 06:34 PM
Monte Carlo now can be used by brokers newellcr FIRE and Money 3 02-18-2005 08:41 AM
Online Monte Carlo calculator RoyUtah FIRE and Money 5 01-18-2004 01:41 AM

» Quick Links

 
All times are GMT -6. The time now is 05:14 PM.
 
Powered by vBulletin® Version 3.8.8 Beta 1
Copyright ©2000 - 2024, vBulletin Solutions, Inc.