|
|
Study Questions Retirement Calcuators
02-20-2016, 02:50 PM
|
#1
|
Recycles dryer sheets
Join Date: May 2015
Location: NorCal
Posts: 333
|
Study Questions Retirement Calcuators
In today's (2/20/16) print version of the WSJ - Study Questions Retirement Calculators
"...A new academic study of 36 such tools - many of them widely used - concludes that "in most cases, the available offerings are extremely misleading" and generally not helpful to consumers trying to figure out if they will have enough money to cover their expenses for the rest of their lives...The study was conducted by three researchers at Texas Tech University, including well-know financial adviser Harold Evensky...The researchers didn't identify the 11 tools that passed their test..."
Too late. I'm already out of the rat race...
New Study Questions Retirement Planning Calculators’ Accuracy - WSJ
|
|
|
|
Join the #1 Early Retirement and Financial Independence Forum Today - It's Totally Free!
Are you planning to be financially independent as early as possible so you can live life on your own terms? Discuss successful investing strategies, asset allocation models, tax strategies and other related topics in our online forum community. Our members range from young folks just starting their journey to financial independence, military retirees and even multimillionaires. No matter where you fit in you'll find that Early-Retirement.org is a great community to join. Best of all it's totally FREE!
You are currently viewing our boards as a guest so you have limited access to our community. Please take the time to register and you will gain a lot of great new features including; the ability to participate in discussions, network with our members, see fewer ads, upload photographs, create a retirement blog, send private messages and so much, much more!
|
02-20-2016, 03:06 PM
|
#2
|
Thinks s/he gets paid by the post
Join Date: Apr 2005
Location: Midwest
Posts: 2,968
|
Quote:
Originally Posted by FIREd_2015
In today's (2/20/16) print version of the WSJ - Study Questions Retirement Calculators
"...A new academic study of 36 such tools - many of them widely used - concludes that "in most cases, the available offerings are extremely misleading" and generally not helpful to consumers trying to figure out if they will have enough money to cover their expenses for the rest of their lives...The study was conducted by three researchers at Texas Tech University, including well-know financial adviser Harold Evensky...The researchers didn't identify the 11 tools that passed their test..."
Too late. I'm already out of the rat race...
New Study Questions Retirement Planning Calculators’ Accuracy - WSJ
|
Wouldn't this undermine the entire concept of 401k's and related retirement veehickles?
|
|
|
02-20-2016, 03:08 PM
|
#3
|
Thinks s/he gets paid by the post
Join Date: Mar 2009
Posts: 2,985
|
Too late here also. Now that I've given notice the last thing I need is to find out the calculators I've used are suspect. I figured it out for myself for the last 38 years, hopefully I'll still be able to do the math myself in the future.
__________________
Took SS at 62 and hope I live long enough to regret the decision.
|
|
|
02-20-2016, 03:10 PM
|
#4
|
Give me a museum and I'll fill it. (Picasso) Give me a forum ...
Join Date: Nov 2010
Location: Sarasota, FL & Vermont
Posts: 36,358
|
That's interesting in that when I was deciding to retire I ran just about every calculator that I could find with as close to the same assumptions that I could since they each ask for different inputs and the results didn't seem that different to me.... all gave me different versions of a green light.
IIRC others have had similar experience. If that is so, how could this study conclude they are generally misleading and unuseful?
Edited to add: just found the study... need to read http://papers.ssrn.com/sol3/papers.c...act_id=2732927
__________________
If something cannot endure laughter.... it cannot endure.
Patience is the art of concealing your impatience.
Slow and steady wins the race.
Retired Jan 2012 at age 56
|
|
|
02-20-2016, 03:36 PM
|
#5
|
Recycles dryer sheets
Join Date: May 2015
Location: NorCal
Posts: 333
|
Quote:
Originally Posted by pb4uski
|
Thanks for finding the study!
|
|
|
02-20-2016, 03:37 PM
|
#6
|
Give me a museum and I'll fill it. (Picasso) Give me a forum ...
Join Date: Nov 2010
Location: Sarasota, FL & Vermont
Posts: 36,358
|
Don't bother. This is an idiotic study. The authors seem to think that whether one is a smoker or non-smoker is important variable. Reading between the lines it seem they think the planning time horizon should be commensurate with health and since smoking has an impact on health then it is important to the retirement planning time horizon. However, there are many very old smokers out there who defy the odds.... including my 85 yo DM.
Am I misreading it? I concede that I just breezed through it but I'm not about to waste time on something so preposterous.
Quote:
We find it interesting that “smoker vs. non-smoker” fell outside the “important” or higher importance classifications given the overwhelming evidence in empirical research of the strong negative impact smoking has on an individual’s longevity. In addition, Figure three shows that there is a noticeable gap in responses for the “smoker vs. non-smoker” and “personal health” variables among financial planning professionals. In aggregate, 43% of the respondents believe the variable “personal health” is “extremely important,” compared to 28% of the respondents believe it is “important,” one level from being classified as “not applicable.” In contrast, 45% of the respondents believe a tobacco use variable, such as smoker vs non-smoker, is “important” with only 29% of the respondents believing it is “extremely important.” Given the significant potential impact on mortality estimates, we are surprised that three times as many respondents believe a tobacco use variable is “not applicable” to building a retirement plan, as compared to respondents indicating “personal health” is “not applicable.” We wonder if the respondents considered the “personal health” variable a more inclusive variable.
|
__________________
If something cannot endure laughter.... it cannot endure.
Patience is the art of concealing your impatience.
Slow and steady wins the race.
Retired Jan 2012 at age 56
|
|
|
02-20-2016, 04:01 PM
|
#7
|
Thinks s/he gets paid by the post
Join Date: Jul 2004
Posts: 1,434
|
Yea, you can look at all these calculators alone. I choose to believe the sigma/sqrt(N) sort of stuff. So if they all give me a good retirement prospectus, the final distribution of my retirement prospect is quite narrow (or so I choose to believe until any opposing real data comes along and then it will be a bit too late).
|
|
|
02-20-2016, 04:49 PM
|
#8
|
Give me a museum and I'll fill it. (Picasso) Give me a forum ...
Join Date: Jul 2006
Posts: 11,401
|
I quickly scanned the research paper. My first question was "what's the gold standard?". Of course, it would be outcomes, i.e. portfolio survival of a large cohort of retirees over decades, compared with predicted results from the calculators prior to retirement. Obviously, that would be impossible to study at this time.
The methodology the authors used was to review the inclusion of predictive data inputs in the various calculators. They focus on retiree-specific variables (age, income, assets are categories). Inflation, stock and bond return rates are also considered. Many of the calculators tested did not include variables that have been predictive in previous research and that the authors and a group of FAs considered important.
They then designed a specific marginal scenario and ran it through all the calculators. The results were wildly inconsistent. It is not clear how much of the inconsistency was due to variation in input variables or variation in calculator algorithms.
FireCalc was among the calculators tested, but is not listed in the final table, so it is not possible to review its performance in the study. Omission of data from the results makes me concerned.
The conclusion is that the design of publicly available calculators needs to be improved to avoid leading people astray. This makes sense to me. Retirement calculators are relatively recent innovations and will continue to evolve. In particular, their predictive values need to be validated with post hoc data. While it is not perfect, I do think this was a worthwhile study, if only to remind us not to encourage someone to ER just because "FireCalc says you're good to go".
|
|
|
02-20-2016, 05:06 PM
|
#9
|
Thinks s/he gets paid by the post
Join Date: Feb 2007
Posts: 2,525
|
During the mid to late 1990's when I first started thinking about ER I ran the calculators available at that time and I also got financial plans from a couple of independent Financial advisor’s at Ernst & Young and such, At the time they all said I was good to go and I ER'd end of 2002 at 52. Surprisingly, the most accurate forecast so far is one I ran in 1996 using QFP which back then had my liquid NW 20 years latter (in 2016) within 10% of what it actually is. I hope it continues to be accurate because it shows some very nice numbers for the 30th and 40th anniversaries...
|
|
|
02-20-2016, 05:10 PM
|
#10
|
Thinks s/he gets paid by the post
Join Date: Mar 2015
Location: philly
Posts: 1,219
|
So let's see....
1) financial advisers lead people astray
2) calculating tools lead people astray
3) most Americans are financially illiterate and don't know enough on their own.
Let's see if I save money, stress from above, If I don't save any money stress that I can never retire.
I'm a newbie at this and in the 16 months I've been preparing myself (or at least attempting to) I think I've figured it out. Just like the latest food warnings, no matter what I do, if I wait long enough some one will come along and tell me to start worrying because it's wrong.
Glad I'm going to Vegas next month, think I'll upgrade my hotel to a suite and start enjoying spending. lol, at least when someone says it's wrong I can say I had a good time.
Jeez
|
|
|
02-20-2016, 05:51 PM
|
#11
|
Give me a museum and I'll fill it. (Picasso) Give me a forum ...
Join Date: Nov 2010
Location: Sarasota, FL & Vermont
Posts: 36,358
|
Quote:
Originally Posted by ejman
During the mid to late 1990's when I first started thinking about ER I ran the calculators available at that time and I also got financial plans from a couple of independent Financial advisor’s at Ernst & Young and such, At the time they all said I was good to go and I ER'd end of 2002 at 52. Surprisingly, the most accurate forecast so far is one I ran in 1996 using QFP which back then had my liquid NW 20 years latter (in 2016) within 10% of what it actually is. I hope it continues to be accurate because it shows some very nice numbers for the 30th and 40th anniversaries...
|
Your post caused me to go back and look at my actual to expected. My end of 2015 portfolio value is 17% higher than what I expected when I retired at the end of 2011, totally due to better than expected investment returns (9% vs 5%).
__________________
If something cannot endure laughter.... it cannot endure.
Patience is the art of concealing your impatience.
Slow and steady wins the race.
Retired Jan 2012 at age 56
|
|
|
02-20-2016, 05:55 PM
|
#12
|
Moderator
Join Date: Apr 2012
Location: San Diego
Posts: 14,211
|
This study definitely seemed biased or incomplete. As pb4uski pointed out - they seemed obsessed with tobacco use and it's impact on longevity... But most calculators don't predict how long you'll live. For example Firecalc asks you to input the length of retirement (putting the burden on the user... )
I would have liked to see the scenario data and results from the 36 calculators. It wasn't there.
Folks on this board tend to be fairly well educated about the possible pitfalls of most retirement plans and take steps to mitigate - or at least consider the steps they might take if needed. I suspect that the vast majority of folks not on this board do not have the knowledge, understanding, or really care that much about these nuances... and if their simple calculator or 4% rule of thumb says they are good to go, they figure they are good to go.
__________________
Retired June 2014. No longer an enginerd - now I'm just a nerd.
micro pensions 6%, rental income 20%
|
|
|
02-20-2016, 05:56 PM
|
#13
|
Give me a museum and I'll fill it. (Picasso) Give me a forum ...
Join Date: Aug 2013
Location: Texas
Posts: 10,929
|
I "pity the fool" who would retire solely based on one or more of these on-line calculators (including FIREcal). I think many are interesting and fun to use, however, I actually trusted my custom spreadsheets and common sense a lot more to help me make my decision to retire.
|
|
|
02-20-2016, 09:45 PM
|
#14
|
Recycles dryer sheets
Join Date: Jul 2013
Posts: 271
|
I hope you are being sarcastic and not calling a lot of people fools.
I "pity the fool" who would retire solely based on one or more of these on-line calculators (including FIREcal).
|
|
|
02-21-2016, 05:37 AM
|
#15
|
Give me a museum and I'll fill it. (Picasso) Give me a forum ...
Join Date: Jan 2008
Location: NC
Posts: 21,298
|
That was pretty vague and therefore useless. Some retirement calculators are misleading (definitely true, they're pretty easy to recognize), so you can't trust any of them. Thanks for the thoughtful insight.
Some Company ABC retirement calculators are black boxes that don't reveal underlying assumptions and their purpose is to sell you Company ABC investments and/or financial advice - really, isn't that shocking! Anyone who plugs in a few numbers without any idea what the underlying assumptions and calculations are, and believes the output is an idiot. Caveat emptor.
They list a bunch of calculators in Appendix A, but never provide any indication re: how useful any of them are/aren't. The results are highly variable, so you can't trust any of them. That would be like Consumer Reports testing all automobiles, finding some more reliable than others, and concluding you can't rely on cars. Huh?
And they say you can't rely on financial advisors either.
So work until you drop? Or take up smoking?
I guess if your a smoker you probably have enough, and if you're not you'll probably outlive your nest egg.
The paper wasn't at all value added for me. YMMV
__________________
No one agrees with other people's opinions; they merely agree with their own opinions -- expressed by somebody else. Sydney Tremayne
Retired Jun 2011 at age 57
Target AA: 50% equity funds / 45% bonds / 5% cash
Target WR: Approx 1.5% Approx 20% SI (secure income, SS only)
|
|
|
02-21-2016, 07:15 AM
|
#16
|
Thinks s/he gets paid by the post
Join Date: Feb 2014
Location: Williston, FL
Posts: 3,925
|
I had to re-read the study. A lot what was said had to do with user input. Some people did not know how to input the data, some calculators did not allow enough data, and smokers die faster. I also got the impression they were advocating for pensions.
Conclusion, There is no 100% way to predict what will actually happen.
At the end is a great list of calculators all with hyperlinks. I tried out a few, and they are basically the same. If that is all you get out of this study, it is worth it.
You can use historical results (FireCalc), you can use Monte Carlo, straight-line, and some sort of blend. There really is not much else.
I tried numerous calculators over the past few years, and none can tell me with 100% certainly I will be OK. They might give a statistical probability of 100%, but no one can ever say until the absolute end, "It worked". It is a leap of faith, similar to getting in your car and expecting to arrive back at home in one piece.
__________________
FIRE no later than 7/5/2016 at 56 (done), securing '16 401K match (done), getting '15 401K match (done), LTI Bonus (done), Perf bonus (done), maxing out 401K (done), picking up 1,000 hours to get another year of pension (done), July 1st benefits (vacation day, healthcare) (done), July 4th holiday. 0 days left. (done) OFFICIALLY RETIRED 7/5/2016!!
|
|
|
02-21-2016, 07:23 AM
|
#17
|
Give me a museum and I'll fill it. (Picasso) Give me a forum ...
Join Date: Nov 2010
Location: Sarasota, FL & Vermont
Posts: 36,358
|
I had not noticed the hyperlinks.... most useful part of the document IMO.
I did notice that they put in only partial information on their test scenario so readers could not try to replicate their results.
__________________
If something cannot endure laughter.... it cannot endure.
Patience is the art of concealing your impatience.
Slow and steady wins the race.
Retired Jan 2012 at age 56
|
|
|
02-21-2016, 07:57 AM
|
#18
|
Moderator
Join Date: Oct 2010
Posts: 10,723
|
Quote:
Originally Posted by Meadbh
The conclusion is that the design of publicly available calculators needs to be improved to avoid leading people astray. .
|
Quote:
Originally Posted by Midpack
Some Company ABC retirement calculators are black boxes that don't reveal underlying assumptions and their purpose is to sell you Company ABC investments and/or financial advice - really, isn't that shocking!
|
Even if there's pages of assumptions associated with the calculator, if it just spits out "an answer", I'm going to be at least a bit skeptical. It would be better if I could download balances and flows year by year to see what it actually did. I'm sure there are calculators out there that have huge bugs that will never be found since we have only a black box / can only see the input and output, nothing in between.
|
|
|
02-21-2016, 08:09 AM
|
#19
|
Give me a museum and I'll fill it. (Picasso) Give me a forum ...
Join Date: Jan 2008
Location: NC
Posts: 21,298
|
Quote:
Originally Posted by sengsational
Even if there's pages of assumptions associated with the calculator, if it just spits out "an answer", I'm going to be at least a bit skeptical. It would be better if I could download balances and flows year by year to see what it actually did. I'm sure there are calculators out there that have huge bugs that will never be found since we have only a black box / can only see the input and output, nothing in between.
|
FIRECALC will return year by year results FWIW. Though it's still difficult to recreate what happens in the black box.
There is no perfect retirement calculator or advisor, and never will be. You look at historical results, and make your own judgement re: how that will fare over the course of your retirement. It's up to you to factor in input variables, probabilities, etc. GIGO
__________________
No one agrees with other people's opinions; they merely agree with their own opinions -- expressed by somebody else. Sydney Tremayne
Retired Jun 2011 at age 57
Target AA: 50% equity funds / 45% bonds / 5% cash
Target WR: Approx 1.5% Approx 20% SI (secure income, SS only)
|
|
|
02-21-2016, 08:21 AM
|
#20
|
Moderator
Join Date: Oct 2010
Posts: 10,723
|
Quote:
Originally Posted by Midpack
FIRECALC will return year by year results FWIW. Though it's still difficult to recreate what happens in the black box.
|
I think there's a spreadsheet 'out there' that has the same premise as FIRECalc and can be used to get at least roughly the same result. I've made a spreadsheet that validates i-orp output, given what it decided to do, flow-wise. So yeah, there are a few that lend themselves to sanity checking. I trust those more than a black box.
|
|
|
|
|
Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
|
|
Thread Tools |
|
Display Modes |
Linear Mode
|
Posting Rules
|
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
HTML code is Off
|
|
|
|
» Recent Threads
|
|
|
|
|
|
|
|
|
|
|
|
|
» Quick Links
|
|
|