Best of Frank: The Efficient Market Theory Hoax

[I'm off this week, enjoying the waning days of summer and catching up on a few things I promised to finish before September. In the meantime, please enjoy this example of that great American summer tradition, reruns. This post originally ran May 26, 2009.]

 

You may have heard of something called the Efficient Market Theory.  If you did, it was almost certainly in a negative context, some writer or blogger excoriating those egghead finance professors for confusing the world with NYSE-floor their crazy and dismal theories. This is a rant mostly heard from the advocates of investing in individual stocks, but is also found occasionally in the arguments of those in favor of active funds over passive (index) funds and market timing over passive asset allocation.

Apparently, this poisonous heresy has been spread by overly educated academics near and wide for decades.  They convince their innocent students that it is categorically impossible to make money picking stocks, that anybody who does anything other than buy an index fund is a fool.  It’s a viewpoint that is not just wrong, it’s dismally pessimistic and, let’s face it, simply un-American.

Funny thing, though. I actually took finance courses from those egghead professors in college and B-school.  I don’t remember an “Efficient Market Theory” being discussed.  I still have my old textbooks.  No index entry for it.  It does appear in the index for Burton Malkiel’s A Random Walk Down Wall Street, a million-seller often described as the chief popularizer of this apostasy. That entry reads “efficient-market theory, see random-walk theory.”  And if you look that up you find out that Malkiel isn’t a true believer after all. “I still worry about accepting all the tenets of efficient-market theory, in part because the theory rests on several fragile assumptions.”

Now, I do remember that in some of those finance classes I took there was a lot of talk about the Efficient Markets Hypothesis, or EMH.  That’s in the index of most of the old textbooks.  It may sound trivial, but the difference between a hypothesis and a theory is, at least in this case, quite significant.

EMH was conceived as a null hypothesis in the 1950s and 60s. On the slim chance that you are unfamiliar with the term, I will summarize. A null hypothesis is a reasonable, obvious, and often naive interpretation of data to explain what is going on.  You invent it as the alternative to the new clever theory you are trying to test.  “The Earth is flat” and “heavier objects fall faster than lighter ones” are examples of great null hypotheses from history.  A key thing to remember about null hypotheses is that they do not need to make sense in the big picture, they exist only as simple explanations that can be disproven to justify more complex ones.  The Earth is flat has a lot of issues as a theory, e.g. what happens at the edge and how the objects in the sky work, but it is largely consistent with ordinary daily experience.

EMH states that stock prices reflect all available information at any given point in time.  Stock prices instantly change to reflect new information as it arrives and those changes will by definition be unpredictable and random, because anything that could have been anticipated would have already been baked into the previous price. As a result, you cannot make money picking stocks.

It’s not clear that when EMH was born any serious researcher believed it as a theory of how the real world worked.  It was thought up as a straw man against which it could be proved that you could indeed make money picking stocks, particularly with some “technical” and “chartist” theories that were then popular and, with the advent of computers, could for the first time be tested methodically.

But when the professors used the computers to look at the data, EMH turned  out to be very very hard to defeat with statistical significance.  In fact, it would be decades before it would be done conclusively.

This simple empirical observation, that stock prices appear to be unpredictable and random and that it is (almost) impossible to demonstrate any way in which they are not random, had far-reaching and profound implications.  The most important one with regard to our understanding of finance is that you can model the movement of stock prices as if they were random walks.  Just about all the useful stuff to come out of 20th Century financial theory was based on this trick, including our understanding of how to diversify portfolios and value options and other derivatives.

But as useful as EMH is as an assumption, it is lousy as a grand theory of how the stock market, or other financial markets, work.  Like the Flat Earth Theory, it collapses in on itself if you think about it too carefully.  Any explanation of how EMH could be true has to start with lots of clever stock traders that collectively find the perfect, all information reflected, true price. As new information arrives, those traders instantly move the price appropriately.  And how does that dynamic work?  How do those traders wind up with the right price? There must be an economic reward given to the smart traders for getting the price right and a penalty for getting it wrong.  In other words, it must be that some traders make money picking stocks, which violates EMH.

So even though they may appear to be random, for some traders some of the time, stock price movements are not actually random but are at least mildly predictable. To use a possibly strained sports analogy, the flurry of gestures the catcher makes tells the pitcher what to throw, but are presumably meaningless to the runner on second. To the runner, even though he knows the signals are meaningful to the pitcher, they can best be considered random noise.

Thoughtful people who understand the stock market don’t say that it can’t be beaten, they say it is very hard.  So hard, in fact, that it is unwise for all but a few to even try.  This got simplified by less thoughtful people as a belief that the market was perfectly efficient and that all market outperformance, even by Warren Buffet, was due to random chance.

The difference between stock price movements being actually random and might-as-well-be random may seem academic, but is not.  Firstly, the arguments made by advocates of stock picking against the Efficient Market Theory should impress no one.  Just because it makes no sense that beating the market is fundamentally impossible, it is not true that anybody can beat the market.

Secondly, while the evidence around EMH makes a good argument that an individual investor should not expect to successfully pick stocks, it does not follow that there do not exist professionals who can beat the market.  Arguing, as many do, that investing in an active fund is pointless because all fund managers are the equivalent of monkeys throwing darts is specious.  (On the other hand, the analogous argument that an individual investor is unlikely to be able to separate the monkeys from the geniuses, i.e. that picking mutual funds is no easier than picking stocks, has more than a little merit.)

And finally, it is worth observing that for many advocates of passive investing, their belief in the efficiency of markets is (appropriately) shallow and limited.  It is quite common, for example, and I think John Bogle subscribes to this, to believe in equity index funds but to advocate very large allocations to equity as an asset class, in some cases approaching 100%.  This is not consistent with a belief in efficient financial markets.

Allocating most of your money to stocks is itself an active decision that only makes sense if you believe that stocks as an asset class are cheaper than they should be.  If you thought the markets were perfect then you would assume that all asset classes, stocks, bonds, real estate, gold, etc., were priced such that on a risk-adjusted basis they all had the same expected future return.  Putting all or nearly all of your money in one class would then make no more sense than putting it all into a single stock.  You would get no improvement in risk-adjusted expected return, since that is impossible, but would greatly increase the risk you were taking on.

That’s not an unreasonable argument, and one that is perfectly consistent with Efficient Market Theory as I understand it. And yet I’ve never heard it anywhere.  Is it possible that this great and sinister theory isn’t quite as widespread as its detractors claim?

31 Comments

  • By Ron, August 26, 2009 @ 12:17 pm

    Burton Malkiel actually admitted in an interview that he believed markets were efficient over the long run, but “they do go crazy from time to time.”

    http://www.pbs.org/wsw/tvprogram/malkiel_interview.html

    He seems to believe the market is efficient … except when it’s not.

    Story: one afternoon at a prestigious university, an economics professor who firmly believed in EMT walked down a path with one of his graduate students, when they both saw a $100 bill lying on the ground. The student started to pick it up but his professor stopped him. “Don’t worry with it,” the professor sighed, “if it REALLY were a $100 bill, someone else would have already picked it up.”

  • By Jim, August 26, 2009 @ 2:19 pm

    The efficient market hypothesis only says that, after expenses, your expected performance using only publicly available information will be less than that of the market on a risk-adjusted basis. This is very difficult to disprove statistically. A few people will outperform consistently for a long period of time because they combine occasional good luck with discipline, but others who are just as intelligent and disciplined will under-perform. It is therefore a superior strategy for the investor who does not have access to special information to focus his energy on the discipline side (e.g., mechanical re-balancing to maintain an diversified asset allocation) while the people chasing the market buy high and sells low.

  • By Jim, August 26, 2009 @ 2:37 pm

    Also, the EMH doesn’t say that markets are rational. Markets are frequently irrational, which makes predicting their behavior difficult even when you do have superior knowledge, and they can stay irrational longer than you can remain solvent. Furthermore, everyone else in the market is trying to behave rationally, so why would you expect to do better?

    A consequence of the EMH is that the only consistent way to make money picking stocks is to sell your advice to other investors and hope they don’t keep close tabs on your performance.

  • By Retirement Savior, August 29, 2009 @ 11:33 pm

    I would view the EMH and the MPT as just supporting the idea that diversification is the only free lunch than an investor can get. So beyond 9-10% nominal returns and around 11% standard deviation for a portfolio, the expertise and work involved will have to increase to gain any outperformance.

  • By mc, November 13, 2010 @ 10:24 pm

    A good definition of “null hypothesis” is that it’s something you know is too simple, and you want to use it as a starting point, to measure how much the real world differs from it.

  • By Doups, May 17, 2023 @ 3:37 pm

    With 7780+ free slots online to choose from here at VegasSlotsOnline, you might be wondering where to begin. We’ve gathered our favorite titles below, so that you can get started in no time with our best five free slots no download games: The brain uses the inner ear, wooden building. Play slots games for free online these run diagonally, which. They know if they don’t that they’ll do their reputations and their new signups serious damage, it may randomly trigger the Jackpot Bonus game. Word Search Puzzles will also work on your other iDevices, look at the games that they offer and that there is enough choice for you. It does not offer sportsbook betting rewards, when available. Landing 2 to 5 of the Pharaohs on the betway triggers a pout from 50 to 20,000 coins, offer the same terms.
    http://www.gbuav.co.kr/bbs/board.php?bo_table=free&wr_id=41662
    All sweepstakes and social casinos offer players the opportunity to play for free without making purchases. Here, you can discover what bonuses you can claim as a new player with the top three online casinos in FL. Online poker is not permitted under Florida state law at this time and the political will to legalize it isn’t very strong. In fact, language that would’ve allowed online poker (and other online gambling) in the new gaming compact was stripped to ensure it passed through the state legislature. An official website of the United States government Online lottery sales also benefitted from the Department of Justice’s 2011 Wire Act opinion. Since then, several states have legalized online lottery sales, with more considering the practice. As of February 2023, six states have fully legal online lottery sales, including Illinois, Michigan, Kentucky, Georgia, Pennsylvania, and New Hampshire, while some others allow individuals to set up lottery subscriptions online.

  • By Строительная чешуя, June 25, 2023 @ 5:48 pm

    I don’t even know how I ended up here, but I thought this post was good. I don’t know who you are but definitely you are going to a famous blogger if you are not already ;) Cheers!

  • By vammebel.ru, June 26, 2023 @ 9:46 am

    I for all time emailed this webpage post page to all my friends, as if like to read it then my links will too.

  • By spravki-kupit.ru, June 26, 2023 @ 3:12 pm

    купить медицинскую справку

  • By купить диплом стоматолога, June 27, 2023 @ 10:07 am

    Thank you for the auspicious writeup. It in fact was a amusement account it. Look advanced to far added agreeable from you! By the way, how can we communicate?

  • By Professor Smith, June 27, 2023 @ 10:24 am

    It’s in point of fact a nice and helpful piece of information. I’m glad that you shared this helpful info with us. Please stay us informed like this. Thanks for sharing.

  • By накрутка яппи, July 30, 2023 @ 7:14 am

    My brother suggested I might like this blog. He was totally right. This post actually made my day. You cann’t imagine just how much time I had spent for this information! Thanks!

  • By smartremstroy.ru, August 1, 2023 @ 5:42 am

    Ahaa, its pleasant discussion about this article here at this webpage, I have read all that, so now me also commenting here.

  • By daachnik.ru, August 2, 2023 @ 1:17 am

    Your way of describing all in this post is in fact good, all be able to effortlessly understand it, Thanks a lot.

  • By delaremontnika.ru, August 2, 2023 @ 3:12 pm

    Hi there! I just would like to give you a huge thumbs up for the great info you have here on this post. I’ll be coming back to your site for more soon.

  • By химчистка матраса жодино, September 2, 2023 @ 12:56 pm

    Howdy! I could have sworn I’ve been to this blog before but after reading through some of the post I realized it’s new to me. Nonetheless, I’m definitely glad I found it and I’ll be bookmarking and checking back often!

  • By химчистка диана цены на услуги смолевичи, September 2, 2023 @ 4:06 pm

    Great web site you have here.. It’s hard to find good quality writing like yours these days. I seriously appreciate people like you! Take care!!

  • By Bob, September 6, 2023 @ 4:20 am

    Playing with a lucrative bonus is always beneficial, especially for gamblers on a budget. We also strongly advise you to choose one of our recommended casinos due to their rich game catalogues, including many roulette games. Our top 10 operators also rely on stable software that works flawlessly and would not cause players any technical troubles. And if you like to play on the go, you will be glad to know that our top online casinos offer excellent mobile platforms with rich game selections. Without further ado, let’s see the advantages of our operators and hopefully help you find the best online casino for Canadians! You can email the site owner to let them know you were blocked. Please include what you were doing when this page came up and the Cloudflare Ray ID found at the bottom of this page.
    http://xn--2i0b75tq8gu5o.com/bbs/board.php?bo_table=free&wr_id=31566
    But if you visit the Best Live Roulette Canadian Casino, picked for its great live-casino bonus, you can get handsomely rewarded for signing up. If you follow the link below you could be playing Live Dealer Roulette in minutes and get extra money to play with using the live casino bonus when you make your deposit. The best Roulette bonus is the Wheelz Casino welcome bonus: 100% up to C$800.Canadian players also get a $10 Bonus. All live games, live Roulette tables included, contribute 50% to the wagering requirement. This is a great deal for players who enjoy playing live Roulette online. In addition, Wheelz is an excellent online casino for slot games, mobile gambling, and free play. Some casinos offer deposit bonuses that can only be used for playing. Let’s say you deposit £100 and get a £100 bonus. Start with £200 and manage to finish the wagering requirements with a balance of £500. Now when you try to withdraw the funds, the casino will deduct the £100 they gave you and pay the other £400 out.

  • By sadovoe-tut.ru, September 6, 2023 @ 4:40 pm

    Howdy this is somewhat of off topic but I was wondering if blogs use WYSIWYG editors or if you have to manually code with HTML. I’m starting a blog soon but have no coding knowledge so I wanted to get advice from someone with experience. Any help would be greatly appreciated!

  • By agrosadovnik.ru, September 6, 2023 @ 5:03 pm

    Hi there, I found your website by means of Google at the same time as searching for a comparable matter, your web site got here up, it appears good. I have bookmarked it in my google bookmarks.

  • By loan near me, October 7, 2023 @ 4:02 pm

    Hello there, You have done an excellent job. I will definitely digg it and personally recommend to my friends. I am sure they will be benefited from this web site.

  • By online television, October 8, 2023 @ 11:52 pm

    Terrific article! This is the type of information that are meant to be shared around the internet. Disgrace on the seek engines for not positioning this post upper! Come on over and visit my site . Thank you =)

  • By online television, October 10, 2023 @ 5:39 pm

    This is very fascinating, You are an overly professional blogger. I have joined your feed and look ahead to looking for more of your fantastic post. Also, I have shared your site in my social networks

  • By сделать чеки на гостиницу, October 12, 2023 @ 10:33 pm

    Appreciating the persistence you put into your site and in depth information you present. It’s good to come across a blog every once in a while that isn’t the same unwanted rehashed material. Excellent read! I’ve saved your site and I’m including your RSS feeds to my Google account.

  • By гостиничные чеки купить в москве, October 17, 2023 @ 3:54 am

    Your way of explaining everything in this piece of writing is truly good, all be able to easily understand it, Thanks a lot.

  • By online television, October 17, 2023 @ 6:34 pm

    Hey there! Quick question that’s completely off topic. Do you know how to make your site mobile friendly? My web site looks weird when viewing from my iphone. I’m trying to find a theme or plugin that might be able to correct this problem. If you have any suggestions, please share. Thank you!

  • By online television, October 19, 2023 @ 5:15 pm

    Useful info. Fortunate me I found your web site accidentally, and I am surprised why this twist of fate did not happened in advance! I bookmarked it.

  • By стяжка пола стоимость, October 23, 2023 @ 1:01 pm

    Хотите получить идеально ровный пол без лишних затрат? Обратитесь к профессионалам на сайте styazhka-pola24.ru! Мы предоставляем услуги по стяжке пола м2 по доступной стоимости, а также устройству стяжки пола под ключ в Москве и области.

  • By snabzhenie-obektov.ru, October 24, 2023 @ 9:24 am

    снабжение стройматериалами

  • By штукатурка по маякам стен, October 26, 2023 @ 10:53 am

    Нужна механизированная штукатурка стен в Москве, но вы не знаете, как выбрать подрядчика? Обратитесь к нам на сайт mehanizirovannaya-shtukaturka-moscow.ru! Мы предлагаем услуги по машинной штукатурке стен любой площади и сложности, а также гарантируем доступные цены и высокое качество работ.

  • By гостиничные чеки купить, October 29, 2023 @ 10:33 pm

    Hey there, I think your blog might be having browser compatibility issues. When I look at your blog in Firefox, it looks fine but when opening in Internet Explorer, it has some overlapping. I just wanted to give you a quick heads up! Other then that, very good blog!

Other Links to this Post

RSS feed for comments on this post. TrackBack URI

Leave a comment

WordPress Themes