D.E. Shaw: Double Down or Diversify?
D.E. Shaw has been a pioneer in quantitative investing since it was founded in the late 80s. Since then, it has focused its efforts on machine learning and other AI-based investment strategies.
The investing landscape has dramatically changed over the last thirty years as innovative asset classes and strategies have dispassionately displaced older asset classes and strategies. This is in no small part attributable to technological advances. Technological advances can have an enormous impact on investing because the margin between success and failure in the industry is razor thin. A small improvement, whether in technology or otherwise, can result in significant differences in the success of a firm. As a result, staying at the forefront of the investing strategy that differentiates an investment firm is critical to its long-term viability.
The hedge fund segment in particular has been grappling with this changing landscape. When D.E. Shaw, one of the world’s largest hedge funds, entered the investing scene in the late 80s, it was an innovative upstart pioneering strategies using computers and quantitative models.[1] Since then, quantitative investing has exploded with competition and new assets flowing to it. It currently represents an estimated $500bn to $1tn of the roughly $3tn in assets across all hedge fund strategies.[2], [3] This growth is attributable to its success. Of the total gains generated by the top 20 hedge funds in history, 25%, representing more than $110bn, has come from hedge funds that utilize computers and quantitative models.[4]
While D.E. Shaw has been a pioneer in quantitative trading, the landscape has been evolving rapidly as machine learning takes center stage. Machine learning is the latest technology that naturally progresses from the quantitative models these firms have used since inception. To stay ahead of the competition, the firm needs to continue investing in its technical talent because coders build the firm’s investing strategies. Investing in this is not easy as there is a significant talent shortage in this new field.[5] D.E. Shaw’s leadership has been working to climb this hill by hiring one of the field’s leading computer science professors and building a machine learning research organization beneath him.[6] When announcing this development, the firm highlighted that “[t]his new, independent venture reflects the importance we attach to gaining fresh perspectives and insights as technology evolves.”[7]
D.E. Shaw knows, and can’t forget, that there are plenty of others on its heels.[8] Both existing funds and new funds are focused on applying machine learning to investing. A recent survey indicated that 17% of hedge funds currently use AI, but 56% plan to make it an integral part of their investment process going forward.[9] Additionally, of all the funds launched last year, 40% relied on computer models as a key driver of their strategy, according to Preqin.[10]
In light of this competitive landscape, a key question I’ve been wrestling with is the durability of a business that relies so heavily on machine learning technology. I wonder how hard it is for the next computer science PhD student or competing fund to build a better mousetrap. If one succeeds, it could threaten even the current titans. Because of this potential instability, should D.E. Shaw diversify its business by building out alternative strategies? On one hand, if they stick to their core competency, they likely maximize their odds of being the long-term leader of the strategy. But if I was a principal of the business, I’d want to diversify across additional strategies. It appears this is the route they are pursuing by building out their fundamental long/short and activist businesses.[11] Is this diversification wise?
(800 words)
[1] Michelle Celarier, “How a Misfit Group of Computer Geeks and English Majors Transformed Wall Street,” New York Magazine, January 2018, http://nymag.com/intelligencer/2018/01/d-e-shaw-the-first-great-quant-hedge-fund.html, accessed November 2018.
[2] Michelle Celarier, “How a Misfit Group of Computer Geeks and English Majors Transformed Wall Street,” New York Magazine, January 2018, http://nymag.com/intelligencer/2018/01/d-e-shaw-the-first-great-quant-hedge-fund.html, accessed November 2018.
[3] Robin Wigglesworth & Lindsay Fortado, “Quant hedge funds lose their allure as performance sags,” Financial Times, July 28, 2018, https://www.ft.com/content/e33e117e-8f7a-11e8-b639-7680cedcc421, accessed November 2018.
[4] Nathan Vardi, “Computers Start To Take Over List Of Most Successful Hedge Funds,” Forbes, February 1, 2017, https://www.forbes.com/sites/nathanvardi/2017/02/01/quants-start-to-take-over-list-of-most-successful-hedge-funds/#6b3256135e00, accessed November 2018.
[5] Disruption in Global Financial Services, 2017—Machine Learning is Imperative, Frost & Sullivan, accessed November 2018.
[6] “D. E. Shaw Group Forms New Machine Learning Research Group,” D.E. Shaw press release (New York, NY, August 16, 2018).
[7] Robin Wigglesworth, “DE Shaw taps academic to set up new machine learning group,” Financial Times, August 16, 2018, https://www.ft.com/content/1553b0a2-a177-11e8-85da-eeb7a9ce36e4, accessed November 2018.
[8] Nathan Vardi, “Computers Start To Take Over List Of Most Successful Hedge Funds,” Forbes, February 1, 2017, https://www.forbes.com/sites/nathanvardi/2017/02/01/quants-start-to-take-over-list-of-most-successful-hedge-funds/#6b3256135e00, accessed November 2018.
[9] Robin Wigglesworth, “DE Shaw taps academic to set up new machine learning group,” Financial Times, August 16, 2018, https://www.ft.com/content/1553b0a2-a177-11e8-85da-eeb7a9ce36e4, accessed November 2018.
[10] Will Knight, “Will AI-Powered Hedge Funds Outsmart the Market?” MIT Technology Review, February 4, 2016, https://www.technologyreview.com/s/600695/will-ai-powered-hedge-funds-outsmart-the-market/, accessed November 2018.
[11] Dana Mattioli and Cara Lombardo, “D.E. Shaw Joins Continental Grain in Pushing for Change at Bunge,” The Wall Street Journal, October 8, 2018, https://www.wsj.com/articles/d-e-shaw-joins-continental-grain-in-pushing-for-change-at-bunge-1539024275, accessed November 2018.
I am not entirely convinced that firms like DE Shaw can continue to maintain their AI-driven competitive advantage indefinitely. I say this because, as new breakthroughs in AI continue to emerge, the technology will become increasingly democratized, such that firms like DE Shaw will find themselves grappling with newcomers with superior or equal AI-driven investment strategies. With that in mind, I believe that it is absolutely critical for DE Shaw to continue to expand out its business lines by investing in developing other standalone capabilities within the investment management space, to help buttress the diversification agenda.
Interesting read!! As investment banks wipe out once crowded trading floors and lay off equity research analysts, this topic seems extremely relevant. Computers are taking over lots of jobs that require brain power. I would be very interested in learning about if firms like DE Shaw will run these strategies, quant, long short and long only as complete stand-alones, and how will they pitch these funds differently to investors when returns diverge one way or another.
This really is an interesting read, and firms like D.E Shaw are on the right track with investing in research in this new field. As for the question of diversifying into other types of trading strategies, that depends on how well they test and simulate their AI models before deployment. Machine learning algorithms are expanding the scope of their Quant models and are rapidly approaching scenarios where AI generates its own algorithms and strategies – one day even generating a hedging strategy against its own durability.
Thanks for sharing! It seems to me that there are two main routes to evolve investment. One route is to turn human into machine such as the Bridgewater’s approach, and the other one is to turn machine into human, like what DE SHAW and a bunch of other hedge funds that are trying to adopt machine learning. I would vote for diversifying trading strategies, simply because nobody can tell which route is going to evolve faster — human or machine.