An industry that once told hard truths to corporate and government clients now mostly just tells them what they want to hear, making it harder for us all to adapt to a changing world -- and that's why I'm leaving it.
I recently quit my job as a "futurist" and "strategic intelligence analyst" after a successful 15-year career of writing books and consulting to corporations and governments around the world. I spent a decade and a half analyzing disruptive new technologies, predicting the effects of the Internet on the international construction industry, helping executives decide whether to spend billions in the nuclear power market, profiling the customer of the future -- and training thousands of executives to do likewise for their own companies. It was exciting and fulfilling, but this is the end of the road. My employment status is interesting to nobody except my wife and I, but why I am leaving the business of intelligence is important to everybody, because it stems from the endemic corruption of how decisions are made in our most critical institutions.
I am not quitting this industry for lack of passion, as I still believe -- more than ever -- in using good information and sophisticated analytical techniques to decode the future and make decisions. The problem is, the market for intelligence is now largely about providing information that makes decision makers feel better, rather than bringing true insights about risk and opportunity. Our future is now being planned by people who seem to put their emotional comfort ahead of making decisions based on real -- and often uncomfortable -- information. Perhaps one day, the discipline of real intelligence will return triumphantly to the world's executive suites. Until then, high-priced providers of "strategic intelligence" are only making it harder for their clients -- for all of us -- to adapt by shielding them from painful truths.
Many people have not encountered the job title, "intelligence analyst." For the past 50 years, since the rise of the Central Intelligence Agency as a clearing house for information about the Soviet Union, this has been a job that involves researching trends, analyzing their potential impact, and reporting the possibilities to decision-makers. In the age of nuclear weapons, the world was changing too fast for leaders to make decisions based only on their own outdated assumptions. Organizations learned to critically assess their futures -- or literally lead humanity into possible mass extinction. The model mostly worked, and eventually the CIA was joined by other agencies, as well as for-profit consulting companies, which mimicked many of the techniques pioneered in the Cold War. Since the middle part of the 20th century, both corporations and governments have used strategic intelligence, forecasting, scenario planning, and other intelligence tools that keep decision-makers informed and ready to lead their institutions safely through tumultuous periods.
According to the private intelligence industry's view of itself, a phalanx of analysts collect data, assess the risks and opportunities inherent in trends, and provide a series of scenarios that help their clients make contingency plans, such that no matter what future arrives, people will thrive. But the reality of 2012 is quite different. A large number of people promise these services, from generalist mega-consultancies such as Booz Allen, Accenture, and McKinsey, to more boutique providers such as Global Business Network, the Institute for the Future, Frost & Sullivan, and countless individual practitioners. And many executives claim to practice state-of-the-art strategic management, dutifully using the insights of these providers in their day-to-day operations. Still, the culture of intelligence has been in free-fall since the financial crisis of 2008. While people may be pretending to follow intelligence, impostors in both the analyst and executive camps actually follow shallow, fake processes that justify their existing decisions and past investments.
The War Against Foresight
When the intelligence business works, it helps create organizational cultures where empirical evidence and concern for the long-range strategic impact of a decision trump internal politics and short-term expediency. And in the past, many such cultures have thrived in businesses and government agencies alike. But three trends are making this harder, or even leading these intelligence providers to have the opposite effect.
First, the explosion of cheap capital from Wall Street has led major industries to consolidate. Where a sector such as pharmaceuticals or telecommunications (and, of course, banking) might have had dozens of big players a couple of decades ago, now it has closer to five. When I began in the intelligence industry 15 years ago, I did projects for Compaq, Amoco, Wyeth Pharmaceuticals, and Cingular -- all of which have since been rolled into the conglomerates of Hewlett Packard, British Petroleum, Pfizer, and AT&T. There are fewer firms for an intelligence analyst to track, and their behavior has to be understood on totally different terms than when this discipline was created. Where once an automotive industry analyst might have based her predictions on the efficient marketplace theory or classical competitive analysis, now she has to use very different analytical tools. Most of these firms are considered Too Big to Fail by their respective nation-states, as evidenced by General Motors and Chrysler in 2009, and the markets are thus convoluted by subsidies, special regulations, and protectionism. One cannot predict the future of a marketplace by trend analysis alone, because oligopolies do not compete the same way as do firms in free markets.
Second, industry consolidations have created gigantic bureaucracies. Hierarchical organizations have a very different logic than smaller firms. In less consolidated industries, success and failure are largely the result of the decisions you make, so intelligence about the reality of the marketplace is critical. Life is different in gigantic organizations, where success and failure are almost impossible to attribute to individual decisions. Though a given conglomerate might have hundreds or thousands of "executives," each is much more beholden to a complex culture of bosses. Even if people mean well, they're living and dying by a system where the incentives are to seek advancement by pushing responsibility downward and pulling credit upwards. In large, slow-moving bureaucracies, conventional thinking and risk avoidance become paramount, irrespective of how many times a day people at that organization use the word "strategy" or "innovation." It is far more preferable to fail conventionally than to make a daring but uncertain decision without the full backing of the entire organization. Because massive bureaucracies are so much more common than they were even a few years ago, decisions are simply not in vogue right now.
Finally, and most importantly, the world's economy is today driven more by policy makers than at any time in recent history. At the behest of government officials, banks have been shielded from the consequences of their market decisions, and in many cases exempt from prosecution for their potential law-breaking. Nation-state policy-makers pick the winners in industries, such as automotive, and guarantee the smooth operations of others, such as Verizon and General Electric, both of which received zero-interest cash flow via the TARP program in 2008 and 2009. Eventually, states might do less of directing specific outcomes in the world markets, but for now, these policy-makers have suspended many critical free market principles, and at times the rule of law, on the notion that we are in a crisis, and keeping the system together comes first.
Thus, what use is the old model of competitive analysis if you are looking at markets in Greece right now? Which would have more impact on a given market: the clever, innovative actions of a CEO in Athens, or the politics within the European Central Bank? And how about analyzing the future of the housing market in the United States? Are you going to examine how much people are able to pay for accommodations and the level of housing stocks available in given cities, or shall you look at the desires of central bankers and Congressional policy-makers able to start new financing programs to end up with a desired outcome? How can you use classical competitive analysis to examine the future of markets when the relationships between firms and government agencies are so incestuous and the choices of consumers so severely limited by industrial consolidation?
There is no good way to reliably predict the future in these markets anymore, except maybe by being privy to the desires of an ever-decreasing number of centrally connected power players. Companies still need guidance, but if rational analysis is nearly impossible, is it any wonder that executives are asking for less of it? What they are asking for is something, well, less productive.
The Anti-Intelligence Culture
Strategic intelligence is more and more like reading the Harvard Business Review through a fun house mirror. Sure, people use the words strategy, future, and foresight, but they mean something quite different.
In my experiences, and based on what my colleagues in the field tell me, executives today do not do well when their analysts confront them with challenging, though often relatively benign, predictions. Confusion, anger, and psychological transference are common responses to unwelcome analysis.
While executives pride themselves on being supremely rational technocrats able to calmly assess changes in the world without letting their personal emotions cloud their analysis, the reality is often quite a bit more human. One senior executive shut down a half-day event about future trends within the first ten minutes after a slide warning about "global aging populations" came up. The silver-haired alpha dog not only refused to discuss the fact that their average customer was near the age of social security and getting ready to leave active economic life, he asserted that Baby Boomers are not in fact aging, that "60 is the new 40," that all future strategic problems will be solved by "getting our numbers up," and that nobody in the company was to mention aging populations ever again.
One group of government officials, while discussing the anticipated tax base from housing and retail, became suddenly unhinged when an analyst suggested that those sectors would not immediately re-inflate back to pre-2008 levels. When shown charts illustrating that Americans have ten times as much retail square footage as Europeans, and that housing bubble was, well, a bubble, the politicians angrily retorted that America was special and its population required ten times as many options when shopping. They blustered that houses always regain value and that the multi-trillion dollar bailout was "a one-time mistake."
In early 2009, many European executives were quick to point out to me that the "financial crisis" was a "uniquely American problem" -- and that Portugal and Greece were fine, thank you very much. As European central banks privately rushed to keep the peripheral countries solvent in 2010, I was told not to publicly discuss any such possibilities while working with European groups. They didn't want to hear it.
When a colleague of mine was brought into his employer's "corporate strategy group" a couple of years ago, he saw it as a great honor to be included in the one unit dedicated solely to the company's long-term success. Once allowed in to the secretive confines of the group, he discovered that the mandate of the position had, after 2008, been radically altered. Rather than mapping out how the markets were likely to change and his company might stay ahead, he was made to flip through old spreadsheets to find which products were most profitable, then get salesmen to "sell more of them." When he asked if he should perhaps include analysis of trends in society, technology, and economics to anticipate what long-term options they should be exploring, he was informed, "You need to go back to grad school if you just want to study stuff for no reason."
A 2008 U.S. government report on "Future Trends 2025" made the following predictions: that the U.S. dollar might not be the world's reserve currency forever, Iran would continue to be a rogue nation, China would have more economic power, Russia would be rife with corruption and organized crime, and oil would be replaced by some other magic, stable, powerful, liquid fuel for the world's increasing fleet of cars and trucks. The report cost the U.S. government millions of dollars, all to produce a document that effectively predicted 2006, plus an extra pipedream forecast of getting out of the world's peak oil predicament, supported by zero technological forecasts from experts in the field. It looked and smelled like strategic forecasting, but was carefully produced to keep from upsetting anyone with scary challenges to their assumptions about the future strategic position of the United States. This is the new business model for an intelligence industry that once lived to disrupt its customers' thinking, not reassure it.
For too many business and government executives, foresight is a luxury that is hardly necessary in this new "hypercompetitive" post-crisis world. Perhaps it's always been superfluous, we just didn't notice. The study of the future used to be easier to sell, maybe because the analysis usually predicted the growth of the consumer economy or the next great gadget. But the future is no longer nearly as palatable, and the customers are less interested. That's too bad, because companies and governments still need help planning for the future. But it takes discomfort, courage and humility to face that future, and who wants to pay for bad news?
It will not always be this way. When the real pain of our losses and poor decisions finally occurs to people, when the last quantitative easing bailout no longer hides the logical incongruities that are fundamental to the system, and when enough people refuse to believe that "the new normal" is normal at all, we will then return to a real discussion of what is next. In the meantime, the remnants of the strategic intelligence world will be happy to take your money in exchange for telling you that everything is fine.