Social Europe

politics, economy and employment & labour

  • Themes
    • Global cities
    • Strategic autonomy
    • War in Ukraine
    • European digital sphere
    • Recovery and resilience
  • Publications
    • Books
    • Dossiers
    • Occasional Papers
    • Research Essays
    • Brexit Paper Series
  • Podcast
  • Videos
  • Newsletter
  • Membership

Macroeconomic Forecasting And Intelligent Guesswork

Simon Wren-Lewis 12th August 2014

Simon Wren-Lewis

Simon Wren-Lewis

Macroeconomic forecasts produced with macroeconomic models tend to be little better than intelligent guesswork. That is not an opinion – it is a fact. It is a fact because for decades many reputable and long standing model based forecasters have looked at their past errors, and that is what they find. It is also a fact because we can use models to generate standard errors for forecasts, as well as the most likely outcome that gets all the attention. Doing so indicates errors of a similar magnitude as those observed from past forecasts. In other words, model based forecasts are predictably bad.

The sad news is that this situation has not changed since I was involved in forecasting around 30 years ago. During the years before the Great Recession (the Great Moderation) forecasts might have appeared to get better, but that was because most economies became less volatile. As is well known, the Great Recession was completely missed. Forecasting has not improved, because our ability to explain variables like consumption or investment has not improved.

Does that mean that macroeconomics is not making any progress? I do not want to get sidetracked on this issue, but it could just be that as macroeconomists understand the economy as it was a little better, the nature of the economy also changes because of factors like financial innovation or technical progress. Does this mean macroeconomics is useless? No, in much the same way as medicine cannot predict year by year how your health changes but is quite good at responding to these changes.

What it does mean is that it is very difficult to use forecast performance as a means of judging between alternative models or organisations. Who is better in any one year is largely luck. You need to look at performance over at least a decade to be able to distinguish between luck and a better model or better judgement. Unfortunately models, and the people who use them, rarely remain unchanged for this length of time. The model and the modelling team that the Bank of England uses to forecast is different from its model and team ten years ago. (For much more on this see Ben Broadbent here.)

economic model, Macroeconomic Forecasting

Macroeconomic forecasting tends to be little better than intelligent guesswork, according to Simon Wren-Lewis.

Why Do People Still Do Macroeconomic Forecasting?

I think it is safe to say that this inability to accurately forecast is unlikely to change anytime soon. Which raises an obvious question: why do people still use often elaborate models to forecast? Here it is useful to distinguish between policy making bodies like central banks and the rest.


Become part of our Community of Thought Leaders


Get fresh perspectives delivered straight to your inbox. Sign up for our newsletter to receive thought-provoking opinion articles and expert analysis on the most pressing political, economic and social issues of our time. Join our community of engaged readers and be a part of the conversation.

Sign up here

It makes sense for both monetary and fiscal authorities to forecast. So why use the combination of a macroeconomic model and judgement to do so, rather than intelligent guesswork? (Intelligent guesswork here means some atheoretical time series forecasting technique.) The first point is that it is not obviously harmful to do so. (From my unsystematic reading the only consistent results from forecasting comparisons using alternative techniques is that all forecasts are pretty poor.) The second point is that forecasting using macroeconomic models allows forecasters to combine a large amount of information into a reasonably consistent story that links what has happened to what might happen, and policymakers find these stories helpful. (See, for example, this post by Corola Binder, or some of the work of Deirdre McCloskey.) There are interesting questions about what type of macromodel is best suited for forecasting, and whether the model used for forecasting should also be used for policy analysis, but I’ll leave those for another day.

Many other organisations, not directly involved in policy making, produce macro forecasts. Why do they bother? Why not just use the policy makers’ forecast? A large part of the answer must be that the media shows great interest in these forecasts. Why is this? I’m tempted to say it’s for the same reason as many people read daily horoscopes. However I think it’s worth adding that there is a small element of a conspiracy to deceive going on here too.

To set the scene, consider a similar little conspiracy. There is now a convention that when there are interesting aggregate moves on the stock or currency markets, the media will present some ‘expert’ – typically an economist working for some financial company – who will tell us why the market has so moved. The truth is that no one knows why the market goes up or down, because no one asks each trader why they are making a trade. So all the expert can give us is an unverifiable intelligent guess, but they never tell you that. This small deception suits the media and the experts.

In a similar way, the media likes to pretend that forecasts are much more accurate than they actually are, because that makes small changes newsworthy. In reality forecasts tend to follow each other and change slowly, for reasons Tim Harford notes, so presenting some new forecast every week makes little sense. (Occasionally this conservatism among forecasters can be usefully predicted, as I once noted in an anecdote.) But this conspiracy has the added bonus for the media that it can express horrified shock and surprise when forecasts go wrong.

The rather boring truth is that it is entirely predictable that forecasters will miss major recessions, just as it is equally predictable that each time this happens we get hundreds of articles written asking what has gone wrong with macro forecasting. The answer is always the same – nothing. Macroeconomic model based forecasts are always bad, but probably no worse than intelligent guesses.

Simon Wren-Lewis

Simon Wren-Lewis is Professor of Economics at Oxford University.

You are here: Home / Economy / Macroeconomic Forecasting And Intelligent Guesswork

Most Popular Posts

Russia,information war Russia is winning the information warAiste Merfeldaite
Nanterre,police Nanterre and the suburbs: the lid comes offJoseph Downing
Russia,nuclear Russia’s dangerous nuclear consensusAna Palacio
Belarus,Lithuania A tale of two countries: Belarus and LithuaniaThorvaldur Gylfason and Eduard Hochreiter
retirement,Finland,ageing,pension,reform Late retirement: possible for many, not for allKati Kuitto

Most Recent Posts

Ukraine,fatigue Ukraine’s cause: momentum is diminishingStefan Wolff and Tetyana Malyarenko
Vienna,social housing Vienna social-housing model: celebrated but misusedGabu Heindl
social democracy,nation-state Social democracy versus the nativist rightJan Zielonka
chemical,European Union Which comes first—Big Toxics’ profits or health?Vicky Cann
Russia,journalists,Ukraine,target Ukraine: journalists in Russia’s sightsKelly Bjorkland and Simon Smith

Other Social Europe Publications

strategic autonomy Strategic autonomy
Bildschirmfoto 2023 05 08 um 21.36.25 scaled 1 RE No. 13: Failed Market Approaches to Long-Term Care
front cover Towards a social-democratic century?
Cover e1655225066994 National recovery and resilience plans
Untitled design The transatlantic relationship

Eurofound advertisement

Eurofound Talks: does Europe have the skills it needs for a changing economy?

In this episode of the Eurofound Talks podcast, Mary McCaughey speaks with Eurofound’s research manager, Tina Weber, its senior research manager, Gijs van Houten, and Giovanni Russo, senior expert at CEDEFOP (The European Centre for the Development of Vocational Training), about Europe’s skills challenges and what can be done to help workers and businesses adapt to future skills demands.

Listen where you get your podcasts, or for free, by clicking on the link below


LISTEN HERE

Foundation for European Progressive Studies Advertisement

The summer issue of the Progressive Post magazine by FEPS is out!

The Special Coverage of this new edition is dedicated to the importance of biodiversity, not only as a good in itself but also for the very existence of humankind. We need a paradigm change in the mostly utilitarian relation humans have with nature.

In this issue, we also look at the hazards of unregulated artificial intelligence, explore the shortcomings of the EU's approach to migration and asylum management, and analyse the social downside of the EU's current ethnically-focused Roma policy.


DOWNLOAD HERE

Hans Böckler Stiftung Advertisement

WSI European Collective Bargaining Report 2022 / 2023

With real wages falling by 4 per cent in 2022, workers in the European Union suffered an unprecedented loss in purchasing power. The reason for this was the rapid increase in consumer prices, behind which nominal wage growth fell significantly. Meanwhile, inflation is no longer driven by energy import prices, but by domestic factors. The increased profit margins of companies are a major reason for persistent inflation. In this difficult environment, trade unions are faced with the challenge of securing real wages—and companies have the responsibility of making their contribution to returning to the path of political stability by reducing excess profits.


DOWNLOAD HERE

ETUI advertisement

The future of remote work

The 12 chapters collected in this volume provide a multidisciplinary perspective on the impact and the future trajectories of remote work, from the nexus between the location from where work is performed and how it is performed to how remote locations may affect the way work is managed and organised, as well as the applicability of existing legislation. Additional questions concern remote work’s environmental and social impact and the rapidly changing nature of the relationship between work and life.


AVAILABLE HERE

About Social Europe

Our Mission

Article Submission

Membership

Advertisements

Legal Disclosure

Privacy Policy

Copyright

Social Europe ISSN 2628-7641

Social Europe Archives

Search Social Europe

Themes Archive

Politics Archive

Economy Archive

Society Archive

Ecology Archive

Follow us

RSS Feed

Follow us on Facebook

Follow us on Twitter

Follow us on LinkedIn

Follow us on YouTube