Are exit polls accurate?

UK Exit Poll Accuracy: A Deep Dive

16/04/2007

Rating: 4.78 (8051 votes)

The general election is upon us, and as the polling stations close their doors at 10 pm, a collective breath is held across the nation. For decades, one of the most anticipated moments of election night has been the release of the exit poll. Commissioned by the UK's major broadcasters – Sky News, BBC, and ITV News – and meticulously designed by a team of academic political scientists led by the esteemed Professor Sir John Curtice of Strathclyde University, this poll offers an early, and often remarkably insightful, glimpse into the likely outcome. Carried out by the reputable research company Ipsos, the exit poll aims to predict the number of seats each party will win, offering a projection far more reliable than opinion polls conducted in the weeks leading up to the vote. But the crucial question remains: just how accurate are these polls, and have they ever been significantly wrong?

Table

What Exactly is an Exit Poll?

At its core, an exit poll is conducted by surveying voters as they leave their polling stations. Tens of thousands of people are asked to privately fill in a replica ballot, mirroring the one they've just cast. This process is designed to provide an indication of how the electorate has voted. The method involves interviewing voters at approximately 144 polling stations across the country, selected to be demographically representative and balanced between rural and urban seats, with a slight weighting towards marginal areas. Crucially, the same polling stations are often used from one election to the next to ensure consistency, although adjustments are made if boundaries change or a seat is held by the Speaker.

Are exit polls accurate?
Some earlier exit polls, however, have been less accurate. In 1974, the first British exit poll predicted a Labour majority of 132, but the actual majority was three. In 1992, the exit poll predicted the election would result in a hung parliament, when in fact Tory prime minister John Mayor had won a slim majority.

The operation is quite sophisticated. Fieldworkers, employed by specialist polling companies like Ipsos Mori, are stationed at selected polling stations. They approach voters at regular intervals – for instance, every tenth voter – and provide them with a mock ballot paper. Voters are asked to fill this in privately, without observation, and then deposit it into a dedicated exit poll ballot box. This emphasis on privacy is key, as Professor Stephen Fisher of the University of Oxford notes, to increasing the accuracy of the results by minimising voter reluctance to disclose their choices.

The data collected is then sent back to a central hub, where a team of experts analyses the results. This analysis involves significant statistical modelling to extrapolate the findings from the sample to the entire country. As Professor Roger Mortimore, Director of Political Analysis at Ipsos, explains, the broad principle is to estimate the shift in votes since the last election. By understanding the differing behaviours in various types of polling stations, the team can build a comprehensive picture of the national trend, even in constituencies where they haven't polled directly.

How Accurate Have UK Exit Polls Been?

The accuracy of the UK's exit poll is a subject of considerable interest and debate. While it's not technically possible to assign a formal 'margin of error' in the traditional sense, as the sample isn't entirely random, the projections are generally considered to be extremely close to the final results. The model used today, developed in 2005 by Professor Curtice and statistician David Firth, has a strong track record.

How many seats did the exit poll Miss?
In two cases, it was less than ten seats off from the final result. The exit poll’s largest miss was in 2015, when the projected majority fell short of the actual number of seats by 30. In fact, it’s so accurate that David Dimbleby – arguably the face of election night – has called it the ‘bane of the broadcaster’s life’.

Since its current methodology was implemented in 2005, the exit poll has demonstrated impressive accuracy. In three of those elections, it correctly predicted the exact size of the majority. In two other instances, its projection was within ten seats of the final outcome. The poll's largest deviation occurred in 2015, when its projected majority fell short of the actual result by 30 seats. Despite this, it's important to note that in 2015, the exit poll actually outperformed all other opinion polls, which had largely failed to anticipate the Conservative majority.

The perception of accuracy can be influenced by high-profile instances where the poll has been perceived as falling short. For example, in the 2017 general election, the exit poll predicted a hung parliament, which ultimately proved correct, indicating Theresa May's Conservatives had lost their majority. While the Tories won 317 seats, just three more than the exit poll predicted, and Labour secured 262, four fewer than suggested, the overall prediction of a hung parliament was accurate. This contrasts with the 2015 election, where many pundits, including former Lib Dem leader Paddy Ashdown, famously doubted its accuracy, only for it to prove more reliable than the campaign's opinion polls.

However, earlier exit polls have shown greater discrepancies. The very first British exit poll in 1974 predicted a Labour majority of 132, a stark contrast to the actual majority of just three. Similarly, in 1992, exit polls for both the BBC and ITN predicted a hung parliament, when in reality, John Major's Conservative government secured a slim majority. These historical examples highlight that while the methodology has improved significantly, no polling method is infallible.

Did the exit poll outperform everyone in 2015?
“Even in 2015, when the polling industry suffered a lot of criticism for their failures to anticipate a Conservative majority, the exit poll outperformed everyone else,” he added. In that election, the seat numbers in the exit poll suggested a hung parliament but David Cameron in fact scraped a thin majority.

The Role of Statistical Wizardry

The transformation of raw data from around 20,000 surveyed voters across 130-140 polling stations into a national projection is a testament to the power of statistical analysis. Professor Curtice and his team employ sophisticated modelling techniques that account for variations in voting behaviour across different types of polling stations and geographical areas. A key aspect of this is the careful study of how voting patterns change from one election to another. This allows them to account for factors such as differing turnout rates, the likelihood of voters agreeing to participate in the survey (around 80% typically do), and the potential for postal votes or voters who refuse to participate in the survey.

The process of selecting voters at random, ensuring confidentiality through replica ballot papers and boxes, and the continuous reporting of data throughout the day all contribute to the robustness of the final projection. The aim is to minimise refusal rates and ensure the sample, though small relative to the total electorate, is representative of the nation's voting intentions.

Why the Exit Poll is Still Crucial

Despite the occasional missteps, the UK exit poll remains a vital tool for understanding election night dynamics. It provides an immediate, data-driven indication of the likely results, offering a stark contrast to the more volatile and often less accurate opinion polls released in the preceding weeks. Its ability to predict the overall trend and the broad seat allocations for major parties is unparalleled in its timeliness and reliability.

The late David Dimbleby, a revered figure in UK election coverage, famously described exit polls as the 'bane of the broadcaster's life' and even the 'worst invention ever'. His sentiment stemmed from the fact that the exit poll often reveals the outcome before the counting process is complete, diminishing the dramatic suspense he so expertly conveyed. However, for many viewers and analysts, this early insight is precisely what makes election night so compelling. It allows for immediate analysis and commentary on the forces shaping the political landscape.

What was the first British exit poll predicting a hung parliament?
In 1974, the first British exit poll predicted a Labour majority of 132, but the actual majority was three. One of the worst misfires was in 1992, when two separate exit polls, for the BBC and ITN, both predicted a hung Parliament. Instead, John Major's Conservative government held its position, albeit with a significantly reduced majority.

Historical Performance: A Snapshot

To better understand the accuracy, let's look at a comparative table of some key past performances:

YearExit Poll Prediction (Seats)Actual Result (Seats)Accuracy
1974Labour majority: 132Labour majority: 3Significant miss
1992Hung ParliamentConservative majorityMissed majority
2005Conservative majority: 67Conservative majority: 66Very accurate
2010Conservative majority: 12Hung Parliament (Conservative lead)Missed majority
2015Hung Parliament (Conservative lead)Conservative majority: 12Underestimated majority
2017Hung Parliament (Conservative lead)Hung Parliament (Conservative lead)Accurate overall

Frequently Asked Questions

Q1: How many polling stations are used for the UK exit poll?
Around 130 to 144 polling stations are typically used, selected for their representativeness.

Q2: Who designs and conducts the UK exit poll?
It's designed by an academic team led by Professor Sir John Curtice and conducted by Ipsos.

Q3: Why do they use replica ballot papers?
To ensure voter privacy and encourage participation, making the results more reliable.

Did the 2015 exit poll predict a Conservative majority?
The 2015 exit poll was more accurate than the opinion polls during the campaign but did not predict a Conservative majority. In 2017, the first take of the exit poll correctly predicted the Conservatives would be the largest party, but stopped short of saying there would be a hung Parliament.

Q4: Has the exit poll ever been completely wrong?
While it has had significant misses, particularly in earlier years (like 1974 and 1992), its overall accuracy in predicting the broad outcome and seat allocations has generally been high, especially in recent elections.

Q5: Is the exit poll more accurate than opinion polls?
Yes, generally the exit poll is considered much more accurate than opinion polls conducted during the campaign, as it captures actual voting behaviour on election day.

In conclusion, while the UK exit poll is not a crystal ball and has experienced its share of inaccuracies, it stands as a remarkably effective tool for providing an early, data-driven indication of election outcomes. Its sophisticated methodology and the expertise of its creators have made it one of the most reliable indicators available on election night, a crucial element in the democratic process.

If you want to read more articles similar to UK Exit Poll Accuracy: A Deep Dive, you can visit the Automotive category.

Go up