In Bourassa, Emmanuel Dubourg led with 47% support against 18% for Stéphane Moraille of the NDP. The Bloc Québécois followed with 15% and the Greens with 12%. However, Forum listed Daniel Mailhot and Georges Laraque as the candidates for the Bloc and Greens. The actual Bloc candidate is Daniel Duranleau (Mailhot ran in 2011), though I don't suspect that would make much of a difference. But Laraque is no longer the Green candidate, and that absolutely would make a difference. If Laraque's vote is cut in half or more, where would it go? Moraille seems like the obvious destination.
The numbers in Brandon-Souris were the most surprising of the set, with Rolf Dinsdale of the Liberals leading with 39% to 35% for Larry Maguire of the Conservatives. The NDP and Greens were tied at 12% apiece. Considering the riding was easily won by the Tories in 2011 and that the Liberals got 5% of the vote, this is a remarkable turnaround.
In Provencher, the Conservatives' Ted Falk led with 56% to 29% for Terry Hayward of the Liberals, another strong showing for the party (they had 7% here in 2011). The NDP followed with just 9%, while the Greens were at 6%.
And in Toronto Centre, which had the largest sample of the bunch by far, the Liberals' Chrystia Freeland led with 45% to 30% for the NDP's Linda McQuaig. That generally matches where the parties were in 2011. The Conservatives were third with 18%, while the Greens had 7%.
Problems?
The numbers look good for the Liberals and quite poor for both the Conservatives and New Democrats (losing Brandon-Souris would be a major blow to the Tories, not being in contention anywhere would be a strike against the NDP), but these polls are not without their potential problems.
First, there are the sampling issues that tend to appear in polls by Forum Research. Their IVR polls often over-sample older Canadians by a large degree, meaning that the samples of younger Canadians are smaller and thus potentially at risk of having larger errors. Those errors can then be amplified as the sample of younger voters is increased to its proper proportion.
Bourassa's sample was the least skewed, with 55% of it being over the age of 55, compared to the 40% of the voting population of the riding that is actually that old (at least according to the 2006 census, I do not believe the 2011 census has been broken down by riding just yet).
But the skew in the other ridings was significantly larger. In Provencher, 64% of the sample was 55 or older, instead of the 32% it should be. The sample in Brandon-Souris was 71% over the age of 55, when it needs to be 36%. And in Toronto Centre, the sample was 64% over the age of 55 instead of 25%.
Second, there is the issue of past voting behaviour. This is a tricky one, though, as the last election was over two years ago. Between then and now, voters have already cast a ballot in provincial elections and the population may have moved around (for example, all of the ridings report some respondents who voted Bloc in 2011, including those in Manitoba and Ontario). So, there is a natural amount of error that could occur.
Nevertheless, the samples do not match the voting results of 2011 very closely. For example, the sample in Toronto Centre reported a past vote of 51% for the Liberals, 24% for the Conservatives, and 18% for the New Democrats, instead of the actual result of 41% for the Liberals, 30% for the NDP, and 23% for the Tories. The samples are similarly Liberal in the other three ridings, while the NDP has been potentially under-estimated in Bourassa and Brandon-Souris. The Conservatives have been potentially under-estimated in the two Manitoba ridings.
If we weigh Forum's poll by how respondents said they voted in 2011, we get the following results:
Bourassa: 45% LPC, 22% NDP, 14% BQ, 11% GPC, 7% CPC
Brandon-Souris: 42% CPC, 35% LPC, 12% NDP, 11% GPC
Provencher: 60% CPC, 26% LPC, 9% NDP, 5% GPC
Toronto Centre: 40% LPC, 34% NDP, 18% CPC, 8% GPC
This still gives the Liberals a lead in Bourassa and Toronto Centre, but Brandon-Souris swings over to the Conservatives. The gap widens in Provencher, while it shrinks in both Bourassa and Toronto Centre, with the latter being particularly close. However, it should be emphasized that weighing by past vote is not necessarily more accurate than Forum's overall numbers. We don't know, for instance, whether past vote is already part of their weighting scheme (my calculations may not be taking into account other weighting factors like age or gender).
What we can know
The Ontario by-elections in August demonstrated that by-election polling can be particularly hit-or-miss. The polls called the race rather well in Etobicoke-Lakeshore and Scarborough-Guildwood, for example, but missed by a significant degree in London West and Ottawa South. The polls in Windsor-Tecumseh, while picking the winner, were off in the details. That is not an especially strong record. If it persists, two of these four by-elections will be called incorrectly by the polls.
To take this into account, I've calculated some reasonable confidence intervals we can apply to the polls in these by-elections, based on how the polls performed in the Ontario and federal by-elections of 2012 and 2013, as well as the Westside-Kelowna by-election in British Columbia earlier this year.
The margin of error of polls always includes 95% confidence, implying that 19 times out of 20 the results are within the margin of error. In other words, there is a 20 to 1 shot that the polls will be right. But that is an assessment of how accurate the polls are of the general population. We cannot know for certain whether the polls are accurately depicting the voting intentions of the general population, since the entire population does not vote. In reality, recent by-election polls have been within their margin of error only about two-thirds of the time. That gives them a roughly 2 to 1 shot of being correct.
I will be averaging the by-election polls again as I did for the Ontario by-elections, but I will be applying 67% and 95% confidence intervals to the results. Put simply, those ranges reflect the degree of error that 67% and 95% of polling results had in recent by-elections. They should act as a good guide for what to expect on voting day, based on what the polls are saying.
Here the those ranges, applied to this series of Forum polls (the polls in Bourassa and Toronto Centre from the spring are too old to be included in the weighted averages, so the weighted averages are the same as the Forum polls across the board). You can click on these charts to magnify them.
The starting positions have been established as the by-elections kick-off. The Liberals look secure enough in Bourassa, but we will need to see what happens to Laraque's support. The party also has the advantage in Toronto Centre, though the campaign is far from over. The Conservatives will need to work to hold on to Brandon-Souris, while Provencher looks safe. These four by-elections should be interesting.
