Why YouGov/Times poll suggesting SNP success may be more reliable than Survation/Daily Record poll

C7PepXbWwAABw4U.png large

Based on a sub-sample of 171 Scots in the YouGov / Times Westminster Voting Intention Survey, the SNP seems to continue to defy electoral gravity, with 47% intending to vote for them. This would take SNP representation at Westminster up to 56 and remove the last Scottish Labour MP.

https://d25d2506sfb94s.cloudfront.net/cumulus_uploads/document/kxau243ykc/TimesResults_181023_VI_Trackers_bpc_w.pdf

In sharp contrast, for Holyrood voting intentions, a Survation / Daily Record full-sample of ‘more than 1 000 Scots’ suggests SNP support in a Holyrood vote, down 8.5% to 38%, the loss of 11 MSPs and the loss of a pro-independence majority. For Westminster, this poll has the SNP holding at 36%.

holyrood

https://www.dailyrecord.co.uk/news/politics/new-poll-shows-snp-could-13486523

However, though a poll of more than 1 000 should be more reliable than a sample of 171, there are good reasons to think differently because of the methods used to gather the information. Most important is the difference between online and landline telephone surveys, used respectively by YouGov and Survation. Regular readers of TuS will have seen this before.

Telephone surveys tend toward exaggerating conservative or no change outcomes such as a NO vote in Scotland 2014 or, as they clearly did, a Remain vote in Brexit 2016.

First see these reservations, from YouGov, about telephone interviews from the opinion polls which got the EU Referendum so wrong:

‘There’s a big difference between the online and telephone polls on the EU referendum – with online polls showing the sides neck-and neck and telephone polls showing about a 15% gap in favour of ‘remain’. Why? It’s striking that both methodologies right across the different polling companies give about the same number to the ‘leave’ campaign, around 40%. The difference is in the ‘remain’ number, which is around 52% from the telephone-polls, but only 40% for online polls.’

So, commonly, telephone surveys generate conservative, negative or status quo returns. Respondents are more likely to say no to a question about a big change of some kind.

In another YouGov report we read:

‘Now however we can reveal a real, significant and evidence-based difference between the two methodologies that explains why they are divergent and why it is online that appears to be calling it correctly.’

See this online, self-selecting, survey report from the, far from sympathetic to Scottish Independence, Scotsman newspaper in June 2016:

‘Nearly six out of 10 Scots say they’d vote Yes in a second independence referendum. In a clear reflection of the growing backlash north of the Border to Thursday’s Brexit result, a ScotPulse online survey of 1,600 Scottish adults on Friday (24 June) showed that 59% of Scots now back leaving the UK.’

Further, not everyone has a landline to be called on. Roughly 20%, especially younger and economically disadvantaged citizens do not have one so cannot be surveyed. As the Scotsman report points out, the young and the less-well-off are more likely to prefer independence.

Here’s an even more interesting thought, from the USA admittedly:

‘There now may be something unusual about people who are willing to answer the phone to talk with strangers, and we should be sceptical about generalizing from the results of these surveys. It is possible that the new habit of non-phone-answering is evenly distributed throughout the population (thus reducing this as a sampling confound), but this seems unlikely.’

Now, are NO voters more unusual than YES voters?

 Sources:

https://www.indeed.co.uk/cmp/Bmg-Research/reviews

https://yougov.co.uk/news/2016/02/23/commentary-what-explains-difference-between-phone-/https://yougov.co.uk/news/2016/02/23/commentary-what-explains-difference-between-phone-/

https://yougov.co.uk/news/2016/05/20/revealed-evidence-greater-skews-phone-polls/

 

 

 

12 thoughts on “Why YouGov/Times poll suggesting SNP success may be more reliable than Survation/Daily Record poll

  1. Graham MacLure October 28, 2018 / 9:10 am

    May I be a shade cynical and wonder if the telephone poll was considered more likely by the client to provide their desired result?
    I must admit some prejudice on this as I am making the assumption that people still using landlines other than for Broadband are also MSM news consumers and possibly quite happy to have their opinions formed for them.

    Liked by 3 people

    • Bugger (the Panda) October 28, 2018 / 3:10 pm

      If it is published, it probably is

      Liked by 1 person

  2. remo fantini October 28, 2018 / 12:28 pm

    Is poll is load of shit

    Like

  3. Robert Graham October 28, 2018 / 2:20 pm

    With 99.99% of the media, print and broadcast ,regurgitating SNP bad and rubbish stories on a daily basis while omitting any progress made in many areas and many successful projects our government are actually doing to make life a little better for many people, it’s a bloody wonder anyone still supports the SNP ,
    These folk myself included see through this total rubbish but obviously it hasn’t gotten through to firstly the women council workers who were stabbed in the back by their Union and the Scottish Labour Party and yet they blame the SNP ,the only party that will solve their problems , next the teachers who seem to believe a pot of gold is available to the Scottish government and they are being spiteful and not giving them a increase to their salaries that already equal or exceed the UK average ,
    I would have thought educated people could see through what the unions egged on by the Labour Party are up to , they can’t be elected so they engage in political terrorism using uninformed people to attempt to remove the SNP government, how bloody short sighted can these people be , the only protection they have from Westminsters crushing cuts , and they want to remove them, bloody bonkers and stupidity .

    Liked by 3 people

  4. Bugger (the Panda) October 28, 2018 / 3:09 pm

    Polls exist not to represent reality but nudge, nuance, lead or just misrepresent reality

    Liked by 2 people

    • Fraser Mac October 28, 2018 / 5:17 pm

      If that’s the case the snp would ever won in 2007 or 2011 or 2016 etc

      Like

      • Bugger (the Panda) October 29, 2018 / 10:59 am

        4 things, yFraser,

        Networking
        Foot Soldiers
        Internet
        Record falls in trust in Printed Press and, especialy, BBC News.

        And a feeling that the time has come, enough is enough

        Distrust

        Like

Leave a comment