34
‘A Brave New World’: The End of the Survey Research Clifford Young, Managing Director of Public Sector and Polling MRA Spring Symposium April 2012 © 2012 Ipsos. All rights reserved. Contains Ipsos' Confidential and Proprietary information and may not be disclosed or reproduced without the prior written consent

Brave New World: The End of Survey Research

Embed Size (px)

DESCRIPTION

Presentation by Cliff Young, Managing Director of Public Sector and Polling, Ipsos. Presented on April 27, 2012 at the MRA Spring Symposium hosted by the Mid-Atlantic Chapter of the Marketing Research Association.

Citation preview

Page 1: Brave New World: The End of Survey Research

‘A Brave New World’: The End of the Survey Research

Clifford Young, Managing Director of Public Sector and Polling

MRA Spring Symposium

April 2012 © 2012 Ipsos. All rights reserved. Contains Ipsos' Confidential and Proprietary information and may not be disclosed or reproduced without the prior written consent of Ipsos.

Page 2: Brave New World: The End of Survey Research

The market and social research world is changing…

2

as a function of the Digital and Virtual

Revolution

Page 3: Brave New World: The End of Survey Research

Three ways to look at these changes

3

Page 4: Brave New World: The End of Survey Research

1. The Aggregator Savages are at the Gate

4

Page 5: Brave New World: The End of Survey Research

Some Aggregator Savages

Page 6: Brave New World: The End of Survey Research

2. The breakdown of metodological Gold Standards...

6

Page 7: Brave New World: The End of Survey Research

Decline of the Landline Telephone Survey

Page 8: Brave New World: The End of Survey Research

Decline of single proprietary Opt-In Panels

• 55% of all market research in the US in done online

• Increasingly difficult to recruit panels

• Especially among younger cohorts

Page 10: Brave New World: The End of Survey Research

3. A socialized-digital world is creating new social aggregations

10

Page 11: Brave New World: The End of Survey Research

Explosion of Facebook as an example

Dec '04 Dec '05 Dec '06 Dec '07 Dec '08 Dec '09 Dec '10 Dec '110

100

200

300

400

500

600

700

800

900

Million Users

Source: newsroom.FB.com

Page 12: Brave New World: The End of Survey Research

New Ways to Interact Socially

Old way… New way

Page 13: Brave New World: The End of Survey Research

What are some implications?

13

Page 14: Brave New World: The End of Survey Research

• Exponential increase in the amount of data

• New forms of data collection

• New forms of social organization

• From “narrative” to “experience”

• Increases access to hard-to-reach population

Page 15: Brave New World: The End of Survey Research

BIG QUESTION:

Substitution or Enhancement?

15

Page 16: Brave New World: The End of Survey Research

What is Ipsos doing in light of these social transformations?

16

Page 17: Brave New World: The End of Survey Research

New approaches in changing a world

• Blended Online Sampling

• Socialized Research

• Blended Modeling Both Enhancement and Substitution Strategies

Page 18: Brave New World: The End of Survey Research

Cortex – Routing & Blended Sampling

I-Say

PANEL B

COMMUNITY SITE

SOCIAL NETWORK

REWARDS PROGRAM

PANEL C

AD NETWORKS

Ampario

Traditional

De-d

uplic

ation

LIKELY SURVEY

Single Survey

Single Survey

Cortex Sample

Draws from over 400 non-panel

websites

Page 19: Brave New World: The End of Survey Research

Panel Sample

Non-panelSample

Cortex Router

Sample Parceling

D

CA

B

Blended Online Sampling

Page 20: Brave New World: The End of Survey Research

How do blended samples perform?

20

Page 21: Brave New World: The End of Survey Research

Demographically well……

Household Income

0%5%

10%15%20%25%30%35%

Cortex

CPS

Page 22: Brave New World: The End of Survey Research

Attitudinally too…………….

0%

10%

20%

30%

40%

50%

60%

70%

Satisfied Dissatisfied Unsure/DK

Satisfaction with State of the Nation

Cortex

Pew Research Center

Page 23: Brave New World: The End of Survey Research

Nailing two Republican primaries 2012

Ipsos Online

Average of All Polls

Election Results

0 0.2 0.4 0.6 0.8 1 1.2

0.1

0.2

1

Ipsos Online

Average of All Polls

Election Results

0 2 4 6 8 10 12 14 16

15

8.7

14.6

Ohio Primary

Florida Primary

Page 24: Brave New World: The End of Survey Research

Socialized Research

24

Page 25: Brave New World: The End of Survey Research

Crisis management case study:Enchacement and Social Listening

25

Page 26: Brave New World: The End of Survey Research

Media is not necessarily a leading indicator of consumer sentiment

Difference between what news reports and what people talk about

Page 27: Brave New World: The End of Survey Research

Consumer Chatter Coincides with Social Media Mentions

27

Effective

ResponsiveFamily Values

InnovativeLeader

EthicalSocially Responsible

5/23-6/19 6/20-7/17 7/18-8/14 8/15-9/11 9/12-10/9 10/10-11/0640

45

50

55

60

65

70

75

80

85

90

79

71

68

5961 61

58

60 60

51

62

5253

48

55

45

Before After

Page 28: Brave New World: The End of Survey Research

Cain Smoking Ad:Enchacement and Social Experience

28

Page 29: Brave New World: The End of Survey Research

29

Page 30: Brave New World: The End of Survey Research

Blended Modeling

30

Page 31: Brave New World: The End of Survey Research

Obama 85% chance of winning

Model includes 300 elections and 2 variables all gathered via

the internet

Page 32: Brave New World: The End of Survey Research

2004 2005 2006 2007 2008 2009 2010 2011

Vacations Internet searches for "Vacations"

Do we even need a survey here?

Internet Mentions in Predicting Vacations

Page 33: Brave New World: The End of Survey Research

What are the institutional and human capital demands of this

new world?

33

Page 34: Brave New World: The End of Survey Research

1. Acknowledge that the world is different

2. Need for a more complete toolbox of survey and non-survey approaches

3. “Non-ignorable” to “Conditionally ignorable” world of error

4. Professionals need to have a more eclectic background