GESIS Panel Attitudes and Behavior 5. Quality-of-Life and Well-being 6. Information and Communication Technology Usage 7. GESIS Panel Survey Participation Evaluation and Survey Mode

1

GESIS PanelAn Open Omnibus Access Panel for the Social SciencesInformation for Primary Researchers and Data Users

Prof. Dr. Michael BosnjakTeam Leader GESIS Panel

#GESISPanel @gesis_panel

Study planning Archive and registering

Research

Data collection Data analysis

GESIS services are organized around user requirements

§  Pretes4ng is generally considered to be indispensable for the successful development of a ques4onnaire

§  The GESIS Pretest Lab offers the following services: -  Conduc4ng cogni4ve pretests in the lab or

„in the field“ -  Conduc4ng eye movement analyses (eye tracking) in combina4on with

cogni4ve pretests -  Consul4ng on choosing and independent usage of various pretes4ng

methods -  Consul4ng on ques4onnaire design

§  Further informa4on about the GESIS Pretest Lab:

www.gesis.org/unser-‐angebot/daten-‐erheben/pretestlabor/

Example: GESIS Pretest Lab

Study planning

Research

Data analysis

Focus of today´s GESIS Panel presentation

Data collection

Archive and registering

5

Deliverables

•  Providing free data collection services for social scientists within a mixed-mode access panel (offline & online) representative for the German population (18-70 years of age).

•  Providing free access to the data collected within the mixed-mode access panel to the social science community.

•  Enabling knowledge transfer on how to build and operate a representative panel.

•  Generating methodological findings on access panel data quality issues (publications, guidelines, standards).

6

Deliverables : Roles / Target Groups





Panelists

Primary Researchers

Data Users

Academic Panel Provider

Survey Methodologists

7






Panelists

Primary Researchers

Data Users



8

Basic Access Panel Characteristics

•  Probability-based access panel of individuals: General population in Germany, German speaking, 18-70 years

•  Recruited panelists from population registers and 7500 face-to-face interviews (CAPI)

•  N= 4000 (approx. starting sample for 2014) •  Multi-mode surveys:

–  Web-based surveys (approx. 65% of panelists) –  Mail surveys (because of Internet coverage deficits in DE

and sample composition bias concerns; approx. 35% of panelists)

•  Experiments among Web-based panelists only •  At least bi-monthly data collection waves scheduled,

approx. 20 minutes of interviewing time each

9

Waves and Accepted Study Designs

•  Single-wave studies: Cross-sectional designs (e.g., S1, S4) •  Multiple-wave, longitudinal studies (e.g. S2, S3), including:

– Multiple cross-sectional designs (e.g., S2) – Panel designs (e.g., S3)

•  NOT considered: Cohort (sub-sample) studies

S2.W1 S2.W3

S2.Wk S1.W1

S4.W2 Sx.Wk 20 m

inutes

Wave 1 Wave 2 Wave 3 Wave k

... ...

4me

S3.W2 S3.W3

10






Panelists

Data Users


Primary Researchers


11

Target Group: Primary Researchers hWp://gesispanel.gesis.org/submission/

12

Target Group: Primary Researchers hWp://gesispanel.gesis.org/submission/

Material to be prepared:

1.   Proposal (structured abstract according to template)

2.   Survey(s) (GPX-‐format, one per wave)

3.   XLS Codebook(s) (one per wave)

13

Target Group: Primary Researchers GESIS Panel Proposal Submission Template

Proposal submission slots to be addressed (brief overview): (1) PI descrip4ves (2) Overall problem statement and (theore4cal) background (3) Objec4ves (4) Items to be used from GESIS Panel Longitudinal Core Study (5) Research ques4on(s) and/or Hypothesis/es (6) Research design (7) Instrument(s) (8) Planned analyses (9) Expected conclusions and implica4ons (10) Dissemina4on strategy (11) References

14

GESIS Panel Longitudinal Core Study

GESIS Panel !Focus: Access panel data quality indicators/determinants,

´evergreen´ topics most likely demanded by omnibus passengers

LISS!http://www.lissdata.nl/lissdata/Research/LISS_Core_Study

1.  Work and Leisure 2.  Political and Social Participation 3.  Personality and Personal Values 4.  Environmental Attitudes and Behavior 5.  Quality-of-Life and Well-being 6.  Information and Communication Technology Usage 7.  GESIS Panel Survey Participation Evaluation and Survey Mode Preferences

1.  Health 2.  Politics and Values 3.  Religion and Ethnicity 4.  Social Integration and Leisure 5.  Family and Household 6.  Work and Schooling 7.  Personality 8.  Economic Situation and Housing

15

Target Group: Primary Researchers GESIS Panel Ques4onnaire Editor (Unipark)

16

Target Group: Primary Researchers Submission Procedure – Step 1

Step 1: StarGng the submission Tick off the checklist and make sure that all items are prepared for the upload in the subsequent step. You can add comments (op4onal). Save and Con4nue for proceeding with Step 2.

17


Step 2: Uploading the proposal Please follow the instruc4ons on the page. Save and Con4nue for proceeding with Step 3.

18


Step 3: Entering the Submission’s Metadata Fill out the form. Add Title and Abstract. Provide items for indexing the submission. Iden4fy Contributors and Support Agencies. Save and con4nue for proceeding with Step 4.

19


Step 4: Uploading Supplementary Files Upload your survey project files, namely (1) your Unipark GPX file(s) and (2) your XLS codebook(s). In case of mul4ple-‐wave studies: Please upload the survey project file(s) for each and every corresponding data collec4on wave.

20


Step 5: Confirming the Submission Check the integrity of your uploaded files. Finish your submission.

21


Your submission is now complete. You can find your proposal in the User Home sec4on and can track the status of your proposal.

22






Panelists

Data Users



Primary Researchers

23

Target Group: Data Users

Data dissemina4on portal for incremental master-‐dataset and codebook (versioning, much like

EVS)

Data dissemina4on portal to generate

customized data sets

24

www.gesis-panel.org

#GESISPanel @gesis_panel

25

Nonresponse Reduction Measures

Development Stages and Surveys Measures and Procedures

Address register -‐> Random selecGon of households -‐> IdenGficaGon of respondents via last birthday method.

Non-‐cooperaGng municipaliGes

Welcome Survey (Mail, Web)

Ini4al Survey Waves (Mail, Web)

Wave aa: August (Mail, Web)

Wave ab: October (Mail, Web)

Wave ac: December (Mail, Web)

Fieldwork

Sampling Frame (270 SP)

Recruitment Interview (CAPI)

Contact Interview Compliance

Non-‐Contact

RejecGon (Interview)

RejecGon (Panlist)

Postal leWers; Four contacts; Contact cards; 0800-‐ Hotline; Electronic AAPOR-‐compliant contact protocol;

Experienced interviewers; Interviewer training.

Short interview (max. 20 mins), Two-‐sided incenGves, PersonalizaGon; Tailored mode offered (online, offline)

Non-‐Response (Unit-‐/Item-‐)

Prompt invitaGon; Prepaid monetary incenGve by mail; Reminder strategy; Mode-‐switch opGon;

24/7 Hotline; Mixed-‐mode and Unimode design

Non-‐Response (Unit-‐/Item-‐),

Within and Between Waves

Mode-‐

Noncompliance

Prepaid monetary incenGves per wave; Reminder strategy;

Mode-‐switch opGon (offline > online); 24/7 Hotline;

Self-‐service environment for online panelists; Mixed-‐mode and Unimode design

26

2013 Surveys

Current and Scheduled Surveys Study Units

Compliance and Educa4on

Respondent Profile

Recruitment Interview (CAPI)

Welcome Survey (Mail, Web)

Ini4al Survey Waves (Mail, Web)

Wave aa: August (Mail, Web)

Wave ab: October (Mail, Web)

Wave ac: December (Mail, Web) Internal Studies

27

Target Group: Panelists: 2013 Surveys

Mixed-‐Mode (Online, Offline) Panel Portal

28

Target Group: Panelists

29

Target Group: Research Community

•  GESIS Pilot Panel Data: –  Incentive effects –  Conditioning and attrition effects –  Mobile participants

•  GESIS Panel: –  Sample composition and measurement quality differences in various

development stages (in relation to external benchmarks) –  Panel conditioning (desired and undesired) –  (Non)Response-related indicators (different types of nonresponse, including

panel attrition) –  Undesired and fraudulent survey behavior

For instance, random responding, illogical or inconsistent responding, overuse of item non-response (“Don’t Know”), speeding (too rapid survey completion), deliberate misreporting.

30

Organizational Structure

Tanja Dannwolf Ines Schaurer

Bella Struminskaya

Tobias Enderle Gabi Wahlig Angela Tanner Benjamin Zapilko Jessica Trixa

Documents

GESIS Panel Attitudes and Behavior 5. Quality-of-Life and Well-being 6. Information and Communication Technology Usage 7. GESIS Panel Survey Participation Evaluation and Survey Mode