Questionnaire Design and Validation BWL 2012

8/18/2019 Questionnaire Design and Validation BWL 2012

1/17

BONY WIEM LESTARI

EPIDEMIOLOGY AND BIOSTATISTICS DEPARTMENT

2012

QUESTIONNAIRE DESIGN AND

VALIDATION


2/17

1. Distinguish between various stages inquestionnaire design.

2. Demonstrate appropriate techniques for

wording questions

3. Validity and Reliability of measurement tool

4. Identify appropriate delivery format ofcertain questionnaire

Learning Objectives:


3/17

What is

Questionnaire

?

A TOOL FOR COLLECTING

INFORMATION TO DESCRIBE,

COMPARE, EXPLAIN, KNOWLEDGE,

ATTITUDES, BEHAVIORS, AND/OR

DEMOGRAPHIC CHARACTERISTICS ON

A PARTICULAR TARGET GROUP


4/17

1. Self administered (mailed or personal contact)

2. In person (face-to-face) interviews

3. Telephone interviews

Questionnaire General Format:


5/17

Types of Questions:

1. Open-ended questions

• Permit free response which should be

recorded in the respondents’ own

words.

2. Closed questions

• Have a list of possible options or

answers from which the respondents

must choose.


6/17

Identify: (Self learning)

1. Advantages & disadvantages of open-ended

questions

2. Advantages & disadvantages of closed

questions


7/17

Steps in Designing A Questionnaire

1. Content Take your objectives and variables asa starting point

2. Formulating questions – Formulate one or more questions that will provide

the information needed for each variable

– Check whether each question measures one thing ata time

– Avoid leading questions

– Avoid words with double or vaguely definedmeanings or that emotionally laden

– Ask sensitive questions in a socially acceptable way


8/17

Steps in Designing A Questionnaire

3. Sequencing the questions – Design your interview schedule or questionnaire to

be ‘informant friendly’

– Use simple, everyday language

4. Formatting the questionnaire

5. Translation

If interviews will be conducted in one or more local

languages, the questionnaire should be translatedin order to standardise the way questions will beasked.


9/17

Conceptualization:

abstract construct – conceptual definition – operasionalization - indicator

Constructing

Testing

Analysis

Revising

Steps in Questionnaire Development:

(Cohen)


10/17

Questionnaire is a tool:

• The quality of a measurement: validity andreliability

Validity:

• the extent to which a test measures what it isintended to measure

•

Free of systematic error• Accuracy


11/17

Questionnaire is a tool:

Reliability:

• The degree to which a variable has nearly the samevalue when measured several times

• Free of random error (chance)• Precision

• Also called reproducibility, consistency

• Assessing precision (reproducibility of repeatedmeasurement):

– Within – between observer

– Within – between instruments


12/17

Reliability:

• Reliability coefficient ~ correlation

coefficient (0 – 1)

• A questionnaire is reliable when the

minimum reliability coefficient is 0.7


13/17

• Criterion validity (predictive and concurrent)

depending on whether the criterion refers to a

current or future assessment

• Construct validity

assembly evidence to support or refute acomplex scientific theory and to show under

what circumstances it holds true

Assessing Validity:


14/17

• Content validity

– refers to comprehensiveness

– how adequate the sampling of questions reflects

the aims of the index that were specified in the

conceptual definition of its scope

Assesing Validity:


15/17

FINAL REMARKS:

•

prior to using a questionnaire it has to be establishedthat the instrument is valid and reproducible in the

context (i.e. population, setting and study design) in

which it is going to be employed.

• conceptually comparable (conceptual equivalence)

• developing a new questionnaire is very time-

consuming

•

burden on respondents• practical aspects of the study


16/17

REFERENCES:

1. Measuring Health: A Guide to RatingScales and Questionnaire. Ian McDowell

and Claire Newell. 1996.

2. Psychological Testing: Design, Analysisand Use. Lisa Friedenberg. 1995.

3. Designing and Conducting Health System

Research Projects. KIT Publishers. WHO.

2003


17/17

What’s Your Message?THANK YOU

Documents

Questionnaire Design and Validation BWL 2012