Upload
wai-ho-lau
View
110
Download
0
Tags:
Embed Size (px)
Citation preview
1
2
CHAPTER 11Collecting Primary Data using Questionnaires
3
Learning Outcomes
Understand the advantages and disadvantages of questionnaires as a data collection method
Aware of a range of self-administered and interview-administered questionnaires
Aware of the need to combine techniques within a research project
Able to select and justify the use of appropriate questionnaire techniques for a variety of research scenarios
4
Learning Outcomes (cont’d)
Able to design, pilot and administer a questionnaire to answer research questions and to meet objectives
Able to take appropriate action to enhance response rates and to ensure the validity and reliability of the data collected
Able to apply the knowledge, skills and understanding gained to your own research project
5
Introduction
Questionnaire – used as a general term to include all techniques of data collection in which each person is asked to respond to the same set of questions in a pre-determined order
6
Introduction (cont’d)
Questionnaires should have following criteria:
Careful design of individual questionsClear layout of the formLucid explanation of the purposePilot testingCarefully planned and executed
administration
7
An Overview of Questionnaire Techniques
When to use questionnairesFor descriptive research – use attitude or
opinion questionnaires to identify and describe the variability in different phenomena
For explanatory or analytical research – to examine and explain relationships between variables
8
An Overview of Questionnaire Techniques (cont’d)
Types of questionnairesSelf-administeredInternet-mediatedIntranet-mediatedPostalInterview-administeredTelephone
9
Figure 11.1 Types of questionnaire
10
An Overview of Questionnaire Techniques (cont’d)
Choice of questionnairesCharacteristics of respondentsImportance of reaching a particular
respondentImportance of respondents’ answersSize of sample requiredTypes of questionsNumber of questions
11
12
An Overview of Questionnaire Techniques (cont’d)
Choice of questionnaires (cont’d)Time available to complete data
collectionFinancial implications of data collectionAvailability of interviewersEase of automating data entry
13
Deciding what data need to be collected
Research design requirementsReview the literature carefullyDiscuss the ideas with relevant partiesBe clear about the relationships that
exist between variables
14
Deciding what data need to be collected (cont’d)
Types of variableOpinion variables – record how
respondents feel about somethingBehaviour – record what respondents doAttribute – record respondents’
characteristics
15
Deciding what data need to be collected (cont’d)
Ensuring that essential data are collected Create a data requirements table Decide whether the main outcome of research
is descriptive or explanatory Subdivide each research question or objective
into more specific investigative questions Identify the variables which you need to collect
data
16
Deciding what data need to be collected (cont’d)
Ensuring that essential data are collected (cont’d)
Establish the level of detail required from the data for each variable
Develop measurement questions to capture the data at the level of data required for each variable
17
Designing the Questionnaire
Researcher is clear about the data required and designs a
question
Respondent decodes the
question in the way researcher
intended
Respondent decodes the
question
Researcher decodes the
answer in the way respondent
intended
18
Designing the Questionnaire (cont’d)
Assessing validityInternal validityContent validityCriterion-related validityConstruct validity
19
Designing the Questionnaire (cont’d)
Test for reliabilityTest re-testInternal consistencyAlternative form
20
Designing the Questionnaire (cont’d)
Designing individual questionsAdopt questions used in other
questionnairesDevelop your own questions
21
Types of Questions in a questionnaire
Open-ended
This type of question allows participants to respond in any way they choose. Open-ended questions provide primarily qualitative data, and are frequently used in exploratory research.
Example
What do you feel can improve your studies?
Participants provide answers in their own words.
22
Types of Questions in a questionnaire
Closed-endedIn contrast to open-ended questions, closed-ended
questions require participants to choose from a limited number of responses predetermined by the researcher.
There are 5 basic types of closed-ended questions: (1) Multiple-choice; (2) Categorical; (3) Likert-scale; (4) Numerical; and (5) Ordinal.
Closed-ended questions provide primarily quantitative data, and are frequently used in confirmatory research.
23
Closed-ended questions
Multiple Choice
Use a multiple-choice question when you want your respondents to choose the best possible answer among all options presented.
Example
What is your current student status? (Select one.)
High school Undergraduate Post graduate
24
Closed-ended questions
Categorical
Use a categorical question when the possible answers are categories, and the respondent must belong to one category.
Example
What is your gender? Male
Female
25
Closed-ended questions
Likert-ScaleUse a Likert-scale question when you are trying to determine respondents’ attitudes or feelings about something.
ExampleHow important do you think SAT scores are to a college student’s success? (select one):
Not very important 1 2 3 4 5 Extremely important
26
Closed-ended questions
Ordinal
Sometimes you may want your respondents to rank order their responses. A ranking indicates the importance assigned by a participant to an attitudinal object.
Example
Please rank the importance of the following qualities in a team leader. (Please fill in your rank order in the spaces provided using the numbers 1 through 4)
A team leader should provide support to team members A team leader should give direction for other to follow A team leader should be a good motivator A team leader should handle group conflicts
27
Closed-ended questions
Numerical
When the answer must be a number, ask a numerical question.
Example
What is your current age? (select one)
Less than 18 18 to 29 30 to 39 40 to 49 50 or older
28
Designing the Questionnaire (cont’d)
Designing individual questions (cont’d) Question wording – needs to be checked to
ensure that they are within context
Translating questions – must ensure meanings remain after translation, paying attention to lexical meaning, idiomatic meaning, grammar and syntax, experiential meaning
29
30
Designing the Questionnaire (cont’d)
Designing the survey formOrder and flow of questionsLayout of questionnaire
31
Designing the Questionnaire (cont’d)
Explaining the purpose of the questionnaire
Cover letterIntroducing the questionnaireClosing the questionnaire
32Figure 11.3 Structure of a covering letter
33
Test the Questionnaire
Pilot testing and assessing validity Time how long the questionnaire took to complete The clarity of instructions Were there any questions that were unclear Were there any questions which respondents
omitted Whether the layout was clear and attractive Any other comments
34
Administering the Questionnaire
Internet-mediated questionnaires Simple and clear instructions Should set up an on-line questionnaire website Carefully handle web/questionnaire page
navigation Carefully design so to allow user to
change/modify their answers.
35
Administering the Questionnaire (cont’d)
Postal questionnaires Ensure questionnaires are printed and
envelopes addressed Contact recipients beforehand about the
questionnaires Use a cover letter and a return envelope Assure anonymity and confidentiality
36
Administering the Questionnaire (cont’d)
Telephone questionnaires Ensure to explain to the interviewee about
your research Use clear voice and the right speech speed. Make callback calls for previously
unsuccessful
37
Summary
Questionnaires collect data by asking people to respond to exactly the same set of questions.
Choice of questionnaire will be influenced by research question(s) and objectives
There are five main types of questionnaires: internet- or intranet-mediated, postal, delivery and collection, telephone and interview schedule
38
Summary (cont’d)
Know precisely what you need to collect prior to designing your questionnaire
Validity and reliability of the data you collect and response rate you achieve depend on the design of questions, structure of questionnaire and rigour of pilot testing
When designing your questionnaire, you should consider the wordings used and the order that the questions appear
39
Summary (cont’d)
Questions may be open or closedSix types of closed questions: list, category,
ranking, rating, quantity, gridClosed questions should be coded to allow
for analysisOrder and flow of questions must be logical
to respondentsQuestionnaire should be laid out so that it is
easy to read and responses easy to fill in
40
Summary (cont’d)
Questionnaires must be introduced carefully to respondents to ensure higher response rate
All questionnaires should be pilot tested to assess validity and reliability
Administration of questionnaires needs to be appropriate to the type of questionnaire