Qualitative Methods vs. Quantitative Methods. Qualitative Methods? Quantitative Methods?

Qualitative Methodsvs.

Quantitative Methods

Qualitative Methods?

Quantitative Methods?

(Some) Qualitative Methods

• (Participant) Observation

• Structural Analysis

• Case Studies

• Interviewing

• Questionnaires/Surveys

Surveys and Questionnaires

Why would you use Questionnaires and how would

you create and administer them?


• Why?

– One of the most common ways to gather data– Can be tailored to your needs– Can be an effective research source


• How?– Need to know

• Difference between question types• Techniques for question wording• Techniques for overall design of questionnaire• Finding a sample population• Effective ways to distribute and enhance the return

rate of questionnaires


Question Type• The more structured a question, the

easier it is to analyze• Many types of questions, but seven main

ones1. Verbal (or “Open”)2. List3. Category4. Ranking5. Scale6. Quantity7. Grid


Question Wording– What to watch: Ambiguity, Imprecision, &

Assumption• Perceived Commonality

– In-situ example: How much time, on average, do you spend studying? a) a great deal; b) a little bit; c) not at all

• Memory• Knowledge• Double Questions: e.g., “Do you attend math and

chemistry classes?”• Leading Questions: e.g., “Do you agree that

mature students earn better grades?”

Question Wording– What to watch: Ambiguity, Imprecision, &

Assumption• Presuming Questions are usually formed by a

researcher’s strong opinions or feelings – and not everyone feels that way; e.g., “Does the University provide Adequate Counseling?”

• Hypothetical Questions: “If you had no family responsibilities and plenty of money, what would you do with your life?”

• Offensive/Sensitive Issues (e.g., specific age, sexual orientation, grades, etc.)



Question Design– No matter how perfectly worded, a

questionnaire will lose much of its impact if it looks untidy

– Some guidelines:• Typed; nice, easy-to-read font• Clear instructions• Spacing (white space) between questions• Check boxes?• Order of questions is very important• Allow space for computer scoring (if applicable);

make certain of its impression


Finding a Sample

– Dependent on your time and project– Location– Should be representative of population in

your project

Distribution and Return of Questionnaires

– Face to face is best• Can explain questionnaire and take-back

immediately once complete

– If must leave-out/mail, include:• Explain the purpose of the study• Outline anonymity, if applicable• What approvals have been given (and by whom)• Indicate what will be done with the information



Reliability

• How reliable is your test, measurement, or survey?

• The extent to which a test (or survey or measurement) produces similar results under constant conditions on all occasions

• How to “test” for reliability– Test-retest– Alternate forms– Split-half

Validity

• Are the parts of your test, measurement, or survey a valid?

• Makes sure that an item measures what it’s supposed to measure– Unreliable = invalid; BUT reliable does not

necessarily = validity– Examine your items critically:


Example of a Survey: Good or Bad?-------------------------------------------

Evaluation of GCU674, Geographic Techniques for Teachers

Instructor: _____________________________Date: _____________________________

Please rate the following: "Great!" "Pretty Good"

"Just OK"

"Not Very

Helpful"

"Total Waste of

Time"

The information presented helped me understand basic techniques used in geography

The presenter clearly explained the information

The handouts were helpful

Do you still need to talk with your instructor to help clarify information about geographic techniques?

Would you use any of the information in your future research endeavors? Yes No

Comments:

IRB…or, is the Survey Harmful?

Institutional Review (IRB)

• An Institutional Review Board is a diverse group of scientific and non-scientific individuals who conduct the initial and ongoing review of behavioral and clinical research studies involving human subjects.

• It is the responsibility of the IRB to review all material related to a study to be sure standards of ethics are maintained. This is especially important in items that will be viewed by the study patient, such as the Informed Consent document, advertisements, diaries, and informational brochures.

• Often follow the “scientific method”– Create hypotheses, theories, models – Construct instruments and/or methods for

measurement and/or testing of hypotheses– Attempt to investigate, manipulate, and/or

control variables – Compile data – Replicate/Model and analyze data – Assess outcomes

• Stats, models, graphs, charts, tables, etc.

(Some) Quantitative Methods

Quantitative Data?

What is an Index?

• A way to Quantify the Unquantifiable

• Examples:– From everyday Life?

• Ranking movies, ranking hotels, ranking restaurants, best schools, best cities

– From schooling?• SAT, your GPA, grading scales in classes

– From geography?• Palmer Drought Severity index, Moh’s hardness

scale, sand mobility index, soil development index

Qualitative vs. Quantitative

• Can they overlap?

• “Mixed method” approach– Can use one or the other, or both– Must use each correctly– What if no previous research exists?

Reading

• Tufte, Edward. 1983. The Visual Display of Quantitative Information.

Documents

Qualitative Methods vs. Quantitative Methods. Qualitative Methods? Quantitative Methods?