Interpreting Qualitative Interpreting Qualitative Research DataResearch Data

KIN 251KIN 251Dr. Matthew MasucciDr. Matthew Masucci

Class AgendaClass Agenda

What is academic research?What is academic research?What is qualitative research?What is qualitative research?How does qualitative research differ from How does qualitative research differ from quantitative research?quantitative research?Establishing Establishing ““rigorrigor”” in qualitative researchin qualitative researchAnalysis & interpretation of qualitative dataAnalysis & interpretation of qualitative dataInIn--class exercise: Analyze & interpret class exercise: Analyze & interpret qualitative research articlesqualitative research articles

What is Academic Research?What is Academic Research?InIn--Class ActivityClass Activity

What do you think academic research is?What do you think academic research is?Are there different paradigms of research?Are there different paradigms of research?What methods do researchers use?What methods do researchers use?Does research always test hypotheses?Does research always test hypotheses?What is the value of research? What is the value of research? How do researchers gather data?How do researchers gather data?How do researchers present data?How do researchers present data?Are there assumptions that underlie ones Are there assumptions that underlie ones researchresearchHow do we evaluate research?How do we evaluate research?

What is Qualitative Research?What is Qualitative Research?Definition:Definition:

““Qualitative research is a situated activity that locates the Qualitative research is a situated activity that locates the observer in the world. It consists of a set of interpretive, observer in the world. It consists of a set of interpretive, material practices that make the world visible. These material practices that make the world visible. These practices transform the world. They turn the world into a practices transform the world. They turn the world into a series of representations, including field notes, series of representations, including field notes, interviews, conversations, photographs, recordings, and interviews, conversations, photographs, recordings, and memos to the self. At this level, qualitative research memos to the self. At this level, qualitative research involves an interpretive, naturalistic approach to the involves an interpretive, naturalistic approach to the world. This means that qualitative researchers study world. This means that qualitative researchers study things in their natural settings, attempting to make sense things in their natural settings, attempting to make sense of, or to interpret, phenomena in terms of the meanings of, or to interpret, phenomena in terms of the meanings people bring to them.people bring to them.”” ((DenzinDenzin & Lincoln, 2003)& Lincoln, 2003)

What is qualitative research?What is qualitative research?Qualitative research involves the systematic use of a Qualitative research involves the systematic use of a variety of empirical materials variety of empirical materials -- case study, personal case study, personal experience, introspective, life story, interview, experience, introspective, life story, interview, observational, historical, observational, historical, interactionalinteractional, and visual texts, and visual texts--that describe routine and problematic moments and that describe routine and problematic moments and meanings in individuals lives.meanings in individuals lives.

Qualitative research deploys a broad spectrum Qualitative research deploys a broad spectrum interconnected methods, in an attempt to get a better interconnected methods, in an attempt to get a better purchase on the research question under investigation.purchase on the research question under investigation.

Qualitative Research as Qualitative Research as BricolageBricolage

The The bricoleurbricoleur (DYI) understands that research is an (DYI) understands that research is an interactive process shaped by interactive process shaped by thierthier own personal history, own personal history, biography, gender, social class, race, and ethnicity and biography, gender, social class, race, and ethnicity and those of the people in the setting.those of the people in the setting.The product of the The product of the bricoleurbricoleur’’ss labour is a labour is a bricolagebricolage, a , a complex, dense, reflexive, collagecomplex, dense, reflexive, collage--like creation that like creation that represents the researchers images, understanding and represents the researchers images, understanding and interpretations of the world or phenomenon under interpretations of the world or phenomenon under analysis.analysis.The The bricolagebricolage will connect the parts to the whole, will connect the parts to the whole, stressing the meaningful relationships that operate in the stressing the meaningful relationships that operate in the situations and social worlds studied.situations and social worlds studied.–– DenzinDenzin & Lincoln (2000)& Lincoln (2000)

Qualitative vs. QuantitativeQualitative vs. QuantitativeQualitativeQualitative QuantitativeQuantitative"All research ultimately has "All research ultimately has

a qualitative groundinga qualitative grounding““ -- Donald CampbellDonald CampbellMiles & Miles & HubermanHuberman (1994). (1994). Qualitative Data AnalysisQualitative Data Analysis p. 40p. 40

"There's no such thing as qualitative data. "There's no such thing as qualitative data.

Everything is either 1 or 0Everything is either 1 or 0““ -- Fred Fred KerlingerKerlingerMiles & Miles & HubermanHuberman (1994). (1994). Qualitative Data Analysis Qualitative Data Analysis p. 40p. 40

The aim of qualitative analysis is a complete, detailed The aim of qualitative analysis is a complete, detailed description. description.

In quantitative research we classify features, count In quantitative research we classify features, count them, and construct statistical models in an attempt them, and construct statistical models in an attempt to explain what is observed. to explain what is observed.

Researcher may only know roughly in advance what Researcher may only know roughly in advance what he/she is looking for. he/she is looking for.

Researcher knows clearly in advance what he/she Researcher knows clearly in advance what he/she is looking for. is looking for.

The design emerges as the study unfolds. The design emerges as the study unfolds. All aspects of the study are carefully designed All aspects of the study are carefully designed before data is collected. before data is collected.

Researcher is the data gathering instrument. Researcher is the data gathering instrument. Researcher uses tools, such as questionnaires or Researcher uses tools, such as questionnaires or equipment to collect numerical data. equipment to collect numerical data.

Data is in the form of words, pictures or objects. Data is in the form of words, pictures or objects. Data is in the form of numbers and statistics. Data is in the form of numbers and statistics.

Qualitative data is more 'rich', time consuming, and Qualitative data is more 'rich', time consuming, and less able to be generalized.less able to be generalized.

Quantitative data is more efficient, able to test Quantitative data is more efficient, able to test hypotheses, but may miss contextual detail. hypotheses, but may miss contextual detail.

Researcher tends to become subjectively immersed in Researcher tends to become subjectively immersed in the subject matter. the subject matter.

Researcher tends to remain objectively separated Researcher tends to remain objectively separated from the subject matter. from the subject matter.

Establishing Establishing ““RigorRigor”” in Qualitative in Qualitative ResearchResearch

1.1. Bracketing interviews (check biases) Bracketing interviews (check biases) 2.2. Member check (review transcripts) Member check (review transcripts) 3.3. Peer review (look over interpretations)Peer review (look over interpretations)4.4. Reflexive journal (ongoing)Reflexive journal (ongoing)5.5. Software (Software (NVivoNVivo, Atlas/TI), Atlas/TI)6.6. Quantification (how many people said what) Quantification (how many people said what) 7.7. Triangulation (alternate sources)Triangulation (alternate sources)8. Cite previous research9. Link purpose of study to paradigm, methods

and findings10. Looking for things that go against what you

think is going on

Analysis & evaluation of qualitative Analysis & evaluation of qualitative researchresearch

10 questions to help you make sense of 10 questions to help you make sense of qualitative research qualitative research (Milton Keynes Primary Care Trust 2002)(Milton Keynes Primary Care Trust 2002)

[Primarily applies to human subject research vs. [Primarily applies to human subject research vs. content analysiscontent analysis for example]for example]

Three broad issues to pay attention to:Three broad issues to pay attention to:–– RigorRigor–– CredibilityCredibility–– Relevance Relevance

10 Questions10 Questions……

1.1. Was there a clear statement of the aims Was there a clear statement of the aims of the research?of the research?

2.2. Is a qualitative methodology appropriate?Is a qualitative methodology appropriate?3.3. Was the research design appropriate to Was the research design appropriate to

address the aims of the research?address the aims of the research?4.4. Was the recruitment strategy appropriate Was the recruitment strategy appropriate

to the aims of the research?to the aims of the research?5.5. Were the data collected in a way that Were the data collected in a way that

addressed the research issue?addressed the research issue?

10 Questions10 Questions……

6.6. Has the relationship between researcher Has the relationship between researcher and participants been adequately and participants been adequately considered?considered?

7.7. Have ethical issues been taken into Have ethical issues been taken into consideration?consideration?

8.8. Was the data analysis sufficiently Was the data analysis sufficiently rigorous?rigorous?

9.9. Is there a clear statement of findings?Is there a clear statement of findings?10.10. How valuable is the research? How valuable is the research?

InIn--Class ExerciseClass Exercise

In groups of 2In groups of 2--3 you will read and evaluate 3 you will read and evaluate a qualitative research study. a qualitative research study. Using the information from class, make a Using the information from class, make a determination of the determination of the ““qualityquality”” of the study.of the study.What was What was ““goodgood”” and what could have and what could have been improved?been improved?What is the main point of the study?What is the main point of the study?How was data colleted and analyzed? How was data colleted and analyzed? Did the conclusions follow from the data?Did the conclusions follow from the data?