ch6

Selecting Appropriate Data Collection Methods

Chapter 6

O'Leary, Z. (2005) RESEARCHING REAL-WORLD PROBLEMS: A Guide to Methods of Inquiry. London: Sage. Chapter 6.

It is a capital mistake to theorize before one has data.

-Sir Arthur Conan Doyle as Sherlock Holmes


Data Collection OptionsData collection possibilities are wide and varied with any one method of collection not inherently better than any otherEach has pros and cons that must be weighed up in view of a rich and complex context


The Data Collection ProcessAll methods of collection require rigorous and systematic design and execution that includesthorough planningwell considered developmenteffective pilotingweighed modificationdeliberate implementation and executionappropriate management and analysis


SurveysSurveying involves gathering information from individuals using a questionnaireSurveys can reach a large number of respondentsgenerate standardized, quantifiable, empirical data - as well as some qualitative dataand offer confidentiality / anonymityDesigning survey instruments capable of generating credible data, however, can be difficult


Survey TypesSurveys can be descriptive or explanatoryinvolve entire populations or samples of populationscapture a moment or map trendscan be administered in a number of ways


Survey ConstructionSurvey construction involvesformulating questions and response categorieswriting up background information and instructionworking through organization and lengthdetermining layout and design


InterviewingInterviewing involves asking respondents a series of open-ended questionsInterviews can generate both standardized quantifiable data, and more in-depth qualitative dataHowever, the complexities of people and the complexities of communication can create many opportunities for miscommunication and misinterpretation


Interview TypesInterviews can range fromformal to informalstructured to unstructuredcan be one on one or involve groups


Conducting InterviewsWhen conducting your interviews you will need to question, prompt, and probe in ways that help you gather rich dataactively listen and make sense of what is being saidmanage the overall process


ObservationObservation relies on the researchers ability to gather data though their senses - and allows researchers to document actual behaviour rather than responses related to behaviour However, the observed can act differently when surveilled, and observations can be tainted by a researchers worldview


Observation TypesObservation can range fromnon-participant to participantcandid to covertfrom structured to unstructured


The Observation ProcessThe observation process is sometimes treated casually, but is a method that needs to be treated as rigorously as any otherThe process should include planning, observing, recording, reflecting, and authenticating


Unobtrusive MethodsUnobtrusive methods involve researchers and research processes that are removed from the researchedUnobtrusive methods are non-reactive and capitalize on existing dataBut researchers need to work through data not expressly generated for their proposes that may contain biases


Unobtrusive MethodsUnobtrusive methods includethe exploration of official data and recordscorporate datapersonal recordsthe mediathe arts social artefacts


The Unobtrusive ProcessIn order to gather data by unobtrusive means you need toknow what you are looking forwhere you can find itwhether it can be trustedwhat you can do with it


ExperimentationExperimentation explores cause and effect relationships by manipulating independent variables in order to see if there is a corresponding effect on a dependent variable


ExperimentationPure experimentation requires both a controlled environment and the use of a randomly assigned control groupThis can be difficult to achieve in human centred experiments conducted in the real-world


Real-World ExperimentsThere are many experiments that can only be carried out in the messy uncontrolled environments of the real-world, so the search for cause and effect will require tradeoffs between real-world contexts and a controlled environment


Documents

ch6