Action Research Data Collection 06

8/8/2019 Action Research Data Collection 06

http://slidepdf.com/reader/full/action-research-data-collection-06 1/19

Data Collection

Action Research Workshop

July 25, 2006Prepared by Margarida Southard, Ph.D



Data Collection

This section will help you todetermine what data is needed and

how to develop a data collectionplan for your action research.



Three Important Qualities

Validity

Reliability

Generalizability



Triangulation

Collect data from morethan one source, atmore than one point intime.

Using three sources of

data to paint a pictureabout whatever you are

studying is calledtriangulation.



Steps in Data Collection

Determine what data is needed

Select data sources and/or

techniques for gathering data

Identify key performance

targets (dependent variable)

Develop data collection plan



Key questions for selecting

data sources

Does it suit the research question youhave in mind?

Can you afford the time to gather,record, and reflect using this technique?

Will a different source provide more

appropriate data?

Will the data be available on time?



DATA SOURCES Attendance rates Interviews

Weekly assessments Student participation rates

Tests, quizzes, homework Performance assessment results

Observational notes Student’ portfolio of daily work

Rubrics/scales/checklists Student projects

Student, staff, parent surveys Referral Rates

Discipline incidents Diaries/journalFocus Group findings Logs (meetings, excursion).

Report card/Grade Book Photography/Videotape

Lesson Plans Time-on-task analysis



Rating Scales/Rubrics

Checklists: To indicate the absence orpresence of a particular behavior orproduct.

Numerical Scale: The rater uses anumerical scale, such as 1 to 5 to judge

specific traits of a performance, process,or program.



Rating Scale/Rubrics

Qualitative Scale: Rely on descriptionrather than numbers to interpretperformance of a student. These scalesvary from a single word summary todetailed categorical descriptions.

Example: Poor, Acceptable, Good,

Excellent



Achievement Tests

Norm-referenced tests (FCAT NRT,SAT/10).

Criterion-referenced tests (FCAT SSS,

Writes Upon Request). Tests developed by teachers.

Tests developed by publishers(Compass, Success Pearson, STAR,

Accelerated Reader, DIBELS).



Written Surveys Favorite data-gathering technique

for action research.

Used to collect information todescribe, compare, and explain

knowledge, attitudes, perceptionsor behavior.



Survey Questions

You must ask questions that are:

valid and reliable

understandable quick to complete

able to get the first response from the respondent

Consider disaggregation and confidentiality

issues



Surveys: Helpful hints in

Developing the Questions

Remember your survey’s purpose

Keep your questions simple Place easy items at the beginning

Difficult items in the middle Sensitive items in the middle

Avoid leading questions



More on writing good survey

questions ..

Avoid double barreled items (itemswith two questions in one item)

Avoid jargon or complex words Consider using open questions

Consider a “Don’t Know” response Provide a meaningful scale



Some Bad Items and

Interesting Responses

Where were you born? In a hospital

Are you a natural born citizenof the U.S? no cesarean

What was your length of residence in your hometown?about 40 feet

Would you use a bathroomsanitizer? Yes we need sanity in the bathroom



Interviews

Advantages over questionnaires Permits greater depth.

Permits probing.

Make it possible to establishrapport.

Appropriate for children.

Disadvantages

Time consuming and expensive.



Focus Group

Focus group is a prompted discussionthat provides a method of data-collection in which ten to twelve

participants gather together to discussissues with which they are familiar.

Advantage of focus groups overone-to-one interviews



Sampling

Process by which subjects/cases are selectedfor study.

Involves selecting small group (sample) of cases from a large group of cases(population).

One way to insure that the sample will berepresentative of the larger population is to

draw a random sample.



Preparing the Data Collection

Plan: The 6 W’s

WHY are we collecting this data? WHAT exactly are we collecting?

WHO are the subjects? WHERE will we collect the data?

WHEN are we going to collect? WHO is going to collect?

Documents

Action Research Data Collection 06