Monitoring of Child Progress

Monitoring of Child Monitoring of Child Progress Progress

Shelby County (AL) Early Childhood SPED ServicesProfessional Development

March 22, 2010

William McInerney / Laurie Dinnebeil Judith Herb College of Education

University of Toledo

Support provided by Margie Spino, M.A.

AssessmentAssessmentOne of the purposes of assessment is

intervention planning– What do we need to teach this child? What are

appropriate instructional goals & objectives? What is rationale for these goals & objectives?

– What are the child’s strengths relative to the demands or expectations of skills in the natural environment?

– How will we teach this child?– How should we arrange the environment

(classroom and peer interaction) to facilitate the acquisition and practice of these skills?

AssessmentAssessment• Curriculum Aligned with Head Start

Outcomes:

– The Creative Curriculum for Preschool, Fourth Edition (Trister Dodge, Colker, & Heroman, 2003)

– Preschool Child Observation Record (COR), Second Edition (High/Scope Educational Research Foundation, 2003)

Questions to consider when developing goals from criterion- and curriculum-referenced test

results:

1. What SKILLS were the items that the child failed designed to measure?

2. Do the items that the child failed reflect important concepts or skills that the child needs to acquire?

3. Do separate items that the child failed represent classes of important behaviors?

Questions….. cont.Questions….. cont.

4. What do the failed items say about the child’s overall competence in the across skill areas?

5. Why are these skills important to this child?6. Is this an essential skill for the child to function

in his present and future environments?7. Are there prerequisites for this skill ? If so, can the child perform these prerequisite

skills?

Questions…. cont.Questions…. cont.8. How does the performance of this skill

relate to other skills in this domain or other developmental domains?

Is this skill an important prerequisite to other skills?

Should the focus of instruction for this skill be on acquisition, fluency, maintenance, or generalization?

Wolery, 2004

Alternative AssessmentAlternative Assessment

Ecological Assessment

– Process for generating goals and objectives, identifying instructional strategies, and devising methods of data collection

– Can be implemented in classroom, at home, childcare setting, or the community before or immediately after the child is placed in the setting

Noonan & McCormick, 2006

Ecological Assessment ProcessEcological Assessment Process

1. List daily activities and routines2. List important behavioral expectations3. Rate as “can do” or “needs to learn”4. Formulate goals and objectives 5. Plan instruction6. Plan how to monitor child progress


Ecological Assessment - ExampleEcological Assessment - ExampleActivities/Routines & Expectations

Can Do

Needs to Learn

Comments Objectives

Activity/Routine: Arrival/free play

• Say “Hi” and respond to “How are you?” √

No response – does not look at teacher, just goes inside

Greet teacher (eye contact + verbalization) at the door

• Put belongings in cubby

√ Looks for his photo and pushes his backpack into his cubby

• Select toy, play table or center

√ Just wanders around the room

Select a toy, play table or center


Goal vs. ObjectivesGoal vs. ObjectivesGoals

– Broad & general statements identifying the desired outcome of intervention/instruction

– Describe behaviors child can accomplish during a 9-12 month period

Objectives– Precise and specific

statements that child can reasonably accomplish in 3-6 months

Goals……ExamplesGoals……Examples

• Jared will participate in the morning circle routine.

• Anisa will eat and drink, independently, at snack time and at lunch.

• Anthony will play on the wheel toys and the playground equipment.


Objectives – Quality IndicatorsObjectives – Quality Indicators

• Functionality

• Generality

• Integration

• Hierarchical Relationship

• Measurability and Monitoring


I. FunctionalityI. Functionality

• Will the skill improve the child’s ability to participate, independently or with assistance, in all or most natural environments?

• Will the skill increase appropriate interactions with peers and materials in the natural environments?

Notari-Syverson & Shuster, 1995

Use of Functional Verbs in IEP PlanningUse of Functional Verbs in IEP Planning

• Use actions that can be observed• Examples of Functional Verbs:

– point to, name, write, say, share, sing, put awayExamples of NON-functional Verbs:– improve, understand, increase, exhibit, identify

… will improve his communication skills… will identify her name …

Mcwilliam & Casey, 2008

Functional VerbsFunctional VerbsTo change a nonfunctional to a functional verb

ask what the behavior should look like.

Nonfunctional: … will become involved in circle time …

What does ‘being involved in circle time’ look like?

Functional: … during circle time, Aaron will choose a song from the choice board and sing song with peers …

McWilliam & Casey, 2008

FunctionalityFunctionalityTrue test of functionality is to ask WHY the

child is working on the given goal/objective. If skill is functional, the answer will be immediately apparent.

Helps to add a rationale statement

… skill is necessary so that …… skill is necessary in order to …

… if child could not perform this skill, adult or peer would need to do so

Where in the World is the Where in the World is the “Functional”“Functional” objective: objective:

1. 5 year old Robin will string 5, 1” beads on a string, by herself.

2. 4 year old Traci will verbally respond to another child who asks her a question.

3. 5 year old Justin will follow 2-step directions provided by a familiar adult.

4. 3 year-old Rannon will stack 6,1.5 “ blocks, by himself. Material taken from Project Open House,

Drs Dinnebeil and McInerney

Is That Your Final Answer?Is That Your Final Answer?

If you think that objectives “2” and “3” are functional, you’re right! – Responding to another person who asks a question

is an important skill that will help Traci interact with her peers and be part of the group.

• Traci will verbally respond to another child who asks her a question …..RATIONALE…..so that she can interact with her peers and be part of the group.

– Following multi-step directions is an important skill for Justin to learn because he’s going to need to do that when he goes to kindergarten.

• Justin will follow 2-step directions provided by a familiar adult …..RATIONALE….. in order to be prepared for kindergarten.

Material taken from Project Open House,Drs Dinnebeil and McInerney

What About Stringing Beads What About Stringing Beads and Stacking Blocks?and Stacking Blocks?

• Let’s talk about Robin’s and Rannon’s objectives.

• Can Robin be successful in preschool or kindergarten if she can’t string beads? Will Rannon get along OK if he can’t stack blocks?

• In isolation, string beads or stacking blocks, are not critical skills or behaviors.


The Important Question: What are the skills The Important Question: What are the skills “behind” stringing beads or stacking blocks?“behind” stringing beads or stacking blocks?

Stringing beads or stacking blocks depends on the ability to use your hands to accomplish a task requiring good fine-motor control. These are important skills that allow children to be successful in other settings and are linked to more mature skills (e.g. dressing, printing, use of utensils).

• How could we rewrite objectives for Robin or Rannon so that they are functional?


What are other activities that require What are other activities that require similar fine motor skills?similar fine motor skills?

• Instead of “stringing beads”……Robin will use both hands to complete a task …Such as? …………………………

• Instead of “stacking blocks……Rannon will …………?

Material taken from Project Open House,

Drs Dinnebeil and McInerney

II. GeneralityII. Generality• Can the skill be ‘generalized’ or

demonstrated across a variety of people, activities, materials, and settings/environments?

• Examples:– …will manipulate puppets, block, spoons, and

zippers using both hands …– … during circle time, snack, and outside play …– … with the teacher, peer, or Mom …


III. Integration of SkillsIII. Integration of Skills• Do the child’s peers demonstrate this skill within a

variety of daily activities and routines?• Are there naturally occurring antecedents and

logical consequences for the skill in the child’s daily activities and routines?

• Can the skill be taught and practiced in a variety of activities and settings?

Examples:– … will request help bathroom..accessing materials– … will clean up…. after building center… snack …


IV. Hierarchical RelationshipIV. Hierarchical Relationship

• Is mastering the learning objective necessary in achieving the learning goal?

Example:– Goal: Jackie will participate in morning circle

routine.– Objective necessary to reach that goal:

• In morning circle, Jackie will say “I’m here” when her name is called in attendance roll, on 3 consecutive days.


V. Measurability and MonitoringV. Measurability and Monitoring

• Can the skill be seen and/or heard so that it can be counted?

• Can an example of the skill be recorded?

Purpose of monitoring is to let the team, including the family, know when the objective has been accomplished.


Challenges of MeasurabilityChallenges of Measurability

1. Does the objective measure an appropriate aspect of the target skill or behavior?

WHAT’S WRONG? Jackie will respond to 3 routine questions (roll call, weather, day of the week) in morning circle by pointing to the appropriate picture on her communication device, 80% of the time for a week.



1. Does the objective measure an appropriate aspect of the target skill or behavior?



2. Is it clear how to elicit the target skill or behavior ?

WHAT’S WRONG with this objective? When shown any 2 letters or small pictures

and asked to say “same” or “different,” Jessie will respond correctly, 9 of 10 trials.



2. Is it clear how to elicit the desired skill or behavior?



3. Can performance of the behavior be measured within the context of daily routines and activities?

WHAT’S WRONG with this objective? When shown 10 pairs of 2” letters or small pictures with minimal differences and asked to say “same” or “different,” Jessie will respond correctly 6 of 7 opportunities. Noonan & McCormick, 2006


3. Can performance of the behavior be measured within the context of daily routines and activities?


Activity: Improve the Quality of these IEP Activity: Improve the Quality of these IEP ObjectivesObjectives

1. Sam will exhibit improved ability to express her wants and needs at least 80% of the time.

2. Desmond will manipulate classroom objects 7 out of 10 trials, for 5 consecutive data collection days.

3. Kelly will socialize with his peers appropriately in 3 out of 5 trials.

Activity: Improved IEP ObjectivesActivity: Improved IEP Objectives1.During daily activities (e.g., small group, center time, snack time), when asked “What do you want?” Sam will use 2- or 3-word (agree on 2 or 3, not both) constructions to request items, at least once during 3 different activities, within a 5 day period. In doing so, she will become more independent and others will be able to meet her needs.

Activity: Improved IEP ObjectivesActivity: Improved IEP Objectives2. During snack time, free play time,

or small group time, Desmond will manipulate (e.g. twist open, screw on lid, etc.) 3 different objects or materials that require the use of both hands at the same time, ONCE a day, 4 consecutive observations.

3. Kelly will move toward and remain within 1’ of another children for at least 2 minutes, 3 different times during free-choices times (such as centers), over 3 consecutive days, so that he can participate socially during these routines.

Prioritizing IEP ObjectivesPrioritizing IEP Objectives

1. Some skills may require direct and consistent intervention by EC partner teacher or classroom teacher

2. Effects of maturation and peer interactions should be considered

3. Some skills may be preferred by parent and/or ECE partner vs. other skills

35

4. Some skills or behaviors may be ‘essential’ to success in the ‘Next Environment’ (e.g. K-garten)

5. Some skills or behaviors may develop as a result of peer acceptance and interaction

6. Some skills or behaviors may be acquired via incidental teaching

36

Prioritizing of IEP ObjectivesPrioritizing of IEP Objectives

Prioritizing IEP Objectives - Prioritizing IEP Objectives - Factors to Consider (Factors to Consider (MEPIMEPI))

• Maturation/experience of child

• Expectations and demands of ECE environment

• Peer expectations and intentional peer interaction (planned by ECE/IECSE)

• Need for immediate and intensive Intervention

37

M = Maturation / BiologyM = Maturation / Biology

Evaluate learning objective to determine if ‘target’ behavior / skill is likely to improve as child develops without significant teacher or peer involvement

(e.g. minor articulation problems, grasping of objects, dressing skills)

38

E = Environmental SupportE = Environmental Support

Evaluate learning objective to determine if ‘target’ behavior / skill is likely to improve as a result of child access to materials or teacher ‘engineering’ of learning (or home) environment’.

Will securing items in a variety of containers and placing out of child’s reach result in increased opportunities for fine motor skill development and communication (e.g. seeking desired toy/item with or w/o request for assistance)

39

P = Peer Intervention / SupportP = Peer Intervention / SupportEvaluate learning objective to determine if

‘target’ behavior / skill is likely to improve as a result of child interaction with competent peers. Teacher organization of ‘peer buddies’ and cooperative activity groups will increase opportunities for imitation learning (via peer modeling). Also peer ‘expectations’ for social interaction and communication may provide ‘motivation’ to target child to improve skill or behavior.

40

I = Intensive / Direct InterventionI = Intensive / Direct InterventionEvaluate learning objective to determine if ‘target’

behavior / skill is of IMMEDIATE use or will enhance child’s acceptance in learning community. Examples would include aggressive behavior, very limited communication skills, very limited personal mobility, toilet training (if developmental indicators present). Child would not be expected to make reasonable progress toward acquisition of this skill/behavior without DIRECT and consistent teacher intervention.

41

Prioritizing IEP ObjectivesPrioritizing IEP Objectives

42

Help ECE teacher understand that they don’t have to address EACH IEP objective with the same level of intensity

Use MEPI Model for making rational decisions about how IEP objectives can be addressed

Use the MEPI………Use the MEPI………

1. During snack time, free play time, or small group time, Desmond will manipulate 3 different objects or materials that require the use of both hands at the same time one time a day for 2 consecutive weeks.

2. Emily will use /k/ sounds in the initial position of words, one observation during 5 min. of play/snack/group sessions in 5 consecutive observations.

3. Kelly will move toward and stay within 1’ of other children for at least 15 seconds, 5 different occasions during free-choices times (such as centers), over 3 days, so that he can participate socially during these routines.

Monitoring of Child Progress Monitoring of Child Progress

• Direct Measurement

• Indirect Measurement


Direct Measurement• provides the most accurate representation of a

child’s behavior or skill acquisition and is the preferable approach to use to measure change.

• However, the use of direct measurement by busy families and providers is not often possible. Indirect measurement may offer a more user-friendly approach.

Direct MeasurementDirect Measurement

• Event recording• Percentage• Rate• Interval Recording (Time Sampling)

– Momentary Time Sampling

• Duration• Latency

Technical Assistance Center on Social Emotional Intervention

Event (Frequency) RecordingEvent (Frequency) Recording

• measured by counting the number of times a behavior occurs.

• It is important that a specific behavior has a clear beginning and ending point in order to ensure accurate measurement.

• Example: recording the number of times a child leaves the table in a 20-minute snack time

• Ms. Rita makes a mark on a record form posted on the cabinet near the art area each time Lilly asks for materials during project time.

Technical Assistance Center on Social Emotional InterventionHojnoski, Gischlar, & Missall, 2009

Event RecordingEvent Recording

Week of Monday Tuesday Wednesday

Thursday

Friday

3/1/10

3/8/10

3/15/10

Frequency of Shaking or Banging a Toy for 3 Seconds or More – During Snack Time

Event RecordingEvent RecordingLearning Opportunities

Child’s response

Feedback

Data

CorrectIncorrec

t

No respon

se

Provide objectsTony is interested in or model how to manipulate objects that are part of the activity

Target behavior 1:

Holds object with one hand while other hand manipulates

Comment on how Tony is manipulating the objects and provide physical support if necessary

||| | ||

Encourage Tony to find various written letters using the magnifying glass

Target behavior 2:

Identifies letter names

Affirm when Anthony correctly identifies letters and letter names when needed

| || ||||

Numerical summaries

Target behavior Total Total Total

1 3 1 2

2 1 2 4

Interval Recording/Time SamplingInterval Recording/Time Sampling• Specific time intervals (e.g., I min, 2 min) are

selected and used in observing and recording the target behavior

• Behaviors can be scored as occurrences if they occur at least once at any time during the interval (i.e., partial interval recording) or if they occur for the entire duration of an observation interval (i.e., whole interval recording). – partial interval recording is most often used to measure

behaviors that are likely to be short in duration (e.g., hitting, biting)

– whole interval recording is most often used to measure behaviors that are expected to occur continuously for a period of time (e.g., sitting in seat).

Interval Recording / Time SamplingInterval Recording / Time Sampling

• At the end of the interval period, the observer makes a check mark in the corresponding area to mark the occurrence of a behavior. The observation continues to the end of the next interval, and another mark is made if the behavior recurs.

• Scores for interval recording are calculated as a percentage—the number of occurrences are divided by the number of opportunities, and then multiplied by 100.

• Yields an approximation of the frequency of behavior as opposed to a precise recording of actual frequency.


Interval Recording / Time SamplingInterval Recording / Time Sampling

Partial-Interval Example: Mr. Tom observes during circle time to see if Jay is actively engaged. Because it is difficult to observe and conduct circle time, he uses intervals that correspond to each circle time activity, which are approximately 3 min. Mr. Tom marks “yes” or “no” on a clipboard in the circle area if he observes Jay as actively engaged during any part of the specific activity or interval.

Whole-Interval Example: All the same except, “if he observes Jay as actively engaged during the entire activity or interval.

Hojnoski, Gischlar, & Missall, 2009

Observation Forms - ClassroomObservation Forms - Classroom

• Samples of generic classroom monitoring tools to assess:

• Engagement / On-Task Behavior• Child Preferences for Centers• Child Preferences for Peers

Guidelines for use……

Momentary Time SamplingMomentary Time Sampling

• Interval is divided into a “rest” part and “watch” part. The behavior is only looked for during the “watch” part – at the end of a interval of time (e.g., during the last minute of a 10 minute interval).

• The target behavior is recorded as occurring only if it occurs during the “watch” part (e.g., during the last 5 sec of a 15 sec interval)

• Scores are calculated as % s of the total number of observed intervals.


Play Behavior Child’s Name: _________________ Week of: ______________________ Time: ___:___--___:___ Indicate play behavior at the beginning, middle, and end of each play period. Summarize play behavior by placing totals in summary column. Day/Activity Beginning Middle End Summary

Date:_________ Activity:_______

___Not playing ___Play with toy alone ___Play with toy with peer




Date:_________ Activity:_______





Date:_________ Activity:_______





Weekly Total

___Not Playing ___Play with toy alone ___Play with toy with peer


LatencyLatency• The elapsed time between the instruction and

the time the child initiates the behavior (e.g., how quickly the child initiates playing with a toy once it is presented).

• Measured by beginning timing once a cue is presented and stopping timing when the child begins to correctly respond to the cue.

• Best used with behaviors that have a clear beginning and are signaled by some type of prompt (e.g., compliance)


LatencyLatencyExample: Mr. Andre start his watch when he gives

Leon a direction to line up at the door and stops his watch when Leon complies with the request and has lined up behind his peers.

Hojnoski, Gischlar, & Missall, 2009


Indirect Measurement• informal data collection strategies; not as

precise as direct measurement, but often useful in helping a child’s team monitor outcomes.

• In many instances, these strategies are easier to use and can be implemented throughout the day even by the busiest of individuals (e.g. teachers


Indirect MeasurementIndirect Measurement

• Daily Log

• Permanent Product

• Task Analysis Recording


Daily LogDaily Log

• Although there is a wide variety, daily logs are general estimates of the child’s performance over a prolonged period of time (e.g., the morning, the entire day).

• May note whether the child had a "good day" or might rate a child’s performance along a 5-point scale using range of smiley faces.


Permanent ProductsPermanent Products• Samples of a child’s work

– Writing samples, artwork (e.g., drawings, sketches, constructions, sculptures), diagrams, a worksheet, or something the child creates

• Could be the actual product or a photograph, audio or video recording

• When collected together, permanent products allow a support team to observe a child’s progress toward developing particular skills such as those specified in a curriculum.


Task Analysis RecordingTask Analysis Recording

• Used when measuring a child’s accuracy for each step of a skill sequence (e.g., brushing teeth, getting dressed, putting toys away, completing an academic task).

• The measurement process begins by constructing a task analysis or listing the individual behaviors that constitute the entire skill sequence.


Task Analysis RecordingTask Analysis Recording• The data collection form that is used is

based on the task analysis and includes all of the steps of the behavior and spaces for recording the child’s performance, as well as coding for level of assistance provided (e.g. complete physical assistance, partial prompt, modification of materials). Scores are expressed as the percentage of steps completed successfully. Progress also can be seen in reduction in levels of assistance

Task Analysis RecordingTask Analysis Recording

Example: Washing hands1. Turn on water2. Place hands in water3. Pump soap onto hands4. Rub hands together5. Rinse hands6. Turn off water7. Dry hands on towel

Selecting a Measurement SystemSelecting a Measurement System

• Need clear, specific, precise definitions of the target behavior so that everyone recognizes the behavior when they see it

• Which measurement system depends on the way you wrote the objective (the criterion)

Be creative!Be creative!

• To collect frequency data, put specific number of rubber bands on one wrist and transfer one rubber band to the other wrist each time the behavior is observed.– Or can transfer objects (paper clips, slips of

paper) from one pocket to another• At a later time, record these on a data

sheet.

Use of Everyday Items to Use of Everyday Items to Support LearningSupport Learning

Or.. “What to do When the Toys Go Home”

Documents

Monitoring of Child Progress