A New Adventure Begins for Program Quality!

PROGRAM QUALITY ASSESSMENTS

Presented by: Anne Reeder, Program Quality Assessment Coordinator

DESE Grantee WorkshopSeptember 19, 2013

TODAY WE WILL COVER…

• What are the PQAs?

• Why are we doing the PQAs?

• How will this actually work? (Who, when, where…)

WHAT ARE THE PQAS?

• Weikart Center for Youth Program Quality

• School Age Program Quality Assessment (SAPQA)

• Youth Program Quality Assessment (YPQA)

• STEM Add-On to YPQA

WHAT ARE THE PQAS?

• A validated instrument designed to assess the quality of youth programs and identify staff training needs,

• A set of items that measures youth access to key development experiences,

• A tool which produces scores that can be used for comparison and assessment of progress over time.

SELECTION OF THE PQA

• State-of-the-art instrument

• Good evidence for reliability and validity

• Measures what we know is our unique contribution to youth success

• Many other states are also using the PQAs

• Ability to compare to other programs

• Ready-made package of support

WHY ARE WE ADDING THE PQAS?

• 21st CCLC funding is a hot topic of discussion in DC

• DESE needs consistent data to support Missouri’s use of funds

• Current program evaluations do not provide a comprehensive, across-the-board picture

• Several other states have adopted the PQAs for consistent measures

l

National Organizations:

Light Green- full-state implementation

Dark Green- place-based implementation

Gold- full-state + place-based

YPQI Quality Improvement Systems

PQA Downloads: 533 Youth PQA

457 School-Age PQA

Individual Box Sets= 20 sites

WEIKART CENTER REACH IN 2012-2013

>21,125 StaffEstimate based on mean of 6.5

staff per site in YPQI Study Sample

85 Networks/Systems

>276,250 Child & YouthEstimate based on mean daily attendance of 85

youth per day in YPQI Study Sample

>3250 Sites

l

21ST CENTURY COMMUNITY LEARNING CENTERS

Aqua– Statewide quality improvement system Blue - City or School District quality improvement systemYellow - Youth PQA used as part of statewide evaluationPurple- Statewide quality improvement system and statewide evaluation

PQA CONTENT

WHAT WILL THE DATA BE USED FOR?

• Another point of data for your program’s External Evaluation

• A point of data for you and your coach (ARE) to include in your Action Plans

• By using a consistent valid tool, DESE will have better data to submit to the USDE.

• Better Data = More Money for programs

PQA

PROCESS• Who are the assessors?

• 4-H Youth Development Specialists or MU HDFS Specialists

• Intense multi-day inter-rater reliability training

• Scheduling

• Anne Reeder will handle all aspects of scheduling

• You will need to provide in advance a copy of the site’s schedule for the day of the observation

• Observation

• No surprises

• No more than 3 hours

• Scores Reporter

SAMPLE PQA REPORT

PQA SUMMARY REPORT

PAQ SUMMARY REPORT

PQA SUMMARY REPORTThe online Reporter has determined the following suggestions for professional development based on the three lowest scoring items in this report. The Scores Reporter makes suggestions automatically and based solely on scores. These suggestions are not meant to replace the thoughtful conversations of staff members during an improvement planning process, but are provided for consideration and to enhance discussion.

Building Community

Creating a safe space in which you feel a sense of belonging is beneficial for their growth and learning (National Research Council and the Institute of Medicine, 2002). When youth get to know each other, don’t leave other youth out, think of the program as theirs, and get recognized for their accomplishments, they build relationships with peers and adults.

(National Research council and the Institute of Medicine (2002). Community Programs to Promote Youth Development Washington, DC; National Academy Press. 96-99)

Reframing Conflict

An approach in which adults support youth in addressing their conflicts and problems helps build a healthy, cohesive group and can produce growth and learning for young people. The HighScope youth-centered approach involves a nonthreatening matter-of-fact attitude and helps youth have a voice in determining both the cause and the solution to the conflict. It is a problem-solving approach that seeks to turn conflicts into learning opportunities.

PQA SAMPLE REPORTStructure and Clear Limits

Structure and clear limits can provide a strong foundation to a youth program. An appropriate structure with routines, activities, and rituals sets the stage. Clear limits establish what’s okay and not okay and can ensure a safe program climate. When done well, structure and clear limits can provide the space kids need to explore and express themselves, a feeling of fairness, and the predictability that young people learn to count on to meet their needs (National Research Council and Institute of Medicine, 2002).

(National Research Council and the Institute of Medicine. (2002). Community Programs to Promote Youth Development. Washington, DC: National Academy Press. 91-94)

Youth Voice

Providing young people with chances to make decisions about their activities and how they carry them out can improve motivation and buy-in, and more importantly, offering choices in the solace of a youth program space gives youth a chance to practice for the bigger choices they’ll make outside of the program.

COACHING - METHODS TRAININGS

Questions

Thank you and enjoy the rest of your conference!