Improving Quality SystemwideOctober 11, 2012
What is your role in afterschool?
NEW RESOURCE: BUILDING CITYWIDE SYSTEMS FOR QUALITY
NEW resource from The Wallace Foundation and the Forum for Youth Investment, available online:
http://forumfyi.org/building_system_quality
Includes:• How-to guide• Six case studies• Capacity self-assessment tool
TODAY’S SPEAKERS
Nicole YohalemDirector, Special Projects
Charles SmithExecutive Director, CYPQVP for Research, Forum for Youth Investment
Laura La FuenteDirector, Target Graduation
Denice WilliamsAssistant Commissioner
WHY FOCUS ON QUALITY IMPROVEMENT?
• Quality Matters• Quality is Measurable• Quality is Malleable
QUALITY MATTERS
In a 2007 meta-analysis of 73 evaluations, afterschool programs on average had positive effects on:
Attitudes toward schoolSocial behaviorSchool grades and achievement test scoresReduced problem behaviors from aggression
But programs without specific quality features had NO effect.
-Durlak & Weissberg (2007)
QUALITY IS MEASURABLE
Tool & Developer Common Elements of Quality
Afterschool Program Assessment SystemNational Institute on Out-of-School Time
Youth EngagementSkill-BuildingRelationshipsEnvironmentRoutines & StructureBehavior ManagementOrganizational ManagementFamily/Community Linkages
Youth Program Quality AssessmentDavid P. Weikart Center for Youth Program Quality
Youth Program Quality Monitoring ToolPolicy Studies Associates
QUALITY IS MALLEABLE
Key findings from the Youth Program Quality Intervention (YPQI) Study
A continuous quality improvement strategy:
• Improves program quality (and the more, the better).
• Works across different types of afterschool systems as well as challenging staffing conditions, and may increase staff tenure.
• Appears to be sustainable and cost-effective.
- Smith et al (2012)
www.cypq.org/ypqi
Improving Quality Systemwide
Charles SmithExecutive Director, Center for Youth Program Quality
VP for Research, Forum for Youth Investment
COMPONENTS OF AN EFFECTIVE QUALITY IMPROVEMENT SYSTEM (QIS)
Shared definition of quality Lead organizationEngaged stakeholders Continuous improvement modelInformation system(s) Guidelines and incentives for participation
Adequate resources
BUILDING A QIS: STAGES AND TASKS
How far along are you in building a quality
improvement system?
Improving Quality Systemwide
Laura LaFuenteDirector, Target Graduation
United Way for Greater Austin
2007
Since 2008:
• 294 assessments were conducted
• 38 organizations were assessed
• 481 individuals have participated in at least one training
• 34 individuals were trained as Methods trainers – 17 are still active
• 32 individuals were trained as External Assessors – 22 are still active
Spring 2008
Fall 2008
Austin’s Ready by 21 Coalition awarded Quality Counts grant
United Way, Central Texas Afterschool Network and Ready by 21 began building and implementing Austin improvement systems.
First Austin sent first cohort of Methods trainers
United Way trained first set of assessors
HISTORY OF YOUTH PROGRAM QUALITY AT UNITED WAY FOR GREATER AUSTIN:
Fall 2012Out-of-School Time Agenda
YOUTH PROGRAM QUALITY INITIATIVECYCLE OF IMPROVEMENT
Assess Program (External or Self
Assessor): Collect data about your program.
Create Improvement Plan: Develop a plan based on collected
data.
Attend Professional Development: Staff attends professional
development sessions that align with what
they want to improve.
Assess Program Again (External or Self
Assessor): Reassess the program and see if areas have improved.
More Professional Development: If the plan was successful,
have more staff attend the professional development.
Improving Quality Systemwide
Denice WilliamsAssistant Commissioner
New York City Department of Youth & Community Development
DYCD funds nonprofits to provide a wide range of high-quality programs including:Adolescent LiteracyThe Out-of-School Time InitiativeBeacon Community CentersCornerstoneSummer Youth EmploymentTEEN Action/Service Learning
17
DYCD Out-of-School Time InitiativeNYC Department of Youth and Community Development
Elements of the Out-of-School Time System
Quality Services
Capacity Building
Evaluation
ProgramsRFP, New Program
Design & Required Program Activities
New Workscope and
Budget Program Quality Monitoring Tool
(PQMT), Coaching & Observing for Quality & Annual Evaluation
(VENDEX )
Professional Development,
Technical Assistance & Conferences
DYCD Online
19
DYCD Out-of-School Time2013 Program Orientation
INFRASTRUCTURE TO SUPPORT QUALITY
KEY ISSUES IN BUILDING A QIS
1. Stakeholder engagement
2. Clarifying purpose
3. Sustainability
NEW RESOURCE: BUILDING CITYWIDE SYSTEMS FOR QUALITY
NEW resource from The Wallace Foundation and the Forum for Youth Investment, available online:
http://forumfyi.org/building_system_quality
Includes:• How-to guide• Six case studies• Capacity self-assessment tool
Improving Quality Systemwide will be archived at: www.wallacefoundation.org
and www.forumfyi.org
Please direct follow up questions to: Nicole Yohalem at [email protected] or
(202) 207-3344
Thank you for participating!