Upload
dinhthu
View
226
Download
1
Embed Size (px)
Citation preview
Sparking Curiosity among underprivileged children of India through hands-on Science Education
New Delhi, India April 23-25, 2014
Team Members: • Ajith Basu • Ranganathan Email contact: [email protected] / krragastya@gmail,com
Monitoring and (Impact) Evaluation Methods
Needs Assessment
Process Evaluation
Impact Evaluation
Analysis of Beneficiary Needs
Analysis of Program
Implementation
Measures How Much the Program
Impacts Beneficiaries
1. Services being delivered?
2. Clients satisfied? 3. Services reaching
target population?
4. Can we improve cost-effectiveness?
1. Health of mothers and children improved?
2. Learning outcomes improved?
3. More people in jobs?
4. Less poverty?
1. Why are we doing the project? 2. Who is the target population? 3. Why do we think this approach will work in this context? 4. What else could we do?
PROGRAM INTERMEDIATE
OUTCOMES IMPACT
Simplified Results Chain
Theory of Change
1. Program intervention summary
A. Brief description of program activities and outputs:
• Sparking curiosity through hands-on Science TLM’s leading to Creativity and Leadership
• Supplementing India’s Govt. school education with hands-on, experiential inputs
• Scaffolding system through teacher training
A. Who is targeted? Be detailed on the number and target beneficiaries
• 1.5 M Underprivileged children of India between the age group of 11 to 16 (reached 5 M students so far)
• Govt. school Teachers (100000 teachers so far)
A. Where is it conducted? Example: 20 villages in State X.
• School door steps, our centers and at our campuses / 13 states of India through 100 Mobile Science Labs , 41 science centers, 5 campuses
A. When is it conducted?
• During school hours / academic year
A. Name(s) of implementing organization(s)? Agastya
Target Region : across India / 13 states
3. Summary: results chain
PROGRAM INTERMEDIATE
OUTCOME IMPACT What is the program about? Inputs: Hands-on TLM
in Science, Maths and Ecology
Activities: Activity based / Project based learning – prototyping – peer teaching, science fairs
Outputs:5 million children and 150,000 teachers in 13 states in India exposed to methodologies
Impact indicators? SELF RELIANT ADULT/
innovation based Entrepreneurial traits… LEADING TO ERADICATION OF POVERTY
Intermediate outcome indicators? Increased proportion of
students with Learning & Problem solving abilities – ability / increased ability to plan learning project end-to-end / forming their own learning networks / innovation
4. Data collection: program indicators
A. List program indicators to be collected :
– Reach statistics: number of children attended the sessions, number of exposure per unique child
– Beneficiary Feedback (Students, teachers)
B. Method of data collection (e.g. electronic healthworker interviews, admin data, etc.):
• Session attendance (admin data) / partly electronic & partly paper based
• Interviews with students, teachers(3 each)
C. Frequency of data collection:
• Every working day after every session. (reach stat / admin data)
C. Who will collect the data:
• Team members are trained to collect the data at the field
Target Region : Bhopal District, Madhya Pradhesh (DM Grant Region)
4. Data collection: intermediate and impact indicators
A. List indicators to be collected: – Level of curiosity in science among the beneficiary children
– Factors influencing curiosity: child enquiring concepts through a dynamic tactile models /TLM
- A child is curious, if she:
• Asks more questions and interacts more with instructors and peers
• Writes and takes note
• Observes a lot
• Listens attentively
• Visits library to know more or explore more.
• Makes extra effort to get answers.
A. Method of data collection (e.g. electronic health worker interviews, admin data, etc.):
• Observation of the children while they handle the models for learning
• Questionnaire and interviews
C. Frequency of data collection:
• Beginning of the academic year on a sample group
• End of the academic year - same group
C. Who will collect the data: Impact evaluation agency team members
5. Impact evaluation design
A. Research question:
Does Agastya’s intervention through Science Centre and Mobile Science Lab spark curiosity among children?
A. Describe the intervention in the (add treatment arms, if applicable):
Over the year (1) Group of 400 children with no exposure (2) 400 will get 3 exposures in both the programs – Mobile Lab and Science Center
(3) 400 will get 6 exposures in both the programs
Treatment:
• Mobile Lab – 400 Children – Normal 3 Exposures
– 400 Children – Enhanced 6 Exposures
• Science Centre – 400 Children – Normal 3 Exposures
– 400 Children – Enhanced 6 Exposures
Control:400 children no intervention
A. Describe the program assignment rule: (e.g. random selection of schools):
-random selection
Target Region : Bhopal District, Madhya Pradhesh (DM Grant Region)
6. Communication of results
Key Message 1 (e.g. communicate program impacts on child health): A. What is the nature of the key message?
• “Sparking Curiosity among underprivileged children of India through hands-on Science Education”
6. Communication of results
Target Audiences:
Target Audiences Numbers Nature of Intervention
Govt. School Students between the age group of 11 to 16 (6th to 10 grade)
10000 unique children / 25000 Exposures*
Primary Beneficiary, Direct reach through Mobile Science :a and Science Center
Govt. School Teachers 80 Teachers Primary Beneficiary, Direct reach through Mobile Science :a and Science Center
Policy Body – Govt. / Govt. Officials
Indirect Beneficiary
Community Members / Parents
Indirect Beneficiary
Target Region : Bhopal District, Madhya Pradhesh
(* one exposure is one Agastya interaction with one student per day
6. Communication of results
Communication Tools:
• Website: www.agastya.org
• Newsletter
• Facebook / Social Media
• Exclusive You Tube Chanel and films
• Print Media: articles in key sector magazines
• Participation in Policy Forums
ACTION ITEMS
• Create a dynamic impact assessment model for Agastya
• Create a tool which optimizes resource usage
• Get the staff and orient them about the difference between output and outcomes