Embed Size (px)
Citation preview
Day 3Aims for participants:1.1 To understand evaluation context and key ideas1.2 To share evaluation case studies1.3 To learn about evaluation research and examples
2.1 To recap evaluation methods2.2 To carry out (video) interviews2.3 To consider data analysis
3.1 To review evaluation reports3.2 To present demographic information using mapping software3.3 To consider evaluation strategies3.4 To present evaluation information
Personal Meaning Maps
Nutrition
Growth
Falk, 2000
Make a chart for both pre visit and post visit
Code Tally Total
Growth
Nutrition
Analysis: Coding pre and post visit PMMs
Analysis: video/microphone
Talk CodesOh my gosh that is the meadow exclamationhabitatPlease keep to the meadow path rules habitatYou got the paths here yeah, in between all the thingies.repetitionthinkingHey commentator, you’ve got to commentate yeah on what we find.recordingHe touched one of the plants. He wasn’t supposed to even touch it.touch plants commenting on peerI can hear some birds but I don’t know where they are.sound name unknown speciesMaybe. uncertaintyWhat do you see? questioning observationHow are you going to see that, look at that! I don’t get it. You can’t really see a bat in a wildlife centre.expectationImagine if we actually saw an elephant in a wildlife centre, that would be so weird.imaginationspecies nameJackdaw- that’s a type of bird. species nameclassificationWhy did we get the meadow? questioninghabitat fairnessThere’s loads in here man! disagreementcalling to peerquantityWe’ve found something! teamworkdiscovery unknown species
You code the data according to what is there
Good for first stage
Sum the occurrences
Code Tally Total
Exclamation
Habitat
Rules
Repetition
Sum the occurrences
Talk CodesOh my gosh that is the meadow exclamationhabitatPlease keep to the meadow path rules habitatYou got the paths here yeah, in between all the thingies.repetitionthinkingHey commentator, you’ve got to commentate yeah on what we find.recordingHe touched one of the plants. He wasn’t supposed to even touch it.touch plants commenting on peerI can hear some birds but I don’t know where they are.sound name unknown speciesMaybe. uncertaintyWhat do you see? questioning observationHow are you going to see that, look at that! I don’t get it. You can’t really see a bat in a wildlife centre.expectationImagine if we actually saw an elephant in a wildlife centre, that would be so weird.imaginationspecies nameJackdaw- that’s a type of bird. species nameclassificationWhy did we get the meadow? questioninghabitat fairnessThere’s loads in here man! disagreementcalling to peerquantityWe’ve found something! teamworkdiscovery unknown species
Analysis: interpretivistic
You fit the data into a frameworkEE EE NH
skills 16 17knowledge 7 5enjoyment 4 3activity 5 2attitudes 4 4
36 31
Extra data?
Integration
Systematic analysis
Use the case study data to start systematic analysis
1.Clean data
2.Sort alphabetically
3.Number
4.Analyse by column and row
Day 3
Evaluation reports
SummaryAimsContextFocus: Presenting demographic informationMethodsResultsDiscussionConclusionsRecommendations
Sample evaluation reports
Mapping Demographic information
Use case study data and one category data column to illustrate
Google fusion tables
Short cut!
Google fusion tables
Short cut!
Day 3
Evaluation strategy
1. What are your organisational aims?
2. Which projects is your organisation involved in to meet those aims?
3. Who are your audiences?
4. Range of stakeholders:- who needs to know about the impact of your work?
Group- What they will do with the information
Evaluation strategy: triangulation
Teacher surveys for many; mixture of quantitative and qualitative information
Level of insight
Number of people
Pupil drawings/ surveysQualitative information analysed quantitatively
Observations/ interviewsQualitative information
analysed quantitatively and reported both qualitatively
and quantitatively
Useful resources
• http://informalscience.org/• http://visitors.org.uk/• http://relatingresearchtopractice.org/• Mus ed monitor• http://www.journals.elsevier.com/studies-in-educational-evaluation/• http://www.inspiringlearningforall.gov.uk/
These aspects need to be worked through within the organisation. Timescales , resources and people and skills gaps need identified.
Could you present this workshop?
Workshop review
1. What are the implications of this workshop for your organisation?
2. What have you learnt that was new?
3. How will you share this information?
a) Who?
b) When?
c) Format?
Thank you for taking part in this workshop
Day 3Aims for participants:1.1 To understand evaluation context and key ideas1.2 To share evaluation case studies1.3 To learn about evaluation research and examples
2.1 To recap evaluation methods2.2 To carry out (video) interviews2.3 To consider data analysis
3.1 To review evaluation reports3.2 To present demographic information using mapping software3.3 To consider evaluation strategies3.4 To present evaluation information
