EVALUATIONIN
EDUCATION
Abdul RasheedM.ed Morning
Roll no : 0102/02/2015
Evaluation
· What is evaluation?
· Why to evaluate?
· How it is done?
What is evaluation?Evaluation is systemic determination of merit,
worth and significance of something or someone using criteria against a set of standard.(en.wikippedia.org/wiki/evaluation)
Evaluation is the process of determining to what extend the educational objectives are being realized • Ralph Tyler
Evaluation is the process of making judgment based on criteria and evidence.(www.sbctc.edu/College/e-assessglossary)
Why to Evaluate….
· Measures the effectiveness of the instructor
· Measures the effectiveness of impact in meeting objectives
· Provide feedback to students
· Provides students gratification and motivation...........
To be Known before
How to EVALUATE ?For
Quality Evaluation
Quality Evaluation
Criteria Questions
TechniquesMethods
Quality
How the evaluation will be done
Criteria
Certain standard on which the
achievements of a learner
is measured
Good Quality Criteria
· Validity
· Reliability· Reproducibility
· Sensitive
· Specific
(VRRSS)
Types of Evaluation
· As per Quality of Evaluation· Quantitative
· Qualitative
· As per Time of Evaluation· Formative
· Summative
Formative v/s Summative Evaluation
Quality Formative Summative
Purpose detect strengths & weakness
Overall achievements
Frequency During or end of unit In end – point of certification, promotion
Area covered One unit/no. of units Course contentAdministrative utility
Advisory, not always for permanent record
Decisive, for permanent record
Feedback to students
Done immediately Inform regarding pass or fail
Feedback to faculty If significant no. shows error than weakness in instruction
Overall pass or fail
Questions
Evaluation Questions should Include Each level of Evaluation
*Levels of EvaluationLevel I – Reaction
How did the student react to the class?
Level - II Learning √ What has the student learned?
Level III – Skill √How much did the student retain?
Level – IV Impact √What is the final impact or practical application of
this learning?
Methodologies Project Assignments Observation
Simple Observation Think-aloud (let the examinee explain) Constructive Interaction
Query via Interviews Focal Group Discussion (FGD) Questionnaires
Combinations of methodologies should be used
Summary of MethodologiesType Strengths Weaknesses
Project Assignment CreativitySkill Judgment
Time ConsumingAnalysis is Difficult
Observational Skill JudgmentIn DepthLess Planning require
Time ConsumingAnalysis is Difficult
Interview DepthHigh ResponseCommunication skill
Extensive PlanningTime ConsumingAnalysis Difficult
Focus group discussion (FGD)
Group EnergyCommunication skillInterpersonal Relationship
Extensive PlanningAnalysis Difficult
Questionnaire Extensive in UseIn DepthEasy Analysis
Extensive Planning
Tests
WrittenQuestionnaire
Practical Project Assignment, Case
Study, Observation, Interview, FGD
OralInterview, FGD
24
Written Tests
Multiple ChoiceTrue/FalseMatchingCompletion or fill in the blankEssay
Short Notes Long Essay
25
How to EVALUATION
Process of Evaluation
Process of Evaluation(9 Steps)
Step 1. Define Purpose & ScopeStep 2. Specify Evaluation QuestionStep 3. Specify Evaluation DesignStep 4. Create Data Collection Action Plan
Planning
Implementation
Step 5. Data Collection Step 6. Data analysisStep 7. Finding data Inference
Step 8. Disseminate Information Step 9. Feedback for improvement
Feedback
Data Collection Action PlanDecide level of EvaluationType of EvaluationType of Evaluation Technique What Evaluation Questions ?From whom/Data Sources ?By whom ?When Collected ?How Collected ?How Data are to be Analyzed ?
Accreditation Council for GraduateMedical Education (ACGME)
· Six General Competencies:Patient CareMedical KnowledgePractice-Based Learning Interpersonal and Communication SkillsProfessionalismSystems-Based Practice
Choosing an Evaluation Method
why in process: Purpose of evaluationWhen in process: Formative vs. Summative
style of evaluation: laboratory vs. field
type of measures: qualitative vs. quantitative
level of information: high level vs. low level
resources available: time, subjects, tools & equipment, expertise etc.
Example
· Which type of test is most commonly used for state or national certifications?
A. True/FalseB. MatchingC. Multiple choiceD. Fill in the blank
39
Goal of Evaluation
Status Evaluation
Feedback
“If you can not measure it, you can not improve it.”
soEvaluation is important.
Be Sweet, Like honeyAbdul RasheedM.ed MorningRoll no: 01