25
Psychometrics Psychometrics Division Division Dr. Carlo Magno Dr. Carlo Magno De La Salle University, Manila De La Salle University, Manila Board of Trustee, PEMEA Board of Trustee, PEMEA

Psycho Metrics Division

Embed Size (px)

Citation preview

Page 1: Psycho Metrics Division

Psychometrics DivisionPsychometrics Division

Dr. Carlo MagnoDr. Carlo Magno

De La Salle University, ManilaDe La Salle University, Manila

Board of Trustee, PEMEABoard of Trustee, PEMEA

Page 2: Psycho Metrics Division

Themes on the Needs of CountryThemes on the Needs of Country Information CampaignInformation Campaign Test DevelopmentTest Development Human ResourceHuman Resource TechnologyTechnology Policy MakingPolicy Making TrainingTraining ResourcesResources

Page 3: Psycho Metrics Division

Themes on the Needs on Schools Themes on the Needs on Schools Colleges and UniversitiesColleges and Universities

Test DevelopmentTest Development Policy MakingPolicy Making ResourcesResources TrainingTraining NetworkingNetworking

Page 4: Psycho Metrics Division

Information CampaignInformation Campaign

Awareness of the role of Awareness of the role of psychometricians in organizations/ psychometricians in organizations/ general public general public

Additional publication of Additional publication of psychometrics studies in the psychometrics studies in the PhilippinesPhilippines

Clarification about the purpose of Clarification about the purpose of psychometricspsychometrics

Page 5: Psycho Metrics Division

Test DevelopmentTest Development

Statistically tested government Statistically tested government exams exams

Revisions of tests based on Revisions of tests based on psychometricspsychometrics

Use IRT for licensure exams, college Use IRT for licensure exams, college entrance examsentrance exams

Develop psychological test fitted for Develop psychological test fitted for FilipinosFilipinos

Page 6: Psycho Metrics Division

Test DevelopmentTest Development

Standardization and validation of Standardization and validation of national exams national exams

Determine guessability of items Determine guessability of items Nonverbal intelligence test for Nonverbal intelligence test for

cultural communities/ indigenous cultural communities/ indigenous people people

Formulation of tests appropriate for Formulation of tests appropriate for public school studentspublic school students

Page 7: Psycho Metrics Division

Test DevelopmentTest Development

Develop standardized diagnostic Develop standardized diagnostic exam for basic and higher education exam for basic and higher education

Develop tests for blue collared jobsDevelop tests for blue collared jobs Re-evaluate standardized tests in the Re-evaluate standardized tests in the

PhilippinesPhilippines Develop local norms for western Develop local norms for western

made tests made tests Supervise teachers in their Supervise teachers in their

development of testsdevelopment of tests

Page 8: Psycho Metrics Division

Test DevelopmentTest Development

More Filipino made personality tests More Filipino made personality tests and intelligence testand intelligence test

Develop tests to measure the effect Develop tests to measure the effect of instruction on psychosocial of instruction on psychosocial developmentdevelopment

Varied entrance exam for different Varied entrance exam for different programsprograms

Revision of a teacher performance Revision of a teacher performance assessment formassessment form

Page 9: Psycho Metrics Division

Human ResourceHuman Resource

Experts/statisticians for evaluating Experts/statisticians for evaluating government projects government projects

Consultative body composed of Consultative body composed of psychometricianspsychometricians

Knowledgeable and competent Knowledgeable and competent higher education faculty in higher education faculty in psychometricspsychometrics

Page 10: Psycho Metrics Division

Human ResourceHuman Resource

Need for a committed Filipino expert Need for a committed Filipino expert in psychometrics in psychometrics

Attendance of the Higher Education Attendance of the Higher Education Instructors administrators on Instructors administrators on conferences and trainings in conferences and trainings in psychometrics psychometrics

Be open minded for new Be open minded for new developmentsdevelopments

Page 11: Psycho Metrics Division

TechnologyTechnology

Availability of local and affordable Availability of local and affordable software software

Website for the consultants in Website for the consultants in psychometricspsychometrics

Page 12: Psycho Metrics Division

Policy MakingPolicy Making

Set a comprehensive national policy on Set a comprehensive national policy on the use of psychometrics on: National the use of psychometrics on: National securitysecurity• Manpower developmentManpower development• Public safetyPublic safety• EconomicEconomic

Initial investment to nurture a culture of Initial investment to nurture a culture of the application of psychometrics in the application of psychometrics in researchresearch

Ethical guidelines/ evaluation instrument Ethical guidelines/ evaluation instrument on test constructionon test construction

Page 13: Psycho Metrics Division

TrainingTraining

Statistical literacyStatistical literacy Graduate training programs in Graduate training programs in

psychometrics in SUC’s and private psychometrics in SUC’s and private HEI’s Training on uni and multi HEI’s Training on uni and multi dimensional models of IRTdimensional models of IRT

Develop competence of individual Develop competence of individual faculty members on educational faculty members on educational statisticsstatistics

Page 14: Psycho Metrics Division

TrainingTraining

Enhancement training for high-stakes Enhancement training for high-stakes test and licensure exams developerstest and licensure exams developers

Comprehensive psychometric Comprehensive psychometric training for administrators and policy training for administrators and policy makersmakers

Page 15: Psycho Metrics Division

TrainingTraining

Orientation on psychometrics Orientation on psychometrics research and statisticsresearch and statistics

Trained and competent Trained and competent psychometricianspsychometricians

Research trainingResearch training Trainings and workshops on modern Trainings and workshops on modern

test theorytest theory Continuous education in Continuous education in

psychometricspsychometrics

Page 16: Psycho Metrics Division

ResourcesResources

Open-access research journals - Open-access research journals - resourcesresources

Page 17: Psycho Metrics Division

Themes on the Needs of the Themes on the Needs of the UniversitiesUniversities

Page 18: Psycho Metrics Division

Test DevelopmentTest Development

Psychometrically validated entrance Psychometrically validated entrance exam, performance assessment, and exam, performance assessment, and departmental examsdepartmental exams

University made testsUniversity made tests IRT for mock board examsIRT for mock board exams English proficiency tests for EFL English proficiency tests for EFL

studentsstudents Modern test theory applicationModern test theory application

Page 19: Psycho Metrics Division

Policy MakingPolicy Making

Utilization of test results for instructionUtilization of test results for instruction Address issues about the qualification of Address issues about the qualification of

psychometricianspsychometricians Make transparent standards for test and Make transparent standards for test and

evaluationsevaluations Create a center who will do assessmentCreate a center who will do assessment Policy requiring all faculty to undergo Policy requiring all faculty to undergo

trainingtraining

Page 20: Psycho Metrics Division

TrainingTraining

Techniques in program evaluationTechniques in program evaluation Need based competency training for Need based competency training for

test development in specific areastest development in specific areas Professional trainingsProfessional trainings Enhancement of psychometric skillsEnhancement of psychometric skills Workshops on item analysisWorkshops on item analysis

Page 21: Psycho Metrics Division

TrainingTraining

IRT trainingIRT training Psychometric advanced trainingPsychometric advanced training Training on psychometrically made Training on psychometrically made

teststests Training on competency in Training on competency in

determining appropriate statistical determining appropriate statistical techniques in analyzing assessment techniques in analyzing assessment resultsresults

Training in the field of psychometricsTraining in the field of psychometrics

Page 22: Psycho Metrics Division

ResourcesResources

More references for More references for psychometricians psychometricians

Website about psychometricsWebsite about psychometrics Software and scanners – fundsSoftware and scanners – funds Statistical software to facilitate data Statistical software to facilitate data

processingprocessing

Page 23: Psycho Metrics Division

NetworkingNetworking

Close collaboration of Close collaboration of psychometricians and statisticians psychometricians and statisticians

Need to hire a psychometricianNeed to hire a psychometrician

Page 24: Psycho Metrics Division

Action PlanAction Plan

TrainingTraining• Training on test development and analysisTraining on test development and analysis

Human ResourceHuman Resource• Create a website of the members of the Create a website of the members of the

psychometric division of PEMEA indicating their psychometric division of PEMEA indicating their email addresses and areas of specializationemail addresses and areas of specialization

TechnologyTechnology• Develop a software that can be downloaded Develop a software that can be downloaded

from PEMEA website for free (collaborate with from PEMEA website for free (collaborate with IT experts)IT experts)

• Facebook for PEMEA psychometrics divisionFacebook for PEMEA psychometrics division

Page 25: Psycho Metrics Division

Action PlanAction Plan Policy MakingPolicy Making

• Party list on psychometricsParty list on psychometrics• Write a position paper then submit to national Write a position paper then submit to national

agencies about the role of psychometriciansagencies about the role of psychometricians ResourcesResources

• Dissemination of projects with funds Dissemination of projects with funds NetworkingNetworking

• Use the site where the members of the Use the site where the members of the psychometrics division are listedpsychometrics division are listed

• Establish a consortium among SUC’s and HEI’sEstablish a consortium among SUC’s and HEI’s Information CampaignInformation Campaign

• Publication, Journals, Newsletters, PEMEA Publication, Journals, Newsletters, PEMEA website with page about psychometricswebsite with page about psychometrics