How to assess the  Students Outcomes? 

Case Study: Tecsup – PerúABET Symposium XIVSt. Louis, Missouri, USA

Henry Gómez UrquizoElectrotechnical Department Head

Tecsup – ArequipaPerú

Content

• Tecsup the Institution• Quality in higher education

• Terminology used• Continuous Improvement Plan

• The PEO and SO of IEP• Assessment and evaluation of SO of IEP

23/02/2012 2hgomez@tecsup‐aqp.edu.pe

Tecsup in Peru and the world• Private Technologic Higher Education Institute 

• Was founded in 1984• Three campus in Peru:

– Lima– Arequipa– Trujillo

• Regular Students: >3000 • Trained Workers: >60000

23/02/2012 3

Lima

Arequipa

Trujillo

hgomez@tecsup‐aqp.edu.peCampus Services

Applied Engineering Programs

• Site: www.tecsup.edu.pe• Accredited Programs:

23/02/2012 4hgomez@tecsup‐aqp.edu.pe

23/02/2012 5

Quality in Higher Education

• Tecsup addresses its activity to achieveeducational excellence.

Fulfillment minimal requirements

Products and process oriented to the client 

satisfaction

The entire organization is committed to the achievement of 

excellence, "the best possible"

According to standard Quality Excellence

Products

Process

Organization

Quality models

Stadiums of the quality

hgomez@tecsup‐aqp.edu.pe

ABET TerminologyTAC  2012‐2013

POE “A”

SO “a”

Program Educational Objectives (POE)SO

 “b”

SO “c

”

SO “h”

SO “I”

SO “j”…

POE “B” POE “D”POE “C” POE “E”

Students Outcomes (SO)

6

Institutional Mission

Specific Objectives of the Courses (SOC)

23/02/2012 hgomez@tecsup‐aqp.edu.pe

23/02/2012 7

Continuous Improvement Plan (CIP)• The CIP is a institutional strategy created with the

purpose of optimize the educational services that weprovide.

hgomez@tecsup‐aqp.edu.pe

ASESSMENT

CIP StrategyEVALUATION ACTIONS

EDUCATIONAL OBJECTIVES

STUDENTS OUTCOMES

COURSES OBJECTIVES

Survey to students 

about Courses

Reports of Courses grades

Reports on execution of courses

Survey to students 

about services

Portfolio         of the   courses

Criterios     de desempeño

Performances of students in Internship I

Interview to students about SO

Survey to students about SO

Performances of students in Internship II

Survey            to the         alumni

Survey           to the   

employers

Collection of data through the WEB site

Minutes of Technical Committee

COMMITTES

Central Committee of Improvement

Technical      advisor 

Committee

Students and alumni services Committee

Jefatura           de Departamento

FORMULATION AND ACHIEVEMENT

Program Educational Objectives

Students 

Outcomes

Courses 

Objectives

Excellence Organization

23/02/2012 8

PLANNING

Performance criteria in activities

hgomez@tecsup‐aqp.edu.pe

Program          

Committee

SO PEO

CommitteesImprovement Actions

Companies

ASSESSMENT ASSESSMENT

EVALUATION

ACTIONS

9

ADMITION

SEMESTR

E 1

SEMESTER 2

INTERS

HIP I

SEMESTER 3

SEMESTER 4

SEMESTER 5

SEMESTER 6

INTERS

HIP II

Industrial Electrotechnical Program (IEP)

23/02/2012 hgomez@tecsup‐aqp.edu.pe

Student Graduates

Cyclical revision of the PEO

23/02/2012 10hgomez@tecsup‐aqp.edu.pe

11

Program Educational Objectives of IEP

Program Educational Objectives (PEO)PEO “A”

Our graduates develop, install and maintain electrical system based on solid knowledge of  Electrical Installations and Power Systems.

PEO “B”Our graduates identify and 

analyze problems to implement effective solutions

PEO “C”Our graduates behave with initiative, creativity, effective resource management and 

teamwork

PEO “D”Our graduates are 

professionals commitment with their development, quality and safety in work

PEO “E”Our graduates practice ethical principles and contribute to the development of society

Mission of Electrotechnical Department (ED)

To develop the professionals in Electrotechnical area, who apply their knowledge and skill to contribute the success of companies and development of the country.

Mission of the Educative Institution (IE)To develop people and companies through education, training and 

consultancy services 

23/02/2012 hgomez@tecsup‐aqp.edu.pe

“a”Students design, implement and optimize electric systems using their knowledge of electric installations and power systems, applying modern tools and techniques

“b”Students apply mathematics, science and technology in the design, installation, operation and maintenance of electric systems

“c”Students conduct tests and measurements, analyze and interpret their results in order to evaluate and improve systems. 

“d” Students apply creativity in the design of systems. 

“e” Students work effectively on teams.

“f” Students identify, analyze and solve problems on equipment and systems. .

“g” Students communicate effectively. 

“h” Students recognize the contemporary issues of their career and society.  They practice continuous life long learning and respect for diversity.

“i” Students work with quality and safety, and proceed with ethical principles. . 

“j” Students manage effectively materials and human resources under their responsibility. .

12

Students Outcomes(SO) of IEP

23/02/2012 hgomez@tecsup‐aqp.edu.pe

23/02/2012 13

Direct and indirect assessment of SO

Surveys

Performance

Interviews

Need improveExcellent Good Deficient

Assessment tool

Objective assessment

hgomez@tecsup‐aqp.edu.pe

Qualification

Performance Criteria

23/02/2012 14hgomez@tecsup‐aqp.edu.pe

Selection of activities for assess SO

23/02/2012 15hgomez@tecsup‐aqp.edu.pe

Taxonomía de Bloom

23/02/2012 16Learning levels

Definitions

Verbs to use

Situation where to apply hgomez@tecsup‐aqp.edu.pe

Learning levels according toBloom Taxonomy

23/02/2012 17

Levels

Crite

ria

hgomez@tecsup‐aqp.edu.pe

SO "a"

1. Knowledge 2. Comprehensión 3. Application 4. Analysis 5. Sintesis 6. Evaluation

Select materials and equipment according to the requirements of an electrical system

Identifies the components necessary for an electrical system

Distinguishes the functional

characteristics of the various components of an electrical system

It calculates and determines the

necessary components for an electrical

installation

Connects and reviews the components of an electrical installation

Develop and implement projects of electrical systems

Defines the characteristics of a project on electrical

systems

Interprets the characteristics of such

a project electrical system

Implements a project on electrical systems

Discusses the features of a project on

electrical systems

Develops projects of electrical systems

Improve actual electrical systems in order to save electric energy

Defines electrical parameters that allow the energy savings in an electrical system

Distinguishes the electrical parameters more relevant to the energy savings of an electrical installation

Controls electrical parameters that allow

the energy saving

Investigates aspects that allow the energy-saving in an electrical

installation

Revises electrical systems and proposes

alternatives to save energy

Evaluates economic and technical feasibility

of alternatives for energy saving in an electrical installation

ATTRIBUTES FRAMEWORK FOR SO "a"Students design, implement and optimize electric systems using their knowledge of electric installations and power systems,

applying modern tools and techniques

Performance Criteria or Attributes

Cognitive Domain Categories

Rubric for SO assessment

23/02/2012 18hgomez@tecsup‐aqp.edu.pe

Levels

Categories

Attributes to observe

Final grade percent

Partial grade

Grade Mark

Sample of Balance Scorecard in CIP

23/02/2012 19hgomez@tecsup‐aqp.edu.pe

a1 a2 b1 b2

a1.1 Electric Distribution Network 61% a2.1 Electrical Installation Mounting 80% b1.1 Electrical Measurement 68% b2.1 Electrical Control Systems 82%

a1.2 Power System 71% a2.2 Industrial Automation 76% b1.2 Power Systems Protection 93% b2.2 Power Systems ####

a1.3 Power System Protection 71% a2.3 Process Control 69% b1.3 Proces Control 62% b2.3 Industrial Electronic 78%

a1.4 Process Control 79% a2.4 Power System Protection 85% b2.4 Electromechanical Systems Ma 75%

Activities Activities Activities Activities

Selects materials and equipment according to requirements of electric system

Develops and implements electric system projects

Uses superior calculus in the analysis of electric systems

Uses software for the analysis, simulation and operation of electric systems

70% 77% 71% 82%

Report Report

Performance Criteria Performance Criteria Performance Criteria Performance Criteria

Student Outcome "a" Student Outcome "b"Students design, implement, and optimize electric systems using their knowledge of

electric installations and power systems, with modern tools and techniqueThe students apply mathematics, science and design technologies, installation,

operation and maintenance of electric systems

74% 76%

a3

a3.1 Audit and Energetic Eficiency 68%

a3.2 Electromechanical System Main80%

a3.3 Electromechanical Systems Ma 69%

Activities

Improves existing electric systems to save electric energy

68%

Performance Criteria

b3

b3.1 Electrical Machine II 75%

b3.2 Transformer Maintenance 81%

Activities

Applies concepts of physics and chemistry on the selection and maintenance of components

78%

Performance Criteria

Application of CIP in SO of IEP

Criterios de desempeño

Desempeño de estudiantes en las Prácticas

Desempeño de estudiantes en las Pasantías

Students survey about SO achievement

Entrevista a Estudiantes sobre logro de Resultados

Los estudiantes:a) Diseñan, implementan y optimizan sistemas eléctricos utilizando sus 

conocimientos de instalaciones eléctricas y sistemas de potencia, aplicando técnicas y herramientas modernas.

b) Aplican matemática, ciencia y tecnología en el diseño, instalación, operación y mantenimiento de sistemas eléctricos. 

c) Conducen pruebas y mediciones, analizan e interpretan sus resultados para evaluar y mejorar sistemas.

d) Aplican la creatividad en el diseño de sistemas.

e) Trabajan eficazmente en equipo.

f) Identifican, analizan y solucionan problemas de equipos y sistemas.

g) Se comunican eficazmente.

h) Reconocen los aspectos contemporáneos de la profesión, la sociedad, practican el aprendizaje permanente y el respeto por la diversidad.

i) Trabajan con criterios de calidad, seguridad y actúan con principios éticos.

j) Gestionan eficazmente los recursos materiales y humanos a su cargo.

Logro de Resultados 2006

74% 80% 83% 77%87%

69%76% 80% 86%

77%

0%

20%

40%

60%

80%

100%

a b c d e f g h i j

Resultados del Programa

23/02/2012 20hgomez@tecsup‐aqp.edu.pe

Conclusions

• Direct assessment is a useful tool to assess SOachievement.

• Its application demand great effort of faculty• Faculty require an inducement plan and apermanent monitors system in each part of theprocess.

• Data gathering and assessment process must besystematic because the large amount of data.

• The assistance of the administrative staff isequally valuable to lighten the teacher of theirroutine tasks.

23/02/2012 21hgomez@tecsup‐aqp.edu.pe

22

Thanks ….

23/02/2012 hgomez@tecsup‐aqp.edu.pe