23
Integrating Knowledge Management in the Context of Evidence Based Learning: Two concept models for facilitating the assessment and acquisition of job knowledge Stefan T. Mol Gabor Kismihok Fazel Ansari Mareike Dornhöfer May 13 th 2012 ISDT 2012, Mallorca, Spain

Isdt 2012 presentation

Embed Size (px)

Citation preview

Page 1: Isdt 2012 presentation

Integrating Knowledge Management in the Context of Evidence Based Learning:

Two concept models for facilitating the assessment and acquisition of job knowledge

Stefan T. Mol

Gabor Kismihok Fazel Ansari

Mareike Dornhöfer

May 13th 2012 ISDT 2012, Mallorca, Spain

Page 2: Isdt 2012 presentation

Contents

• Context

• The Med-Assess Concept

• The Meta Practitioner Concept

• Challenges

• Synthesis

• Questions / comments

Page 3: Isdt 2012 presentation

“…people who are more intelligent learn more job knowledge and learn it faster, the major determinant of job performance is not GMA but job knowledge” (Schmidt and Hunter, 2001).

Point of departure

GMA Job knowledge Job

Performance

Page 4: Isdt 2012 presentation

Job Knowledge: A tentative definition

The oftentimes job idiosyncratic and specifically defined know-how or evidence that is required of and by the job-holder to make sound decisions and thereby demonstrate successful job performance.

Page 5: Isdt 2012 presentation

Job Knowledge

Job Knowledge Specificity

1 2 4 3 6 5 8 7 9 Su

bstan

tiation

Job Performance Specificity

1 2 4 3 6 5 8 7 9

Page 6: Isdt 2012 presentation

Introducing Med-Assess

• MED-ASSESS is a personnel selection and training platform that takes an individualized approach to the assessment and development of job specific knowledge.

• Based on cutting edge semantic technology, MED-ASESS provides detailed personalized assessment and training of essential technical competencies and related job knowledge elements that are required for a particular job.

Page 7: Isdt 2012 presentation
Page 8: Isdt 2012 presentation

What will MED-ASSESS offer?

• General Mental Ability test • Customizable, adaptive job knowledge test for

medical employees (e.g., ward nurses, medical imaging nurses)

• Applicant ranking based on integrated Job Knowledge and GMA test performance

• Automatic and tailored e-Learning content delivery on the basis of test results

• Cutting-edge semantic technology for job knowledge structuring, testing, and evaluation

Page 9: Isdt 2012 presentation

Benefits of MED-ASSESS to Organizations

• Efficient applicant screening

• Greater person – job fit.

• Cuts in selection and initial training costs

• Fully customizable tests and training modules

• Based on ONTO-HR (see www.ontohr.eu)

Page 10: Isdt 2012 presentation

Benefits of MED-ASSESS to individuals

• Easy to access, online interface

• Easy to use and straightforward test environment

• Comprehensive presentation of results

• Personalized learning plan for knowledge deficiencies

• Fair and ethical testing

Page 11: Isdt 2012 presentation

Unequivocally Job Specific (albeit more portable for more related occupations) Undeniably Job General

Job Specific – Job

General

Job

Knowledge

Job

Performance GMA

Education

The MED-ASSESS Concept

Page 12: Isdt 2012 presentation

Unequivocally Job Specific (albeit more portable for more related occupations)

Job Specific – Job

General

Job

Knowledge

Job

Performance

Education

The META-PRACTITIONER Concept

Page 13: Isdt 2012 presentation

Evidence based management

…is based on the belief that facing the hard facts about what works and what doesn’t, understanding the dangerous half-truths that constitute so much conventional wisdom about management, and rejecting the total nonsense that too often passes for sound advice will help organizations perform better.

Pfeffer & Sutton (2006)

Page 14: Isdt 2012 presentation

Meta-Practitioner

• Aimed at facilitating practitioner access to academically accrued evidence through the automated conduct of meta-analysis

Page 15: Isdt 2012 presentation

Systematic Reviews: Meta-analysis

Meta-analysis is a statistical technique of summarizing and aggregating the findings of large numbers of previous investigations into the strength of the relationship between two or more variables (for instance the correlation between general mental ability and job performance).

Page 16: Isdt 2012 presentation

Systematic Reviews: Meta-analysis

Shaffer et al. 2006

Page 17: Isdt 2012 presentation
Page 18: Isdt 2012 presentation
Page 19: Isdt 2012 presentation

Conclusions

• The importance and centrality of job knowledge in today’s knowledge based economy is undeniable

• Multidisciplinary approaches are needed to tackle the challenges inherent to modeling job knowledge

Page 20: Isdt 2012 presentation

Research challenges

– both systems are currently mainly concerned with explicit knowledge that has in some way shape or form been documented. One challenge that awaits here is facilitating the automated processing and mapping into the ontologies of such knowledge.

– It should be recognized that job incumbents are likely to have significant know-how, and incorporating this latent knowledge into either system will be another significant challenge.

Page 21: Isdt 2012 presentation

Research challenges

Technological challenges:

– (semi) automated ontology development

– Content development

– Validation

– Integration

• Into existing learning environments

• With educational programs

– Engaging stakeholders

Page 22: Isdt 2012 presentation

Job Knowledge as Matchmaker

• Connecting:

– HRM, eLearning & Knowledge Management (foster collaboration)

– Academia and industry (Science and practice)

– Employees and workplaces (Enhanced Matching)

– Policy and Education (Training)

– Government and Labor Market (Needs analysis)

http://www.ontohr.eu

Page 23: Isdt 2012 presentation

Dr. Stefan T. Mol

Assistant Professor in Organizational Behavior

Rm. M-2.36 | Plantage Muidergracht 12

1018 TV Amsterdam | The Netherlands T +31 20 525 5490 | F +31 20 525 4182 E [email protected] | I www.abs.uva.nl/pp/stmol