Credential Transparency Initiative (CTI)

Technical Advisory CommitteeMeeting

December 1, 2015

Slide 2

• 11:30 am – 12:00 pm - TAC Overview• Via in-person participation at Collaborative Kickoff

meeting only.

• 12:00 pm – 1:30 pm - TAC Meeting Begins• Welcome and Role Call – Jeanne Kitchens• Quick DCAP Approach Recap – Stuart Sutton• Review of Draft Functional Requirements for Use Cases:

Ordered by User Group – Stuart, Bob Sheets, and Jeanne • Draft Domain Model - Stuart • Next Steps – Stuart and Jeanne

Topics

Slide 3

Welcome and Role Call

• Prior meeting materials and questions/comments are save in the TAC Google Drive folder.

• CTI team members will scribe this meeting.

Slide 4

Quick DCAP Approach Recap

Slide 5

What’s in and out of scope?

The focus of the Domain Model is on description of Credentials, Credential Issuers, Quality Assurance Organizations and other entities necessary to express the range of credential description data and key relationships. Description of Credential Holders "earning" credentials and Credential Consumers "requesting" verification of credentials are out of the CTI project's scope.

Slide 6

CTI Process: DCAP for Defining Constrains on on RDF Graph

Slide 7

Information on the DCAP stages

Development Stages

http://www.credreg.net/

Slide 8

Credential name and version Credential type Credentialing organization name Credentialing organization type Required competencies/learning

outcomes Credentialing requirements Role in occupational regulation and

licensing Type and scope of primary application Labor market value Education and training opportunities Credential costs

Credential transfer value Education and career pathway

connections Credential renewal and removal Credential holder profile (aggregate

data) Information on development of

competencies/learning outcomes and assessment

Assessments required to attain the credential

Credential holder authentication (cost) Credential version management and

control External credential recognition

Preliminary 1st phase attribute analysis & stakeholder input

Slide 9

Purpose of the quality assurance body Scope of the quality assurance body Quality Criteria – framework for

Evaluation Outcomes Quality assurance methodologies Validity and reliability of the quality

assurance process

Information on quality assurance decisions

Publicly-availability of quality assurance information

Managing conflicts of interest Quality assurance complaint process Quality assurance appeal process

Preliminary 1st phase attribute analysis & stakeholder input

Provided the launch basis for functional requirements / use cases

Slide 10

Registry Applications

☛ Credential Directory Application ☛ Employer Signaling and Talent Pipeline Management Application ☛ Credential Transfer Value Application ☛ Competency Authoring Application

Slide 11

Review of Draft Functional

Requirements for Use Cases

Use Cases by User Groups

Slide 12

CTI Technical Planning Websitehttp://www.credreg.net/dcap/1

Draft Functional Requirements for Use Cases: Ordered by User Group November 29, 2015 Version 3https://docs.google.com/document/d/16tXLZfQo1IvMLlMsIyUsHolasAlXAzqINfQbdNPReec/edit?usp=sharing

User Groups:1. Students/Learners/Job Seekers 2. Employers3. Credentialing Organizations4. Government5. Other?

Slide 13http://credreg.com/dcap/1

Slide 14

• Credential name • Credential holder authentication [cost of]• Credential holder profile [aggregate data]• Credential renewal and removal• Credential transfer value• Credentialing costs• Credential type • Credential version • Credentialing requirements• Assessments required to attain the credential• Competencies/learning outcomes required to attain the credential• Credentialing organization name• Education and career pathway connections• Labor market value• Primary application scope - Geographic Area• Primary application type - Education: Subject/Discipline• Primary application type - Employment/Career Advancement - Industry and Occupation• Public finance eligibility• Quality assurance organization (Recognizing the credential or credentialing organization)

Current Use Case-Derived Attributes

Slide 15

laborMarketValueemployerRecognitionassociationRecognitionemploymentRatemedianEarningsRangeinterquartileEarningsRange

“Labor Market Value” Unpacked

Slide 16

Registry and Apps Steps

• Step 1: Define Users and Use Cases: Individual Learners/Students/Job Seekers; Employers; Credentialing Organizations; Quality Assurance Organizations, and Government.• Step 2: Gather and define functional requirements.• Step 3: Develop requirements document and wireframes with reviews and revisions.• Step 4: Graphical design with reviews and revisions.• Step 5: Technical design with reviews and revisions.• Step 6: Iterative development and testing minimal viable

product (MVP)• Step 7: Pilot and Improve.

Slide 17

1.8  Credential Profiling and Comparison. Review and compare two or more credentials that meet their career and/or education goals and are offered within a geographic area. Compare on one or more of the following:  (1) credentialing and credentialing renewal/maintenance requirements, (2) who gets them, (3) education and training options to get them, (3) cost of attaining them, (4) recognition by quality assurance organizations (5) availability and cost of providing authentication services, and (6) value of attaining these credentials including transfer, career and education pathways/connections, and labor market value.Attributes/ Properties:

• Name of Credential• Type of Credential• Version of Credential (if credential has

changed properties under same name)• Name of Credentialing Organization• Primary Application Type - Education:

Subject/Discipline• Primary Application Type -

Employment/Career Advancement - Industry and Occupation

• Primary Application Scope: Geographic Area

• Quality Assurance Organization (Recognizing the credential or credentialing organization)

• Labor Market Value:  Employer/Industry Recognition and Employment and Earnings

• Competencies/Learning Outcomes Required to Attain the Credential

• Assessments Required to Attain the Credential

• Credentialing Requirements• Credential Holder Profile• Credentialing Costs• Credential Renewal and Removal• Labor Market Value• Transfer Value• Education and Career Pathway

Connections• Credential Holder Authentication

Step 2: Use Cases

Slide 18

Topic Use Case Scenario DetailsUse Case Reference ID:

AA-BB-CC-DDDD-MMDDYY

App Identify the app. Use Case Name/Title Short descriptive phrase naming the use case.Description Short description describing the function or goalActor(s) The type of user(s) who interacts with the system to

accomplish a task. Value and Benefits to Actor

Describe the value and benefits of the use case from the perspective of the actor.

Current State-User Problem To Be Addressed

Problem the actor is facing, or opportunity that is presented that doesn’t currently exist with existing tools or information.

Future State--User Scenario(s)

What actions the actor will take and how these actions enable positive results – or what changes in the current state can be accomplished that represents an improvement. More specifically, a clear, concise description of the goal for the use case, what is going to be accomplished, and how the end user will utilize the ISLE platform.

Priority Rate importance.Frequency of Use How often will this app be used or accessed?Attributes/ Properties Credential descriptors

Competency descriptors Other descriptors

Draft Questionnaire

Slide 19

DRAFT online pilot-site partner questionnaire – Currently setup so nothing is required so it’s easy to get all the way through it. https://www.surveymonkey.com/r/CTIPartnerInfo

The online questionnaire is based on the Pilot-Testing the Credential Registry: Credential Descriptors in Question Format, Example CTI Pilot Site Questions for Identifying, Reviewing, and Accessing Credential Descriptor Information, November 22, 2015. This questionnaire doesn't include questions concerning current web formats or locations.

TAC Google Drive Folder – Pilot Partner and QA Questionnaireshttps://drive.google.com/drive/u/0/folders/0B1uSTaYpjhXJUzA4NDBVY2FhcDQ

Draft Credential DirectoryMockups and Wireframes

Slide 20

Draft Credential Directory Search Mockuphttp://credreg.net/mockups/mockup/searchv3

DRAFT Credential Directory - Mockups and Wireframes – November 30, 2015 Version 6https://drive.google.com/drive/u/0/folders/0B1uSTaYpjhXJVnl0QWVJVnMxSFU

Slide 21

Draft Domain Model

Slide 22

Draft Domain Model for Discussion

Slide 23

Schema.org base types (classes) of potential use:

• Intangible• CreativeWork • Organization• JobPosting • EducationalEvent• AlignmentObject• Offer• EducationalAudience• Product• Service• Others?

Base Community Model—Schema.org

Slide 24

Next Steps

• Use TAC Google Group to provide feedback and comment on:• Draft use cases and related attributes

and properties• Draft Domain Model• Draft Pilot-site Partner Questionnaire

• Identify best options for monthly TAC webinars in Doodle Poll.

Slide 25

TAC Website, Tools and Liaison

Technical Planning Site http://www.credreg.net/

Google Technical Group https://groups.google.com/forum/#!forum/cti-technical-committee

Google Open Discussion Group https://groups.google.com/forum/#!forum/cti-open-discussion

Google Drive Documents for Technical Team by Invitation https://drive.google.com/drive/folders/0B1uSTaYpjhXJekc0dlpGdW9xZGc

CTI Github for Specifications Versioning

Technical Liaison:Jeanne Kitchens, Associate DirectorSIUC Center for Workforce Developmentjkitchens@siuccwd.com

Slide 26

Appendix

Credential Directory Mock-up

Slide 27

• This is mock-up to show examples of Credential Registry app search options.

Credential Directory Mock-up

Slide 28

• This is mock-up to show an example of Credential Registry app’s credential search.

• This is an example of Credential Registry app search options.

Slide 29

Credential Directory AppSearch Options Example

• This is an example of search results after selecting some search options.

Slide 30

Credential Directory AppSearch Results Example

• This is an example of credential information after selecting a credential from the search results.

Slide 31

Credential Directory AppCredential Information Example

• This is an example of quality assurance information selected from credential information.

Slide 32

Credential Directory AppQuality Assurance Linkage

Example

• This is an example of the credential directory app customized in a regional manufacturing website.

Slide 33

Regional Manufacturing Website

Customized Example

• This is an example of the credential directory app customized in a state licensing agency website.

Slide 34

State Licensing AgencyCustomized Example

• This is an example of the credential directory app customized in a state board of higher education website.

Slide 35

State Board of Higher Education

Customized Example

Students/Learners/Job Seekers• 1.1 Name Search. Search and find one or more types of credentials by the

name of the credential and/or name of the credentialing organization• 1.2 Search on Career/Education Goal and Geographic Area. Search

and find one or more types of credentials that best meet their career and/or education goals and are offered by a credentialing organization within a geographic area

• 1.3 Search on Credentials Recognized by Quality Assurance Organizations. Search and find one or more types of credentials that best meet their career and/or education goals and are offered by a credentialing organization within a geographic area and are recognized (accredited, endorsed, or approved) by quality assurance organizations including those that are necessary for public financing (e.g., military benefits, student grants and loans, WIOA funding)

• 1.4 Search on Credentialing Requirements. Search for and find one or more types of credentials that best meet their career and/or education goals and are offered by a credentialing organization within a geographic area and have credential eligibility requirements that they can meet.

• 1.5 Search on Transfer Value and Career and Education Connections. Search for and find one or more types of credentials that best meet their career and/or education goals and are offered by a credentialing organization within a geographic area and provide the best transfer value for credentials they have(e.g., high school and college course credits, degrees, certificates) along career and education pathways.

Slide 36

Students/Learners/Job Seekers• 1.6 Search Using Competencies. Search for and find one or more

types of credentials that best meet their career/education goals and are offered by a credentialing organization within a geographic area that best address: (1) competencies they wish to attain through a credential and/or (2) competencies that they wish to be recognized through the analysis of competency-based resumes, transcripts, and portfolios and other types of prior learning assessment.• 1.7 Search for Career Goals and Labor Market Value. Search

and find one or more types of credentials that meet career goals and have employer and industry recognition and/or established labor market value within a geographic area.• 1.8 Credential Review and Comparison. Review and compare

two or more credentials that meet their career and/or education goals and are offered within a geographic area. Compare on one or more of the following: (1) credentialing and credentialing renewal/maintenance requirements, (2) who gets them, (3) education and training options to get them, (3) cost of attaining them, (4) recognition by quality assurance organizations (5) availability and cost of providing authentication services, and (6) value of attaining these credentials including transfer, career and education pathways/connections, and labor market value.

Slide 37

Employers• 2.1 Name Search. Search and find one or more types of credentials by the

name of the credential and/or name of the credentialing organization• 2.2 Search on Industries and Occupations and Geographic Area. Search

and find one or more types of credentials that address their critical jobs; are offered by a credentialing organization within a geographic area; and are recognized (accredited, endorsed, or approved) by quality assurance organizations (e.g., business and industry association)• 2.3 Search Using Competencies and Related Quality Assurance

Requirements. Search for and find one or more types of credentials that address their critical jobs; are offered by a credentialing organization within a geographic area; and best address: (1) their most important competency requirements, and (2) their quality assurance requirements involving assessment, continuous updating and validating of competencies and assessment to address changing employer needs and whether they are recognized by a trusted quality assurance organization. • 2.4 Review and Compare Credentials by Geographic Area. Review and

compare two or more credentials that address their chosen jobs and are offered within a geographic area. Compare them on: (1) competencies required to attain the credential (2) assessments required to attain the credentials, (3) how they develop, validate and continually update their competencies and assessments, (4) what quality assurance organizations recognize them, (5) credentialing and credentialing renewal/maintenance requirements, (6) the number and types of individual who have attained these credentials, and (7) availability and cost of authenticating credential holders who apply for jobs with employers.

Slide 38

Employers• 2.5 Compile Employer Partnership Directories. Work

with business and industry associations and employer-led collaboratives to build customized directories of industry-recognized credentials within a geographic area.• 2.6 Monitor Talent Pipelines. Build talent pipeline

dashboards for tracking changes in selected preferred credentials and credentialing within a geographic area. The dashboard would address changes in scopes of application, competencies, assessments, credentialing requirements, and the number and characteristics of individuals attaining the credentials.• 2.7 Monitor and Analyze Credentialing Marketplace.

Use data analytic tools to monitor and analyze changes in the credentialing marketplace including changes in competency and quality assurance requirements and changes in labor market value.

Slide 39

Credentialing Organizations• 3.1 Name Search. Search and find one or more types of credentials by

the name of the credential and/or name of the credentialing organization• 3.2 Search on Scopes of Application and Recognition. Search and

find one or more types of credentials that address similar career and educational areas and geographic and are recognized by one or more quality assurance organizations.)• 3.3 Search on Transfer Value and Career and Education

Connections. Search for and find one or more types of credentials that declare transfer value and career and education connections with their credential or credentials with similar scopes of application and quality assurance. • 3.4 Search Using Competencies and Assessments. Search for and

find one or more types of credentials with similar scopes of application and geographic coverage that best match their competency and related quality assurance requirements including assessment required to attain the credential. • 3.5 Search for Career Applications and Labor Market Value. Search

and find one or more types of credentials that have similar scopes of application (e.g., industries and occupations) related to labor markets and have employer and industry recognition and/or established labor market value within a geographic area.

Slide 40

Credentialing Organizations• 3.6 Credential Review and Comparison. Review and compare two or

more credentials with similar scopes of application and compare on one or more of the following: (1) credentialing and credentialing renewal/maintenance requirements, (2) who gets them, (3) education and training options to get them, (3) cost of attaining them, (4) recognition by quality assurance organizations (5) availability and cost of providing authentication services, and (6) value of attaining these credentials including transfer, career and education pathways/connections, and labor market value.• 3.7 Monitor and Analyze Credentialing Marketplace. Use data

analytic tools to monitor and analyze changes in the credentialing marketplace including changes in competency and quality assurance requirements and changes in labor market value.

Slide 41

Government• 4.1 Name Search. Search and find one or more types of credentials by the

name of the credential and/or name of the credentialing organization• 4.2 Search on Scopes of Application and Recognition. Search and find

one or more types of credentials that address similar career and educational areas and geographic and are recognized by one or more quality assurance organizations.

• 4.3 Search on Transfer Value and Career and Education Connections. Search for and find one or more types of credentials that declare transfer value and career and education connections with other credentials or credentials with similar scopes of application and quality assurance.

• 4.4 Search for Career Applications and Labor Market Value. Search and find one or more types of credentials that have similar scopes of application (e.g., industries and occupations) related to labor markets and have employer and industry recognition and/or established labor market value within a geographic area.

• 4.5 Credential Review and Comparison. Review and compare two or more credentials with similar scopes of application and compare on one or more of the following: (1) credentialing and credentialing renewal/maintenance requirements, (2) who gets them, (3) education and training options to get them, (3) cost of attaining them, (4) recognition by quality assurance organizations (5) availability and cost of providing authentication services, and (6) value of attaining these credentials including transfer, career and education pathways/connections, and labor market value.

Slide 42

Government• 4.6 Monitor and Analyze Credentialing Marketplace. Use

data analytic tools to monitor and analyze changes in the credentialing marketplace including changes in competency and quality assurance requirements and changes in labor market value.• 4.7 Build Customized Directories: State Occupational and

Professional Licensing Agencies. Compile a directory of state licenses that can be searched by major industries and occupations showing: credentialing requirements, licensing renewal and removal, licensing costs and recognized credentials and education and training programs for each state license and related quality assurance organizations that are involved in state recognition. Search results would create license profiles containing name, scope of application (e.g., scope of practice), competency and assessment requirements, credential costs, other credentialing requirements, licensing renewal and removal, and authentication services.

Slide 43

Government• 4.8 Build Customized Directories: State Higher Education Agencies.

Compile a directory of approved postsecondary education programs that award degrees or education certificates and that state higher education agencies and boards (statewide governing, policy, and coordinating boards of postsecondary education) have approved for operating within a state along with their accreditation by national, regional and specialized accreditors and their relationship to state licensing requirements.• 4.9 Build Customized Directories: State and Local Workforce Boards and Agencies. Compile a directory of industry-recognized credentials including approved education training programs providing credentials for funding under one or more federal and state workforce programs including “eligible training providers” under WIOA and related programs. This directory also could provide the basis for improved state and local demand and supply reports based on the scope of application for each credential.• 4.10 Build Customized Directories: Federal and State Military and Veterans Agencies. Compile a directory of high-quality credentials that can be searched by active military and veterans that provide the best transfer and labor market value in transitioning to the civilian labor force with military and related credentials.

Slide 44