Reactions to the Latest Job-Search Tool: Online Career Portfolios€¦ · Reactions to the Latest...

NACE 2004 National Meeting & Exposition

Reactions to the LatestJob-Search Tool:

Online Career Portfolios

Jill Lumsden & Myrna HooverJune 4, 2004

NACE 2004 National Meeting & Exposition

Workshop Objectives

• Do employers use online portfolios?

• Do employers find online portfolios effective?

• When do employers use portfolios?

• What do employers look for in portfolios?

• How can we guide students in creating more effective portfolios?

NACE 2004 National Meeting & Exposition

Program Outline

• Goals of the FSU Career Portfolio

• History of FSU Career Portfolio

• Demonstration

• Employer Reactions/Survey Results

• Implications of Feedback

• Future Objectives

• Questions & Discussion

NACE 2004 National Meeting & Exposition

Goals of the FSU Career Portfolio

• Educate students about workforce skills

• Connect students with opportunities to develop skills

• Provide a mechanism for students to document their skills and market themselves to employers or graduate schools

NACE 2004 National Meeting & Exposition

Fall 1997 1998 - 1999 June 1999 Ju ly 1999 D ecem ber 1999 2000 2001- 2002 A pril 26 , 2002

P ro to type D eveloped

O P S Funding for S taff P osition

P residen t’s In itiative

S tart o f R esearch & D evelopm ent

A IS P ro ject T eam E stab lished & T echnical In frastructure D evelopm ent B egins

In ternal & E x ternal P roposals

C areer C en ter P ortfo lio T ask Force E stab lished

D edicated S taff P osition

P ro to type T esting B egins

E xpanded U niversity S upport, A IS W eb D esigner Jo ined T ask Force

C areer P ortfo lio L au n ch

Live T esting w ith S elected G roups & C ontinued D evelopm ent

Key Events In Project History

NACE 2004 National Meeting & Exposition

Demonstration

http://portfolio.fsu.edu

NACE 2004 National Meeting & Exposition

Employer Reactions -Survey Results

• Survey Objectives

• Timeline

• Methodology

• Results

• Implications

NACE 2004 National Meeting & Exposition

Survey Objectives

• Usefulness

• Usability & Effectiveness

• Familiarity, Access & Effectiveness

• Stage of Recruitment Process

• Importance of Components

NACE 2004 National Meeting & Exposition

Fall 1997 Fall 2000 Spring 2002 Fall 2002 Spring 2003 Fall 2003 Spring 2004

President’s Initiative

Electronic Survey

“Usability & Effectiveness”

Career Portfolio

“Launch”

Data Collection & Analysis

Employer Survey -Focus Group

“Stage of Recruitment Process, Importance of

Components”

Timeline of Surveys

Employer Survey @ Career Expo

“Familiarity, Access & Effectiveness”

Employer Survey OCR“Familiarity, Access & Effectiveness”

Employer Survey

“Usefulness”

NACE 2004 National Meeting & Exposition

Employer Survey “Usefulness”

• Date: September 15, 2000

• Participants: Employers participating in Expo, Fall 2000

• Method: Survey distributed at Expo– Number of Employers Surveyed: 264

– Respondents: 87

– Percentage: 33%

NACE 2004 National Meeting & Exposition

Survey Results “Usefulness”

“Would you be interested in an online portfolio system?”

YES88%

NO6%

UNSURE6%

NACE 2004 National Meeting & Exposition

“Would you use an on-line portfolio to screen candidates?”

YES87%

NO8%

UNSURE5%

“Would you use an on-line portfolio to supplement a candidate’s interview?”

YES71%

NO16%

UNSURE13%

NACE 2004 National Meeting & Exposition

“Would you prefer a paper portfolio rather than an on-line portfolio?”

YES18%

NO66%

UNSURE16%

“Would access to candidates’ self-reported employability skills be useful in screening potential applicants?”

YES87%

NO8%

UNSURE5%

NACE 2004 National Meeting & Exposition

Implications

Employers endorsed an on-line portfolio system - a tool providing evidence of a candidate’s skills would be useful in screening and evaluating candidates.

NACE 2004 National Meeting & Exposition

Employer Survey “Usability & Effectiveness”

• Date: December 2001

• Participants: Actively Recruiting Employers

• Method: Electronic Survey

• Number of Employers Surveyed: 93– Respondents: 21

– Percentage: 23%

NACE 2004 National Meeting & Exposition

48%

38%

24%

0% 0% 0%0% 0% 0% 0% 0%0% 0% 0% 0% 0%

52%52%

43%

52%

62%

71%

48%

5%5%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

I found the Career Portfolioeasy to use.

I like the design and look ofthe Career Portfolio.

The Career Portfolio is wellorganized.

I feel the Career Portfolio isuseful in providing evidence

of a candidate’s skills.

I feel the Career Portfolio willbe beneficial in assessing

candidates.

Strongly AgreeAgree

NeutralDisagree

Strongly Disagree

Survey Results

100% of employers agreed or strongly agreed the portfolio was easy to use

NACE 2004 National Meeting & Exposition

Survey Results

48%

38%

24%

0% 0% 0%0% 0% 0% 0% 0%0% 0% 0% 0% 0%

52%52%

43%

52%

62%

71%

48%

5%5%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

I found the Career Portfolioeasy to use.

I like the design and look ofthe Career Portfolio.

The Career Portfolio is wellorganized.

I feel the Career Portfolio isuseful in providing evidence

of a candidate’s skills.

I feel the Career Portfolio willbe beneficial in assessing

candidates.

Strongly AgreeAgree

NeutralDisagree

Strongly Disagree

95% strongly agreed or agreed the design was user friendly

NACE 2004 National Meeting & Exposition

Survey Results

48%

38%

24%

0% 0% 0%0% 0% 0% 0% 0%0% 0% 0% 0% 0%

52%52%

43%

52%

62%

71%

48%

5%5%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

I found the Career Portfolioeasy to use.

I like the design and look ofthe Career Portfolio.

The Career Portfolio is wellorganized.

I feel the Career Portfolio isuseful in providing evidence

of a candidate’s skills.

I feel the Career Portfolio willbe beneficial in assessing

candidates.

Strongly AgreeAgree

NeutralDisagree

Strongly Disagree

100% strongly agreed or agreed that the Career Portfolio was well organized

NACE 2004 National Meeting & Exposition

Survey Results

48%

38%

24%

0% 0% 0%0% 0% 0% 0% 0%0% 0% 0% 0% 0%

52%52%

43%

52%

62%

71%

48%

5%5%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

I found the Career Portfolioeasy to use.

I like the design and look ofthe Career Portfolio.

The Career Portfolio is wellorganized.

I feel the Career Portfolio isuseful in providing evidence

of a candidate’s skills.

I feel the Career Portfolio willbe beneficial in assessing

candidates.

Strongly AgreeAgree

NeutralDisagree

Strongly Disagree

98% strongly agreed or agreed the portfolio validated candidates’ skills

NACE 2004 National Meeting & Exposition

48%

38%

24%

0% 0% 0%0% 0% 0% 0% 0%0% 0% 0% 0% 0%

52%52%

43%

52%

62%

71%

48%

5%5%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

I found the Career Portfolioeasy to use.

I like the design and look ofthe Career Portfolio.

The Career Portfolio is wellorganized.

I feel the Career Portfolio isuseful in providing evidence

of a candidate’s skills.

I feel the Career Portfolio willbe beneficial in assessing

candidates.

Strongly AgreeAgree

NeutralDisagree

Strongly Disagree

Survey Results

95% strongly agreed or agreed that the Career Portfolio was beneficial in assessing candidates

NACE 2004 National Meeting & Exposition

Implications

Employers endorsed the Career Portfolio as easy to use and effective in assessing and validating candidates’ skills.

NACE 2004 National Meeting & Exposition

Employer Survey: “Familiarity, Access, & Effectiveness”

• Date: Fall 2002 - Spring 2004

• Participants: – On-Campus Recruiters – Participants at Career Expos

• Method: Employer Evaluations

• Respondents

NACE 2004 National Meeting & Exposition

Survey Return Rates

OCR

2002-2003

OCR 2003-2004

Expo Fall 2003

Expo Spring 2003

Eng. Expo

Fall 2003

Number Surveyed

395 317 122 104 58

Number Responded

149 107 46 31 18

Response

Rate

37% 34% 38% 30% 31%

Overall:

34%

NACE 2004 National Meeting & Exposition

Respondents by Industry Types

Financial27%

Government7%

Retail32%

Technology16%

Engineering18%

NACE 2004 National Meeting & Exposition

Are you familiar with the FSU Online Career Portfolio?

0%10%20%30%40%50%60%70%80%90%

100%

2002-03 2003-04 Fall 03 Sp 04 Fall 03

OCR OCR SF SF ED

Yes (%)No (%)No Response (%)

Survey Results “Familiarity”

42% were familiar

NACE 2004 National Meeting & Exposition

Survey Results “Access”

Have you been given access to a student's Online Career Portfolio?

0%10%20%30%40%50%60%70%80%90%

100%

2002-03 2003-04 Fall 03 Sp 04 Fall 03

OCR OCR SF SF ED

Yes (%)No (%)No Response (%)

27% were given access

NACE 2004 National Meeting & Exposition

Survey Results“Effectiveness”

If yes, how beneficial did you find it in identifying the student's skills as they relate to your organization's

opportunities?(1= not beneficial, 5= very beneficial)

4.082.80

4.003.80 4.30

1

2

3

4

5

2002-03 2003-04 Fall 03 Sp 04 Fall 03

OCR OCR SF SF ED

Average

Those 27% rated the

Portfolio as Beneficial

NACE 2004 National Meeting & Exposition

Implications

• Familiarity of the online portfolio is increasing among employers, yet only 1 out of 11 have been provided access by a student.

• Employers with access rated the effectiveness of the online portfolio as above average.

NACE 2004 National Meeting & Exposition

Employer Survey“Stage of Recruitment Process -

Importance of Components”

• Date: January 2004

• Participants: Judges of Career Portfolio Contest

• Method: Employer Survey & Focus Group

• Respondents: 7 Judges/5 Participants

NACE 2004 National Meeting & Exposition

Survey Results

0%

0%

14%

0%

43%

14%

29%

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

All of the above/ equally useful at all steps

None of the above / not useful

Placement after Selection

Final Selection

Secondary Interview Process

Initial Interview Process

Application ProcessAt what step in

the recruitment

process would you find this

tool most useful?

NACE 2004 National Meeting & Exposition

Survey Results

3.14

2.71

2.86

4.43

5.57

1.00

0 1 2 3 4 5 6

References

Transcript

Profile

Artifacts

Skills

Resume

Please rank the following items in

terms of their usefulness in evaluating

candidates. (1=Most Useful, 6=Least Useful)

NACE 2004 National Meeting & Exposition

Implications

• Employers identified the second interview as the most likely stage they would use the online portfolio; the application process was second.

• The resume was considered the most important component; followed by skills and artifacts.

NACE 2004 National Meeting & Exposition

Future Objectives

• Provide students with results of employer feedback.

• Encourage students to provide access to employers in the second interview process.

• Survey employers about the effectiveness of interviews with students who have completed an online portfolio vs. those who have not.

NACE 2004 National Meeting & Exposition

Questions & Discussion

For more information, please visit: http://www.career.fsu.edu/portfolio/info.html

NACE 2004 National Meeting & Exposition

Thank You!