Balance of State Continuum of Care (BoSCoC) NH HMIS Training Evaluation 08/09/2012 1NH-HMIS Training on 8/9/2012 - BoSCoC

Balance of State Continuum of Care (BoSCoC)

NH HMIS Training Evaluation 08/09/2012

1NH-HMIS Training on 8/9/2012 - BoSCoC

Overview of BoSCoC Training• Date: 8/9/2012• Purpose: Training for all users and Agency Admins was required

because there was a software upgrade to ServicePoint 5.0.• Where: Mandatory training held at DOT Computer Resource Center, 7

Hazen Drive in Concord, NH. • Number of Attendees: 18 users/Admins in the morning and afternoon

sessions.• Training lasted 2 hours for end users; Admins were required to stay an

extra hour to review Reports and Administrative tasks.• Attendees were given a training binder that included 300 pages of

documentation and a DVD with videos. They were asked to fill out an evaluation form, but everyone did not fill out a form, and some did not complete every question. • Users knew before training that there was a test to verify knowledge

and that passing the test was a requirement for access into the new version of ServicePoint 5.• After passing test, users were emailed their HMIS certificate and given

access to SP5.• Donna held make up training at Nashua and Manchester location and

also online.

NH-HMIS Training on 8/9/2012 - BoSCoC 2

Agencies Represented

NH-HMIS Training on 8/9/2012 - BoSCoC 3

Agency Name # of Attendees # of Users # of AdminsNew Generation Homeless Shelter -Greenland

2 1 1

Center for Life Management – Derry

3 2 1

Crossroads House 2 1 1

Seacoast Mental Health Center

1 0 1

Community Services Council of NH – Franklin

1 0 1

BM-CAP 2 1 1

BHHS 1 0 1

Tri-county CAP 4 2 2

First Congregation Church Emergency Shelter

2 1 1

TOTALS 18 8 10

Is this your first time attending HMIS training?

# Answer Response %

1 Yes 7 39%

2 No 11 61%

Total 18 100%


Would you say the length of the training was:

# Answer Response %

1 Too Brief 3 17%

2 Just Right 14 78%

3 Too Long 1 6%

Total 18 100%


Please rate your overall knowledge/skill level using the HMIS software (circle one in each category)

Rating: 0 indicates the least knowledge and 11 indicates the most knowledge.

# Question 0 1 2 3 4 5 6 7 8 9 10 11 Responses Mean

1 Before attending this session/event 2 1 2 1 2 2 1 4 1 1 1 0 18 5.83

2 After attending this session/event 0 0 0 1 1 2 4 4 4 1 1 0 18 7.67


What did you hope to gain from this session?

# Answer Response %

1 How to enter a client record

12 67%

2 How to look up resources 2 11%

3 How to check a client into a bed

10 56%

4 Other (Please specify) 6 33%


The registration process from the Eventbrite website was:

# Answer Response %

1 Easy 13 76%

2 Just Right 4 24%

3 Too Difficult 0 0%

Total 17 100%


Would you say the frequency of reminder emails was:

# Answer Response %

1 Too many 3 17%

2 Just Right 15 83%

3 Not Enough 0 0%

Total 18 100%


How well did this session meet its stated objectives? Rating: 1 indicates the least accurate and 5 indicates the most accurate.

# Answer Response %

1 1 0 0%

2 2 1 6%

3 3 2 11%

4 4 5 28%

5 5 10 56%

Total 18 100%


Was the content organized and presented well? Rating: 1 indicates the least accurate and 5 indicates the most accurate.

# Answer Response %

1 1 0 0%

2 2 0 0%

3 3 0 0%

4 4 6 33%

5 5 12 67%

Total 18 100%


How would you rate the delivery of the content? Rating: 1 indicates the least accurate and 5 indicates the most accurate.

# Answer Response %

1 1 0 0%

2 2 0 0%

3 3 2 11%

4 4 6 33%

5 5 10 56%

Total 18 100%


How would you rate the trainer? Rating: 1 indicates the least accurate and 5 indicates the most accurate.

# Answer Response %

1 1 0 0%

2 2 0 0%

3 3 1 6%

4 4 3 17%

5 5 14 78%

Total 18 100%


How would you rate the handouts? Rating: 1 indicates the least accurate and 5 indicates the most accurate.

# Answer Response %

1 1 0 0%

2 2 0 0%

3 3 0 0%

4 4 4 25%

5 5 12 75%

Total 16 100%


How would you rate the location and room? Rating: 1 indicates the least accurate and 5 indicates the most accurate.

# Answer Response %

1 1 0 0%

2 2 1 6%

3 3 2 11%

4 4 4 22%

5 5 11 61%

Total 18 100%


After the training, rate your comfort level with these ServicePoint tasks:

Rating: 1 indicates the least accurate and 5 indicates the most accurate.

# Question 1 2 3 4 5 Responses Mean

1 entering a single client 0 0 4 5 9 18 4.28

2 assessing a client 0 2 2 8 6 18 4.00

3 entering a family record 0 2 4 9 3 18 3.72

4 checking a client into a bed 0 1 6 5 6 18 3.89

5 looking up a client 0 0 3 5 10 18 4.39


If online training videos were available 24/7, how likely would you be to watch the videos?

Rating: 1 indicates the least accurate and 5 indicates the most accurate.

# Answer Response %

1 1 0 0%

2 2 6 55%

3 3 3 27%

4 4 1 9%

5 5 1 9%

Total 11 100%


Which type of training method do you prefer?

# Answer Response %

1 watching videos showing the computer screen only

2 11%

2 watching videos showing the instructor interaction with the screen and class

1 6%

3 traveling to a location with a live trainer on site

15 83%

4 other: 1 6%


I would like to attend additional training on: Choose all that apply.

# Answer Response %

1 Another User Training 3 33%

2 Administration Training 4 44%

3 Basic Report Writing 4 44%

4 Advanced Report Writing 3 33%

5 User Group (interactive group with other users)

0 0%

6 Other: 0 0%


How often would you like to have a refresher training?

# Answer Response %

1 Monthly 0 0%

2 Every 3 months 1 6%

3 Every 6 months 4 22%

4 Once a year 11 61%

5 Other: 2 11%

Total 18 100%20NH-HMIS Training on 8/9/2012 - BoSCoC

Job Type/Role

# Answer Response %

1 Case Manager 3 17%

2 Program Manager 5 28%

3 Agency Administrator 5 28%

4 Executive Director 3 17%

5 Volunteer 0 0%

6 Other: 6 33%


Summary

• Tim from Bowman Systems trained 85 users in 5 days, 3 locations and 10 sessions (morning/afternoon each day)

• Most users, not their first training and thought length of training was just right

• Using Eventbrite to register was easy • Most everyone improved their knowledge or skill level• 83% said the several emails sent by HMIS as reminders about

the training were just the right amount• Content organization, delivery, handouts and the trainer all

received favorably high ratings

NH-HMIS Training on 8/6/2012 - GNCoC 22

Summary (cont’d)

• Comfort level of using the system after the training was markedly higher

• Mixed review on watching videos• 61% of users want to travel to be trained by a live trainer

every year; 22% wanted refresher training every 6 months• Users want additional training on Basic Report Writing and

Administration tasks

NH-HMIS Training on 8/6/2012 - GNCoC 23

Documents

Balance of State Continuum of Care (BoSCoC) NH HMIS Training Evaluation 08/09/2012 1NH-HMIS Training on 8/9/2012 - BoSCoC