new hampshire state-wide summary results

New Hampshire State-Wide Summary Results

NH HMIS Training Evaluation 08/06/2012 – 08/10/2012

1NH-HMIS State-Wide Training – August 2012

Overview of NH State-Wide Training• Dates: week of 8/6/- 8/10/2012 --morning and afternoon sessions each

of the 5 days.• Purpose: Training for all users and Agency Admins was required

because there was a software upgrade to ServicePoint 5.0.• Where: Mandatory training was held at three locations (Nashua,

Manchester and Concord).• Number of Attendees: 85 total users/Admins attended from all CoCs.• Training was 2 hours for end users; Admins were required to stay an

extra hour to review ART Reports and Administrative tasks.• Attendees were given a training binder that included 300 pages of

documentation and a DVD with videos. They were asked to fill out an evaluation form, but everyone did not fill out a form, and some did not complete every question. • Users knew before training that there was a test to verify knowledge

and that passing the test was a requirement for access into the new version of ServicePoint 5.• After passing the online test, users were emailed their HMIS certificate

and given access to ServicePoint 5.• Donna held make up training at Nashua and Manchester locations and

also online.

NH-HMIS State-Wide Training – August 2012 2

NH-HMIS Training Evaluation Form

DATE: ___________________ LOCATION: □BOSCoC □MCoC □GNCoC NH HMIS would like your comments about this ServicePoint 5 training session. Your feedback helps us improve the effectiveness and content of future training and improve our services. We appreciate and value your time in responding to these questions. Please answer the questions below using the numbers 1-5 with 1 being the least accurate and 5 being the most accurate. Thank you for filling out the evaluation! 1. Is this your first time attending HMIS training? (check one) □Yes □ No 2. Would you say the length of the training was: □ Too brief □ Just Right □ Too long

If not just right, please explain: 3. Please rate your overall knowledge/skill level on HMIS Software (circle one in each category):

BEFORE attending this session/event: (Low) 0 1 2 3 (Moderate) 4 5 6 7 (High) 8 9 10AFTER attending this session/event: (Low) 0 1 2 3 (Moderate) 4 5 6 7 (High) 8 9 10

4. What did you hope to gain from the session? (Please check all that apply)

□ How to enter a client record □ How to check a client into a bed

□ How to look up resources □ Other (Please specify)_________________________ 5. The registration process from the Eventbrite website was: □ Easy □ Just right □ Too difficult

If difficult, please explain: 6. Would you say the frequency of reminder emails was: □ Too many □ Just right □ Not enough

If not just right, please explain: 7. How well did this session meet its stated objectives? (circle one): (low) 1 2 3 4 5 (high)

Please explain: 8. Was the content organized and presented well? (circle one): (low) 1 2 3 4 5 (high) 9. How would you rate the delivery of the content? (circle one): (low) 1 2 3 4 5 (high) 10. How would you rate the trainer? (circle one): (low) 1 2 3 4 5 (high) 11. How would you rate the handouts? (circle one): (low) 1 2 3 4 5 (high) 13. How would you rate the location? (circle one): (low) 1 2 3 4 5 (high) 14. How would you rate the room? (circle one): (low) 1 2 3 4 5 (high)NH-HMIS State-Wide Training – August

2012 3

15. Rate your comfort level (after the training) with the following:

entering a single client (circle one): (low) 1 2 3 4 5 (high)

assessing a client (circle one): (low) 1 2 3 4 5 (high)

entering a family record (circle one): (low) 1 2 3 4 5 (high)

checking a client into a bed (circle one): (low) 1 2 3 4 5 (high)

looking up a client (circle one): (low) 1 2 3 4 5 (high) 16. How will this training help you in your day to day work?

Please explain: 17. If online training videos were available 24/7, how likely

would you be to watch the videos? (circle one): (low) 1 2 3 4 5 (high) 18. Which type of training method do you prefer?:

□ watching videos showing the computer screen only

□ watching videos showing the instructor interaction with the screen and class

□ traveling to a location with a live trainer on site

□ other _________________________________ I would like to attend additional training on (please check all that apply):

□Another User training □Administration training □Basic Report Writing□Advanced Report Writing □User Group (interactive group with other users) □Other:___________________________________________________

How often would you like to have refresher training?

□Monthly □Every 3 months □Every 6 months □Once a year □Other:___________________________________________________ Contact Information: Name:_____________________________________ Agency:___________________________________ Job/Role (please check appropriate box):□Case Manager □Program Manager □Agency Administrator □Executive Director□Volunteer Other:__________________________________________________ More comments:


Attendees per Location

# Answer Response %

1 Balance of State CoC 49 58%

2 MCoC 21 25%

3 GNCoC 15 18%

Total 85 100%


Is this your first time attending HMIS training?

# Answer Response %

1 Yes 19 23%

2 No 63 77%

Total 82 100%


Would you say the length of the training was:

# Answer Response %

1 Too Brief 7 8%

2 Just Right 74 87%

3 Too Long 4 5%

Total 85 100%


Please rate your overall knowledge/skill level using the HMIS software (circle one in each category)

Rating: 0 indicates the least knowledge and 11 indicates the most knowledge.

# Question 0 1 2 3 4 5 6 7 8 9 10 11 Responses Mean

1 Before attending this session/event 7 4 6 4 12 6 11 11 7 13 1 0 82 6.27

2 After attending this session/event 1 0 1 2 7 9 9 14 16 16 7 0 82 8.01


What did you hope to gain from this session? Choose all that apply.

# Answer Response %

1 How to enter a client record

39 49%

2 How to look up resources 16 20%

3 How to check a client into a bed

30 38%

4 Other (Please specify) 43 54%


The registration process from the Eventbrite website was:

# Answer Response %

1 Easy 52 68%

2 Just Right 24 31%

3 Too Difficult 1 1%

Total 77 100%


Would you say the frequency of reminder emails was:

# Answer Response %

1 Too many 7 9%

2 Just Right 70 89%

3 Not Enough 2 3%

Total 79 100%


How well did this session meet its stated objectives? Rating: 1 indicates the least accurate and 5 indicates the most accurate.

# Answer Response %

1 1 0 0%

2 2 1 1%

3 3 5 6%

4 4 26 34%

5 5 45 58%

Total 77 100%


Was the content organized and presented well? Rating: 1 indicates the least accurate and 5 indicates the most accurate.

# Answer Response %

1 1 0 0%

2 2 1 1%

3 3 2 2%

4 4 21 25%

5 5 59 71%

Total 83 100%


How would you rate the trainer? Rating: 1 indicates the least accurate and 5 indicates the most accurate.

# Answer Response %

1 1 0 0%

2 2 0 0%

3 3 4 5%

4 4 15 18%

5 5 65 77%

Total 84 100%


How would you rate the handouts? Rating: 1 indicates the least accurate and 5 indicates the most accurate.

# Answer Response %

1 1 0 0%

2 2 0 0%

3 3 1 1%

4 4 15 19%

5 5 64 80%

Total 80 100%


How would you rate the delivery of the content? Rating: 1 indicates the least accurate and 5 indicates the most accurate.

# Answer Response %

1 1 0 0%

2 2 1 1%

3 3 6 7%

4 4 17 21%

5 5 58 71%

Total 82 100%


How would you rate the location and room? Rating: 1 indicates the least accurate and 5 indicates the most accurate.

# Answer Response %

1 1 1 1%

2 2 2 2%

3 3 7 8%

4 4 13 15%

5 5 61 73%

Total 84 100%


After the training, rate your comfort level with these ServicePoint tasks:

Rating: 1 indicates the least accurate and 5 indicates the most accurate.

# Question 1 2 3 4 5 Responses Mean

1 entering a single client 0 1 11 22 50 84 4.44

2 assessing a client 1 3 12 28 41 85 4.24

3 entering a family record 1 5 19 31 29 85 3.96

4 checking a client into a bed 1 4 14 24 40 83 4.18

5 looking up a client 0 1 9 18 57 85 4.54


If online training videos were available 24/7, how likely would you be to watch the videos?

Rating: 1 indicates the least accurate and 5 indicates the most accurate.

# Answer Response %

1 1 5 8%

2 2 12 20%

3 3 18 31%

4 4 15 25%

5 5 9 15%

Total 59 100%


Which type of training method do you prefer? Choose all that apply.

# Answer Response %

1 watching videos showing the computer screen only

13 16%

2 watching videos showing the instructor interaction with the screen and class

16 19%

3 traveling to a location with a live trainer on site

62 75%

4 other: 3 4%


I would like to attend additional training on: Choose all that apply.

# Answer Response %

1 Another User Training 16 31%

2 Administration Training 22 42%

3 Basic Report Writing 19 37%

4 Advanced Report Writing 18 35%

5 User Group (interactive group with other users)

4 8%

6 Other: 6 12%


How often would you like to have a refresher training?

# Answer Response %

1 Monthly 1 1%

2 Every 3 months 8 10%

3 Every 6 months 21 25%

4 Once a year 47 56%

5 Other: 7 8%

Total 84 100%


Job Type/Role

# Answer Response %

1 Case Manager 21 25%

2 Program Manager 12 14%

3 Agency Administrator 28 33%

4 Executive Director 9 11%

5 Volunteer 0 0%

6 Other: 26 31%


Summary

• Tim from Bowman Systems trained 86 users in 5 days, 3 locations and 10 sessions (morning/afternoon each day)

• For 77% of users, not their first training; 88% thought length of training was just right

• Most everyone improved their knowledge or skill level• Using Eventbrite to register was easy for 68% of users• 89% said that the several emails sent by HMIS as reminders

about the training were just the right amount• 92% determined the sessions met their objectives by rating

them between 4 and 5 (the highest rating)


Summary (continued)

• Content organization and delivery, handouts and the location/room all scored favorably high ratings

• 95% gave the trainer the highest two ratings• Comfort level of using the system after the training was

markedly higher• Mixed reviews on watching videos• 75% of users want to travel to be trained by a live trainer

every year, many wanted training every 6 months• Users want additional training on Basic Report Writing (37%)

and Administration (42%) tasks


new hampshire state-wide summary results

Documents

nhhmis statewide training

training session

training binder

mandatory training

content of future training

hmis software circle

hmis certificate

boscoc mcoc gncocnh