1

“Survey Says?”

A Survey of the ATI Pilot E&IT Procurement Process at

Sacramento State

Accessible Technology Initiative

2

Best Practices Agenda

• Problem and description • Who is involved? • Technology involved • Results • How does it scale?• Unanticipated obstacles & benefits• Future improvements  • Questions & Comments

Problem & Description

Problem: • Part of the Accessible

Technology Initiative (ATI) Procurement Plan was to develop a pilot process and evaluate the process

• Using assessment to shape decisions is a key strategic priority at Sacramento State

Description of Practice:

• An online survey for those involved in the pilot process

• Surveys can be quick, easy for respondents

• Online surveys can provide real time access to responses and summaries for administrators

3

4

Technology: Survey Tool

• A web-based survey on the ATI pilot procurement process was developed http://CTLSilhouette.wsu.edu/surveys/ZS80209

• Flashlight Online Survey Tool - institutional membership

• Flashlight resources and FAQs at http://www.csus.edu/atcs/tools/onlinesurveys/resources.stm#tutorials

• New version of Flashlight is accessible

5

Who is Involved

Survey Respondents: Requestors of IT purchases, IT Consultants, Administrative Support, BuyerSurvey Administrator: ATI CoordinatorGetting a Good Response Rate (~70%)

1. Contacted each person individually2. Made survey anonymous3. Provided contact information for questions

or concerns (ati@csus.edu)4. Mentioned that the survey was short (5 min) 5. Explained that the survey results could help

improve the process

6

Survey Results

• www.csus.edu/accessibility/prosurvey.doc • 71% recommended online training for

learning about accessible E&IT procurement• 64% indicated that vendors were not

familiar with VPATs • 71% indicated that they understood the

CSU accessible E&IT procurement requirement (this needs to be further assessed)

• 50% found the ATI procurement documentation on the Accessibility web page; 43% found it on the Procurement web page

7

Survey Results - Comments

• “Ensure that there is someone who I can contact if I have a question/issue regarding the requirements/process”

• “Continuing education in the form of online training, group training and even newsletters help”

• “Procurement might want to maintain a list of vendors through which frequent & high value purchases are made.”

• “I'd like a link on the [Accessibility] home page that gives a brief overview of the procurement requirements, etc.”

8

How to Use Results to Make Campus ImprovementsA. Added enhancements to Accessibility web pageB. Plan to develop and offer web-based training in

addition to group and individual trainingC. Linked to documentation from both the

Accessibility and Procurement web pages D. Ensure that there is a specialist to contactE. Need to streamline accessibility review processF. Maintain list of frequent/high value IT vendors G. Need to provide education for vendors H. Need additional ATI awareness & educationI. ATI compliance position to design “action plan”

9

Scalability of Results to the CSUA. Shows need to develop shared web-based training

on accessible IT procurement process B. Points to evidence that more vendor education and

training on VPATs is neededC. Suggests importance of a centralized list of

vendors and consistent communication D. Recommends continuing education in the form of

both online and group trainingE. Recommends importance of having an ATI

procurement specialist to contactF. Recognizes need to continue ATI awareness &

education about accessible E&IT procurement

10

Some Unanticipated Obstacles and Benefits

Obstacles:• Survey results don’t capture time/effort

involved in accessible IT procurement• Survey didn’t assess understanding of 508

definitions, exceptions Benefits: • Survey results can help gauge attitudes• Survey provided education about process• Opportunities for collaboration

11

Future Improvements

Need to assess knowledge of Section 508 and requirements for accessible IT procurement

Need to assess understanding of 508 exceptions and alternate access plans

Need more feedback about support needed More accessible version of survey software Survey methodology improvements Better follow up and sharing of results Need to better assess procurement training

activities What other activities could be assessed?

12

Assessment Resources and Tools

• Educause General Assessment Resources:– http://connect.educause.edu/term_view/

Assessment+and+Evaluation • Online Assessment Tools: Do They Work for

Students with Disabilities?– http://connect.educause.edu/Library/Abstract/

OnlineAssessmentToolsDoTh/45599

• Survey Tools: – Flashlight www.tltgroup.org/flashlightP.htm

– Accessibility Survey of Survey Tools: www.wac.ohio-state.edu/workshops/survey_of_surveys/

13

Questions & Comments?

• E-mail additional questions, feedback, and comments about this presentation to: ati@csus.edu or fax them to 916-278-7825

• Thank you!