28
Parshall UXDC 2016 Using Technology to Improve Assessments Cynthia G. Parshall, PhD Principal Consultant Touchstone Consulting

UXDC 2016: Technology in Assessments

Embed Size (px)

Citation preview

Page 1: UXDC 2016: Technology in Assessments

Parshall UXDC 2016

Using Technology to Improve Assessments

Cynthia G. Parshall, PhDPrincipal Consultant

Touchstone Consulting

Page 2: UXDC 2016: Technology in Assessments

Parshall UXDC 2016

Page 3: UXDC 2016: Technology in Assessments

Parshall UXDC 2016

Inventory of Teacher Technology Skills (ITTS)

Page 4: UXDC 2016: Technology in Assessments

Parshall UXDC 2016

ITTS Examples

Harmes, J.C., Parshall, C.G., Rendina-Gobioff, G., Jones, P.K., Githens, M.P., & Dennard, A. (2004, November). Integrating Usability Methods into the CBT Development Process: Case Study of a Technology Literacy Assessment. Paper presented at the annual meeting of FERA, Tampa, November 17-19.

Page 5: UXDC 2016: Technology in Assessments

Parshall UXDC 2016

Example 1 – File Management Prototype

Harmes, J.C., Parshall, C.G., Rendina-Gobioff, G., Jones, P.K., Githens, M.P., & Dennard, A. (2004, November). Integrating Usability Methods into the CBT Development Process: Case Study of a Technology Literacy Assessment. Paper presented at the annual meeting of FERA, Tampa, November 17-19.

©2005 Florida Department of Education. Used with permission.

Page 6: UXDC 2016: Technology in Assessments

Parshall UXDC 2016

©2005 Florida Department of Education. Used with permission.

Revised File Management Prototype

Harmes, J.C., Parshall, C.G., Rendina-Gobioff, G., Jones, P.K., Githens, M.P., & Dennard, A. (2004, November). Integrating Usability Methods into the CBT Development Process: Case Study of a Technology Literacy Assessment. Paper presented at the annual meeting of FERA, Tampa, November 17-19.

Page 7: UXDC 2016: Technology in Assessments

Parshall UXDC 2016

Final Design – Word Processor

©2005 Florida Department of Education. Used with permission.

Harmes, J.C., Parshall, C.G., Rendina-Gobioff, G., Jones, P.K., Githens, M.P., & Dennard, A. (2004, November). Integrating Usability Methods into the CBT Development Process: Case Study of a Technology Literacy Assessment. Paper presented at the annual meeting of FERA, Tampa, November 17-19.

Page 8: UXDC 2016: Technology in Assessments

Parshall UXDC 2016

©2005 Florida Department of Education. Used with permission.

Final Design – Email Application

Harmes, J.C., Parshall, C.G., Rendina-Gobioff, G., Jones, P.K., Githens, M.P., & Dennard, A. (2004, November). Integrating Usability Methods into the CBT Development Process: Case Study of a Technology Literacy Assessment. Paper presented at the annual meeting of FERA, Tampa, November 17-19.

Page 9: UXDC 2016: Technology in Assessments

Parshall UXDC 2016

Driver Certificate of Professional Competence

(CPC)

Page 10: UXDC 2016: Technology in Assessments

Parshall UXDC 2016

CPC Example 1 – Case

Kayser, M., & Parshall, C.G. (2008, March). Building a Global Innovative Test. Presented at the annual meeting of the Association of Test Publishers, Dallas, TX.

Page 11: UXDC 2016: Technology in Assessments

Parshall UXDC 2016

Kayser, M., & Parshall, C.G. (2008, March). Building a Global Innovative Test. Presented at the annual meeting of the Association of Test Publishers, Dallas, TX.

CPC Case – Multiple Choice Question

Page 12: UXDC 2016: Technology in Assessments

Parshall UXDC 2016

Kayser, M., & Parshall, C.G. (2008, March). Building a Global Innovative Test. Presented at the annual meeting of the Association of Test Publishers, Dallas, TX.

CPC Case – Audio Question

Page 13: UXDC 2016: Technology in Assessments

Parshall UXDC 2016

Kayser, M., & Parshall, C.G. (2008, March). Building a Global Innovative Test. Presented at the annual meeting of the Association of Test Publishers, Dallas, TX.

CPC Case – Graphic Response Options

Page 14: UXDC 2016: Technology in Assessments

Parshall UXDC 2016

Kayser, M., & Parshall, C.G. (2008, March). Building a Global Innovative Test. Presented at the annual meeting of the Association of Test Publishers, Dallas, TX.

CPC Case – Hotspot Question

Page 15: UXDC 2016: Technology in Assessments

Parshall UXDC 2016

CPC Example 2 – Audio Question

Kayser, M., & Parshall, C.G. (2008, March). Building a Global Innovative Test. Presented at the annual meeting of the Association of Test Publishers, Dallas, TX.

Page 16: UXDC 2016: Technology in Assessments

Parshall UXDC 2016

The participants had several difficulties with the audio player.

Audio – Audio – Second Second Usability Usability RoundRound

Kayser, M., & Parshall, C.G. (2008, March). Building a Global Innovative Test. Presented at the annual meeting of the Association of Test Publishers, Dallas, TX.

Page 17: UXDC 2016: Technology in Assessments

Parshall UXDC 2016

Some participants still found the instructions insufficiently clear.

Audio – Audio – ThirdThirdUsability Usability RoundRound

Kayser, M., & Parshall, C.G. (2008, March). Building a Global Innovative Test. Presented at the annual meeting of the Association of Test Publishers, Dallas, TX.

Page 18: UXDC 2016: Technology in Assessments

Parshall UXDC 2016

The orange font color, along with a simplified audio player, were successful.

Audio – Audio – FinalFinalUsabilityUsabilityRoundRound

Kayser, M., & Parshall, C.G. (2008, March). Building a Global Innovative Test. Presented at the annual meeting of the Association of Test Publishers, Dallas, TX.

Page 19: UXDC 2016: Technology in Assessments

Parshall UXDC 2016

Council of Landscape Architectural Registration

Boards (CLARB)

Page 20: UXDC 2016: Technology in Assessments

Parshall UXDC 2016

CLARB Example 1

Cadle, A., Parshall, C.G., & Baker, J. (2013, February). Development of a New Item Type: The Drag and Place Item. Presented at the annual meeting of ATP, Ft. Lauderdale, FL, February 3-6.

Page 21: UXDC 2016: Technology in Assessments

Parshall UXDC 2016

Spot Elevation – Early Round

Cadle, A., Parshall, C.G., & Baker, J. (2013, February). Development of a New Item Type: The Drag and Place Item. Presented at the annual meeting of ATP, Ft. Lauderdale, FL, February 3-6.

Page 22: UXDC 2016: Technology in Assessments

Parshall UXDC 2016

Spot Elevation – Later Round

Cadle, A., Parshall, C.G., & Baker, J. (2013, February). Development of a New Item Type: The Drag and Place Item. Presented at the annual meeting of ATP, Ft. Lauderdale, FL, February 3-6.

Page 23: UXDC 2016: Technology in Assessments

Parshall UXDC 2016

Exhibit – Fail

Cadle, A., Parshall, C.G., & Baker, J. (2013, February). Development of a New Item Type: The Drag and Place Item. Presented at the annual meeting of ATP, Ft. Lauderdale, FL, February 3-6.

Page 24: UXDC 2016: Technology in Assessments

Parshall UXDC 2016

Exhibit – Win

Cadle, A., Parshall, C.G., & Baker, J. (2013, February). Development of a New Item Type: The Drag and Place Item. Presented at the annual meeting of ATP, Ft. Lauderdale, FL, February 3-6.

Page 25: UXDC 2016: Technology in Assessments

Parshall UXDC 2016

CLARB Example 2

Page 26: UXDC 2016: Technology in Assessments

Parshall UXDC 2016

Item Interface – Unexpected Win

Cadle, A., Parshall, C.G., & Baker, J. (2013, February). Development of a New Item Type: The Drag and Place Item. Presented at the annual meeting of ATP, Ft. Lauderdale, FL, February 3-6.

Page 27: UXDC 2016: Technology in Assessments

Parshall UXDC 2016

Questions?

Page 28: UXDC 2016: Technology in Assessments

Parshall UXDC 2016

Thank you!

Cynthia G. Parshall, PhDPrincipal Consultant

Touchstone [email protected]

https://www.linkedin.com/in/cynthia-parshall-16530286