19
Computer Literacy Placement Exam Design and Assessment Amber M. Epps The Art Institute of Pittsburgh

Computer Literacy Placement Exam Design and Assessment Amber M. Epps The Art Institute of P ittsburgh

Embed Size (px)

Citation preview

Page 1: Computer Literacy Placement Exam Design and Assessment Amber M. Epps The Art Institute of P ittsburgh

Computer Literacy Placement Exam Design and

Assessment

Amber M. Epps

The Art Institute of Pittsburgh

Page 2: Computer Literacy Placement Exam Design and Assessment Amber M. Epps The Art Institute of P ittsburgh

What is Computer Literacy?

Computer-related terminologyHardware and software basicsBasic operating system functionalityFile managementUsing the internet and understanding

related issuesProductivity applications

Page 3: Computer Literacy Placement Exam Design and Assessment Amber M. Epps The Art Institute of P ittsburgh

Why Do We Care?

Page 4: Computer Literacy Placement Exam Design and Assessment Amber M. Epps The Art Institute of P ittsburgh

Facts

May or may not be a required courseStudents complain!Faculty complain!

Page 5: Computer Literacy Placement Exam Design and Assessment Amber M. Epps The Art Institute of P ittsburgh

Myths

Students already know “this stuff”Should be removed from curriculum

without a backup plan

Page 6: Computer Literacy Placement Exam Design and Assessment Amber M. Epps The Art Institute of P ittsburgh

Survey Says...

Students don’t always know as much as they think they do

Students need to meet minimum proficiency requirementsSchool-definedIndustry-defined

Every school is differentNeed to continue research

Page 7: Computer Literacy Placement Exam Design and Assessment Amber M. Epps The Art Institute of P ittsburgh

So Now What??

Page 8: Computer Literacy Placement Exam Design and Assessment Amber M. Epps The Art Institute of P ittsburgh

Assessment!According to the Higher Learning Commission: “Assessment of student learning is a participatory, iterative

process that: Provides data/information you need on your students’ learning Engages you and others in analyzing and using this

data/information to confirm and improve teaching and learning Produces evidence that students are learning the outcomes

you intended Guides you in making educational and institutional

improvements Evaluates whether changes made improve/impact student

learning, and documents the learning and your efforts.”

Page 9: Computer Literacy Placement Exam Design and Assessment Amber M. Epps The Art Institute of P ittsburgh

Assessment! (cont)

Accreditation often requires computer literacy standards

Not always fun...but importantEvolving work in progress

Don’t expect perfection right away

Page 10: Computer Literacy Placement Exam Design and Assessment Amber M. Epps The Art Institute of P ittsburgh

Where to Begin?

Know your school’s policiesWho else is involved?Consider the scope

How many students will be affected?Online students?Staffing requirements

Get faculty involved!Use tools that are available to you

Page 11: Computer Literacy Placement Exam Design and Assessment Amber M. Epps The Art Institute of P ittsburgh

Next...Platform issues: PC vs MacPlan...

What’s important?What do you want to know?

Start with your competenciesWhat should students know?

Find balance between theory and applicationAsk faculty what matters most

Page 12: Computer Literacy Placement Exam Design and Assessment Amber M. Epps The Art Institute of P ittsburgh

Suggestions!Use a question pool

Check text book instructor resources

Separate competencies by sectionAutomate as much as possible

Clear rubrics when manual grading required

What is a passing score?Pilot test with a focus groupBe flexible and aware of changesRemote testing?

Page 13: Computer Literacy Placement Exam Design and Assessment Amber M. Epps The Art Institute of P ittsburgh

So I’ve Created My Exam...Now What?

What to assess:Pass/fail rate overallPass/fail rate per majorPre/post test differencesAnything that’s important to YOU and

YOUR school

Page 14: Computer Literacy Placement Exam Design and Assessment Amber M. Epps The Art Institute of P ittsburgh

What Does Assessment Tell Us?

Achievement of learning outcomesCompetency proficienciesCompetency deficienciesChanges to degree requirements?

Page 15: Computer Literacy Placement Exam Design and Assessment Amber M. Epps The Art Institute of P ittsburgh

Let’s Look At Some Real Examples

Page 16: Computer Literacy Placement Exam Design and Assessment Amber M. Epps The Art Institute of P ittsburgh

Pre-Test: Theory*Based on 80% as Passing Score

Page 17: Computer Literacy Placement Exam Design and Assessment Amber M. Epps The Art Institute of P ittsburgh

Test-Out Results*Based on 80% as Passing Score

Page 18: Computer Literacy Placement Exam Design and Assessment Amber M. Epps The Art Institute of P ittsburgh

Questions!!

Why is the pre-test passing rate so low?

Why is the test-out passing rate so high?

Page 19: Computer Literacy Placement Exam Design and Assessment Amber M. Epps The Art Institute of P ittsburgh

Time to share!

Feel free to contact me:Amber M. EppsThe Art Institute of [email protected]