9
Tech 1010 Understanding Technology – Cafeteria Style Utah Valley University What it looks like:

ISETL presentation: Cafeteria Style Grading 10/13/16

Embed Size (px)

Citation preview

Page 1: ISETL presentation: Cafeteria Style Grading 10/13/16

Tech 1010 Understanding Technology – Cafeteria Style

Utah Valley University

What it looks like:

Page 2: ISETL presentation: Cafeteria Style Grading 10/13/16

The Results

Grade Scale

Grade Points Percent of 781 minimum points available*

A 376 48.1%A- 356 45.6%B+ 346 44.3%B 336 43.0%B- 316 40.5%C+ 307 39.3%C 297 38.0%C- 277 35.5%D+ 267 34.2%D 257 32.9%D- 237 30.4%

*Some sections had up to 1010 total points available

Of the 412 students who submitted more than one assignment, 49.51% achieved an A grade, 25.24% scored 2% or more above an A (which could have been completed with one or

two additional assignments), 8.98% scored 5% or more above an A (which necessitated three or four additional

assignments), 3.88% scored 10% or more above an A (which necessitated five or six additional

assignments), and about 1% actually completed 30% or more than was required for an A (which necessitated

sixteen or seventeen additional assignments)

Percentage of Students Completing Each Assignment Sorted by % CompletionTotal number of students: 419

Assignment # of students who completed

% of all students

Midterm Exam 352 84.0%Lesson 8 Quiz: Chapters 35, 36 338 80.7%Lesson 7 Quiz: Chapter 31 337 80.4%Lesson 4 Quiz: Chapters 24, 25, 26 325 77.6%Lesson 11 Quiz: Chapters 19, 2, 21, 22, 23 323 77.1%Lesson 1 Quiz: Chapters 27, 28 321 76.6%Lesson 1 Quiz: Chapters 2,4,5,6,9 313 74.7%Lesson 12 Quiz: Chapters 1, 11, 12, 32, 33 307 73.3%Final Exam 305 72.8%

Page 3: ISETL presentation: Cafeteria Style Grading 10/13/16

Lesson 2 Quiz: Chapters 7,13,14,15,16,17 303 72.3%Lesson 3 Quiz: Chapters 29, 3 301 71.8%Terms of Agreement Quiz 277 66.1%Student Evaluation (bonus points) 257 61.3%Discuss World Health Issue 196 46.8%Energy Exercise 194 46.3%Discuss Society & Technological Changes 192 45.8%Service Learning Project 192 45.8%Homemade Noodles Video / Images 187 44.6%Early Tech. Adv. Report 185 44.2%Bridge Video / Images - Construct Model Bridge 175 41.8%Discuss Artificial Intelligence 168 40.1%Technology Fair 2 160 38.2%Persuasive Message 159 38.0%Technology Solution: Problem Solving Worksheet 153 36.5%Boat Design Document - Create a PVC Boat Design 153 36.5%

Communication Article 153 36.5%Aerospace/Space Exploration Article 148 35.3%Technology Fair 1 147 35.1%Ideal Future 143 34.1%Technology Issue Flyer 138 32.9%Trombe Wall Video / Images 135 32.2%Discuss Gaming Video 129 30.8%Transportation Floor plan 126 30.1%Disassemble Product 121 28.9%Construction Worker Interview 119 28.4%Farmer/Agriculture Interview 117 27.9%Discuss Generic Top Level Domains (gTLD's) 114 27.2%IBM Watson Report 114 27.2%Discuss Company Ownership 110 26.3%Solar Cooker Video / Images 108 25.8%Homemade Cheese Video / Images 107 25.5%Computer / Networking Paper 96 22.9%Ethics Case Study 92 22.0%Simple Product Summary 90 21.5%Block-cut relief image 89 21.2%Hydraulic Fracturing Report 85 20.3%Land Vehicle Video / Images 79 18.9%Network Protocols Diagram 79 18.9%Medical Technology Paper 78 18.6%Genetic Food Modification Report 74 17.7%Motion Model 71 17.0%

Page 4: ISETL presentation: Cafeteria Style Grading 10/13/16

Discuss Educational Resource Merlot 68 16.2%Design Transport Vehicle 66 15.8%Discuss Educational Resource Connexions 65 15.5%Virtual Reality Video 65 15.5%Force/Lift 56 13.4%Original Invention Idea 50 11.9%Nanotechnology Report 49 11.7%Three Mechanisms Lift Ball 42 10.0%Stockbroker interview 30 7.2%Bonus point for finding broken link and reporting 7 1.7%Note: Seven students only turned in one assignment so not part of grading assessments

Range of scores from A Level Grade by Year, Term and Faculty Member2012 2013

Spr Fall Spr Sum Fall

Instr2 Instr2 Instr2 Instr2 Instr

1 Instr2 Instr3

Grand Total

Percent of total

-40% or lower 6 8 2 5 3 2 12 38 9.22%-30% to -39.99% 2 1 3 4 6 6 22 5.34%

-20% to -29.99% 1 1 1 2 1 7 13 3.16%

-10% to -19.99% 7 2 5 7 4 6 31 7.52%

-5% to -9.99% 7 8 5 10 1 7 12 50 12.14%-1% to -4.99% 10 6 2 10 6 5 15 54 13.11%

0 to 1.99% 13 17 16 24 6 12 12 100 24.27%2% to 4.99% 12 17 10 8 6 2 12 67 16.26%5% to 9.99% 9 5 3 2 2 21 5.10%

10% to 14.99% 3 1 3 2 1 10 2.43%15% to 19.99% 1 1 0.24%20% to 29.99% 2 2 0.49%30% or more 1 1 1 3 0.73%Grand Total 70 66 50 72 37 32 85 412 100.00%

Page 5: ISETL presentation: Cafeteria Style Grading 10/13/16

What Students Thought of Cafeteria Style

Student Evaluation Results on Five Point Scale

Term Course Eval

uatio

ns

Enro

llmen

t

Org

aniz

ed

Res

pect

ful

Fair

Cla

rity

Kno

wle

dgea

ble

Tim

ely

Feed

back

Stan

dard

s

Rec

omm

end

Ove

rall

Fall 2011 1010-001 28 37 4.6 4.9 4.9 4.5 4.8 4.9 4.

4 4.8 4.7

Fall 2011 1010-003 23 35 4.6 4.9 4.9 4.9 4.9 4.7 4.

4 4.8 4.8

Spring 2012 1010-002 29 35 4.6 4.8 4.9 4.7 4.8 4.9 4.

8 4.8 4.8

Spring 2012 1010-003 27 34 4.6 4.9 4.8 4.6 4.9 4.7 4.

5 4.6 4.7

Fall 2012 1010-003 31 34 4.5 4.7 4.7 4.5 4.7 4.5 4.

3 4.7 4.6

Fall 2012 1010-004 23 32 4.8 4.9 4.9 4.8 4.9 4.7 4.

7 4.9 4.8

Spring 2013 1010-002 31 35 4.6 4.8 4.9 4.8 4.9 4.6 4.

5 4.9 4.8

Spring 2013 1010-x01 12 14 4.6 4.5 4.7 4.5 4.7 4.6 4.

7 4.7 4.6

Summer 2013 1010-x01 31 36 4.8 4.8 4.

8 4.7 4.8 4.8 4.7 4.8 4.8

Summer 2013 1010-x02 29 38 4.8 4.9 4.

8 4.6 4.8 4.8 4.8 4.8 4.8

Fall 2013 1010-x01 27 31 4.8 4.7 4.7 4.7 4.7 4.7 4.

7 4.7 4.7

Fall 2013 1010-x04 26 34 4.5 4.4 4.5 4.2 4.2 4.4 4.

4 4.5 4.4

Fall 2013 1010-x07 29 38 4.6 4.5 4.6 4.2 4.5 4.4 4.

3 4.2 4.4

Fall 2013 1010-x08 6 20 4.8 4.5 4.7 4.2 4.7 4.7 4.

8 4.8 4.7

Fall 2013 1010-x09 21 31 4.6 4.4 4.6 4.1 4.2 4.6 4.

5 4.4 4.4

Averages: 4.7 4.7 4.8 4.5 4.7 4.7 4.

6 4.7 4.7

Source:

Page 6: ISETL presentation: Cafeteria Style Grading 10/13/16

Anne Arendt , Angela Trego , Jonathan Allred , "Students reach beyond expectations with cafeteria style grading", Journal of Applied Research in Higher Education, Vol. 8 Iss: 1, pp.2 – 17

http://www.emeraldinsight.com/doi/abs/10.1108/JARHE-03-2014-0048?af=R

Page 7: ISETL presentation: Cafeteria Style Grading 10/13/16

What Students Like to Do

Three instructors who used cafeteria-style grading in a Fundamentals of Technology course analyzed sixteen class sections totaling 1002 students

The data concludes that the largest chosen assignment as well as greatest indicator of a student’s final grade was test submittal

The 58 baseline assignments (more could be added at faculty’s discretion) were divided into four types or categories:• Discussions: Logged online group discussions • Tests: Open book, unlimited time quizzes and tests with questions pulled from chapter-based test banks• Reports: Short written reports • Projects: Construction of models or prototypes

First, and perhaps the most interesting, is that tests were taken far more frequently than any of the other assignment type as an overwhelming 86% of students submitted at least 50% of the tests and 48% of students submitted every test offered

Discussions were also common. Perhaps they were perceived as easier for point attainment because they only required a short duration of time and a few thoughtful responses. Whatever the reason, 51% of students submitted at least 50% of the discussions.

Reports and Projects, both requiring additional effort and worth substantially more points, were split on the number of students submitting assignments for these types, at 15% and 14% respectively, completing 50% of the assignments.

Page 8: ISETL presentation: Cafeteria Style Grading 10/13/16

Total percentage submitting assignment types

Grade versus assignment types

Source:

Trego, Angela, & Arendt, Anne (2015). “What Students Choose to Complete When Given Options”. Assessment and Evaluation in Higher Education. Submitted for consideration September, 2016.