29
Assessment Day ‘15 Social Science

Assessment Day ‘15 Social Science. Today’s Plan 1 – Overview/Background/Questions 2 – Ethical Responsibility – Overview of results/plan for future 3 –

Embed Size (px)

Citation preview

Page 1: Assessment Day ‘15 Social Science. Today’s Plan 1 – Overview/Background/Questions 2 – Ethical Responsibility – Overview of results/plan for future 3 –

Assessment Day ‘15Social Science

Page 2: Assessment Day ‘15 Social Science. Today’s Plan 1 – Overview/Background/Questions 2 – Ethical Responsibility – Overview of results/plan for future 3 –

Today’s Plan

• 1 – Overview/Background/Questions• 2 – Ethical Responsibility– Overview of results/plan for future

• 3 – Critical Thinking– Discussion of items/ Norming items in groups

• 4 – Odds and Ends from Laura’s office• 5 – Info Lit./Written Comm. Discussion for those

of us w/ Gordon Rule classes (History, Poli Sci)

Page 3: Assessment Day ‘15 Social Science. Today’s Plan 1 – Overview/Background/Questions 2 – Ethical Responsibility – Overview of results/plan for future 3 –

1 – Overview/Background/Questions

Page 4: Assessment Day ‘15 Social Science. Today’s Plan 1 – Overview/Background/Questions 2 – Ethical Responsibility – Overview of results/plan for future 3 –

1 – Overview/Background/Questions

Page 5: Assessment Day ‘15 Social Science. Today’s Plan 1 – Overview/Background/Questions 2 – Ethical Responsibility – Overview of results/plan for future 3 –

2 – Ethical Responsibility - Overview

• 5 shared questions amongst all Social Science• 5 discipline specific questions– This was developed Assessment Day ’14

• We rolled out a small pilot in the Fall ’14– Only to full time faculty

• We rolled out a 30% sample to all section Spring’15 – just after spring break– N= 3455

Page 6: Assessment Day ‘15 Social Science. Today’s Plan 1 – Overview/Background/Questions 2 – Ethical Responsibility – Overview of results/plan for future 3 –

2 – Ethical Responsibility - Overview

• We rolled out a 30% sample to all section Spring’15 – just after spring break

• There were some… issues… w/ this roll out.

• The Learning Outcomes Leaders (LOLs) have proposed a number of changes based on these issues and our overall experiences.– I will address these changes after presenting the data

Page 7: Assessment Day ‘15 Social Science. Today’s Plan 1 – Overview/Background/Questions 2 – Ethical Responsibility – Overview of results/plan for future 3 –

2 – Ethical Responsibility - Results

146/3455= 4.23%Add in the pilot data from the fall and we had 181 responses

Page 8: Assessment Day ‘15 Social Science. Today’s Plan 1 – Overview/Background/Questions 2 – Ethical Responsibility – Overview of results/plan for future 3 –

2 – Ethical Responsibility – Shared ResultsQ1- Academic Dishonesty – Students are assigned at the start of the term a midterm exam. This midterm will take place the week after spring break. While on spring break, one student email the professor and explains that their uncle has died and they will miss the exam. In the email, they ask if they could take the midterm exam late. The professor agrees but asks for verification of the story upon the students’ return. The student returns but fails to provide any evidence of the story.

1 2 3 4 514 28 49 52 37

N=181

1 – Totally ethical with no code violation2 – Mostly ethical with minor code violation3 – Kind of ethical and generally accepted for this type of situation4 – Mostly unethical with minor code violation5 – Totally unethical and a total code violation

1 2 3 4 50

10

20

30

40

50

60

Page 9: Assessment Day ‘15 Social Science. Today’s Plan 1 – Overview/Background/Questions 2 – Ethical Responsibility – Overview of results/plan for future 3 –

2 – Ethical Responsibility – Shared Results• Q2 - Cheating– Subhas and Sally are taking a multiple choice test.

After 45 minutes of the test, Sally sneezes accidently and her scantron sheet flies off the desk. Subhas as a nice gesture picks up the scantron for Sally, however, prior to giving it back, looks at the scantron very briefly. After returning to his own test, Subhas then proceeds to changes several of his answers to what he saw on Sally’s sheet.

1 2 3 4 57 5 10 38 120

N=181

1 – Totally ethical with no code violation2 – Mostly ethical with minor code violation3 – Kind of ethical and generally accepted for this type of situation4 – Mostly unethical with minor code violation5 – Totally unethical and a total code violation

1 2 3 4 50

20406080

100120140

Page 10: Assessment Day ‘15 Social Science. Today’s Plan 1 – Overview/Background/Questions 2 – Ethical Responsibility – Overview of results/plan for future 3 –

2 – Ethical Responsibility – Shared Results• Q3 - Plagiarism– A student is feeling pressured to do a writing

assignment but does not fully understand what is required. As this student never asked the teacher for clarification nor help, it has been left until the night before it is due. At this point, the student asks a friend who previously took the course for help. The friend loans their old paper to the student who then proceeds to copy 35% of the paper and fills in their own info the test. The student then submits the paper to the teacher as their own.

1 2 3 4 56 4 15 40 114

N=181 1 – Totally ethical with no code violation2 – Mostly ethical with minor code violation3 – Kind of ethical and generally accepted for this type of situation4 – Mostly unethical with minor code violation5 – Totally unethical and a total code violation

1 2 3 4 50

20406080

100120

Page 11: Assessment Day ‘15 Social Science. Today’s Plan 1 – Overview/Background/Questions 2 – Ethical Responsibility – Overview of results/plan for future 3 –

2 – Ethical Responsibility – Shared Results• Q4 – Sexual Harassment – A female professor is walking through

campus passes by a former female student and says “Hello.” The female student responds, “Hi , beautiful, nice to see you again.” Both keep walking and the conversation ends. The next day, they see each other again and the student comes over and says, “Hi, gorgeous, how has your day been?” The professor, feeling uncomfortable, walks away quickly.

1 2 3 4 514 15 23 57 71

N=181

1 – Totally ethical with no code violation2 – Mostly ethical with minor code violation3 – Kind of ethical and generally accepted for this type of situation4 – Mostly unethical with minor code violation5 – Totally unethical and a total code violation

1 2 3 4 50

1020304050607080

Page 12: Assessment Day ‘15 Social Science. Today’s Plan 1 – Overview/Background/Questions 2 – Ethical Responsibility – Overview of results/plan for future 3 –

2 – Ethical Responsibility – Shared Results• Q5 – Class Disruption – During class time, a student has

repeatedly been able to text without a professor noticing. However, another student in the near proximity has noticed the texting and has become annoyed by the distraction.

1 2 3 4 511 15 49 69 36

N=181

1 – Totally ethical with no code violation2 – Mostly ethical with minor code violation3 – Kind of ethical and generally accepted for this type of situation4 – Mostly unethical with minor code violation5 – Totally unethical and a total code violation

1 2 3 4 50

1020304050607080

Page 13: Assessment Day ‘15 Social Science. Today’s Plan 1 – Overview/Background/Questions 2 – Ethical Responsibility – Overview of results/plan for future 3 –

2 – Ethical Responsibility – Discipline Specific - Psychology N=105

• 1 – My Psychology course challenged me to think more broadly about poverty, health, rights of children, and/or issues of prejudice and discrimination.

SA A N D SD43 32 19 5 4

Indicate the extent to which you agree or disagree with the following: SA, A, N, D, SD

Page 14: Assessment Day ‘15 Social Science. Today’s Plan 1 – Overview/Background/Questions 2 – Ethical Responsibility – Overview of results/plan for future 3 –

2 – Ethical Responsibility – Discipline Specific - Psychology N=105

• 2 – My Psychology course enhanced my ability to see the world from someone else’s perspective.

SA A N D SD42 42 11 6 2

Indicate the extent to which you agree or disagree with the following: SA, A, N, D, SD

Page 15: Assessment Day ‘15 Social Science. Today’s Plan 1 – Overview/Background/Questions 2 – Ethical Responsibility – Overview of results/plan for future 3 –

2 – Ethical Responsibility – Discipline Specific - Psychology N=105

• 3 – My Psychology course promoted the tolerance of others with different beliefs.

SA A N D SD45 29 25 2 2

Indicate the extent to which you agree or disagree with the following: SA, A, N, D, SD

Page 16: Assessment Day ‘15 Social Science. Today’s Plan 1 – Overview/Background/Questions 2 – Ethical Responsibility – Overview of results/plan for future 3 –

2 – Ethical Responsibility – Discipline Specific - Psychology N=105

• 4 – My Psychology course influenced my openness to having my views challenged.

SA A N D SD47 33 18 4 1

Indicate the extent to which you agree or disagree with the following: SA, A, N, D, SD

Page 17: Assessment Day ‘15 Social Science. Today’s Plan 1 – Overview/Background/Questions 2 – Ethical Responsibility – Overview of results/plan for future 3 –

2 – Ethical Responsibility – Discipline Specific - Psychology N=105

• 5 – My Psychology course promoted the understanding of differences in culture, gender, and/or sexual orientation.

SA A N D SD45 30 24 2 1

Indicate the extent to which you agree or disagree with the following: SA, A, N, D, SD

Page 18: Assessment Day ‘15 Social Science. Today’s Plan 1 – Overview/Background/Questions 2 – Ethical Responsibility – Overview of results/plan for future 3 –

2 – Ethical Responsibility – Discipline Specific - Sociology N = 26

Scenario #1 - While you are walking down a busy street you see a foreman yelling at a construction worker. At first it appears that they are arguing about the worker’s performance on the job but then you realize the foreman is criticizing the worker’s resistance to working overtime during the weekend.

1 2 3 4 51 1 8 8 8

1 – Totally ethical2 – Mostly ethical 3 – Kind of ethical and generally acceptable4 – Mostly unethical5 – Totally unethical

Page 19: Assessment Day ‘15 Social Science. Today’s Plan 1 – Overview/Background/Questions 2 – Ethical Responsibility – Overview of results/plan for future 3 –

2 – Ethical Responsibility – Discipline Specific - Sociology N = 26

Scenario #2 - A man steals bread from a grocery store in order to feed his starving wife and children. He is caught, put in jail for a number of years and his children are removed from their home. Using the above scale, rate the man’s theft.

1 2 3 4 51 3 9 8 5

1 – Totally ethical2 – Mostly ethical 3 – Kind of ethical and generally acceptable4 – Mostly unethical5 – Totally unethical

Page 20: Assessment Day ‘15 Social Science. Today’s Plan 1 – Overview/Background/Questions 2 – Ethical Responsibility – Overview of results/plan for future 3 –

2 – Ethical Responsibility – Discipline Specific - Sociology N = 26

Scenario #3 - You are standing in line to vote and you see an elderly lady struggling with filling out her ballot. She turns to you and asks for help. You find a volunteer to help her but while you wait she shows you her ballot and asks what you think. You say “This looks good.” Rate this reaction using the above scale.

1 2 3 4 52 3 14 3 4

1 – Totally ethical2 – Mostly ethical 3 – Kind of ethical and generally acceptable4 – Mostly unethical5 – Totally unethical

Page 21: Assessment Day ‘15 Social Science. Today’s Plan 1 – Overview/Background/Questions 2 – Ethical Responsibility – Overview of results/plan for future 3 –

2 – Ethical Responsibility – Discipline Specific - Sociology N = 26

Scenario #4 - On the first day of high school at a new school two siblings are revealed to have “two mommies.” This is mentioned by the homeroom teacher and without the siblings consent. The siblings are not embarrassed but also do not elaborate on the teacher’s admission. Rate the teacher using the above scale.

1 2 3 4 50 2 4 8 12

1 – Totally ethical2 – Mostly ethical 3 – Kind of ethical and generally acceptable4 – Mostly unethical5 – Totally unethical

Page 22: Assessment Day ‘15 Social Science. Today’s Plan 1 – Overview/Background/Questions 2 – Ethical Responsibility – Overview of results/plan for future 3 –

2 – Ethical Responsibility – Discipline Specific - Sociology N = 26

Scenario #5 - A young man, about 15 years old, listens to a lot of hip hop and rap music. His mother hears the music coming from his bedroom and asks him about the names of some of his favorite songs. After Googling the songs, and finding the lyrics objectionable, she demands that he delete the music from his devises and has a talk with him about why the songs were objectionable. Rate the mother using the above scale.

1 2 3 4 59 5 5 5 2

1 – Totally ethical2 – Mostly ethical 3 – Kind of ethical and generally acceptable4 – Mostly unethical5 – Totally unethical

Page 23: Assessment Day ‘15 Social Science. Today’s Plan 1 – Overview/Background/Questions 2 – Ethical Responsibility – Overview of results/plan for future 3 –

2 – Ethical Responsibility – Proposed Changes

• Survey either Eth. Resp. or Crit. Thinking every year – not both.– 2016 Critical Thinking and 2017 Ethical Resp.

• Survey all Gen. Ed classes in all disciplines– Not 30% sample– This allows us to offer pts for completion, etc.

• Increase involvement by part time faculty

Page 24: Assessment Day ‘15 Social Science. Today’s Plan 1 – Overview/Background/Questions 2 – Ethical Responsibility – Overview of results/plan for future 3 –

2 – Ethical Responsibility – Discussion• Questions from Laura

1 - What do the results of your assessment suggest about student preparation in your program?2 - What are the strengths of your students as shown through your program assessment? Which areas need to be strengthened?3 - What next steps are suggested regarding your program from the assessment process and outcomes?4 - Which of these steps can be taken over the next year?5 - Which of these steps need to be taken over the long term?

Page 25: Assessment Day ‘15 Social Science. Today’s Plan 1 – Overview/Background/Questions 2 – Ethical Responsibility – Overview of results/plan for future 3 –

3 – Critical Thinking - Overview• How was this list of questions developed?

East Questions tend to be a bit different from West

We now have a list of 59 questions.

• The accepted questions will go into a pool.• When we assess for Critical Thinking – it will

be a 10 item test, drawn from this pool.

Page 26: Assessment Day ‘15 Social Science. Today’s Plan 1 – Overview/Background/Questions 2 – Ethical Responsibility – Overview of results/plan for future 3 –

3 – Critical Thinking – Group Norming• We will break into 5 groups lead by LOLs – Carl, Gina, Adrienne, Derek and Jovan

• You will assess 12 questions as Acceptable, Revise, or Reject• The accepted questions will go into a pool.• When we assess for Critical Thinking – it will be a 10 item

test, drawn from this pool.Keep in Mind

Questions must be general (not requiring disc. specific knowledge)Students will be answering 10 of them

Other departments have been shooting for 70% accuracy

Page 27: Assessment Day ‘15 Social Science. Today’s Plan 1 – Overview/Background/Questions 2 – Ethical Responsibility – Overview of results/plan for future 3 –

3 – Critical Thinking - Discussion• Thoughts and Concerns about:– Items/Questions?– Pool?– Overall Assessment?

Page 28: Assessment Day ‘15 Social Science. Today’s Plan 1 – Overview/Background/Questions 2 – Ethical Responsibility – Overview of results/plan for future 3 –

4 – Odds and Ends from Laura’s office

6 - What kinds of faculty development activities are needed?7 - Is this outcome being assessed in other areas of the program?8 - Should the process of communicating the assessment process and results change next year? If so, how?9 - How should the process of assessing and reviewing the results change next year, if at all?10 - What are the other learning outcomes for the program and how are they being assessed?11- Who is responsible for the next steps in the development of the improvement plan and when should these steps be taken?

Page 29: Assessment Day ‘15 Social Science. Today’s Plan 1 – Overview/Background/Questions 2 – Ethical Responsibility – Overview of results/plan for future 3 –

5 – Info Lit./Written Comm.

• Discussion for those of us w/ Gordon Rule classes (History, Poli Sci)