Software Engineering Exams of Bachelor Students …ritzschk/paper/... · 2012-12-04 · Software Engineering Exams of Bachelor Students - some ... Knowledge question: ... Preliminary

Software Engineering Exams of Bachelor Students - some

Conclusions

Michael Ritzschke

12th Workshop “Software Engineering Education and Reverse Engineering” Opatija, Croatia, 3 September – 8 September 2012

Humboldt-Universität zu Berlin Department of Computer Science

Software Engineering

Overview Three types of examination questions Fields of knowledge The influence of the preparation Conclusions

Opatija, Croatia, 3 September – 8 September 2012

Contents

2

Overview

3

Written exam after winter semester 2011/2012: Time: 120 minutes Number of tasks: 43 (with subtasks 64) Instruction: short answers in free spaces Maximal points: 180 students:

101 accepted for exam, 87 registered, 81 participated


0

2

4

6

8

10

12

14

1,0 1,3 1,7 2,0 2,3 2,7 3,0 3,3 3,7 4,0 5,0

The main result

4 Opatija, Croatia, 3 September – 8 September 2012

• 77 students passed • 4 students failed • Average grade: 2,61

1,0 – best grade: excellent 4,0 – just passed 5,0 - failed

Our basis for the statistical evaluation



Contents

6


Types of examination questions

7

Knowledge question: 31 tasks (45 subtasks) Apply skills: 7 tasks (14 subtasks) Multiple choice: 5 tasks


Examples type 1: Knowledge question

8

2. (1 point) Define internal and external software quality criterion? 3. (2 points) Classify as internal or external software quality criterion: maintainability, reliability, portability, scalability, testability, reusability, robustness.

20. (2 points) What is the importance of regression testing?

34. (3 points) What are the similarities and the differences of analysis patterns and design patterns ? 35. (3 points) What are the similarities and the differences of architectural patterns and design patterns ?


Example type 2: Apply skills

9

24. (5 points) Given: Classification tree for image identification. What is the minimal and the maximal number of test cases in that example? How can you find these numbers for arbitrary classification trees?


Example type 2: Apply skills

10

38. (9 points = 3 + 6) Calculate the cohesion measured with LOCM (Lack Of Cohesion of Methodes) for the following class. a) Give a definition for LOCM. b) Calculate the value LOCM. Discuss your result.


Example type 3: Multiple choice

Assessment: 0.5 points for each correct answer

11

10. (3 points) On which basis cost estimation for software projects is possible? a) Preliminary requirements specification b) Requirements specification c) Use Case Diagrams d) previous projects e) Division of a system to sub-systems f) Information of the portion of a special phase as part of the whole system development


Comparision kinds of tasks

12

criterion knowledge multiple choice Skills

quantity (subtasks) 45 5 14

possible points 97 15 68

average points % 62,4 69,3 62,8 min 11 5,5 17 max 92,5 14 63


Kinds of tasks: Comparision between good and bad student-groups

13

best students: the distribution is balanced worst student: multiple choice leads to better result

students

average points %

overall knowledge multiple choice Skills

all 63,1 62,4 69,3 62,8 10 best 85,8 86,5 82,3 84,2 10 worst 39,2 36,5 57,0 39,0




Contents

14

Fields of knowledge: 5 types

15

Basics: 6 tasks Analysis and Definition: 13 tasks (19 subtasks) Test: 11 tasks (22 subtasks) Design: 6 tasks (9 subtasks) Further problems: 7 tasks (8 subtasks)


Comparision: Fields of knowledge

16

criterion Basics

Analysis and

Definition Test Design further

problems quantity (subtasks) 6 19 22 9 8 possible points 11 43 71 32 23 average points % 78,6 69,6 65,5 50,5 53,6 min 0 10 12,5 1 0 max 11 40,5 67,5 32 23


Fields of knowledge: Comparision between good and bad student groups

17

bad group: we see a stronger decrease of the average points in the last chapters (design, further …)

better group: the distribution is more balanced

students

average points %

overall Basics

Analysis and

Definition Test Design further

problems all 63,1 78,6 69,6 65,5 50,5 53,6

10 best 85,1 90,5 87,8 86,3 83,1 76,1 10 worst 39,2 65,9 48,6 41,2 19,5 29,8




Contents

18

The preparation for the exam

19

to get the permission for the written exam the students have to solve 8 exercises and 6 practical assignments

students work in groups of 3 persons they need 120 points (70 % of the possible points)

To find out if there is a correlation between the obtained preparation points and the result of the written exam we use the statistical program SAS (Statistical Analysis Systems)


Significant correlation between the preparation points of the group and the exam result

20

Conclusions The written exam was successful, all tasks where solved,

we get a normally distribution of the marks The time (120 minutes) was adequate The exam covered tasks from all chapters For better students, the type of task and the field of

knowledge is insignificant The worse students achieved significant better results

with multiple choice tasks, they were badly prepared to the last chapters of the course


Conclusions

Thank you for your attention!

22

Groups of students with more points in the tutorials and practices tasks achieve better results in the exam


Documents

Software Engineering Exams of Bachelor Students …ritzschk/paper/... · 2012-12-04 · Software Engineering Exams of Bachelor Students - some ... Knowledge question: ... Preliminary