Upload
others
View
8
Download
0
Embed Size (px)
Citation preview
<Prozessname><Funktion>
Phase IV
Data
Analysis
Phase V
Feedback
Phase III
Data
Management
Phase II
Testing
Phase I
Item
Archiving
Reading Item - Strategy 1.1.Identifying text type
The shepherd Jorindel noticed with fear that he and his girl friend had sat down close under the
walls of the old castle in the dark wood. The girl was singing while she was watching the sun setting
fast. Suddenly there was no more singing. When Jorindel turned round, he saw his pretty fiancée
had been turned into a nightingale. Jorindel himself could not move from the spot. He stood fixed
as a rock.
Where is the passage taken from?
A An adventure story
B A fairy tale
C A newspaper article
D A crime story
Writing Prompt - Short Task 2
You will have 10 minutes to do this task.
Read the instructions carefully and then write your text on the separate sheet. Your short letter or e-
mail should be 40 to 60 words long.
You are staying with an English host family. Their son, John, is 14 years old.
You borrowed his new SHAKIRA CD while John was out with friends and listened to it in your room,
but you sat down on it and it broke.
As you will be in the disco when he comes home, you write a note for him in which you
tell him what happened,
say how sorry you are and
explain what you are going to do. LTC Item Bank
E-Day
Instructing
Schools
Test
Administrator
Training
Rater Training
for Writing
Interlocutor/
Assessor
Training for
Speaking
Test Construction
Reading
(20 items)
Writing
(2 prompts)
Speaking
(3 prompts)
Listening
(20 items)
Data Merging
Plausibility Check
Scanning of
Reading
Answer Sheets
Scanning of
Listening
Answer Sheets
Scoring Key
Tables Listening/Reading
Raw Data Sets
Reading Listening Biodata Speaking Writing
Final Data Sets
Reading Listening Biodata Speaking Writing
Rating of
Writing
Performances
Rating of
Speaking
Performances
Online Feedback
For Students For Principals For Teachers For Authorities
Results reported as
Scale (0-100) Reading and Listening
Scale (0-7) Writing and Speaking
Percent Ranks
(norm-referenced interpretation)
CEF level (A1 - B1+)
(criterion-referenced interpretation)
TABLE 12.2 LISTENING&READING/E8 (May 2008): Final ZOU946WS.TXT Jul 18 9:17 2008INPUT: 1238 Persons 230 Items MEASURED: 1238 Persons 230 Items 2 CATS 3.65.0--------------------------------------------------------------------------------
Persons - MAP - Items <more>|<rare> 4 . + . | | .# | . | .# | 3 # T+ .# | ### | re_hechenbl06_s1 .## | .## |T rc_madertha06_s1
.#### | rc_brockrai13_s12 ##### + li_cranegra01_s1 li_kainighu03_s1 li_lackenba02_s1 re_poiselev06_s1
.####### | li_gotteinh04_l5 rc_gritscha10_l5 rc_schmolmu07_l5 rc_wallners08_l4 re_schmolmu07_l1 .####### S| ld_feyertag04_l1 ld_feyertag04_l3 li_wallners03_s1 rc_brockrai15_s1 rc_feyertag06_s1
######## | ld_feyertag02_s1 li_cranegra04_l5 rc_brockrai17_l3 rc_brockrai17_l4 rc_schmolmu07_l2 rc_sturmeli05_s1 '1 .######## | ld_cranegra04_l2 rc_brockrai17_l2 rc_feyertag05_s1 rc_gotteinh08_l5 rc_gritscha10_l1 rc_schmolmu07_l4 '2 .######### |S ld_lackenba04_l2 ld_wurmsmol04_l3 li_cranegra04_l4 rc_brockrai17_l1 rc_gritscha10_l4 rc_kainighu06_l5 '3
1 .########## + ld_feyertag03_s1 ld_lackenba04_l1 ld_sturmeli03_s1 li_brockrai07_s1 li_gritscha03_s1 li_kainighu02_s1 '4############ | ld_gotteinh04_l4 ld_sturmeli04_l2 li_hafnerma06_s1 li_wurmsmol04_l2 rc_feyertag07_l3 rc_gritscha10_l3 '5
.####### | li_madertha01_s1 li_poiselev04_l5 li_wurmsmol04_l1 rc_hafnerma16_l2 rc_parthchr05_s1 rc_poiselev07_l3 '6 .######## M| ld_poiselev04_l2 ld_schmolmu04_l2 ld_sturmeli04_l4 li_hechenbl04_l4 li_schmidbe01_s1 li_schmidbe05_l5 '7
.########## | ld_langnick03_s1 ld_poiselev01_s1 li_parthchr04_l2 rc_isakgabr16_s1 rc_kainighu06_l4 rc_madertha09_l1 '8 .###### | ld_gotteinh04_l2 ld_madertha04_l3 ld_sturmeli04_l1 ld_wurmsmol04_l4 li_brockrai06_s1 li_hechenbl03_s1 '9 0 ############# +M ld_cranegra02_s1 ld_hechenbl04_l2 ld_hechenbl04_l5 li_sturmeli04_l3 rc_brockrai17_l5 rc_gritscha11_l4 '10
######## | li_hafnerma05_s1 li_isakgabr02_s1 li_parthchr04_l3 li_schmidbe05_l3 li_schmolmu04_l3 rc_parthchr08_s1 '11.####### | ld_cranegra04_l1 ld_feyertag04_l2 ld_feyertag04_l4 ld_schmidbe05_l1 ld_schmidbe05_l2 ld_wallners01_s1 '12
.######### | ld_poiselev04_l3 rc_feyertag07_l4 rc_gotteinh06_s1 rc_gotteinh07_s1 rc_hafnerma16_l3 re_gritscha11_l1 '13 .#### | ld_gotteinh03_s1 ld_schmidbe05_l4 li_lackenba04_l4 li_madertha04_l5 li_poiselev02_s1 rc_schmolmu05_s1 '14 .##### S| ld_lackenba03_s1 ld_parthchr04_l5 li_feyertag04_l5 li_kainighu01_s1 rc_hospsabi07_s1 rc_parthchr09_l5 '15
-1 .###### + ld_parthchr04_l4 ld_poiselev04_l1 ld_poiselev04_l4 li_schmidbe03_s1 li_schmolmu02_s1 rc_poiselev05_s1 '16 .###### |S ld_hechenbl04_l3 ld_madertha04_l2 li_poiselev03_s1 rc_gritscha11_l3 re_parthchr09_l1
##### | ld_wurmsmol01_s1 li_schmolmu04_l4 li_schmolmu04_l5 rc_madertha09_l3 re_wallners07_s1.#### | ld_cranegra04_l3 ld_gotteinh01_s1 ld_gotteinh04_l1 ld_madertha03_s1 li_hechenbl01_s1 re_greifene05_s1
.#### | ld_madertha04_l4 rc_madertha09_l5 .### | ld_feyertag01_s1 ld_greifene02_s1 ld_isakgabr05_s1 ld_lackenba04_l3 rc_madertha09_l4
-2 .# + ld_gotteinh04_l3 ld_schmolmu04_l1 li_gritscha04_s1 li_parthchr04_l1 re_fuchseve06_s1 re_schmidbe09_l3 . T| li_greifene01_s1 rc_gritscha08_s1 re_isakgabr10_s1 .# |T ld_parthchr02_s1 rc_kainighu05_s1 . | ld_hechenbl04_l1 ld_madertha02_s1 . | . | ld_madertha04_l1 re_parthchr09_l2
-3 + ld_hechenbl02_s1 . | . | | | |
-4 . + <less>|<frequ> EACH '#' IS 6.
1 re_feyertag07_l1; re_langnick05_s12 rc_wurmsmol07_l43 rc_madertha05_s1; rc_parthchr07_s1; rc_poiselev07_l24 rc_feyertag07_l2; rc_hafnerma15_l4; rc_kainighu06_l3; rc_poiselev07_l4; rc_wurmsmol05_s1; rc_wurmsmol07_l5; re_gotteinh08_l4;
re_gritscha10_l2; re_madertha07_s1; re_schmidbe09_l15 rc_hafnerma15_l1; rc_hafnerma16_l4; rc_parthchr09_l4; re_wurmsmol06_s16 rc_poiselev07_l5; re_isakgabr11_s1; re_poiselev07_l17 rc_hafnerma15_l5; rc_hechenbl07_s1; rc_lackenba05_s1; rc_langnick04_s1; rc_wurmsmol07_l2; re_lackenba06_s1; re_schmolmu06_s1;
re_sturmeli06_l28 rc_madertha09_l2; rc_parthchr06_s1; re_hafnerma11_s19 li_sturmeli04_l5; rc_gotteinh08_l3; rc_gritscha11_l5; rc_hafnerma15_l2; rc_kainighu06_l2; rc_schmidbe06_s1; rc_sturmeli06_l4
rc_sturmeli06_l5; re_isakgabr14_s1; re_madertha08_s110 rc_hafnerma15_l3; rc_wallners08_l3; re_wallners05_s111 rc_feyertag07_l5; rc_parthchr09_l3; rc_wurmsmol07_l3; re_fuchseve04_s1; re_langnick06_s1; re_sturmeli06_l1; re_wurmsmol07_l112 ld_wurmsmol04_l5; li_lackenba04_l5; rc_gotteinh05_s1; rc_hafnerma16_l5; rc_schmidbe08_s1; rc_schmidbe09_l2; rc_schmidbe09_l4;
re_gotteinh08_l1; re_gritscha11_l2; re_schmidbe07_s1; re_schmidbe09_l513 re_isakgabr15_s1; re_wallners08_l114 re_cranegra06_s1; re_gotteinh08_l2; re_hafnerma16_l115 rc_schmolmu07_l3; rc_wallners06_s1; rc_wallners08_l2; re_hechenbl05_s1; re_lackenba07_s1; re_wallners08_l516 re_kainighu06_l1 re_sturmeli06_l3
„Well, I mean, I know almost everybody in Austria goes skiing in
their winter holidays but I don’t. True, it’s the favourite sport of most
Austrians but it is not cheap – think of all the equipment you need,
and ski lift passes, and hotel costs and and and .... So there’s no
fun in skiing for me.“
The woman thinks skiing is
A everybody’s favourite sport
B dangerous
C great fun
D expensive
Listening Item:
-4
-3
-2
-1
0
1
2
3
4
0,7 0,75 0,8 0,85 0,9 0,95 1 1,05 1,1 1,15 1,2 1,25 1,3
Mea
su
res
Infit Mean-square
Items
ld_hechenbl02_s1
re_hechenbl06_s1
rc_parthchr08_s1
re_schmidbe09_l3
rc_brockrai17_l2
li_parthchr04_l3
Items/Prompts
Item Characterisation Form (ICF)/ Solutions
Reading Listening
Writing Speaking
Item Archive Item Bank
Item Writer
Training
Item
Writing
Item Screening
and Editing
TDMSTest Data Management System
TMSTest Management
System
IMSItem Management
System
TTMSTest Taker Management
System
-3
-2
-1
0
1
2
3
li_greifene01_s1
li_gritscha04_s1
ld_greifene02_s1
li_isakgabr02_s1
ld_cranegra02_s1
ld_feyertag02_s1
li_hafnerma05_s1
ld_hechenbl02_s1
li_madertha01_s1
li_kainighu01_s1
li_parthchr04_l1
li_parthchr04_l2
li_parthchr04_l3
ld_parthchr04_l4
ld_parthchr04_l5
ld_poiselev04_l1
ld_poiselev04_l2
ld_poiselev04_l3
ld_poiselev04_l4
li_poiselev04_l5
li_cranegra01_s1
li_gritscha03_s1
li_brockrai07_s1
ld_langnick03_s1
li_brockrai06_s1
ld_feyertag03_s1
ld_poiselev01_s1
li_kainighu02_s1
li_lackenba02_s1
li_hafnerma06_s1
ld_cranegra04_l1
ld_cranegra04_l2
ld_cranegra04_l3
li_cranegra04_l4
li_cranegra04_l5
ld_gotteinh04_l1
ld_gotteinh04_l2
ld_gotteinh04_l3
ld_gotteinh04_l4
li_gotteinh04_l5
ld_gotteinh01_s1
li_poiselev02_s1
ld_isakgabr05_s1
li_schmidbe03_s1
ld_madertha02_s1
ld_hechenbl04_l1
ld_hechenbl04_l2
ld_hechenbl04_l3
li_hechenbl04_l4
ld_hechenbl04_l5
ld_schmolmu04_l1
ld_schmolmu04_l2
li_schmolmu04_l3
li_schmolmu04_l4
li_schmolmu04_l5
ld_feyertag01_s1
li_hechenbl03_s1
ld_lackenba03_s1
li_schmidbe01_s1
li_poiselev03_s1
ld_sturmeli04_l1
ld_sturmeli04_l2
li_sturmeli04_l3
ld_sturmeli04_l4
li_sturmeli04_l5
ld_schmidbe05_l1
ld_schmidbe05_l2
li_schmidbe05_l3
ld_schmidbe05_l4
li_schmidbe05_l5
ld_gotteinh03_s1
ld_wurmsmol01_s1
li_schmolmu02_s1
ld_sturmeli03_s1
ld_madertha03_s1
ld_madertha04_l1
ld_madertha04_l2
ld_madertha04_l3
ld_madertha04_l4
li_madertha04_l5
li_wurmsmol04_l1
li_wurmsmol04_l2
ld_wurmsmol04_l3
ld_wurmsmol04_l4
ld_wurmsmol04_l5
ld_wallners01_s1
li_kainighu03_s1
ld_parthchr02_s1
li_wallners03_s1
li_hechenbl01_s1
ld_feyertag04_l1
ld_feyertag04_l2
ld_feyertag04_l3
ld_feyertag04_l4
li_feyertag04_l5
ld_lackenba04_l1
ld_lackenba04_l2
ld_lackenba04_l3
li_lackenba04_l4
li_lackenba04_l5
DIF
Meas
ure
(d
iff.
)
Testform
Listening
Person DIF plot (DIF=@FORM_L)
1a
1b
2a
2b
3a
3b
4a
4b
5a
5b
6a
6b
Speaking Test
MFRA
Multi Faceted
Rasch Analysis
Item Measures
Person Measures
Percent Ranks (per ability group) -for individuals, teachers, principals and educational authorities
Linking to CEF
Item Rating for Reading and Listening
according to the CEF
Standard Setting
with regard to CEF Levels
DRM
Dichotomous
Rasch Model
E8-StandardstestsPURPOSE
System Monitoring and Linking Learning Outcomes
to the Common European Framework
BASIS
Test Specifications based on the
Common European Framework and the Curriculum