1 Those who can do. Those who understand teach. Those who teach assess

11

Those who can do.Those who can do.

Those who understand Those who understand teach.teach.

Those who teach assess.Those who teach assess.

22

Choosing Test ItemsChoosing Test ItemsThere are no perfect items.There are no perfect items.

Regional Collaboratives Regional Collaboratives February 12, 2007February 12, 2007

presented bypresented byVirginia MaloneVirginia Malone

Virginia_Malone@juno.comVirginia_Malone@juno.com

33

Today’s QuestionsToday’s Questions

Why test?Why test?

What is being tested?What is being tested?

What makes some test items better than What makes some test items better than others?others?

44

Why Test?Why Test?

55

66

It is kind of nice to know why It is kind of nice to know why you do what you do.you do what you do.

77

Major Reasons for TestingMajor Reasons for Testing

DiagnosticDiagnostic

ComparativeComparative

To standards (criteria base)To standards (criteria base)

To others (norm reference)To others (norm reference)

88

What is being tested?What is being tested?

99

What do we want to learn from the What do we want to learn from the test?test?

Who knows the science Who knows the science

and who does not.and who does not.

NOT who is a good reader and who is notNOT who is a good reader and who is not

NOT who a good test taker and who is notNOT who a good test taker and who is not

1010

Need Test BlueprintNeed Test Blueprint

Assure that what should be taught is Assure that what should be taught is tested.tested.

Assure a balanced coverage of Assure a balanced coverage of Performance Objectives.Performance Objectives.

1111

Test BlueprintTest Blueprint

Define what tests will cover.Define what tests will cover.

Guide for reporting.Guide for reporting.

Keep test forms parallel.Keep test forms parallel.

Pre/post testsPre/post tests

1212

What will be reported? What will be reported?

Strands Strands

Concepts Concepts

Performance Objectives Performance Objectives

Vocabulary Vocabulary

5 items for percent correct score5 items for percent correct score

10 items for scaled scores10 items for scaled scores

1313

One Type of BlueprintOne Type of Blueprint

TEKS TEKS

NumberNumber

KnowledgeKnowledge

ItemsItems

Application Application ItemsItems

1.21.2 11 55

2.72.7 33 88

etc.etc.

1414

What makes some test items better What makes some test items better than others?than others?

There is no such thing as a perfect item.There is no such thing as a perfect item.

1515

Thought Provoking Test ItemsThought Provoking Test Items

Require the use of both Require the use of both knowledge and skills.knowledge and skills.

May cover more than one TEKS.May cover more than one TEKS.

Go beyond reading and recalling.Go beyond reading and recalling.

1616

The ixleb was heb. That narf, the illby ixleb summit and was all domini. Where was its zomba? The ixleb zanked and then izzly zonched for its zomba from the hightow. It zonched because an uga of dow filled that narf er - dow of the dumbing tonto's bleer.

1. What was the ixleb?2. When did the illby ixleb summit? 3. Who was the illby?4. Where did the ixleb zank and zonch from? 5. Why did the ixleb izzly zonch?

1717

Appropriate Reading LevelAppropriate Reading Level

Reading levels as low as possible.Reading levels as low as possible. Sentence structure simple.Sentence structure simple. Words other than science should be as Words other than science should be as

simple as possible.simple as possible. Short sentences rather than long.Short sentences rather than long. Avoid “there…”Avoid “there…”

1818

More than Rote MemoryMore than Rote Memory

poorpoorWhich of these is present in eukaryotic Which of these is present in eukaryotic cells, but not prokarotic cells? cells, but not prokarotic cells?

A. a cytoplasmic membraneA. a cytoplasmic membraneB. a chromosomeB. a chromosomeC. a nucleous *C. a nucleous *D. a cell wallD. a cell wall

1919

Application to new situationApplication to new situationbetterbetter

A cell is isolated that contains a cytoplasmic A cell is isolated that contains a cytoplasmic fluid phospholipid membrane, a cell wall, and fluid phospholipid membrane, a cell wall, and a single circular chromosome. This cell most a single circular chromosome. This cell most likely belongs to which type of organism?likely belongs to which type of organism?

A. a plantA. a plant

B. a prokaryote *B. a prokaryote *

C. a protozoanC. a protozoan

D. a fungusD. a fungus

2020

RecallRecall

Objective:Objective: Identify the six most common elements Identify the six most common elements in living things.in living things.

poorpoor

Which of these is the most common Which of these is the most common element in living things?element in living things?

A.A.IronIronB.B.SulfurSulfurC.C.CalciumCalciumD.D.Carbon * Carbon *

2121

better but lots of reading better but lots of reading

Some students saw some white salt Some students saw some white salt (NaCl) crystals at the edge of a drop of (NaCl) crystals at the edge of a drop of water. As the water evaporated the water. As the water evaporated the salt crystals became bigger and more salt crystals became bigger and more of them appeared in the dish. All of the of them appeared in the dish. All of the following would seem to indicate that following would seem to indicate that the crystals are alive EXCEPT the fact the crystals are alive EXCEPT the fact that the crystals -- that the crystals --

A.A. grow in size.grow in size.B.B. lack hydrogen. *lack hydrogen. *C.C. appear to reproduce.appear to reproduce.D.D. contain chlorine.contain chlorine.

2222

Graphics can simplify and engage.Graphics can simplify and engage.

The diagram shows salt crystals that The diagram shows salt crystals that appeared in a dish after salt water appeared in a dish after salt water evaporated. Which of these shows that the evaporated. Which of these shows that the salt is not alive? salt is not alive?

A.A. The size of the crystals increased.The size of the crystals increased.

B.B. They lack hydrogen. *They lack hydrogen. *

C. They appear to reproduce. C. They appear to reproduce.

D. They contain chlorine.D. They contain chlorine.

2323

Use graphics to simplify not to Use graphics to simplify not to decorate.decorate.

PoorPoor

The picture shows a mouse. Mice have fur The picture shows a mouse. Mice have fur and feed their young milk. Mice belong and feed their young milk. Mice belong with what group?with what group?

A Mammals A Mammals B Insects B Insects

C Fish C Fish D Birds D Birds

2424

Use graphics to simplify not to Use graphics to simplify not to decorate.decorate.

Better Better

Mice have fur and feed their young milk. Mice have fur and feed their young milk. Mice belong with what group?Mice belong with what group?

A Mammals A Mammals

B Insects B Insects

C Fish C Fish

D Birds D Birds

Grade level and ELL considerationsGrade level and ELL considerations

2525

Alignment to ObjectivesAlignment to Objectives

Objective: Understand the transfer of heat.Objective: Understand the transfer of heat.

poorpoor

Which temperature is equivalent Which temperature is equivalent

of 273 K?of 273 K?

A. 0 A. 0 ooCC B. 32 B. 32 ooFF

C. 100 C. 100 ooCC D. - 273 D. - 273 ooC C

2626

Objective: Understand the transfer of heat.Objective: Understand the transfer of heat.

betterbetter

Which diagram correctly shows the Which diagram correctly shows the direction of net heat transfer?direction of net heat transfer?

2727

Avoid tricky questions or two Avoid tricky questions or two justifiable correct choicesjustifiable correct choices

poorpoor

Which of these shows the greatest Which of these shows the greatest evidence of erosion?evidence of erosion?

A.A. A mountain rangeA mountain range

B.B. A canyon A canyon

C.C. A deltaA delta

D.D. A meteor craterA meteor crater

2828

betterbetter

Which of these landforms is the result of Which of these landforms is the result of erosion caused by primarily by water?erosion caused by primarily by water?

A A volcanoA A volcano

B A canyonB A canyon

C A meteor craterC A meteor crater

D A sand duneD A sand dune

2929

Avoid the Use of “You”Avoid the Use of “You”poorpoor

Which of these would you do if a student Which of these would you do if a student asked you to help them on a test?asked you to help them on a test?

A. Reprimand the student.A. Reprimand the student.

B. Try to help the student without givingB. Try to help the student without giving

away the answer.away the answer.

C. Ask the student to stay after school C. Ask the student to stay after school

for more helpfor more help

D. Remind the student that you are D. Remind the student that you are

not allowed to help on the test.not allowed to help on the test.

3030

BetterBetter

According to the directions for administering According to the directions for administering the test, which of these should a teacher do the test, which of these should a teacher do if a student asks for help on the test?if a student asks for help on the test?

A. Reprimand the student.A. Reprimand the student.

B. Try to help the student without giving away B. Try to help the student without giving away the answer.the answer.

C. Ask the student to stay after school for more C. Ask the student to stay after school for more helphelp

D. Remind the student that you are not allowed D. Remind the student that you are not allowed to help on the test. *to help on the test. *

3131

Items should provide focus.Items should provide focus.

PoorPoor

The earth is –The earth is –

A. spherical more or lessA. spherical more or less

B. made up of elementsB. made up of elements

C. part of the solar systemC. part of the solar system

D.D. the third rock from the sunthe third rock from the sun

3232

Providing Focus Makes It Clear Providing Focus Makes It Clear What a Student Is Being Asked What a Student Is Being Asked

to Do.to Do.

betterbetter

Which of these best describes the Which of these best describes the shape of the earth?shape of the earth?

A. An oblate spheroidA. An oblate spheroid

B. A circleB. A circle

C. A torusC. A torus

D. A lumpy sphereD. A lumpy sphere

3333

Items should avoid the use of Items should avoid the use of negatives.negatives.

poorpoor

Which of these is not a characteristic of Which of these is not a characteristic of animals? animals?

A. They eat other organisms.A. They eat other organisms.

B. They have no chlorophyll.B. They have no chlorophyll.

C. They do not make their own food.C. They do not make their own food.

D. They have cell walls.* D. They have cell walls.*

3434

betterbetter

Which of these is a characteristic that Which of these is a characteristic that all animals have?all animals have?

A. Four legsA. Four legs

B. Food getting behavior*B. Food getting behavior*

C. ChlorophyllC. Chlorophyll

D.D. BloodBlood

3535

Items should not clue other itemsItems should not clue other items Vitamin B, found in rice hulls, helps prevent--Vitamin B, found in rice hulls, helps prevent--

A. beriberi*A. beriberi*B. scurvyB. scurvyC. measlesC. measlesD.D. botulism botulism

As westerners introduced better milling techniques As westerners introduced better milling techniques to remove rice hulls, natives of south sea islands to remove rice hulls, natives of south sea islands began to develop beriberi due to a lack of --began to develop beriberi due to a lack of --

A. calciumA. calciumB. a vitamin *B. a vitamin *C. citric acidC. citric acidD. protein D. protein

3636

Items should not require knowledge Items should not require knowledge of the correct answer to a previous of the correct answer to a previous question.question.

1. At what point on this diagram is winter in North America represented?

2. During what season in North America is the sun closest to Earth?

3737

Options should be in logical Options should be in logical order.order.

Which seeds are probably the slowest to germinate?

A. Mango* B. Tomato C. Peach D. Watermelon

Which seeds are probably the slowest to germinate?

A. WatermelonB. TomatoC. Mango* D. Peach

3838

Rationales for distractors.Rationales for distractors.

What is the greatest percent of weed control What is the greatest percent of weed control in this investigation?in this investigation?

A. 55 the lowest value shownA. 55 the lowest value shown B. 85 the greatest value for single treatmentB. 85 the greatest value for single treatment

C. 90 The greatest valueC. 90 The greatest value D. 200 Just a number no justifiable rationaleD. 200 Just a number no justifiable rationale

3939

The question must have one The question must have one clearly correct answer.clearly correct answer.

Tundras and taigas are found at high Tundras and taigas are found at high latitudes, but similar biomes can also latitudes, but similar biomes can also be found –be found –

A. at high altitudes*A. at high altitudes*

B. at high longitudeB. at high longitude

C. along coastlinesC. along coastlines

D. in the interior of continents D. in the interior of continents

4040

The options should be free of The options should be free of repetitious information.repetitious information.

poorpoorWhen is the earth farthest from the sun?When is the earth farthest from the sun?

A. During the spring in the Northern A. During the spring in the Northern HemisphereHemisphere

B. During the summer in the Northern B. During the summer in the Northern HemisphereHemisphere

C. During the fall in the Northern HemisphereC. During the fall in the Northern HemisphereD. During the winter in the Northern D. During the winter in the Northern

Hemisphere Hemisphere

4141

better During what season in North

America is Earth farthest from the sun?

A. SpringB. Summer*C. WinterD. Fall

4242

When possible, items should be When possible, items should be complete questions.complete questions.

poorpoor

The test item type that is most efficient The test item type that is most efficient and reliable is the –and reliable is the –

A. Multiple Choice A. Multiple Choice

B. Constructed Response B. Constructed Response

C. MatchingC. Matching

D. True/false D. True/false

4343

Complete QuestionsComplete Questions betterbetter

Which of these is the most efficient and Which of these is the most efficient and reliable type of test item on a 30 item reliable type of test item on a 30 item test?test?

A. Multiple Choice A. Multiple Choice

B. Constructed Response B. Constructed Response

C. MatchingC. Matching

D. True/false D. True/false

4444

Distractors should be plausible.Distractors should be plausible.

poorpoor

Which of these is a planet in our solar Which of these is a planet in our solar system?system?

A. WaterA. Water

B. MarsB. Mars

C. An asteroidC. An asteroid

D. DirtD. DirtNo real rationale for answersNo real rationale for answers

4545

Plausible distractorsPlausible distractors

betterbetter

Which of these is a planet in our solar Which of these is a planet in our solar system?system?

A. The sunA. The sun B. The moonB. The moon

C. The planet MarsC. The planet Mars D. The comet HalleyD. The comet Halley

4646

Options parallel in structure Options parallel in structure and degree of specificity.and degree of specificity.

poorpoor

Which of the following is a compound?Which of the following is a compound?

A. Kinetic energyA. Kinetic energy

B. Wind that is blowingB. Wind that is blowing

C. Pure distilled water*C. Pure distilled water*

D. A soft drink like PepsiD. A soft drink like Pepsi

4747

Parallel OptionsParallel Options

better

Which of the following is a compound?

A. Sulfur

B. Iron

C. Water*

D. Hydrogen

4848

The options should be free of The options should be free of repetitious information.repetitious information.

poorpoorWhen is the earth farthest from the sun?When is the earth farthest from the sun?

A. During the spring in the Northern A. During the spring in the Northern HemisphereHemisphere

B. During the summer in the Northern B. During the summer in the Northern Hemisphere*Hemisphere*

C. During the fall in the Northern HemisphereC. During the fall in the Northern HemisphereD. During the winter in the Northern D. During the winter in the Northern

Hemisphere Hemisphere

4949

better During what season in North

America is the earth farthest from the sun?

A. SpringB. Summer*C. WinterD. Fall

5050

Items should not contain options Items should not contain options that are subsumed by other options.that are subsumed by other options. poorpoor

A patient had a high fever, a greater blood A patient had a high fever, a greater blood pressure on the right side of his body than pressure on the right side of his body than his left. He was loosing about one pound a his left. He was loosing about one pound a day. Which of these caused this person to day. Which of these caused this person to become ill? become ill?

A. HIVA. HIVB. vasculitis*B. vasculitis*C. circulatory illnessC. circulatory illnessD.D. an infectionan infection

5151

Items should not contain options Items should not contain options that are subsumed by other options.that are subsumed by other options. betterbetter

A patient had a high fever, a greater blood A patient had a high fever, a greater blood pressure on the right side of his body than pressure on the right side of his body than his left. He was loosing about one pound a his left. He was loosing about one pound a day. Which of these caused this person to day. Which of these caused this person to become ill? become ill?

A. elephantiasisA. elephantiasisB. vasculitis*B. vasculitis*C. gastritis C. gastritis D.D. pneumonia *pneumonia *

5252

Options should not be opposites Options should not be opposites of one another.of one another.

poorpoor

What time will it be on the side of the What time will it be on the side of the earth facing the sun?earth facing the sun?

A.A. DaytimeDaytime

B.B. NighttimeNighttime

C.C. 2:00 A.M.2:00 A.M.D.D. 11:07 P.M.11:07 P.M.

5353

betterbetter

What causes there to be nighttime on What causes there to be nighttime on Earth?Earth?

A.A. One side of Earth is facing away One side of Earth is facing away from the Sun.from the Sun.

B. The Earth revolves around to the B. The Earth revolves around to the back side of the Sun.back side of the Sun.

C. The sun moves to the daylight side C. The sun moves to the daylight side of Earth.of Earth.

D. The sun stops sending light toward D. The sun stops sending light toward Earth.Earth.

5454

Wording and/or art must be clear.Wording and/or art must be clear.

Which of these models shows the orbit of the Which of these models shows the orbit of the

Earth?Earth?

5555

Factual information should be Factual information should be accurate and logical.accurate and logical.

Onion root do not generally grow to a length of 300 centimeters and even if they did they would not grow as fast as indicated by the graph.

5656

Does the writer have a Does the writer have a misconception?misconception?

Five-fingers occur more commonly in Five-fingers occur more commonly in any human population than six fingers. any human population than six fingers. The five-finger trait is probably --The five-finger trait is probably --

A. dominant*A. dominant*

B. recessiveB. recessive

C. hybridC. hybrid

D. incomplete D. incomplete

5757

NOTENOTE

Every item can be improved.Every item can be improved.

“ “Better” in this presentation does not Better” in this presentation does not equate to good.equate to good.

5858

LoriciferaLoricifera Use a ChecklistUse a Checklist

to Explain How You Arrive at Your to Explain How You Arrive at Your AnswersAnswers

5959

LoriciferansLoriciferans

Answering questions without Answering questions without knowing much about the knowing much about the

subjectsubject

6060

1. Which of the following is a 1. Which of the following is a characteristic unique to the phylum characteristic unique to the phylum Loricifera?Loricifera?

A. MulticellularityA. Multicellularity

B. Small body structureB. Small body structure

C. A flexible feeding tube that can be C. A flexible feeding tube that can be retracted into the organism retracted into the organism

D. Multiple spines D. Multiple spines

6161

2. All Loriciferans are –2. All Loriciferans are –

A.A. Single cellular Single cellular

B.B. MulticellularMulticellular

C.C. Colorful Colorful

D.D. Hungry Hungry

6262

3. What is the level of classification for 3. What is the level of classification for Loriciferans?Loriciferans?

A.A. Kingdom Kingdom

B.B. PhylumPhylum

C.C. Genus Genus

D.D. Species Species

6363

4. All of these are places Loriciferans can 4. All of these are places Loriciferans can be found EXCEPT –be found EXCEPT –

A. sedimentsA. sediments

B. artic ocean sandsB. artic ocean sands

C. ocean coastal deposits C. ocean coastal deposits

D. in the needles of pine trees D. in the needles of pine trees

6464

5. Who named the phylum Loricifera?5. Who named the phylum Loricifera?

A. Reinhardt Kristensen, a A. Reinhardt Kristensen, a Smithsonian Postdoctoral FellowSmithsonian Postdoctoral Fellow

B. Carl Linnaeus, a Postdoctoral B. Carl Linnaeus, a Postdoctoral FellowFellow

C. Feras Feras, a Lorci Postdoctoral C. Feras Feras, a Lorci Postdoctoral FellowFellow

D. A Postdoctoral Fellow D. A Postdoctoral Fellow

6565

6. Loriciferans are most closely 6. Loriciferans are most closely associated with an --associated with an --

a. glacier c. oceana. glacier c. ocean

b. river D. storm b. river D. storm

6666

7. What is the source of energy for 7. What is the source of energy for Loriciferans?Loriciferans?

A. Snow A. Snow

B. Meiofauna B. Meiofauna

C. PhylaC. Phyla

D. Cars D. Cars

6767

8. Which of these do you think is the 8. Which of these do you think is the most important phylum?most important phylum?

A.A. Phylum ArthropodaPhylum Arthropoda

B.B. Phylum LoriciferaPhylum Loricifera

C.C. Phylum ChordataPhylum Chordata

D.D. Phylum Platyhelminthes Phylum Platyhelminthes

6868

9. Loricifera larvae 1 and 2 are moving 9. Loricifera larvae 1 and 2 are moving toward the grain of sand. If they start toward the grain of sand. If they start at the same time and arrive at the next at the same time and arrive at the next grain of sand at the same moment, grain of sand at the same moment, which one moved the fastest?which one moved the fastest?

A. 2 moved faster than 1A. 2 moved faster than 1B. 1 moved faster than 2B. 1 moved faster than 2C. 1 and 2 moved at the same speedC. 1 and 2 moved at the same speedD. 1 moved slower than 2 D. 1 moved slower than 2

6969

10. Which of these is not a characteristic 10. Which of these is not a characteristic of the producers Loriciferas eat?of the producers Loriciferas eat?

A. They are able to make their own food.A. They are able to make their own food.

B. They lack photosynthetic pigments.B. They lack photosynthetic pigments.

C. They do not require carbon dioxide at C. They do not require carbon dioxide at night.night.

D. They give off oxygen when it is not dark. D. They give off oxygen when it is not dark.

7070

10. What type of fauna is most 10. What type of fauna is most appealing to Loriciferans?appealing to Loriciferans?

A. deer B. meiofaunaA. deer B. meiofauna

C. fishC. fish D. flowers D. flowers

7171

11. Loriciferans are approximately 0.3 11. Loriciferans are approximately 0.3 mm long. If 8 loriciferans were placed mm long. If 8 loriciferans were placed side by side they would extend side by side they would extend approximately how many millimeters?approximately how many millimeters?

A. 0.1 mm B. 2.4 mmA. 0.1 mm B. 2.4 mm C. 5.5 mmC. 5.5 mm D. 1.6 mm D. 1.6 mm

7272

12. Which of the following pieces of 12. Which of the following pieces of equipment would be required to equipment would be required to calculate the density of the water calculate the density of the water surrounding the sand in which the surrounding the sand in which the Loriciferans live? Loriciferans live?

A. Balance and graduated cylinder A. Balance and graduated cylinder B. Graduated cylinder and burnerB. Graduated cylinder and burnerC. Thermometer and balanceC. Thermometer and balanceD. Balance and volumetric flask D. Balance and volumetric flask

7373

13. Which of these is the main function of 13. Which of these is the main function of the ovaries of adult Loriciferans?the ovaries of adult Loriciferans?

A. MaleA. Male

B. EggsB. Eggs

C. FoodC. Food

D. Larva D. Larva

7474

14. What is the function of the 14. What is the function of the protonephridium? protonephridium?

A. To produce digestive enzymesA. To produce digestive enzymes

B. To eliminate metabolic wasteB. To eliminate metabolic waste

C. To pump bloodC. To pump blood

D. To act as a primitive eye D. To act as a primitive eye

7575

15. What type of compounds have a 15. What type of compounds have a multitude of different functions in multitude of different functions in Loriciferans including providing Loriciferans including providing structural support within cells and structural support within cells and catalyzing chemical reactions and catalyzing chemical reactions and facilitating diffusion through the facilitating diffusion through the plasma membrane and allowing cell plasma membrane and allowing cell recognition through its unique recognition through its unique structure?structure?

A. mitochondria B. proteinsA. mitochondria B. proteins C. ribosomes D. cells C. ribosomes D. cells

7676

16. In the Loriciferans ecosystem energy flows 16. In the Loriciferans ecosystem energy flows from producers to primary consumers to from producers to primary consumers to Loriciferans. More energy flows from Loriciferans. More energy flows from producers to primary consumers in the producers to primary consumers in the Loriciferans ecosystem than in a forest Loriciferans ecosystem than in a forest ecosystem where there is thick vegetation. ecosystem where there is thick vegetation. Why is this?Why is this?

AA Forest plants receive more sunlight than aquatic Forest plants receive more sunlight than aquatic photosynthetic organisms.photosynthetic organisms.

BB Plants in forests put more energy into wood and Plants in forests put more energy into wood and other hard-to-digest biomass.other hard-to-digest biomass.

CC Animals in oceans perform less cellular Animals in oceans perform less cellular respiration than animals in forests.respiration than animals in forests.

DD Producers are less able to harvest the light Producers are less able to harvest the light energy in forests than in oceans. energy in forests than in oceans.

7777

Well Constructed Test ItemsWell Constructed Test Items

Match the objective.Match the objective.

Do not give away the answer.Do not give away the answer.

Do not favor the test wise student.Do not favor the test wise student.

Do not favor the good reader over the Do not favor the good reader over the good social studies, math, or science good social studies, math, or science student. student.

7878

Well Constructed Test ItemsWell Constructed Test Items

Avoid the use of negative words in the Avoid the use of negative words in the stem and/or options.stem and/or options.

Have responses in logical order.Have responses in logical order.

Have one clearly correct answer.Have one clearly correct answer.

Are factually correct.Are factually correct.

Make it clear what the student is being Make it clear what the student is being asked to do.asked to do.

7979

Well Constructed OptionsWell Constructed Options

Parallel in degree of specificity.Parallel in degree of specificity.

Parallel in lengthParallel in length

Parallel in grammatical structure.Parallel in grammatical structure.

8080

Well Constructed OptionsWell Constructed Options

Free of excess repetitionFree of excess repetition

Do not subsume other optionsDo not subsume other options

Not opposite of one anotherNot opposite of one another

Have rationales for the distractorsHave rationales for the distractors

8181

Did you Learn?Did you Learn?

Why test?Why test?

What is being tested?What is being tested?

What makes some test items better than What makes some test items better than others?others?

There are no perfect items.There are no perfect items.

8282

The fatal pedagogical error… The fatal pedagogical error…

to throw answers like stones to throw answers like stones at the heads of those who at the heads of those who have not yet asked the have not yet asked the questions.questions.

Paul TillichPaul Tillich

8383

A Test A DayA Test A Day

Keeps Students AwayKeeps Students Away

8484

Teachers should not have to Teachers should not have to put aside good instruction to put aside good instruction to

prepare for the test.prepare for the test.

UnknownUnknown

8585

Every test question Every test question can be improved.can be improved.

8686

Every student can Every student can learn.learn.

8787

Every teacher can Every teacher can improve.improve.

8888

Every school can Every school can become a center of become a center of

excellence.excellence.

8989

No one said it will be easy.No one said it will be easy.

There are no short cuts.There are no short cuts.

9090

The Road to Success Is

Always Under Construction.

9191

For more information

http://webusers.xula.edu/jsevenai/objective/objective.html

Easy to follow examples of test items

http://www.tenet.edu/teks/science/stacks/instruct/strategy.html

Strengths and weaknesses of various strategies. Provides examples of poor and better selected response items

http://questioning.org/Q6/question.html

For more questionsFor more questions