Updated 12/2011

2012 Destination ImagiNation Training for

Score Room

Manny Alvarez & Steve Donley

Liberally plagiarised from many experts Thanks to all that have contributed!

Updated 12/2011

Score Room Masters

Useful email addresses

Cell Phone Numbers

Updated 12/2011

Important Websites

• Destination ImagiNation http://www.idodi.org

• Capital Region Destination ImagiNation http://capital.texasdi.org

• Score Site http://www.nh-di.org/discoring

• DI Appraiser Basics http://www.diuniversity.org

Updated 12/2011

Good Vs. Bad of being part of the Score Room

• You can’t tell anybody! • You have to be get it

correct (accurate !)• You must stay all day

(7am-finished)• You will probably go

crazy from looking at numbers

• You know who wins first!• In charge of tournament.

No score room = no tournament

• Free food! (breakfast and lunch)

Updated 12/2011

Overview of the Training

• Score Room Mission• 2012 Challenges• Score Room Mission• Paperwork Flowchart• Scoring Guidelines• Individual Jobs for Score Room• Handling Problems• Final Thoughts

Updated 12/2011

2012 Challenges

Updated 12/2011

Challenges & Texas Colors

• A: Assembly Required Orange/Salmon• B: The Solar Stage   Yellow• C: Coming Attractions   Blue• D: News to Me Pink/Red• E: Hold it! Green• PO: The World Canvas Grey• IC     Purple• Score room   Black• Rising Stars Built to Last   White

Updated 12/2011

Primary Mission• The primary Mission of a DI Score Room is to

provide the announcer at the conclusion of a tournament with an accurate list of place finishes for the teams that competed at that tournament.

• Help keep the tournament running smoothly• Get everyone home at a reasonable hour

– Goal: All scores Complete 1 hr before the award ceremony

• Accuracy• Efficiency• Timeliness

Updated 12/2011

Score Room Mission

• Accuracy is foremost.– The suggested procedures result in

all scoring operations being done twice by independent people.

– These two people must agree on the resulting computation.

– Never erase a score– Initial ALL changes

Updated 12/2011

Score Room Mission

– Efficiency is defined as computing the final scores by the time that the Tournament Director expects them to be done.

– Typically final scores are available about an hour or less after the last team performance.

• Efficiency is secondary to Accuracy.

Updated 12/2011

Score Room Mission

• Timeliness– Process paperwork ASAP– Don’t Hold on to Packets!

Process and move on to the next step, then file!

– Have everything completed well before the scheduled awards ceremony

Updated 12/2011

Paperwork Flow - Central Appraisers

AppraisersAppraisers

AppraisersAppraisers

Appraisal Team

Organizer

Gate Keeper

Head Appraiser

Team Manager

Checker

Paper Work Manager File Manager

Challenge Sites

Score Room

Data Entry 1 Data Entry 2

Results TM, HA

Logs allTime(s) In

Time(s) Out

Final Score

storage area

Runner

Updated 12/2011

Paperwork Flow - HybridAppraisers

AppraisersAppraisers

AppraisersAppraisers

Appraisal TeamOrganizer

Checker (optional)

Gate Keeper

Head Appraiser

Team Manager

Checker (optional)

Paper Work Manager File Manager

Challenge Sites

Score Room

Data Entry 1

Data Entry 2

Runner

HA & TM Copy

Logs allTime(s) In

Time(s) Out

Final Score storage area

Check digits and / or USB Flash Drive electronic check

Updated 12/2011

Scoring Guidelines• Objective - Non-averaged

scores– 0, 5, 10, 15– all appraisers agree

• Subjective - Averaged scores– USS Appraiser ranges 1-30– will vary between

appraisers• Rounding – Score program

does this for us– 2 digits to right of decimal

.666 > .67 and .333 > .33

• Zero Score– if element is not present– all appraisers scoring that

element must agree it was not there

• Deductions– all appraisers must agree– reason(s) must be noted– Deduction Worksheet with

highlighted entry

Updated 12/2011

Individual Responsibilities

• Appraiser• Appraisal Team Organizer- Site• Score checkers• Computer operators• Score runner• Gate keeper• Paperwork Manager• Score Room Challenge Master

Updated 12/2011

Appraiser

• Complete the Appraiser Score Sheet

– Must complete all assigned items and no more!

– Must be legible– Must agree on all deductions, zero

scores or non averaged scores (0, 5, 10, 15)

Updated 12/2011

Appraisal Team Organizer

• Collect Appraiser forms, envelope and all paperwork from the team.

• Check for legibility and any missing items• Place all paperwork in envelope, give to runner

to deliver to checker & Computer Operator• Receive Head Appraiser and Team copies from

computer operator - log times in for Head Appraiser.

• Log times when team has received their copy

Updated 12/2011

Making up the Score Packet• Team label on the upper left corner of envelope• Please put the papers in this order—it really helps

– Deductions worksheet– Weigh-in sheet (Structure only)– Weight held sheet (Structure only)– Appraisers sheets

» in the order that they appear on the printed Appraiser Assignment sheet form

– Prep area sheet– Everything else last

» No score-relevant information

– Stickies on the special stickies sheet stay at the appraisal site to give back to Team manager with team scores

» ONLY positive comments! Trash inappropriate ones…

LabelStatus Dots

Updated 12/2011

Score Checkers• Check incoming score sheets for completeness & legibility

– Check Weight help calculation (structure only)» Write initials next to calculation if in score room

– Check order of paperwork» Deduction Work sheet

» Weigh-in Sheet (structure only)

» Weight held sheet (structure only)

» Appraiser sheets (in order)

» Prep Area sheet

» extra material last

• Pass to Computer Operators. – Optionally trade off with Computer operators

Updated 12/2011

Checking Scores

• Never have two team’s paperwork out in your work area at once!

– If your Head Appraiser needs you to look at something, put the current team’s paper away!

• After checking, please put the score sheets in the order that they appear on the printed Appraiser Assignment sheet form before sending to score room.

Updated 12/2011

Score Checker

• Ensure Legibility

• Common Errors

– Subjective vs Objective» Objective all must agree

– Range

– Deductions

Updated 12/2011

Computer Operators• Will use provided Computers & Printers• Computer Proficiency very helpful! • Importance of accuracy in typing numbers• 1st Entry Operators

– Enter scores from appraiser sheets» Check weight held calculation if not already initialed

– Place all remaining paperwork in team envelope and pass to 2nd entry computer operator

• 2nd Entry Operators – Reenter scores from appraiser sheets – Check is automatically done when saved

» Occasionally enter bad data to verify check– Print 1 Team, 1 Head Appraiser and 1 Score Room

Copy» Score Room Copy into envelope» Team and HA copies get returned to site in folder

• Can download program and be familiar with it (http://www.nh-di.org/discoring)

Updated 12/2011

Tournament Summary Window

Scoreboard for the tournament

number of teams

number whose scores are incomplete

when they should finish

when the scores were printed

Drill down to a challenge level

Updated 12/2011

Drilling Down to Enter ScoresList of teams in a challenge level

performance time

status

being scored?

TC done?

IC Done?

Updated 12/2011

Enter Team Scores (Detail Mode with Appraisers)

Results in fewest errors

Requires data entry of all appraisers’ scores

No Number Cruncher needed (Appraisal team Organizer instead)

Computer verifies rangesVerifies appraiser agreement for objective scores

Computer calculates it all

Computer scales the final results and prints them

Updated 12/2011

Error Checking

Updated 12/2011

Entering Item-Specific Deductions

Click on “OK” to close the deduction dialog box

• Click on the square checkbox to the left of the item’s title

• Fill in the deduction value and the reason

• Note that deductions can be a percent of the awarded score (not the max score!)

Updated 12/2011

Setting up or changing Appraisers

Best to assign a single appraiser for entering Other Deductions!

1

2

3

Updated 12/2011

Score Runners

• Very Important Job!

• Introduce yourself to Head Appraiser, Appraisal Team Organizer and Gate Keeper

• Pick up completed score packets from competition sites

– Team challenges

– Instant challenges

• Deliver score packets to score room check-in

• Make scheduled runs

Updated 12/2011

Gate Keeper

• Accept all incoming packets• Log in and out times on IC/TC Check Lists• Log out paperwork leaving score room for

questions. • Do not let unauthorized individuals in

score room

Updated 12/2011

Paperwork Manager

• Deliver HA and Team score printouts to return folder

• File folders in appropriate boxes by challenge and update checklist

• If scores are pulled after filing, hand walk the returned envelope to computer operators and identify actions needed

• Pick up incoming folders from gatekeeper and transfer to the correct computer operator

• Pick up completed folders from Computer Operators.

Updated 12/2011

Score Room Challenge Master

• Knowledge of– the challenges– scoring program– how calculations are done– all score room jobs

• Recruit and train – appraisal team organizers– score room personnel

Updated 12/2011

How to Handle Issues

• Talk with your score room leader• Mark team with an Issue in the program

– Enter explanation in Modify Team dialog box

• Print Appraiser Feedback form or use “yellow sticky” to describe issue

• Put all paperwork in the package• Put on a red sticker• Log team red in the Check-In program• Return to team challenge room for correction

Updated 12/2011

Issues Form (Modify Team dialog)

Updated 12/2011

Processing Issues (cont.)

When a red sticker packet comes back in• Log it in• Goes to head of the queue for the first computer

– It is an older packet than those we’re processing

• Could be from– A change we requested– A change the Head Appraiser is requesting

» They can cover our green sticker with red

Updated 12/2011

Sticker ManagementGood packet after 1st entry – put a green sticker on

packet

MJA Good packet after 2nd entry and check – initial green sticker – Send to File

Bad packet during 2nd entry – add red sticker – return for problem resolution

Problem resolved and re-run through 1st entry – add a green sticker

Good packet after 2nd entry and check – initial green sticker – Send to fileMJA

Bad packet during 1st entry – put a red sticker on packet – return for problem resolution

Updated 12/2011

Entering Item-Specific Deductions

Click on “OK” to close the deduction dialog box

• Click on the square checkbox to the left of the item’s title

• Fill in the deduction value and the reason

• Note that deductions can be a percent of the awarded score (not the max score!)

Updated 12/2011

Entering “Other” Deductions

• Deductions are not normally editable as a safety measure.

• To enable:– Right click in the score area– Select “Modify Deductions”– Or, “Alt-D” for you keyboard types

• All deductions MUST have a reason– Entered in the second computer

Updated 12/2011

Instant Challenge• IC Scores can be calculated by the score

program again this year. • 1st set instant challenge to be used • Note: No information about the challenge is shown in

the score program. Preserves IC confidentiality

• The rest works just like Team Challenge.

Updated 12/2011

Practice

• Some people will not be doing data entry• Everyone should be familiar with the scoring

program– In case of illness, etc.

• If you haven’t used it before, please download it and practice

http://www.nh-di.org/discoring/

Updated 12/2011

Scoring Goals

• Ensure that every team gets the full credit they deserve for their challenge solution– And only the credit they deserve

• Turn scores around promptly– Allows team managers to review them

• Maintain the confidentiality of the scores– Never leave your paperwork unattended

• Let everyone get home at a reasonable hour• Have fun in the process

Updated 12/2011

QUESTIONS!

• Ask and we’ll see if we can answer.

Updated 12/2011

… for your time.

… for your service.

… for your generosity.