2013 NACTEI Conference The Marriott Renaissance Phoenix
Downtown Phoenix, Arizona May 8, 2013
Slide 2
6. Summary: People, Process, Product, and Progress Questions?
1. Activity: Walk a Mile in Your Students Shoes 2. Arizonas Skill
Standards Assessment System 4. Adding Dimensions to Teaching and
Learning 3. Activity: Item Development/ Analysis Process 5.
Arizonas New Workplace Skills
Slide 3
State of Arizona Department of Education Office of John
Huppenthal Superintendent of Public Instruction Dear Student,
Welcome to the Arizona Skill Standards Assessment System designed
to measure knowledge and skills attained in Career and Technical
Education (CTE) programs. Assessments are linked to program
standards validated by Arizona business and industry leaders.
Students, teachers, and administrators receive immediate results
for continuous learning and program improvement. The Arizona Skill
Standards Commission, top business and industry leaders throughout
Arizona, issues certificates and technical skill transcripts
documenting knowledge and skill attainment useful to prospective
employers. Sincerely, John Huppenthal Superintendent of Public
Instruction CONTINUE
Slide 4
Student Agreement I will NOT: -copy this assessment. -use
additional information or materials. -talk during the assessment or
use electronic equipment. -share content with others after the
assessment. I understand that: -I can use the computer calculator
and/or pencil/paper provided for computations. -If I fail to comply
with the assessment requirements, I face consequences, including
the invalidation of my assessment results and/or district
discipline. Student Agreement I will NOT: -copy this assessment.
-use additional information or materials. -talk during the
assessment or use electronic equipment. -share content with others
after the assessment. I understand that: -I can use the computer
calculator and/or pencil/paper provided for computations. -If I
fail to comply with the assessment requirements, I face
consequences, including the invalidation of my assessment results
and/or district discipline. AGREE
Slide 5
1. Architectural Drafting What type of door is illustrated in
the drawing? a. Bifold b. Pocket c. Exterior d. Interior 2. Fashion
Design and Merchandising An outfit requires 2 yards of fabric for
the skirt and 1 yards for the top. If the fabric is $5.00 per yard,
what is the total cost of the fabric? a. $19.75 b. $19.50 c. $17.00
d. $18.75
Slide 6
3. Nursing Services Which statement about HIPAA privacy and
security rules is CORRECT? a. Residents/patients can decide which
family members have access to their medical information. b. A
nursing assistant has access to the records of all
residents/patients in the facility. c. When resident/patient
information is found outside a secure location, it must be
destroyed. d. Any family member can ask to see the
resident/patients medical records. 4. Welding Technologies When
setting up a SMAW welding machine, what two factors determine the
amperage setting? a. Electrode length and polarity b. Type of
machine and length of weld c. Thickness of the metal and the
electrode size d. Polarity and arc length
Slide 7
5. Culinary Arts A recipe calls for 2/3 cup of liquid. What is
the total amount of liquid needed if the recipe is tripled? a. 1
1/2 cups b. 1 1/3 cups c. 2 cups d. 1 2/3 cups 6. Law, Public
Safety and Security Double jeopardy refers to a situation in which
a defendant cannot be prosecuted for a criminal offense for which
he or she has already been tried. What amendment to the U.S.
Constitution guarantees this right? a. 10 th Amendment b. 1 st
Amendment c. 3 rd Amendment d. 5 th Amendment
Slide 8
7. Engineering Sciences The solar water heating system in the
diagram is designed to transfer heat from the solar panel to the
hot water tank. The heat is transferred to and from the water pipes
through heat exchangers. The system will be MOST efficient if the
heat exchangers are made of what material? a. Porcelain b. Copper
c. Glass d. Plastic
Slide 9
8. Fire Service In a solid stream nozzle, what determines the
flow? a. Pump size and available water b. Nozzle pressure and size
of discharge opening c. Nozzle pressure d. Length of hose 9.
Automotive Technologies Which safety precaution must be taken when
inspecting a cooling system? a. Secure all locking devices on all
coolant adjustments and attachments. b. Check hydraulic fluid in
the lift system used to check expansion plugs. c. Wear rubber
gloves to protect your hands. d. Never remove the radiator cap when
the engine is extremely hot.
Slide 10
10. Business Management and Administrative Services What budget
categories are used to determine a companys ability to pay current
debt? a. Current assets and liabilities b. Current payroll and
deductions c. Current short-term and long-term goals d. Current
purchases, returns, and allowances
Slide 11
1. Architectural Drafting What type of door is illustrated in
the drawing? a. Bifold b. Pocket c. Exterior d. Interior 2. Fashion
Design and Merchandising An outfit requires 2 yards of fabric for
the skirt and 1 yards for the top. If the fabric is $5.00 per yard,
what is the total cost of the fabric? a. $19.75 b. $19.50 c. $17.00
d. $18.75
Slide 12
3. Nursing Services Which statement about HIPAA privacy and
security rules is CORRECT? a. Residents/patients can decide which
family members have access to their medical information. b. A
nursing assistant has access to the records of all
residents/patients in the facility. c. When resident/patient
information is found outside a secure location, it must be
destroyed. d. Any family member can ask to see the
resident/patients medical records. 4. Welding Technologies When
setting up a SMAW welding machine, what two factors determine the
amperage setting? a. Electrode length and polarity b. Type of
machine and length of weld c. Thickness of the metal and the
electrode size d. Polarity and arc length
Slide 13
5. Culinary Arts A recipe calls for 2/3 cup of liquid. What is
the total amount of liquid needed if the recipe is tripled? a. 1
1/2 cups b. 1 1/3 cups c. 2 cups d. 1 2/3 cups 6. Law, Public
Safety and Security Double jeopardy refers to a situation in which
a defendant cannot be prosecuted for a criminal offense for which
he or she has already been tried. What amendment to the U.S.
Constitution guarantees this right? a. 10 th Amendment b. 1 st
Amendment c. 3 rd Amendment d. 5 th Amendment
Slide 14
7. Engineering Sciences The solar water heating system in the
diagram is designed to transfer heat from the solar panel to the
hot water tank. The heat is transferred to and from the water pipes
through heat exchangers. The system will be MOST efficient if the
heat exchangers are made of what material? a. Porcelain b. Copper
c. Glass d. Plastic
Slide 15
8. Fire Service In a solid stream nozzle, what determines the
flow? a. Pump size and available water b. Nozzle pressure and size
of discharge opening c. Nozzle pressure d. Length of hose 9.
Automotive Technologies Which safety precaution must be taken when
inspecting a cooling system? a. Secure all locking devices on all
coolant adjustments and attachments. b. Check hydraulic fluid in
the lift system used to check expansion plugs. c. Wear rubber
gloves to protect your hands. d. Never remove the radiator cap when
the engine is extremely hot.
Slide 16
10. Business Management and Administrative Services What budget
categories are used to determine a companys ability to pay current
debt? a. Current assets and liabilities b. Current payroll and
deductions c. Current short-term and long-term goals d. Current
purchases, returns, and allowances
Slide 17
Reliable test application Assessment link on Arizona Department
of Education (ADE) home page Online delivery with real-time
feedback Student Status Report individual and total student results
by standards and measurement criteria Score Distribution Report
assessment data and a line graph with percent of students at score
levels Program Performance Report JTED, district, and school data
by state score and ADE pass score Two testing windows Student
certificates and transcripts
Slide 18
Spring 2008 13 assessments 4,829 students Spring 2009 30
assessments 10,446 students Spring 2010 49 assessments 14,507
students 11,637 certificates and transcripts Spring 2011 51
assessments 15,765 students 12,786 certificates and transcripts
Spring 2012 49 assessments 17,532 students 13,814 certificates and
transcripts Spring 2013 49 assessments offered 17,536 students
13,725 certificates and transcripts
Slide 19
WEDO oversees the development of the assessments and manages
the database system that includes Test Item banks History of item
performance Data on assessment results over time Item analysis
reports Ability to assemble 100-item assessments for online
delivery
Slide 20
Arizona CTE Skill Standards and Assessment System / Arizona
Department of Education in Partnership with the University of
Arizona / May 2013
Slide 21
Slide 22
(Dont repeat oven in options.) What kind of oven uses forced
circulating air? a.Convection b.Conventional c.Revolving d.Deck
(Capitalize words such as first and best.) What is the FIRST step
when preparing to key a hand-written document? a.Review the
document to determine format. b.Read the document thoroughly for
content. c.Key a rough draft for the document. d.Proofread the
document for errors. (Each option is a complete sentence followed
by a period.) What is the BEST method for determining seasonal
sales promotion strategies? a.Collect data on buying trends of the
target market. b.Place certain items on sale and calculate total
revenue. c.Review newspaper ads for local competition. d.Circulate
product coupons and track their redemption.
Slide 23
Problem: The stem leads the reader to the correct answer. What
type of search engine crawls the internet looking for recently
created pages and updates? a.Spider-based b.RSS c.Directory d.Pay
per click Modified: The stem is adjusted to eliminate the animated
language. What type of search engine looks for recently created
pages and updates? a.Spider-based b.RSS c.Directory d.Pay per
click
Slide 24
Problem: Passive would be is used when active is is more
direct. What would be the PRIMARY purpose of DHCP? a.It assigns IP
addresses. b.It assigns protocol instruction to a server. c.It
assigns domain names automatically. d.It assigns a new user name.
Modified: Stem is in active voice. Distractors are shortened by
using gerunds. What is the PRIMARY purpose of DHCP? a.Assigning IP
addresses b.Assigning protocol instructions to a server c.Assigning
domain names automatically d.Assigning user name
Slide 25
Slide 26
CULINARY ARTS ENGINEERING SCIENCES
Slide 27
1.Difficulty Index. Percentage of students who answered the
item correctly 2.Discrimination Index. Difference between students
who know the content and those who do not 3.Distractor Analysis.
Percentage of students who chose each option An item is flagged
when it falls below these parameters: Difficulty Index of.45 with
Discrimination Index of.3 OR Difficulty Index of.5 with
Discrimination Index of.25
Slide 28
This item is not flagged. PROGRAM: Early Childhood Education
STANDARD: ESTABLISH AN ENVIRONMENT TO PROMOTE LEARNING AND
DISCOVERY MEASUREMENT CRITERION: Arrange the physical environment
to facilitate planned and spontaneous activities Difficulty Index:
0.6378 / Discrimination Index: 0.4762 Blooms ID: C3 Item Status:
Edited What action BEST encourages spontaneous painting activity
for children? * 81 (63.78%) Keeping paint containers at a childs
level 38 (29.92%) Instructing each child how to paint 4 (3.15%)
Placing paint brushes on a high counter 4 (3.15%) Storing extra
butcher paper in cabinet
Slide 29
This item is flagged. PROGRAM: Sports Medicine and
Rehabilitation Services STANDARD: APPRAISE WELLNESS AND HEALTH
PROMOTION MEASUREMENT CRITERION: Identify different types of
exercise needed for special populations Difficulty Index: 0.4218 /
Discrimination Index: 0.2245 Blooms ID: B5 Item Status: New What is
the BEST activity for preventing bone density loss in an elderly
person? * 62 (42.18%) Strength/resistance training 50 (34.01%)
Swimming 22 (14.97%) Stretching 13 (8.84%) - Running
Slide 30
Slide 31
Interior Design and Merchandising Mathematics Standard
Mathematical Practices CTE Standard / Measurement Criterion
Application of Mathematics Standard Example of Mathematics Standard
in (CTE Program name)
Slide 32
Automotive Technologies Mathematics Standard Mathematical
Practices CTE Standard / Measurement Criterion Application of
Mathematics Standard Example of Mathematics Standard in (CTE
Program name)
Slide 33
Advanced Construction Technologies Mathematics Standard
Mathematical Practices CTE Standard / Measurement Criterion
Application of Mathematics Standard Example of Mathematics Standard
in (CTE Program name)
Slide 34
Entrepreneurship Mathematics Standard Mathematical Practices
CTE Standard / Measurement Criterion Application of Mathematics
Standard Example of Mathematics Standard in (CTE Program name)
Slide 35
Slide 36
Slide 37
Workforce Education Development Office (WEDO) University of
Arizona, Department of Agricultural Education 714 E Van Buren
Street Phoenix AZ 85006-3364 Maggie Mangini, Ed.D. Executive
Director, WEDO 602-827-2332 [email protected] Judy
Balogh Project Director 602-827-2328 [email protected]
Lynne Bodman Storms Senior Program Coordinator 602-827-2329
[email protected]
