Embed Size (px)
Citation preview
ASTM International Proficiency Test Programs
and Interlaboratory Studies Program
Presenters:
Anne McKlindonand
Phillip Godorov
September 2010
ASTM Proficiency Testing Programs Designed to provide participating
laboratories with a statistical quality control tool enabling laboratories to assess their performance in conducting an ASTM test or series of tests.
It is a testing program where uniform samples are sent to participating labs where they are analyzed using standard test methods and results reported for statistical treatment
September 2008
ASTM Proficiency Testing Programs ASTM provides management and
administrative support to the program including program registration, contract negotiations, data collection and generation of statistical summary reports
ASTM coordinates the preparation and distribution of test samples
ASTM provides test data reporting instructions and electronic data report forms for recording data
Participation registration fees are assessed to each PTP program.
September 2008
ASTM Proficiency Testing Programs
September 2008
ASTM statistical summary reports include:
Listing of all lab data
Charts and graphs
Lab data coded to maintain lab confidentiality.
Final summary reports are provided electronically to participants and appropriate Committee contacts.
September 2008Lab data coded to maintain lab confidentiality
ASTM Motor GasolineSample ID: MG0805
Sulfur – D5453
Lab Result Rob. Dev. Z-Score Notes
1 58.9 -2.70 -0.4
2 69 7.40 1.1
3 64 2.40 0.4
4 59.1 -2.50 -0.4
5 **85 Rejected
6 59 -2.60 -0.4
7 58.19 -3.40 -0.5
8 59.7 -1.90 -0.3
9 62 -0.40 0.1
25 80.99 19.40 3.0 1,2,3
No. Valid Results 57Robust Mean 61.55Robust Std. Dev. 6.55Reproducibility ASTM Standard 12.74Reproducibility These Test Data 18.14Anderson Darling
0.70TPI 0.70
Note Column:
1 = Test result outside 3 sigma range for these test data
2 = Test range outside 3 sigma range ASTM reproducibility
3 = Z-score outside range of -2 to 2
Sample ID: MG0805 Sulfur - D5453
(mg/kg)
3 Sigma Range Limit ASTM Standard Reproducibility
3 Sigma Range Limit ASTM Standard Reproducibility
3 Sigma Range Limit These Test Data
3 Sigma Range Limit These Test Data
-26.2
-19.65
-13.1
-6.55
0
6.55
13.1
19.65
26.2
74
71
43
16
59
22
100
39
80
58
61
60
32
82
94
48
78
10
42
1 107
50
9 5 92
63
11
112
64
52
73
116
91
101
13
29
110
4 97
17
57
62
118
19
46
24
41
68
2 53
34
85
76
96
117
95
25
Lab Code (Presented Vertically)
Dev
iati
on
35.35
41.9
48.45
55
61.55
68.1
74.65
81.2
87.75
September 2008
ASTM Proficiency Testing Programs
Globally recognized programs:
Over 2,900 laboratories participating
Over 50% participation outside continental U. S.
September 2008
www.ASTM.org
Metals Testing: (E28 and E01) Steel: Mechanical Properties Testing Plain Carbon and Low-Alloy Steel (Chemical
Analysis) Stainless Steel (Chemical Analysis) Aluminum (Chemical Analysis) Determination of Gold in Bullion Ores / Metals Environmental Testing
Plastics Testing: (D20) Polyethylene Plastics Testing Multiple Plastics: Mechanical Properties Testing Polypropylene Mechanical Properties Testing Flammability Plastics Testing Thermal & Elemental Analyses of Plastics
Textiles :(D13) Light, Medium, Heavy Fabric Testing Yarns and Threads
ASTM
PROGRAMS
September 2008
Aromatic Hydrocarbons Testing (D16)
Engine Coolants Testing (D15)
Electrical Insulating Liquids: (D27)Insulating Fluid Quality Dissolved Gas Analyses of In-Service Insulating Fluid
ASTM's Cement and Concrete Reference Laboratory (CCRL)ASTM Committees C01 on Cement and C09 on Concrete and Aggregates sponsor the Cement and Concrete Reference Laboratory (CCRL). CCRL is located at the National Institute of Standards and Technology (NIST)
as a cooperative program between ASTM and NIST. CCRL operates proficiency sample programs in the following construction materials areas: portland cement, blended cement, masonry cement, hydraulic cement concrete, pozzolans, concrete masonry units, and masonry mortar. Visit the CCRL web site on ASTM web page for more information.
ASTM
PROGRAMS
September 2008
Petroleum Products and Lubricants (D02)
Engine Oil Lubricants #2 Diesel Fuel Aviation Turbine (Jet A) Fuel Motor Gasoline #6 Fuel Oil Automatic Transmission Fluid Gear Oil Reformulated Gasoline Hydraulic Fluids & Oils
Lube Additives Industrial Gear Oil
Turbine Oil Lubricating Grease
Crude Oil In-Service Diesel Oil & Hydraulic Fluids & Oils Base Oils Wax General Gas Oils Ultra Low Sulfur Diesel
Fuel EthanolBiodiesel(B100) Fuel
ASTM
PROGRAMS
September 2006
Provides labs with a QA tool to compare their performance versus other labs worldwide
Provides data for monitoring lab strengths and weaknesses Offers ability to compare results among several test methods
measuring the same parameter (e.g., 5 test methods for sulfur)
Residual material from these programs along with the published statistical data can provide useful internal QA samples
Participation helps satisfy lab accreditation requirements Satisfactory performance can demonstrate testing capability
to customers Results and associated statistics helps ASTM validate test
method performance under real world conditions
September 2008
ASTM Proficiency Testing Programs
Use of Programs by ASTM Committees
Obtain valuable feedback on methods
Resource for increased membership
Database of laboratories for test method validation
September 2008
Establishing New Programs
Concept approved by Executive Subcommittee
Program pre-proposal
Market research
Final program proposal
Promote & Launch
ASTM staff can provide guidelines and assistance.
September 2008
The programs are open
to all companies and industry
test professionals.
September 2008
ASTM Proficiency Testing Programs
For more information please contact:
Anne McKlindon
ASTM Proficiency Testing [email protected]: (610) 832-9688
“Until a measurement is in a state of statistical control, it can not be believed in any logical sense that it's measuring anything at all." Dr. Churchill Eisenhart
September 2008
ASTM International Interlaboratory Study Program
(ILS)
Presenter:Phillip Godorov
August 2010
ASTM ILS Program
Strengthen the perceived quality of ASTM Test Methods
Produce data that will be used to develop Precision & Bias statements and Research Reports
Provide administrative support to the committees
Provide financial support to the committees
Help ensure the confidentiality of participating labs
Objectives
August 2010
Administrative Support
Review of Experimental Design
Assistance identifying volunteer laboratories
Identification of sample vendors
Coordination of sample distribution
Data collection
Statistical processing
Generation of reports
August 2010
Strengths of the ASTM Interlaboratory Study Program Input encouraged from active Committee volunteers, as well as non-members, broadening the range and diversity of the study participants, allowing the study to most accurately demonstrate expected “real-world” precision
Scientific neutrality of ASTM in reviewing test data
Provides value-added Quality Assurance Programs to participating laboratories
August 2010
Potential Benefits of Participation
Statistical program to monitor strengths and weaknesses of lab testing when compared to peers
Assess testing performance and adherence to written procedures by lab technicians
May help meet the interlaboratory testing requirements of accreditation programs
Recognition in the final Research Report and on the Committee’s webpage
August 2010
Benefits to the Committees
Obtain valuable feedback on methods, leading to the correction of errors and omissions, as well as highlighting the need for technical updates
Resource for increased membership
Database of laboratories for test method validation
Database of suppliers for common study materials
August 2010
Establishing New Programs Concept registered as a Work Item
Program registered online as an ILS
Initial conference call, with the a technical contact from the committee, to establish the basic study parameters
Experimental design (with input from the committee’s statistical support person, if available)
Identification of study materials, suppliers, a distributor, and volunteer laboratories
August 2010
Our new informational Web pages
www.ASTM.org
Administering Programs Conference Calls or Virtual Meetings with the participants to discuss specific study instructions
Coordination of acquisition and distribution of study material
Physical Electronic
Collection of data
Analysis of data
Compilation of Precision Statement and Draft Research Report (from registered information)
August 2010
Research Reports
A draft can be made available to committee members while the associated precision statement is on ballot
Research Reports contain: The names of participants The instructions used for the study All of the raw data (lab name’s hidden)
RR numbers assigned after ballot approved
August 2010
Examples of Active Programs Committee C24
C1519, Standard Practice for Evaluating Durability of Building Construction Sealants by Laboratory Accelerated Weathering Procedures
Committee D02 D892, Standard Test Method for Foaming Characteristics of Lubricating Oils
Committee E08 E1921, Standard Test Method for Determination of Reference Temperature, for Ferritic Steels in the Transition Range
August 2010
Examples of Completed Programs Committee E15
E1064, Standard Test Method for Water in Organic Liquids by Coulometric Karl Fischer Titration
Committee D02 D1662, Standard Test Method for Active Sulfur in Cutting Oils
Committee C07 C110, Standard Test Methods for Physical Testing of Quicklime, Hydrated Lime, and Limestone
Committee D01 D4446, Standard Test Method for Anti-Swelling Effectiveness of Water-Repellent Formulations and Differential Swelling of Untreated Wood When Exposed to Liquid Water Environments
August 2010
Some of the 79 Committees Currently Participating in the ILS Program
A01 A05 A06 B07 C01 C07 C08 C09 C11 C14 C16
D11 D12 D13 D14 D15 D16 D18 D19 D20 D22 D27
D30 D31 D32 D34 D35 E01 E04 E06 E08 E12 E15
F02F03F04F06F08F11F15F17F23F40G01
August 2010
C21 C24 D01 D02 D03 D04 D05 D07 D08 D09 D10
E18 E20 E28 E29 E33 E34 E35 E37 E42 E56 F01
ASTM International Interlaboratory Study Program
(ILS)
Phillip GodorovDirector, Interlaboratory Study ProgramASTM International100 Barr Harbor DriveWest Conshohocken, PA 19428-2959Phone: 610-832-9715Fax: 610-834-7011E-mail: [email protected]
August 2010
Thank you for attending theASTM International
2010 Officer’s Conference
Proficiency / Interlaboratory Crosscheck Testing Programs
Interlaboratory Study Program (ILS)
August 2010
