Embed Size (px)
Citation preview
An Overview of theAn Overview of theQuality Assurance ProgramQuality Assurance Program
Valerie Connor, SWAMP CoordinatorValerie Connor, SWAMP Coordinator
Model Ocean Discharge Monitoring WorkshopModel Ocean Discharge Monitoring WorkshopFebruary 2, 2006February 2, 2006
State Water Resources Control Board Division of Water QualityState Water Resources Control Board Division of Water QualityOakland, CAOakland, CA
US EPA US EPA Decision Decision ProcessProcess
The SWAMP QA Program’s goal is to help
produce data that is USED in DECISIONS.
Data that supports Decisions
The SWAMP QA Program GoalsThe SWAMP QA Program Goals
Performance Requirements(measurement quality objectives)
Linked toProgram Goals
(data quality objectives)
Develop Comparability Statewide
Build Comparabilitywith other Programs
Data of Known and Documented Quality
QA/QC Tools & Systems to Improve Efficiency
The SWAMP QA VisionThe SWAMP QA Vision
�� Develop Develop comparability to help answer stateto help answer state--wide wide questions and support environmental decisionquestions and support environmental decision--making.making.
�� Use a Use a systems-based approach to the generation and to the generation and storage of applicationstorage of application--appropriate data and metadata.appropriate data and metadata.
�� Emphasize Emphasize science-based decisions and flexibility. .
�� Program changes will be evaluated with regard to Program changes will be evaluated with regard to data quality objectives.
� Coordinate with a variety of groups including the with a variety of groups including the regulated community, other state programs, regulated community, other state programs, environmental organizations, and EPA R9.environmental organizations, and EPA R9.
The SWAMP QA ChallengeThe SWAMP QA Challenge
Multiple End-User Groups and
Purposes
Contract Laboratories and Field Crews
(Public and Private)
State Water BoardRegional Water Boards
EPA R9 OWData Management Team
QA Team
Diverse Waterbody Types,
Beneficial Uses and Study Designs
Field MeasurementsToxicity Testing
Bioassessment StudiesChemistry Data
The SWAMP QA AnswerThe SWAMP QA Answer�� Data ComparabilityData Comparability�� Ensure the Ensure the Data Quality ObjectivesData Quality Objectives and and Data QualityData Quality
AssessmentAssessment processes are used in planning and data processes are used in planning and data reporting reporting
�� Create systems that integrate objectives from multiple Create systems that integrate objectives from multiple endend--user groups user groups –– relate back to relate back to DQOsDQOs
�� Test systems on small scales, refine and implement at Test systems on small scales, refine and implement at program scaleprogram scale
�� ReRe--assess annually assess annually –– relate back to relate back to DQOsDQOs�� Are we doing all these? Not yet.Are we doing all these? Not yet.�� Do we have a plan for implementing all? Yes.Do we have a plan for implementing all? Yes.
The SWAMP QA ComponentsThe SWAMP QA Components•• Quality Assurance Management PlanQuality Assurance Management Plan•• Laboratory AuditsLaboratory Audits•• QAPP ReviewsQAPP Reviews•• Data Verification/Validation ProceduresData Verification/Validation Procedures•• QA Communication SystemsQA Communication Systems•• QA Reports to ManagementQA Reports to Management•• QC Sample Control ChartsQC Sample Control Charts•• QA Toolbox and TrainingQA Toolbox and Training•• Assessment of project plans from a QAAssessment of project plans from a QA--standpoint (e.g., process standpoint (e.g., process
used to pick contract labs, field crew, etc.)used to pick contract labs, field crew, etc.)•• Corrective Action FileCorrective Action File•• OnOn--site audits of field sampling (crew and procedures)site audits of field sampling (crew and procedures)•• MDL studies or lowMDL studies or low--level PE tests as appropriatelevel PE tests as appropriate•• SOP review and approvalSOP review and approval•• Method ReviewMethod Review•• TrainingTraining•• Expert Panel and Technical ResearchExpert Panel and Technical Research
Example Example –– Data Verification/ValidationData Verification/Validation
Contract Lab Creates Data Batch
Contract LabVerifies Data Batch
Contract LabValidates Data Batch
DMT Verifies Data Batch to MQOs
DMT or QA TeamValidates Data Batch to
SWAMP MQOs
DMT Places Data Batch on
Permanent Side ofDatabase
QA Team Validates % ofPermanent Side Data
Against CLP-Level 4 ReportEnd-User Performs
Data Quality Assessmentfor Usability in
Reports and DecisionsQA Team ManagesCorrective Action
Example Example –– Data Verification/ValidationData Verification/Validation
Contract Lab Creates Data Batch
Contract LabValidates Data Batch
Contract LabVerified Data Batch
DMT Verifies Data Batch to DQIs
DMT or QA TeamValidates Data Batch to SWAMP-Compliance
DMT Places Data Batch on
Permanent Side ofDatabase
QA Team Validates % ofPermanent Side Data
Against CLP-Level 4 ReportEnd-User Performs
Data Quality Assessmentfor Usability in Reports
SWAMPSOP
Lab SOPor
EPA Method
SWAMPSOP
SWAMPSOP
SWAMPSOP
SWAMPSOP
SWAMPSOP
Statistical &Scientific
InterpretationQA Team ManagesCorrective Action
SWAMPSOP
Systems Development Systems Development -- ExampleExample
SWAMPSOP
DQASWAMP
SOP
SWAMPSOP
SWAMPSOP SWAMP
SOP
SWAMPSOP
DQOs
What decisions will bemade with this
data?
Environmental Decision(i.e., using the data)
SWAMP QC SYSTEM
Example
Why use the SWAMP’s QA/QC?Why use the SWAMP’s QA/QC?
�� Other programs/projects are encouraged to use Other programs/projects are encouraged to use the SWAMP’s QA/QC criteria, systems and tools the SWAMP’s QA/QC criteria, systems and tools in order to leverage monitoring resourcesin order to leverage monitoring resources
�� Tested QC criteria via expert focus groupsTested QC criteria via expert focus groups
�� StateState--ofof--thethe--art methodsart methods
�� Systems for data collection, verification, Systems for data collection, verification, validation, management, and reportingvalidation, management, and reporting
�� Covers most analyte/matrix combinations in Covers most analyte/matrix combinations in addition to field measurements, toxicity testing addition to field measurements, toxicity testing and bioassessment studiesand bioassessment studies
�� Infrastructure and tools for othersInfrastructure and tools for others
�� PeerPeer--reviewedreviewed
�� COMPARABILITYCOMPARABILITY
The SWAMP QA ProgramThe SWAMP QA ProgramCoordination with OthersCoordination with Others
�� CALFED/CBDA Science ProgramCALFED/CBDA Science Program�� Regulated CommunityRegulated Community�� US EPA R9 OWUS EPA R9 OW�� SCCWRPSCCWRP�� SFEISFEI�� NPDESNPDES�� USGSUSGS�� NWQMCNWQMC�� Ag.Ag.--Waiver ProgramWaiver Program�� TMDLTMDL�� SWRCB DFASWRCB DFA�� SWRCB OITSWRCB OIT�� NonNon--Point Source ProgramPoint Source Program�� CA universities and colleges (research)CA universities and colleges (research)
CONTACT CONTACT INFORMATIONINFORMATION
Valerie ConnorSWAMP Coordinator
Beverly H. van BuurenSWAMP QA Officer
