The Navy’s Munitions Response Program – The MEC UFP-QAPPBryan Harre

NAVFAC Engineering Service Center

2

Uniform Federal Policy for Quality Assurance Project Plans

Developed by EPA, DoD, and DOE Required for use by DoD for

environmental data collection, including those from an MR project

Contains and describes in detailspecific data requirements orother information that must becollected to demonstrateconformance to requirements

• 37 required elements into 37worksheets

• Emphasis on systematic planning

3

Acquisitions Policy for Environmental Sampling or Testing Services

DoD policy and guidelines for procurement of environmental sampling or testing services procured by or on behalf of, the DoD

Contractor quality systems documents collectively shall specify the quality assurance responsibilities of the contractor. Quality systems documentation to be provided by the contractor will include one or more of the following:

• Documentation of the organization’s Quality System (usually called a Quality Management Plan), in accordance with the Uniform Federal Policy for Implementing Environmental Quality Systems (UFP-QS).

• Documentation of project-specific quality assurance (QA) and quality control (QC) activities (usually called a Quality Assurance Project Plan or QAPP) in accordance with the UFP-QAPP.

• Documentation of the laboratory quality system in accordance with the DoD Quality Systems Manual for Environmental Laboratories (DoD QSM).

4

QAPP/SAP

Why is the Quality Assurance Project Plan QAPP/ Sampling and Analysis Plan (SAP) so important?

The ultimate success of project depends on the quality of the environmental data collected. This quality depends significantly on the adequacy of the SAP and on its effective implementation.

5

NAVFAC’s Munitions Response Web Portal

MR Portal has an example MEC UFP-QAPP and the MEC

UFP-QAPP Template

MR Portal at http://www.ert2.org/t2mrportal

6

Adak MEC UFP-QAPP (1)

Available on the MR Portal, along with a UFP-QAPP template at

www.ert2.org/ t2mrportal

UFP-QAPP Worksheet #

Required Information Included or Excluded

A. Project Management Documentation

1 Title and Approval Page Included 2 SAP Identifying Information Included 3 Distribution List Included 4 Project Personnel Sign-Off Sheet Included

Project Organization 5 Project Organizational Chart Included 6 Communication Pathways Included

7 Personnel Responsibilities and Qualifications Table

Included

8 Special Personnel Training Requirements Table Included Project Planning/Problem Definition

9 Project Scoping Session Participants Sheet Included 10 Problem Definition Included

11 Project Quality Objectives/Systematic Planning Process Statements

Included

12 Measurement Performance Criteria Table Included 13 Secondary Data Criteria and Limitations Table Included 14 Summary of Project Definable Features of Work Included 15 Reference Limits and Evaluation Table Excluded 16 Project Schedule/Timeline Table Included

B. Measurement Data Acquisition Sampling Tasks

17 Sampling Design and Rationale Included

18 Sampling Locations and Methods/SOP Requirements Table

Included

19 Analytical Methods/SOP Requirements Table Excluded 20 Field Quality Control Sample Summary Table Excluded 21 Project SOP References Table Included

7

Adak MEC UFP-QAPP (2)UFP-QAPP

Worksheet # Required Information

Included or Excluded

22 Field Equipment Calibration, Maintenance, Testing, and Inspection Table

Included

Analytical Tasks 23 Analytical SOP References Table Excluded 24 Analytical Instrument Calibration Table Excluded

25 Analytical Instrument and Equipment Maintenance, Testing, and Inspection Table

Excluded

Sample Collection 26 Sample Handling System Excluded 27 Sample Custody Requirements Excluded

Quality Control Samples

28 Laboratory QC Samples Table Screening/Confirmatory Analysis Decision Tree

Excluded

Data Management Tasks 29 Project Documents and Records Table Included

30 Analytical Services Table Analytical and Data Management SOPs

Excluded

C. Assessment Oversight 31 Planned Project Assessments Table Included 32 Change Control Management Included 33 QC Management Reports Table Included

D. Data Review

34 Verification (Step I) Process Table – Preparatory and Initial Inspections

Included

35 Tier 2 QC Process Summary Table Included 36 Product QC Tier 3 Summary Table Included 37 Usability Assessment – AOC Certification Included

8

Adak MEC UFP-QAPP (3)

Field Equipment

Activity Frequency Acceptance Criteria Corrective Action Responsible

Person SOP

Reference Battery Strength Test

3 times/day Audio response over ferrous object

Replace batteries; re-work if necessary

Operator

White’s XLT Standardization Check

At start of operations

Audio response over GPO standardization item

Assess/correct instrument set-up (cables, settings); perform instrument maintenance; replace unit; re-work if necessary

Operator SOP-01

Battery Strength Test

3 times/day Audio response over ferrous object

Replace batteries; re-work if necessary

Operator

Vallon (all metal detector) Standardization

Check At start of operations

Audio response over GPO standardization item

Assess/correct instrument set-up (cables, settings); perform instrument maintenance; replace unit; re-work if necessary

Operator SOP-05

DGPS Positional Accuracy Daily ±25 cm at known monument

Perform instrument maintenance and, if discovered after operations, identify affected points to re-survey at a later date

Operator SOP-01 SOP-02

Battery Strength Test

At beginning and end of each grid; after equipment restart

Battery strength no less than 12V at start and no less than 10.8 V at finish

If post survey is less than 10.8V then replace batteries; re-work grid

Operator

Static Check At beginning and end of each survey day

Stable instrument drift ±1.5 mV over 3-minute interval (after minimum 10-minute warm-up)

Perform instrument maintenance; replace unit if necessary

Operator

Standardization Check

After equipment re-start (min. 3 times/day)

±20% of established value Repair or replace unit; examine data taken since last test re-work if necessary

Operator

Visual Data Reviews

End of each grid

Number of readings consistent with walking pace and sampling rate

Perform instrument maintenance; re-survey grid

Operator

EM61 MK2

Data Download Check

2 times/day 100% of files downloaded Re-survey grids with lost data

Operator

SOP-02

Worksheet #22 – Field Equipment Calibration, Maintenance, Testing, and Inspection Table

9

MEC UFP-QAPP Template (1)

SAP Worksheet #12 -- Measurement Performance Criteria Table (UFP-QAPP Manual Section 2.6.2) Complete this worksheet for each matrix, analytical group, and concentration level. Identify the data quality indicators (DQIs), measurement performance criteria (MPC), and QC sample and/or activity used to assess the measurement performance for both the sampling and analytical measurement systems. Use additional worksheets if necessary. If MPC for a specific DQI vary within an analytical parameter, i.e., if MPC are analyte-specific, then provide analyte-specific MPC on additional worksheets. Separate worksheets should be provided for each matrix (e.g. WS#12.1 Soils, WS#12.2 Sediments, etc.)

RPM Notes: Worksheet #12 was developed for analytical quality control associated with chemical sampling in various environmental matrices (e.g. air, groundwater, surface water, surface and subsurface soils). For MEC explosive hazard projects, sampling is usually limited to a single matrix, surface and subsurface soils. While the fields developed for WS #12 are not directly applicable to an MEC Explosive Hazard Project, these projects have their own measurement performance criteria requirements that must be addressed. For this reason, WS #12 may be adapted to reflect these unique criteria. Fields that may be considered are:

Analytical or Sampling Procedure changed to Definable Feature of Work: The specific procedure that is the subject of the QC and QA effort. An example would be the Anomaly Selection Criteria and Anomaly Prioritization SOP or process for interpretation of raw geophysical data to identify anomalies for investigation (generation of a pick list). For the purposes of an MEC EHP, a geophysical anomaly is defined as a geophysical measurement that is distinguishable from nearby background geophysical measurements. Digital geophysical mapping of anomalies offers the potential for measurements of peak milli-volt response, spatial extent (area) of above background measurements, estimated target depth, signal to noise ratios (SNR), as well as other characteristics.

10

MEC UFP-QAPP Template (2)

Definable Feature of Work

Data Type

Geophysical Anomaly

Measurement Data Quality

Indicator

QC Sample and/or Activity to Assess

Measurement Performance Measurement Performance Criteria Frequency

Geophysical Data Processing/

Interpretation

Prioritized Anomaly Detection List

Sensitivity Maximum detection depth assessed during GPO and daily instrument checks

Sensor to identify buried munitions (or acceptable surrogates) at or shallower than the 11X detection line, up to a maximum of 4” bgs. This metric may be met (for example) by ensuring that the instrument can reliably detect an 81mm mortar at a depth of 891mm (approximately 3’) bgs

At the start of operations and daily

Geophysical Data Processing/

Interpretation

Processed Positional and Geophysical Data

Accuracy/ Precision

Last lane of grid is recollected from opposite direction and compared (repeat line test and sensor position)

Accuracy – positional difference ≤1.25 ftPrecision – Relative percent difference in anomaly signal strength is less than ± 20 percent

At the end of each grid

Intrusive Operations

Anomaly Resolution Data

Completeness QC audit of anomaly identification data; QC of post excavation to ensure removal of targets to specified depth

Every target anomaly ≤ to 4’ bgs has been resolved (anomalies > 4’ will not be resolved)

Daily and weekly

11

Project Scoping and Documentation

What about project scoping?• The best way to ensure that a project meets its

goals is to have project planning meetings with all the stakeholders (e.g., data users, data producers, decision-makers)

• Scoping ensures that all needs are defined adequately

• The penalty for ineffective planning often is greater conflict and extensive reworking, which results in increased cost and lost time

12

Systematic Planning Process and Project Quality Objectives (PQO’s)

Systematic planning requirements come from the project team in the form of DQO’s/PQO’s

Every project phase identifies them, e.g., PA and SI PQO’s were developed for your site

PQOs & data collection

Collect data

Step 1

Step 2

Step 3

Step 4

Step 5

Step 6

Step 7

State the problem

Identify the goal of study

Identify information inputs

Define study boundaries

Develop analytic approach

Specify performance or acceptance criteria

Develop plan for obtaining data

13

Scoping Session Worksheets (1)

PROJECT TEAM

SCOPING/BUILDING DQO's

Worksheet #  Title

10 Problem Definition

11 PQO's/Systematic Planning Process

9Project Scoping Session/Participant Sheets

14Summary of Tasks and Definable Features of Work

17 Sampling Design Rationale (Partial)

2 QAPP Identifying Information

14

Scoping Session Worksheets (2)

PROJECT TEAM SCOPING/BUILDING DQO's

Worksheet #  Title

5 Project Organizational Chart (Partial)

7Personnel Responsibilities and Qualifications Table (Partial)

8Special Personnel Training Requirements (Partial)

37 Data Usability Assessment

34 SAP Verification (Partial)

35 SAP Validation (Partial)

15 Project Action Limits and Evaluation

15

Benefits of the UFP-QAPP Format (1)

Provides a clear, systematic, planning process with detailed instructions

Follows a logical process promoting a consistent format that meets established requirements

Focused on obtaining the type and quantity of data needed to support decisions

Establishes clear and explicit project quality objectives

Provides a documented starting point for procedures/SOPs

16

Benefits of the UFP-QAPP Format (2)

• Defines expected QC (contractor) and QA (third party) roles and responsibilities

Provides criteria for quality assessment and contractor oversight

Documents the planning process and agreement of stakeholders

• Increases stakeholder buy-in on QC and QA efforts

17