16
Detection and Quantitation: Understanding DL/LOD/LOQ Melinda McClellan, Ph.D. NAVSEA Laboratory Quality and Accreditation Office 4/9/2018

Detection and Quantitation: Understanding DL/LOD/LOQ · the sample. –J –The reported result is an estimated value (e.g. matrix interference was observed or the analyte was detected

  • Upload
    others

  • View
    6

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Detection and Quantitation: Understanding DL/LOD/LOQ · the sample. –J –The reported result is an estimated value (e.g. matrix interference was observed or the analyte was detected

Detection and Quantitation:

Understanding DL/LOD/LOQ

Melinda McClellan, Ph.D.

NAVSEA Laboratory Quality and Accreditation Office

4/9/2018

Page 2: Detection and Quantitation: Understanding DL/LOD/LOQ · the sample. –J –The reported result is an estimated value (e.g. matrix interference was observed or the analyte was detected

2

Why Have Detection and Quantitation Limits?

•Define qualitative limits on data

–Where can we assure (and be right 99% of the time) presence?

–Where can we assure (and be right 99% of the time) absence?

•Define quantitative limits on data

–At what concentration can we accurately tell how much is

present?

•Ultimately: Define how data may (and may not) be appropriate for

use.

Page 3: Detection and Quantitation: Understanding DL/LOD/LOQ · the sample. –J –The reported result is an estimated value (e.g. matrix interference was observed or the analyte was detected

3

WHAT ARE DL, LOD, AND LOQ?

Page 4: Detection and Quantitation: Understanding DL/LOD/LOQ · the sample. –J –The reported result is an estimated value (e.g. matrix interference was observed or the analyte was detected

4

A Quick Review

•Remember, the result (data) you get back from the laboratory should

really be considered one point from a distribution of points.

•A probability distribution is a plot of the relative distribution of those

results.

Pro

ba

bilit

y

Concentration

68% within

1 StDev

95% within 2 StDev

99.7% within 3 StDev

True Value

Page 5: Detection and Quantitation: Understanding DL/LOD/LOQ · the sample. –J –The reported result is an estimated value (e.g. matrix interference was observed or the analyte was detected

5

Pro

ba

bilit

y

Detection Limit (DL):

False positive rate (Type I

error) is 1%. Lowest

concentration for reliably

reporting a detection.

DL

1% FP50% FN

LOD0

LOD LOQDL

0 ~2×DL

Quantification

Range

~3 – 10×DL

1% FN

High Cal

Defining Limits

Limit of Detection (LOD):

False negative rate (Type II

error) is 1%. Lowest

concentration for reliable

reporting a non-detect.

ConcentrationWhat

about

MDL? The MDL is an approximation of the DL – it protects against false positives only.

Limit of Quantitation

(LOQ): The smallest

concentration that produces

a quantitative result with

known and recorded

precision and bias.

Page 6: Detection and Quantitation: Understanding DL/LOD/LOQ · the sample. –J –The reported result is an estimated value (e.g. matrix interference was observed or the analyte was detected

6

Defining Limits

Limit of Quantitation

•Limit of Quantitation (LOQ) (Clarification): The smallest concentration

that produces a quantitative result with known and recorded precision

and bias. For DoD/DOE projects, the LOQ shall be set at or above

the concentration of the lowest initial calibration standard and within

the calibration range.

•For DoD/DOE, at a minimum, the LOQ shall be verified quarterly.

However, not all possible combinations of preparation and cleanup

techniques are required to have LOQ verifications. If LOQ

verifications are not performed on all combinations, the laboratory

must base the LOQ verifications on the worst case basis (preparation

with all applicable cleanup steps). In situations where methods are

setup and used on an infrequent basis, the laboratory may choose to

perform LOQ verifications on a one per batch basis in lieu of

quarterly verification, prior to sample analysis. [Module 4 Section

1.5.2.2 e)]

Page 7: Detection and Quantitation: Understanding DL/LOD/LOQ · the sample. –J –The reported result is an estimated value (e.g. matrix interference was observed or the analyte was detected

7

Defining Limits

Quantitation Range

•Quantitation Range: The range of values (concentrations) in a

calibration curve between the LOQ and the highest successfully

analyzed initial calibration standard. The quantitation range lies

within the calibration range.

Concentration

Sig

nal

LOD

DL

LOQ

Quantitation Range

Page 8: Detection and Quantitation: Understanding DL/LOD/LOQ · the sample. –J –The reported result is an estimated value (e.g. matrix interference was observed or the analyte was detected

8

Data Quality and Reporting

•What does all this mean for data quality around these limits?

•How should data be reported around these limits?

Concentration below DL

• Not detectable

Concentration above DL and

below LOD

• Low false positive

• High false negative

• Estimated values

Concentration above LOD and below

LOQ

• Low false positive

• Low false negative

• Estimated values

Concentration above LOQ

• Quantitative values

LOD LOQDL

J

0 ~2×DL

Quantification

Range

~3 – 10×DL High Cal

U

• “LOD”U or <LOD

• Do not use DL

• “Value” J-flagged • “Value” J-flagged

• “Value”

Page 9: Detection and Quantitation: Understanding DL/LOD/LOQ · the sample. –J –The reported result is an estimated value (e.g. matrix interference was observed or the analyte was detected

9

Reporting – An Example

• In this example, DL = 2, LOD = 4, LOQ = 20 and the project

Reporting Limit = 30.

•The following are the data and corresponding results:

•Data Qualifiers:

–U – Analyte was not detected and is reported as less than the LOD or as defined

by the customer. The LOD has been adjusted for any dilution or concentration of

the sample.

–J – The reported result is an estimated value (e.g. matrix interference was

observed or the analyte was detected at a concentration outside the calibration

range).

Sample Analytical Result Reported Result

1 Non-detect 4U

2 2 2J

3 10 10J

4 20 20

5 30 30

Example taken from QSM 5.1 Module 2 Section 5.10.3.1.1

Page 10: Detection and Quantitation: Understanding DL/LOD/LOQ · the sample. –J –The reported result is an estimated value (e.g. matrix interference was observed or the analyte was detected

10

Additional Things to Keep in Mind

•Limits are specific to analyte, matrix, test method, instrumentation,

and analyst

–DL/LOD determined in laboratory water matrix is a lowest

possible value

–Spikes at the LOD in the matrix of concern may be helpful in

understanding your data quality and needs

•Limits are adjusted with dilution of sample

–i.e., if an analysis with a LOD of 2 is performed on a sample that

has been diluted 3x, the LOD for that sample is 6. Therefore, a

non-detect, would be reported as 6U not 2U.

•DL is statistically determined; LOD is empirically verified

Page 11: Detection and Quantitation: Understanding DL/LOD/LOQ · the sample. –J –The reported result is an estimated value (e.g. matrix interference was observed or the analyte was detected

11

Should Project Goals = LOQ?

•Why Not?

–Precision and bias are only defined at and above the LOQ

–The laboratory’s DL, LOD, and LOQ are typically defined in a

clean matrix, and so are a lowest possible value.

–The laboratory LOQ does not take into consideration any of the

uncertainty derived from sampling procedures.

–Remember, data is a distribution. Consider tolerable decision

error along with measurement error when determining project

goals.

Pro

ba

bilit

y

Concentration

LOQ

GoalGoalGoalGoal

Page 12: Detection and Quantitation: Understanding DL/LOD/LOQ · the sample. –J –The reported result is an estimated value (e.g. matrix interference was observed or the analyte was detected

12

References

•EDQW Detection and Quantitation Fact Sheet (October 2017)

•DoD Quality System Manual 5.1 (January 2017)

Page 13: Detection and Quantitation: Understanding DL/LOD/LOQ · the sample. –J –The reported result is an estimated value (e.g. matrix interference was observed or the analyte was detected

13

Definitions

• Detection Limit (DL) – The smallest analyte concentration that can be

demonstrated to be different from zero or a blank concentration with a 99%

confidence. At the DL, the false positive rate (Type I error) is 1%. A DL may

be used as the lowest concentration for reliably reporting a detection of a

specific analyte in a specific matrix with a specific method with 99%

confidence.

• Limit of Detection (LOD) (Clarification): The smallest concentration of a

substance that must be present in a sample in order to be detected at the DL

with 99% confidence. At the LOD, the false negative rate (Type II error) is

1%. A LOD may be used as the lowest concentration for reliable reporting a

non-detect of a specific analyte in a specific matrix with a specific method at

99% confidence.

• Limit of Quantitation (LOQ) (Clarification): The smallest concentration that

produces a quantitative result with known and recorded precision and bias.

For DoD/DOE projects, the LOQ shall be set at or above the concentration of

the lowest initial calibration standard and within the calibration range.

Page 14: Detection and Quantitation: Understanding DL/LOD/LOQ · the sample. –J –The reported result is an estimated value (e.g. matrix interference was observed or the analyte was detected

14

Signal-to-Noise

~ Pure Noise C 0 Q. Ill CII

ci::: +' C CII

I-CII Ill C 0 Q. Ill CII

ci::: +' C CII E :::s

~~ C

Time

6:1 Signal to Noise

CII Ill C 0 Q. Ill CII

ci::: +' C CII E :::s .. +' Ill C

CII Ill C 0 Q. Ill CII

ci::: +' C CII

E :::s

3:1 Signal to Noise

12:1 Signal to Noise

~ ~~~W----~MfMJ!lM~~ c o

Time

Page 15: Detection and Quantitation: Understanding DL/LOD/LOQ · the sample. –J –The reported result is an estimated value (e.g. matrix interference was observed or the analyte was detected

15

Precision

Pro

ba

bilit

yP

rob

ab

ilit

yP

rob

ab

ilit

y

Concentration

Incre

asin

g P

recis

ion

Page 16: Detection and Quantitation: Understanding DL/LOD/LOQ · the sample. –J –The reported result is an estimated value (e.g. matrix interference was observed or the analyte was detected

16

Bias

Pro

ba

bilit

yP

rob

ab

ilit

yP

rob

ab

ilit

y

Concentration

Low Bias

High Bias

No Bias