30
Developing Interim Milestones & Criteria to Measure Progress Thomas E. Davenport [email protected]

Developing Interim Milestones & Criteria to Measure Progress

  • Upload
    others

  • View
    9

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Developing Interim Milestones & Criteria to Measure Progress

Developing Interim Milestones & Criteria to Measure Progress

Thomas E. [email protected]

Page 2: Developing Interim Milestones & Criteria to Measure Progress

“We Cannot Solve The Problems That We Have Created With The

Same Thinking That Created Them”

--Albert Einstein--

Page 3: Developing Interim Milestones & Criteria to Measure Progress

Administrative vs. Resource Outcomes Based Management

Administrative Outcome Approach

Resource Outcomes Approach

Goal Program Performance

Environmental Performance

Measures Administrative Actions

IndicatorEnd-points

Results Improve Programs

Programs are Tools to Improve the Environment

Page 4: Developing Interim Milestones & Criteria to Measure Progress
Page 5: Developing Interim Milestones & Criteria to Measure Progress

Integrated Watershed Planning

WQS

Source Water

Nonpoint sourcesNPDESEQIP/CRP

Wetlands

Estuaries

Fisheries

Stormwater

CAFOs

Monitor

AssessPlan

Implement

RCRA

Superfund

TMDL

Page 6: Developing Interim Milestones & Criteria to Measure Progress

Sharing Your Data…What We Want to Show

NPS Loadings Water Quality

Dollars Spent

Page 7: Developing Interim Milestones & Criteria to Measure Progress

LEVEL 1:Ohio EPA awards 319 grants; goal is achieve restoration of impaired uses (meet WQS); Ohio DNR & NRCS develop NPS management & abate-ment strategies

ADMINISTRATIVE INDICATORS

$$$$

M&A

WQSTMDL

Non Point

Sources

Agricultural Producers Implement Conservation Practices

STRESSORSLEVEL 2:

0

10

20

30

40

50

60

1982

1983

1984

1985

1986

1987

1988

1989

1990

1991

1992

1993

1994

1995

1996

1997

1998

NO TILLAGECONSERVATION TILLAGE

YEAR

Perc

enta

ge o

f Bas

in A

cres

Auglaize Basin Tillage Practices

LEVELS 3-5: BMPs Produce Reduced NPS loadings

0

500

1000

1500

2000

Annual Spring Summer Fall Winter

1970-741996-98

Mea

n D

aily

Sus

pend

ed S

edim

ent

Load

ing

(Ton

s/D

ay)

Auglaize River near Ft. Jennings, Ohio

TSS decreased, water quality & habitat improved

STRESS & EXPOSURELEVEL 6: Biological assemblage improvesRESPONSE

Page 8: Developing Interim Milestones & Criteria to Measure Progress

OUTCOMESINPUTS OUTPUTS

Activities Participation Short Medium Long

term

Programmaticinvestments

i

EVALUATION

PLANNING

Page 9: Developing Interim Milestones & Criteria to Measure Progress

Upper Illinois River Watershed

98%

2%

Drainage Area

Summary Conservation PracticesAll Plans, All Land Uses, AllResources for FY2004

Page 10: Developing Interim Milestones & Criteria to Measure Progress
Page 11: Developing Interim Milestones & Criteria to Measure Progress
Page 12: Developing Interim Milestones & Criteria to Measure Progress

For each natural resource component in your watershed, identify the stressors acting to degrade or impair that component. Then, identify the sources that contribute to the stressors.

Natural Resource Component

Fishery

Stressor Sediment

Stressor Nutrients

Stressor Hydrologic Dynamics

Eroding road-stream

crossing

Streambank erosion

Livestock in stream

Source

Source

Livestock in stream

Failing septic systems

Source

Source

Source

Land Conversion

Source

Source

Source

Source

1

2

3

Natural Resource Component

Stressor Stressor Stressor

Source

Source

Source

Source

Source

Source

Source

Source

Source

Source

Source

Source

Source

Source

Source

1

2

3

Page 13: Developing Interim Milestones & Criteria to Measure Progress

Natural Resource Component

Fishery

Goal Restore the cold water fishery

Objective Reduce the amount of sediment by _amount_ by _date_

Objective Reduce the amount of nutrients by _amount_ by _date_

Objective Reduce hydrologic impacts by _amount_ by _date_

Objective

Natural Resource Component

Goal

Objective Objective

Objective Objective

Natural Resource Component

Goal

Objective Objective

Objective Objective

Page 14: Developing Interim Milestones & Criteria to Measure Progress

Objective

Reduce the amount of sediment by:

Alternative

Stabilizing eroding road-stream crossings

Alternative

Manage land use conversion

Alternative

Remove road-stream crossings

Alternative

Change design criteria for future road-stream crossing

Formulate Alternatives

Page 15: Developing Interim Milestones & Criteria to Measure Progress

Lake Sarah Watershed Management Plan Turbidity

Objective Objective Activity Action Responsibility Time

FrameCostEstimate

Reduce turbidity in lake by 15 % by June 2004

Install riparian buffers

Involve local land-owners

Partner group

July 2001 – July2002

XXXX

Page 16: Developing Interim Milestones & Criteria to Measure Progress

Milestones/Adaptive Management

Project water quality goals are not modified based on lack of progress –

Implementation, monitoring, O&M activities are modified to achieve water

quality goals –Milestones help tell you when

Page 17: Developing Interim Milestones & Criteria to Measure Progress

Milestones

• Indicator and temporally based• Stakeholders can relate to the time frame

and measure.• Specific to work plan activities and

priorities.• Milestones with water quality goals form

the bases of the projects monitoring effort

Page 18: Developing Interim Milestones & Criteria to Measure Progress

Types of Milestones

• Tracking milestones (process –track BMPs, # of permits, etc against workplan expectations)

• Interim milestones (process/outcome –training completed prior to BMP installation)

• Critical milestones (outcome/impact –without this achievement the project will succeed must make changes)

Page 19: Developing Interim Milestones & Criteria to Measure Progress

Types of Indicators

• Administrative

• Environmental

• Social

Page 20: Developing Interim Milestones & Criteria to Measure Progress

Why are Social Indicators Important?

Section 319 and Other Related NPS Programs

IntermediateOutcomes

ImprovedWaterQuality

Page 21: Developing Interim Milestones & Criteria to Measure Progress

Evaluation Measurements

Type/Time frame Indicator

Administrative “Beans” (early)

$ spentBMPs installed

Environmental(end)

Loading reductionsIBI changes

Social(early-end)

# participantsKSA changes

Page 22: Developing Interim Milestones & Criteria to Measure Progress

Critical milestone

• Lower Big Rib Priority Watershed project established a critical milestone to trigger management focus:

“after 5 years of implementation, the calculated sediment reduction based on cost share agreements, is less than 60% of the total cropland sediment reduction goal. Additional cropland fields will be classified as critical and eligible for assistance.”

Page 23: Developing Interim Milestones & Criteria to Measure Progress

Value of Milestones

• Allows you to track actions various partners will take to achieve goals

• Relates project goals to how things are being accomplished

• Status of objectives/outputs easy to determine

Page 24: Developing Interim Milestones & Criteria to Measure Progress

This diagram shows how development and its corresponding increase in impervious cover disrupts the natural water balance. In the post-development setting, the amount of water

running off the site is dramatically increased.

Page 25: Developing Interim Milestones & Criteria to Measure Progress

LOGIC MODEL Biological Endpoint

INPUTS OUTPUTS OUTCOMESTechnical

Financial

Social Capacity Building

investments

Activities BMP installation

Flow Channel Biology

What we invest

What we do

Who we reach

What results

SO WHAT??

Page 26: Developing Interim Milestones & Criteria to Measure Progress

Situation–Excessive Soil Loss Causing WQ Impairments

INPUTS OUTPUTS OUTCOMESMeasures/Activities Products Short Medium Long-term

Ecucation Awareness Activities

Behavior Changes

O&M Management

ChangeFlow

Stabilized

IBI Shows Improvement Impairment

Eliminated

Channel Change

Additional BMPs

Installed

Reduced Availability

of Pollutants

Decreased Pollutant Loading

Decreased Peak Flow and

Total Flow

ManagementCapability is

Increased

Conservation Plan

Developed

Technical Assistance Provided

Terrace Installed

Financial Assistance Allocated

TechnicalFinancial

I&EMonitoring

Project Profile

Page 27: Developing Interim Milestones & Criteria to Measure Progress

Figure 1: Logic Model. Low Impact Development (LID) channel stability example integrating modeling and monitoring (green) activities. Modeling (red) is used to help define critical areas and estimate how long until medium and long-term outcomes can be obtained. The monitoring (blue) strategy for sediment and flow strategy is based upon the model predictions.

Technical Assistance Financial Assistance Data and information (baseline condition)

Public awareness

Watershed Inventory & assessment

Awareness of water quality problems

Landowner/ Developer outreach

Management Plan developed

LID and zoning ordnances enacted

Habitat Quality Improved Channel stabilized

Decreased flow

Biology restored WQS met

INPUTS OUTPUTS Activities Product

OUTCOMES Short Medium Long-term

Water quality problems documented

Critical areas defined & identified

Decreased Sediment

Reduce Erosion (tons of soil saved)

LID BMPs installed

Future development limited

Management changed

Page 28: Developing Interim Milestones & Criteria to Measure Progress

Indicators & targets: short/long term

28

Page 29: Developing Interim Milestones & Criteria to Measure Progress

Maumee Example3 components

number of participantscircumstances beyond projects

controll

Page 30: Developing Interim Milestones & Criteria to Measure Progress

Finally…Make Adjustments• Monitor water quality and

BMPs• Compare results to goals• Are you making progress?• Are you meeting your goals?• If you aren’t meeting

implementation milestones • If you aren’t making progress

toward reducing pollutant loads….

Then…do it all over again!