Presented by: Alison Kittle, U.S. EPA Bill Rensmith , Windsor Solutions, Inc

11

Presented by:Presented by:Alison Kittle, U.S. EPA Alison Kittle, U.S. EPA

Bill Rensmith, Windsor Solutions, Inc.Bill Rensmith, Windsor Solutions, Inc.Mike Beaulac, Michigan DEQMike Beaulac, Michigan DEQ

Tony Jeng, enfoTech & ConsultingTony Jeng, enfoTech & Consulting

Integrated Compliance Information Integrated Compliance Information System (ICIS) and Beyond:System (ICIS) and Beyond:

Current and Future Plans and TechnologyCurrent and Future Plans and Technology

Exchange Network National MeetingExchange Network National MeetingMay 30, 2012May 30, 2012

22

AgendaAgenda

ICIS TodayICIS Today Future of ICISFuture of ICIS ICIS Electronic Submission ToolsICIS Electronic Submission Tools

OpenNode2 Starter Kit for ICISOpenNode2 Starter Kit for ICIS EN-Node2 Plug-In for ICISEN-Node2 Plug-In for ICIS

Resources Available to StatesResources Available to States

33

AgendaAgenda




44

ICIS TodayICIS Today

DMR BatchDMR Batch In production since May 2008In production since May 2008 6 state agencies using it (AK, AR, IL, MI, MN, TN)6 state agencies using it (AK, AR, IL, MI, MN, TN) 12 NetDMR states using it (AR, CO, CT, HI, IN, KY, LA, MD, SD, TN, UT, TX)12 NetDMR states using it (AR, CO, CT, HI, IN, KY, LA, MD, SD, TN, UT, TX)

Full BatchFull Batch Phase 1Phase 1

Batching of permit related dataBatching of permit related data 7 state agencies submitting this data (AL, DE, FL, KY, MO, OH, PA)7 state agencies submitting this data (AL, DE, FL, KY, MO, OH, PA) In production since February 2011In production since February 2011

Phase 2Phase 2 Batching of inspection related dataBatching of inspection related data 6 state agencies submitting this data (AL, DE, FL, KY, OH, PA)6 state agencies submitting this data (AL, DE, FL, KY, OH, PA) In production since November 2011In production since November 2011

55

ICIS Today ICIS Today

Full BatchFull Batch

Phase 3Phase 3 Batching of enforcement action, violation and program report related dataBatching of enforcement action, violation and program report related data 15 State agencies to be migrated out of PCS (AZ, IA, KS, ME, MS, NJ, NC, 15 State agencies to be migrated out of PCS (AZ, IA, KS, ME, MS, NJ, NC,

ND, OR, SC, VA, VT, WA, WV, WY)ND, OR, SC, VA, VT, WA, WV, WY) Scheduled to be in production December 2012Scheduled to be in production December 2012

66

AgendaAgenda




77

Future of ICISFuture of ICIS

Full Batch Data Flow Enables ICIS For:Full Batch Data Flow Enables ICIS For:

Electronic exchange of information between EPA and Electronic exchange of information between EPA and states (e.g., NPDES Permitting, Enforcement and states (e.g., NPDES Permitting, Enforcement and Compliance information).Compliance information).

Electronic reporting from the NPDES regulated Electronic reporting from the NPDES regulated universe to EPAuniverse to EPA

Electronic reporting of compliance monitoring data Electronic reporting of compliance monitoring data from inspectors in the fieldfrom inspectors in the field

Electronic submission of data from other EPA Electronic submission of data from other EPA systemssystems

88

Future of ICISFuture of ICIS

Electronic reporting of compliance data from Electronic reporting of compliance data from inspectors in the field:inspectors in the field:

Region 4 inspectors to send their compliance Region 4 inspectors to send their compliance monitoring data and RCRA inspection reports directly monitoring data and RCRA inspection reports directly to ICIS from the field via CDXto ICIS from the field via CDX

EPA is piloting tablet software for the PCB andEPA is piloting tablet software for the PCB and NPDES Construction Storm Water compliance NPDES Construction Storm Water compliance monitoring programsmonitoring programs

99

AgendaAgenda



Making the Future of ICIS and Electronic Making the Future of ICIS and Electronic Reporting a RealityReporting a Reality

10101010

Free .NET and Java software posted on the Exchange Network used for submitting all data Free .NET and Java software posted on the Exchange Network used for submitting all data families to ICISfamilies to ICIS

Stores data extracted from state NPDES system into staging tables structured like ICISStores data extracted from state NPDES system into staging tables structured like ICIS

Generates XML submission files and submits them to ICIS through CDXGenerates XML submission files and submits them to ICIS through CDX

Returns results of ICIS processingReturns results of ICIS processing

States must extract their NPDES data into the staging tables with ICIS reference codesStates must extract their NPDES data into the staging tables with ICIS reference codes

ICIS Electronic Submission ToolsICIS Electronic Submission Tools

OpenNode2 ICIS-NPDES Full OpenNode2 ICIS-NPDES Full Batch PluginBatch Plugin

Submitting Data to ICIS the Easy Submitting Data to ICIS the Easy WayWay

Bill Rensmith, Windsor Solutions, Inc.Bill Rensmith, Windsor Solutions, Inc.

1111

OpenNode2OpenNode2 Project BackgroundProject Background

About OpenNode2, flows, and pluginsAbout OpenNode2, flows, and plugins About this ProjectAbout this Project Project TimelineProject Timeline

How it WorksHow it Works Staging TablesStaging Tables Submission LifecycleSubmission Lifecycle

Live DemonstrationLive Demonstration Implementer ResponsibilitiesImplementer Responsibilities Options for non-OpenNode2 StatesOptions for non-OpenNode2 States

Q & AQ & A

1212

About OpenNode2About OpenNode2

Open source Exchange Network node Open source Exchange Network node softwaresoftware

OpenNode2 can:OpenNode2 can: send data to other Network partnerssend data to other Network partners make data available for others to querymake data available for others to query

Most widely used node software on the Most widely used node software on the NetworkNetwork

Available at Available at http://code.google.com/p/opennode2http://code.google.com/p/opennode2

1313

About Flows and PluginsAbout Flows and Plugins

Each type of data on the network is a “flow”Each type of data on the network is a “flow” There is a flow for each regulatory area (air, waste, There is a flow for each regulatory area (air, waste,

etc…)etc…) ICIS-NPDES is one of many available flowsICIS-NPDES is one of many available flows EPA defined the rules for sending data via the ICIS-EPA defined the rules for sending data via the ICIS-

NPDES flowNPDES flow Each flow is implemented as a Plugin in OpenNode2Each flow is implemented as a Plugin in OpenNode2

Plugins are the software that contain the functionality Plugins are the software that contain the functionality needed to support a specific flowneeded to support a specific flow

The OpenNode2 Google code site has plugins for The OpenNode2 Google code site has plugins for most major regulatory flows to EPAmost major regulatory flows to EPA

1414

About this ProjectAbout this Project

The ICIS-NPDES Full Batch flow is The ICIS-NPDES Full Batch flow is complexcomplex 4646 different data families different data families 149149 tables (complex data types) tables (complex data types) 11951195 fields (simple elements) fields (simple elements) 963963 business rules business rules

To reduce implementation challenge, EPA To reduce implementation challenge, EPA and ECOS wanted to make available tools and ECOS wanted to make available tools to simplify flow implementation for states.to simplify flow implementation for states.

1515

About this Project (cont’d)About this Project (cont’d)

In September 2011, EPA and ECOS engaged Windsor In September 2011, EPA and ECOS engaged Windsor to develop full batch data flow plugin for OpenNode2to develop full batch data flow plugin for OpenNode2 Ubiquity of OpenNode2 made it a good choice to Ubiquity of OpenNode2 made it a good choice to

reach the widest potential audience of statesreach the widest potential audience of states To reduce cost, only developing for the .NET version To reduce cost, only developing for the .NET version

of OpenNode2 (most commonly used version)of OpenNode2 (most commonly used version) Pilot with Washington Dept. of EcologyPilot with Washington Dept. of Ecology

Summer 2012Summer 2012

1616

Project TimelineProject Timeline

1/5/2012 1/5/2012 – Plugin design completed– Plugin design completed 2/8/20122/8/2012 – Staging tables released to Google – Staging tables released to Google

CodeCode 3/13/20123/13/2012 – Beta Plugin released to Google Code – Beta Plugin released to Google Code 4-8/20124-8/2012 – Test/Implement in WA – Test/Implement in WA 8/23/20128/23/2012 – Final Plugin release to Google Code – Final Plugin release to Google Code 12/201212/2012 – Release of ICIS v4 Plugin – Release of ICIS v4 Plugin

Adds support for compliance and enforcement modulesAdds support for compliance and enforcement modules

1717

Overall Submission WorkflowOverall Submission Workflow

1818

Workflow LifecycleWorkflow Lifecycle

1.1. Data Preparation StageData Preparation Stage

a.a. State-specific Extract, Transform and Load (ETL)State-specific Extract, Transform and Load (ETL)

b.b. Change Detection ProcessChange Detection Process

2.2. Submission StageSubmission Stage

3.3. Result Processing StageResult Processing Stage

a.a. Retrieve Accept/Reject Report and Parse/Store Retrieve Accept/Reject Report and Parse/Store ResultsResults

b.b. Store Accepted RecordsStore Accepted Records Full lifecycle must complete before repeatingFull lifecycle must complete before repeating Checks in place to prevent out-of-sequence executionChecks in place to prevent out-of-sequence execution

1919

ICIS-NPDES Staging TablesICIS-NPDES Staging Tables Two sets of staging tables: Two sets of staging tables:

ICS_FLOW_LOCAL ICS_FLOW_LOCAL – Agency’s NPDES data to send to – Agency’s NPDES data to send to ICISICIS

ICS_FLOW_ICIS ICS_FLOW_ICIS – Copy of all data successfully sent to – Copy of all data successfully sent to ICISICIS

ICIS_PAYLOAD

1. ICIS_BASIC_PRMT

2. ICS_BS_PRMT

3. ICS_CAFO_PRMT

...

46. ICS_SWMS_4_PROG_REP

ICS_FLOW_LOCAL

ICIS_PAYLOAD

1. ICIS_BASIC_PRMT

2. ICS_BS_PRMT

3. ICS_CAFO_PRMT

...


ICS_FLOW_ICIS

2020

Stage 1: Data PreparationStage 1: Data Preparation

ETL StepETL Step Refresh “local” tables with latest data from Refresh “local” tables with latest data from

agency NPDES databaseagency NPDES database

ICIS_PAYLOAD

1. ICIS_BASIC_PRMT

2. ICS_BS_PRMT

3. ICS_CAFO_PRMT

...


ICS_FLOW_LOCAL

NPDES Data Source(s)

2121

ICIS_PAYLOAD

1. ICIS_BASIC_PRMT

2. ICS_BS_PRMT

3. ICS_CAFO_PRMT

...


ICIS_FLOW_LOCAL

ICIS_PAYLOAD

1. ICIS_BASIC_PRMT

2. ICS_BS_PRMT

3. ICS_CAFO_PRMT

...


ICIS_FLOW_ICIS

Stage 1: Data Preparation Stage 1: Data Preparation (cont’d)(cont’d)

Detect Changes StepDetect Changes Step Database routine compares “Local” data with Database routine compares “Local” data with

“ICIS” data to determine what needs to get sent.“ICIS” data to determine what needs to get sent. Sets Transaction Codes (N, C, R). Leave Sets Transaction Codes (N, C, R). Leave

Transaction Code blank if data is already in sync Transaction Code blank if data is already in sync with ICIS.with ICIS.

Inserts records into “Local” for Deletes (D, X).Inserts records into “Local” for Deletes (D, X).

2222

Stage 2: SubmissionStage 2: Submission

Plugin builds payload for all Plugin builds payload for all modules/records that have a Transaction modules/records that have a Transaction Code set.Code set.

OpenNode2

ICIS_PAYLOAD

1. ICIS_BASIC_PRMT

2. ICS_BS_PRMT

3. ICS_CAFO_PRMT

...

<BasicPermitData>

<BiosolidsPermitData>

<XML>

ICS_FLOW_LOCAL

2323

Stage 3: Result ProcessingStage 3: Result Processing

Download, Parse and Store Results Download, Parse and Store Results Step: Step: When processing is complete, Node When processing is complete, Node

downloads and parses Accepted and downloads and parses Accepted and Rejected Transactions into a Result Tracking Rejected Transactions into a Result Tracking Table.Table.

OpenNode2ICIS Result Tracking TableICIS Key FieldsError/Info CodeError/Info Type CodeError/Info Description

Accepted Transactions

Rejected Transactions

<XML>ICS_FLOW_LOCAL

2424

Stage 3: Result Processing Stage 3: Result Processing (cont’d)(cont’d)

Store Accepted Transactions Step:Store Accepted Transactions Step: Accepted Records are copied from “Local” to “ICIS”.Accepted Records are copied from “Local” to “ICIS”. Performed by a stored procedure executed by the Performed by a stored procedure executed by the

plugin.plugin.

ICIS_PAYLOAD

1. ICIS_BASIC_PRMT

2. ICS_BS_PRMT

3. ICS_CAFO_PRMT

...


ICIS_PAYLOAD

1. ICIS_BASIC_PRMT

2. ICS_BS_PRMT

3. ICS_CAFO_PRMT

...


ICS_FLOW_LOCAL ICS_FLOW_ICIS

2525

Stage 3: Result Processing Stage 3: Result Processing (cont’d)(cont’d)

How do I audit successes/failures?How do I audit successes/failures? All feedback from ICIS is stored in result tracking All feedback from ICIS is stored in result tracking

table (ICS_SUBM_RESULTS)table (ICS_SUBM_RESULTS) Only stores the accepted transactions from the most Only stores the accepted transactions from the most

recent submissionrecent submission Stores all errors received for a given business key’Stores all errors received for a given business key’

2626

Live DemonstrationLive Demonstration

2727

What Can I Download?What Can I Download?

http://code.google.com/p/opennode2/http://code.google.com/p/opennode2/

2828

What Can I Download? What Can I Download? (cont’d)(cont’d)

PluginPlugin Plugin.zip Plugin.zip – this is what you upload to OpenNode2– this is what you upload to OpenNode2 Database scripts Database scripts – for SQL Server and Oracle – for SQL Server and Oracle

• Creates needed tables, procedures, views…Creates needed tables, procedures, views…

DocumentationDocumentation Plugin Implementation Guide PDFPlugin Implementation Guide PDF

• Just the facts. Describes how to install and configure the Just the facts. Describes how to install and configure the plugin and database components.plugin and database components.

Plugin Design Specification PDFPlugin Design Specification PDF• All the nitty-gritty details of the plugin design. Very useful to All the nitty-gritty details of the plugin design. Very useful to

understand the details of how the plugin components work.understand the details of how the plugin components work.

2929

Implementer ResponsibilitiesImplementer Responsibilities

1.1. Set up staging tables in state environmentSet up staging tables in state environment

2.2. Map source systems to staging tablesMap source systems to staging tablesMapping to ICIS-NPDES lookup valuesMapping to ICIS-NPDES lookup values

3.3. Develop data extraction and transformation routines to Develop data extraction and transformation routines to copy data from state database to staging tablescopy data from state database to staging tables

4.4. Set up node and pluginSet up node and plugin

5.5. Flow data to CDX Test environmentFlow data to CDX Test environment

6.6. Monitor for errors. Fix by:Monitor for errors. Fix by:

1.1.Fixing data in source systemFixing data in source system

2.2.refining ETL logicrefining ETL logic

7.7. Migrate to productionMigrate to production

3030

Questions and AnswersQuestions and Answers

http://code.google.com/p/opennode2http://code.google.com/p/opennode2

Webinar Video: Webinar Video: http://youtu.be/7qP2d6CUypsb

3131

32323232

Michigan eDMR DemonstrationMichigan eDMR Demonstration by Mike Beaulac, Michigan DEQby Mike Beaulac, Michigan DEQ

Electronic Submission Plug-InsElectronic Submission Plug-Ins

33333333

NMS: NPDES Management SystemNMS: NPDES Management System

E2: Online DMR Reporting System E2: Online DMR Reporting System

EN Node: ICIS-DMR batch loading to CDX/ICISEN Node: ICIS-DMR batch loading to CDX/ICIS

State of Michigan

E2

Reporting Requirements obtained from State System

2

DMR submissions sent to State

System

4

Wastewater Facility

DMR Certifier

DMR is submitted

electronically

3

State Node

Reporting Data Submission to

EPA CDX

5

EPA

EPA CDX PCS / ICIS

1

NMS

NMS:· Application Tracking· Permit Issuance· Permit Limit· Inspection· Compliance· Enforcement, etc.

A

A

B

B

C

C


34343434

Permittee requests an accountPermittee requests an account Authorized representative submits a TPA to DEQ to request an Authorized representative submits a TPA to DEQ to request an

account (preparer, viewer, certifier)account (preparer, viewer, certifier) DEQ approves the request, establishes accounts, sends security DEQ approves the request, establishes accounts, sends security

credentials to the requestorcredentials to the requestor

DMR Reporting FormsDMR Reporting Forms NMS pushes monitoring/reporting requirements to E2 (supports NMS pushes monitoring/reporting requirements to E2 (supports

monthly, quarterly, semi-annual, annual DMRs)monthly, quarterly, semi-annual, annual DMRs)

DMR Reporting & ManagementDMR Reporting & Management PermitteePermittee: Online data entry, Excel copy-and-paste, XML : Online data entry, Excel copy-and-paste, XML

upload, compliance checks, comment results, data validations, upload, compliance checks, comment results, data validations, make revisions (745 participating facilities, 76% out of 976)make revisions (745 participating facilities, 76% out of 976)

DEQDEQ: late/no submission report, email reporting alerts, etc. : late/no submission report, email reporting alerts, etc. Procedures in meeting CROMERR requirementsProcedures in meeting CROMERR requirements


3535

Parameter requirement by Monitoring Point Parameter requirement by Monitoring Point and Stageand Stage

Seasonal requirementsSeasonal requirements Effective dates could be stagedEffective dates could be staged


3636

Violation Alert!Violation Alert!

Incomplete!Incomplete!

Commenting Result.Commenting Result.


3737

Report results for parameters not listed on the DMR form…

Report results for parameters not listed on the DMR form…

Commenting Result.Commenting Result.


38383838

EN-Node2 ICIS Plug-In DemonstrationEN-Node2 ICIS Plug-In Demonstration by Tony Jeng, enfoTech & Consulting, Inc.by Tony Jeng, enfoTech & Consulting, Inc.

ICIS Electronic Submission ToolsICIS Electronic Submission Tools

3939

ICIS-Batch Data Family StructureICIS-Batch Data Family Structure

4040

EN-Node Plugins for ICIS-NPDESEN-Node Plugins for ICIS-NPDES

Optional Payloads for General PMT

BiosolidsCAFOCSOPOTWPretreatmentStorm Water MS4…

Optional Payloads for General PMT


Optional Payloads for Master General PMT


Optional Payloads for Master General PMT


General Permit Plug-in

Master General Permit Plug-in

Optional Payloads for Basic PMT


Optional Payloads for Basic PMT


Optional Payloads:

SSO Annual ReportSSO Monthly ReportStorm Water EventStorm Water Program Report…

Optional Payloads:

SSO Annual ReportSSO Monthly ReportStorm Water EventStorm Water Program Report…

DMR Plug-in

Optional Payloads

Single eventSchedule Violation

Optional Payloads

Single eventSchedule Violation

Compliance Determination Plug-in

Optional Payloads

Enforcement Actions

Optional Payloads

Enforcement Actions

Enforcement Plug-in

Unpermitted Facility Plug-In

Basic Permit Plug-in

Report Plug-in

Optional Payloads:

CAFO Inspection SSO InspectionCSO Inspection Storm water Inspection…

Optional Payloads:

CAFO Inspection SSO InspectionCSO Inspection Storm water Inspection…

Inspection Plug-in

State Environment

Wastewater Facility

DMR CertifierDMR Certifier

Submit DMR Electronically

State NPDES DatabaseState NPDES Database

EPA

EPA CDXEPA CDX

EN NodeEN Node

ICIS Data Flows

PCS / ICISPCS / ICIS

A

C

D

5

Download Process Report

Data Submission

EN Node Starter Kit

1

4

ICIS Staging TablesB

Pushed Data to Staging Tables

2

Update ICIS-processing Status in Submit Data Tables

6State Data

Storage

Submit Data

Storage

Generate ICIS-NPDES xml

3

EN-Node ICIS-Batch ImplementationEN-Node ICIS-Batch Implementation

Data Push Options:•Triggers,•Stored Procedures,•Schedule Jobs,•…

Generic data validation:•State-to-ICIS code translation•Data type & length•Schema validationState-specific validation…

Reports:

•Search/View State Data

•Search/View Submit data

•Search/View Transactions & status

•View ICIS processing reports

Submissions:

•Types: X, N, R, C

•Delete Permit: To delete a Permit, all child records must be deleted first (limits, DMR, violations, inspection, etc.)

•Reload DMR: For period of over-lapping permits, DMRs need to be reloaded

4141

EN-Node ICIS Submission OptionsEN-Node ICIS Submission Options

4242

EN-Node Flow Wizard - Process ConfigurationEN-Node Flow Wizard - Process Configuration

4343

4444

EN-Node ICIS PluginsEN-Node ICIS Plugins

Availability StatusAvailability Status Download EN-Node & Plug-ins: Download EN-Node & Plug-ins:

https://code.google.com/p/en-node2/downloads/list

4545

AgendaAgenda




4646


OEI Exchange Network GrantsOEI Exchange Network Grants

Funding to states, territories and federally recognized Funding to states, territories and federally recognized Indian tribes to support development of Environmental Indian tribes to support development of Environmental Information Exchange Network related activities Information Exchange Network related activities

Announcement of the availability of funds and soliciting Announcement of the availability of funds and soliciting of proposals and partial applications from applicants of proposals and partial applications from applicants occurs through the Exchange Network Grant web page occurs through the Exchange Network Grant web page at at www.epa.gov/networkgwww.epa.gov/networkg

4747

For More InformationFor More Information

ContactsContacts

ICIS-NPDES Electronic SubmissionsICIS-NPDES Electronic Submissions Alison Kittle Alison Kittle [email protected]

Michigan eDMR Michigan eDMR Mike Beaulac Mike Beaulac [email protected]

EN-NodeEN-Node Tony Jeng Tony Jeng [email protected]

OpenNode2OpenNode2 Bill Rensmith Bill Rensmith [email protected]

4848

QuestionsQuestions

??????

Documents

Presented by: Alison Kittle, U.S. EPA Bill Rensmith , Windsor Solutions, Inc