41

Current Data Collation

  • Upload
    tekla

  • View
    36

  • Download
    0

Embed Size (px)

DESCRIPTION

Current Data Collation. Waste Information Excel and paper based system. Water Quality Excel files + Other sent to EPA. Diverse formats Some extracted from Agency LIMS. LAMS (LA statutory performance) Collected on disk (access system). Complaints Paper based correspondence. Air Quality - PowerPoint PPT Presentation

Citation preview

Page 1: Current Data Collation
Page 2: Current Data Collation

Water QualityExcel files + Other sent to EPA. Diverse formatsSome extracted from Agency LIMS

Bathing WaterOnline internet system providing summary compliance information

Urban Waste WaterExcel system – Files sent to EPA, slow and cumbersome

LAMS (LA statutory performance)Collected on disk (access system)

ComplaintsPaper based correspondence

Drinking WaterAbstractionReceived in various forms form LAQualityVia Excel template

Waste InformationExcel and paper based system

Air QualityData down loaded and Excel file sent to EPA.Real-time invalidated data available

Dangerous SubstancesPaper based system

Water QuantityData reported to EPA via email

Current Data Collation

Page 3: Current Data Collation

Health Board

EPA Labs

Water Quality Analysis Data

Electronic or Paper Based

LGCSB

EPA

EPA Data Bases

LA LIMS

Contract Lab

LA Lab

EPA Data Bases

EPA Data Bases

EPA extracts data from excel or other format, checks and puts into

DB’s

Page 4: Current Data Collation

Health Board

EPA Labs

Water Quality Analysis Data

Electronic or Paper Based

EDEN

EPA Data Bases

LA LIMS

Contract Lab

LA Lab

EPA Data Bases

EPA Data Bases

EPA extracts data from excel or other format, checks and puts into

DB’s

LA Approval

Page 5: Current Data Collation

Water - Example

• What constitutes “Water”– Bathing Water– Drinking Water– Ground Water– Lake Water– River Water– Transitional and Costal Water– Urban Waste Water

GroundWater

LakeWater

RiverWater

Transitional,Coastal and

Marine Water

UrbanWasteWater

BathingWater

DrinkingWater

GroundWater

LakeWater

RiverWater

T & CWater

Urban WasteWater

Page 6: Current Data Collation

Lakes - Overview

CFB

ExcelTemplates

CFB MonitoringProgram

Excel Sheets

MasterExcelSheet

CompassInformatics

CodingDetails

Env. Monitoring Lakes Trophic

Status

EPA OEEP-Reg & DSMonitoring

Trophic Status& P-Reg Data

LA P-Reg & DSMonitoring

Trophic Status, P-Reg & DS Data

EPA TrophicStatus & P-Reg

Data only

Water Qualityin Ireland

EnvironmentalIndicators

State of theEnvironment

Lake WaterQuality Report

Phosphorous Report

DangerousSubstance Report

River Basin Districts

Each EPA Office Local Authorities

European EnvironmentalAgency

Environmental BusinessConsultants DEHLG

General Public External IT partners

EPA Annual Report

EWN-2: Lake quality

Other Data Sources

EPAOCCS

EPAOEA

EPA OEEP-Reg & DSMonitoring

DEHLG

EEA

CastlebarQSI Lims

DublinQSI Lims

Local Authorities

Env. Monitoring- Lakes

EPA LakeMonitoringProgram

LA Lake MonitoringProgram

3rd Party Labs P-Reg Excel Sheet

DS Excel Sheet

LA DSData only

OEA

ExcelSheets

Excel Templates

Page 7: Current Data Collation

Water Quality in Ireland

Environmental Indicators (Water)

State of the Environment (Water)

EPA Annual Report

Phosphorous Report

Dangerous Substance Report

EIONET (Lake Quality - EWN 2)

Lake WaterData set(s)

Local AuthoritiesBiological data

via Excel Templates

EPA Laboratories Chemical data

via Excel Templates

Central Fisheries BoardBiological data

via Excel Templates

Local Authorities Phosphorus data

via Excel sheets and Paper

EPA Lake Monitoring ProgramPhosphorus datavia Excel sheets

Local AuthoritiesDangerous Substance datavia Excel sheets and Paper

EPA LaboratoriesDangerous Substance data

via Excel sheets

Lakes Data “Flow”

Page 8: Current Data Collation

Bathing Water Directive Report

Water Quality in Ireland

Environmental Indicators (Water)

State of the Environment (Water)

Bathing Water Report

EPA Annual Report

Drinking Water Report

Ground Water Quality Report

Eionet (Ground Water - EWN 3)

Phosphorous Report

Dangerous Substance Report

Eionet (Lake Quality - EWN 2)

River Water Quality Report

River Biological Survey report

Eionet (River Quality - EWN 1)

OSPAR report

Eionet (Marine Quality - ME 1)

UWWT Discharge Report

GroundWater

LakeWater

RiverWater

Transitional,Coastal and

Marine Water

UrbanWasteWater

Local AuthoritiesSummary data via Web

Local AuthoritiesChemical data via Excel Templates

Local AuthoritiesChemical data via Excel Templates

Hydrometric TeamsSite Readings via ExcelPaper and Citrix entry

Local AuthoritiesBacterialogical data

via Excel sheets

Hydrometric TeamsLevel data via Excel

Paper and Citrix entry

Local AuthoritiesBiological data

via Excel Templates

EPA LaboratoriesChemical data

via Excel Templates

Central Fisheries BoardBiological data

via Excel Templates

Local AuthoritiesPhosphorus data

via Excel sheets and Paper

EPA Lake Monitoring ProgramPhosphorus datavia Excel sheets

Local AuthoritiesDangerous Substance datavia Excel sheets and Paper

EPA LaboratoriesDangerous Substance data

via Excel sheets

EPA BiologistsBiological data

via MSAccess exports to Excel sheets

Local AuthoritiesChemical data

via Labinfo export to Excel

EPA BiologistsPhosphorus Biological data

via Paper

EPA LaboratoriesChemical data

via LIMS export to Excel sheets

Marine InstituteChemical data

via Excel sheets

Dublin EPA laboratoryOSPAR data

via Excel sheets

Local AuthoritiesTreatment Plant data

via web site entry

Local AuthoritiesChemical data

via MSAccess databases

EPA LaboratoriesPhosphorus Chemical data

via Excel sheets

BathingWater

DrinkingWater

GroundWater

LakeWater

RiverWater

T & CWater

Urban WasteWater

Page 9: Current Data Collation

The First Step – A Central Data Repository

CDX/CDR acts only as convayer of information

Water Quality date received can be assessed by Agency, processed and reported onwards where required.

Data from Agency’s water quality monitoring programmes available to LA’s via CDX

Information on state of water quality in Ireland availabe via Agency’s GIS webservices

LA 3

RBD 3

RBD 2

RBD 1

LA 2 LA 4

Drinking Water

Bathing Water

Urban Waste Water

River Water Quality

Lake Water Quality

C&T Water Quality

Hydrometric Data

LA 1

Groundwater Data

All data can be uniquely geo referenced for use in national GIS.

EPA

Page 10: Current Data Collation

Synopsis

• EDEN - a Central Data Exchange for environmental data

• Readily accessible to key stakeholders. • ‘One Stop Shop’ for quality data related to the

environment. • Benefit for those involved in projects that come

under the Water Framework Directive.• Organisations can then avail of EDEN to

download and upload the datasets that they are responsible for and interested in.

Page 11: Current Data Collation

Solution - EDEN

• Environmental Data Exchange Network• Will build on what is already in existence• Focus on standardised reporting format -

XML• Data collection and sharing using web

services• EDEN will be used to share data nationally

and internationally

Page 12: Current Data Collation

Phase 1

Urban Waste Water

Drinking Water

Abstraction

Bathing WaterQuality

River Water Quality

Biological Quality

Costal and Transitional

Quality

Lakes Quality

Water Quantity

Industrial Discharges

Drinking Water Quality

Groundwater

Quality

Groundwater

Quantity

Page 13: Current Data Collation

Phase 1

Urban Waste Water

Drinking Water

Abstraction

Bathing WaterQuality

River Water Quality

Biological Quality

Costal and Transitional

Quality

Lakes Quality

Water Quantity

Industrial Discharges

Drinking Water Quality

Groundwater

Quality

Groundwater

Quantity

EDEN

Page 14: Current Data Collation

Progressive Integration

Urban Waste Water

Drinking Water

Abstraction

Bathing WaterQuality

River Water Quality

Biological Quality

Costal and Transitional

Quality

Lakes Quality

Water Quantity

Industrial Discharges

Drinking Water Quality

Groundwater

Quality

Groundwater

Quantity

EDEN

Page 15: Current Data Collation

EDENUrban Waste Water

Drinking Water

Abstraction

Bathing

Water

River Water Quality

Biological Quality

Costal and Transitional

Dangerous Substances

& Phosphorous

Lakes

Water Quantity

Industrial Discharges

Drinking Water Groundwate

rQuality

Groundwater

Quantity

GISRivers, Lakes, Aquifer, C&T

A Single Integrated System for Water Data

Page 16: Current Data Collation

Soil

EDEN

Noise

Air

Waste

Water

Page 17: Current Data Collation

LA can enter details of TFS

receivedAllows for

improved tracking of Waste

TFS Register

maintained in CDX

EPA can query TFS register and can generate reports

WRT waste export etc

A similar tracking system might also be established for waste transferred under C1 forms

TFS/C1 Management

Page 18: Current Data Collation

LA can enter complaints received wrt to their own functions. They can also enter complaints wrt to IPPC and Waste facilitiesLA notified of comtplaints entered by EPA regarding complaints received relating to LA functions. LA can view/import records

Complaints Register maintained in CDX

EPA can enter complaints regarding IPPC and Waste Industry.

Can also enter complaints received regarding LA functions.

EPA notified of comtplaints entered by LA’s regarding IPPC and Waste facilities & can view/import records

Complaints Management

Page 19: Current Data Collation

WasteWaste RegisterTFSPackagingLandfill Reports

AirAir Quality Monitoring DataLicensee Emissions Data

WaterSurface water monitoring dataGroundwater Monitoring DataUrban Waste WaterDrinking WaterBathing WaterLicensee Emissions Data

Licence DetailsLocationClass of IndustryEmission Limits

ComplaintsLA ComplaintsIPPC and Waste Complaints

Diary/Calander

Document Repository

Statutory RequirmentsNoise

GIS Enforcement Tracking

Public Information

Web Services

Farm Management

Future Elements of EDEN

Page 20: Current Data Collation

Diary/Calander

Document Repository

Statutory Requirments

WasteWaste RegisterTFSPackagingLandfill Reports

AirAir Quality Monitoring DataLicensee Emissions Data

WaterSurface water monitoring dataGroundwater Monitoring DataUrban Waste WaterDrinking WaterBathing WaterLicensee Emissions Data

NoiseNoise Mapping

GIS

Public InformationInternet

Licence DetailsLocationClass of IndustryEmission Limits

ComplaintsLA ComplaintsIPPC and Waste Complaints

Enforcement Tracking

Farm Management

Enforcment

Statutory Performanc

e

Network

Information sharing

Reference

Exte

rnal

Com

mun

icati

on

En

vir

on

menta

l Q

ualit

y/D

ata

EDEN (Portal)

Page 21: Current Data Collation

The Vision

MI

EPA

LGCSB

LALA

EC

CSO

DEHLG

DOA OSI

FSAI

Ind

OECD

EEA

RBDs

GSI

EDEN

LA’s

Page 22: Current Data Collation

EDEN – 4 Key Functions

• Data Gathering

• Exchange & Validation

• Data Repository

• Reporting

Page 23: Current Data Collation

XML Extraction

Page 24: Current Data Collation

LabInfoDatabase

LabInfo Data Access

Business Rule Layer

Data Access Objects

XML Export Processing

EDEN Export Document API

EDEN Submission and Retrieval API

EDEN Web Services

XML Export File

LabInfo Export Utility

Export and Import Layer

EDEN Integration

User Interface

LabInfo Export

Page 25: Current Data Collation

Download/Upload

Page 26: Current Data Collation

EDEN Verification

Report

Page 27: Current Data Collation

EDEN Website

Page 28: Current Data Collation
Page 29: Current Data Collation

Settings

Page 30: Current Data Collation

View Metadata

Batch ID

Data Purpose

DW_414

Approval Status

Comments

Data Type

Data Owner(s)

Source of Data

Uploaded By Date 10/04/2007 14:15:06

File Size

Joe Bloggs

8.54 MB

Data Availability

Eastern RBD

Kildare County Council

Drinking Water

Approved Unapproved

EDEN Community

Share

Private

Contracted Share Data EPA Return

Authorised Organisations

EPA

EditCancel

Metadata

Page 31: Current Data Collation

Queries

Create New Query

Monitored Entities

Organisations Dublin City Council

Laois County Council

Kildare County Council

OKCancel

Sample Date 01/04/2007From 15/04/2007To

Entity Types

-----------ALL--------

Ballacolla PRI

Ballintlea PRI

Ballybuggy PRI

Ballymaddock

-------ALL--------

Drinking Water Schemes - Public

Drinking Water Schemes - Private

Data Type Drinking Water

Stations -----------ALL--------

Sample Purpose -----------ALL--------

DW Check Monitoring - Private

DW Audit Monitoring – Private

DW Surface Waters for Abstraction – A1

DW Surface Waters for Abstraction – A2

Parameters -----------ALL--------

Alkalinity (CaCO3)

Alpha HCH

Aluminium (Al)

Ametryene

Page 32: Current Data Collation

Queries

Saved Queries

<< First Page | < Prev | Page 1 of 1 | Next > | Last Page >>

Cancel Edit Run

Page 33: Current Data Collation

EDEN

Work Flow

RBD Labs

LA Lab

s

Third Party Labs /Orgs

EPA

Database Server

EDEN System

Web Service

Web Service

Web Service

Web Service

Web Server

Data Warehouse

DTS – For Links to RBD for EMS – Pull

Data from Data Warehouse

Page 34: Current Data Collation

EDEN Work FlowRBD Labs

LA Lab

s

Third Party Labs /Orgs

EPA

Database Server

Data Warehouse

DTS – For Links to RBD for EMS – Pull

Data from Data Warehouse

Web Service

EDEN System

Web Server

Web Service

Web Service

Web Service

Page 35: Current Data Collation

User Requirements

• Data Quality – Only Certified Data (or QC’d) data will be

accepted to EDEN

– Data must be certified within the LA’s Local LIMS System to ensure high data reliance

• Agreements– System Use Agreements – by all participants

Page 36: Current Data Collation

User Requirements cntd.

• IT– Internet Access – Environment Sections– Internet Explorer version 6 (or above)– Netscape/Mozilla– LIMS capable of exporting to XML in required

Structure– Windows XP SP2 operating System

Page 37: Current Data Collation

Benefits

• Data gathered via EDEN can benefit the success of the Water Framework Directive :-– RBD Consultants can collect and return Monitoring

Data to/from LA’s & EPA– Develop Programme Of Measures– Enhances ability to detect improvements/

deterioration– Improves design of RBMP and EMS

Page 38: Current Data Collation

Benefits

• Data Quality Standards – Validation, structure, certification, agreement of use - Integrated naming conventions – reduces misinterpretation & confusion

• WFD Data Transfer – quicker, easier

• Data Dissemination – quicker, easier

Page 39: Current Data Collation

Benefits

• For LIMS Users - No additional workload to LA’s

• Regulatory Returns – Quality, Timeliness

• Increase in Data Exchange Openness & Transparency

• Future Applications – Public Participation in WFD, Public Awareness

Page 40: Current Data Collation

Project Status

Scoping Document Complete

Definition Phase Complete

Prototype Complete

Contracting Complete

Requirements Definition Complete

Development Ongoing

Pilot - Wicklow, Tipperary South, Offaly & Kildare , EPA Kilkenny Laboratory

June 2007

Begin Roll Out July 2007

Page 41: Current Data Collation

Questions?

Thank You