19
James Kreft U.S. Geological Survey, Center for Integrated Data Analytics NWQMC National Monitoring Conference, Cincinnati, OH April 29, 2014

James Kreft - ACWI · 2014. 5. 23. · James Kreft U.S. Geological Survey, Center for Integrated Data Analytics NWQMC National Monitoring Conference, Cincinnati, OH April 29, 2014

  • Upload
    others

  • View
    3

  • Download
    0

Embed Size (px)

Citation preview

Page 1: James Kreft - ACWI · 2014. 5. 23. · James Kreft U.S. Geological Survey, Center for Integrated Data Analytics NWQMC National Monitoring Conference, Cincinnati, OH April 29, 2014

James KreftU.S. Geological Survey, Center for Integrated Data Analytics

NWQMC National Monitoring Conference, Cincinnati, OH

April 29, 2014

Page 2: James Kreft - ACWI · 2014. 5. 23. · James Kreft U.S. Geological Survey, Center for Integrated Data Analytics NWQMC National Monitoring Conference, Cincinnati, OH April 29, 2014

Portal Background2003 USGS-EPA

Memorandum of Understanding

“Working with the National Water Quality MonitoringCouncil (NWQMC), [USGS and EPA] will develop ageospatial internet based query tool. This tool should bedesigned to facilitate the greatest possible sharing of datafrom all sources to all users...”

Page 3: James Kreft - ACWI · 2014. 5. 23. · James Kreft U.S. Geological Survey, Center for Integrated Data Analytics NWQMC National Monitoring Conference, Cincinnati, OH April 29, 2014

Portal Background

Launched in 2012 at NWQMC Conference Includes water‐quality data from federal, state and tribal

partners through the USGS NWIS & EPA STORET (and nowUSDA ARS STEWARDS) systems

Based on WQX data format and convention (Water QualityExchange)

Organized to support broad regional and national assessments Updated every night from NWIS; every week from STORET (and

STEWARDS!) Serve over 220 million samples from 2.1 million sites

Page 4: James Kreft - ACWI · 2014. 5. 23. · James Kreft U.S. Geological Survey, Center for Integrated Data Analytics NWQMC National Monitoring Conference, Cincinnati, OH April 29, 2014

Water Quality Data Exchange (WQX)

Launched in 2007 to provide a format forsubmitting water quality data to EPA

Partnered with Exchange Network to increase theability of others to share water quality data

WQX-Outbound is the format that all WaterQuality Portal data is served in.

First step for a new WQP data partner is mappingdata to WQX-Outbound

4

Page 5: James Kreft - ACWI · 2014. 5. 23. · James Kreft U.S. Geological Survey, Center for Integrated Data Analytics NWQMC National Monitoring Conference, Cincinnati, OH April 29, 2014

Interagency Cooperation With the support of the National Water Quality Monitoring Council

(NWQMC), the Water Quality Portal (WQP) integrates publiclyavailable water-quality data from the USGS National WaterInformation System (NWIS) the EPA STOrage and RETrieval(STORET) Data Warehouse and the USDA ARS STEWARDS database

5

States, tribes,Feds, and otherdata partners

WQPUsers

Page 6: James Kreft - ACWI · 2014. 5. 23. · James Kreft U.S. Geological Survey, Center for Integrated Data Analytics NWQMC National Monitoring Conference, Cincinnati, OH April 29, 2014

Success of the WQP WQP launched in April 2012

50-100 visits per weekday

Over 10,000 unique Visitors

3000-5000 downloads per day from web services

Recently added USDA Agricultural Research ServiceSTEWARDS database

Steady increase in visits and actual use in starting in Fall 2013

6

Number of Visits to Portal per Day April 2013-April 2014

Page 7: James Kreft - ACWI · 2014. 5. 23. · James Kreft U.S. Geological Survey, Center for Integrated Data Analytics NWQMC National Monitoring Conference, Cincinnati, OH April 29, 2014

0

100

200

300

400

500

600

70011

/4/1

2

12/4

/12

1/4

/13

2/4

/13

3/4

/13

4/4

/13

5/4

/13

6/4

/13

7/4

/13

8/4

/13

9/4

/13

10/4

/13

11/4

/13

12/4

/13

1/4

/14

2/4

/14

3/4

/14

4/4

/14

Weekly downloads fromwww.waterqualitydata.us/portal.jsp

Page 8: James Kreft - ACWI · 2014. 5. 23. · James Kreft U.S. Geological Survey, Center for Integrated Data Analytics NWQMC National Monitoring Conference, Cincinnati, OH April 29, 2014

Launch

0

20

40

60

80

100

120

140

160

Total Weekly Map Create events

Page 9: James Kreft - ACWI · 2014. 5. 23. · James Kreft U.S. Geological Survey, Center for Integrated Data Analytics NWQMC National Monitoring Conference, Cincinnati, OH April 29, 2014

WQP Services

9

NWIS_WS_STAR

STORETMODERN

ARS_STEWARDS

WQPServices

WQPServices

STORETQWSTORETQW

ARSQWARSQW

NWISQWNWISQW

XML

XLSX

CSV

TSV

KML

FSWQX

WQX

WQX

GeoJSON

SHP

WQX

Page 10: James Kreft - ACWI · 2014. 5. 23. · James Kreft U.S. Geological Survey, Center for Integrated Data Analytics NWQMC National Monitoring Conference, Cincinnati, OH April 29, 2014

Benefits of WQP Web Services

Fairly low entry and use requirements

Part of REST utility is by using URL

Provides an easy way to access data and bypass theWQP form interface

Easy to follow set-up instructions in Web Service UserGuide

Increases ability of others to call data for analysis

No throttling or restriction of data access

Simple to extend to other formats

10

Page 11: James Kreft - ACWI · 2014. 5. 23. · James Kreft U.S. Geological Survey, Center for Integrated Data Analytics NWQMC National Monitoring Conference, Cincinnati, OH April 29, 2014

11

0

1000

2000

3000

4000

5000

6000Downloads from the Water Quality Portal

3/17/2014 - 4/14/2014

WQP Site WQP Service

Page 12: James Kreft - ACWI · 2014. 5. 23. · James Kreft U.S. Geological Survey, Center for Integrated Data Analytics NWQMC National Monitoring Conference, Cincinnati, OH April 29, 2014

Map Interface

12

Page 13: James Kreft - ACWI · 2014. 5. 23. · James Kreft U.S. Geological Survey, Center for Integrated Data Analytics NWQMC National Monitoring Conference, Cincinnati, OH April 29, 2014

Addition of USDA STEWARDS USDA Agricultural Research Service STEWARDS

Required significant re-architecture

Improves long-term maintainability of codebase

States, tribes,Feds, and otherdata partners

WQPUsers

NEW

Page 14: James Kreft - ACWI · 2014. 5. 23. · James Kreft U.S. Geological Survey, Center for Integrated Data Analytics NWQMC National Monitoring Conference, Cincinnati, OH April 29, 2014

Responsive Design

14

Water QualityPortal works onany device with amodern webbrowser

Page 15: James Kreft - ACWI · 2014. 5. 23. · James Kreft U.S. Geological Survey, Center for Integrated Data Analytics NWQMC National Monitoring Conference, Cincinnati, OH April 29, 2014

NEMI Integration

15

• Over 50 million WQPresults matched toNEMI methods

• NEMI calls WQP webservices

• Generates maps on thefly from GeoJSON

• WQP datadownloadable fromNEMI

Page 16: James Kreft - ACWI · 2014. 5. 23. · James Kreft U.S. Geological Survey, Center for Integrated Data Analytics NWQMC National Monitoring Conference, Cincinnati, OH April 29, 2014

Portal Next Steps Education and outreach:

Promote the use of WQP and web services Help advertise user-developed tools which utilize the

Portal web services

Expand data types and formats: Serve out biological, habitat, metrics, index Explore continuous monitoring or sensor data Serve more data, such as NEMI links and metadata

Enhance geospatial capabilities: Develop an OGC-compliant web map service Integrate the mapping interface with the National Hydrography

Dataset (NHD)Plus flow volume and direction attributes Take advantage of in-development NWIS mapping tools for Gage

information.

16

Page 17: James Kreft - ACWI · 2014. 5. 23. · James Kreft U.S. Geological Survey, Center for Integrated Data Analytics NWQMC National Monitoring Conference, Cincinnati, OH April 29, 2014

Portal Next Steps Examine opportunities to improve data quality

Identify common issues in data quality Develop dynamic reporting mechanism to increase

visibility of data issues so that they can be fixed

Add new data sources: Identify new data partners increasing state data contributions

Enhance Discoverability Build summary pages for collections of data

HUC Organization State/County

Make WQP data visible to search engines

17

Page 18: James Kreft - ACWI · 2014. 5. 23. · James Kreft U.S. Geological Survey, Center for Integrated Data Analytics NWQMC National Monitoring Conference, Cincinnati, OH April 29, 2014

Come visit us at our booths Charles Kovatch

[email protected]

202-566-0399

Jim Kreft

[email protected]

608-821-3919

http://www.waterqualitydata.us

18

Page 19: James Kreft - ACWI · 2014. 5. 23. · James Kreft U.S. Geological Survey, Center for Integrated Data Analytics NWQMC National Monitoring Conference, Cincinnati, OH April 29, 2014

Come visit us

19http://www.waterqualitydata.us