14
iDigBio Train the Trainers 2 Georeferencing Workshop Gainesville, FL 12-16, Aug 2013 FishNet Workflow for Large Scale Collaborative Georeferencing Nelson Rios [email protected]

IDigBio Train the Trainers 2 Georeferencing Workshop Gainesville, FL 12-16, Aug 2013 FishNet Workflow for Large Scale Collaborative Georeferencing Nelson

Embed Size (px)

Citation preview

Page 1: IDigBio Train the Trainers 2 Georeferencing Workshop Gainesville, FL 12-16, Aug 2013 FishNet Workflow for Large Scale Collaborative Georeferencing Nelson

iDigBio Train the Trainers 2 Georeferencing WorkshopGainesville, FL 12-16, Aug 2013

FishNet Workflow for Large Scale Collaborative Georeferencing

Nelson [email protected]

Page 2: IDigBio Train the Trainers 2 Georeferencing Workshop Gainesville, FL 12-16, Aug 2013 FishNet Workflow for Large Scale Collaborative Georeferencing Nelson

History1999: Creation of original FishNet Network

Z39.50 protocol for sharing data

Search via Species Analyst (distributed query model)

2005: FishNet 2 created

Search via DiGIR Portal (distributed query model)

Harvesting of DiGIR, DwCA, IPT, Static Spreadsheets

Search via FishNet 2 Portal (centralized query model)

2010: FishNet 2 (centralized query model)

Transition to DiGIR Protocol

2012-2016: Portal & data expansion and enhancement

Page 3: IDigBio Train the Trainers 2 Georeferencing Workshop Gainesville, FL 12-16, Aug 2013 FishNet Workflow for Large Scale Collaborative Georeferencing Nelson

Global network of fish collections

71 data providers

3.7 million lots

35+ million specimens

57% georeferenced

Page 4: IDigBio Train the Trainers 2 Georeferencing Workshop Gainesville, FL 12-16, Aug 2013 FishNet Workflow for Large Scale Collaborative Georeferencing Nelson

Current Activity

To expand the number of records within FishNet to approximately 4 million lots representing over 30 million specimens To georeference all "georeferencable" records lacking geographic coordinates

To repatriate results to source data providers

321,102 collecting events representing 1,568,695 specimen lots have been identified for georeferencing from FishNet2

Page 5: IDigBio Train the Trainers 2 Georeferencing Workshop Gainesville, FL 12-16, Aug 2013 FishNet Workflow for Large Scale Collaborative Georeferencing Nelson

Georeferencing FishNet

• 250,000 collecting events• 18 months• 12 technicians• 5+ volunteers• GEOLocate• Collaborative

Page 6: IDigBio Train the Trainers 2 Georeferencing Workshop Gainesville, FL 12-16, Aug 2013 FishNet Workflow for Large Scale Collaborative Georeferencing Nelson

The Dirty Dozen

Page 7: IDigBio Train the Trainers 2 Georeferencing Workshop Gainesville, FL 12-16, Aug 2013 FishNet Workflow for Large Scale Collaborative Georeferencing Nelson

Preliminary Assignments

Page 8: IDigBio Train the Trainers 2 Georeferencing Workshop Gainesville, FL 12-16, Aug 2013 FishNet Workflow for Large Scale Collaborative Georeferencing Nelson

Leveraging Existing Technology and Expertise

Page 9: IDigBio Train the Trainers 2 Georeferencing Workshop Gainesville, FL 12-16, Aug 2013 FishNet Workflow for Large Scale Collaborative Georeferencing Nelson

Workflow: Integrating API’s

pre-georeference, assess verification difficulty, identify problematic

records

produce datasets for CoGe based on institution and anticipated difficulty of

verification

Assi

gn w

orkl

oads

by

insti

tutio

n,

diffi

culty

& re

gion

final review of results

repatriate

clean data, add to locality

gazetteer & match against

locality gazetteer

verify, correct & annotate

data providers

http://geolocate.fishnet2.net/workflow.html

Page 10: IDigBio Train the Trainers 2 Georeferencing Workshop Gainesville, FL 12-16, Aug 2013 FishNet Workflow for Large Scale Collaborative Georeferencing Nelson

i. Point

i. Point ii. Radius

i. Pointii. Radiusiii. Polygon

Measuring Uncertainty

Page 11: IDigBio Train the Trainers 2 Georeferencing Workshop Gainesville, FL 12-16, Aug 2013 FishNet Workflow for Large Scale Collaborative Georeferencing Nelson

Georeferencing Output

Base Map - 1:2M 8-Digit HUCs

Page 12: IDigBio Train the Trainers 2 Georeferencing Workshop Gainesville, FL 12-16, Aug 2013 FishNet Workflow for Large Scale Collaborative Georeferencing Nelson

11 January - 12 June 2013 Stats

• 90,301 total locality verifications• 6,009 verifications were re-evaluations

• 73,639 corrected – 36,549 associated with polygons

• 10,653 skipped

• Total: 84,292 localities “completed”

Page 13: IDigBio Train the Trainers 2 Georeferencing Workshop Gainesville, FL 12-16, Aug 2013 FishNet Workflow for Large Scale Collaborative Georeferencing Nelson

Georeferencing Efficiency

11 January – 12 June 2013

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 230

1000

2000

3000

4000

5000

6000

Week Number

No.

Loc

aliti

es C

ompl

eted

excluding volunteer data

Page 14: IDigBio Train the Trainers 2 Georeferencing Workshop Gainesville, FL 12-16, Aug 2013 FishNet Workflow for Large Scale Collaborative Georeferencing Nelson

Georeferencing Status

11 January – 12 June 2013

366K Specimens / 84K Localities / 6 Months