Route Data Cleanup - Transportation.org · 6/13/2018  · Route Data Cleanup. for Roads and...

Route Data Cleanupfor Roads and HighwaysKyle Gonterwitz KDOTJune 13, 2018

Kevin Sigwart1SpatialJune 13, 2018

with

Stuff I thought was impossible Until I learned 1Spatial and got help from experts

Problem Statement

KDOT needed to quickly validate road centerlines from NG911 with conflated route-defining attributes, and enhance

the centerlines for Route Migration for migration to Roads and Highways with minimal route errors.

High Level Workflow

Goalposts moveAiming for 100%

Create new routes using projected shape length measures for Roads

and Highways

KDOT SourcesKDOT source 1:

w\ Measures (M) - Project StationingTemporality for temporal events

KDOT Source 2:w\ Measures (M) - Map or driven

distances

KDOT source 3:Measure Attributes (not M) - Driven

distances or shape lengths

Stat

e Hi

ghw

ays

3456

7

UR

U

R + ramps

Conflate KDOT sources

to NG911 Road

Centerline Geometry

Roads and Highways

ClassUrbanRural

All Single Carriageway Polylines & Route Defining Attributes

Dual Carriageway (No M’s)No Route defining attributesAddress Location Attributes

No temporality (current state)Overlapping Segments

105 Sources (not edge matched)Topology Rules

Alias Tables

Next Gen 911

Workflow

Technology Used

• Edit in ArcGIS Pro• 1Integrate for ArcGIS

• Validate• Pinpoints Issue Locations• Automate fixups

• Shared Pro Packages on ArcGIS Online

• Facilitated Editing & Validation

• Consistent Cartography & Labeling

Editing and Reviewing

Automation• Python Development

• Calibrate & Update Route Measures

• Flip Lines• Update Datasets• Package and Share Docs

https://github.com/KDOTGIS/pydot/tree/master/KhubCode25

Editing and Reviewing

1Integrate for ArcGIS Demonstration

• Validation• Rules Based Validation• Pin-Point Exact

Locations • Enhancement

• Automate Cleanup• Integration

• Validate Multiple Sources

• Snap Sources Together

Editing and Reviewing

Results for All Source Routes*

Validation Check 1 2 3 4* 5*Duplicate Calibration Points – Different measures 34,190 27,616 38,717 22,969 1,363

Duplicate Calibration Points – Same measures 56 20 2 - -

Detect Non-Monotonic Routes 11,561 27,452 6,643 2,473 887

Branches 503 628 460 172 179

Barbells 1 1 2 1 1

Complex Self-Intersections 1351 201 144 37 44

Duplicate Vertex 2,809 1,117 1,031 227 253

* Round 4 and 5 networks did not include local, ghost, or zombie roads

Results for All Source Routes*

Validation Check 1 2 3 4* 5*Invalid Geometry 3 3 3 - -

Multipart Line 4,755 3,242 2,499 865 841

Dangles 1,486 243 256 44 37

Orphan 137 123 107 6 7

Alpha Routes 5 8 8 2 1

Single Self Intersection – 4 approaches 445 16 29 4 17

Single Self Intersections – 5 approaches - 1 - - -

* Round 4 and 5 networks did not include local, ghost, or zombie roads

Results for All Source Routes*

Validation Check 1 2 3 4* 5*Infinity 5 - 1 - -

Cutbacks 246 146 204 40 39

Evaluate Polyline Length 26 13 33 2 2

Polyline or Path Closes on Self 2,535 794 892 151 179

Loops 389 180 200 9 9

Lollipops 101 80 187 1 1

TOTAL 60,604 61,884 51,418 27,003 3,860

* Round 4 and 5 networks did not include local, ghost, or zombie roads

Results for All Source Routes*

* Round 4 and 5 networks did not include local, ghost, or zombie roads

Results for State Highway System

Validation Check 1 2 3 4* 5*Duplicate Calibration Points – Different measures 11,116 11584 1838 1866 0

Duplicate Calibration Points – Same measures 2 0 0 0 0

Detect Non-Monotonic Routes 684 540 468 324 142

Branches 60 60 56 13 47

Barbells 0 0 0 0 0

Complex Self-Intersections 68 29 23 1 13

Duplicate Vertex 142 97 91 15 74

Results for State Highway System

Validation Check 1 2 3 4* 5*Invalid Geometry 0 0 0 0 0

Multipart Line 327 249 279 190 213

Dangles 155 18 16 6 4

Orphan 0 0 0 0 0

Alpha Routes 0 0 1 1 0

Single Self Intersection – 4 approaches 13 6 10 0 14

Single Self Intersections – 5 approaches 0 0 0 0 0

Results for State Highway System

Validation Check 1 2 3 4 5Infinity 0 0 0 0 0

Cutbacks 7 4 4 0 0

Evaluate Polyline Length 4 2 1 0 0

Polyline or Path Closes on Self 108 67 63 10 54

Loops 0 0 1 0 0

Lollipops 1 2 0 0 0

TOTAL 12,687 12,658 2,851 2,426 561

Results for All Source Routes*

Results for Non-State HWAY –non local

Validation Check 1 2 3 4* 5*Duplicate Calibration Points – Different measures 13,219 13,809 33,142 21,103 1,363

Duplicate Calibration Points – Same measures 32 14 0 0 0

Detect Non-Monotonic Routes 2733 3913 3784 2149 745

Branches 296 407 281 159 132

Barbells 0 0 1 1 1

Complex Self-Intersections 266 123 78 36 31

Duplicate Vertex 730 560 391 212 179

Validation Check 1 2 3 4* 5*Invalid Geometry 3 0 3 0 0

Multipart Line 1191 982 921 675 628

Dangles 356 79 82 38 33

Orphan 4 2 1 6 7

Alpha Routes 2 2 2 1 1

Single Self Intersection – 4 approaches 48 9 18 4 3

Single Self Intersections – 5 approaches 0 1 0 0 0

Results for Non-State HWAY –non local

Validation Check 1 2 3 4 5Infinity 0 0 0 0 0

Cutbacks 57 39 39 40 39

Evaluate Polyline Length 2 0 7 2 2

Polyline or Path Closes on Self 574 347 246 141 125

Loops 10 9 10 9 9

Lollipops 8 4 1 1 1

TOTAL 19,531 20,300 39,007 24,577 3,299

Results for Non-State HWAY –non local

Results for Non-State HWAY –non local