What To Do With LiDAR Data? - Maine GIS User...

MEGUG Summer School June 25, 2011

What To Do With LiDAR Data?

Mike Shillenn – Photo ScienceMike Umansky – Applied Imagery

Presentation OutlineBefore Break: Mike S. • LiDAR Basics• LiDAR Data & Derivatives After Break: “Mike & Mike” • Software Applications• Northeast LiDAR Update (Time Permitting)

• Q&A

LIDAR BASICSGeospatial Solutions

LiDAR Basics

• Generate an accurate 3D model of the earth’s surface

• Use a near infrared laser and scanning mirror in measurement

• Sensors have the ability to measure multiple returns from each pulse

• Also measure the intensity of each of the returns

LiDAR Basics - Platforms

LiDAR Basics - Applications

LiDAR Measures Objects From “Line of Sight”

LiDAR Basics

• Time of flight of the laser provides an accurate distance to the ground

• Airborne GPS provides the 3D position (XYZ)• Inertial Navigation Systems (INS) provides the

3D rotation of the sensor (omega, phi, kappa)• A galvanometer provides the swing angle of

the scanning mirror• Must solve for 8 variables for each laser return

LIDAR 1st and Last Return

1ST stop from canopy

Last stop from ground

~50 cm

~ 2 ft

FOOTPRINTTOP/MAP VIEW

1ST STOP HITS LEAF, LAST STOP HITS

GROUND

Multiple LIDAR Returns

LiDAR Basics

http://youtu.be/JVgtXVzwPCE

LiDAR Basics

• LiDAR is an active sensor, generating infrared light and can be flown day or night

• LiDAR is not an all weather sensor; it cannot be flown above clouds and should not be flown with standing water on the ground

• LiDAR can pass through gaps in some vegetation so generally better results will be gained during “leaf off” conditions for deciduous vegetation

LiDAR Basics

• Laser rates in sensors today are generally in the 150 kHz to 200 kHz range

• Many sensors can work in the mode of discrete returns (typically 1st, 2nd, 3rd, and last) or full waveform technology

• High end systems are made by Leica, Optech, and Riegl

• Sensor costs are typically more than $1M

LiDAR Basics

• Automated routines used to help classify the returns (e.g., removing artifacts, vegetation, structures, vehicles, etc.)

• These routines are typically 90 to 95% efficient• Manual editing is necessary to produce a quality

LiDAR product• Hydro enforcement of bare earth surface (flattening

of water/downward flow of streams)

LiDAR Basics – QA/QC

• Quantitative– Vertical accuracy– Horizontal accuracy– Clustering of points– Nominal posting

• Qualitative– Quality of the elevation surface (look and feel)– Removal of artifacts, etc.

• Relatively easy to assess, often required• Normally look at various types of land cover…

bare earth, urban, forest, brush, high grasses• Typically find a location with no abrupt changes

in the ground surface (within 3 to 5 meters)• Determine precise 3D location with field

techniques… then determine elevation from the LiDAR surface at that XY, subtract, and statistically summarize

• Control at least 3x better than required accuracy

LiDAR Basics- Vertical Accuracy

MEGUG Summer School June 25, 2011Bare Earth

MEGUG Summer School June 25, 2011 Brush

MEGUG Summer School June 25, 2011Forest

MEGUG Summer School June 25, 2011High Grass

MEGUG Summer School June 25, 2011Urban Area

LiDAR Basics- Vertical Accuracy

• Fundamental, Supplemental, and Consolidated Accuracies– Fundamental – the accuracy in open terrain– Supplemental – the accuracy in other areas– Consolidated – the accuracy in all areas

combined

• More difficult to assess, not often required• Possible to find identifiable objects in the

intensity images… paint stripes, concrete-asphalt edges, etc.

• Building corners can be very useful; best to use multiple points on the building and intersect planes to determine the correct XY location

LiDAR Basics- Horizontal Accuracy

Building Corners

Accurate XY Location

˚˚ ˚ ˚

˚ ˚ ˚ ˚˚ ˚ ˚

LiDAR Basics – Qualitative Review

Flight Line Analysis & Relative Adjustment

• Compensation for systematic bias between the flight missions

• Vertical overlap is analyzed & color coded to flag differences

• Calibration points between strips are identified and used to perform flight line calibration adjustment.

Automated & manual filtering for LiDAR products achieves artifact / feature removal from the bare earth surface model for:

90% of artifacts classified

95% of outliers classified

95% of vegetation classified

98% of buildings classified

• QT Modeler used to micro check (tile level) of the bare earth dataset

• GeoQue’s LP360EQC & ArcGIS used to macro check (multiple tiles) dataset

LiDAR Basics – Qualitative Review

LiDAR Basics - Platform Dependent

Fixed Wing Rotary Wing Mobile Mapping

Acquisition Heights 3,000-8,000’ AMT 300-800’ AMT Ground based

Acquisition Speeds 90-200 knots 20-50 knots 10-60 mph

Vertical Accuracy 9-25 cm 3-15 cm 2-10 cm

Horizontal Accuracy 0.5-1.0 m 10-50 cm 3-10 cm

Point Density 0.5-8 ppsm 20-80 ppsm 1,000-8,000 ppsm

NOTE: All accuracies expressed as RMSE

LiDAR Basics –Advancements

• Waveform Technology– Captures whole waveform– Complex details of multiple

pulses recorded– Possible to resolve closely-

spaced targets– Shape of return pulse gives

additional information about target

– Analysis of vegetation density, mapping live versus dead vegetation, forest fuels analysis, and wildlife habitat mapping

http://youtu.be/NC50BrzFHRw

LiDAR Basics - Resources• National Standards for Spatial Data Accuracy

(NSSDA) – Standards for accuracy verification and testing that are applied for most LiDAR projects.

• USGS V13 – United States Geological Survey (USGS) LiDAR Guidelines and Base Specifications Version 13.

• FEMA PM61 – FEMA Procedure Memorandum No. 61—Standards for LiDAR and Other High Quality Digital Topography published September 27, 2010.

• ASPRS- LAS Data Standards- V1.3– http://www.asprs.org/society/committees/standards/lida

r_exchange_format.html

LIDAR DATA & DERIVATIVESGeospatial Solutions

LiDAR Data• Basic Deliverables include:

– Raw LiDAR Data– Classified LiDAR Data

• Derivative Data can include:– DEM’s, DTM’s & DSM’s– Intensity images– Hill shades– Break Lines– Contours

LiDAR Data – Raw LiDAR Data

• Collected in proprietary format typically referred to as “raw” (unprocessed) LiDAR point cloud data.

• Post-processing software combines raw scan data with GPS (position) data and IMU (orientation) data to produce a LiDAR LAS file

• Point cloud data is dumb – no data classifications have been assigned; typically organized and delivered by individual flight lines

LiDAR Data – Classified LiDAR Data

• LASer (LAS) File Format is a public file format for the interchange of 3-dimensional point cloud data developed by ASPRS in conjunction with LiDAR industry

• Non proprietary binary format (smaller); high performance (faster) compared to ASCII

• Includes all relevant LiDAR attributes: classification, intensity, return info, GPS timestamp, flight line info, etc. compared to ASCII

• Typically data is tiled to predefined schema• LAS Versions 1.0, 1.1, 1.2, 1.3, 2.0 (in development)• LAS Version 1.3 stores return pulse waveform data

LiDAR Data - Derivatives• Digital Surface Model (DSM) -Elevation model including

ground, vegetation, buildings and other objects

• Digital Elevation Model (DEM) -Elevation model including ground but not vegetation, buildings or other objects

• Digital Terrain Model (DTM) - Elevation model including ground and break line but not vegetation, buildings or other objects

• Intensity Imagery – ortho corrected• Hill shades• Break Lines• Elevation Contours

LiDAR Data - Derivatives

USGS DEM LiDAR DEM

SOFTWARE APPLICATIONSGeospatial Solutions

Software Applications

• COTS software has made significant gains recently and overall is very good

• Very important as a LiDAR provider to have programming staff to automate and assist in LiDAR processing– intersecting building corners– flagging and removing anomalies– assessing completeness

Software Applications• End user GIS & CADD software now able to

directly ingest the LAS format for classified LiDAR data.

• Stand Alone/Extensions have matured and provide advanced viewing, manipulating, rendering, & analytical capabilities

• Numerous freeware applications continue to emerge providing no cost basic functionality

• Cloud computing will have an impact

Standalone Software1. QT Modeler – Applied Imagery2. Fusion – Forest Service3. MARS – Merrick4. VG4D – Virtual Geomatics

Plugins/Extensions:1. AutoCAD Map 3D – Autodesk2. 3D Analyst – ESRI3. LP360 – Qcoherent/GeoCue

Free Software1. QT Reader – Applied Imagery2. Fusion – US Forest Service3. Fugro Viewer– Fugro

Software Applications

QT Modeler – Mike U.

3D Analyst – Mike U.

Fugro – Mike S.

Questions

THINGS TO KNOWGeospatial Solutions

And That aren’t always disclosed

EXTRA SLIDES

Things to Know

• Horizontal accuracy of the surface is important• Vertical accuracy is more difficult in sloping terrain

Things to Know

• Vertical accuracy of LiDAR is commonly specified as the Root Mean Square Error (RMSEz), not an “absolute” accuracy

• RMSEz is the 68% confidence interval• RMSEz x 1.96 is the 95% confidence interval• RMSEz x 3.0 is the 99.7% confidence interval

Things to Know

• All sensors have a vertical discrimination ranging from about 1 to 3 meters

• This is the minimum distance between successive returns…

• May lose ground

Things to Know

• Proper calibration of both the sensor and LiDAR surface are critical to quality

Things to Know

• There is significant value in manual cleanup (after automatic filtering)… this also is a significant cost factor

• Up to 90% of the post-processing costs can be associated with manual edits

• Ensure clear communication with LiDAR provider regarding expectations

Things to Know

• For cost efficiency, projects should be designed for compatibility in accuracy and posting

• Compatible pairs would include – 9.25 cm RMSEz & 0.5 m point spacing– 15 cm RMSEz & 1 m point spacing– 25 cm RMSEz & 2 m point spacing– Not a major issue, but openly discuss options with

your LiDAR provider

Things to Know• Achieving ultra high densities can result in

– Significant costs– Increased data storage– Data manipulation issues

• Acquisition costs can increase to 2x or 4x• Data requirements:

– 1 ppsm point density would equate to 200 Megabytes per square mile

– 4 ppsm would be 4X, or 800 Megabytes per mi2

– 8 ppsm would be 8X, or 1.6 Gigabytes per mi2

LiDAR Basics: Terms

• Nominal Post Spacing (NPS)– Average distance between adjacent LiDAR points (ft or m)

• Point Density– Number of LiDAR points per unit area (points per square meter)

• Root Mean Square Error (RMSE)– Statistical value equal to the square root of the average of the

squares of the differences between known points and modeled points in the LiDAR surface

• Accuracy– 95% confidence interval of the data (vertical = RMSE x 1.96)

• Swath Width – The linear width of the laser coverage during acquisition, which varies with the flying height and FOV. Increased swath widths result in increased productivity and lower acquisition costs.

• Along Track – The direction in the line of the flight of the aircraft during acquisition.

• Cross Track – The direction perpendicular to the flight of the aircraft during

• Laser Pulse Rate or Repetition Rate – The speed at which the laser is pulsed during LiDAR collection. Maximum laser pulse rates on new sensors today generally range from between 150 kHz to 200 kHz (150,000 to 200,000 outgoing laser pulses per second).

• Scan Rate – The speed at which the scanning mirror (that directs the laser pulses back and forth over the ground) is moved during LiDAR acquisition. Maximum scan rates on new sensors are generally around 100 Hz (100 times per second).

• Nadir – The direction pointing straight down from the aircraft.

• Field of View – The angular swing of the mirror during acquisition. Typically the mirror moves in a perpendicular direction to the line of flight. The USGS V13 specifications call for a maximum FOV of 40 degrees (20 degrees each side of nadir), with a preferred maximum of 34 degrees.

• Illuminated Footprint – The diameter of the laser beam as it reaches the earth. The laser beam exits the sensor as a very narrow, highly focused beam but diverges slightly on its path from the sensor to the ground. The illuminated footprint increases with increased flying height, but is generally around 1 to 3 feet when using a fixed wing aircraft.

Vertical Accuracy Analysis

Point Northing EastingField

ElevationLidar

ElevationVertical

Difference

103 1,234,542.12 456,263.54 109.23 109.34 -0.11

104 1,254,673.33 454,295.26 114.89 115.05 -0.16

108 1,326,329.48 450,292.58 120.33 120.05 0.28

110 1,323,545.89 449,848.94 105.06 105.08 -0.02

112 1,543,949.74 459,737.84 112.49 112.44 0.05

114 1,442,759.03 460,274.56 114.38 114.68 -0.30

115 1,348,499.10 448,392.69 119.20 119.24 -0.04

116 1,365,749.73 483,295.74 106.58 106.32 0.26

117 1,299,493.58 465,820.74 108.44 108.10 0.34

Impact of Cover on Accuracy

0 5 10 15 20 25 30

Sorted Data Check Points

Open Terrain Forest Scrub/Shrub Built-Up Weeds/Crops

Distribution of Errors

Normal Probability Distribution

RMSE RMSE1.96 x RMSE 1.96 x RMSE

95%Vertical Component

LiDAR Accuracy

Orange County – 204 Square Mile LiDAR SetAve: -0.07’ Min: -0.43’ Max: 0.21’ RMSE: 0.17’ Shots: 26

Less than -0.81

-0.8 to -0.61 -0.6 to -0.41 -0.4 to -0.21 -0.2 to 0 0 to 0.2 0.21 to 0.4 0.41 to 0.6 0.61 to 0.8 More than 0.81

Residual Ranges

High Grass, Weeds

LiDAR Accuracy

Orange County – 204 Square Mile LiDAR SetAve: 0.13’ Min: -0.57’ Max: 0.90’ RMSE: 0.21’ Shots: 180

Less than -0.81

-0.8 to -0.61 -0.6 to -0.41 -0.4 to -0.21 -0.2 to 0 0 to 0.2 0.21 to 0.4 0.41 to 0.6 0.61 to 0.8 More than 0.81

Residual Range

Urban Areas

What To Do With LiDAR Data? - Maine GIS User...

Documents

Understanding LiDAR for Forest ApplicationsUnderstanding LiDAR for Forest Applications By Jonathon Donager and Andrew Sánchez Meador ... What types of data does LiDAR provide? Specific

Stripes Tutorial

Key Drivers in Determining LiDAR Sensor Selection … · Key Drivers in Determining LiDAR Sensor ... Reliability Find out what you can about the “workhorse” lidar ... there is

Stars and Stripes Forever - Ivory Spring...Stars and Stripes Forever Quilt design by Wendy Sheppard of ivoryspring.wordpress.com. What could be more American than the Ohio Star. Add

Yikes Stripes

LiDAR: What do you do with all that data?

NC LiDAR (1999-2003) Success in other States – (Zsolt Nagy – AECOM) 1.What was the business driver for NC LiDAR? 2.What was the coordination approach?

Frequently Asked Questions - American Heritage Girls · 22 Frequently Asked Questions What are the required badges for the Stars & Stripes Award? The Stars & Stripes Award requires

What happens to a ToF LiDAR in fog? - arXiv

What do the Stripes on the American Flag representgraziman.weebly.com/uploads/1/7/6/4/1764005/citizenship...What do the Stripes on the American Flag represent • The 13 Colonies What

LiDAR: What is it and how do we use it?€¦ · LiDAR: What is it and how do we use it? Christopher Maike LiDAR (light detection and ranging) is a remote sensing technology used by

STArS ANd STripeS FOrever STArS ANd STripeS FOrever

Markus Hücker What Pins Stripes in La 2-x Ba x CuO 4 ? Neutron Scattering Group Electronic Liquid-Crystal Nature of Stripes Doping Phase Diagram of LBCO

REMOTE SENSING: LIDAR 1 - Earth Hour Homepage … SENSING: LIDAR 3 What is LiDAR? LiDAR (light detection and ranging) is a remote sensing method that uses a laser to measure distances

Checks & Stripes

boat. · 34.Zach has blue shoes with red stripes. r What color are Zach's shoes? o What color are the stripes? o Who has blue shoes with red stripes? 35. Derrick went shopping at

AND STRIPES

STRIPES · White Stone STRIPES, STRIPES TRANSITION & LISO XL Graphite Matt 14 15. STRIPES, STRIPES TRANSITION & LISO XL Greige Stone 16 17. STRIPES, STRIPES TRANSITION & LISO XL Graphite

White stripes

Brown Stripes