1

Devon Humphreyp yGeospatial Consultant

Full Motion Video as an Operational Layer in GIS

copyright 2013 waypoint mapping LLC1

John n KlierGeography & Remote Sensingg p yy

Texas State University

2

Aerial PlatformsManned planes & helicoptersManned planes & heliccopterUnmanned Aerial Vehicles

Data TypepesHigh Definition Digital al OrthosHigh Definition D3D Point Cloud3D Point CloudFull Motion Video (FMV)

Content capture Technologies:

Aerial PlatformsM d l & h li tM d l &

Content is key

Multilt -ti-ii capture capability provides all types in a single flight!

3

Just a few definitions(Pop quiz at the end of presentation...)

Unmanned Aerial Vehicle (UAV)V) – A fixed wing or rotor craft without a pilot on Unmanned Aeboard. Fully

d Aelyly-

erial Vehicle (UAVV) ––– A fixed wAeAeyy-autonomous in some cases.

Remotely Piloted Aircraft (RPA)A) – A fixed wing or rotor craft having a pilot that Remotely Piloted Aircraft (RPAA) ––– A fixed wingAcontrols the vehicle from a remote location.

Full Motion Video (FMV)V) – True color or infrared video source with Full Motion Video (FMVV) ––– True color or infrared video source witth Taccompanying aircraft metadata. Contains spatial information and aircraft accompanying aircraft metadata. Contains spaaccompanying aircraft mmeetadata. Contains spatialetadetattitude information allowing the video to be geo

atatialeoeo-

information informationtial tialoo-referenced.

Motion Industry Standards Board (MISB)) ––– THEE standard for FMV.

Certificate of Authorization (COA)A) - Permit to operate a UAV in a defined Certificate of Authorization (COACertificate of Authorization (COAA)A) -- PermPermPPairspace for a project of fixed duration.

Common Operational Picture (COP)) - A single identical display of relevant Common Operational Picture (COP) - A single identical display oof reof relevant Ainformation shared by more than one command. A COP facilitates collaborative information shared by more than one command. A COP facicilitatees collaborratiinformation shared by more than onnee command. A COP facilitalitatees collaborrate coe cplanning and assists all echelons to achieve situational awareness (NIMS).

4

Example Applications

Environmental studiesPipeline HCA and route analysispEmergency Management

5

How is visual intelligence used in Emergency Management?Situationn Status Displayss in the

Incident Command Post =ACTIONABLE INTELLIGENCE

6

How can GIS contribute to Emergency Management?Example: : Deepwaterr Horizon Oil Disaster ICP

7

Deepwaterr Horizon: Comparing the tradedee-

eepwater HeDee--off between

rizon: HorHn nn data timeliness & && accuracy.&

(NGA provided imagery and data capture team via IRSCC.)

Photo by USCG

8

Deepwaterr Horizon: How Visual al I Intelligence was used

ArcGIS for Server Flex Viewer ArcGIS for Server Flex Viewer showing spill extent, currents & showing spill extentboom verification.

Used in ICP for Planning: Used in ICP for Planning: USCG, LA Nat. Guard, LA DNR, USCG, LA Nat. GuarUSFWS & others.

iOSS and browser access!

9

UAVs Can Provide e Realtimee Visual Intelligence

High Definition n orthophotoss (up to 2cm resolution)g e t o t op otoso s up to(u3D terrain and structure mapping3 te a a d st ucFull Motion Videou ot o deoUpdate the base mapUpdate t e base aOperational Layer

10

UAVs come in all shapes and sizes

Rotoror-r-craft and fixedd-d-wing configurationsVarious flight profiles and durationsEasily launched and landed almost anywhere

11

UAVs have a niche in PhotogrammetrySmall to mediumm-m-sized project areasAffordability = RepeatabilityFAA restrictions (What is a COA and why do I need one?)

Video not included in Powerpoint:See http://www.flightlinegeographics.com for

a link to the actual video

12

UAVAV-V-collected imagery

Ground control stationGISSS-SS-based mission softwareResults viewed in reala -ll-time

13

UAVAV-V-collected imagery

3D point cloud data rivals s LiDARR for some usesCreate 3D scenesVolumetric calculations

14

UAVAV-V-collected imagery3D imagery in ArcGISAffordability for small to mediumm-m-sized projectsRepeatability due to cost and turnrn-n-around time

15

UAV V Full Motion Videoeo: December 2012FAA COA in Wimberley, TXUAVAVAV-

yVV-based IR FMV for GIS

UAV with 10 hour durationLive streaming of FMV to Ground Station and GIS

Video not included in Powerpoint:See http://www.flightlinegeographics.com for

a link to the actual video

16

UAV Imaging for Google EarthCaboo San Lucas, MX250 0 0 sqq milesqqq2500 linear miles, 16,000 images3” resolution

17

Full Motion Video (FMV)

Pipeline observation & field studiesPipeline observation &HCA feature spotting

Video not included in Powerpoint:See http://www.flightlinegeographics.com for

a link to the actual video

18

How is Aerial Visual Intelligence used in Pipeline?

Asset monitoring: Pipelines

19

•• Fulll -l-Motion Video viewing/processing− Developed for USAF Predator & Reaper to enhance Developed for USAF P

quality of UAV video

− Ingests and processes “raw” incoming video feed in Ingests annear real

anaa -

d procedanll-time (1

oce(1(1-

sses raw esce11-2 seconds)

− Georeferencedd video output in GISS-S-ready format

Reala -l-time Aerial Video Exploitation (RAVE)

20

•• Platform/Sensor/Hardware agnostic

•• Can be used with all UAVs and/or FMV sensors (IR/EO)

•• KEY: Standard video and metata-a-data feeds are required

ti

FMV Requirements

22222202

21

FMV Video Processing Tools

Video Stabilization

FMV V V Mosaicing

Geooo-o-registration

22

Example of Full Motion Video Processing for GIS

Video not included in Powerpoint:See http://www.flightlinegeographics.com for

a link to the actual video

23

Results of Full Motion Video Processing for GISHD Waterfall Mosaic (strip)

24

UAV Multit -i-Capture: HD D Orthoss + 3D Point Cloud + FMVPipeline observationPipeline observaRugged terrainRugged terrain1 day mission1 day missioRapid turn

ssiornrn-

nosionn--around time

25

How do GIS users make use of FMV?ESRI released is first generation FMV toolbarESRI reMISB

RI reB-

leased is first geeI reB-compliant FMV

et geV -

g- Must st have accompanying metadata from the aircraft to workrk.MISMISB

DVDSSBD-

ompliant FMVompliant FMVcococc V V -- MusMusMMMM st stccBBBBBB-DD--style player windowDVDDVDDDDDD--sstss

Allows e player windoe player winndotyletyletytstst

s ss feature capture owowo

e e in the video player window.

The ESRI FMV toolbar is the target platform The ESRI FMV toolbar isbar is the target platform for GIS users for feature capture and integration.

26

FMV Technology y BBenefits for GIS

Onn-n-demand aerial visual intelligenceStreaming data without the need to land & processQuickly update existing base mapsRealtimee Operational Layer for missionn-n-critical applicationsGIS data capture e directly from m georeferenceddd videoThe time factor… … imagery noww.

While USA UAV regulations are changing, While USA UAV regulations are changing, g g gpiloted systems still provide value for many applications.

Epiloted systems still provide va

EEEEEEEEspecially where mission flexibility va

y y &ue for many applicaations. alua

&& platform stability are important.

27

Why can’t I do this myself?

You can. Just follow the rules.FAA COAs are required inside USARecreational/hobby vs. professionalMISB data formatPublic relations concerns

28

by Devon Humphrey & & Darronn Pustam

Statete-e-ofoo -ff-ff thehe-e-industry summary of image data and full motion video Stattee oooff hhthhee dustry summary of image data aanand full motition videonincapture from both manned and unmanned platforms for GIS.

See “GIS Unmanned”April 2013 Point of Beginning Magazine

bbbbbbby DDDDDDDevon HHHHHHHumphhhhhhhrey &&&&&&&&&&&&&&&& arronDDDDDD n PPPPPPPPPPPPPPustttttamPPPPPPP

29

Thank you for attending!

copyright 2013 waypoint mapping LLC

Contact info:

Devon HumphreyDevon Humphreydevon@waypointmapping.com@@@@@ yyyyyppppp pppppppppp ggggg

Aerial content provided by

Connect to us on social media to hear about cool new applications

of UAVs for GIS!