Be a #DroneDETECTIVE

AAUS RPAS in Australian Skies 2019, Canberra.

• Remote sensing scientist working in spatial science fields for 17 years,

• Worked closely with the European Commission, Joint Research Centre

(JRC) testing the use of drones (fixed wing and rotor) for applications

of drones in support of the European Common Agricultural Policy

(CAP) Control with Remote Sensing

• Started own company in 2010

• Certified Drone operator

• “Woman to Watch in UAS 2018’ selected globally from 388 women. Each woman is selected as the global leader in a drone field .

• DroneREGIM works in collaboration with EASA (European Aviation

Security Agency) and EC for the harmonisation of drone regulation

implementation. (Regulatory Oversight & Enforcement’ and ‘Drone

Registration Database ).

Rapid Drone Reporting tool to easily report

bad drone activity in 4 fast steps.

Global reporting system optimized for

mobile devices.

Free access to the public for reporting.

End result: a valuable evidence-based

report to aid authorities in investigation.

Global Rapid Drone Reporting

Over 100 global drone laws available.

Global No-Fly-Zones (aerodromes, utilites,

correctional facilities, stadiums, military bases

and NP)

Users can select a region, click on the

country flag and see drone laws

Click on a no fly zone and the country drone law is shown.

Global Drone Laws and No-fly-Zones

How authorities use DroneALERT• A valuable evidence-based report is sent to the

authorities to aid investigation.

• Investigators can use evidence from reports to

triangulate drone position and build a scene of the

incident.

• Gather witness ‘statements’ and photographic

evidence from report.

• Identify other methods of evidence sources (CCTV

etc)

• Customised Twitter feed allows authorities to easily

search for more evidence on social media

#DRONEDETECTIVE

Artificial Intelligence

Researching the feasibility of

detecting a drone from social

media sources

• Can AI successfully ID drones from

social media?

• Social media is a valuable source

of supporting evidence. Society

likes to ‘post’.

• Evidence for drone investigations

can also be given directly as

videos/images.

• Finding and/or processing such

data can be resource intensive

and specialised.

AIM

• Gather videos of drones flying from

social media (Youtube, Twitter,

home video).

• Day and night footage and static

images of numerous drone models

and angles.

• Classify imagery of a drone

• Develop and train AI model.

• … see what happens…

METHOD

• Automatic image extraction every 10 sec

or 1 sec from social media videos.

• Manual sorting of images and

classification. (bounding box)

• AI model open source (pre-trained),

trained/custom data and run on test

data.

What happened?...Imagery/data collection

Drone Model Day Imagery

Night

Imagery Video non std mod

DJI Mavic seriers X X X X

DJI Spark series X X

DJI Phantom series X X X X

DJI Matric series X X X X

DJI Inspire series X X X X

DJI S1000 series X X X

DJI MG1 Series X X X

DJI F550 Naza X X X

Parrot bebop series X X

Parrot ANAFI X X

Yuneec MantisQ X X

SG 900 GPS FVP RC drone X X

ZLRC Beast SG906 X X

Hubsan quadcopter X

• AI model YOLOv3 using darknet deep

learning framework pretrained on

classification of ImageNet database.

• Applied Transfer learning method:

model pre-training over the millions of

labeled images and fine-tuned to

specific category…ie drones

• AI training on 4000 labeled drone

images.

• AI test data taken from flight video of

drone incidents and research.

What happened?...AI model

YOLOv3/darknet

Original image

Drone AI detection

• Initial stages of training the AI have been positive, however all AI needs to

be trained further to obtain better results.

• 200.000 epochs of training on nVidia GP100

• best detection at ~50.000 epochs.

• Day time ok…Night time detection needs work. but…

Results

Deep learning is data hungry!

• AI can be trained to detect drones from social

media.

• Lack of available data sets.

• Future: Continue to build a dataset of drones

from social media.

• Future: continue to train AI to detect drone

• Future…future: drone type & malicious items.

Conclusions & Future steps

• Disbelief of the technical

capabilities of the drone

• Hotting up ya drone

• Break the drone..for fun…

• New sports: Drone fishing. Drone

fighting

• Demographic: males, 35-50 age

Be a #DroneDETECTIVE

@Drone_ALERT

#DroneDETECTIVE

info@drone-detectives.com

https://www.drone-detectives.com