34
ManaTI Web Assistance for the Threat Analyst, supported by Domain Similarity RAÚL BENÍTEZ NETTO [email protected] Czech Technical University in Prague SEBASTIÁN GARCÍA @Piuliss [email protected] @eldracote https://github.com/stratosphereips/Manati

ManaTI · 2019-11-13 · ManaTI Web Assistance for the Threat Analyst, supported by Domain Similarity ... Web/App developer focus cyber-security environment Photographer aficionado

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: ManaTI · 2019-11-13 · ManaTI Web Assistance for the Threat Analyst, supported by Domain Similarity ... Web/App developer focus cyber-security environment Photographer aficionado

ManaTI Web Assistance for the Threat Analyst,

supported by Domain Similarity

RAÚL BENÍTEZ [email protected]

Czech Technical University in Prague

SEBASTIÁN GARCÍA

@[email protected]

@eldracote

https://github.com/stratosphereips/Manati

Page 2: ManaTI · 2019-11-13 · ManaTI Web Assistance for the Threat Analyst, supported by Domain Similarity ... Web/App developer focus cyber-security environment Photographer aficionado

Stratosphere Projecta free software Intrusion Prevention System

Free protection for NGOs.

Stratosphere Data Analysis Project

https://stratosphereips.org/

Security and MachineLearning

@stratosphereips@StratosphereIPS

Page 3: ManaTI · 2019-11-13 · ManaTI Web Assistance for the Threat Analyst, supported by Domain Similarity ... Web/App developer focus cyber-security environment Photographer aficionado

What and why?

ManaTI is a web-based system toanalyze, store and organize weblogs

faster in a threat analysis team.

Page 4: ManaTI · 2019-11-13 · ManaTI Web Assistance for the Threat Analyst, supported by Domain Similarity ... Web/App developer focus cyber-security environment Photographer aficionado

ManaTI assists threat analysis team tomake their work faster and more

effective

ManaTI Purpose

Page 5: ManaTI · 2019-11-13 · ManaTI Web Assistance for the Threat Analyst, supported by Domain Similarity ... Web/App developer focus cyber-security environment Photographer aficionado

Raúl Benítez NettoMaster Student in CTU

Member of Stratosphere Project

Web/App developer focus cyber-

security environment

Photographer aficionado

[email protected]

@Piuliss

Page 6: ManaTI · 2019-11-13 · ManaTI Web Assistance for the Threat Analyst, supported by Domain Similarity ... Web/App developer focus cyber-security environment Photographer aficionado

Sebastian GarcíaFounder of Stratosphere Project

Creator of Stratosphere IPS

Researcher on cybersecurity using

Machine Learning

[email protected]

@eldracote

Page 7: ManaTI · 2019-11-13 · ManaTI Web Assistance for the Threat Analyst, supported by Domain Similarity ... Web/App developer focus cyber-security environment Photographer aficionado

Basic knowledge

Weblogs

WHOIS information

IoCs (Indicators of Compromise)

Page 8: ManaTI · 2019-11-13 · ManaTI Web Assistance for the Threat Analyst, supported by Domain Similarity ... Web/App developer focus cyber-security environment Photographer aficionado

The art of understanding thetraces of the malware in thenetwork logs.

Analysis ofMalwareBehavior inthe Network

Page 9: ManaTI · 2019-11-13 · ManaTI Web Assistance for the Threat Analyst, supported by Domain Similarity ... Web/App developer focus cyber-security environment Photographer aficionado

Records ofconnections thatmalware perform toconnect with theirC&C

MalwareTraces

Page 10: ManaTI · 2019-11-13 · ManaTI Web Assistance for the Threat Analyst, supported by Domain Similarity ... Web/App developer focus cyber-security environment Photographer aficionado

Threat Analyst work

Openweblogs

filtering andsearching

Consult DB ofReputationsindicators

Identifyingpatterns

IdentifyMalware

IncidentReport

Labels IoCs

Page 11: ManaTI · 2019-11-13 · ManaTI Web Assistance for the Threat Analyst, supported by Domain Similarity ... Web/App developer focus cyber-security environment Photographer aficionado

Tools used byThreat Analysts

Logs Viewer

Log ParserApache Log ViewerLogExpert

Terminal/Console

VIM/VIWC (Word Count)AWKGREP

Big Data analysis

splunk.com

Page 12: ManaTI · 2019-11-13 · ManaTI Web Assistance for the Threat Analyst, supported by Domain Similarity ... Web/App developer focus cyber-security environment Photographer aficionado

Problems inThreat Analysis

Huge amount of Data Labeling Data

Repetitive tasks Much Knowledgelost over time

It is difficult and tiresome

Page 13: ManaTI · 2019-11-13 · ManaTI Web Assistance for the Threat Analyst, supported by Domain Similarity ... Web/App developer focus cyber-security environment Photographer aficionado

ManaTI principles

https://github.com/stratosphereips/Manati

Fast!

Provide Assistance

Storage Work in teams

GUI - Web

Machine LearningAlgorithm

API - Class Interface

Page 14: ManaTI · 2019-11-13 · ManaTI Web Assistance for the Threat Analyst, supported by Domain Similarity ... Web/App developer focus cyber-security environment Photographer aficionado

ManaTI Workflow

Page 15: ManaTI · 2019-11-13 · ManaTI Web Assistance for the Threat Analyst, supported by Domain Similarity ... Web/App developer focus cyber-security environment Photographer aficionado

ManaTI basic featuresand usability

Page 16: ManaTI · 2019-11-13 · ManaTI Web Assistance for the Threat Analyst, supported by Domain Similarity ... Web/App developer focus cyber-security environment Photographer aficionado

Analysis Sessions andMulti-users

Page 17: ManaTI · 2019-11-13 · ManaTI Web Assistance for the Threat Analyst, supported by Domain Similarity ... Web/App developer focus cyber-security environment Photographer aficionado

BasicInterface

GUI to vizualise weblogs files.Basic table to paginate, filterand search weblog data

Page 19: ManaTI · 2019-11-13 · ManaTI Web Assistance for the Threat Analyst, supported by Domain Similarity ... Web/App developer focus cyber-security environment Photographer aficionado

WeblogsLabelling

It is the basic and more importantaction for a malware behavioranalyst. Detect malicious IoCs

Page 21: ManaTI · 2019-11-13 · ManaTI Web Assistance for the Threat Analyst, supported by Domain Similarity ... Web/App developer focus cyber-security environment Photographer aficionado

Exporting Dynamic Table

Page 22: ManaTI · 2019-11-13 · ManaTI Web Assistance for the Threat Analyst, supported by Domain Similarity ... Web/App developer focus cyber-security environment Photographer aficionado

Comments

Page 23: ManaTI · 2019-11-13 · ManaTI Web Assistance for the Threat Analyst, supported by Domain Similarity ... Web/App developer focus cyber-security environment Photographer aficionado

History of changes

Page 24: ManaTI · 2019-11-13 · ManaTI Web Assistance for the Threat Analyst, supported by Domain Similarity ... Web/App developer focus cyber-security environment Photographer aficionado

Third-partyintelligencetools

The threat analysts often use severalexternal services to know about theIoCs

Page 25: ManaTI · 2019-11-13 · ManaTI Web Assistance for the Threat Analyst, supported by Domain Similarity ... Web/App developer focus cyber-security environment Photographer aficionado

Statistics andMetrics

See in real time theperfomance progress of theuser

Page 26: ManaTI · 2019-11-13 · ManaTI Web Assistance for the Threat Analyst, supported by Domain Similarity ... Web/App developer focus cyber-security environment Photographer aficionado

ExternalModulesManaTI allows analysts tocreate their own scriptsand modules to increasethe number of labels orweblogs analyzed in aperiod of time

Page 27: ManaTI · 2019-11-13 · ManaTI Web Assistance for the Threat Analyst, supported by Domain Similarity ... Web/App developer focus cyber-security environment Photographer aficionado

Sync with Database -Merging Labels

Weblog Merging Labels

Page 28: ManaTI · 2019-11-13 · ManaTI Web Assistance for the Threat Analyst, supported by Domain Similarity ... Web/App developer focus cyber-security environment Photographer aficionado

WHOIS SimilarityDistance Algorithm

How similar are twodomains ?

WHOIS fields Domain A Domain B Distance

registrar’s name MARKMONITOR INC. MARKMONITOR IN 0.0

contact’s name. DNS Admin DomainAdministrator

13.0

org.’s name Google Inc. Facebook, Inc. 8.0

contacts emails [email protected]

[[email protected]] 11.0

zip code 94043 94025 2.0

domain’s name google.com facebook.com 8.0

duration in days 8401 10229 0.82

servers’ name [ns1.google.com,...] [a.ns.facebook.com...]

11.0

Page 29: ManaTI · 2019-11-13 · ManaTI Web Assistance for the Threat Analyst, supported by Domain Similarity ... Web/App developer focus cyber-security environment Photographer aficionado

WHOIS Similarity DistanceAlgorithm

Page 30: ManaTI · 2019-11-13 · ManaTI Web Assistance for the Threat Analyst, supported by Domain Similarity ... Web/App developer focus cyber-security environment Photographer aficionado

https://github.com/stratosphereips/whois-similarity-distance

How to determine is twodomains are related?

Machine Learning ?

WHOIS Similarity DistanceAlgorithm

Page 31: ManaTI · 2019-11-13 · ManaTI Web Assistance for the Threat Analyst, supported by Domain Similarity ... Web/App developer focus cyber-security environment Photographer aficionado

ManaTIContributions

All-in-one with Web interface

A scalable and extensible backend server

A novel WHOIS distance measure

Verification of performance improvements

Page 32: ManaTI · 2019-11-13 · ManaTI Web Assistance for the Threat Analyst, supported by Domain Similarity ... Web/App developer focus cyber-security environment Photographer aficionado

Future of ManaTIImproving WHOIS Similarity Distance

IOCs labeling

Import/Export labelled IOCs

Integration with Stratosphere IPS

Add more types of files

Malware Detection

Active learning

Community Ideas

Page 33: ManaTI · 2019-11-13 · ManaTI Web Assistance for the Threat Analyst, supported by Domain Similarity ... Web/App developer focus cyber-security environment Photographer aficionado

Conclusion

ManaTI : is a novel tool to facilitate the work

is high functional scalable

user-friendly

can increase the weblogs labelling speed x3.4

OpenSource !

Page 34: ManaTI · 2019-11-13 · ManaTI Web Assistance for the Threat Analyst, supported by Domain Similarity ... Web/App developer focus cyber-security environment Photographer aficionado

Thank you!

RAÚL BENÍTEZ NETTO

[email protected]

SEBASTIÁN GARCÍA

@Piuliss

[email protected]

@eldracote

ManaTI Project

https://github.com/stratosphereips/Manati

[email protected]