20
1 Effective Acquaintance Management for Collaborative Intrusion Detection Networks Carol Fung, Jie Zhang, and Raouf Boutaba David R. Cheriton School of Computer Science, University of Waterloo 16th International Conference on Network and Service Management 2010

Effective Acquaintance Management for Collaborative ...rboutaba.cs.uwaterloo.ca/Papers/Conferences/2010/... · Acquaintance Management for CIDN 9 Know the Candidates • Learn the

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Effective Acquaintance Management for Collaborative ...rboutaba.cs.uwaterloo.ca/Papers/Conferences/2010/... · Acquaintance Management for CIDN 9 Know the Candidates • Learn the

1

Effective Acquaintance

Management for Collaborative

Intrusion Detection Networks

Carol Fung, Jie Zhang, and Raouf Boutaba

David R. Cheriton School of Computer Science,

University of Waterloo

16th International Conference on Network

and Service Management 2010

Page 2: Effective Acquaintance Management for Collaborative ...rboutaba.cs.uwaterloo.ca/Papers/Conferences/2010/... · Acquaintance Management for CIDN 9 Know the Candidates • Learn the

Acquaintance Management for CIDN 2

Roadmap

• Background

• Intrusion Detection and Collaboration

• Acquaintance Management

• Evaluation

• Conclusion

Page 3: Effective Acquaintance Management for Collaborative ...rboutaba.cs.uwaterloo.ca/Papers/Conferences/2010/... · Acquaintance Management for CIDN 9 Know the Candidates • Learn the

Acquaintance Management for CIDN 3

Network Intrusions

• Worms, Viruses, Malware

– Storm worm (2007)

– Conflicker (2008)

• Botnet

– Zeus (2007-2010)

• Attack motivation

– ID theft, Credit card , Privacy spying, Online

account , Spamming, DoS, etc.

Page 4: Effective Acquaintance Management for Collaborative ...rboutaba.cs.uwaterloo.ca/Papers/Conferences/2010/... · Acquaintance Management for CIDN 9 Know the Candidates • Learn the

Acquaintance Management for CIDN 4

Intrusion Detection Systems

• Network-based

• Host-based

Computer activities

System logs

Files system

Network traffic

Page 5: Effective Acquaintance Management for Collaborative ...rboutaba.cs.uwaterloo.ca/Papers/Conferences/2010/... · Acquaintance Management for CIDN 9 Know the Candidates • Learn the

Acquaintance Management for CIDN 5

Host-based IDS (HIDS)

• Monitor computer activities, files, and

compare against malicious patterns

– Traditional HIDS such as OSSEC, Tripwire

– Antivirus systems

• A single HIDS can be vulnerable to new

attacks

– Collaboration improves detection accuracy

Page 6: Effective Acquaintance Management for Collaborative ...rboutaba.cs.uwaterloo.ca/Papers/Conferences/2010/... · Acquaintance Management for CIDN 9 Know the Candidates • Learn the

Acquaintance Management for CIDN 6

Alarm

Collaborative Intrusion Detection

• Information sharing (DShield, NetShield)

• Expertise sharing (Cloud-AV)

ObservationDiagnosisObservationObservation

Information Sharing

Type1

Type2

Alarm

Expertise Sharing

Alarm

Page 7: Effective Acquaintance Management for Collaborative ...rboutaba.cs.uwaterloo.ca/Papers/Conferences/2010/... · Acquaintance Management for CIDN 9 Know the Candidates • Learn the

Acquaintance Management for CIDN 7

Who to collaborate with?

• Existing solutions

– Fixed number

– Fixed thresh-bar

• Our Contribution

– An automatic acquaintance management

– Cost efficient acquaintance selection

Page 8: Effective Acquaintance Management for Collaborative ...rboutaba.cs.uwaterloo.ca/Papers/Conferences/2010/... · Acquaintance Management for CIDN 9 Know the Candidates • Learn the

Acquaintance Management for CIDN 8

Our Approach

Step 1: Know your candidates

Step 2: Cost function modeling

Step 3: Consensus reaching

Page 9: Effective Acquaintance Management for Collaborative ...rboutaba.cs.uwaterloo.ca/Papers/Conferences/2010/... · Acquaintance Management for CIDN 9 Know the Candidates • Learn the

Acquaintance Management for CIDN 9

Know the Candidates

• Learn the quality of a candidate

– False positive rate and True positive rate

– Using test messages to gain experience

– Bayesian learning

11)1(

),(

1~

−− − βα

βαxx

BF

Distribution of False Positive rateBeta function

Cumulative evidences

on false diagnosis

Cumulative evidences

on true diagnosis

Page 10: Effective Acquaintance Management for Collaborative ...rboutaba.cs.uwaterloo.ca/Papers/Conferences/2010/... · Acquaintance Management for CIDN 9 Know the Candidates • Learn the

Acquaintance Management for CIDN 10

Cost Function Selection

• Cost on maintenance of collaborators

– Increases with the number of collaborators

• Cost on false decisions

– Cost of false positive and false negative decisions

∑ ∏∏Α∈

−− −−

+Α=

Α+Α=

||}1,0{

1

0

1

1 })1(,)1(min{

||

)()(

y i

y

i

y

ifp

y

i

i

y

ifn

m

total

iiii FFCTTC

C

RMC

ππ

Maintenance cost

Cost on raising alarmCost on no alarm

Page 11: Effective Acquaintance Management for Collaborative ...rboutaba.cs.uwaterloo.ca/Papers/Conferences/2010/... · Acquaintance Management for CIDN 9 Know the Candidates • Learn the

Acquaintance Management for CIDN 11

Acquaintance Selection Algorithm

Algorithm1: Select the optimal acquaintance list with minimal cost

- Brute Force for a short candidate list and greedy for a

long candidate list

Algorithm2: Acquaintance management to find mutual agreement among nodes

- Probation period

- Collaboration connection is established only if both

peers select each other

Page 12: Effective Acquaintance Management for Collaborative ...rboutaba.cs.uwaterloo.ca/Papers/Conferences/2010/... · Acquaintance Management for CIDN 9 Know the Candidates • Learn the

Acquaintance Management for CIDN 12

Evaluation - Cost Efficiency

Page 13: Effective Acquaintance Management for Collaborative ...rboutaba.cs.uwaterloo.ca/Papers/Conferences/2010/... · Acquaintance Management for CIDN 9 Know the Candidates • Learn the

Acquaintance Management for CIDN 13

Evaluation - Convergence

Page 14: Effective Acquaintance Management for Collaborative ...rboutaba.cs.uwaterloo.ca/Papers/Conferences/2010/... · Acquaintance Management for CIDN 9 Know the Candidates • Learn the

Acquaintance Management for CIDN 14

Evaluation - Stability

Page 15: Effective Acquaintance Management for Collaborative ...rboutaba.cs.uwaterloo.ca/Papers/Conferences/2010/... · Acquaintance Management for CIDN 9 Know the Candidates • Learn the

Acquaintance Management for CIDN 15

Evaluation – Incentive Compatibility

Page 16: Effective Acquaintance Management for Collaborative ...rboutaba.cs.uwaterloo.ca/Papers/Conferences/2010/... · Acquaintance Management for CIDN 9 Know the Candidates • Learn the

Acquaintance Management for CIDN 16

Conclusion

• Proposed an automatic acquaintance

selection algorithm for collaborative

intrusion detection networks

• Find optimal acquaintance list which leads

to the minimum cost

• The acquaintance management algorithm

holds the properties of efficiency, stability,

and incentive-compatibility

Page 17: Effective Acquaintance Management for Collaborative ...rboutaba.cs.uwaterloo.ca/Papers/Conferences/2010/... · Acquaintance Management for CIDN 9 Know the Candidates • Learn the

Acquaintance Management for CIDN 17

Thank YouThank YouThank YouThank You

Page 18: Effective Acquaintance Management for Collaborative ...rboutaba.cs.uwaterloo.ca/Papers/Conferences/2010/... · Acquaintance Management for CIDN 9 Know the Candidates • Learn the

Acquaintance Management for CIDN 18

Page 19: Effective Acquaintance Management for Collaborative ...rboutaba.cs.uwaterloo.ca/Papers/Conferences/2010/... · Acquaintance Management for CIDN 9 Know the Candidates • Learn the

Acquaintance Management for CIDN 19

Page 20: Effective Acquaintance Management for Collaborative ...rboutaba.cs.uwaterloo.ca/Papers/Conferences/2010/... · Acquaintance Management for CIDN 9 Know the Candidates • Learn the

Acquaintance Management for CIDN 20

Bayesian Learning

False Positive Rate0 1

3

1

2

4

1== βα 1 2 == βα 2 2 == βα 5 2 == βα 10 2 == βα

α: Cumulative evidences on false diagnosis

β: Cumulative evidences on true diagnosis