18
Sensitive and Private Information Filter for Open Data RHoK Global December 2012 Monday, December 3, 2012

SPIF - Sensitive and Private Information Filter

Embed Size (px)

Citation preview

Page 1: SPIF - Sensitive and Private Information Filter

Sensitive and Private Information Filter for

Open Data

RHoK Global December 2012

Monday December 3 2012

The ldquoSPIFrdquo Team

Ali AlshammariBirhanu EsheteMichele Fogarolli

Monday December 3 2012

The Problem

Monday December 3 2012

The ProblembullIndividualOrganization wants to publish an open data

Monday December 3 2012

The ProblembullIndividualOrganization wants to publish an open data

bullBut wants to filter sensitiveprivate information before publishing

Monday December 3 2012

The ProblembullIndividualOrganization wants to publish an open data

bullBut wants to filter sensitiveprivate information before publishing

bullAn App to do the filtering

Monday December 3 2012

Solution Should

Monday December 3 2012

Solution ShouldbullSupport widely used formats (txt csv docx xlsx xml html pdf)

Monday December 3 2012

Solution ShouldbullSupport widely used formats (txt csv docx xlsx xml html pdf)

bullFilter SSNs CCNs IBANs Telephone Numbers

Monday December 3 2012

Solution ShouldbullSupport widely used formats (txt csv docx xlsx xml html pdf)

bullFilter SSNs CCNs IBANs Telephone Numbers

bullSpecific enough to locate sensitive info(page line )

Monday December 3 2012

Our Solution

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Social Security

Credit Card

Bank Account

Telephone

Monday December 3 2012

Demo

Monday December 3 2012

Code Repo

httpsgithubcombirhanumspif

Monday December 3 2012

Page 2: SPIF - Sensitive and Private Information Filter

The ldquoSPIFrdquo Team

Ali AlshammariBirhanu EsheteMichele Fogarolli

Monday December 3 2012

The Problem

Monday December 3 2012

The ProblembullIndividualOrganization wants to publish an open data

Monday December 3 2012

The ProblembullIndividualOrganization wants to publish an open data

bullBut wants to filter sensitiveprivate information before publishing

Monday December 3 2012

The ProblembullIndividualOrganization wants to publish an open data

bullBut wants to filter sensitiveprivate information before publishing

bullAn App to do the filtering

Monday December 3 2012

Solution Should

Monday December 3 2012

Solution ShouldbullSupport widely used formats (txt csv docx xlsx xml html pdf)

Monday December 3 2012

Solution ShouldbullSupport widely used formats (txt csv docx xlsx xml html pdf)

bullFilter SSNs CCNs IBANs Telephone Numbers

Monday December 3 2012

Solution ShouldbullSupport widely used formats (txt csv docx xlsx xml html pdf)

bullFilter SSNs CCNs IBANs Telephone Numbers

bullSpecific enough to locate sensitive info(page line )

Monday December 3 2012

Our Solution

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Social Security

Credit Card

Bank Account

Telephone

Monday December 3 2012

Demo

Monday December 3 2012

Code Repo

httpsgithubcombirhanumspif

Monday December 3 2012

Page 3: SPIF - Sensitive and Private Information Filter

The Problem

Monday December 3 2012

The ProblembullIndividualOrganization wants to publish an open data

Monday December 3 2012

The ProblembullIndividualOrganization wants to publish an open data

bullBut wants to filter sensitiveprivate information before publishing

Monday December 3 2012

The ProblembullIndividualOrganization wants to publish an open data

bullBut wants to filter sensitiveprivate information before publishing

bullAn App to do the filtering

Monday December 3 2012

Solution Should

Monday December 3 2012

Solution ShouldbullSupport widely used formats (txt csv docx xlsx xml html pdf)

Monday December 3 2012

Solution ShouldbullSupport widely used formats (txt csv docx xlsx xml html pdf)

bullFilter SSNs CCNs IBANs Telephone Numbers

Monday December 3 2012

Solution ShouldbullSupport widely used formats (txt csv docx xlsx xml html pdf)

bullFilter SSNs CCNs IBANs Telephone Numbers

bullSpecific enough to locate sensitive info(page line )

Monday December 3 2012

Our Solution

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Social Security

Credit Card

Bank Account

Telephone

Monday December 3 2012

Demo

Monday December 3 2012

Code Repo

httpsgithubcombirhanumspif

Monday December 3 2012

Page 4: SPIF - Sensitive and Private Information Filter

The ProblembullIndividualOrganization wants to publish an open data

Monday December 3 2012

The ProblembullIndividualOrganization wants to publish an open data

bullBut wants to filter sensitiveprivate information before publishing

Monday December 3 2012

The ProblembullIndividualOrganization wants to publish an open data

bullBut wants to filter sensitiveprivate information before publishing

bullAn App to do the filtering

Monday December 3 2012

Solution Should

Monday December 3 2012

Solution ShouldbullSupport widely used formats (txt csv docx xlsx xml html pdf)

Monday December 3 2012

Solution ShouldbullSupport widely used formats (txt csv docx xlsx xml html pdf)

bullFilter SSNs CCNs IBANs Telephone Numbers

Monday December 3 2012

Solution ShouldbullSupport widely used formats (txt csv docx xlsx xml html pdf)

bullFilter SSNs CCNs IBANs Telephone Numbers

bullSpecific enough to locate sensitive info(page line )

Monday December 3 2012

Our Solution

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Social Security

Credit Card

Bank Account

Telephone

Monday December 3 2012

Demo

Monday December 3 2012

Code Repo

httpsgithubcombirhanumspif

Monday December 3 2012

Page 5: SPIF - Sensitive and Private Information Filter

The ProblembullIndividualOrganization wants to publish an open data

bullBut wants to filter sensitiveprivate information before publishing

Monday December 3 2012

The ProblembullIndividualOrganization wants to publish an open data

bullBut wants to filter sensitiveprivate information before publishing

bullAn App to do the filtering

Monday December 3 2012

Solution Should

Monday December 3 2012

Solution ShouldbullSupport widely used formats (txt csv docx xlsx xml html pdf)

Monday December 3 2012

Solution ShouldbullSupport widely used formats (txt csv docx xlsx xml html pdf)

bullFilter SSNs CCNs IBANs Telephone Numbers

Monday December 3 2012

Solution ShouldbullSupport widely used formats (txt csv docx xlsx xml html pdf)

bullFilter SSNs CCNs IBANs Telephone Numbers

bullSpecific enough to locate sensitive info(page line )

Monday December 3 2012

Our Solution

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Social Security

Credit Card

Bank Account

Telephone

Monday December 3 2012

Demo

Monday December 3 2012

Code Repo

httpsgithubcombirhanumspif

Monday December 3 2012

Page 6: SPIF - Sensitive and Private Information Filter

The ProblembullIndividualOrganization wants to publish an open data

bullBut wants to filter sensitiveprivate information before publishing

bullAn App to do the filtering

Monday December 3 2012

Solution Should

Monday December 3 2012

Solution ShouldbullSupport widely used formats (txt csv docx xlsx xml html pdf)

Monday December 3 2012

Solution ShouldbullSupport widely used formats (txt csv docx xlsx xml html pdf)

bullFilter SSNs CCNs IBANs Telephone Numbers

Monday December 3 2012

Solution ShouldbullSupport widely used formats (txt csv docx xlsx xml html pdf)

bullFilter SSNs CCNs IBANs Telephone Numbers

bullSpecific enough to locate sensitive info(page line )

Monday December 3 2012

Our Solution

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Social Security

Credit Card

Bank Account

Telephone

Monday December 3 2012

Demo

Monday December 3 2012

Code Repo

httpsgithubcombirhanumspif

Monday December 3 2012

Page 7: SPIF - Sensitive and Private Information Filter

Solution Should

Monday December 3 2012

Solution ShouldbullSupport widely used formats (txt csv docx xlsx xml html pdf)

Monday December 3 2012

Solution ShouldbullSupport widely used formats (txt csv docx xlsx xml html pdf)

bullFilter SSNs CCNs IBANs Telephone Numbers

Monday December 3 2012

Solution ShouldbullSupport widely used formats (txt csv docx xlsx xml html pdf)

bullFilter SSNs CCNs IBANs Telephone Numbers

bullSpecific enough to locate sensitive info(page line )

Monday December 3 2012

Our Solution

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Social Security

Credit Card

Bank Account

Telephone

Monday December 3 2012

Demo

Monday December 3 2012

Code Repo

httpsgithubcombirhanumspif

Monday December 3 2012

Page 8: SPIF - Sensitive and Private Information Filter

Solution ShouldbullSupport widely used formats (txt csv docx xlsx xml html pdf)

Monday December 3 2012

Solution ShouldbullSupport widely used formats (txt csv docx xlsx xml html pdf)

bullFilter SSNs CCNs IBANs Telephone Numbers

Monday December 3 2012

Solution ShouldbullSupport widely used formats (txt csv docx xlsx xml html pdf)

bullFilter SSNs CCNs IBANs Telephone Numbers

bullSpecific enough to locate sensitive info(page line )

Monday December 3 2012

Our Solution

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Social Security

Credit Card

Bank Account

Telephone

Monday December 3 2012

Demo

Monday December 3 2012

Code Repo

httpsgithubcombirhanumspif

Monday December 3 2012

Page 9: SPIF - Sensitive and Private Information Filter

Solution ShouldbullSupport widely used formats (txt csv docx xlsx xml html pdf)

bullFilter SSNs CCNs IBANs Telephone Numbers

Monday December 3 2012

Solution ShouldbullSupport widely used formats (txt csv docx xlsx xml html pdf)

bullFilter SSNs CCNs IBANs Telephone Numbers

bullSpecific enough to locate sensitive info(page line )

Monday December 3 2012

Our Solution

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Social Security

Credit Card

Bank Account

Telephone

Monday December 3 2012

Demo

Monday December 3 2012

Code Repo

httpsgithubcombirhanumspif

Monday December 3 2012

Page 10: SPIF - Sensitive and Private Information Filter

Solution ShouldbullSupport widely used formats (txt csv docx xlsx xml html pdf)

bullFilter SSNs CCNs IBANs Telephone Numbers

bullSpecific enough to locate sensitive info(page line )

Monday December 3 2012

Our Solution

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Social Security

Credit Card

Bank Account

Telephone

Monday December 3 2012

Demo

Monday December 3 2012

Code Repo

httpsgithubcombirhanumspif

Monday December 3 2012

Page 11: SPIF - Sensitive and Private Information Filter

Our Solution

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Social Security

Credit Card

Bank Account

Telephone

Monday December 3 2012

Demo

Monday December 3 2012

Code Repo

httpsgithubcombirhanumspif

Monday December 3 2012

Page 12: SPIF - Sensitive and Private Information Filter

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Social Security

Credit Card

Bank Account

Telephone

Monday December 3 2012

Demo

Monday December 3 2012

Code Repo

httpsgithubcombirhanumspif

Monday December 3 2012

Page 13: SPIF - Sensitive and Private Information Filter

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Social Security

Credit Card

Bank Account

Telephone

Monday December 3 2012

Demo

Monday December 3 2012

Code Repo

httpsgithubcombirhanumspif

Monday December 3 2012

Page 14: SPIF - Sensitive and Private Information Filter

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Social Security

Credit Card

Bank Account

Telephone

Monday December 3 2012

Demo

Monday December 3 2012

Code Repo

httpsgithubcombirhanumspif

Monday December 3 2012

Page 15: SPIF - Sensitive and Private Information Filter

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Monday December 3 2012

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Social Security

Credit Card

Bank Account

Telephone

Monday December 3 2012

Demo

Monday December 3 2012

Code Repo

httpsgithubcombirhanumspif

Monday December 3 2012

Page 16: SPIF - Sensitive and Private Information Filter

Our Solutiontxt

csv

docx

xlsx

xml

pdf

Social Security

Credit Card

Bank Account

Telephone

Monday December 3 2012

Demo

Monday December 3 2012

Code Repo

httpsgithubcombirhanumspif

Monday December 3 2012

Page 17: SPIF - Sensitive and Private Information Filter

Demo

Monday December 3 2012

Code Repo

httpsgithubcombirhanumspif

Monday December 3 2012

Page 18: SPIF - Sensitive and Private Information Filter

Code Repo

httpsgithubcombirhanumspif

Monday December 3 2012