From Big Data, to Machine Learning, to AI: A Privacy and ... + Privacy...– What data is being collected, how it is used, what is being inferred – Lack of explanability, possible

USABLE PRIVACY POLICY AND PERSONALIZED PRIVACY ASSISTANT PROJECTS 1Usable Privacy Policy Project

FROM BIG DATA, TO MACHINE LEARNING, TO AI

Copyright,© 2017 Norman Sadeh

From Big Data, to Machine Learning, to AI:

A Privacy and Security Perspective

Norman Sadeh

Carnegie Mellon University

www.normsadeh.org

usableprivacy.org privacyassistant.org

explore.usableprivacy.org

USABLE PRIVACY POLICY AND PERSONALIZED PRIVACY ASSISTANT PROJECTS 2

Understanding the Technologies

• Artificial Intelligence (AI) is a branch of Computer Science– Also a fancy (and still controversial) term to refer to a vast

collection of technologies aimed at emulating, supplementing, and eventually outperforming human intelligence

• From knowledge representation and reasoning, to perception, planning, natural language processing, etc.

• From ”symbolic” (and logic-based) frameworks to neural networks

• Machine Learning is a big part of AI


AI Bragging Rights (Short Selection)

Source: https://www.britannica.com/topic/Deep-Blue Source: Carnegie Mellon University. - Tartan Racing Team

Source: TED BlogSource: http://www.idownloadblog.com/2016/05/27/10-features-i-want-siri-for-mac-to-have/


AI is Everywhere• Navigation• Translation• Scene recognition• Facial expression recognition – incl. recognizing emotions• Autonomous driving, autonomous flying of drones, etc• Speech recognition• Automated trading• Discovering new uses for existing drugs• Analyzing DNA to detect genomic conditions• Detecting crop diseases and predicting crop yield• Product recommendations and personalized search results


Many Security & Privacy Challenges (I)• Software-related challenges

– Lack of software guarantees, perpetual beta, software everywhere, system of systems

• Note: AI and ML can help

• Unique security & safety issues related to AI and ML– Adversarial machine learning, new attack

surfaces, intelligent botnets, etc.– Increased levels of delegation

• Time scales, lack of human-understandable models• Note: AI and ML can help


Many Security & Privacy Challenges (II)• Unique privacy issues related to AI and ML

– What data is being collected, how it is used, what is being inferred

– Lack of explanability, possible bias, etc– Note: AI and ML can help

• Man machine communication challenges– Risk of over-delegating, risk of miscommunication, lack of

accountability…– Note: AI and M can help

• Socio-economic disruptions

• And a variety of doomsday scenarios…


AI Can Also Help Solve Security and Privacy Challenges• Understanding Privacy Policies

• Automating compliance analysis

• Privacy Assistants

• Machine learning to detect intrusion detection

• Machine learning to help train users

• ..And many other techniques I’m not working on


Mobile App Privacy Assistant



Privacy Policies Mobile Apps

Compliance with Privacy Requirements

PolicyAnalysis(MachineLearning)

AppAnalysis(StaticCodeAnalysis)


Concluding Remarks• AI, ML: not intrinsically “good” or “bad” but a

number of challenges and ethical questions– Delegation of control should ideally come with

stronger guarantees (e.g., driving, health, trading, etc.)

– Requires a combination of training (developers and users), technologies, mechanism design, and regulation

• AI/ML can also be part of the solution• Some of these challenges extend to software

in general


The Usable Privacy Policy Project and the Personalized Privacy Assistant Project both involve

collaborations with a number of individuals.See usableprivacy.org and privacyassistant.org for additional details incl. lists of collaborators, publications

and sponsors.

usableprivacy.org

privacyassistant.org

explore.usableprivacy.org

Documents

From Big Data, to Machine Learning, to AI: A Privacy and ... + Privacy...– What data is being collected, how it is used, what is being inferred – Lack of explanability, possible