39
1 CSE 4705 Artificial Intelligence Jinbo Bi Department of Computer Science & Engineering http://www.engr.uconn.edu/~jinbo

CMPUT 650: Learning To Make Decisionsjinbo/courses/AI_Spring2015/AI_Spring2015_lec… · Department of Computer Science & Engineering jinbo . The Instructor ... • Contact: jinbo@

  • Upload
    vandiep

  • View
    215

  • Download
    0

Embed Size (px)

Citation preview

Page 1: CMPUT 650: Learning To Make Decisionsjinbo/courses/AI_Spring2015/AI_Spring2015_lec… · Department of Computer Science & Engineering jinbo . The Instructor ... • Contact: jinbo@

1

CSE 4705

Artificial Intelligence

Jinbo Bi

Department of Computer Science & Engineering

http://www.engr.uconn.edu/~jinbo

Page 2: CMPUT 650: Learning To Make Decisionsjinbo/courses/AI_Spring2015/AI_Spring2015_lec… · Department of Computer Science & Engineering jinbo . The Instructor ... • Contact: jinbo@

The Instructor • Ph.D. in Mathematics

• Working experience

• Siemens Medical Solutions

• Department of Defense, Bioinformatics

• UConn, CSE

• Contact: jinbo@ engr.uconn.edu, 486-1458 (office phone)

• Research Interests:

• Machine learning, Computer vision, Bioinformatics

• Apply machine learning techniques in bio medical informatics

• Help doctors to find better therapy to cure disease

subtyping GWAS

Color of flowers

Cancer, Psychiatric

disorders, …

http://labhealthinfo.uconn.edu/Ea

syBreathing

Page 3: CMPUT 650: Learning To Make Decisionsjinbo/courses/AI_Spring2015/AI_Spring2015_lec… · Department of Computer Science & Engineering jinbo . The Instructor ... • Contact: jinbo@

3

Today

Organizational details

Purpose of the course

Material coverage

Introduction of AI

Page 4: CMPUT 650: Learning To Make Decisionsjinbo/courses/AI_Spring2015/AI_Spring2015_lec… · Department of Computer Science & Engineering jinbo . The Instructor ... • Contact: jinbo@

4

Course Syllabus

Go over syllabus carefully, and keep a copy of it

Course website

http://www.engr.uconn.edu/~jinbo/Spring2015_Ar

tificial_Intelligence.htm

Page 5: CMPUT 650: Learning To Make Decisionsjinbo/courses/AI_Spring2015/AI_Spring2015_lec… · Department of Computer Science & Engineering jinbo . The Instructor ... • Contact: jinbo@

5

Instructor and TAs

My office hours Tue 1 – 3pm

Office Rm: ITE Building 233

Two TAs Xingyu Cai ([email protected])

office hours Fri 2-3pm, contact him for the place to meet

Xia Xiao ([email protected])

office hours Fri 2-3pm, ITEB 221

Page 6: CMPUT 650: Learning To Make Decisionsjinbo/courses/AI_Spring2015/AI_Spring2015_lec… · Department of Computer Science & Engineering jinbo . The Instructor ... • Contact: jinbo@

6

Required Textbook

Attending the lectures is highly encouraged, and lectures highlight some examples

Attending lectures is not a substitute for reading the text

Read the text in Chap 1 – 9, because we follow them tightly

Page 7: CMPUT 650: Learning To Make Decisionsjinbo/courses/AI_Spring2015/AI_Spring2015_lec… · Department of Computer Science & Engineering jinbo . The Instructor ... • Contact: jinbo@

7

Optional Textbooks

These textbooks cover some of the most popular and fast-growing sub-areas of AI

Page 8: CMPUT 650: Learning To Make Decisionsjinbo/courses/AI_Spring2015/AI_Spring2015_lec… · Department of Computer Science & Engineering jinbo . The Instructor ... • Contact: jinbo@

8

Prerequisite

Good knowledge of programming

Data structures

Algorithm and complexity

Introductory probability and statistics

Logic (discrete math)

Page 9: CMPUT 650: Learning To Make Decisionsjinbo/courses/AI_Spring2015/AI_Spring2015_lec… · Department of Computer Science & Engineering jinbo . The Instructor ... • Contact: jinbo@

9

Slides

We do not always have slides for later lecture

We use more lecture notes than slides

Slides will be used to demonstrate, and will be available at HuskyCT after the lecture

Page 10: CMPUT 650: Learning To Make Decisionsjinbo/courses/AI_Spring2015/AI_Spring2015_lec… · Department of Computer Science & Engineering jinbo . The Instructor ... • Contact: jinbo@

10

Marking Scheme

3 HW assignments: 30% (programming based, and require time to complete)

1 Midterm: 30%

1 Final Term project: 40%

Curved

Curve is tuned to the final overall distribution

No pre-set passing percentage

Page 11: CMPUT 650: Learning To Make Decisionsjinbo/courses/AI_Spring2015/AI_Spring2015_lec… · Department of Computer Science & Engineering jinbo . The Instructor ... • Contact: jinbo@

11

Grading Arrangement

Xingyu Cai (BECAT A22)

Responsible for

HW 1

Mid-term exam

Final term projects

Xia Xiao (ITEB 221)

Responsible for

HW 2

HW 3

Please find the right TA for specific questions

Page 12: CMPUT 650: Learning To Make Decisionsjinbo/courses/AI_Spring2015/AI_Spring2015_lec… · Department of Computer Science & Engineering jinbo . The Instructor ... • Contact: jinbo@

12

Questions?

Page 13: CMPUT 650: Learning To Make Decisionsjinbo/courses/AI_Spring2015/AI_Spring2015_lec… · Department of Computer Science & Engineering jinbo . The Instructor ... • Contact: jinbo@

13

In-Class Participation

Finding errors in my lecture notes

Answering my questions and asking questions

Come present your progress on term projects

Page 14: CMPUT 650: Learning To Make Decisionsjinbo/courses/AI_Spring2015/AI_Spring2015_lec… · Department of Computer Science & Engineering jinbo . The Instructor ... • Contact: jinbo@

14

Material Coverage

Two sets of topics:

classic versus state-of-the-art

Weeks 1 - 9:

Intelligent agents

Searching, informed searching

Constraint satisfaction problems

Logical agents

First-order logic

Read text chap 1-9 in the required textbook

Page 15: CMPUT 650: Learning To Make Decisionsjinbo/courses/AI_Spring2015/AI_Spring2015_lec… · Department of Computer Science & Engineering jinbo . The Instructor ... • Contact: jinbo@

15

Material Coverage

Two sets of topics:

classic versus state-of-the-art

Weeks 10 - 14:

Basics in learning (supervised vs. unsupervised learning)

Support vector machines

Artificial neural networks

These largely come from the optional textbooks, will give slides to read

Page 16: CMPUT 650: Learning To Make Decisionsjinbo/courses/AI_Spring2015/AI_Spring2015_lec… · Department of Computer Science & Engineering jinbo . The Instructor ... • Contact: jinbo@

16

Course Evaluation

Classic topics for weeks 1-9

3 HW assignments and 1 mid-term

60% of the final grade

Machine learning topics for weeks 10-14

A substantial term project

40% of the final grade

Page 17: CMPUT 650: Learning To Make Decisionsjinbo/courses/AI_Spring2015/AI_Spring2015_lec… · Department of Computer Science & Engineering jinbo . The Instructor ... • Contact: jinbo@

17

Assignments

Each will have 4-10 problems from the textbook (not all problems need coding)

Solutions will be published at HuskCT when grades are returned

Each assignment will be given 1-2 weeks to complete, and grades will be returned 1 week after turn in

Page 18: CMPUT 650: Learning To Make Decisionsjinbo/courses/AI_Spring2015/AI_Spring2015_lec… · Department of Computer Science & Engineering jinbo . The Instructor ... • Contact: jinbo@

18

Term Projects

Substantial projects require teamwork. Teams of 4-6 students should formed.

Each team needs to present at class their project progress

Each team needs to submit a final report together with necessary codes/results for grading

Page 19: CMPUT 650: Learning To Make Decisionsjinbo/courses/AI_Spring2015/AI_Spring2015_lec… · Department of Computer Science & Engineering jinbo . The Instructor ... • Contact: jinbo@

19

Term Projects

Three projects will be designed All from real-world AI applications

Specifically big data applications

1) Drug discovery (computational biology)

2) Disease understanding - Alzheimer’s Disease from images

3) Robotics – learning to move Sarcos robot arm

Page 20: CMPUT 650: Learning To Make Decisionsjinbo/courses/AI_Spring2015/AI_Spring2015_lec… · Department of Computer Science & Engineering jinbo . The Instructor ... • Contact: jinbo@

20

Term Projects

Involve learning the background by reading 1-2 papers

Involve programming with any of the following languages/packages

Java

Python

Matlab

Or existing ML packages written in these languages

Page 21: CMPUT 650: Learning To Make Decisionsjinbo/courses/AI_Spring2015/AI_Spring2015_lec… · Department of Computer Science & Engineering jinbo . The Instructor ... • Contact: jinbo@

21

Questions?

Page 22: CMPUT 650: Learning To Make Decisionsjinbo/courses/AI_Spring2015/AI_Spring2015_lec… · Department of Computer Science & Engineering jinbo . The Instructor ... • Contact: jinbo@

22

Why This Course?

A lot to list

Let us say

“This course will teach us foundational knowledge of AI, so later we can do research on top of it to

1. build intelligent agents (robots, search engines etc.

2. understand human intelligence

3. handle massive BIG DATA

… … … “ Exemplar systems …..

Page 23: CMPUT 650: Learning To Make Decisionsjinbo/courses/AI_Spring2015/AI_Spring2015_lec… · Department of Computer Science & Engineering jinbo . The Instructor ... • Contact: jinbo@

23

I want to design a machine that will be proud of me – Danny Hillis

Page 24: CMPUT 650: Learning To Make Decisionsjinbo/courses/AI_Spring2015/AI_Spring2015_lec… · Department of Computer Science & Engineering jinbo . The Instructor ... • Contact: jinbo@

24

DARPA Grand Challenge 2005 (driverless car competition)

Stanley won

Page 25: CMPUT 650: Learning To Make Decisionsjinbo/courses/AI_Spring2015/AI_Spring2015_lec… · Department of Computer Science & Engineering jinbo . The Instructor ... • Contact: jinbo@

25

DARPA Urban Challenge 2007 (driverless car competition)

http://archive.darpa.mil/gr

andchallenge/

Page 26: CMPUT 650: Learning To Make Decisionsjinbo/courses/AI_Spring2015/AI_Spring2015_lec… · Department of Computer Science & Engineering jinbo . The Instructor ... • Contact: jinbo@

26

Significant advances in NLP

Page 27: CMPUT 650: Learning To Make Decisionsjinbo/courses/AI_Spring2015/AI_Spring2015_lec… · Department of Computer Science & Engineering jinbo . The Instructor ... • Contact: jinbo@

27

Page 28: CMPUT 650: Learning To Make Decisionsjinbo/courses/AI_Spring2015/AI_Spring2015_lec… · Department of Computer Science & Engineering jinbo . The Instructor ... • Contact: jinbo@

28

Search engines

Google search engine

Amazon (online purchase with product recommendation)

Netflix (recommender systems)

Page 29: CMPUT 650: Learning To Make Decisionsjinbo/courses/AI_Spring2015/AI_Spring2015_lec… · Department of Computer Science & Engineering jinbo . The Instructor ... • Contact: jinbo@

29

BIG DATA

Big data emerged from biology, engineering, social science, almost everywhere

Page 30: CMPUT 650: Learning To Make Decisionsjinbo/courses/AI_Spring2015/AI_Spring2015_lec… · Department of Computer Science & Engineering jinbo . The Instructor ... • Contact: jinbo@

30

BIG DATA Big data emerged from biology, engineering, social science, almost every discipline

For instance, Biology: the big challenges of big data, Nature 498, 255-260, 2013

Need powerful computers

to handle data traffic jams

Most importantly, need AI techniques to learn and discover knowledge from data.

Page 31: CMPUT 650: Learning To Make Decisionsjinbo/courses/AI_Spring2015/AI_Spring2015_lec… · Department of Computer Science & Engineering jinbo . The Instructor ... • Contact: jinbo@

31

What is AI

Views of AI fall into four categories

We focus on “acting rationally”

Page 32: CMPUT 650: Learning To Make Decisionsjinbo/courses/AI_Spring2015/AI_Spring2015_lec… · Department of Computer Science & Engineering jinbo . The Instructor ... • Contact: jinbo@

32

Acting humanly (Turing test)

Λ

Page 35: CMPUT 650: Learning To Make Decisionsjinbo/courses/AI_Spring2015/AI_Spring2015_lec… · Department of Computer Science & Engineering jinbo . The Instructor ... • Contact: jinbo@

35

Thinking humanly (cognitive modeling)

Page 36: CMPUT 650: Learning To Make Decisionsjinbo/courses/AI_Spring2015/AI_Spring2015_lec… · Department of Computer Science & Engineering jinbo . The Instructor ... • Contact: jinbo@

36

Thinking rationally (laws of thought)

Page 37: CMPUT 650: Learning To Make Decisionsjinbo/courses/AI_Spring2015/AI_Spring2015_lec… · Department of Computer Science & Engineering jinbo . The Instructor ... • Contact: jinbo@

37

Acting rationally (rational agents)

Page 38: CMPUT 650: Learning To Make Decisionsjinbo/courses/AI_Spring2015/AI_Spring2015_lec… · Department of Computer Science & Engineering jinbo . The Instructor ... • Contact: jinbo@

38

Human has much stronger perception than computers

Can you see a dalmation dog?

Page 39: CMPUT 650: Learning To Make Decisionsjinbo/courses/AI_Spring2015/AI_Spring2015_lec… · Department of Computer Science & Engineering jinbo . The Instructor ... • Contact: jinbo@

39

Survey?