14
Visual Sequences IQ Tests 1 Dipendra Kumar Misra (Y9201) Mukul Singh (Y9350) Tags : Search, Pattern Recognition, Logic etc Advisor : Dr. Amitabh Mukherjee Dr. Sumit Gulwani

Visual Sequences IQ Tests 1 Dipendra Kumar Misra (Y9201) Mukul Singh (Y9350) Tags : Search, Pattern Recognition, Logic etc Advisor : Dr. Amitabh Mukherjee

Embed Size (px)

Citation preview

Page 1: Visual Sequences IQ Tests 1 Dipendra Kumar Misra (Y9201) Mukul Singh (Y9350) Tags : Search, Pattern Recognition, Logic etc Advisor : Dr. Amitabh Mukherjee

1

Visual SequencesIQ Tests

Dipendra Kumar Misra (Y9201) Mukul Singh (Y9350)

Tags : Search, Pattern Recognition, Logic etc

Advisor : Dr. Amitabh Mukherjee Dr. Sumit Gulwani

Page 2: Visual Sequences IQ Tests 1 Dipendra Kumar Misra (Y9201) Mukul Singh (Y9350) Tags : Search, Pattern Recognition, Logic etc Advisor : Dr. Amitabh Mukherjee

2

Sample Problem

Which Image logically follows the Input Sequence

Page 3: Visual Sequences IQ Tests 1 Dipendra Kumar Misra (Y9201) Mukul Singh (Y9350) Tags : Search, Pattern Recognition, Logic etc Advisor : Dr. Amitabh Mukherjee

3

Motivation

• Automate Manual Verification of Intelligence Problems

• Synthesis of IQ Problems

• Insights into cognitive studies

• Visual Problems combine both Logic and Geometry

Page 4: Visual Sequences IQ Tests 1 Dipendra Kumar Misra (Y9201) Mukul Singh (Y9350) Tags : Search, Pattern Recognition, Logic etc Advisor : Dr. Amitabh Mukherjee

4

Background Work

• IQ problems have been studied for a long time

• Fanya Montalvo [1986, 1993] discusses topics such as Diagram Understanding

• “It will be hard for a computer program to solve picture problems” – Sanghi & Dowe

Page 5: Visual Sequences IQ Tests 1 Dipendra Kumar Misra (Y9201) Mukul Singh (Y9350) Tags : Search, Pattern Recognition, Logic etc Advisor : Dr. Amitabh Mukherjee

5

Case Study

• No Formal Definition of IQ problems

• Separate Semantic Based problems from Syntax Based problems

• Case Study on over 100 problems from standard books and online tests

Page 6: Visual Sequences IQ Tests 1 Dipendra Kumar Misra (Y9201) Mukul Singh (Y9350) Tags : Search, Pattern Recognition, Logic etc Advisor : Dr. Amitabh Mukherjee

6

Our Intuition

“A Transformation Language with few transformations like Rotation and Shading should be powerful enough to cover a large subset of problems”

Page 7: Visual Sequences IQ Tests 1 Dipendra Kumar Misra (Y9201) Mukul Singh (Y9350) Tags : Search, Pattern Recognition, Logic etc Advisor : Dr. Amitabh Mukherjee

7

Methodology

Front End

Back End

Set of Images ( Test Set and Solution Set )

Solution

Page 8: Visual Sequences IQ Tests 1 Dipendra Kumar Misra (Y9201) Mukul Singh (Y9350) Tags : Search, Pattern Recognition, Logic etc Advisor : Dr. Amitabh Mukherjee

8

Front End

L1

Set of Images (Test Set and solution set)

Set of Lines, Circles and Special Objects detected in the image set

L2

Polygons formed by combining suitable lines

Page 9: Visual Sequences IQ Tests 1 Dipendra Kumar Misra (Y9201) Mukul Singh (Y9350) Tags : Search, Pattern Recognition, Logic etc Advisor : Dr. Amitabh Mukherjee

9

Back End

Transformation of P1 = T1 ∩ T3 U T2 ∩ (T4 U T5)

P1

P2 P3

P4 P6P5

T2T1

T3 T4 T5

Page 10: Visual Sequences IQ Tests 1 Dipendra Kumar Misra (Y9201) Mukul Singh (Y9350) Tags : Search, Pattern Recognition, Logic etc Advisor : Dr. Amitabh Mukherjee

10

Ranking Method

Rank(P,Q) = MatchPrimitive(P,Q) + MatchPrimitive(Q,P)

MatchPrimitive(P,Q) = Number of Primitive of P in Q

Page 11: Visual Sequences IQ Tests 1 Dipendra Kumar Misra (Y9201) Mukul Singh (Y9350) Tags : Search, Pattern Recognition, Logic etc Advisor : Dr. Amitabh Mukherjee

11

Lets Do Some Practice

Page 12: Visual Sequences IQ Tests 1 Dipendra Kumar Misra (Y9201) Mukul Singh (Y9350) Tags : Search, Pattern Recognition, Logic etc Advisor : Dr. Amitabh Mukherjee

12

Handling Ambiguity

• Multiple Transformations – • Use Least Complex Formula (Kolmogorov)

P

A B

Q

A B

R 270R 90 R 90R 270

Choosing Cross Terms (90,270) will give us wrong answer

Page 13: Visual Sequences IQ Tests 1 Dipendra Kumar Misra (Y9201) Mukul Singh (Y9350) Tags : Search, Pattern Recognition, Logic etc Advisor : Dr. Amitabh Mukherjee

13

Results

• Solve Visual Problems for a Large Subset

• Zero Human Intervention

• No restriction on type of primitives – apple, cap, chair etc.

Page 14: Visual Sequences IQ Tests 1 Dipendra Kumar Misra (Y9201) Mukul Singh (Y9350) Tags : Search, Pattern Recognition, Logic etc Advisor : Dr. Amitabh Mukherjee

14

References & Resources

• “IQ Tests to Keep You Sharp” by Philip Carter and Kenneth Russel

• “Check Your IQ” by Ken Russell and Philip Carter• www.similarminds.com• Spreadsheet Data Manipulation Using Examples S.

Gulwani POPL 2011• A computer program capable of passing IQ tests, Sanghi,

P. and Dowe 2003• Montalvo, Fanya S. Diagram understanding, 1986