Google vs. Copernic

An Academic Exercise

Introduction A comparison of Google’s Knowledge Graph and

Copernic 3 Queries Batch Evaluation Qualitative Evaluation

Google http://www.youtube.com/watch?v=mmQl6VGvX-c

Copernic meta search engine Copernic Agent gives you the ability to search

deeper into the Web and to get relevant, high quality results grouped into categories. http://www.copernic.com/en/products/agent/index.html

Research Process1. system selection2. hypothesis creation3. information needs scenario development4. query selection5. survey creation6. subject recruiting7. survey dissemination8. results aggregation9. batch evaluation10. qualitative evaluation11. analysis12. results

Needs and Queries John wants to make sure that he uses that classic

"to be or not to be" quote from Shakespeare correctly in a speech to a book club, he wants to make sure he understands the meaning.

(keyword search terms: to be or not)

Needs and Queries A Student is going to visit Stanford University to

interview and wants to know how to get to the University from the airport as cheaply as possible.

(keyword search terms: how to get from San Francisco airport to Stanford)

Needs and Queries Grandma was told that Junior’s favorite music is

electronica and wants to know what this music is so that she can buy him a cd. 

(keyword search terms: electronica music cd)

Needs and Queries A student wants to do a report on Huey P. Long’s

contribution to education.  (keyword search terms: user chosen)

o Huey Long education contributiono Huey p long's contribution to education o huey long's contribution to educationo Huey P Long's contribution to educationo Huey P. Long Educationo Huey P. Long's contribution to Louisiana educationo Huey P. Long’s contribution to education

Research Tools Jotform’s online

form builder 8 forms (2 per

query)

Submission results downloadable via excel, csv, or pdf

Research Tools

Research Tools (Recruiting)

Email Facebook

0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.00.000.100.200.300.400.500.600.700.800.901.00

Copernic To Be or Not to Be

Precision-Recall

Copernic Precision RecallInterpolation

Recall

Prec

isio

n

Summary:Google has a higher Interpolated average precision

0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.00.00

0.10

0.20

0.30

0.40

0.50

0.60

GoogleTo Be or Not To Be

Precision-Recall

Google Pre-cision Recall

Interpolation

Recall

Precision

0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 10

0.10.20.30.40.50.60.70.80.9

1

Copernic Precison RecallStanford Query

Copernic P/RInterpolation

Recall

Prec

isio

n

0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 10

0.10.20.30.40.50.60.70.80.9

1

Google Precision Recall Stanford QueryGoogle P/RInterpolation

Recall

Prec

isio

n

Summary:Google has a higher Interpolated average precision

0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.00.00

0.10

0.20

0.30

0.40

0.50

Google Precision Recall

Electronica

Google P-RInterpolation

RecallPr

ecis

ion

0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.00.00

0.05

0.10

0.15

0.20

0.25

0.30

CopernicPrecision Recall

Electronica

"Copernic Precision-Re-call"Interpolation

Recall

Prec

isio

n

Summary:Google has a higher Interpolated average precision

Qualitative: Google Returns More Relevant Results

1st Re

sult

2nd Resu

lt

3rd Resu

lt

4th Resu

lt

5th Resu

lt

6th Resu

lt

7th Resu

lt

8th Resu

lt

9th Resu

lt

10th R

esult

15 5

3 3 46 6 6

2

62 1 4 4 3

1 1 15

Google Relevance ResultsIrrelevant Relevant

1st Result

2nd Result

3rd Result

4th Result

5th Result

6th Result

7th Result

8th Result

9th Result

10th Result

4 5 6 5

24 4

1

5 4

3 2 0 1

42 2

5

1 2

Copernic Relevance ResultsIrrelevant Relevant

10 9 8 7 6 5 4 3 2 1 00

1

2

3

Ease of Use

Google Ease of SearchCopernic Ease of Search

On a Scale of 1 - 10, how easy is each system to use?

Use

r Re

spon

se

Results Summary Results indicate that Google is superior This can be attributed to several factors:

Knowledge Graph produces more relevant documents

Google has more users thus a broader base of aggregated search results from a common query; Copernic does not have this feature.