Understanding WeboNaver

WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS

Understanding WeboNaver: API-based search tool for the Naver search engine

Han Woo PARKAssociate Professor

Dept of Media & Communication, YeungNam University, S.KoreaDirector of WCU Webometrics Institute

http://english-webometrics.yu.ac.kr [email protected]

http://www.hanpark.net

Se Jung ParkPh.D. Student, Dept of Media and Communication, YeungNam University. S.Korea

David StuartHonorary Research Fellow, Statistical Cybermetrics Research Group, University of Wolverhampton, Wulfruna Street, Wolverhampton, UK.

Seung Wook LeeMA Student, Dept of Information and Communication of Engineering, YeungNam University, S.Korea

박한우 , 박세정 , David Stuart, 이승욱 (2010). API 를 활용한 검색 프로그램 WeboNaver 의 이해와 적용 : 18 대 국회의원의 웹 가시성 분석 . Journal of the Korean Data Analysis Society. 11 권 6 호 (B).

2

The purpose of this paper is to introduce the API-based webometrics tool created for the Korean search engine Naver

This non-commercial software is designed to collect large amounts of data automatically and can easily distinguish between different types of information on the web, which was impossible before.

(Image Source: Newsweek, 5 Nov 2007)



Webonaver (Webometrics Tool for Naver)Webonaver (Webometrics Tool for Naver)

3

Rationale for the Naver

• “Republic of Naver” (Kim & Sohn, 2007)

• CEO Google, 30 May 2007)• “Korea is a great laboratory of the digital age.”

(Eric Schmidt,

• “Korea’s Naver is now the world’s 5th search service provider, behind Google, Yahoo, Baidu and Microsoft.” (The AP, 9 Oct 2007)

(Image Source: Newsweek, 5 Nov 2007)



4

Rationale for the Naver

• “Google left behind as Koreans Naver-gate the internet” (Financial Times, 2 Jan 2008)

• “IN SOUTH KOREA People who want to looksomething up on the internet don’t “Google it”. Instead they “ask Naver”. (Economist, 30 Feb 2009)

• Yeon-Ok Lee and Park. H. W., (2008). "The Importance of Search Engines in Digital News Consumption A Comparative Study Between South Korea and the UK". refereed paper presented at the Workshop “Gatekeepers in a Digital Asian-European Media Landscape: The rising structural power of Internet search engines”(2008).



5

Component of Naver



Log-in

The articles title (changing automatically)

The press linkedToday’s issues

Quick menubrowser window

6

Terms of Use



7

Interface



The interface is fairly self-explanatory:

-Tick or untick to collect either only hit number or the title, URL, and description of the results

- Select which of the search options you want to include

- Click on the '...' button to select the text file that contains the queries you wish to run

- Click 'Run Queries'

The interface is fairly self-explanatory:

-Tick or untick to collect either only hit number or the title, URL, and description of the results

- Select which of the search options you want to include

- Click on the '...' button to select the text file that contains the queries you wish to run

- Click 'Run Queries'

8

Getting an API key



URL : http://dev.naver.com/openapi/register**This page need the Login

9

Search query limit



API Key

Search query limit per day: 25,000

10

Input file



*.txt file must encoded by UTF-8 type

11

Output file



When you tick it to collect only hit number, it shows the number of web pages containing search query

Pilot comparison between API and Manual Webpage search

12



Comparison was done using randomly selected Korean politicians as of 12 Aug 2009

13

• There are always differences between the

API’s results and the normal search results, but these are miniscule differences in comparison with the APIs of Google, Yahoo and Bing



Pilot comparison between API’s and Manual

14

Output file



When you tick it to parse the title, URL, and description of theresults (except for images which doesn’t have) the number of web pages containing search query

15

Issues in multiple hits



The multiple hits reflect the numbers displayed in pages of the Naver. It’s not program error. The Webonaver show actual different numbers of the results from the Naver. The last hits show actual results Webonaver can extract. It’s not the only case of the Naver, but also other search engines such as yahoo display different results as an each webpage.

16

Issues in multiple hits example



17




18




19

Output file



The Naver API doesn't provide the real URL. Rather it supplies a 'Naver API’. But, user can visit an actual site when they put the api-based URL to the window browser of the Naver.

•

There are programming and time issues, but there are also issues regarding how service provider responds.

Naver is more protective of handing out API keys, in comparison with yahoo or Bing which provide Open APIs.

It is important that services are not abused.

20



Ethical issues

Korean National Assembly Members’ web presence

• Web presence of Korean 18th congressman between 27th August and 24th September is automatically collected using WeboNaver at an interval of a week.

• 20 members’ web presence including blog, scholar, news and web documents is visualized.

21

22

• web presence of the term H1N1 is examined using Webonaver. We tested the usability and reliability of this tool.

Queres: 신종플루 (A virus subtype H1N1) 신종 인플루엔자 (Influenza A virus subtype H1N1) 신종인플루엔자 (Influenza A virus subtype H1N1)

• Users can get same results from certain words containing space character and the one without space using WeboNaver.

• But, it can not assume similar words as same. Users should consider which specific data they want to extract before using this tool.

WCUWEBOMETRICSINSTITUTEINVESTIGATING INTERNET-BASED POLITICSS WITH E-RESEARCH TOOLS Web presence of the term H1N1

23

24

• API-based search tool such as WeboNaver enables researchers to capture massive web data automatically and systemically.

• This software can help researchers improve efficiency of data analysis within a specified timeframe.

• Web data gathered using this tool can also be visualized to describe online trend.

25



Conclusion

• Mayr, Philipp; Tosques, Fabio (2005).

Google Web APIs - An instrument for webometric analyses? pp. 677-678. In: Ingwersen, Peter; Larsen,Birger (eds.): 10th International Conference of theInternational Society for Scientometrics and informetrics.Stockholm (Sweden)

http://www.ib.hu-berlin.de/~mayr/arbeiten/ISSI2005_Mayr_Toques.pdf

• The project site with the APIs demos is offline thesedays. But they are recovering the demos soon. http://bsd119.ib.hu-berlin.de/%7Eft/

26



Reference (Web APIs)


This tool is publicly available. Please check out WWI official website. http://www.hanpark.net →software

27

Technology

Understanding WeboNaver