Enriching Literature Reviews with Text Mining ToolsCase: Group Support SystemsPh.D. Johanna Bragge / HSE / Business Technology / ISShttp://www.hse.fi/EN/HKI/B/Johanna_Bragge
The presentation is based on Bragge J., Relander S., Sunikka A. and Mannonen P. (2007) Enriching Literature Reviews with Computer-Assisted Research Mining. Case: Profiling Group Support Systems Research, Proceedings of 40th HICSS Conference, Hawaii, USA.
Structure of presentationObjectives of our HICSS07 paperWhat is research profiling?Profiling research on Group Support SystemsDimensions of research profilingFrom undergrad class papers and one-nighters to dissertation or other major research projectsPossibilities of ISI WoS Analysis toolConclusions
Objectives of our HICSS07 paperExtend the notion of a traditional literature reviewinto the domain of research profilingPresent a practical case studyGroup (Decision) Support Systems researchBriefly overview the capabilities of VantagePointText-mining software originally developed at the Georgia Institute of Technology, USA (currently SearchTech Inc.)
Can we improve on the traditional literature review?Science and technology abstracts are literally at our fingertips in R&D databasesSearch engines enable rapid and effective collection of records relating to ones research interestsAnalytical software helps elicit useful information from the searches (even if thousands of abstracts) to gain perspective on ones research context.
This enhanced literature review research profiling should become standard research practice.Source: Porter, Kongthon and Lu (2002), From Traditional Literature Reviews to Research Profiling, Scientometrics, Vol. 53, No. 3, 351-370. AVAILABLE in SpringerLink database.
Augmenting, not replacing!Research profiling aims to augment, not replace, the traditional literature reviewhelping to fulfill purposes of understanding the structure of the subject, important variables, pertinent methods, and key needsThese aims can be better served by analyzing the whole, rather than just a few parts of the research milieu.students often limit their perspective to specialized slices of the literatureresearch streams often lose connection to other research activitiesPorter et al. (2002, p. 351).
Comparison of traditional literature reviews and research profilingPorter et al. (2002, p. 353).
The research profiling process based on Herbert Simons Decision PhasesSource: Adapted from Porter and Cunningham (2005).
Fundamental researchCommercial application Science Citation Index, ISI MEDLINE Chem abstracts INSPEC (by IEE) EI Compendex Derwent World Patent Index ABI Inform (ProQuest) Lexis Nexis
Source: Porter & Cunningham (2005, p. 83)Selection of databases
Case: Profiling Group Support Systems ResearchResearch question: Past, present and future of GSSLevel of maturity / saturation?Who? What? When?Whats hot? Are there any emerging themes? Etc.Search words used:group support system(s), group decision support system(s), electronic meeting system(s)Database used: INSPEC by IEECovers more than 3.850 journals and 2.200 conference proceedingsFinal sample: 2.000 publications from 1982-2005The sample was collected in April 2006
G(D)SS Publications yearly in INSPEC
Top-12 Institutions of GSS research
Top-12 Outlets of GSS research
Top-7 authors and selected details
Key figures of GSS research in 2000-2005 (from 688 out of 2000 publications)
Trends in authors keywords (non-technology)
5-year trends of various terms
Illustration of VantagePoints DSS-capabilities
Dimensions of research profiling Source: Porter et al. (2002, p. 366)
ISI Web of Sciences Analysis tool suitable for one-nighters
Problems occur as the authors may be inserted differently in the database! With VantagePoint these can be cleaned for the purposes of advanced analyses with simple frequencies ISI works well.
More options can be found from the Analyze Results: Analyze button (in the right-hand column of the main search results page). Also possibility to save records to file for graphs.
ConclusionsIncreasing availability and amount of informationModern search engines developedResearch profiling uses sophisticated text mining tools for structured science information resources i.e. abstracts from ISI WoS, Ebsco, ProQuest, INSPEC etc.Emphasis on content - uncovering research gaps and new scientific domainsEmphasis not on co-citation analysis (SNA tools better for that)Does not replace traditional literature reviews!Database limitations, e.g. publication delays and non-standardized contents of different databases
Questions or comments?
More references on the foundations and applications of research profilingPorter, A. L., Kongthon, A. and J.-C. Lu, (2002) "Research Profiling: Improving the Literature Review", Scientometrics, vol. 53, no. 3, pp. 351-370.Porter, A. L. and S.W. Cunningham (2005), Tech Mining. Exploiting New Technologies for Competitive Advantage, Wiley Series in System Engineering and Management, New Jersey: John Wiley & Sons, Inc.Bragge, J., and Storgrds, J, (2007) Profiling Academic Research on Digital Games Using Text Mining Tools, Proceedings of the Digital Games Research Associations DIGRA Conference, Tokyo, Japan.Bragge, J., and Storgrds, J, (2007) Utilizing Text-Mining Tools to Enrich Traditional Literature Reviews. Case: Digital Games, Proceedings of the 30th Information Systems Research Seminar in Scandinavia IRIS, Tampere, Finland.Sunikka, A. and Bragge, J. (2008) What, Who and Where: Insight into Personalization, Forthcoming in the Proceedings of the HICSS-41, Hawaii, USA, January, 2008