1
Lette r to the Editor Library and Information Science (LIS) in Aid of Meta-Analysis Sir: In his letter Birger Hjørland (2001) claims that “meta-analysis is totally neglected by mainstream information science,” since nothing on it has appeared in this journal or Information Process- ing and Management or the Journal of Documention. He writes that LIS “has not been able to contribute to meta analysis or utilize this subject to expand our professional activities,” adding that, because document searching and information retrieval are core competencies in LIS, “We should be able to prescribe optimal search strategies . . . or at least we should be able to illuminate the consequences of different kinds of search strategies” to meta- analysts in other fields. The fourth item in his bibliography is The Handbook of Re- search Synthesis (Cooper & Hedges, 1994). This volume is one of the bibles of the meta-analytic movement (citations to it in Scisearch and Social Scisearch currently exceed 800). Opened, it will be found to contain a chapter by me (White, 1994) that does exactly what Hjørland asks for, with attention to psychological as well as technical aspects of searching. In it, I cite about 25 names that are familiar to readers of this journal, bringing mainstream information scientists, from Marcia Bates to Ron Rice, into a common context with writers on research synthesis from outside LIS. For example, Patrick Wilson’s intuitive account of modes of literature searching turns out to fit nicely with Harris Cooper’s empirical account (Wilson, 1992; Cooper, 1985); I use both to organize the chapter around the consequences of the modes. Among other things, I address the “file-drawer problem”—the problem Hjørland mentions of finding studies that lie unpublished in drawers because they do not report statistically significant results. If the full set of treatment effects is to be available to the meta-analyst, such studies should be retrieved. Finding them is essentially a problem in recall, and I discuss matters of both recall and precision as they bear on meta-analytic goals. My chapter, moreover, is complemented by three others on information and document retrieval (Reed & Baxter, 1994; Dickersin, 1994; Rosenthal, 1994) including one on “the fugitive literature” by librarian Marylu Rosenthal, wife of Robert Rosenthal, the psychol- ogist-statistician who first formulated the file-drawer problem. Hjørland implies that LIS has been remiss because its leading journals have not published articles on meta-analysis for export. On the contrary, if we want to be useful to statistical research synthesists in other fields, it is better to publish outside LIS. I was fortunate to be recruited as a Handbook contributor, because it allowed me to discuss aspects of my field in a prominent non-LIS forum. The chapter is now my chief source of extradisciplinary citation. It has been referenced in literature-reviewer’s guidelines on the Web and in journals of psychology, education, nutrition, epidemiology, and plant science (topically, the ca. 30 citing arti- cles range from “breast-feeding in cognitive development” to “leaf gas-exchange and nitrogen in trees grown under elevated carbon dioxide.”) A companion piece that seems to me at least as useful, since it shows anyone how to do the kinds of things that Hjørland and I do to assess the interdisciplinary impact of publications, is an article I published in Library Trends (White, 1996). It has hardly been cited at all and is unknown outside LIS. I do not think that publishing it in one of the journals Hjørland names would have helped. A permanent lesson of behavioral information science is that people rarely search the literature outside their own fields and prefer to get their methodological information from one-stop cen- ters like the Handbook. We must go to them if we are to be noticed at all. Howard D. White College of Information Science and Technology Drexel University Philadelphia, PA 19104 [email protected] Published online 25 January 2002 DOI: 10.1002/asi.10069 References Cooper, H.M. (1985). Literature searching strategies of integrative research reviewers. American Psychologist, 40, 1267–1269. Cooper, H., & Hedges, L.V. (Eds.). (1994). The Handbook of Research Synthesis. New York: Russell Sage Foundation. Dickersin, K. (1994). Research registers. In Cooper, H., & Hedges, L.V. (Eds.), The Handbook of Research Synthesis (pp. 71– 83), New York: Russell Sage Foundation. Hjørland, B. (2001). Why is meta analysis neglected by information scientists? Journal of the American Society for Information Science, 52, 1193–1194. Reed, J.G., & Baxter, P.M. (1994). Using reference databases. In Cooper, H., & Hedges, L.V. (Eds.), The Handbook of Research Synthesis (pp. 57–70). New York: Russell Sage Foundation. Rosenthal, M.C. (1994). The fugitive literature. In Cooper, H., & Hedges, L.V. (Eds.), The Handbook of Research Synthesis (pp. 85–94), New York: Russell Sage Foundation. White, H.D. (1994). Scientific communication and literature retrieval. In Cooper, H., & Hedges, L.V. (Eds.), The Handbook of Research Syn- thesis (pp. 41–55), New York: Russell Sage Foundation. White, H.D. (1996). Literature retrieval for interdisciplinary syntheses. Library Trends, 45, 239 –264. Wilson, P. (1992). Searching: Strategies and evaluation. In White, H.D., Bates, M.J., & Wilson, P. For Information Specialists: Interpretations of Reference and Bibliographic Work (pp. 153–181), Norwood, NJ: Ablex. © 2002 Wiley Periodicals, Inc. JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY, 53(4):323, 2002

Library and information science (LIS) in aid of meta-analysis

Embed Size (px)

Citation preview

Page 1: Library and information science (LIS) in aid of meta-analysis

Letter to the Editor

Library and Information Science (LIS) in Aid ofMeta-Analysis

Sir:

In his letter Birger Hjørland (2001) claims that “meta-analysisis totally neglected by mainstream information science,” sincenothing on it has appeared in this journal or Information Process-ing and Management or the Journal of Documention. He writesthat LIS “has not been able to contribute to meta analysis or utilizethis subject to expand our professional activities,” adding that,because document searching and information retrieval are corecompetencies in LIS, “We should be able to prescribe optimalsearch strategies . . . or at least we should be able to illuminate theconsequences of different kinds of search strategies” to meta-analysts in other fields.

The fourth item in his bibliography is The Handbook of Re-search Synthesis (Cooper & Hedges, 1994). This volume is one ofthe bibles of the meta-analytic movement (citations to it inScisearch and Social Scisearch currently exceed 800). Opened, itwill be found to contain a chapter by me (White, 1994) that doesexactly what Hjørland asks for, with attention to psychological aswell as technical aspects of searching. In it, I cite about 25 namesthat are familiar to readers of this journal, bringing mainstreaminformation scientists, from Marcia Bates to Ron Rice, into acommon context with writers on research synthesis from outsideLIS. For example, Patrick Wilson’s intuitive account of modes ofliterature searching turns out to fit nicely with Harris Cooper’sempirical account (Wilson, 1992; Cooper, 1985); I use both toorganize the chapter around the consequences of the modes.

Among other things, I address the “file-drawer problem”—theproblem Hjørland mentions of finding studies that lie unpublishedin drawers because they do not report statistically significantresults. If the full set of treatment effects is to be available to themeta-analyst, such studies should be retrieved. Finding them isessentially a problem in recall, and I discuss matters of both recalland precision as they bear on meta-analytic goals. My chapter,moreover, is complemented by three others on information anddocument retrieval (Reed & Baxter, 1994; Dickersin, 1994;Rosenthal, 1994) including one on “the fugitive literature” bylibrarian Marylu Rosenthal, wife of Robert Rosenthal, the psychol-ogist-statistician who first formulated the file-drawer problem.

Hjørland implies that LIS has been remiss because its leadingjournals have not published articles on meta-analysis for export.On the contrary, if we want to be useful to statistical researchsynthesists in other fields, it is better to publish outside LIS. I wasfortunate to be recruited as a Handbook contributor, because itallowed me to discuss aspects of my field in a prominent non-LISforum. The chapter is now my chief source of extradisciplinary

citation. It has been referenced in literature-reviewer’s guidelineson the Web and in journals of psychology, education, nutrition,epidemiology, and plant science (topically, the ca. 30 citing arti-cles range from “breast-feeding in cognitive development” to “leafgas-exchange and nitrogen in trees grown under elevated carbondioxide.”) A companion piece that seems to me at least as useful,since it shows anyone how to do the kinds of things that Hjørlandand I do to assess the interdisciplinary impact of publications, is anarticle I published in Library Trends (White, 1996). It has hardlybeen cited at all and is unknown outside LIS. I do not think thatpublishing it in one of the journals Hjørland names would havehelped. A permanent lesson of behavioral information science isthat people rarely search the literature outside their own fields andprefer to get their methodological information from one-stop cen-ters like the Handbook. We must go to them if we are to be noticedat all.

Howard D. WhiteCollege of Information Science and TechnologyDrexel UniversityPhiladelphia, PA [email protected] online 25 January 2002DOI: 10.1002/asi.10069

References

Cooper, H.M. (1985). Literature searching strategies of integrative researchreviewers. American Psychologist, 40, 1267–1269.

Cooper, H., & Hedges, L.V. (Eds.). (1994). The Handbook of ResearchSynthesis. New York: Russell Sage Foundation.

Dickersin, K. (1994). Research registers. In Cooper, H., & Hedges, L.V.(Eds.), The Handbook of Research Synthesis (pp. 71–83), New York:Russell Sage Foundation.

Hjørland, B. (2001). Why is meta analysis neglected by informationscientists? Journal of the American Society for Information Science, 52,1193–1194.

Reed, J.G., & Baxter, P.M. (1994). Using reference databases. In Cooper,H., & Hedges, L.V. (Eds.), The Handbook of Research Synthesis (pp.57–70). New York: Russell Sage Foundation.

Rosenthal, M.C. (1994). The fugitive literature. In Cooper, H., & Hedges,L.V. (Eds.), The Handbook of Research Synthesis (pp. 85–94), NewYork: Russell Sage Foundation.

White, H.D. (1994). Scientific communication and literature retrieval. InCooper, H., & Hedges, L.V. (Eds.), The Handbook of Research Syn-thesis (pp. 41–55), New York: Russell Sage Foundation.

White, H.D. (1996). Literature retrieval for interdisciplinary syntheses.Library Trends, 45, 239–264.

Wilson, P. (1992). Searching: Strategies and evaluation. In White, H.D.,Bates, M.J., & Wilson, P. For Information Specialists: Interpretations ofReference and Bibliographic Work (pp. 153–181), Norwood, NJ: Ablex.© 2002 Wiley Periodicals, Inc.

JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY, 53(4):323, 2002