21
+ Hunt or Gather, Share or Steal: Scottish News Networks, 1790-1840 M. H. Beals Sheffield Hallam University @mhbeals View These Slides About Me Colonial News Database View This Presentation After 16 Sept 2014

Hunt or Gather, Share or Steal:Scottish News Networks, 1790-1840

Embed Size (px)

DESCRIPTION

Between 1783 and 1840, the number of newspapers published in Scotland grew tenfold and spread far beyond the key port towns of Glasgow, Edinburgh, and Aberdeen into market towns and centres throughout the region. Although these provincial newspapers remained weekly or bi-weekly publications throughout the period, they still required a significant amount of international reportage to fill their four to eight pages. This material was shamelessly, and often haphazardly, gleaned from international periodicals in the form of scissors-and-paste reprints. Through these half-hearted shortcuts, we can develop a significant understanding of newspaper networks before the rise of international telegraphy and the slow decline of the scissors-and-paste system. Utilising highly detailed transcriptions of newspaper content from Scotland, England and the wider Anglophone world, this paper will trace key dissemination pathways of news content from its origin in various British colonies and the United States, through its many reprints, abridgments, summaries and commentaries, to the pages of Scottish periodical press. By mapping the shape and directionality of these network connections, a greater understanding of news dissemination and editorial links can be achieved. These networks can then form the statistical basis of further qualitative studies into the spread of ideas or interpersonal connections. The paper, developed and expanded from an initial proposal presented at ESSHC 2014, will demonstrate how, through a combination of traditional close reading, ‘big data’ edition tracking, and social network analysis, Georgian news networks, including periodicals with extremely short runs and no contextual records, can be significantly mapped and the quantitative influence of key hubs can be preliminarily determined. It will explore the relative value of manual and computer-assisted transcriptions at different stages of the project, the feasibility of training historians in high-level programming languages such as Python, the nature of the resulting network data and its interoperability with mathematical and sociology research, and the possibilities for wider dissemination and collective reuse of transcription data. Finally, the piece will demonstrate, through select case studies, how basic quantitative data regarding network dissemination pathways can fundamentally alter our interpretation of the purpose of miscellany material in Scotland’s provincial press.

Citation preview

Page 1: Hunt or Gather, Share or Steal:Scottish News Networks, 1790-1840

+

Hunt or Gather, Share or Steal:Scottish News Networks, 1790-1840

M. H. BealsSheffield Hallam University

@mhbeals

View These Slides

About MeColonial News Database

View This Presentation

After 16 Sept 2014

Page 2: Hunt or Gather, Share or Steal:Scottish News Networks, 1790-1840

+Overview

Scottish Scissors-and-Paste Journalism

Identifying Reprints

Understanding Dissemination Pathways

Manual Construction of Social Networks

Digitally Constructed Dissemination Pathways

Page 3: Hunt or Gather, Share or Steal:Scottish News Networks, 1790-1840

+Journalism in Georgian Scotland

Proliferation of Colonial and Provincial PressesSpread of Journeyman Printers

Reduction of Stamp Duty

New Profit ModelsEntertaining and Literary Content

Adverts to Attract Readers to Sell to Advertisers

Ports and Post-RoadsSignificant amount of Material Copied from London

Growth of Domestic News-SharingEventual Establishment of Direct Overseas Connections

Manual Dissemination of NewsLimited Number of “Specials”

Postal Exchange, Subscriptions, CorrespondenceNo Telegraph until 1840s and Not Used for Miscellany

Page 4: Hunt or Gather, Share or Steal:Scottish News Networks, 1790-1840

+Scissors-and-Paste Journalism

A contemporary term, often used pejoratively, for the wide-spread practice of excerpting from or recycling of articles from other publications, this term actually covered a number of different editorial strategies, ranging from agreed syndication to unacknowledged piracy […] The practice was not limited to news and, encouraged by confused and ambiguous copyright law, many cheap literary miscellanies were founded on the premise of extracting 'useful knowledge' from prohibitively expensive books, monthlies and quarterlies to make it more accessible to the lower classes.

Catherine Feely, Dictionary of Nineteenth-Century Journalism

Page 5: Hunt or Gather, Share or Steal:Scottish News Networks, 1790-1840

+

Promise Large-Scale Digitisation EffortsKeyword SearchingnGram Matching (WCopyFind)Edition Tracking (Juxta)

Viral Texts Project (Cordell, Dillon, and Smith) Large-Scale Corpus of Nineteenth Century Newspapers

Extensive, Automatic Repair of OCR ErrorsIdentification of Highly Reprinted Materials (Memes)

Discussion and Exploration of Meme Traits and and Patterns

PerilsDiscrete Digital Corpera (Paywalls)

Offline Penumbra (Curation)Lost Nodes (Incomplete Data)

OCR Variability (50-80%)

Computer-Aided Identification of Reprints

Page 6: Hunt or Gather, Share or Steal:Scottish News Networks, 1790-1840

+ Computer-Aided Identification of Reprints

# concordanceset.pyimport redef replace_words(text, word_dic): rc = re.compile('|'.join(map(re.escape, word_dic))) def translate(match): return word_dic[match.group(0)] return rc.sub(translate, text)

def getNGrams(wordlist, n): return [wordlist[i:i+n] for i in range(len(wordlist)-(n-1))]

basenumber = raw_input('What is the first id number? ’)number = str(basenumber)numberint = int(basenumber)basenumberend = raw_input('What is the last id number? ’)endnumber = int(basenumberend)

ngram = raw_input('How many words should be in a phrase? ’)ngrams = int(ngram)combifile = 'combine.txt’listopen = open(combifile, "r”)wordlist = listopen.read()splitlist = wordlist.split()listopen.close()ngramslist = getNGrams(splitlist, ngrams)

if ngramslist: ngramslist.sort() last = ngramslist[-1] for i in range(len(ngramslist)-2, -1, -1): if last == ngramslist[i]: del ngramslist[i] else: last = ngramslist[i]

tidystring = '’

for item in ngramslist: number = str(basenumber) numberint = int(basenumber) lineitem = " ".join(item) print lineitem tidystring += str('\n' + lineitem + ',')

while (numberint<=endnumber): file = str(number + ".txt”) fin = open(file, 'r’) text = fin.read() fin.close() if lineitem in text: tidystring += str(number + ',’) numberint = int(number) numberint += 1 number = str(numberint)

# create an excelfile for this exampleexcel_file = "ngramcompiled.csv”fout = open(excel_file, "w”)fout.write(tidystring)fout.close()

Page 7: Hunt or Gather, Share or Steal:Scottish News Networks, 1790-1840

+ Computer-Aided Identification of Reprints

Page 8: Hunt or Gather, Share or Steal:Scottish News Networks, 1790-1840

+ Understanding Reprint Networks

Meme Identification

Courtesy of Viral Texts Project, http://www.viraltexts.org/

Page 9: Hunt or Gather, Share or Steal:Scottish News Networks, 1790-1840

+ Understanding Reprint Spread

Chronological Spread

Courtesy of Viral Texts Project, https://www.youtube.com/watch?v=YwDlyt7jhMs

Page 10: Hunt or Gather, Share or Steal:Scottish News Networks, 1790-1840

+Understanding Dissemination

Pathways

Genealogical Model

Page 11: Hunt or Gather, Share or Steal:Scottish News Networks, 1790-1840

+

Datelines

Sections

Attributions

In-Text References

Maintained Errors

House Style

Inconsistencies

A Faithful Reprint

Page 12: Hunt or Gather, Share or Steal:Scottish News Networks, 1790-1840

+

Original, Sydney Gazette, 8 November 1815

Reprint, London Courier, 2 January 1817

A Faithful Reprint

Page 13: Hunt or Gather, Share or Steal:Scottish News Networks, 1790-1840

+

Reprint, London Courier, 2 January 1817

Reprint, Caledonian Mercury, 6 January 1817

A Faithful Reprint

Page 14: Hunt or Gather, Share or Steal:Scottish News Networks, 1790-1840

+

Reprint, Caledonian Mercury, 6 January 1817

Reprint, Aberdeen Journal, 8 January 1817

A Faithful Reprint

Page 15: Hunt or Gather, Share or Steal:Scottish News Networks, 1790-1840

+A Faithful Reprint

Page 16: Hunt or Gather, Share or Steal:Scottish News Networks, 1790-1840

+ Manual Construction of Social Networks

The Glasgow Advertiser, 7 October 1793, p. 5

Knoxville, May 11.IT is shocking to describe the bloody scenes thathave lately taken place in this district. TheIndians have killed and scalped a great number ofpersons, among whom is Colonel Isaac Bledose,who was massacred within 150 yards of his ownhouse.

On the 27th instant a body of Indians attackedGreenfield station: they killed John Jervis, anda negro fellow, belonging to Mrs. Tarker. Bythe bravery of three young men, viz. William Nee-ly, William Wilson, and William Hall, the stationwas preserved; they killed two Indians, woundedseveral others, and put them to flight. It is to beremembered, that Neely and Hall had each lost afather and two brothers, and Wilson a brother, bythe savages. Men are now in pursuit of the Indi-ans.

Full Discussion of Dissemination Pathway Available at: http://prezi.com/in4_bqvgmanr/

Page 17: Hunt or Gather, Share or Steal:Scottish News Networks, 1790-1840

+Manual Construction of Social

Networks

Derived from Google News Archive, British Library 19th Century Newspapers,

NewspaperArchive.com, Readex Early American Newspapers, Newspapers.com, and the University of Kentucky

Page 18: Hunt or Gather, Share or Steal:Scottish News Networks, 1790-1840

+Binary Computer Model

Arbitrary Tolerance Levels

Reference to Additional Tables

Bypassing Missing Nodes

Flexibility

Difficult to Recreate Human Instinct…

…But is That a Bad Thing?

Page 19: Hunt or Gather, Share or Steal:Scottish News Networks, 1790-1840

+Phylogenic Model

Phylogenetic Model

Image Courtesy of Fred Hsu (Wikipedia:User:Fredhsu on en.wikipedia) CC-BY-SA-3.0 via Wikimedia Commons

Page 20: Hunt or Gather, Share or Steal:Scottish News Networks, 1790-1840

+ Can Computers Replace Historians?

Computer ProgramOCR Clean-up ProcessesDivision into Likely Meme GroupingsVariety of Relatedness Scores

Textual IntegrityPrefixes and SuffixesChronological SeparationChronological-Geographical FeasibilityWell-Worn Path ModifierModeling of Relatedness Factors

Directional Social Network DatabaseRaw Data to Inform Additional Research

Manual CorrectionsDirect Attributions

Parsing Compilations

Initial Discovery of Well-Worn Paths

Inclusion of Offline Materials

(www.mhbeals.com/cnd)

Page 21: Hunt or Gather, Share or Steal:Scottish News Networks, 1790-1840

+

Hunt or Gather, Share or Steal:Scottish News Networks, 1790-1840

M. H. BealsSheffield Hallam University

@mhbeals

View These Slides

About MeColonial News Database

View This Presentation

After 16 Sept 2014