The Era of Open

Philip E. Bourne

University of California San Diego

pbourne@ucsd.edu

WikiSym+OpenSym Aug 7, 2013 1

The Era of Open Has The Potential to Deinstitutionalize

Daniel Hulshizer/Associated Press

An Example of That Potential:The Story of Meredith

http://fora.tv/2012/04/20/Congress_Unplugged_Phil_Bourne

Deinstitutionalization Vs Conservatism

It Starts with the Metrics of Success

[Adapted from Carole Goble]WikiSym+OpenSym Aug 7, 2013 7

Committee on Academic Promotions

• What Counts– Money– Grants– Papers– Teaching – Service

• What Does Not– Sharing data– Sharing software– Open access– Collaboration– Patents– Startups

Getting Ahead as a Computational Biologist in Academia PLOS Comp Biol

Interim Solution: Use the Traditional Reward SystemThe Wikipedia Experiment – Topic Pages

Identify areas of Wikipedia that relate to the journal that are missing of stubs

Develop a Wikipedia page in the sandbox

Have a Topic Page Editor Review the page

Publish the copy of record with associated rewards

Release the living version into Wikipedia

MOOCs Are Another Form of Disruption

In Short Most Academic Institutions Have Yet to

Embrace the Open Digital Enterprise They Surely Will

Become

• Anyone, anything, anytime

• publication access, data, models, source codes, resources, transparent methods, standards, formats, identifiers, apis, licenses, education, policies

• “accessible, intelligible, assessable, reusable”

http://royalsociety.org/policy/projects/science-public-enterprise/report/

[Carole Goble]WikiSym+OpenSym Aug 7, 2013 13

Business Models Rule

• The Internet demanded new business models to support scholarly communication

• Open access was one such sustainable model: – Began with the community – Was driven by new organizations (PLOS, BMC,

F1000, eLife, Dryad, Mendeley etc.)– Was NOT driven by academic institutions– Was driven by policies and funders

One Metric of Change:Multidisciplinary Open Access

Mega Journal

• This year PLOS ONE will publish over 30,000 papers!

This Disruption Got Us Thinking About…

• A paper as only one form of knowledge discovery

• The use of interaction and rich media from which to learn and actually do science

• Reproducibility• Reward structures• Better management of the research lifecycle

P.E. Bourne 2005 In the Future will a Biological Database Really be Different from a Biological Journal? PLOS Comp. Biol. 1(3) e34

This Disruption Got Us Thinking About…

• A paper as only one form of knowledge discovery

• The use of interaction and rich media from which to learn and actually do science

• Reproducibility• Reward structures• Better management of the research lifecycle

P.E. Bourne 2005 In the Future will a Biological Database Really be Different from a Biological Journal? PLOS Comp. Biol. 1(3) e34

Better Management of the Research Lifecycle is Not a

New Concept

“An article about computational science in a scientific publication is not the scholarship itself, it is merely advertising of the scholarship. The actual scholarship is the complete software development environment, [the complete data] and the complete set of instructions which generated the figures.” David Donoho, “Wavelab and Reproducible Research,” 1995

datasetsdata collectionsalgorithmsconfigurationstools and appscodesworkflowsscriptscode librariesservices,system software infrastructure, compilershardware

Morin et al Shining Light into Black BoxesScience 13 April 2012: 336(6078) 159-160

Ince et al The case for open computer programs, Nature 482, 2012

[Carole Goble]

The Research Lifecycle

IDEAS – HYPOTHESES – EXPERIMENTS – DATA - ANALYSIS - COMPREHENSION - DISSEMINATION

AuthoringTools

Lab Notebooks

DataCapture

SoftwareRepositories

Analysis Tools

Visualization

ScholarlyCommunication

Commercial &Public Tools

Git-likeResources

By Discipline

Data JournalsDiscipline-

Based MetadataStandards

Community Portals

Institutional Repositories

New Reward Systems

Commercial Repositories

Training

The Research Lifecycle

IDEAS – HYPOTHESES – EXPERIMENTS – DATA - ANALYSIS - COMPREHENSION - DISSEMINATION

AuthoringTools

Lab Notebooks

DataCapture

SoftwareRepositories

Analysis Tools

Visualization

ScholarlyCommunication

Commercial &Public Tools

Git-likeResources

By Discipline

Data JournalsDiscipline-

Based MetadataStandards

Community Portals

Institutional Repositories

New Reward Systems

Commercial Repositories

Training

automate: workflows, pipeline & service integrative frameworks

pool, share & collaborate web systems

nanopub

semantics & ontologiesmachine readable documentation

scientific software engineering

Carole Goble]

Why is This Important to Me Personally?

• My wife is being treated for stage 1 breast cancer

• This highlights for me the disparity between what is happening in the lab and what is happening in the clinic– In the lab cancer is a personalized and treatable

condition– In the clinic we are still equally “poisoning”

patients with drugs first introduced 10-20 years ago

http://sagecongress.org/Presentations/Sommer.pdf

Josh Sommer]

http://sagecongress.org/Presentations/Sommer.pdf

[Josh Sommer]

Most Laboratories

• We are the long tail• Goodbye to the student is

goodbye to the data• Very few of us have

complied (or will comply with the data management plans we write into grants)

• Too much software is unusable

S.Veretnik, J.L.Fink, and P.E. Bourne 2008 Computational Biology Resources Lack Persistence and Usability. PLoS Comp. Biol. . 4(7): e1000136

Today’s Research Lifecycle is Digitally Fragmented at Best

• Proof:– I cant immediately reproduce the research in

my own laboratory• It took an estimated 280 hours for an average user

to approximately reproduce the paper

– Workflows are maturing and becoming helpful– Data and software versions and accessibility

prevent exact reproducability

Daniel Garijo et al. 2013 Quantifying Reproducibility in Computational Biology: The Case of the Tuberculosis Drugome PLOS ONE under review.

At the Same Time The Disruption Continues

G8 open data charterhttp://opensource.com/government/13/7/open-data-charter-g8

• In the US alone..– March 2012 OSTP

commits $200M to Big Data

– OSTP demands sharing plans by August 2013

– GBMF/Sloan provide institutional awards for data science

– NCBI considers data catalog and MyBibliography

And the Disruption Continues

Where Will It End?

First We Should Ask What It Is We Wish to Accomplish

1. A link brings up figures from the paper

0. Full text of PLoS papers stored in a database

2. Clicking the paper figure retrievesdata from the PDB which is

analyzed

3. A composite view ofjournal and database

content results

Here is What I Want – The Paper As Experiment

1. User clicks on thumbnail2. Metadata and a

webservices call provide a renderable image that can be annotated

3. Selecting a features provides a database/literature mashup

4. That leads to new papers

4. The composite view haslinks to pertinent blocks

of literature text and back to the PDB

PLoS Comp. Biol. 2005 1(3) e34

Here is What I Want – Knowledge Push

• Each evening the labs “Evernote” notebooks are scanned for commonalities from the days activities. These are seeds in a deep search of the webs research lifecycles that has become available since last searched. Results are ranked and presented for consideration over coffee the next morning

http://www.discoveryinformaticsinitiative.org/diw2012

Will End With …

• Infrastructure:– Science, Nature, Cell and megajournals all

“open access” – An array of coupled institutional repositories – A central repository – PubMed Central – Open software in full support of the research

lifecycle – The research lifecycle in the cloud

Will End With …

• Sociologically:– An end to build it and they will come– Alternative metrics accepted by the

community– Alternative reward systems that recognize the

realities of today’s scholarship, namely:• Open data availability• Software availability• Collaborative research

We Have a Way to GoConsider the Life Sciences

• Good News– We have NCBI/EBI– Publishers are starting

to embrace data– Workflows in support

of the research lifecycle are catching on

• Bad News– Sustainability remains

a noun not a verb– Data are organized by

type not by questions asked (silos)

– Tenure committees are still in the dark ages

What Can We Do As a Community?

Build Trust

Trust in the dataand the derived knowledge

WikiSym+OpenSym Aug 7, 2013

What I Have Learned About Trust 1/2

• Trust is like compound interest

• Comes from listening

• Comes from engaging the community in every aspect of the process

• Comes from data consistency and level of annotation

• Comes from responsiveness

• Comes from the quality of the delivery service

39WikiSym+OpenSym Aug 7, 2013

What I Have Learned About Trust 2/2

• Quality begats trust– Quality requires data models/ontologies

• Quality requires people– Annotators are the unsung heroes

• Trust requires provenance & versioning

• Trust requires explaining that all data and knowledge are not created equal

Beyond Building Trust What Else Can We Do?

Think Globally Act Locally

• Support emergent community commons/portals• Be involved in the support and development of

metadata standards• Contribute to workflow development etc. to drive

an open research lifecycle• Educate your mentors on the importance of

open science and scholarly communication • Write software thinking of an App model

Understand That All Data/Knowledge Are NOT

Created Equal• We need to understand

how data are used• Sustainability is not

more money from the funding agencies its about business models

• Reductionism is not a dirty word

• We need to do more with the long tail

On the Future of Genomic DataScience 11 February 2011: vol. 331 no. 6018 728-729 WikiSym+OpenSym Aug 7, 2013

Recognize That Institutions Must Play a Greater Role

• We need institutional data/knowledge sharing plans

• We need data/information scientists to be better recognized by institutions – its not all about papers – this implies new metrics

Learn from the App Store

• The App model– Think of it operating on a content base rather

than a mobile device– Simple and consistent user interface– Needs to pass some quality control– Has a reward

• The App+ Model– Apps interoperate through a generic workflow

interface

In Summary

• Open science is a means to accelerate the rate of discovery

• Disruption has begun, but there is great inertia in the system

• All of us are stakeholders and capable of invoking further positive change

• We need to get institutions and more scientists involved….

Acknowledgementswww.force11.org

pbourne@ucsd.edu

• Force11 Manifesto• Fourth Paradigm: Data Intensive Scientific

Discovery http://research.microsoft.com/enus/collaboration/fourthparadigm/WikiSym+OpenSym Aug 7, 2013 48

The Era of Open

Education

Open Banking A new era begins - Lloyds Bank Cardnet · Open Banking: a new era begins 4 Open Banking introduces new opportunities for banks to work with merchants and other third

A new era in the management of open abdomen

Managing Open Source software in the Docker era

Open stax history_ch16 the era of reconstruction, 1865-1877_imageslideshow.ppt

The Era of Big Spatial Data: A Survey - UCReldawy/publications/DBSJ_survey.pdf · The Era of Big Spatial Data: A Survey ... of the art work and highlighting open research problems

ISSN 1883-1974 (Print) Toward an Era of 57 Open …open data, are essential in promoting open science. Recently, the Linked Open Data (LOD) have attracted attention and are starting

Tele-production of miningscapes in the open-pit era: The

Era of Crisis is Now - Open Minds Planning Innovation 2014-06

The Era of Open Innovation

Assessing Public Participation in an Open Government Era

The Role of Open Platform in the Coming Era of Ship ... Project_ANDO... · The Role of Open Platform in the Coming Era of Ship Digitalization (船舶デジタライゼーション時代に向けた船舶オープンプラットフォームの役割)

CHAPTER The Civil Rights Era (1960s–1970s): Development of ... · This was the era that prompted the Open Systems and Social Equity themes of public administration. Development

Open repair of thoracoabdominal aneurysm in the endovascular era

Open DevOps: Transparency and open source in the modern era

The Open Era of Computing

Chesbrough - 2003 - The Era of Open Innovation

Study of the response of open CR-39 detector to radon and - eRA

The Scientiﬁc Method in the era of Big (Open) Data · receive updates of content hosted in the portal Figure 1. Open Science Taxonomy Open (Digital) Science source: Pontika : et

High Performance Computing in the Open Data Science Era

Confronting API Security in the Brave New Open Banking Era