SOME THINGS WE NEED TO KNOW ISRAEL LEDERHENDLER, PH.DNATIONAL INSTITUTES OF HEALTH

EVALUATION 2009NOVEMBER 12, 2009

Managing information overload

Outputs and Outcomes Exploiting knowledge; Finding disruptive ideas

Scientist are entrepreneursMaking ideas count

Measuring Innovation

It’s Almost Always About Innovation

Lederhendler, Nov 2009

Factors Driving NIH Decisions

Public Interest and Societal Demands

Public Health Requirements

Scientific Opportunities

NIH Funding Priorities

Funding Priorities of

Institutes and Centers

Lederhendler, Nov 2009

APPLICATION PEER REVIEW PROGRAM & COUNCIL

GRANTS MANAGEMENT

PROGRAM: PRE & POST AWARD

Title Summary Statement RFAs, RFPs, PA’s Special Actions

Notice of Grant Award

Progress reports, checklist

Abstract Merit Evaluation Funding Recommendation

Terms & conditions Workshops, conferences

Specific Aims Evaluate Specific Aims

Administrative Actions

Checklist Scientific Initiatives

Research Methods Significance Impact Initiatives, mission relevance

Training Data

Personnel Expert Roster Roster Administrative Assistance

Technical Scientific Assistance

Budget Request Budget considerations

Final budget approval Budgetary Adjustments & Oversight

Scientific Oversight

Institution Bars, regulations Institute Policy Regulatory compliance oversight

Opportunities, trends, gaps

Docu

men

ts a

nd

Decis

ion

sNIH Data is Mostly Generated from the Grants Business Process

Str

uctu

red

Data

Un

str

uctu

red

Da

ta

Lederhendler, Nov 2009

Office of the NIH Director

Publications & Biomedical Progress

Databases

(examples)

Think Tanks (examples)

Reports to Congress Conference Abstracts Thomson ISI NAS/Institute of Medicine

Reporting

Data Calls

Medline Scopus RAND

Scientific Coding

Portfolio Analysis

PubMed Central Ovid Families USA

Trans-NIH Initiatives Research Advances Gene Ontology ResearchAmerica!

Workforce &

Infrastructure

Clinical Trials Swiss-Prot IDA/STPI

Budget Preparation Drugs, Diagnoses & Treatments

ClinicalTrials.Gov NIH Consensus Conference

Policy

Policy Analysis

Treatment Guidelines

Additional Data from Analysis and Other sources

Ou

tpu

ts a

nd

Ou

tco

me

s

Data External to Grants Database

Lederhendler, Nov 2009

Publications & Citations Data

Adoption and diffusion of academic ideas

History and structure of scientific communities

Identification of disruptive ideas

DIMENSIONS OF INNOVATION

Lederhendler, Nov 2009

Validity

Data quality

New communication media

PUBLICATION AND CITATION DATACan’t live without it

Lederhendler, Nov 2009

Adoption and Diffusion Science of Networks

Describe the evolution and structure of scientific communities

History and Structure of a FieldLederhendler, Nov 2009

This visualization tracing citations shows that two seminal papers in 2002 and 2003 are widely cited in the community.Visual Overviews for Discovering Key Papers and Influences Across Research Fronts. Aleks Aris1, Ben Shneiderman1, Vahed Qazvinian2, and Dragomir Radev2 – thanks to Ping Want

EVALUATING IMPACT

IDENTIFYING DISRUPTIVE IDEAS

Lederhendler, Nov 2009