15
JANUARY 2014 PAM BISHOP NIMBioS EVALUATION 5 $ S

Bishop germany 2015_slidesh_part a

Embed Size (px)

Citation preview

JANUARY 2014

PAM BISHOP

NIMBioSEVALUATION5

$S

NIMBioS numbers

5000+Participants

Investigative Workshops

Postdoctoral Fellows

Working Groups

94 meetings

Short-Term Visitors

Sabbatical Fellows

Educational Activities

200+

13

237

34

37

32

400+Scholarly

Articles

Evaluation Model

Systems approach

context

FEEDBACK

surveys

product

interviewsbibliometrics

process

document

analysis

input

demographic

surveys Network

analysis

Science

mapping

V9 88

evaluation componentswhat is evaluated

context

Goals that guide

input, process, and

product evaluations

input

Responsiveness of

inputs to goals

process

Monitor document,

and assess center

activities

product

Quality and

significance of

outcomes

(

Tailored to your charitable

and financial interests

input

8

V

Diverse pool of applicants

Range of disciplines supported

Necessary supports

Benchmarksparticipant diversity

29%

40%

40%

Female

21%

17%

13%

Non-U.S.

9%

11%

12%

Under-represented Groups

15%

13%

18%

Local

Working Groups Investigative Workshops All Activitiessss

Benchmark

N = 4912

Research Disciplines

31%

19%

12%

7%

5%

4%

4%

2%

2%

2%

2%

1%

1%

1%

0%

Ecology

Evolutionary Biology

Mathematical Biology

Zoology

Microbiology

Other*

Mathematical Ecology

Biochemistry

Neuroscience

Biology

Biophysics

Physiology

Parasitology

Cellular Biology

Environmental Science

44%

31%

5%

5%

3%

3%

2%

1%

1%

1%

1%

1%

1%

0.3%

0.1%

0.1%

Biological Sci

Mathematics

Agricultural Sci

Health Sci

Social Sci

Computer Sci

Engineering

Marine Sci

Physics

Education

Chemistry

Other

Geology

Humanities

Psychology

Atmoshperic Sci

participant diversity

N = 4912

Other diversityGeographic

University faculty50%

Undergrad13%

Grad student13%

Postdoc12%

Government5%

University staff4%

Non-profit2%

Industry1%

CAREER STATUS12%

5%

2%

0.5%

Not reported

Visual

Hearing

Mobility/orthopedic

ability

N = 4912

Event Discipline Areas

0 10 20 30 40 50 60

Population and Evolutionary Processes

Quantitative methods

Ecological Biology

Ecosystem Science

Epidemiology

Agriculture

Behavioral Systems

Economics and social sciences

Physiology and Immunology

Environmental Sciences

Anthropology

Systematic Biology

Biophysics, Biomechanics, and Bioengineering

Developmental Systems

Cellular Systems

Microbiology

Neuroscience

Psychological and Language Sciences

Genes and genome systems

Biomolecular Systems

EducationWorkshops Working Groups

Participant supporthappy = productive

98%

96%

90%

90%

Ho…

Fa…

Fa…

Tr…

Participant Accommodations

Facility comfort

Facility resources

Organizer Satisfaction

NIMBioS handling of event

Working Groups

n = 54Travel

100%

Housing

All of your help with the

logistics of travel, food,

and technology was

extremely helpful and

allowed us to focus on the

content of the working

group instead of small

details.Expanding Data Nuggets WG

Organizer, 2015

Year Six Data

N = 70

process

9

Group collaboration

Knowledge gains

Roadblocks to success

Factors contributing to success

Process improvement

Process Outcomesworking groups

First 6 Years

N = 1032

Process Outcomesworking groups

Exchange of ideas will

influence future research

91% 94%

Helped them understand the

research happening in other

disciplines

Developed unanticipated

plans for collaborative

research

Year 6 Working Group Participants

N = 70

91%

Process outcomesWorking groups

0 20 40 60 80 100

new methods and modeling techniques that need to be developed

-As a result of participating in this Working Group, I have a better understanding of:

the research data available on the working group's topic

the modeling techniques available on the working group's topic

Agree

the types of data needed to better inform existing models

Neutral DisagreeYear 6 Working

Group Participants

N = 70

Play, Evolution, and Sociality WG2011

Modeling antimicrobial resistance WG2014

TESTIMONIALSPARTICIPANT EXPERIENCE

Productivity…

I think the recent NIMBioS working group meeting was the most

productive, useful, and collaborative experience in my career to date. I

am simply thrilled to be a part of it.

Unique experience…

Bringing together people with different backgrounds, perspectives, and

expertise to address the issue. [Ours] is a complex problem that

requires collaborations among experts from a number of fields. Given

the number of disciplines involved it is difficult to get so many people to

work together without such a forum as NIMBioS.