Heesang Jeon, Principal Product Manager

25th June 2021

SciVal

What have we done and

what’s coming in 2021?

South Korea User Group

• 3 July, 2019

• Robber t jan Kalf fand Chr is Jam es

1. What have we been working on?

2. A view into our kitchen

3. Where are we going?

Agenda

Meet the team

Product team User ExperienceSoftware Development Analytics

SciVal today

• Global market leader

• More than 1,400 customers, across 80 countries. Predominantly academic institutions.

• Strong customer base in China, UK, US, Japan and Australia

• Corporate customers include Unilever, Siemens, Boeing

• Several funding organizations andnational government bodies

• Cover more than 20k institutions in SciVal

Unique Users global + 44% YTD

Data enhancements - 20,225 Institution Profiles to date

We have added ~4,000 profiles in 2020, 1,150 of them were corporate profiles.

Institution

OrgDB

Manualcuration

2ndLineSupport

IPW

Customers/Customer Consultants

10,400

16,070

20,042

6,048 7,061

8,609

1,613

5,044 6,163

2018 2019 2020

Over the last 12 months – 10 releases with over

75 notable release items

Enhanced interface:

• New graphics• Matrix table• Chord diagram

• Roof-shaped matrix• Heatmaps

• Timeline motion chart• Reference lines • Bubble chart

• Draggable wheel tooltips• Improved homepage

New metrics:

• THE Rankings metrics• Open Access analysis• Authorship

• Topics for Research Areas• Scopus Source as a new entity type

Over the last 12 months – 10 releases with over

75 notable release items

• THE World University Rankings 2021

• 112 New Topics and 1 new Topic Cluster

• Update to SDGs + free layer (scival.com/sdg)

• Increase export from 20k to 100k

• Enhancements to import large hierarchies over multiple sessions

• Additional metrics guidance and enhanced Support Center

• Curated Research Areas – including COVID-19 and Quantum tech

• Report templates – share and edit user defined + Word export

• API updates

Let’s take a quick look at the

highlights!Time to go online

1. What have we been working on?

2. A view into our kitchen

3. Where are we going?

Agenda

SciVal’s design principles

Accuracy Flexibility Transparency

Our innovation projects

Customer collaboration Project team Experiments

Interviews (needs & problem)

Testing

Prototype feedback

UX designer

Engineers

Data scientists

Product Manager

Paper experiments

Designs

PrototypesSME

1. What have we been working on?

2. A view into our kitchen

3. Where are we going?

Agenda

We’re playing in a dynamic and exciting market

• The needs of our customers are evolving• Competition is intensifying

1. Increasing competitiveness / high stakes attached to research investment decisions => Strategic Planning Use Case

2. Push for broader impact measures => need to diversify SV beyond

bibliometric indicators

Our Product Strategy addresses these dynamics

Grow the core value proposition

Expansion of baseline data sets

Capability investments

We’re focussing on 9 Innovation themes within these objectives

New module: outside-in perspective for strategic research planning, providing funding insights & benchmarking from funding agency awarded grants

Deeper insights & benchmarking for your university ranking strategyUniversity Ranking

enhancements

Deeper Research Performance analysis

Faster data processing

Custom Area of Research definition & global library

Funding insights & benchmarking

Societal impact insights & benchmarking

New module: insights & benchmarking for societal impact. Policy citations, SDGs and attention metrics likely for MVP, followed by clinical citations

Perform more fine-grained analysis

Handle more data & datatypes. Faster processing of data, more subject classifications, larger limits, etc.

Better define area or analysis, predefined hot topics by editors and customer shared research areas

Onboarding new users

Institution hierarchies

Improved collaboration analysis

Help get new users up to speed quickly. Give content at login. Guide users on responsible use of metrics etc

Easier overviews and benchmarking on the hierarchy within an institution

Discover new collaboration partners by analyzing citation networks

SciVal Roadmap – Summary (subject to change)

Innovation Theme

MVP

NOAM - MVP Region 2 - MVP

MVP

THE WUR 2022

Export report as Word doc

Automated update from OrgDB (Scopus)

Discovery

Problem–Solution fit with 5 col laborating customers

Migration ongoing

Authorship analysis – res group

Problem–Solution fitOpportunity

Q1 Q2 H2

Solution-Market fit

More subject class (BM) onlyFlexible date ranges in Collab

Global l ibrary of research areas(editor defined)

Export to VOSviewer

Discovery & prototyping

New SDGs

University Ranking enhancements

Deeper Research Performance analysis

More scalable, faster and flexible data processing

Custom Area of Research definition & global library

Onboarding new users

Institution hierarchies

Improved collaboration analysis

Funding insights & benchmarking

Societal impact insights & benchmarking

Enhanced customisation Global l ibrary of research areas(customer shared)

Linking Collaboration and

Trends through Topics

22,500 Inst Profiles

More FWCI transparency

Enhanced guidance for new usersA/B TestingDiscovery – Scopus to SciVal

New Topics

OrgID as used by THE (snapshot)

Elasticsearch delivers 70% BM metrics

Additional RAs

Better HQ management

Problems:

Regional Collaboration:

Need

Insights & benchmarking for societal impact

As a research leader I need to demonstrate societal impact to improve the

perception of the university (in the public, international students strategic

international partnerships), to support national assessment impact case studies

and to support grant applications

→ Societal impact is hard to define

→ The main method currently, impact case studies, are extremely labor intensive

→ Baseline data sets still to be defined (policy, attention, media and SDGs)

APAC & MAEU: Problem – Solution fit stage • Define baseline set of organizations,

• First paper experiments,

• Looking for additional candidates

EMLA & NOAM: Problem – Solution fit stage • Needs & problem interviews

SciVal Rankings enhancementsRobust information and transparency around the bibliometrics used in the THE World University Rankings

SciVal Rankings enhancements enable you to:

• Analyze, understand and generate insights based on the actual FWCI and Citation

Scores used to make up 38.5% the THE WUR score, rather than proxies developed

in-house

• Benchmark at the THE subject level for deeper understanding of your university’s

position and to inform faculty and department level plans

• Analyze, benchmark and produce peer comparison reports across all bibliometric

drivers directly in the Benchmarking module

• Analyze the trends in the bibliometric drivers to enrich your understanding and inform

plans accordingly

• Remove the need for manual curation and the development of proxy indicators

SciVal: Robust information and transparency around

the bibliometric dataset considered in 38.5% of the

Overall Score in the THE World University rankings

SciVal Rankings enhancements – complimentary to THE

DataPoints

THE DataPoints: Understanding institutional performance is essential for universities to advance in their strategic goals

and to help them to present themselves in rankings. THE

DataPoints unlocks the data behind the rankings, and

provides visibility of institutions’ performance in a global

context.

Problems:

Regional Collaboration:

Need

Benchmarking funding performance in areas of research, using a baseline set of Funders.

As a research leader, I want a full perspective on funding for our strategic

research planning tasks, so that we can make better investment, hiring and

collaboration decisions

→ External perspective on funding is missing, both regionally & globally

→ Hard to get data about the dynamics at research area (topic) level

→ Information on foundations, corporate funding and smaller funders is missing

→ Benchmarking on funding performance against peers or aspirant institutions is

NOT happening

→ Funding forecasting done at a central level is not evidence driven at the

moment

NOAM: Market-Solution fit stage.

Collaborating with 5 customers on running strategic research planning

projects

APAC: Problem-Solution fit stage

Initial discussions started, looking for additional candidates

Address funding insight needs in strategic

research planningProposition: Benchmarking funding performance at a Topic Group level

US Federal funders, foundations and major international funders Major international funding bodies

from research intensive regions

.. we’ll grow the list with

your feedback

Analyze the funding landscape in a focus area

Get funding trends

on:

• # Funders in

this area

• # institutions

are getting

funded

• Median

awarded grant

• Awards volume

Analyze a focus area – Funders, Institutions

and Topics

• Is a Funder’s investment going

up / down?

• Who else got grants from the

Funder?

• Institution (future

collaborator/competitor?)

• PI (future hire?)

• What researchers are getting

funded?

• Awarded grants

• Topics

• What are the resulting

publications from the research?

Analyze who and what the Funders are supporting

Compare funding in your strategic research

focus areas or Funders

Funding view of my research

portfolio

• Compare your focus research

areas or Funders against

each other and global trends

Licensing and

other IP income

Spinouts

(capital gains)

Patents

(forward citations)

Patents

(forward citations)

Research

Publications

Patents

Ran

kin

gs &

Natio

nal

Assessm

en

ts

Tuition fees

(international

students)

Research

income

Collaboration

opportunities

Researchers

Output Outcome / Impact

Outcomes not

related to patentsOther factors

Evaluation Indirect Benefit

Why patents matter to universities

Research

Publications

Ran

kin

gs &

Natio

nal

Assessm

en

ts

Tuition fees

(international

students)

Research

income

Collaboration

opportunities

Researchers

Output Outcome / Impact

Outcomes not

related to patentsOther factors

Evaluation Indirect Benefit

Opportunity – Impact, Rankings & Assessments

Licensing and

other IP income

Spinouts

(capital gains)

Patents

(forward citations)

Patents

(forward citations)

Patents

Top innovative

universities

GVM Taiwan University

Rankings

Top innovative

universities

GVM Taiwan University

Rankings (PAI)

Top innovative

universities

Elsevier provide research-

citing patents data to THE

and GVM. GVM also uses

Patent Asset Index.

SV economic impact metrics

not good enough in isolation,

without ability to drill down.

Narratives or case studies

need details, not just numbers

UCD and Imperial

college – they

couldn’t figure out

why they slipped

down in the Reuters

ranking. Insights

needed.

Thank youQuestions?