Embed Size (px)
Citation preview
| 1 | 1 | 1
Analysis of research performance
SciVal tailored for Poland
Peter Porosz, October 9th 2018.
| 2 | 2 | 2
Welcome to the Polish SciVal user community!
• Starting January 2018, Elsevier’s SciVal solution is available to all universities and research institutions in Poland.
• Poland is among the top countries in Europe for SciVal usage intensity (other top conutries are: UK, Italy, Russia)
• SciVal provides a powerful tool for:
- researchers,
- research managers,
- research administrators,
- research evaluators.
• SciVal enables flexibles analysis of:
- research performance of individuals, research groups, institutions,
- collaboration networks,
- areas and topics of research.
• Elsevier provides training and consulting opportunities for SciVal and has set up a Research Evaluation Academy for Polish professionals. Please stay tuned for more information on all of these programs.
• We encourage you to be an active part of the community. Your kind feedback and contributions are welcome!
| 3 | 3 | 3
Objectives for today
Analyse research performance effectively in SciVal.
In this webinar we walk through an in-depth analysis of research performance using SciVal.
The program will consider assessment requirements set forth in the new national law (“2.0”).
Topics for today include:
• SciVal in a nutshell
• Key resources: SciVal Polska web site and Research Academy
• How can I use SciVal to analyse individual research performance? - How to work with classification systems?
(ASJC, Fields of Science, Polish classification)
- How to define researchers?
- How to get to the publications?
- How to select the “best” publications?
| 4 | 4 | 4
SciVal in a nutshell
SciVal offers quick, easy access to the research performance of over
10,000 research institutions and 230 countries and regions
Visualize
research
performance
Benchmark
your progress
Develop
collaborative
partnerships
Ready-made-at a
glance snapshots
of any selected
entity
Flexibility to create
and compare any
research groups
Identify and analyze
existing and potential
collaboration
opportunities
Analyze
research
trends
Analyze research
trends to discover the
top performers and
rising stars
| 5 | 5 | 5
The layers of SciVal
Big Data technology
Publication, citation and usage data (Scopus)
Awarded grants, mass media mentions, patent-article citations
Data in SciVal is updated every week and is roughly 3 weeks behind Scopus.
Thus, you’re always guaranteed the most up-to-date information.
| 6 | 6 | 6
Publication, citation and usage data (Scopus)
mass media mentions, patent-article citations
Publication, Citation, usage data
The foundation of SciVal
| 7 | 7 | 7
Accessing SciVal at www.scival.com
If you haven’t previously registered for Scopus or ScienceDirect then please go to
Register Now. Use VPN off-campus or ask Shelly for a Remote Access link
| 8 | 8 | 8
SciVal’s key differentiators
1. Incredibly flexible and easy to navigate
Get started right away and perform insightful analysis within
minutes!
2. Based on most comprehensive data source in the world,
Scopus
Scopus is the most widely used and trusted data source for
researchers and research evaluators worldwide. It has a
distinct content advantage for Poland and Central&Eastern
Europe.
3. Allows analysis and scenario modeling for
any researcher, group, organizational unit or institution
This is your opportunity to see as well as be seen in the world
of research.
| 9 | 9 | 9
SciVal Polska Web Site
elsevier.com/scival-polska
| 10 | 10 | 10
SciVal Polska Research Academy
• What will you learn?
- What is SciVal and how to use it like a pro
- Framework to train the academic and research community
- Use cases for researchers, librarians, bibliometricians,
research administrators and research evaluators
- What to expect from the SciVal Support Team
• What can you use to learn it?
- Live webinars (like this one)
- Collection of recorded webinars
- Support material (such as SciVal Metrics Guidebook)
- On-site training: October to December
| 11 | 11 | 11
How to work with
classification systems?
| 12 | 12 | 12
How to work with classification systems
(ASJC, Fields of Science, Polish)
• The native classification system of Scopus is „ASJC”.
• SciVal also provides the Fields of Science and Technology („FOS”)
classification, which is used by OECD.
• Fields of Research and Development („FORD”) is being planned in
SciVal.
• ASJC to FOS mapping by Elsevier is done at a journal level.
• Polish categories roughly, but not directly correspond to FOS
(OECD).
• There is an ongoing professional initiative within the Polish scientific
community, to map the Polish categories to FOS/FORD.
• Elsevier provides advice and consulting to the Polish community
to work with our solutions for best effect, under the Polish
classification.
| 13 | 13 | 13
Mapping categories and Working Strategies
Example: Natural Sciences and Social Sciences
Description by MNiSW (Disciplines in the OECD classification)
Biological Sciences Biological Sciences biological sciences
Chemical sciences Chemical sciences chemical sciences
Computer and information sciences Informatics computer and information sciences
Earth and related environmental sciences Earth and related environmental sciences earth and related evironmental sciences
Mathematics Mathematics mathematics
Other natural sciences
Physical sciences and astronomy
Astronomy physical sciences (in the field of astronomy)
Physical sciences physical sciences (excluding astronomy)
Economics and business
Education sciences Education sciences education sciences
Law Law law (excluding canon law)
Media and communication Media and communication media and communication
Other social sciences
Political science Political science and administration Political science (excluding security sciences)
Psychology Psychology psychology
Social and economic geography Social and economic geography social and economic geography (excluding town planning)
Sociology Sociology sociology (excluding anthropology and ethnology)
Economics and finance economics and business (excluding spatial economy, business and managment)
Security Studies political sciences (in the field of security sciences)
Management and Quality Studies economics and business (in business and management)
Canonic Law law (in the field of canon law)
Social SciencesSocial Sciences
Natural Sciences Natural Sciences
FOS Polish disciplines
• Green: exact 1:1 equivalent use it automatically in SciVal
• Orange: approximative equivalent use it with manual curation in SciVal
• Grey: partial or no equivalent define Research Area in SciVal
| 14 | 14 | 14
Green
Exact 1:1 equivalent use it automatically in SciVal
Example
The publications are available for analysis.
| 15 | 15 | 15
Orange
approximative equivalent use it with manual
curation in SciVal
Example – Step 1.
| 16 | 16 | 16
Orange
approximative equivalent use it with manual
curation in SciVal
Example – Step 2.
The publications are available for analysis, following manual curation.
| 17 | 17 | 17
Grey
partial of no equivalent define Research Area
in SciVal
Example – Step 1.
| 18 | 18 | 18
Grey
partial of no equivalent define Research Area
in SciVal
Example – Step 2.
| 19 | 19 | 19
Grey
partial of no equivalent define Research Area
in SciVal
Example – Step 3.
| 20 | 20 | 20
Grey
partial of no equivalent define Research Area
in SciVal
Example – Step 4.
| 21 | 21 | 21
Grey
partial of no equivalent define Research Area
in SciVal
Example – Step 5.
| 22 | 22 | 22
Grey
partial of no equivalent define Research Area
in SciVal
Example – Step 6.
The publications are available for analysis.
| 23 | 23 | 23
How to define researchers?
| 24 | 24 | 24
Several options are available:
Define new / Import / Define new Group
| 25 | 25 | 25
Define new: 3 simple steps
1. Provide name
2. Select from potential matches
3. Validate publications (optional)
| 26 | 26 | 26
Define new: researcher profile ready for analysis
| 27 | 27 | 27
Import: through a spreadsheet
(or simply Scopus IDs/ ORCID)
| 28 | 28 | 28
Import: the matching algorithm
| 29 | 29 | 29
Create new group
• New Researcher Groups can be created from already
defined / imported Researchers
• Analysable the same way as any other pre-defined entity
(e.g. university)
• Can be used to map an organizational structure into SciVal.
• Can be shared within the organization:
local administrator’s privileges are required for that
Please apply for local administrator privileges via Elsevier Support
• Some “new law” driven analytics are best performed at an
individual researcher level, due to high interactivity and
manual curation/optimization involved in the process. E.g.
- counting all publications can be done at group level
- selecting “best publications” is best done at individual level.
| 30 | 30 | 30
Creating new group / example
| 31 | 31 | 31
Creating new group / example
| 32 | 32 | 32
How to get to the publications?
| 33 | 33 | 33
Getting to the list of publications
Possible for any analysable entity (researcher, group, university)
| 34 | 34 | 34
Getting to the list of publications
| 35 | 35 | 35
Getting to the list of publication: export
| 36 | 36 | 36
Getting to the list of publication:
results for further analysis
| 37 | 37 | 37
How to select the “best”
publications?
| 38 | 38 | 38
How do we define “best”?
• A number of metrics can be considered, such as:
- Total citations
- Field Weighted Citation Impact useful to compare across disciplines!
- International / industrial collaboration
- Journal metrics, such as CiteScore
• Qualitative (non-qualitative) judgement can be considered
- Peer review (post-publication)
- Self-submission: “This is my best paper and I know it.”
• In the Polish system, the publication source journal is considered,
and the journal SNIP is a key metric.
- SNIP = Source Normalized Impact Per Paper
- Reflects “relative citedness” of all articles in the journal
- Works as a proxy for researcher performance.
| 39 | 39 | 39
Getting the SNIP of publications
• Can be done at group level (seen before)
• Can be done very flexibly at an individual level
- Either by exporting results (seen before)
- OR:
| 40 | 40 | 40
Getting the SNIP of publications: the result list
| 41 | 41 | 41
Conclusions
| 42 | 42 | 42
We are here to help!
• SciVal can be used to support reporting under the new law.
• There are suggested “use cases” and “best practices” for this
purpose.
• We continue to devise and share such use cases and practices, for
the benefit of the community
- Via webinars
- Via on-site trainings
- On Library Connect, Poznan 13th November
- On the SciVal Polska web site and the Research Academy
• We continue to encourage you to experiment and use SciVal not
only for compliance, but innovation and excellence.
• Your feedback is highly appreciated!
- We use it to develop training as well as new product features.
| 43 | 43 | 43
www.elsevier.com/research-intelligence
Please rate this webinar in BrighTalk:
how relevant was it to your work?
Wishing you much success
Peter Porosz
