STRATEGY TOWARDS HIGH IMPACT JOURNAL - mycc.mymycc.my/document/files/Bengkel Kelestarian Jurnal/Presentation... · bengkel kelestarian jurnal, 11-13 januari 2017, akept, bandar enstek,

BENGKEL KELESTARIAN JURNAL, 11-13 JANUARI 2017, AKEPT, BANDAR ENSTEK, NEGERI SEMBILAN

STRATEGY TOWARDS HIGH IMPACT JOURNAL

PROF. DR. MD MUSTAFIZUR RAHMAN

EDITOR-IN CHIEF

International Journal of Automotive and Mechanical Engineering (Scopus Index)

Journal of Mechanical Engineering and Sciences (Scopus Index)

DEAN OF RESEARCH (ENGINEERING)

Universiti Malysia Pahang, 26600 Pekan, Pahang, Malaysia

Email: [email protected]

Contact: +60163775026 (H/P); +6094245027

mailto:[email protected]


Publisher: UMP

Editor in Chief Dr. Muhamad Mat NoorProf. Dr. Md Mustafizur Rahman

Editor in ChiefProf. Dr. Md Mustafizur RahmanDr. Muhamad Mat Noor

Publisher: UMP

Scopus and ERA Indexed

Scopus Indexed


SCOPUS RANKING

International Journal of Automotive and Mechanical Engineering (IJAME)

CiteScore: 2.58

Rank: #8/62 (Automotive Engineering; 87 percentile);

#50/520 (Mechanical Engineering; 90th percentile)

Journal of Mechanical Engineering and Sciences

(JMES)

CiteScore: 1.86

Rank: #5/38 (Computational Mechanics; 88 percentile);

#93/520 (Mechanical Engineering; 82th percentile)


Team IJAME

Team JMES

Executive Editorial Team (IJAME and JMES)

Editor-in-ChiefFor IJAME and JMES


| 5

• Analyzing journal indicators / journal metrics

• How to make your journal visible / improve journal ranking based on the journal indicators

• Experiences, issues and challenges in managing a Scopus-indexed journal

• Roles as lecturer and journal editor : How to manage

Outline


CITATIONS AS A PROXY OF SCIENTIFIC IMPACT

Quality Scientific impact

Relevance

Visibility

Random factors

Reputation

Citations

Citation analysis


“There is no single ‘best’ indicator that could accommodate all aspects of the new reality of bibliometrics”

- Wolfgang Glänzel, Head of bibliometrics group Professor at KU Leuven, Belgium

“Using the Impact Factor alone to judge a journal is like using weight alone to judge a person’s health.”


JOURNAL METRICS

• Most prominent metric is Journal Impact Factor (JIF)

• There are many metrics, some of them claimed to be better than JIF

• Metrics are calculated on an underlying database

• Other database are Scopus and Google Scholar

• Metrics can assess the journal impact and researcher’s impact.

• Question: What are the best journal metrics to access journals?

• How can these metrics best be calculated?


Currently in the market? – Impact Factor

Impact Factor pros

• Most well-known

• Easy to understand

• Pervasive - stranglehold

Impact Factor cons • Little transparency – underlying database not publicly

available – Impact Factors cannot be reconstructed

• Citation windows available are biased

• 2 years favours rapidly moving fields (very short

time period for many disciplines)

• 5 years favours slowly moving fields

• Depends heavily on the research field

• Easy to mislead and manipulate


Impact Factor

• Only the high quality journals are included (according to Thomson Reuter Criteria)

• Only a limited subset of journals is indexed by ISI• Only uses the articles cited by the ~12,000 “ISI journals”

• Some disciplines are especially poorly covered

• Biased toward English-language journals• ISI has recently added several hundred non-English journals

• Is an average; not all articles are equally well-cited• All citations are equally weighted

• Only articles that are cited within two years after publication contribute to the Impact Factor

• Includes self-citations


Impact Factor

• Only includes “citable” articles in the denominator of the equation, i.e., articles and reviews

• Editors may skew IF by increasing the number of review articles, which bring in more citations…

• Or by increasing the number of “news” items , which are cited but not considered “citable”

• It is expensive to subscribe to the JCR

• Citations are gathered from Journal articles only

• Citations from books, books chapter or conference proceedings are not contributed to Impact factor

• Impact Factor can distort publication polices of journals, if focus on improving their Impact Factors for example by publishing more reviews.


•Classified as a review by Thomson Reuters criteria: • More than 100 references, • It appears in a review publication or a review section of a journal, • The word “review or overview” appears in its title, or • The abstract states that it is a “review or survey”.

• Some fields methodological papers are also more cited than original research papers

Impact Factor


Journal Impact Factor

Pain 6.125

Nature Genetics 38.597

Annals of Mathematics 3.027

Computers & Operations Research 2.374

Progress in Energy and Combustion Science 17.778

Addiction Biology 5.914

Remote Sensing of Environment 6.144

Answer: All of them are the best journals in their subject areas.

With IF journals from different subject fields CANNOT be compared.

Which Journal is the Best Journal?


SJR- SCImago Journal Rank

• Developed by Felix de Moya, CSIC (Spanish Research Council)

• Prestige metric- not all citations are the same

• Citations are weighted depending on the status of the source they come from



Life Sciences

journal

High impact, lots of citationsOne citation = low value

Arts & Humanities

journal

Low impact, few on citations

One citation = high value

SJR normalizes for differences in citation behaviour between subject fields




SNIP: Source Normalised Impact per Paper

• Developed by Henk Moed - CWTS (Centre for Science andTechnology Studies)-Leiden University

• Measures the average citation impact of the publications of ajournal, correcting for the differences in citation practices betweenscientific fields and therefore allowing for more accurate between-field comparisons of citation impact

• SNIP is field normalized, dependent on likelihood of citation insubject field of source

http://www.info.scopus.com/researchtrends/archive/RT7/08126_rt7_6.html

http://www.info.scopus.com/researchtrends/archive/RT7/08126_rt7_6.html


SNIP: Source-normalized impact per paper

Journal IPP Citation Potential SNIP

Inventiones Mathematicae 1.5 0.4 3.8

Molecular Cell 13.0 3.2 4.0

All ~21,000 journals have a Source-normalized impact per paper (SNIP) measuring contextual citation impact by weighting citations per subject field

impact per publication (IPP)

Citation potential in its subject field

+ + +- Peer-reviewed papers only- Field’s frequency and immediacy of citation- Database coverage- Journal’s scope and focus- Measured relative to database median


Example of publishers promoting journal metrics on their journal website


Journal metrics on their journal website


QUALITY OF A JOURNAL

h-index (Hirsch index)• Originated by Jorge Hirsch in 2005

• A group of papers has index h if h of the papers have at least hcitations each, and the other papers have no more than h citations each.

• Can be calculated from publication list when the number of citations is available for the articles (WoS, Scopus and Google Scholar).

• Productivity of a journal over a long time period

• Journals that publish review articles are not over-valued(compare to journal IF)

• Publish or Perish calculates the H-index of journals using citation data from Google Scholar/Scopus

• Also evaluation of the journals not found in WoS database

• Reasonable evaluation to journals that are cited mainly in sources outside the WoS, like in books or in journals that are not included in the WoS.

http://www.harzing.com/pop.htm


H-Index

• The novel property of h is that in one number it summarizes both impact, in terms of citations, and productivity in terms of number of papers.

• It combines both productivity and impact in a single measure that is easily understood and very intuitive.

• It is easily calculated the number of citations either from WoS, Scopus or Google Scholar (GS). Indeed, all three now routinely calculate it.

g-IndexVariant of h-index that emphasizes the most highly-cited papers in a data set

m-IndexVariant of h-index that displays h-index per year since first publication


Analyze Journals in Scopus


Analyze Journals in Scopus


Evaluation of Journal: Quantitative Methods

• Circulation and usage statistics• Large circulation and plenty of readers testify the quality of the journal

• Its own subject area (Important)

• Subscriptions: Open access, EBSCOHOST, DOAJ, Ulrich’s International Periodicals, and from publishers website.

• Acceptance and Rejection Rates • Large number of manuscripts

• Have a high rejection rate seen to be prestigious

• Journal often inform their acceptance and rejection rates on their websites

• Indexing services covering the journal

• Assessing electronic journals


• Citation index evaluated by measuring the it has received.

• The and used are also important

• Databases with citation information Web of Science (WoS) (Thomson Reuters, former SCI by ISI)

Scopus (Elsevier)

Google Scholar (also Non-scientific)

New: Altmetrics

Visibility and impact of the article in web and social media - Fast

Quality of Scientific Articles


Quality of a Journal

•The characteristics of a quality journal are:•High standards for acceptance of manuscripts•A broadly representative editorial board•A critical refereeing system•Promptness of publication•Coverage by major abstracting and indexing services•High confidence level of scientists in the contents•High frequency of citation by other journals


Quality of a Journal

•New factors for measuring the impact • Take into account the quality of the journal citing the article• Based on the PageRank algorithm• Significance to be seen

• Impact Factor (IF)

• Eigenfactor (EF)

• Article influence (AI)

• H index

• SCImago Journal Rank Indicator (SJR),

• Source Normalized Impact per Paper (SNIP)

• CiteScore

WOS

SCOPUS



Feature Web of Science Scopus Google Scholar

Availability Subscription based Subscription based Freely accessible

Number of journals Over 12.000 peer-reviewed journals Over 21,000 peer-reviewed journals Information is not publically available

Other contents Conference proceedingsConference proceedingsProfessional magazinesPatents and book series

Books, pre-prints, theses and dissertations, and webpages

Main disiplinesNatural Sciences, Technology, Social Sciences, Fine Arts and Humanities

Physics, Technology, Health Sciences, Bio sciencesFine Arts and HumanitiesSocial Sciences

Information is not publically available

Time spanFrom 1900 (Science), 1956 (Social Sciences) and 1975 (Arts and Humanities)

Some of the journals from 1966, others from 1996

Information is not publically available

Up-dates Weekly DailyInformation not publically available, but more or less weekly

Citation analysis Citation Report -tool View citation overview -toolSearch report with a 'Cited by' link, giving all publications which cite the publication in question

REVIEW OF JOURNAL CITATION INDICATORS



Feature Web of Science Scopus Google Scholar

Indicators

Journal Citation Reports:- Article Influence (AI)- Eigenfactor- H-index- Immediacy Index- Impact Factor (IF)

- H-index- Impact per publication (IPP)- SCImago Journal Rank (SJR)- Source normalized impact per paper (SNIP)- CiteScore (Impact Factor)- Field-Weighted Citation Impact (FWCI)

- H-index- Total citations

Tools- Journal Citation Reports- Eigenfactor- ScienceWatch

- Scival- SCImago Journal and Country Rank- CWTS Journal Indicators

- Publish or Perish

Time span of citation information

From 1900 (Science), From 1956 (Social Sciences) and From 1975 (Arts and Humanities)

From 1996Information is not publically available

Type of articles

Journal articles Journals, proceedings, books Almost all types of source

Collection policy

Public PublicInformation not publically available, Contracts with most significant publishing houses


Journal Evaluation Indicators

IndicatorTools providing the indicator

Source database Citation window Weight of citations Self-citations

Impact Factor (IF)Journal Citation Reports Web of Science 2 years (5 years)

All citations are weighted equally

Journal self-citations are include

Eigen Factor (EF) Eigenfactor.org, Journal Citation Reports

Web of Science 5 yearsWeights citations based on the prestige of the citing journal

Journal self-citations are ignored

Article Influence (AI)Eigenfactor.org, Journal Citation Reports

Web of Science 5 yearsWeights citations based on the prestige of the citing journal

Journal self-citations are ignored

SCImago Journal Rank Indicator (SJR)

Scimago Journal & Country Rank, Scopus

Scopus 3 yearsWeights citations based on the prestige of the citing journal

Max 33 % journal self-citations are included

Source normalized impact per paper (SNIP)

CWTS Journal Indicators, Scopus

Scopus 3 yearsAccounts characteristics of journal's subject field

Journal self-citations are included

H-index Scopus, Web of Science, Scimago Journal & Country Rank, Publish or Perish

Scopus, Web of Science, Google scholar

Can be defined Not weightedIncluded(Can be removed)

g-index Publish or Perish Google scholar Can be defined Not weighted Included

Field-Weighted Citation Impact (FWCI)

Scopus, SciVal Scopus 3 yearsRatio of the citations in the subject field



• He established the first citation indexes (Science Citation Index)

• WoS and Scopus differs significantly between different fields.

• The natural sciences, where coverage is very good.

• The social sciences where it is moderate and variable.

• The arts and humanities where it is generally poor.

• The coverage of Google Scholar (GS) is generally higher, and does not differ so much between subject areas, but the reliability and quality of its data can be poor.

• GS generates a significantly greater number of citations for any particular work.

• This can range from two times to five times as many because the citations come from a wide range of sources, not being limited to the journals that are included in the other databases.



• Data quality in GS is very poor with many entries being duplicated because of small differences in spellings or dates and many of the citations coming from a variety of non-research sources.

• There is also an issue about normalising Google Scholar data

• Even with the specialised databases (WoS and Scopus), there are still issues around error correction and disambiguation of common names.

• WOS coverage tends to be heavily concentrated on North American journals.

• Journals show a significant improvement in their ranking [better: metrics] when using GS

• Free availability of GS allows for a democratization of citation analysis.


Ongoing content Curation of the Scopus: (To ensure continuous high quality content)


Metric and Benchmarks: (To identify poor performing journals for re-evaluation)


RADAR:Identifies Journals with Outlier Performance


Evaluation of Metrics and Analytical Tools


Golden Rules: Use of Journal Metrics

Give a balanced, multi-dimensional view for decision-

making


USE MORE THAN ONE METRIC:(For weaknesses compensation)


CiteScore (Alternative of Impact Factor)

December 8, 2016:- Elsevier's Scopus released theirCiteScore journal metric.

- This new metric is intended as analternative to the popular Thomson-Reuters (now Clarivate Analytics)Impact Factor.

- CiteScore™ metrics are a new standardthat help to measure journal citationimpact.

- It is comprehensive, transparent,current and free metrics for helping toanalyze where research outputs arepublished.


CiteScore


CiteScore Percentile Calculated

CiteScore Percentile of

Where

L = number of serial titles in subject field with a CiteScore lower than X

S = number of serial titles in the subject field with CiteScore X

N = total number of serial titles in the subject field with any CiteScore

1002

N

SL

S


CiteScore Analysis


JOURNAL METRICS


CiteScore

CiteScore, SJR and SNIP values


CiteScore (cont)


Trends of CiteScore under Automotive Engineering Category for IJAME


Trends of CiteScore under Mechanical Engineering Category for IJAME




Malaysian Journals: CiteScore in 2015








PERFORMANCE OF JOURNAL

• Productivity

• Rejection rate or impact

• Publication speed



• Productivity • Number of issues published• Number of articles published

• Number of original research papers • Number of review papers

• Number of pages published • Number of original research paper pages• Number of review paper pages

• Number of productivity can be measured from start of a journal

• Higher numbers show higher productivity



REJECTION RATE

• Number of rejected submissions• failed in preliminary review • failed due to content out of scope • failed due to content insufficient • failed due to authors typesetting • failed in full review • failed in plagiarism check

• Number of accepted manuscripts

• Number withdrawn • withdrawn before peer review (cheap for review process) • withdrawn after peer review (expensive for review process)


Performance of Journal

PUBLICATION SPEED

• Average time from “Submission” to "Preliminary Review"

• Average time from "Preliminary Review" to "First Review Summary"

• Average time from "First Review Summary" to "Revision"

• Average time from "Revision" to “Acceptance”

• Average time from “Acceptance” to "Author's Formatted Version"

• Average time from "Author's Formatted Version" to “Publication”

• Average total time from “Submission” to “Publication”

• Shorter average times show higher publication speed.


Publishing Speed

Submission to Acceptance(weeks)

Submission to first online

(weeks)

Submission to Print(weeks)

22.6 31.4 47.3

For authors looking to publish their research, the time an article takes to go through the publishing process is one of the most important consideration in selecting a journal

Many journals have now introduced a “Fast Rejection“ process by the journal Editor


Journal Metrics for Impact

• Impact metrics leading towards the number of citations • Number of index entries (will probably enhance journal page visits)

• Number of journal page visits (will probably enhance downloads)

• Number of downloads (will probably enhance citations)

• Number of citations on WOS, Scopus, or Google Scholar


CRITERIA FOR JOURNAL PRESTIGE FACTOR

• The eight criteria with their characteristic levels are:

• Geographic coverage: Topics, distribution, authorship, readership, editorial board members:

• World

• Continent

• Nation

• Language:

• International (English)

• Mixed language including English

• Only one language (or more languages) other than English



• Scope: • Entire discipline (e.g. aerospace)

• Sub-discipline (e.g. aeronautics)

• Specialized subject area (e.g. aerodynamics)

• Contributions:• Most contributions are scientifically and methodologically most

meticulous and innovative, very frequently pioneer work and milestones of the respective discipline

• Most contributions are scientifically or methodologically innovative

• Most contributions contain scientific results in simplified form to make them easier to comprehend



• Target readers: • Most articles are understandable only for scientists with in-

depth method knowledge in the field (PhD level)

• Most articles are understandable for graduates of relevant studies (Master level)

• Most articles are understandable for practitioners with knowledge in the field, but not necessarily with higher academic training (Bachelor level plus practical experience)



• Authors: • Most lead author are professors and post-docs

• Most lead authors are PhD students

• Most lead authors are practitioners with academic training

• Author competition: • Toughest competition of authors from all over the world (very high

rejection rate of manuscripts)

• Strong competition of authors from an international realm (high rejection rate of manuscripts)

• Moderate competition of authors (moderate rejection rate of manuscripts)



• Review process: • At least two external reviewers and editor

• At least one external reviewer and editor

• Editorial review (at times with internal reviewers), but without external reviewers

• There are 8 criteria each of them with 3 characteristics scoring from • 3 points (highest fulfillment) to 1 point (lowest fulfillment).

• All criteria have equal weight.

• The Journal Prestige Factor (JPF) is calculated


RELEVANCE OF CRITERIA FOR JOURNAL PRESTIGE FACTOR ON WOS AND SCOPUS

4 out of 8


ADDITIONAL CRITERIA FOR JOURNAL PRESTIGE FACTOR ON WOS AND SCOPUS


INCREASE VISIBILITY OF JOURNAL

• Be open → Get more citations!

• More page views, downloads, and media attention

• Article sharing• Articles posted in open repositories

• Open access citation advantage holds with maximum

percent increases in citations from 36-600%!

• Data sharing

http://whyopenresearch.org/visibility

http://whyopenresearch.org/visibility


STRATEGY FOR INCREASING VISIBILITY

• Include publications in an open repository so google will track when you've been cited:• An Institutional Repository - and provide full-text of it.

• A Subject Repository - such as arXiv.org, RePEc, SSRN, etc.

• Publish in an Open Access journal or self-archive it.

• Publish in an online journal with search features allowing users to find articles that cite it.• For example, see "cited by" features.

• Share publications using social networking tools such as • Mendeley, ResearchGate, CiteULike, twitter, Slideshare, blogs, etc.

http://arxiv.org/

http://repec.org/

http://www.ssrn.com/

http://doaj.org/

http://www.mendeley.com/features/

http://www.researchgate.net/about

http://www.citeulike.org/faq/faq.adp

https://twitter.com/

http://www.slideshare.net/about


STRATEGY FOR INCREASING VISIBILITY

• Create an online presence utilizing tools such as• Google Scholar Citations profile

• Bone up on how to influence Google page rankings• Facebook shares, backlinks, and tweets are the top ways to increase page visibility in

search engine result pages.

• Keywords and abstracts play a vital role in researchers retrieving an article.

• Publish thought-provoking, critical pieces or literature reviews - These traditionally have higher citation rates as do those dealing with hot topics.

http://scholar.google.com/intl/en/scholar/citations.html

http://www.facebook.com/


INCREASING VISIBILITY




























Issues and challenges in managing journal

Roles as researcher/lecturer and journal editor


Thank You for your Attention

Email: [email protected]

Documents

STRATEGY TOWARDS HIGH IMPACT JOURNAL - mycc.mymycc.my/document/files/Bengkel Kelestarian Jurnal/Presentation... · bengkel kelestarian jurnal, 11-13 januari 2017, akept, bandar enstek,