STRATEGY TOWARDS HIGH IMPACT JOURNAL

STRATEGY TOWARDS HIGH IMPACT JOURNAL PROF. DR. MD MUSTAFIZUR RAHMAN EDITOR-IN CHIEF International Journal of Automotive and Mechanical Engineering (Scopus Index) Journal of Mechanical Engineering and Sciences (Scopus Index) DEAN OF RESEARCH (ENGINEERING) Universiti Malysia Pahang, 26600 Pekan, Pahang, Malaysia Email: mustafizur@ump.edu.my Contact: +60163775026 (H/P); +6094245027

Publisher: UMP Scopus and ERA Indexed Editor in Chief Prof. Dr. Md Mustafizur Rahman Dr. Muhamad Mat Noor Editor in Chief Dr. Muhamad Mat Noor Prof. Dr. Md Mustafizur Rahman Scopus Indexed Publisher: UMP

SCOPUS RANKING International Journal of Automotive and Mechanical Engineering (IJAME) CiteScore: 2.58 Rank: #8/62 (Automotive Engineering; 87 percentile); #50/520 (Mechanical Engineering; 90th percentile) Journal of Mechanical Engineering and Sciences (JMES) CiteScore: 1.86 Rank: #5/38 (Computational Mechanics; 88 percentile); #93/520 (Mechanical Engineering; 82th percentile)

xecutive Editorial Team (IJAME and JMES) Team JMES Editor-in-Chief For IJAME and JMES Team IJAME

Outline 5 Analyzing journal indicators / journal metrics How to make your journal visible / improve journal ranking based on the journal indicators Experiences, issues and challenges in managing a Scopus-indexed journal Roles as lecturer and journal editor : How to manage

CITATIONS AS A PROXY OF SCIENTIFIC IMPACT Visibility Relevance Quality Reputation Random factors Scientific impact Citations Citation analysis

There is no single best indicator that could accommodate all aspects of the new reality of bibliometrics - Wolfgang Glänzel, Head of bibliometrics group Professor at KU Leuven, Belgium Using the Impact Factor alone to judge a journal is like using weight alone to judge a person s health.

JOURNAL METRICS Most prominent metric is Journal Impact Factor (JIF) There are many metrics, some of them claimed to be better than JIF Metrics are calculated on an underlying database Other database are Scopus and Google Scholar Metrics can assess the journal impact and researcher s impact. Question: What are the best journal metrics to access journals? How can these metrics best be calculated?

Currently in the market? Impact Factor Impact Factor pros Most well-known Easy to understand Pervasive - stranglehold Impact Factor cons Little transparency underlying database not publicly available Impact Factors cannot be reconstructed Citation windows available are biased 2 years favours rapidly moving fields (very short time period for many disciplines) 5 years favours slowly moving fields Depends heavily on the research field Easy to mislead and manipulate

Impact Factor Only the high quality journals are included (according to Thomson Reuter Criteria) Only a limited subset of journals is indexed by ISI Only uses the articles cited by the ~12,000 ISI journals Some disciplines are especially poorly covered Biased toward English-language journals ISI has recently added several hundred non-english journals Is an average; not all articles are equally well-cited All citations are equally weighted Only articles that are cited within two years after publication contribute to the Impact Factor Includes self-citations

Impact Factor Only includes citable articles in the denominator of the equation, i.e., articles and reviews Editors may skew IF by increasing the number of review articles, which bring in more citations Or by increasing the number of news items, which are cited but not considered citable It is expensive to subscribe to the JCR Citations are gathered from Journal articles only Citations from books, books chapter or conference proceedings are not contributed to Impact factor Impact Factor can distort publication polices of journals, if focus on improving their Impact Factors for example by publishing more reviews.

Impact Factor Classified as a review by Thomson Reuters criteria: More than 100 references, It appears in a review publication or a review section of a journal, The word review or overview appears in its title, or The abstract states that it is a review or survey. Some fields methodological papers are also more cited than original research papers

Which Journal is the Best Journal? Journal Impact Factor Pain 6.125 Nature Genetics 38.597 Annals of Mathematics 3.027 Computers & Operations Research 2.374 Progress in Energy and Combustion Science 17.778 Addiction Biology 5.914 Remote Sensing of Environment 6.144 Answer: All of them are the best journals in their subject areas. With IF journals from different subject fields CANNOT be compared.

SJR- SCImago Journal Rank Developed by Felix de Moya, CSIC (Spanish Research Council) Prestige metric- not all citations are the same Citations are weighted depending on the status of the source they come from

SJR- SCImago Journal Rank Life Sciences journal Arts & Humanities journal High impact, lots of citations One citation = low value Low impact, few on citations One citation = high value SJR normalizes for differences in citation behaviour between subject fields

SJR- SCImago Journal Rank

SNIP: Source Normalised Impact per Paper Developed by Henk Moed - CWTS (Centre for Science and Technology Studies)-Leiden University Measures the average citation impact of the publications of a journal, correcting for the differences in citation practices between scientific fields and therefore allowing for more accurate betweenfield comparisons of citation impact SNIP is field normalized, dependent on likelihood of citation in subject field of source

SNIP: Source-normalized impact per paper All ~21,000 journals have a Source-normalized impact per paper (SNIP) measuring contextual citation impact by weighting citations per subject field - Peer-reviewed papers only - Field s frequency and immediacy of citation - Database coverage - Journal s scope and focus - Measured relative to database median + + + impact per publication (IPP) Citation potential in its subject field Journal IPP Citation Potential SNIP Inventiones Mathematicae 1.5 0.4 3.8 Molecular Cell 13.0 3.2 4.0

Example of publishers promoting journal metrics on their journal website

Journal metrics on their journal website

QUALITY OF A JOURNAL h-index (Hirsch index) Originated by Jorge Hirsch in 2005 A group of papers has index h if h of the papers have at least h citations each, and the other papers have no more than h citations each. Can be calculated from publication list when the number of citations is available for the articles (WoS, Scopus and Google Scholar). Productivity of a journal over a long time period Journals that publish review articles are not over-valued (compare to journal IF) Publish or Perish calculates the H-index of journals using citation data from Google Scholar/Scopus Also evaluation of the journals not found in WoS database Reasonable evaluation to journals that are cited mainly in sources outside the WoS, like in books or in journals that are not included in the WoS.

H-Index The novel property of h is that in one number it summarizes both impact, in terms of citations, and productivity in terms of number of papers. It combines both productivity and impact in a single measure that is easily understood and very intuitive. It is easily calculated the number of citations either from WoS, Scopus or Google Scholar (GS). Indeed, all three now routinely calculate it. g-index Variant of h-index that emphasizes the most highly-cited papers in a data set m-index Variant of h-index that displays h-index per year since first publication

Analyze Journals in Scopus

Evaluation of Journal: Quantitative Methods Circulation and usage statistics Large circulation and plenty of readers testify the quality of the journal Its own subject area (Important) Subscriptions: Open access, EBSCOHOST, DOAJ, Ulrich s International Periodicals, and from publishers website. Acceptance and Rejection Rates Large number of manuscripts Have a high rejection rate seen to be prestigious Journal often inform their acceptance and rejection rates on their websites Indexing services covering the journal Assessing electronic journals

Quality of Scientific Articles Citation index evaluated by measuring the has received. The and used are also important Databases with citation information Web of Science (WoS) (Thomson Reuters, former SCI by ISI) Scopus (Elsevier) Google Scholar (also Non-scientific) New: Altmetrics Visibility and impact of the article in web and social media - Fast it

Quality of a Journal The characteristics of a quality journal are: High standards for acceptance of manuscripts A broadly representative editorial board A critical refereeing system Promptness of publication Coverage by major abstracting and indexing services High confidence level of scientists in the contents High frequency of citation by other journals

Quality of a Journal New factors for measuring the impact Take into account the quality of the journal citing the article Based on the PageRank algorithm Significance to be seen Impact Factor (IF) Eigenfactor (EF) Article influence (AI) H index WOS SCImago Journal Rank Indicator (SJR), Source Normalized Impact per Paper (SNIP) CiteScore SCOPUS

REVIEW OF JOURNAL CITATION INDICATORS Feature Web of Science Scopus Google Scholar Availability Subscription based Subscription based Freely accessible Number of journals Over 12.000 peer-reviewed journals Over 21,000 peer-reviewed journals Information is not publically available Other contents Main disiplines Time span Conference proceedings Natural Sciences, Technology, Social Sciences, Fine Arts and Humanities From 1900 (Science), 1956 (Social Sciences) and 1975 (Arts and Humanities) Up-dates Weekly Daily Conference proceedings Professional magazines Patents and book series Physics, Technology, Health Sciences, Bio sciences Fine Arts and Humanities Social Sciences Some of the journals from 1966, others from 1996 Citation analysis Citation Report -tool View citation overview -tool Books, pre-prints, theses and dissertations, and webpages Information is not publically available Information is not publically available Information not publically available, but more or less weekly Search report with a 'Cited by' link, giving all publications which cite the publication in question

REVIEW OF JOURNAL CITATION INDICATORS Feature Web of Science Scopus Google Scholar Indicators Journal Citation Reports: - Article Influence (AI) - Eigenfactor - H-index - Immediacy Index - Impact Factor (IF) - H-index - Impact per publication (IPP) - SCImago Journal Rank (SJR) - Source normalized impact per paper (SNIP) - CiteScore (Impact Factor) - Field-Weighted Citation Impact (FWCI) - H-index - Total citations Tools - Journal Citation Reports - Eigenfactor - ScienceWatch - Scival - SCImago Journal and Country Rank - CWTS Journal Indicators - Publish or Perish Time span of citation information From 1900 (Science), From 1956 (Social Sciences) and From 1975 (Arts and Humanities) From 1996 Information is not publically available Type of articles Collection policy Journal articles Journals, proceedings, books Almost all types of source Public Public Information not publically available, Contracts with most significant publishing houses

Journal Evaluation Indicators Indicator Tools providing the indicator Source database Citation window Weight of citations Self-citations Impact Factor (IF) Journal Citation Reports Web of Science 2 years (5 years) All citations are weighted equally Journal self-citations are include Eigen Factor (EF) Eigenfactor.org, Journal Citation Reports Web of Science 5 years Weights citations based on the prestige of the citing journal Journal self-citations are ignored Article Influence (AI) Eigenfactor.org, Journal Citation Reports Web of Science 5 years Weights citations based on the prestige of the citing journal Journal self-citations are ignored SCImago Journal Rank Indicator (SJR) Scimago Journal & Country Rank, Scopus Scopus 3 years Weights citations based on the prestige of the citing journal Max 33 % journal selfcitations are included Source normalized impact per paper (SNIP) CWTS Journal Indicators, Scopus Scopus 3 years Accounts characteristics of journal's subject field Journal self-citations are included H-index Scopus, Web of Science, Scimago Journal & Country Rank, Publish or Perish Scopus, Web of Science, Google scholar Can be defined Not weighted Included (Can be removed) g-index Publish or Perish Google scholar Can be defined Not weighted Included Field-Weighted Citation Impact (FWCI) Scopus, SciVal Scopus 3 years Ratio of the citations in the subject field

REVIEW OF JOURNAL CITATION INDICATORS He established the first citation indexes (Science Citation Index) WoS and Scopus differs significantly between different fields. The natural sciences, where coverage is very good. The social sciences where it is moderate and variable. The arts and humanities where it is generally poor. The coverage of Google Scholar (GS) is generally higher, and does not differ so much between subject areas, but the reliability and quality of its data can be poor. GS generates a significantly greater number of citations for any particular work. This can range from two times to five times as many because the citations come from a wide range of sources, not being limited to the journals that are included in the other databases.

REVIEW OF JOURNAL CITATION INDICATORS Data quality in GS is very poor with many entries being duplicated because of small differences in spellings or dates and many of the citations coming from a variety of non-research sources. There is also an issue about normalising Google Scholar data Even with the specialised databases (WoS and Scopus), there are still issues around error correction and disambiguation of common names. WOS coverage tends to be heavily concentrated on North American journals. Journals show a significant improvement in their ranking [better: metrics] when using GS Free availability of GS allows for a democratization of citation analysis.

Ongoing content Curation of the Scopus: (To ensure continuous high quality content)

Metric and Benchmarks: (To identify poor performing journals for re-evaluation)

RADAR: Identifies Journals with Outlier Performance

Evaluation of Metrics and Analytical Tools

Golden Rules: Use of Journal Metrics Give a balanced, multi-dimensional view for decisionmaking

USE MORE THAN ONE METRIC: (For weaknesses compensation)

CiteScore (Alternative of Impact Factor) December 8, 2016: - Elsevier's Scopus released their CiteScore journal metric. - This new metric is intended as an alternative to the popular Thomson- Reuters (now Clarivate Analytics) Impact Factor. - CiteScore metrics are a new standard that help to measure journal citation impact. - It is comprehensive, transparent, current and free metrics for helping to analyze where research outputs are published.

CiteScore

CiteScore Percentile Calculated CiteScore Percentile of Where S L S 2 100 N L = number of serial titles in subject field with a CiteScore lower than X S = number of serial titles in the subject field with CiteScore X N = total number of serial titles in the subject field with any CiteScore

CiteScore Analysis

JOURNAL METRICS

CiteScore CiteScore, SJR and SNIP values

CiteScore (cont)

Trends of CiteScore under Automotive Engineering Category for IJAME

Trends of CiteScore under Mechanical Engineering Category for IJAME

Malaysian Journals: CiteScore in 2015

PERFORMANCE OF JOURNAL Productivity Rejection rate or impact Publication speed

PERFORMANCE OF JOURNAL Productivity Number of issues published Number of articles published Number of original research papers Number of review papers Number of pages published Number of original research paper pages Number of review paper pages Number of productivity can be measured from start of a journal Higher numbers show higher productivity

PERFORMANCE OF JOURNAL REJECTION RATE Number of rejected submissions failed in preliminary review failed due to content out of scope failed due to content insufficient failed due to authors typesetting failed in full review failed in plagiarism check Number of accepted manuscripts Number withdrawn withdrawn before peer review (cheap for review process) withdrawn after peer review (expensive for review process)

Performance of Journal PUBLICATION SPEED Average time from Submission to "Preliminary Review" Average time from "Preliminary Review" to "First Review Summary" Average time from "First Review Summary" to "Revision" Average time from "Revision" to Acceptance Average time from Acceptance to "Author's Formatted Version" Average time from "Author's Formatted Version" to Publication Average total time from Submission to Publication Shorter average times show higher publication speed.

Publishing Speed For authors looking to publish their research, the time an article takes to go through the publishing process is one of the most important consideration in selecting a journal Submission to Acceptance (weeks) Submission to first online (weeks) Submission to Print (weeks) 22.6 31.4 47.3 Many journals have now introduced a Fast Rejection process by the journal Editor

Journal Metrics for Impact Impact metrics leading towards the number of citations Number of index entries (will probably enhance journal page visits) Number of journal page visits (will probably enhance downloads) Number of downloads (will probably enhance citations) Number of citations on WOS, Scopus, or Google Scholar

CRITERIA FOR JOURNAL PRESTIGE FACTOR The eight criteria with their characteristic levels are: Geographic coverage: Topics, distribution, authorship, readership, editorial board members: World Continent Nation Language: International (English) Mixed language including English Only one language (or more languages) other than English

CRITERIA FOR JOURNAL PRESTIGE FACTOR Scope: Entire discipline (e.g. aerospace) Sub-discipline (e.g. aeronautics) Specialized subject area (e.g. aerodynamics) Contributions: Most contributions are scientifically and methodologically most meticulous and innovative, very frequently pioneer work and milestones of the respective discipline Most contributions are scientifically or methodologically innovative Most contributions contain scientific results in simplified form to make them easier to comprehend

CRITERIA FOR JOURNAL PRESTIGE FACTOR Target readers: Most articles are understandable only for scientists with indepth method knowledge in the field (PhD level) Most articles are understandable for graduates of relevant studies (Master level) Most articles are understandable for practitioners with knowledge in the field, but not necessarily with higher academic training (Bachelor level plus practical experience)

CRITERIA FOR JOURNAL PRESTIGE FACTOR Authors: Most lead author are professors and post-docs Most lead authors are PhD students Most lead authors are practitioners with academic training Author competition: Toughest competition of authors from all over the world (very high rejection rate of manuscripts) Strong competition of authors from an international realm (high rejection rate of manuscripts) Moderate competition of authors (moderate rejection rate of manuscripts)

CRITERIA FOR JOURNAL PRESTIGE FACTOR Review process: At least two external reviewers and editor At least one external reviewer and editor Editorial review (at times with internal reviewers), but without external reviewers There are 8 criteria each of them with 3 characteristics scoring from 3 points (highest fulfillment) to 1 point (lowest fulfillment). All criteria have equal weight. The Journal Prestige Factor (JPF) is calculated

RELEVANCE OF CRITERIA FOR JOURNAL PRESTIGE FACTOR ON WOS AND SCOPUS 4 out of 8

ADDITIONAL CRITERIA FOR JOURNAL PRESTIGE FACTOR ON WOS AND SCOPUS

INCREASE VISIBILITY OF JOURNAL Be open Get more citations! More page views, downloads, and media attention Article sharing Articles posted in open repositories Open access citation advantage holds with maximum percent increases in citations from 36-600%! Data sharing

STRATEGY FOR INCREASING VISIBILITY Include publications in an open repository so google will track when you've been cited: An Institutional Repository - and provide full-text of it. A Subject Repository - such as arxiv.org, RePEc, SSRN, etc. Publish in an Open Access journal or self-archive it. Publish in an online journal with search features allowing users to find articles that cite it. For example, see "cited by" features. Share publications using social networking tools such as Mendeley, ResearchGate, CiteULike, twitter, Slideshare, blogs, etc.

STRATEGY FOR INCREASING VISIBILITY Create an online presence utilizing tools such as Google Scholar Citations profile Bone up on how to influence Google page rankings Facebook shares, backlinks, and tweets are the top ways to increase page visibility in search engine result pages. Keywords and abstracts play a vital role in researchers retrieving an article. Publish thought-provoking, critical pieces or literature reviews - These traditionally have higher citation rates as do those dealing with hot topics.

INCREASING VISIBILITY

Issues and challenges in managing journal Roles as researcher/lecturer and journal editor

Thank You for your Attention Email: mustafizur@ump.edu.my