What are Bibliometrics? Bibliometrics are statistical measurements that allow us to compare attributes of published materials (typically journal articles) Research output Journal level Institution level Country level Citation metrics Based on the assumption that when an article has been cited by another paper, it has had an impact on their research.
Citation Metrics - Overview Citation metrics such as the Impact Factor remain popular. However, taken in isolation they can be of limited use. At their simplest, most citation metrics are just average numbers of citations. What citation metrics can do: Allow us to rank comparable journals. Identify highly-cited research areas. Allow academics to filter content at a glance. Attract top authors and readers. Considerations: Most citation metrics are averages, disguising variations within the journal.
Average Citation Counts These two hypothetical journals both have a 2011 Impact Factor of 1.507. Both published the same number of papers and received the same number of 2011 citations to those papers. % Citable Documents 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% Journal A Journal B 10+ citations 5-10 Citations 3-5 citations 1-2 Citations Uncited
Citation Metrics - Overview Citation metrics such as the Impact Factor remain popular. However, taken in isolation they can be of limited use. At their simplest, most citation metrics are just average numbers of citations. What citation metrics can do: Allow us to rank comparable journals. Identify highly-cited research areas. Allow academics to filter content at a glance. Attract top authors and readers. Considerations: Most citation metrics are averages, disguising variations within the journal. Citation and publication behaviours vary by discipline and document type.
Citation Trends by Subject Some disciplines are more likely to cite older content, yet the traditional Impact Factor only considers citations to content published in the previous two years. Citation metrics therefore measure a different proportion of each discipline s total citations. The longer the citation window, the more equal this proportion is likely to be.
Citation Metrics - Overview Citation metrics such as the Impact Factor remain popular. However, taken in isolation they can be of limited use. At their simplest, most citation metrics are just average numbers of citations. What citation metrics can do: Allow us to rank comparable journals. Identify highly-cited research areas. Allow academics to filter content at a glance. Attract top authors and readers. Considerations: Most citation metrics are averages, disguising variations within the journal. Citation and publication behaviours vary by discipline and document type. Citation and publication counts are dependent on the size and scope of the database.
Citation Data Sources Web of Science Run by Thomson Reuters. Content indexed after review. Metrics (i.e. Impact Factor) Published in the JCR. Approx. 12,000 journals indexed. Scopus Run by Elsevier. Content indexed after review. Metrics (i.e. SJR and SNIP) published by SCIMago. Approx. 20,000 journals indexed. Google Scholar Run by Google. Autonomous citation index. Publishes metrics based on the H-Index. Size Unknown. Other Sources Microsoft Academic Search Cross-Ref Altmetrics
Citation Metrics - Overview Citation metrics such as the Impact Factor remain popular. However, taken in isolation they can be of limited use. At their simplest, most citation metrics are just average numbers of citations. What citation metrics can do: Allow us to rank comparable journals. Identify highly-cited research areas. Allow academics to filter content at a glance. Attract top authors and readers. Considerations: Most citation metrics are averages, disguising variations within the journal. Citation and publication behaviours vary by discipline and document type. Citation and publication counts are dependent on the size and scope of the database. Bibliographic data can be messy / non-standardised. Citation metrics can be easily manipulated (i.e. through self-citations). Chasing metrics can be detrimental to the academic community.
Why Do We Use Bibliometrics at Wiley? There are many metrics that are commonly used to measure academic or institutional performance. Some of the most common include: The H-Index The Impact Factor The SNIP (Source Normalised Impact per Paper) We do not take the opinion that these metrics in isolation can tell us anything useful about academic performance. Rather, at Wiley we look at a range of variables that allow us to observe trends in researcher behaviour at a national, institutional or subject level.
Research Analytics at Wiley Wiley Analytics Sales Data Usage and Web Analytics Bibliometrics Market Research
What Analyses are Possible? Author? Journal Institute? Country Funder? Region
Regional Trends The following slides are based on Scopus data as summarised by SCImago Journal & Country Rank, http://www.scimagojr.com
Research Output - Croatia Avg. Growth 2000-2011 = 10% per year SCImago. (2007). SJR SCImago Journal & Country Rank. Retrieved May 03, 2013, from http://www.scimagojr.com
Croatian Research Share Eastern Europe v. World % Eastern Europe 4,50 4,00 3,50 3,00 2,50 2,00 1,50 1,00 0,50 0,30 0,25 0,20 0,15 0,10 0,05 % World 0,00 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 % Eastern Europe % World 0,00 SCImago. (2007). SJR SCImago Journal & Country Rank. Retrieved April 10, 2013, from http://www.scimagojr.com
Research Output Croatia in Context 20000 18000 16000 14000 12000 10000 8000 6000 4000 2000 0 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 Belarus Chile Croatia Iran Slovenia Thailand This graph shows the comparative growth of countries that had a comparable research output to Croatia in 2000. This graph shows the comparative growth of countries that had a comparable research output to Croatia in 2011. SCImago. (2007). SJR SCImago Journal & Country Rank. Retrieved April 10, 2013, from http://www.scimagojr.com 8000 7000 6000 5000 4000 3000 2000 1000 0 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 Chile Croatia Nigeria Serbia Tunisia
Citation Impact (Relative to World) 1,6 1,4 Relative Impact (vs. Rest of World) 1,2 1 0,8 0,6 0,4 Belarus Chile Croatia Iran Nigeria Serbia Slovenia Thailand Tunisia 0,2 0 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 SCImago. (2007). SJR SCImago Journal & Country Rank. Retrieved April 10, 2013, from http://www.scimagojr.com
Subject / Institutional Output The following slides are based on data extracted from Web of Science: Science, Social Science, Arts & Humanities Citation indices The absolute numbers differ to the Scopus data, but the trends are in the same direction
Growth by Subject (High Level) Citable Items in 2012 800 700 600 500 400 300 200 100 0 160% 140% 120% 100% 80% 60% 40% 20% 0% -20% -40% % Growth 09-12 Citable Items % Growth 09-12
2012 Research Output by Subject (Granular) 300 250 Citable Items 200 150 100 50 0
2012 Research Output by Institute (Top 5) 1800 1600 1400 1200 1000 800 600 400 200 0 2009 2010 2011 2012 Univ Zagreb Rudjer Boskovic Inst Univ Split Univ Rijeka Univ Osijek
2012 Research Output by Institute (Top 20) 1600 1400 1200 Citable Items 1000 800 600 400 200 0
Most Prolific Wiley Publications for Croatia JOURNAL OF APPLIED ICHTHYOLOGY CHEMISTRY & BIODIVERSITY MATERIALWISSENSCHAFT UND WERKSTOFFTECHNIK CHEMISTRY-A EUROPEAN JOURNAL ACTA CRYSTALLOGRAPHICA SECTION E-STRUCTURE REPORTS ONLINE COCHRANE DATABASE OF SYSTEMATIC REVIEWS ELECTROANALYSIS JOURNAL OF FISH BIOLOGY INTERNATIONAL JOURNAL OF FOOD SCIENCE AND TECHNOLOGY SCANDINAVIAN JOURNAL OF IMMUNOLOGY EUROPEAN JOURNAL OF ORGANIC CHEMISTRY
Research Analytics at Wiley Wiley Analytics Sales Data Usage and Web Analytics Bibliometrics Market Research
Building the Bigger Picture Materials = Journals, Books, Databases, Reference Works, etc. Materials Purchased Usage of Materials Publication Output Citing Behaviour
Institutional Fingerprint University of Zagreb University of Split University of Rijeka University of Osijek University of Zadar University of Dubrovnik Harvard University Oxford University University of Sao Paulo University of Tokyo
Thank you for you time. Any questions?