What are Bibliometrics?

Transcription

1

2 What are Bibliometrics? Bibliometrics are statistical measurements that allow us to compare attributes of published materials (typically journal articles) Research output Journal level Institution level Country level Citation metrics Based on the assumption that when an article has been cited by another paper, it has had an impact on their research.

3 Citation Metrics - Overview Citation metrics such as the Impact Factor remain popular. However, taken in isolation they can be of limited use. At their simplest, most citation metrics are just average numbers of citations. What citation metrics can do: Allow us to rank comparable journals. Identify highly-cited research areas. Allow academics to filter content at a glance. Attract top authors and readers. Considerations: Most citation metrics are averages, disguising variations within the journal.

4 Average Citation Counts These two hypothetical journals both have a 2011 Impact Factor of Both published the same number of papers and received the same number of 2011 citations to those papers. % Citable Documents 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% Journal A Journal B 10+ citations 5-10 Citations 3-5 citations 1-2 Citations Uncited

5 Citation Metrics - Overview Citation metrics such as the Impact Factor remain popular. However, taken in isolation they can be of limited use. At their simplest, most citation metrics are just average numbers of citations. What citation metrics can do: Allow us to rank comparable journals. Identify highly-cited research areas. Allow academics to filter content at a glance. Attract top authors and readers. Considerations: Most citation metrics are averages, disguising variations within the journal. Citation and publication behaviours vary by discipline and document type.

6 Citation Trends by Subject Some disciplines are more likely to cite older content, yet the traditional Impact Factor only considers citations to content published in the previous two years. Citation metrics therefore measure a different proportion of each discipline s total citations. The longer the citation window, the more equal this proportion is likely to be.

7 Citation Metrics - Overview Citation metrics such as the Impact Factor remain popular. However, taken in isolation they can be of limited use. At their simplest, most citation metrics are just average numbers of citations. What citation metrics can do: Allow us to rank comparable journals. Identify highly-cited research areas. Allow academics to filter content at a glance. Attract top authors and readers. Considerations: Most citation metrics are averages, disguising variations within the journal. Citation and publication behaviours vary by discipline and document type. Citation and publication counts are dependent on the size and scope of the database.

8 Citation Data Sources Web of Science Run by Thomson Reuters. Content indexed after review. Metrics (i.e. Impact Factor) Published in the JCR. Approx. 12,000 journals indexed. Scopus Run by Elsevier. Content indexed after review. Metrics (i.e. SJR and SNIP) published by SCIMago. Approx. 20,000 journals indexed. Google Scholar Run by Google. Autonomous citation index. Publishes metrics based on the H-Index. Size Unknown. Other Sources Microsoft Academic Search Cross-Ref Altmetrics

9 Citation Metrics - Overview Citation metrics such as the Impact Factor remain popular. However, taken in isolation they can be of limited use. At their simplest, most citation metrics are just average numbers of citations. What citation metrics can do: Allow us to rank comparable journals. Identify highly-cited research areas. Allow academics to filter content at a glance. Attract top authors and readers. Considerations: Most citation metrics are averages, disguising variations within the journal. Citation and publication behaviours vary by discipline and document type. Citation and publication counts are dependent on the size and scope of the database. Bibliographic data can be messy / non-standardised. Citation metrics can be easily manipulated (i.e. through self-citations). Chasing metrics can be detrimental to the academic community.

10 Why Do We Use Bibliometrics at Wiley? There are many metrics that are commonly used to measure academic or institutional performance. Some of the most common include: The H-Index The Impact Factor The SNIP (Source Normalised Impact per Paper) We do not take the opinion that these metrics in isolation can tell us anything useful about academic performance. Rather, at Wiley we look at a range of variables that allow us to observe trends in researcher behaviour at a national, institutional or subject level.

11 Research Analytics at Wiley Wiley Analytics Sales Data Usage and Web Analytics Bibliometrics Market Research

12 What Analyses are Possible? Author? Journal Institute? Country Funder? Region

13 Regional Trends The following slides are based on Scopus data as summarised by SCImago Journal & Country Rank,

14 Research Output - Croatia Avg. Growth = 10% per year SCImago. (2007). SJR SCImago Journal & Country Rank. Retrieved May 03, 2013, from

15 Croatian Research Share Eastern Europe v. World % Eastern Europe 4,50 4,00 3,50 3,00 2,50 2,00 1,50 1,00 0,50 0,30 0,25 0,20 0,15 0,10 0,05 % World 0, % Eastern Europe % World 0,00 SCImago. (2007). SJR SCImago Journal & Country Rank. Retrieved April 10, 2013, from

16 Research Output Croatia in Context Belarus Chile Croatia Iran Slovenia Thailand This graph shows the comparative growth of countries that had a comparable research output to Croatia in This graph shows the comparative growth of countries that had a comparable research output to Croatia in SCImago. (2007). SJR SCImago Journal & Country Rank. Retrieved April 10, 2013, from Chile Croatia Nigeria Serbia Tunisia

17 Citation Impact (Relative to World) 1,6 1,4 Relative Impact (vs. Rest of World) 1,2 1 0,8 0,6 0,4 Belarus Chile Croatia Iran Nigeria Serbia Slovenia Thailand Tunisia 0, SCImago. (2007). SJR SCImago Journal & Country Rank. Retrieved April 10, 2013, from

18 Subject / Institutional Output The following slides are based on data extracted from Web of Science: Science, Social Science, Arts & Humanities Citation indices The absolute numbers differ to the Scopus data, but the trends are in the same direction

19 Growth by Subject (High Level) Citable Items in % 140% 120% 100% 80% 60% 40% 20% 0% -20% -40% % Growth Citable Items % Growth 09-12

20 2012 Research Output by Subject (Granular) Citable Items

21 2012 Research Output by Institute (Top 5) Univ Zagreb Rudjer Boskovic Inst Univ Split Univ Rijeka Univ Osijek

22 2012 Research Output by Institute (Top 20) Citable Items

23 Most Prolific Wiley Publications for Croatia JOURNAL OF APPLIED ICHTHYOLOGY CHEMISTRY & BIODIVERSITY MATERIALWISSENSCHAFT UND WERKSTOFFTECHNIK CHEMISTRY-A EUROPEAN JOURNAL ACTA CRYSTALLOGRAPHICA SECTION E-STRUCTURE REPORTS ONLINE COCHRANE DATABASE OF SYSTEMATIC REVIEWS ELECTROANALYSIS JOURNAL OF FISH BIOLOGY INTERNATIONAL JOURNAL OF FOOD SCIENCE AND TECHNOLOGY SCANDINAVIAN JOURNAL OF IMMUNOLOGY EUROPEAN JOURNAL OF ORGANIC CHEMISTRY

24 Research Analytics at Wiley Wiley Analytics Sales Data Usage and Web Analytics Bibliometrics Market Research

25 Building the Bigger Picture Materials = Journals, Books, Databases, Reference Works, etc. Materials Purchased Usage of Materials Publication Output Citing Behaviour

26 Institutional Fingerprint University of Zagreb University of Split University of Rijeka University of Osijek University of Zadar University of Dubrovnik Harvard University Oxford University University of Sao Paulo University of Tokyo

27 Thank you for you time. Any questions?