Google Scholar and ISI WoS Author metrics within Earth Sciences subjects. Susanne Mikki Bergen University Library

Transcription

1 Google Scholar and ISI WoS Author metrics within Earth Sciences subjects Susanne Mikki Bergen University Library

2 My first steps within bibliometry Research question How well is Google Scholar performing compared to Thomson Reuters ISI WoS? Limitation Limit to author searches within Earth Sciences subjects

3 Research objective Analyse search results of the two services by overlap coverage ranking Similarities in ranking are carried out in terms of Spearman s footrule Mean citation count h-index

4 Data material 29 (26) authors, avoiding common names and names containing special characters Most of the authors related to UoB Mainly working with climate and petrology issues In Google Scholar Author search, which includes citation searching Result list includes items marked [BOOK], [CITATION] and [PDF] (representing about 55% of all results) Citation count obtained by Cited by In ISI WoS Author search, not Cited Reference Search Citation count obtained by Times cited (not including conference proceedings)

5

6 Data treatment Export titles from ISI WoS and GS (cut and paste) Matlab for further data treatment and analysis Filter data Remove duplicates (7,7% in GS) For identification of identical records - Compare titles Remove all punctuations Compare max first 50 characters

7 Unique items and overlap of search results

8 Comparing search results - Methods and indicators Overlap O = P( ISI) P( ISI) P( GS) P( GS) Coverage - defined as the recall of ISI records in Google Scholar Similarity of rank defined by the Normalized Spearmans s footrule F = 1 P( ISI) P( GS) C = P( ISI) Z i = 1 σ GS i F max σ ISI i h-index A scientist has index h if h of his or her papers have at least h citations each. The h-index is introduced as a measure which ignores the impact of inflated citation counts of single documents, and a long tail of rarely cited documents h N C ( h) while N ( h + 1) < h + 1 C

9 Citation count versus rank of publication Skewed distribution or Mathew effect in science Number of publications 52 (ISI), 117(GS) Number of citations 775(ISI), 835 (GS) Mean citation count ca 15 (ISI), 7(GS) h-index 16(ISI), 13 (GS)

10 Citation count for overlapping items Higher citation counts in ISI WoS

11 ISI WoS and Google Scholar compared autho r ISI sum publ N P(ISI ) GS sum publ N P(GS ) ISI citation count N C(ISI ) GS citation count N C(GS ) ISI h- index h ISI GS h- index h GS relative h-index h h ISI GS ISI mean citation count CC ISI GS mean citation count CC GS relative citation count N N C( ISI ) C( GS ) footrule coverage py>2000 cover age F C py> 2000 C (Σ 29 ) (1573) (5048) (43028) (40908) (16.7) (16.0) (1.04) (20.3) (6.5) (0.93) (0.80) (0.75) (0.84) Σ For all authors Coverage 0, Footrule 0, h-indeks 15,3(ISI); 15,0(GS)

12 Summery The amount of earth science content is comprehensive in Google Scholar. It covers about 85% of content indexed by ISI WoS. For impact studies the h-index has proofed to be a robust measure leading to similar values for the two sources. The ranking of the two services similar. However, for overlapping items, ISI WoS accumulates significantly more citing articles, by which it confirms its position as the leading citation index. The number of search results and their citations is otherwise higher in Google Scholar. The service returns highly cited sources not indexed by ISI WoS, but also a long tail of minor relevant items, barely matching the search expression. Even if the citation counts in this study are comparable, the citing documents in Google Scholar and ISI WoS will differ. Citing records were not verified and examined in this study.

13 Future work Rerun the calculations Automate Google Scholar searches Combine GS citation counts with the institutional data Improve the duplicate control

14 Thank you for your attention Hirsch, J. E. (2005). An index to quantify an individual's scientific research output. Proceedings of the National Academy of Sciences, 102(46), Mikki, S. (2009). Google Scholar compared to Web of Science. A literature review. Journal, 1(1), Retrieved from Mikki, S. (2010). Comparing Google Scholar and ISI WoS for Earth Sciences. Scientometrics, 82, , doi: /s