CSIRO INFORMATION MANAGEMENT & TECHNOLOGY

Transcription

1 Connecting researchers and research organisations with data publication metrics the visibility and value of data publications in bibliometrics and altmetrics systems Dominic Hogan & Anne Stevenson Research Data Services Support 24 th October 2013 CSIRO INFORMATION MANAGEMENT & TECHNOLOGY Image:

2 Metrics what s available Data Citation Index flexible DOI searching with citation data. Hoping for ANDS ingest in the near future. 2 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson

3 Metrics what s available Scopus you might get excited when searching for a DOI prefix in references, e.g. the ANDS DOI prefixes: but then you have to remember the correct syntax for an exact phrase. At least it works in principle, even if there s nothing worth showing off yet. 3 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson

4 Metrics what s available Google Scholar am I doing it correctly? (Incidentally, neither the DAP nor RDA records for this show up in GS) 4 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson

5 Metrics what s available For comparison, here s a similar search in Google 5 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson

6 Metrics what s available Microsoft Academic Search DOI search does not allow truncation, so full DOIs only General search will retrieve many false positives Exact phrase may prove useful for DOI prefixes 6 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson

7 Altmetrics What Google Trends has to say about this 7 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson

8 Altmetrics Roberta Kwok points out the difference between the views and citations of this article: Hull, D., Pettifer, S. R., & Kell, D. B. (2008). Defrosting the Digital Library: Bibliographic Tools for the Next Generation Web. PLoS Comput Biol, 4(10), e doi: /journal.pcbi Kwok, R. (2013). Research impact: Altmetrics make their mark. Nature, 500(7463), doi: /nj a 8 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson

9 Altmetrics Impact Story: CSIRO datasets showing up as items with no metrics Dryad and figshare datasets showing up in a dataset category Tracking DOIs from DataCite is on the roadmap, but timeline unknown Search by creator is also on the roadmap 9 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson

10 Altmetrics Altmetric.com: We tested out tweeting a DOI, Altmetric.com did pick it up No real activity for the ANDS DOI prefix Altmetric badges embedded in Scopus 10 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson

11 Altmetrics Plum Analytics: Specifically mentions that metrics are gathered for datasets Can currently add figshare and Dryad records to a profile Some issues with what gets listed (although it s uncertain whether this was just the way the profile was created) 11 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson

12 Altmetrics Some publishers are displaying altmetrics in their pages 12 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson

13 Altmetrics The paper itself doesn t cite the data in the reference section 13 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson

14 Project Columbus The steps: Weekly report on new collections from the DAP. New collections with DOIs identified. We search our publications systems for the data collection authors, looking for papers that aren t published yet. We then contact the authors that match to talk about data citation generally, and Project Columbus specifically. Results so far: Very early days. 4 candidates identified. Candidates are extremely keen, however. Additional datasets have been deposited by candidates 14 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson

15 Project Columbus Use available tools to report metrics back to authors. Current: Google Analytics reports Analysis of server logs Providing data for inclusion in annual reports Manual searching for DOIs in the wild Use of metrics tools on the citing papers Future: Data Citation Index Impact Story search-by-creator Science reviews / internal assessments 15 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson

16 Number of DOIs Case study: what DOIs do we have? 450 Total DOIs minted for DAP collections Total DOIs minted Date At EOFY 2013 CSIRO had under 100 DOIs for data collections in the DAP 16 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson

17 Australian Telescope National Facility But wait What s this? 17 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson

18 Australian Telescope National Facility Publications which include archived Parkes pulsar data should include an additional statement as follows: This paper includes archived data obtained through the Australia Telescope Online Archive and the CSIRO Data Access Portal ( So will anybody cite the DOI? Nothing from either list matches with the other at least the list is small enough to manually check 18 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson

19 Anywhere? By excluding the two main suspects, we get a sane number of results to browse Definitely some false positives Compared to searching for a handle ANDS PID handles have the prefix more false hits The prefix is not organisation specific, so it s harder to filter out parent organisations 19 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson

20 Number of download events Roll your own Google Analytics Server logs DAP downloads (ATNF spikes are off scale) Manual_other REST_other ATNF ATNF_REST Date 20 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson

21 ATNF downloads 21 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson

22 Atlas of Australian Acid Sulphate Soils 22 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson

23 DAP Visitors 23 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson

24 Challenges It s early days for altmetrics, there are no standards. There s capacity to innovate or collaborate with altmetrics providers. What sort of metrics would you be interested in seeing? What sort of metrics would your researcher or organisation be interested in? 24 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson

25 Acknowledgementsyou Thanks to Sue Cook David Benn Cynthia Love 25 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson

26 Thank you CSIRO Information Management & Technology Dominic Hogan Research Data Service Support t e dominic.hogan@csiro.au w CSIRO Information Management & Technology Anne Stevenson Research Data Service Support t e anne.stevenson@csiro.au w CSIRO INFORMATION MANAGEMENT & TECHNOLOGY