Connecting researchers and research organisations with data publication metrics the visibility and value of data publications in bibliometrics and altmetrics systems Dominic Hogan & Anne Stevenson Research Data Services Support 24 th October 2013 CSIRO INFORMATION MANAGEMENT & TECHNOLOGY Image: http://xkcd.com/285/
Metrics what s available Data Citation Index flexible DOI searching with citation data. Hoping for ANDS ingest in the near future. 2 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson
Metrics what s available Scopus you might get excited when searching for a DOI prefix in references, e.g. the ANDS DOI prefixes: but then you have to remember the correct syntax for an exact phrase. At least it works in principle, even if there s nothing worth showing off yet. 3 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson
Metrics what s available Google Scholar am I doing it correctly? (Incidentally, neither the DAP nor RDA records for this show up in GS) 4 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson
Metrics what s available For comparison, here s a similar search in Google 5 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson
Metrics what s available Microsoft Academic Search DOI search does not allow truncation, so full DOIs only General search will retrieve many false positives Exact phrase may prove useful for DOI prefixes 6 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson
Altmetrics What Google Trends has to say about this 7 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson
Altmetrics Roberta Kwok points out the difference between the views and citations of this article: Hull, D., Pettifer, S. R., & Kell, D. B. (2008). Defrosting the Digital Library: Bibliographic Tools for the Next Generation Web. PLoS Comput Biol, 4(10), e1000204. doi: 10.1371/journal.pcbi.1000204 Kwok, R. (2013). Research impact: Altmetrics make their mark. Nature, 500(7463), 491-493. doi: 10.1038/nj7463-491a 8 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson
Altmetrics Impact Story: CSIRO datasets showing up as items with no metrics Dryad and figshare datasets showing up in a dataset category Tracking DOIs from DataCite is on the roadmap, but timeline unknown Search by creator is also on the roadmap 9 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson
Altmetrics Altmetric.com: We tested out tweeting a DOI, Altmetric.com did pick it up No real activity for the ANDS DOI prefix Altmetric badges embedded in Scopus 10 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson
Altmetrics Plum Analytics: Specifically mentions that metrics are gathered for datasets Can currently add figshare and Dryad records to a profile Some issues with what gets listed (although it s uncertain whether this was just the way the profile was created) 11 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson
Altmetrics Some publishers are displaying altmetrics in their pages 12 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson
Altmetrics The paper itself doesn t cite the data in the reference section 13 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson
Project Columbus The steps: Weekly report on new collections from the DAP. New collections with DOIs identified. We search our publications systems for the data collection authors, looking for papers that aren t published yet. We then contact the authors that match to talk about data citation generally, and Project Columbus specifically. Results so far: Very early days. 4 candidates identified. Candidates are extremely keen, however. Additional datasets have been deposited by candidates 14 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson
Project Columbus Use available tools to report metrics back to authors. Current: Google Analytics reports Analysis of server logs Providing data for inclusion in annual reports Manual searching for DOIs in the wild Use of metrics tools on the citing papers Future: Data Citation Index Impact Story search-by-creator Science reviews / internal assessments 15 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson
Number of DOIs Case study: what DOIs do we have? 450 Total DOIs minted for DAP collections 400 350 300 250 200 150 Total DOIs minted 100 50 0 Date At EOFY 2013 CSIRO had under 100 DOIs for data collections in the DAP 16 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson
Australian Telescope National Facility But wait What s this? 17 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson
Australian Telescope National Facility Publications which include archived Parkes pulsar data should include an additional statement as follows: This paper includes archived data obtained through the Australia Telescope Online Archive and the CSIRO Data Access Portal (http://data.csiro.au). So will anybody cite the DOI? Nothing from either list matches with the other at least the list is small enough to manually check 18 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson
Anywhere? By excluding the two main suspects, we get a sane number of results to browse Definitely some false positives Compared to searching for a handle ANDS PID handles have the prefix 102.100.100 more false hits The prefix is not organisation specific, so it s harder to filter out parent organisations 19 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson
Number of download events Roll your own Google Analytics Server logs 1000 900 800 700 600 500 400 300 200 100 0 DAP downloads (ATNF spikes are off scale) Manual_other REST_other ATNF ATNF_REST Date 20 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson
ATNF downloads 21 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson
Atlas of Australian Acid Sulphate Soils 22 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson
DAP Visitors 23 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson
Challenges It s early days for altmetrics, there are no standards. There s capacity to innovate or collaborate with altmetrics providers. What sort of metrics would you be interested in seeing? What sort of metrics would your researcher or organisation be interested in? 24 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson
Acknowledgementsyou Thanks to Sue Cook David Benn Cynthia Love 25 Bibliometrics and Altmetrics Dominic Hogan & Anne Stevenson
Thank you CSIRO Information Management & Technology Dominic Hogan Research Data Service Support t 1300 363 400 e dominic.hogan@csiro.au w www.csiro.au CSIRO Information Management & Technology Anne Stevenson Research Data Service Support t 1300 363 400 e anne.stevenson@csiro.au w www.csiro.au CSIRO INFORMATION MANAGEMENT & TECHNOLOGY