LMerdandng Science by analysing its Literature Institute for Scl.ntiflc

Similar documents
Foreword. Current Contents and then, all the rest of those many technical aids. in the mid- 1950s. After all, like everyone else at the time, I had no

In basic science the percentage of authoritative references decreases as bibliographies become shorter

Scientometrics & Altmetrics

Tracing the origin of a scientific legend by Reference Publication Year Spectroscopy (RPYS): the legend of the Darwin finches

Can scientific impact be judged prospectively? A bibliometric test of Simonton s model of creative productivity

Your use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at

Discussing some basic critique on Journal Impact Factors: revision of earlier comments

hprints , version 1-1 Oct 2008

DAT335 Music Perception and Cognition Cogswell Polytechnical College Spring Week 6 Class Notes

Eigenfactor : Does the Principle of Repeated Improvement Result in Better Journal. Impact Estimates than Raw Citation Counts?

Citation Analysis in Research Evaluation

A QUANTITATIVE STUDY OF CATALOG USE

GENERAL WRITING FORMAT

Measuring the Impact of Electronic Publishing on Citation Indicators of Education Journals

Scientific Quality Assurance by Interactive Peer Review & Public Discussion

ENGLISH LANGUAGE ARTS

ISSN: ISO 9001:2008 Certified International Journal of Engineering Science and Innovative Technology (IJESIT) Volume 3, Issue 2, March 2014

Strategies for Writing about Literature (from A Short Guide to Writing about Literature, Barnett and Cain)

Code Number: 174-E 142 Health and Biosciences Libraries

Thomas Kuhn's "The Structure of Scientific Revolutions"

Science Indicators Revisited Science Citation Index versus SCOPUS: A Bibliometric Comparison of Both Citation Databases

AP Statistics Sec 5.1: An Exercise in Sampling: The Corn Field

GUIDELINES FOR AUTHOR

Peter Ingwersen and Howard D. White win the 2005 Derek John de Solla Price Medal

Introduction to Citation Metrics

The section can be divided into subsections:

What is Web of Science Core Collection? Thomson Reuters Journal Selection Process for Web of Science

Ferenc, Szani, László Pitlik, Anikó Balogh, Apertus Nonprofit Ltd.

The problems of field-normalization of bibliometric data and comparison among research institutions: Recent Developments

P a g e 1. Simon Fraser University Science Undergraduate Research Journal. Submission Guidelines. About the SFU SURJ

Fairness and honesty to identify materials and information not your own; to avoid plagiarism (even unintentional)

inter.noise 2000 The 29th International Congress and Exhibition on Noise Control Engineering August 2000, Nice, FRANCE

CitNetExplorer: A new software tool for analyzing and visualizing citation networks

in the Howard County Public School System and Rocketship Education

Cascading Citation Indexing in Action *

Bibliometric evaluation and international benchmarking of the UK s physics research

CITATION INDEX AND ANALYSIS DATABASES

PICK THE RIGHT TEAM AND MAKE A BLOCKBUSTER A SOCIAL ANALYSIS THROUGH MOVIE HISTORY

1.3 Avoiding plagiarism

THE USE OF THOMSON REUTERS RESEARCH ANALYTIC RESOURCES IN ACADEMIC PERFORMANCE EVALUATION DR. EVANGELIA A.E.C. LIPITAKIS SEPTEMBER 2014

The Public and Its Problems

WHAT MAKES FOR A HIT POP SONG? WHAT MAKES FOR A POP SONG?

Development of a novel and cost-effective redox sensor for voltammetric determination of pantoprazole sodium during pharmacokinetic studies

Temporal coordination in string quartet performance

Scientometric and Webometric Methods

Precision testing methods of Event Timer A032-ET

UNITED STATES PATENT AND TRADEMARK OFFICE BEFORE THE BOARD OF PATENT APPEALS AND INTERFERENCES. Ex parte JENNIFER MARKET and GARY D.

Bibliometric glossary

International Journal of Modern Pharmaceutical Research (IJMPR)

Why t? TEACHER NOTES MATH NSPIRED. Math Objectives. Vocabulary. About the Lesson

Human Hair Studies: II Scale Counts

International Journal of Library and Information Studies ISSN: Vol.3 (3) Jul-Sep, 2013

Interpersonal and Cross-Cultural Incomparability in Survey Research

Historiographic mapping of knowledge domains literature

Perceptual differences between cellos PERCEPTUAL DIFFERENCES BETWEEN CELLOS: A SUBJECTIVE/OBJECTIVE STUDY

British Journal of Humanities and Social Sciences 33 September 2011, Vol. 1 (2)

Sample Analysis Design. Element2 - Basic Software Concepts (cont d)

Assessment of quality of contributions. The Noble Prizes

Skip Length and Inter-Starvation Distance as a Combined Metric to Assess the Quality of Transmitted Video

Author Instruction. World Journal of Pharmacy and Pharmaceutical Sciences (WJPPS) publishes the following manuscript types:

Guidelines for Manuscript Preparation for Advanced Biomedical Engineering

Sport and Health Sciences Referencing Guide

Journal of American Computing Machinery: A Citation Study

Analysis of local and global timing and pitch change in ordinary

BER MEASUREMENT IN THE NOISY CHANNEL

2013 Music Style and Composition GA 3: Aural and written examination

PHYSICAL REVIEW E EDITORIAL POLICIES AND PRACTICES (Revised January 2013)

INTERNATIONAL JOURNAL OF EDUCATIONAL EXCELLENCE (IJEE)

The Power of Ideas: Milton Friedman s Empirical Methodology

Publication boost in Web of Science journals and its effect on citation distributions

Project Summary EPRI Program 1: Power Quality

Department of American Studies M.A. thesis requirements

NAA ENHANCING THE QUALITY OF MARKING PROJECT: THE EFFECT OF SAMPLE SIZE ON INCREASED PRECISION IN DETECTING ERRANT MARKING

Grade 7. Paper MCA: items. Grade 7 Standard 1

The Structural Characteristics of the Japanese Paperback Book Series Shinsho

Results of the bibliometric study on the Faculty of Veterinary Medicine of the Utrecht University

The APA Style Converter: A Web-based interface for converting articles to APA style for publication

Gandhian Philosophy and Literature: A Citation Study of Gandhi Marg

K-means and Hierarchical Clustering Method to Improve our Understanding of Citation Contexts

Citation and Impact Factor

Scientometric Measures in Scientometric, Technometric, Bibliometrics, Informetric, Webometric Research Publications

ANALYSING DIFFERENCES BETWEEN THE INPUT IMPEDANCES OF FIVE CLARINETS OF DIFFERENT MAKES

LabView Exercises: Part II

Bibliometric analysis of the field of folksonomy research

2013 Environmental Monitoring, Evaluation, and Protection (EMEP) Citation Analysis

Audio Feature Extraction for Corpus Analysis

Citation-Based Indices of Scholarly Impact: Databases and Norms

Predicting the Importance of Current Papers

Syddansk Universitet. The data sharing advantage in astrophysics Dorch, Bertil F.; Drachen, Thea Marie; Ellegaard, Ole

Contribution of Chinese publications in computer science: A case study on LNCS

AN OVERVIEW ON CITATION ANALYSIS TOOLS. Shivanand F. Mulimani Research Scholar, Visvesvaraya Technological University, Belagavi, Karnataka, India.

21W.016: Designing Meaning

UNIVERSITY OF CAMBRIDGE INTERNATIONAL EXAMINATIONS General Certificate of Education Ordinary Level

A HIGHLY INTERACTIVE SYSTEM FOR PROCESSING LARGE VOLUMES OF ULTRASONIC TESTING DATA. H. L. Grothues, R. H. Peterson, D. R. Hamlin, K. s.

Scientometric Profile of Presbyopia in Medline Database

STAT 250: Introduction to Biostatistics LAB 6

Lecture 3 Kuhn s Methodology

A Scientometric Study of Digital Literacy in Online Library Information Science and Technology Abstracts (LISTA)

AP Statistics Sampling. Sampling Exercise (adapted from a document from the NCSSM Leadership Institute, July 2000).

CST/CAHSEE GRADE 9 ENGLISH-LANGUAGE ARTS (Blueprints adopted by the State Board of Education 10/02)

Transcription:

Reprinted from The hrfomwtion.%ktkt 10(1):3-10, March 1976 LMerdandng Science by analysing its Literature Institute for Scl.ntiflc Information@ A. E. CAWKELL 18 North Common Road. Middlmex UPB8 lpd A brief description of work using citation networks for the better understanding of the history and structure of Science. The uae of a computer is necessary for large scale automatic clustering procedures using the phenomena of bibliographic coupling and co-citation coupling, Resulte may be ueed as indicators of changing reletlonshipa between apeclalties, and possible coalescence and for the early detection of possible research fronts. The institutional conception of science as part of the public domain is linked with the imperative for communication of findings. Secrecy is the antithesis of the norm, full and open communication is its enactment. Robert Merton If I have seen farther it is by standing on the shoulders of giants. Isaac Newton Introduction The above quotations imply that published papers are the end product of much scientific research, and that Science is like an edifice, building upon the past. The socio-scientific aspects of this activity have been discussed by Kuhnl and Merton. 2 Since published papers follow a traditional pattern in the main and the structure of the edifice is indicated by references to earlier building blocks the potential for examining Science through its literature obviously exists. It is fashionable to decry citations and various examples have been put forward purporting to show that they cannot be reliable indicators for a variety of reasons-for example because of excessive self-citations, plagiarism of references, careless or omitted references etc. Some thorough investigations have been carried out, notably by the Cole brothers, and these criticisms have been satisfactorily answered.g It turns out that if citation counts to the work of scientific communities are examined, a good correlation exists between numbers of citations received and a range of conventional indicators such as honorific rewards received, occupational position, books and papers published, and so forth.4 Citation anomalies have little effect-they are like random noise in the presence of strong repetitive signals. However, the use of citations in assessing the quality of the work of an individual scientist requires considerable care. Anomalies having a small effect on the average might have a serious effkct in a particular case. It is unwise to draw conclusions from citation counts for individuals unless a detailed examination is made by a person very well versed in citation practices and adequate supportive evidence is available. It is my purpose here to describe work which has been done using citation networks as aids to a better understanding of the history and structure of 543

Science. An early suggestion that citations might be used as quality indicators was made by Garfield, ~ and later de Solla Pricee suggested that citation analysis could be used to investigate research fronts. A detailed examination was carried out by Garfield d al. 7 of the history of the Genetic Code in terms of nodal articles and citation inter-connections, and the coalescence of protein chemistry, genetics and nucleic acid chemistry was tracked. A further exercise was carried out by Cawke118 who illustrated the controversy surrounding S. R. Ovshinsky s work on Amorphous Semi-conductors with a citation network. A portion of this network is displayed in Fig. x. Articles are shown as circles, ordered chronologically from top to bottom; an arrow between articles indicates a citation. Atilcle coupling Fig. 1. Part of amorphous semiconductor citation network Work is in progress for the interactive plotting of individual diagrams by computer, and to look at whole areas of science it is essential to use automatic methods. It will be helpful to understand two forms of article coupling before describing these methods. In Fig. 2 articles A and B are said to be bibliographically coupled by their common references to earlier articles. An extreme case of bibliographic coupling occurred recentlyg when six references in each of two articles, each of which contained a total of eight references, were to the same earlier articles. These two articles covered the same subject with a remarkable degree of similarity. Another form of subjectsimilarity indicator is provided by co-citation coupling.l J In Fig. 3 articles 544

A Fig. 2. Bibliographic B coupling F@ 3. Co-citation coupling GR I SUN VAN KOL BAG CHA CITIffi tsf tsf prl Sps bap jrp Auth.Jour.Year Co-cited (Stren~th 5) Fig. & Citation matrix 545

A and B are perceived as being about the same subject by M and N which co-cite them in year P. Later, an allied subject emerges and W and X perceive that B and C are related. The subject areas containing A, B and B, C, presumably are related or would be if the number of co-citations was larger. Bibliographic coupling fixes the relationship between the citing papers A, B, for all time, but dynamic relationships are exposed by co-citation activity as authors perceive changing subject relationships. These functions (Fig. 4) can be shown as a matrix (taken from reference 8). Bibliographic coupling between two 19 articles is shown, whilst several 19 authors perceive the relationship between a 1968 and a 1970 article (the other symbols denote author and journal). A method has been evolved by Small and Griffith* 1,12 to use co-citations on a grand scale as part of an automatic clustering procedure. This method pre-supposes two effects-firstly that heavily cited articles are of greater interest than less cited articles, and secondly that heavily cited articles which are co-cited by many pairs, triples, quads, etc. of later articles are significant and subject related. Clustering 1S1 s annual machine-readable file covering all major Science and Technology-say the 1973 file-lists about 400,000 1973 articles together with the 4.5 million earlier articles which they cite. Some of these articles date back to antiquity (Aristotle and I-Ierodotus received a number of citations from 1973 articles), but a high proportion are concentrated within the last 20 years. In the clustering procedure, firstly only those articles cited p or more times are listed. This new file is substantially smaller than 4.5 million articles Fig. 5. Cited and co-citing papers Next, these highly cited papers are clustered by selecting one paper and listing all papers which are co-cited with it. Other papers which are co-cited with these papers are listed in turn until all cited papers linked by co-citations have been identified. The co-cited papers in a cluster depend upon a selected threshold level q, the minimum number of times any paper is co-cited. 546

In Fig. 5 p = 3, q = 2. For the experimental work various values are arbitrarily chosen for p and q. As the values are increased clusters separate from the mass, and at high values all but a few, characterized by intense publication activity, disappear. The process is analogous to flood water rising on hilly country; islands, and finally peaks are isolated. At a particular level of p and q, t600 clusters appeared and these have been individually examined. Subject relationships between papers may be determined by examining each paper in a cluster, or by examining the corpus of co-citing papers, or both. One convenient method is to analyse words in the titles of the co-citing papers. The subject matter, as expressed by significant high frequency words-that is as perceived from a consmsus of co-citing authors-may not necessarily be the same as it appears to be from examining the co-cited papers in the cluster. In the event, clusters appear to be definable scientific specialties Some work has been done to find out whether practicing experts agree with 1S1 s description of a specialty, and whether the articles in the clusters do reoresent maior contributions. The results look verv promising. A cluster id&-died as locus of control is mapped in Fig. rectangles containing Author, Journal and Year 6. &ticles a~e shown as of publication, with the TROTTERJB S02 LEA CLIN 54 *C 174 JOE VC 333 LEFCOURTM 264 GORE PM PSYCH REP PSYCH B J PERS. 71 4 (lfi~ 7R ; 63 (15~ I 200 L!??3QJ Fig. 6. Specality locus of control number of times cited in brackets. Figures on connecting lines are a measure of the connectedness of articles, derived from numbers of co-citations received. This particular cluster is not highly interconnected. t00 per cent connectedness would be represented by lines connecting each article with every other article. However a list of some of the co-citing articles, given in Fig. 7 shows that an interesting collection of papers in different fields and journals are drawn together by co-citation characteristics, although the background fields in which control is being examined maybe very different. 547

Number of core Description articles cited 8LANCHARDLB J SOC PSYCH 89 12373 Locus of control and prediction of voting behavtour tn college students (2) JOFFE JM SCIENCE 180 138373 Control of their envirorsrtent reduces emotionality in rates (3) EDMAROSAL ANNR PSYCH 24 241 73 Measurement of personality traits; theory and technique (2) SAOAVASW CANJ BEHS 5 371 73 Initiation to cannabis use-longitudinal social psychological study of college freshmen (2) PI!ARES EJ PSYCHOLREP 32 923 73 Source and type of wives. Problems as related to responsibility attribution, interpersonal attraction, and understanding (2) Fig.7. Examples of Iocusof control co-citing papers A similar procedure has been uscdfor clustering clusters-that is toshow how clusters are perceived as being related to each other. This provides insights to the structure of Science. Space precludcsadetailcd picture ofone of these maps, but part ofone (from reference IO) is shown in Fig. 8. The Fig,8. Part of scientific specialty map 548

figures within rectangles denote the number of articles in the cluster, and those on connecting lines the relative connectedness of cluster. This map was plotted from a smali sample of the 19 SCI file so weak links may not be statistic~lly significant. Annual analyses produce similar but more meaningful maps. Application Work is proceeding towards the interpretation of changes between successive annual maps as possible indicators of changing relationships between specialties and possible coalescence. For example there was a substantial difference between the t 9 and 1973 maps in the biomedical area when a number of clearly distinguishable separate specialties merged into one large specialty which has been entitled Viral genetics reverse transcription and chromosomes. Another possibility is the detection of new specialties or possible research fronta at any early stage. These fronts might be detected by virtue of their special characteristics (as has been suggested by Meadowsl 3, when analysing citation data. References 1. Merton R K. The sociology of science, University of Chicago Press, 197S. 2. Kuhn T S. The structure of scient:~ic reuokdiom. 2nd ed. University of Chicago Press, 1970. 3. See letters from A. Coudsmit ef al. and response from J.R. Cole and S. Cole under the title Citation Analysis. Science 183(41!20):28-33, 1974. 4, Cose J R & Cole S. Social stratt~iccation in science. University of Chicago Press, 1973. 5. Garfield E. Citation indexes in sociological and historical research. American Documentation 14(4):289-91, 1963. 6, Price D J D. Networks of scientific papers. Science 149(3683):510-15, 1965. 7. Garfield E, Sher I H & Torpie R J. The use of citation dots /or wi* the history oj science. Philadelphia: Institute for Scientific Information@, 1964, 86 pp. 8. Cawkell A E. Search strategy, construction and usc of citation networks with a socio. scientific example; amorphous semiconductors and S.R. Ovshinsky. J. Amer. Sot. InJorrrt. Sci. 25(2):123-30, 1974. 9. Neville A C & Smith D S. Airborne organism identified. Nature 223(5228): 199, 1970. 10. Small H. Co-citation in the scientific literature; a new measure of the relationships between two documents. j. Amer. Sot. InJorrn. Sci. 24(4): 265-69, 1973. 11. Small H & Griffith B C. The structure of scientific literatures. 1. Identifying and graphing specialties. Science Studies 4:17-40, 1974. 12. Griffith B C, Small H, Stonehill J A & Dey S. The structure of scientific literatures. 2. Toward a macro- and micro-structure for science. Science Studies 4:339-65, 1974. 13. Meadows A J & OCtmnor J G. Bibliographic statistics as a guide to growth points in science. Science Studies 1(1):95-99, 1971. 549