{"id":199,"date":"2018-07-10T04:50:51","date_gmt":"2018-07-10T04:50:51","guid":{"rendered":"http:\/\/liscp10.epgpbooks.inflibnet.ac.in\/?post_type=chapter&#038;p=199"},"modified":"2018-12-07T06:33:04","modified_gmt":"2018-12-07T06:33:04","slug":"challenges-of-bibliometric-and-scientometric-studies","status":"publish","type":"chapter","link":"https:\/\/ebooks.inflibnet.ac.in\/liscp10\/chapter\/challenges-of-bibliometric-and-scientometric-studies\/","title":{"rendered":"Challenges of Bibliometric and Scientometric Studies"},"content":{"raw":"<div><span style=\"float: right\"><a href=\"https:\/\/youtu.be\/79qFPZZKrSc\" target=\"_blank\" rel=\"noopener\"><img src=\"http:\/\/epgpbooks.inflibnet.ac.in\/wp-content\/uploads\/2018\/11\/download.png\" alt=\"epgp books\" width=\"75px\" height=\"75px;\" \/><\/a>\r\n<\/span><\/div>\r\n<div>\r\n\r\n&nbsp;\r\n\r\n&nbsp;\r\n\r\n&nbsp;\r\n\r\n<strong>I.\u00a0 <\/strong><strong>Objectives<\/strong>\r\n\r\n&nbsp;\r\n\r\nAfter going through this Unit you will be able to:\r\n\r\n&nbsp;\r\n\r\n\u2022\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 Understand the importance of bibliometric analysis\r\n\r\n\u2022\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 Identify the various indicators used in bibliometric studies\r\n\r\n\u2022\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 Classify the indicators according their purpose\r\n<p style=\"text-align: justify\">\u2022\u00a0\u00a0\u00a0\u00a0\u00a0 Appreciate that a number of important qualifications (and limitations) must be borne in mind when assessing the validity of bibliometric analysis<\/p>\r\n\r\n<div>\r\n\r\n&nbsp;\r\n\r\n<strong>II.\u00a0\u00a0\u00a0\u00a0\u00a0 <\/strong><strong>Module Structure<\/strong>\r\n\r\n&nbsp;\r\n\r\n<a href=\"#page3\">1.0 Introduction<\/a>\r\n\r\n<a href=\"#page4\">2.0 Limitations of Bibliometric Analysis<\/a>\r\n\r\n<a href=\"#page4\">3.0 Limitations of Citation Analysis<\/a>\r\n\r\n<a href=\"#page7\">4.0 Characteristics and Limitations of Bibliometric Indicators<\/a>\r\n\r\n<a href=\"#page7\">4.1 Publication Indicators<\/a>\r\n\r\n<a href=\"#page8\">4.2 Citation Indicators<\/a>\r\n\r\n<a href=\"#page11\">4.3 Journal Indicators<\/a>\r\n\r\n<a href=\"#page12\">5.0 Conclusion<\/a>\r\n\r\n<a href=\"#page13\">6.0 Summary<\/a>\r\n\r\n<\/div>\r\n<\/div>\r\n&nbsp;\r\n\r\n<strong style=\"text-align: initial;font-size: 1em\">1.0 Introduction<\/strong>\r\n\r\n&nbsp;\r\n<p style=\"text-align: justify\"><span style=\"text-align: justify;font-size: 1em\">Bibliometrics, a term coined by Pritchard in 1969, is a measure used to understand the output and impact of scientific communication. Publications and Citations are the two important variables normally used in bibliometrics. Bibliometrics has arguably provided ways and means of benchmarking and evaluation of scholarly work. In recent years bibliometrics has been a growing field of interest in Library and Information Science, yielding to various resultant factors in rankings and decision making process in library management and information services to the users. For example the citation analysis is also used as one of the methods employed in user studies.<\/span><\/p>\r\n&nbsp;\r\n<p style=\"text-align: justify\"><span style=\"font-size: 1em\">Bibliometrics \u2013 as a method and as a discipline - has received a greater deal of significance since its\u00a0 germination or genesis.\u00a0 One of the important aspects of the increasing interest in bibliometrics, in the libraries as well as in academia in general is the increasing use\u00a0 of\u00a0 bibliometric\u00a0 indicators\u00a0 to\u00a0 evaluate\u00a0 research performance of faculty and researchers, \u201cespecially in the university\u00a0 and\u00a0 government\u00a0 laboratories,\u00a0 and\u00a0 also\u00a0 by policymakers,\u00a0 research\u00a0 directors\u00a0 and\u00a0 administrators, information specialists and librarians and researchers by themselves\u201d\u00a0 (Pendlebury,\u00a0 2009).The\u00a0 objectivity\u00a0 with which the assessments can be made and repeatability of the analyses are basic reasons for its popularity.\u00a0 Other <\/span><strong style=\"font-size: 1em\">Source: European Physical Society,\u00a0 EDP\u00a0 <\/strong><span style=\"font-size: 1em\">reasons, for accepting bibliometrics as a measurement<\/span><\/p>\r\n\r\n<div>\r\n\r\n<img class=\"alignnone size-full wp-image-202 aligncenter\" src=\"http:\/\/liscp10.epgpbooks.inflibnet.ac.in\/wp-content\/uploads\/sites\/19\/2018\/07\/1-103.png\" alt=\"\" width=\"485\" height=\"673\" \/>\r\n\r\n&nbsp;\r\n<p style=\"text-align: center\"><strong>Sciences, 2009<\/strong><\/p>\r\n<p style=\"text-align: justify\">tool, is its being relatively inexpensive in terms of time, money and effort in its study, and provided a good data source is made available. Scalability is one of the main advantages of bibliometrics as a tool. In other words, it can be applied from a micro level, i.e., an individual researcher or an institute, to a macro level, i.e., country or global level. Ability for comparative analyses \u2013 temporal, geographic, linguistic, biographic, etc. \u2013 in bibliometrics has drawn the attention of many scholars. It has been universally accepted as an ideal method for assessing the research productivity.<\/p>\r\n&nbsp;\r\n<p style=\"text-align: justify\"><span style=\"font-size: 1em\">The use in library administration and management is one of the early applications of bibliometrics. Use of bibliometrics in collection development and management in libraries is a well known practice, not the least in relation to digital library management. As a student of Library and Information Science (LIS), you would be interested to know that bibliometrics is a well-established part of LIS research. There has been an increase in the number of research activities by the LIS profession in recent years (Naseer and Mahmood, 2009).<\/span><\/p>\r\n&nbsp;\r\n<p style=\"text-align: justify\"><span style=\"font-size: 1em\">Not everything is green for bibliometrics. It has received some criticisms as well. While bibliometric data bring useful information, the implementation often seems to arise from a loss of critical and rational mind and application. In this Unit an attempt is made to identify and to understand the limitations of bibliometrics studies.<\/span><\/p>\r\n&nbsp;\r\n<p style=\"text-align: justify\"><strong style=\"text-align: initial;font-size: 1em\">2.0 Limitations of Bibliometric Analysis<\/strong><\/p>\r\n&nbsp;\r\n<p style=\"text-align: justify\"><span style=\"font-size: 1em\">Bibliometrics undoubtedly has its distinct strengths. However, it is also subjected to several valid criticisms. Using bibliometrics to measure the quality in scholarly work has attracted attention of the critiques. As Lalo\u00eb and Mosser (2009) put it, the use of indices such as the H-index at the level of individuals is easy and therefore attractive, but mostly unscientific. Publication counts, one of the widely used indicators, is criticised for this measure of only the quantity and not the quality. Publication counts have also been subject to other criticisms, such as problems associated with gratuitous co-authoring of articles; different publication practices across fields; and difficulties of defining fields of research especially given strong trends towards collaborative research (Lundberg, 2006). These kinds of criticisms can be seen for other measures also.<\/span><\/p>\r\n&nbsp;\r\n<p style=\"text-align: justify\"><strong style=\"text-align: initial;font-size: 1em\">3.0 Limitations of Citation Analysis<\/strong><\/p>\r\n&nbsp;\r\n<p style=\"text-align: justify\"><span style=\"font-size: 1em\">Citation analysis, one of the most applied bibliometrics techniques, is also not far from receiving the criticisms. Let us try to understand the limitations of citation analysis in more detail in the subsequent section.<\/span><\/p>\r\n\r\n<\/div>\r\n<div>\r\n\r\n<img class=\"alignnone size-full wp-image-203\" src=\"http:\/\/liscp10.epgpbooks.inflibnet.ac.in\/wp-content\/uploads\/sites\/19\/2018\/07\/1-104.png\" alt=\"\" width=\"316\" height=\"320\" \/>\r\n<p style=\"text-align: justify\">There exists a relationship between cited and citing documents; and a citation represents the relationship between them. This is the fundamental principle on which\u00a0<span style=\"font-size: 1em;text-align: initial\">citation analysis is based upon. The citation analysis is the area of bibliometrics which deals with the study of this relationship between cited and citing references. Undoubtedly, citation analysis is the most used and useful technique of all. As a concept, it has been responsible for the development of most of the citation databases such Thomson Reuters\u2019s Citation Index, Elsiever\u2019s Scopus, Google\u2019s Google Scholar and so on. Citation analysis is the basis for the development of \u2018Citation Indexing\u2019 by Eugene Garfield. Citation indexing is a kind of indexing in which the bibliographic references of documents are made searchable and refer to the documents being indexed. The cited references in a document are made to be a part of the subject access points available for information retrieval.<\/span><\/p>\r\n&nbsp;\r\n<p style=\"text-align: justify\"><span style=\"font-size: 1em\">Why do researchers cite? What is the citers\u2019 motivation for referencing earlier work? These questions have been comprehensively answered by Garfield (1979), the person who originated the citation analysis. He gives a list of 15 reasons for authors to cite earlier works. On examination of these reasons, one may find some of them really show the scholarly impact; and some of them indicate that they have less-than-noble intention behind them. It is the second category of reasons which attract the attention of the critics; and hampers the very purpose of citation analysis.<\/span><\/p>\r\n&nbsp;\r\n<p style=\"text-align: justify\"><span style=\"text-align: initial;font-size: 1em\">Citation analysis is based on a few assumptions: 1) Citation of a document implies use of that document by the citing author; 2) Citation of document (author, journal, etc.) reflects the merit (quality, significance, impact) of that document (author, journal, etc.); 3) Citations are made to best possible works; 4) A cited document is semantically related in content to the citing document (if two documents are bibliographically coupled, they are related in content; and if two documents are co-cited, they are related in content); and 5) All citations are equal. All these assumptions have inherent flaws in them which are succinctly described below:<\/span><\/p>\r\n\r\n<ul>\r\n \t<li style=\"text-align: justify\"><strong style=\"text-align: initial;font-size: 1em\">Criticism about the first assumption<\/strong><span style=\"text-align: initial;font-size: 1em\">: The first assumption implies that the citing author has either partly or fully used\/influenced by the ideas in the cited work; and secondly that all the cited documents were indeed used by the citing author. Failure to meet any one of these conditions amounts to sins of omission and commission. These \u2018sins\u2019 will have a negative impact on the fundamental principle on which citation analysis is based upon.<\/span><\/li>\r\n \t<li style=\"text-align: justify\"><strong style=\"font-size: 1em\">Criticism about the second assumption<\/strong><span style=\"font-size: 1em\">: The citations received by a document show its quality is the meaning of this assumption. On the face value, one may say that there is a positive correlation between the number of citations received and the quality of the article. But it is not always true. Sometimes, citations are received for wrong reasons also. It has been shown by many studies that the authors have the habit of giving citations to the spurious works also. This also shakes the very fundamentals of citation analysis.<\/span><\/li>\r\n \t<li style=\"text-align: justify\"><strong style=\"font-size: 1em\">Criticism about the third assumption<\/strong><span style=\"font-size: 1em\">: Studies often show that not all good works are cited. Number of Citations, among other reasons, also depend upon the availability (accessibility) of the documents to the authors. Accessibility of a document may be a function of its form, place of origin, age, and language. Hence, non-availability of documents may have a negative impact on the citation analysis.<\/span><\/li>\r\n \t<li style=\"text-align: justify\"><strong style=\"font-size: 1em\">Criticism about the fourth assumption: <\/strong><span style=\"font-size: 1em\">This assumption has a bearing on the information retrieval function of the citation databases. Martyn (1964) contends that a bibliographic coupling is not a valid unit of measurement because one does not know that two documents citing a third are citing the identical unit of information in it. The same applies to co-citation as well; the fact that two papers are co-cited does not guarantee a common relation- ship between their contents.<\/span><\/li>\r\n \t<li style=\"text-align: justify\"><strong style=\"font-size: 1em\">Criticism about the fifth assumption: <\/strong><span style=\"font-size: 1em\">It is not difficult to see that all the papers cited in an article are not of equal importance in the context of the citing work. However, this varied importance of the cited articles are neither reflected in the reference list nor used for citation analysis. This might have a negative impact on the overall results.<\/span><\/li>\r\n<\/ul>\r\n&nbsp;\r\n<p style=\"text-align: justify\">Apart from the above, as Smith (1981) lists, the other parameters which may induce errors in the citation analysis are: multiple authorship, self-citations, homographs, synonyms, types of sources, implicit citations, fluctuations with time, field variations, and errors. The limitations of citation analysis do not negate its value as a research method\u00a0<span style=\"font-size: 1em;text-align: initial\">when used with care. There are, in fact, several application areas where citation analysis has been used successfully.<\/span><\/p>\r\n&nbsp;\r\n<p style=\"text-align: justify\"><strong style=\"text-align: initial;font-size: 1em\">4.0 Characteristics and Limitations of Bibliometric Indicators<\/strong><\/p>\r\n&nbsp;\r\n<p style=\"text-align: justify\"><span style=\"font-size: 1em\">It is not uncommon to use bibliometrics as the tool for research assessment as it is considered as an objective, quantitative and un-obstructive method. These bibliometric indicators have become important for individual researchers and organizations. For researchers they are important because they provide objective mode of assessment of diffusion and impact of articles on their works. For organizations, the bibliometric indicators are significant because they are the means of assessing the quality of particular work, person, or group. However, as said in the last segment of the previous section, the usability of the indicators has to be properly assessed before applying them for quantification. When applied judiciously with care and caution, the bibliometric indicators provide valid results useful for decision making.<\/span><\/p>\r\n&nbsp;\r\n<p style=\"text-align: justify\"><span style=\"font-size: 1em\">The indicators are normally used as unit of analysis in various bibliometric studies. The indicators can be categorised, for the sake of explanation here, into three groups, viz., Publication Indicators; Citation Indicators; and Journal Indicators. The following section provides a brief explanations of indicators used in bibliometrics under each of these categories along with their advantages and limitations, if any. The list is compiled from the list given by Rehn (2007).<\/span><\/p>\r\n&nbsp;\r\n<p style=\"text-align: justify\"><strong style=\"text-align: initial;font-size: 1em\">4.1 Publication Indicators<\/strong><\/p>\r\n\r\n<ul>\r\n \t<li style=\"text-align: justify\"><strong style=\"font-size: 1em\">Number of Publications<\/strong><span style=\"font-size: 1em\">: It is the number of publications published either by an author, institute, country or so on. The time span is also taken in many situations to suit the temporal scope. The data is collected either directly from the original publications from databases. It is relatively easy to collect data. Although this count is a very straightforward indicator that can be easily calculated by the authors themselves, one must be very careful when using it to compare authors or research groups. The disadvantages of this indicator are: when used does not take the size of the analysed unit; and does not speak of the impact of the publications counted.<\/span><\/li>\r\n \t<li style=\"text-align: justify\"><strong style=\"font-size: 1em\">Number of ISI Publications<\/strong><span style=\"font-size: 1em\">: It is the number of publications indexed by Thomson ISI indices. Temporal and geographic filters are applied many a times in many studies.\u00a0<\/span><span style=\"font-size: 1em;text-align: initial\">Quite easy to collect data as it can be directly collected from the databases. The disadvantages are: when used does not take the size of the analysed unit; has inherent problem of scope and coverage as that of ISI indices; and does not count non-ISI publications.<\/span><\/li>\r\n \t<li style=\"text-align: justify\"><strong style=\"text-align: initial;font-size: 1em\">Number of Publications in Top Journals<\/strong><span style=\"text-align: initial;font-size: 1em\">: It is the number of publications the analyzed unit has published in a selected number of journals during the analyzed time span. The selection of journals is usually made on some criteria. The advantage is that as the data is collected from top journals (which show their relative importance among others in the group); it is a better count than a mere publication count. The disadvantages are: does not take the size of the analyzed unit into account; and has the limitations of the selection criteria. Although this approach may look like a performance indicator, it was designed to address the shortcoming of the above-mentioned quantity indicator.<\/span><\/li>\r\n<\/ul>\r\n&nbsp;\r\n\r\n<strong style=\"text-align: initial;font-size: 1em\">4.2 Citation Indicators<\/strong>\r\n\r\n<\/div>\r\n<div>\r\n<p style=\"text-align: justify\">\u2022\u00a0\u00a0\u00a0\u00a0\u00a0 <strong>Number of citations<\/strong>: It is the total number of references received from other works,<\/p>\r\n<strong>\u00a0<\/strong>\r\n\r\ni.e., number of citations to articles published by an analyzed unit during the analyzed\r\n\r\n<strong>\u00a0<img class=\"alignnone size-full wp-image-204 aligncenter\" src=\"http:\/\/liscp10.epgpbooks.inflibnet.ac.in\/wp-content\/uploads\/sites\/19\/2018\/07\/1-105.png\" alt=\"\" width=\"150\" height=\"109\" \/><\/strong>\r\n<p style=\"text-align: justify\">time span. The citation of one article by another is characteristic of scientific publications, and it is generally accepted that the number of citations of a particular article receives is a reflection of its impact in the scientific community (Rhen, 2006). The data has to be collected from the citation databases such as Thomson Reuters Web of Knowledge, Scopus, Google Scholar, CiteseerX and so on. As collected from databases, data and results are verifiable. Limitations of this indicator include: it does not take into account older articles as usually are more cited and that citation rates vary between document types and subject areas; and does not compensate for size of the unit.<\/p>\r\n\r\n<ul>\r\n \t<li style=\"text-align: justify\"><strong>\u00a0<\/strong><strong>Citations per publication<\/strong>: It is the average number of citations to articles published by an analyzed unit during the analyzed time span. It is calculated by the ratio of total publications and dividing by the total number of publications considered. The limitations are: Does not take into account that older articles usually are more cited\u00a0<span style=\"font-size: 1em;text-align: initial\">if a variable, cumulative citation time window is used, and that citation rates vary between document types and subject areas.<\/span><\/li>\r\n \t<li style=\"text-align: justify\"><strong style=\"font-size: 1em\">Field Normalized Score<\/strong><span style=\"font-size: 1em\">: This indicator corresponds to the relative number of citations to publications from a specific unit, compared to the world average of citations to publications of the same document type, age and subject area. It is calculated as follows: The number of citations to each of the unit\u2019s publications is normalized by dividing it with the world average of citations to publications of the same document type, publication year and subject area, which is called the field reference value (\u00b5f). If an article is classified as belonging to several subject areas, a mean value of the areas is used. The limitations include if the normalization is done on an article level, a few highly cited articles in a moderately cited research area may contribute un-proportionately to the value of the field normalized citation score.<\/span><\/li>\r\n \t<li style=\"text-align: justify\"><strong style=\"font-size: 1em\">Total field normalized citation score<\/strong><span style=\"font-size: 1em\">: This indicator gives an indication of both the impact and the production volume of the analyzed unit. The score is got by adding together the item oriented field normalized citation scores for all the publications of the analyzed unit. The disadvantage is that it does not compensate for the size of the analyzed unit.<\/span><\/li>\r\n \t<li style=\"text-align: justify\"><strong style=\"font-size: 1em\">Journal normalized citation score<\/strong><span style=\"font-size: 1em\">: This indicator corresponds to the number of citations to publications from a specific unit during an analyzed time span, compared to the world average of citations to publications of the same document types, ages and in the same journals. The calculation is as follows: the number of citations to each of the unit\u2019s publications is normalized by dividing it with the world average of citations to publications of the same document type, published in the same year in the same journal. The indicator is the mean value of all the normalized citation counts for the unit\u2019s publications.<\/span><\/li>\r\n \t<li style=\"text-align: justify\"><strong style=\"font-size: 1em\">Crown indicator<\/strong><span style=\"font-size: 1em\">: It is developed by Center for Science and Technologies Studies at Leiden University. It intends to measure the scientific impact of a researcher or a research group. This indicator is calculated by dividing the average number of received citations (from a researcher or a research group) by the average number that could be expected for publications of the same type, during the same year, and published in journals within the same field (Lundberg, 2007). It has a few flaws also.\u00a0<\/span>First, its dependence on categories published by Thomoson Reuters leads to a problem that it does not take into account that publications from a particular field are often published in journals categorized in another field. Second, the size of a research group influences its productivity \u2014 quite simply, the more researchers in a group, the larger the number of published articles. It is therefore recommended to compare research groups with the crown indicator only if the groups are of similar sizes (Lundberg, 2007).<\/li>\r\n \t<li style=\"text-align: justify\"><strong style=\"text-align: initial;font-size: 1em\">h-index<\/strong><span style=\"text-align: initial;font-size: 1em\">: The h-index is an index that attempts to measure both the scientific productivity and the apparent scientific impact of a scientist. J.E. Hirsch introduced it<\/span><\/li>\r\n<\/ul>\r\n<\/div>\r\n<div>\r\n\r\n<img class=\"alignnone size-full wp-image-205\" src=\"http:\/\/liscp10.epgpbooks.inflibnet.ac.in\/wp-content\/uploads\/sites\/19\/2018\/07\/1-106.png\" alt=\"\" width=\"185\" height=\"141\" \/>\r\n\r\n&nbsp;\r\n<p style=\"text-align: justify\">in 2005 and defined it in the following way: \u201cA scientist has index h if h of [his\/her] Np papers have at least h citations each, and the other (Np -h)papers have at most h citations each\u201d. The \u2018Web of Science\u2019 now gives direct access to the H index in a few mouse clicks. It is calculated as follows: find the unit\u2019s published articles in a citation index and sort them in descending order by number of citations. Count articles from the top of the list and downwards, and when the number of an article rises above the citation count for that very article, the number of the preceding article is to be counted as the h-index. H-index is criticized as it gives positive bias to senior researchers with older articles, since these have had more time to be cited, though the demand that new articles with comparable citation levels has to be added has a certain damping effect on that bias.<\/p>\r\n\r\n<ul>\r\n \t<li style=\"text-align: justify\"><strong>Uncitedness<\/strong>: It is the share of a unit\u2019s publications that that remain uncited after a certain time period. Self-citations should be removed from the citation count. It requires data from a comprehensive citation database such as the Thomson citation indices and validation of the unit\u2019s publications.<\/li>\r\n \t<li style=\"text-align: justify\"><strong style=\"font-size: 1em\">Self-citation<\/strong><span style=\"font-size: 1em\">: It is the share of a unit\u2019s received citations where authors refer to their own papers. The calculation of the self-citation is as follows: count the total number of citations to the unit\u2019s publications during the analyzed time span. Check where citations are coming from and count the number coming from the unit itself. Divide the second number with the first to get share of self citedness. The requirement for getting self-citation is that it requires data from a comprehensive citation database\u00a0<\/span><span style=\"font-size: 1em;text-align: initial\">such as the Thomson citation indices, validation of publications and analysis of citing articles, which can be done in the ISI Web of Science.<\/span><\/li>\r\n<\/ul>\r\n&nbsp;\r\n\r\n<strong style=\"text-align: initial;font-size: 1em\">4.3 <\/strong><strong style=\"text-align: initial;font-size: 1em\">Journal Indicators<\/strong>\r\n\r\n<\/div>\r\n<div>\r\n<ul>\r\n \t<li style=\"text-align: justify\"><strong>Impact factor<\/strong>: The impact factor (IF) of an academic journal is a measure reflecting the average number of citations to recent articles published in the journal and intended to gauge the importance of a journal in its given field. It is perceived that higher impact factor of a journal more important it is in that field than those with lower ones. The impact factor was devised by Eugene Garfield, the founder of the Institute for Scientific Information. Impact factor is calculated yearly for those journals that are indexed in the Journal Citation Reports. IFs are available in the SCI (Science Citation Index) Journal Citation Reports and on the Web of Knowledge for more than 8000 selected scientific journals. The IF does have several limitations (Durieux &amp; Gevenois, 2010). First, although a higher IF can suggest a greater impact of a journal, it does not reflect the quality of each particular article published by that journal. Consequently, it is not clear whether a high IF is due to a moderate degree of citation of all of the articles published or to a high degree of citation of only some articles. Second, multidisciplinary journals usually have a higher IF than specialized journals. Third, there are differences between research fields, including in research intensity. The highest ranking journal in each specialized field may have a very different IF from specialty to specialty. Fourth, the types of articles published by a journal also influence its IF. Review articles and technical reports are more frequently quoted than are original research articles, case reports, and pictorial essays.<\/li>\r\n \t<li style=\"text-align: justify\"><strong style=\"font-size: 1em\">Normalized Journal Impact Factor<\/strong><span style=\"font-size: 1em\">: This indicator corresponds to the relative number of citations to publications in one specific journal, compared to the world average of citations to publications of the same document type, age and subject area. The indicator is stated as a decimal number that shows the relation of the number of citations to the world average. As an example, 0.9 means that publications in this journal are cited 10% below average and 1.2 that they are cited 20% above average.<\/span><\/li>\r\n \t<li style=\"text-align: justify\"><strong style=\"font-size: 1em\">Immediacy Index<\/strong><span style=\"font-size: 1em\">: It is an indicator which measures the current importance of the work published by a journal by calculating the average number of times articles published during a particular year by a specific journal is cited over the course of that same year. The immediacy index is useful for identifying the journals publishing the articles in the emerging areas. It is said that immediacy index has an unintended bias towards articles published in the earlier part of the year as they would have better and more chance to get cited than those articles published later in the year.<\/span><\/li>\r\n \t<li style=\"text-align: justify\"><strong style=\"font-size: 1em\">Journal-to-field impact score<\/strong><span style=\"font-size: 1em\">: The journal-to-field impact score has been proposed by the Center for Science and Technologies Studies of Leiden University (Leiden, the Netherlands) as an alternative to the IF. It measures the average number of cited articles in a specific journal and compares this number with that of other journals in the same research field category. The field categorization of journals is based on the journal subject categories, which are defined by Thomson Reuters. By ranking journals in a given subject category, this score overcomes the limitations of IF related to research field characteristics such as productivity, citation habits, and citation dynamics<\/span><\/li>\r\n<\/ul>\r\n<\/div>\r\n<div>\r\n\r\n&nbsp;\r\n\r\n<strong>5.0 Conclusion<\/strong>\r\n\r\n&nbsp;\r\n<p style=\"text-align: justify\">Bibliometric and Scientometric analysis are based on many indicators. These indicators seek to measure the quantity and impact of research publications. The indicators are used increasingly in evaluation processes in universities, and public and private research institutes. Each of these indicators has its own merits and limitations. Interpreted as exhaustive measures of scientific\/research output, the indicators would present a biased story. However, when used with caution, they can reveal some insights through trends regarding aspects of scientific\/research production at global level.<\/p>\r\n&nbsp;\r\n<p style=\"text-align: justify\">As a conclusion, let us bear in mind the following words-of-caution given by Durieux and Gevenois (2010) while using the bibliometric and scientometric indicators for analysis:<\/p>\r\n&nbsp;\r\n<ul>\r\n \t<li style=\"text-align: justify\">Performance indicators are based on the assumption that the quality of a particular article is reflected by the frequency of its citations in other articles.<\/li>\r\n \t<li style=\"text-align: justify\">Given differences between fields of research in terms of productivity, citation habits, and citation dynamics, bibliometric indicators should not be used for comparing researchers, research groups, or journals from different fields.<\/li>\r\n \t<li style=\"text-align: justify\">It is recommended to measure the quality and the impact of scientific journals, research groups, or particular researchers through several indicators rather than only one.<\/li>\r\n<\/ul>\r\n<\/div>\r\n<div>\r\n\r\n&nbsp;\r\n\r\n<strong>6.0 Summary<\/strong>\r\n\r\n&nbsp;\r\n<p style=\"text-align: justify\">Bibliometrics is a set of mathematical and statistical tool used to measure quantity and quality of books, articles, and other genera of publications. Studies indicate that bibliometrics, as a metric, is objective, quantitative and un-obstructive method used for. However, it is not without any limitations. The limitations in citation analysis is discussed in the Unit Critics have also shown the flaws in most of the indicators used in bibliometric studies. Each of these indicators along with their advantages and limitations has been explained. The bibliometric analysis and the use of indicators would serve the purpose when used with care. This unit provides an overview of the currently used bibliometric indicators and summarizes the limitations and characteristics one should be aware of when evaluating the quantity and quality of scientific output.<\/p>\r\n\r\n<\/div>\r\n<table>\r\n<tbody>\r\n<tr>\r\n<td><strong>you can view video on Challenges of Bibliometric and Scientometric Studies<\/strong><\/td>\r\n<td><a href=\"https:\/\/youtu.be\/79qFPZZKrSc\" target=\"_blank\" rel=\"noopener\"><img class=\"alignnone wp-image-120\" src=\"http:\/\/epgpbooks.inflibnet.ac.in\/wp-content\/uploads\/2018\/11\/download.png\" alt=\"\" width=\"36\" height=\"36\" \/><\/a><\/td>\r\n<\/tr>\r\n<\/tbody>\r\n<\/table>\r\n\r\n<strong>References<\/strong>\r\n\r\n&nbsp;\r\n<ul>\r\n \t<li style=\"text-align: justify\">Durieux, V., &amp; Gevenois, P. A. (2010). Bibliometric Indicators: Quality Measurements of Scientific Publication 1. <em>Radiology<\/em>, <em>255<\/em>(2), 342-351.<\/li>\r\n \t<li style=\"text-align: justify\">Garfield, E. (1979). <em style=\"text-align: initial;font-size: 1em\">Citation indexing: Its theory and application in science, technology, and\u00a0<\/em><em style=\"font-size: 1em\">humanities <\/em><span style=\"font-size: 1em\">(Vol. 8). New York: Wiley.<\/span><\/li>\r\n \t<li style=\"text-align: justify\">Lalo\u00eb, F., &amp; Mosseri, R. (2009). Bibliometric evaluation of individual researchers: not even right... not even wrong!. <em style=\"font-size: 1em\">Europhysics News<\/em><span style=\"font-size: 1em\">, <\/span><em style=\"font-size: 1em\">40<\/em><span style=\"font-size: 1em\">(5), 26-29.<\/span><\/li>\r\n \t<li style=\"text-align: justify\">Lundberg, J. (2006). <em style=\"font-size: 1em\">Bibliometrics as a research assessment tool: impact beyond the impact<\/em> <em style=\"font-size: 1em\">factor. <\/em><span style=\"font-size: 1em\">Doctoral Thesis. Sweden:Korolinska Instituet.<\/span><\/li>\r\n \t<li style=\"text-align: justify\">Lundberg, J. (2007). Lifting the crown\u2014citation z-score. <em style=\"text-align: initial;font-size: 1em\">Journal of informetrics<\/em><span style=\"text-align: initial;font-size: 1em\">, <\/span><em style=\"text-align: initial;font-size: 1em\">1<\/em><span style=\"text-align: initial;font-size: 1em\">(2), 145-154.<\/span><\/li>\r\n \t<li style=\"text-align: justify\">Martyn, J. (1964). Bibliographic coupling. <em style=\"text-align: initial;font-size: 1em\">Journal of documentation<\/em><span style=\"text-align: initial;font-size: 1em\">, <\/span><em style=\"text-align: initial;font-size: 1em\">20<\/em><span style=\"text-align: initial;font-size: 1em\">(4), 236-236.<\/span><\/li>\r\n \t<li style=\"text-align: justify\">Naseer, M. M., &amp; Mahmood, K. (2009). Use of bibliometrics in LIS research. <em style=\"font-size: 1em\">LIBRES: Library<\/em> <em style=\"font-size: 1em\">and Information Science Research Electronic Journal<\/em><span style=\"font-size: 1em\">,<\/span><em style=\"font-size: 1em\"> 19<\/em><span style=\"font-size: 1em\">(2).<\/span><\/li>\r\n \t<li style=\"text-align: justify\">Pendlebury, D.A. (2009). Whitepaper: Using bibliometrics: A guide to evaluating research performance with citation data. Philadelphia: Thomson Reuters.<\/li>\r\n \t<li style=\"text-align: justify\">Rehn, C., &amp; Kronman, U. (2008). Bibliometric handbook for Karolinska Institutet. Huddinge: Karolinska Institutet.<\/li>\r\n \t<li style=\"text-align: justify\">Rehn, U. K. C. (2007). Bibliometric indicators\u2013definitions and usage at Karolinska Institutet.<\/li>\r\n \t<li style=\"text-align: justify\">Smith, L. C. (1981). Citation analysis. <em style=\"text-align: initial;font-size: 1em\">Library trends<\/em><span style=\"text-align: initial;font-size: 1em\">, <\/span><em style=\"text-align: initial;font-size: 1em\">30<\/em><span style=\"text-align: initial;font-size: 1em\">(1), 83-106.<\/span><\/li>\r\n<\/ul>","rendered":"<div><span style=\"float: right\"><a href=\"https:\/\/youtu.be\/79qFPZZKrSc\" target=\"_blank\" rel=\"noopener\"><img decoding=\"async\" src=\"http:\/\/epgpbooks.inflibnet.ac.in\/wp-content\/uploads\/2018\/11\/download.png\" alt=\"epgp books\" width=\"75px\" height=\"75px;\" \/><\/a><br \/>\n<\/span><\/div>\n<div>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p><strong>I.\u00a0 <\/strong><strong>Objectives<\/strong><\/p>\n<p>&nbsp;<\/p>\n<p>After going through this Unit you will be able to:<\/p>\n<p>&nbsp;<\/p>\n<p>\u2022\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 Understand the importance of bibliometric analysis<\/p>\n<p>\u2022\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 Identify the various indicators used in bibliometric studies<\/p>\n<p>\u2022\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 Classify the indicators according their purpose<\/p>\n<p style=\"text-align: justify\">\u2022\u00a0\u00a0\u00a0\u00a0\u00a0 Appreciate that a number of important qualifications (and limitations) must be borne in mind when assessing the validity of bibliometric analysis<\/p>\n<div>\n<p>&nbsp;<\/p>\n<p><strong>II.\u00a0\u00a0\u00a0\u00a0\u00a0 <\/strong><strong>Module Structure<\/strong><\/p>\n<p>&nbsp;<\/p>\n<p><a href=\"#page3\">1.0 Introduction<\/a><\/p>\n<p><a href=\"#page4\">2.0 Limitations of Bibliometric Analysis<\/a><\/p>\n<p><a href=\"#page4\">3.0 Limitations of Citation Analysis<\/a><\/p>\n<p><a href=\"#page7\">4.0 Characteristics and Limitations of Bibliometric Indicators<\/a><\/p>\n<p><a href=\"#page7\">4.1 Publication Indicators<\/a><\/p>\n<p><a href=\"#page8\">4.2 Citation Indicators<\/a><\/p>\n<p><a href=\"#page11\">4.3 Journal Indicators<\/a><\/p>\n<p><a href=\"#page12\">5.0 Conclusion<\/a><\/p>\n<p><a href=\"#page13\">6.0 Summary<\/a><\/p>\n<\/div>\n<\/div>\n<p>&nbsp;<\/p>\n<p><strong style=\"text-align: initial;font-size: 1em\">1.0 Introduction<\/strong><\/p>\n<p>&nbsp;<\/p>\n<p style=\"text-align: justify\"><span style=\"text-align: justify;font-size: 1em\">Bibliometrics, a term coined by Pritchard in 1969, is a measure used to understand the output and impact of scientific communication. Publications and Citations are the two important variables normally used in bibliometrics. Bibliometrics has arguably provided ways and means of benchmarking and evaluation of scholarly work. In recent years bibliometrics has been a growing field of interest in Library and Information Science, yielding to various resultant factors in rankings and decision making process in library management and information services to the users. For example the citation analysis is also used as one of the methods employed in user studies.<\/span><\/p>\n<p>&nbsp;<\/p>\n<p style=\"text-align: justify\"><span style=\"font-size: 1em\">Bibliometrics \u2013 as a method and as a discipline &#8211; has received a greater deal of significance since its\u00a0 germination or genesis.\u00a0 One of the important aspects of the increasing interest in bibliometrics, in the libraries as well as in academia in general is the increasing use\u00a0 of\u00a0 bibliometric\u00a0 indicators\u00a0 to\u00a0 evaluate\u00a0 research performance of faculty and researchers, \u201cespecially in the university\u00a0 and\u00a0 government\u00a0 laboratories,\u00a0 and\u00a0 also\u00a0 by policymakers,\u00a0 research\u00a0 directors\u00a0 and\u00a0 administrators, information specialists and librarians and researchers by themselves\u201d\u00a0 (Pendlebury,\u00a0 2009).The\u00a0 objectivity\u00a0 with which the assessments can be made and repeatability of the analyses are basic reasons for its popularity.\u00a0 Other <\/span><strong style=\"font-size: 1em\">Source: European Physical Society,\u00a0 EDP\u00a0 <\/strong><span style=\"font-size: 1em\">reasons, for accepting bibliometrics as a measurement<\/span><\/p>\n<div>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-202 aligncenter\" src=\"http:\/\/liscp10.epgpbooks.inflibnet.ac.in\/wp-content\/uploads\/sites\/19\/2018\/07\/1-103.png\" alt=\"\" width=\"485\" height=\"673\" srcset=\"https:\/\/ebooks.inflibnet.ac.in\/liscp10\/wp-content\/uploads\/sites\/19\/2018\/07\/1-103.png 485w, https:\/\/ebooks.inflibnet.ac.in\/liscp10\/wp-content\/uploads\/sites\/19\/2018\/07\/1-103-216x300.png 216w, https:\/\/ebooks.inflibnet.ac.in\/liscp10\/wp-content\/uploads\/sites\/19\/2018\/07\/1-103-65x90.png 65w, https:\/\/ebooks.inflibnet.ac.in\/liscp10\/wp-content\/uploads\/sites\/19\/2018\/07\/1-103-225x312.png 225w, https:\/\/ebooks.inflibnet.ac.in\/liscp10\/wp-content\/uploads\/sites\/19\/2018\/07\/1-103-350x486.png 350w\" sizes=\"auto, (max-width: 485px) 100vw, 485px\" \/><\/p>\n<p>&nbsp;<\/p>\n<p style=\"text-align: center\"><strong>Sciences, 2009<\/strong><\/p>\n<p style=\"text-align: justify\">tool, is its being relatively inexpensive in terms of time, money and effort in its study, and provided a good data source is made available. Scalability is one of the main advantages of bibliometrics as a tool. In other words, it can be applied from a micro level, i.e., an individual researcher or an institute, to a macro level, i.e., country or global level. Ability for comparative analyses \u2013 temporal, geographic, linguistic, biographic, etc. \u2013 in bibliometrics has drawn the attention of many scholars. It has been universally accepted as an ideal method for assessing the research productivity.<\/p>\n<p>&nbsp;<\/p>\n<p style=\"text-align: justify\"><span style=\"font-size: 1em\">The use in library administration and management is one of the early applications of bibliometrics. Use of bibliometrics in collection development and management in libraries is a well known practice, not the least in relation to digital library management. As a student of Library and Information Science (LIS), you would be interested to know that bibliometrics is a well-established part of LIS research. There has been an increase in the number of research activities by the LIS profession in recent years (Naseer and Mahmood, 2009).<\/span><\/p>\n<p>&nbsp;<\/p>\n<p style=\"text-align: justify\"><span style=\"font-size: 1em\">Not everything is green for bibliometrics. It has received some criticisms as well. While bibliometric data bring useful information, the implementation often seems to arise from a loss of critical and rational mind and application. In this Unit an attempt is made to identify and to understand the limitations of bibliometrics studies.<\/span><\/p>\n<p>&nbsp;<\/p>\n<p style=\"text-align: justify\"><strong style=\"text-align: initial;font-size: 1em\">2.0 Limitations of Bibliometric Analysis<\/strong><\/p>\n<p>&nbsp;<\/p>\n<p style=\"text-align: justify\"><span style=\"font-size: 1em\">Bibliometrics undoubtedly has its distinct strengths. However, it is also subjected to several valid criticisms. Using bibliometrics to measure the quality in scholarly work has attracted attention of the critiques. As Lalo\u00eb and Mosser (2009) put it, the use of indices such as the H-index at the level of individuals is easy and therefore attractive, but mostly unscientific. Publication counts, one of the widely used indicators, is criticised for this measure of only the quantity and not the quality. Publication counts have also been subject to other criticisms, such as problems associated with gratuitous co-authoring of articles; different publication practices across fields; and difficulties of defining fields of research especially given strong trends towards collaborative research (Lundberg, 2006). These kinds of criticisms can be seen for other measures also.<\/span><\/p>\n<p>&nbsp;<\/p>\n<p style=\"text-align: justify\"><strong style=\"text-align: initial;font-size: 1em\">3.0 Limitations of Citation Analysis<\/strong><\/p>\n<p>&nbsp;<\/p>\n<p style=\"text-align: justify\"><span style=\"font-size: 1em\">Citation analysis, one of the most applied bibliometrics techniques, is also not far from receiving the criticisms. Let us try to understand the limitations of citation analysis in more detail in the subsequent section.<\/span><\/p>\n<\/div>\n<div>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-203\" src=\"http:\/\/liscp10.epgpbooks.inflibnet.ac.in\/wp-content\/uploads\/sites\/19\/2018\/07\/1-104.png\" alt=\"\" width=\"316\" height=\"320\" srcset=\"https:\/\/ebooks.inflibnet.ac.in\/liscp10\/wp-content\/uploads\/sites\/19\/2018\/07\/1-104.png 316w, https:\/\/ebooks.inflibnet.ac.in\/liscp10\/wp-content\/uploads\/sites\/19\/2018\/07\/1-104-296x300.png 296w, https:\/\/ebooks.inflibnet.ac.in\/liscp10\/wp-content\/uploads\/sites\/19\/2018\/07\/1-104-65x66.png 65w, https:\/\/ebooks.inflibnet.ac.in\/liscp10\/wp-content\/uploads\/sites\/19\/2018\/07\/1-104-225x228.png 225w\" sizes=\"auto, (max-width: 316px) 100vw, 316px\" \/><\/p>\n<p style=\"text-align: justify\">There exists a relationship between cited and citing documents; and a citation represents the relationship between them. This is the fundamental principle on which\u00a0<span style=\"font-size: 1em;text-align: initial\">citation analysis is based upon. The citation analysis is the area of bibliometrics which deals with the study of this relationship between cited and citing references. Undoubtedly, citation analysis is the most used and useful technique of all. As a concept, it has been responsible for the development of most of the citation databases such Thomson Reuters\u2019s Citation Index, Elsiever\u2019s Scopus, Google\u2019s Google Scholar and so on. Citation analysis is the basis for the development of \u2018Citation Indexing\u2019 by Eugene Garfield. Citation indexing is a kind of indexing in which the bibliographic references of documents are made searchable and refer to the documents being indexed. The cited references in a document are made to be a part of the subject access points available for information retrieval.<\/span><\/p>\n<p>&nbsp;<\/p>\n<p style=\"text-align: justify\"><span style=\"font-size: 1em\">Why do researchers cite? What is the citers\u2019 motivation for referencing earlier work? These questions have been comprehensively answered by Garfield (1979), the person who originated the citation analysis. He gives a list of 15 reasons for authors to cite earlier works. On examination of these reasons, one may find some of them really show the scholarly impact; and some of them indicate that they have less-than-noble intention behind them. It is the second category of reasons which attract the attention of the critics; and hampers the very purpose of citation analysis.<\/span><\/p>\n<p>&nbsp;<\/p>\n<p style=\"text-align: justify\"><span style=\"text-align: initial;font-size: 1em\">Citation analysis is based on a few assumptions: 1) Citation of a document implies use of that document by the citing author; 2) Citation of document (author, journal, etc.) reflects the merit (quality, significance, impact) of that document (author, journal, etc.); 3) Citations are made to best possible works; 4) A cited document is semantically related in content to the citing document (if two documents are bibliographically coupled, they are related in content; and if two documents are co-cited, they are related in content); and 5) All citations are equal. All these assumptions have inherent flaws in them which are succinctly described below:<\/span><\/p>\n<ul>\n<li style=\"text-align: justify\"><strong style=\"text-align: initial;font-size: 1em\">Criticism about the first assumption<\/strong><span style=\"text-align: initial;font-size: 1em\">: The first assumption implies that the citing author has either partly or fully used\/influenced by the ideas in the cited work; and secondly that all the cited documents were indeed used by the citing author. Failure to meet any one of these conditions amounts to sins of omission and commission. These \u2018sins\u2019 will have a negative impact on the fundamental principle on which citation analysis is based upon.<\/span><\/li>\n<li style=\"text-align: justify\"><strong style=\"font-size: 1em\">Criticism about the second assumption<\/strong><span style=\"font-size: 1em\">: The citations received by a document show its quality is the meaning of this assumption. On the face value, one may say that there is a positive correlation between the number of citations received and the quality of the article. But it is not always true. Sometimes, citations are received for wrong reasons also. It has been shown by many studies that the authors have the habit of giving citations to the spurious works also. This also shakes the very fundamentals of citation analysis.<\/span><\/li>\n<li style=\"text-align: justify\"><strong style=\"font-size: 1em\">Criticism about the third assumption<\/strong><span style=\"font-size: 1em\">: Studies often show that not all good works are cited. Number of Citations, among other reasons, also depend upon the availability (accessibility) of the documents to the authors. Accessibility of a document may be a function of its form, place of origin, age, and language. Hence, non-availability of documents may have a negative impact on the citation analysis.<\/span><\/li>\n<li style=\"text-align: justify\"><strong style=\"font-size: 1em\">Criticism about the fourth assumption: <\/strong><span style=\"font-size: 1em\">This assumption has a bearing on the information retrieval function of the citation databases. Martyn (1964) contends that a bibliographic coupling is not a valid unit of measurement because one does not know that two documents citing a third are citing the identical unit of information in it. The same applies to co-citation as well; the fact that two papers are co-cited does not guarantee a common relation- ship between their contents.<\/span><\/li>\n<li style=\"text-align: justify\"><strong style=\"font-size: 1em\">Criticism about the fifth assumption: <\/strong><span style=\"font-size: 1em\">It is not difficult to see that all the papers cited in an article are not of equal importance in the context of the citing work. However, this varied importance of the cited articles are neither reflected in the reference list nor used for citation analysis. This might have a negative impact on the overall results.<\/span><\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<p style=\"text-align: justify\">Apart from the above, as Smith (1981) lists, the other parameters which may induce errors in the citation analysis are: multiple authorship, self-citations, homographs, synonyms, types of sources, implicit citations, fluctuations with time, field variations, and errors. The limitations of citation analysis do not negate its value as a research method\u00a0<span style=\"font-size: 1em;text-align: initial\">when used with care. There are, in fact, several application areas where citation analysis has been used successfully.<\/span><\/p>\n<p>&nbsp;<\/p>\n<p style=\"text-align: justify\"><strong style=\"text-align: initial;font-size: 1em\">4.0 Characteristics and Limitations of Bibliometric Indicators<\/strong><\/p>\n<p>&nbsp;<\/p>\n<p style=\"text-align: justify\"><span style=\"font-size: 1em\">It is not uncommon to use bibliometrics as the tool for research assessment as it is considered as an objective, quantitative and un-obstructive method. These bibliometric indicators have become important for individual researchers and organizations. For researchers they are important because they provide objective mode of assessment of diffusion and impact of articles on their works. For organizations, the bibliometric indicators are significant because they are the means of assessing the quality of particular work, person, or group. However, as said in the last segment of the previous section, the usability of the indicators has to be properly assessed before applying them for quantification. When applied judiciously with care and caution, the bibliometric indicators provide valid results useful for decision making.<\/span><\/p>\n<p>&nbsp;<\/p>\n<p style=\"text-align: justify\"><span style=\"font-size: 1em\">The indicators are normally used as unit of analysis in various bibliometric studies. The indicators can be categorised, for the sake of explanation here, into three groups, viz., Publication Indicators; Citation Indicators; and Journal Indicators. The following section provides a brief explanations of indicators used in bibliometrics under each of these categories along with their advantages and limitations, if any. The list is compiled from the list given by Rehn (2007).<\/span><\/p>\n<p>&nbsp;<\/p>\n<p style=\"text-align: justify\"><strong style=\"text-align: initial;font-size: 1em\">4.1 Publication Indicators<\/strong><\/p>\n<ul>\n<li style=\"text-align: justify\"><strong style=\"font-size: 1em\">Number of Publications<\/strong><span style=\"font-size: 1em\">: It is the number of publications published either by an author, institute, country or so on. The time span is also taken in many situations to suit the temporal scope. The data is collected either directly from the original publications from databases. It is relatively easy to collect data. Although this count is a very straightforward indicator that can be easily calculated by the authors themselves, one must be very careful when using it to compare authors or research groups. The disadvantages of this indicator are: when used does not take the size of the analysed unit; and does not speak of the impact of the publications counted.<\/span><\/li>\n<li style=\"text-align: justify\"><strong style=\"font-size: 1em\">Number of ISI Publications<\/strong><span style=\"font-size: 1em\">: It is the number of publications indexed by Thomson ISI indices. Temporal and geographic filters are applied many a times in many studies.\u00a0<\/span><span style=\"font-size: 1em;text-align: initial\">Quite easy to collect data as it can be directly collected from the databases. The disadvantages are: when used does not take the size of the analysed unit; has inherent problem of scope and coverage as that of ISI indices; and does not count non-ISI publications.<\/span><\/li>\n<li style=\"text-align: justify\"><strong style=\"text-align: initial;font-size: 1em\">Number of Publications in Top Journals<\/strong><span style=\"text-align: initial;font-size: 1em\">: It is the number of publications the analyzed unit has published in a selected number of journals during the analyzed time span. The selection of journals is usually made on some criteria. The advantage is that as the data is collected from top journals (which show their relative importance among others in the group); it is a better count than a mere publication count. The disadvantages are: does not take the size of the analyzed unit into account; and has the limitations of the selection criteria. Although this approach may look like a performance indicator, it was designed to address the shortcoming of the above-mentioned quantity indicator.<\/span><\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<p><strong style=\"text-align: initial;font-size: 1em\">4.2 Citation Indicators<\/strong><\/p>\n<\/div>\n<div>\n<p style=\"text-align: justify\">\u2022\u00a0\u00a0\u00a0\u00a0\u00a0 <strong>Number of citations<\/strong>: It is the total number of references received from other works,<\/p>\n<p><strong>\u00a0<\/strong><\/p>\n<p>i.e., number of citations to articles published by an analyzed unit during the analyzed<\/p>\n<p><strong>\u00a0<img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-204 aligncenter\" src=\"http:\/\/liscp10.epgpbooks.inflibnet.ac.in\/wp-content\/uploads\/sites\/19\/2018\/07\/1-105.png\" alt=\"\" width=\"150\" height=\"109\" srcset=\"https:\/\/ebooks.inflibnet.ac.in\/liscp10\/wp-content\/uploads\/sites\/19\/2018\/07\/1-105.png 150w, https:\/\/ebooks.inflibnet.ac.in\/liscp10\/wp-content\/uploads\/sites\/19\/2018\/07\/1-105-65x47.png 65w\" sizes=\"auto, (max-width: 150px) 100vw, 150px\" \/><\/strong><\/p>\n<p style=\"text-align: justify\">time span. The citation of one article by another is characteristic of scientific publications, and it is generally accepted that the number of citations of a particular article receives is a reflection of its impact in the scientific community (Rhen, 2006). The data has to be collected from the citation databases such as Thomson Reuters Web of Knowledge, Scopus, Google Scholar, CiteseerX and so on. As collected from databases, data and results are verifiable. Limitations of this indicator include: it does not take into account older articles as usually are more cited and that citation rates vary between document types and subject areas; and does not compensate for size of the unit.<\/p>\n<ul>\n<li style=\"text-align: justify\"><strong>\u00a0<\/strong><strong>Citations per publication<\/strong>: It is the average number of citations to articles published by an analyzed unit during the analyzed time span. It is calculated by the ratio of total publications and dividing by the total number of publications considered. The limitations are: Does not take into account that older articles usually are more cited\u00a0<span style=\"font-size: 1em;text-align: initial\">if a variable, cumulative citation time window is used, and that citation rates vary between document types and subject areas.<\/span><\/li>\n<li style=\"text-align: justify\"><strong style=\"font-size: 1em\">Field Normalized Score<\/strong><span style=\"font-size: 1em\">: This indicator corresponds to the relative number of citations to publications from a specific unit, compared to the world average of citations to publications of the same document type, age and subject area. It is calculated as follows: The number of citations to each of the unit\u2019s publications is normalized by dividing it with the world average of citations to publications of the same document type, publication year and subject area, which is called the field reference value (\u00b5f). If an article is classified as belonging to several subject areas, a mean value of the areas is used. The limitations include if the normalization is done on an article level, a few highly cited articles in a moderately cited research area may contribute un-proportionately to the value of the field normalized citation score.<\/span><\/li>\n<li style=\"text-align: justify\"><strong style=\"font-size: 1em\">Total field normalized citation score<\/strong><span style=\"font-size: 1em\">: This indicator gives an indication of both the impact and the production volume of the analyzed unit. The score is got by adding together the item oriented field normalized citation scores for all the publications of the analyzed unit. The disadvantage is that it does not compensate for the size of the analyzed unit.<\/span><\/li>\n<li style=\"text-align: justify\"><strong style=\"font-size: 1em\">Journal normalized citation score<\/strong><span style=\"font-size: 1em\">: This indicator corresponds to the number of citations to publications from a specific unit during an analyzed time span, compared to the world average of citations to publications of the same document types, ages and in the same journals. The calculation is as follows: the number of citations to each of the unit\u2019s publications is normalized by dividing it with the world average of citations to publications of the same document type, published in the same year in the same journal. The indicator is the mean value of all the normalized citation counts for the unit\u2019s publications.<\/span><\/li>\n<li style=\"text-align: justify\"><strong style=\"font-size: 1em\">Crown indicator<\/strong><span style=\"font-size: 1em\">: It is developed by Center for Science and Technologies Studies at Leiden University. It intends to measure the scientific impact of a researcher or a research group. This indicator is calculated by dividing the average number of received citations (from a researcher or a research group) by the average number that could be expected for publications of the same type, during the same year, and published in journals within the same field (Lundberg, 2007). It has a few flaws also.\u00a0<\/span>First, its dependence on categories published by Thomoson Reuters leads to a problem that it does not take into account that publications from a particular field are often published in journals categorized in another field. Second, the size of a research group influences its productivity \u2014 quite simply, the more researchers in a group, the larger the number of published articles. It is therefore recommended to compare research groups with the crown indicator only if the groups are of similar sizes (Lundberg, 2007).<\/li>\n<li style=\"text-align: justify\"><strong style=\"text-align: initial;font-size: 1em\">h-index<\/strong><span style=\"text-align: initial;font-size: 1em\">: The h-index is an index that attempts to measure both the scientific productivity and the apparent scientific impact of a scientist. J.E. Hirsch introduced it<\/span><\/li>\n<\/ul>\n<\/div>\n<div>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-205\" src=\"http:\/\/liscp10.epgpbooks.inflibnet.ac.in\/wp-content\/uploads\/sites\/19\/2018\/07\/1-106.png\" alt=\"\" width=\"185\" height=\"141\" srcset=\"https:\/\/ebooks.inflibnet.ac.in\/liscp10\/wp-content\/uploads\/sites\/19\/2018\/07\/1-106.png 185w, https:\/\/ebooks.inflibnet.ac.in\/liscp10\/wp-content\/uploads\/sites\/19\/2018\/07\/1-106-65x50.png 65w\" sizes=\"auto, (max-width: 185px) 100vw, 185px\" \/><\/p>\n<p>&nbsp;<\/p>\n<p style=\"text-align: justify\">in 2005 and defined it in the following way: \u201cA scientist has index h if h of [his\/her] Np papers have at least h citations each, and the other (Np -h)papers have at most h citations each\u201d. The \u2018Web of Science\u2019 now gives direct access to the H index in a few mouse clicks. It is calculated as follows: find the unit\u2019s published articles in a citation index and sort them in descending order by number of citations. Count articles from the top of the list and downwards, and when the number of an article rises above the citation count for that very article, the number of the preceding article is to be counted as the h-index. H-index is criticized as it gives positive bias to senior researchers with older articles, since these have had more time to be cited, though the demand that new articles with comparable citation levels has to be added has a certain damping effect on that bias.<\/p>\n<ul>\n<li style=\"text-align: justify\"><strong>Uncitedness<\/strong>: It is the share of a unit\u2019s publications that that remain uncited after a certain time period. Self-citations should be removed from the citation count. It requires data from a comprehensive citation database such as the Thomson citation indices and validation of the unit\u2019s publications.<\/li>\n<li style=\"text-align: justify\"><strong style=\"font-size: 1em\">Self-citation<\/strong><span style=\"font-size: 1em\">: It is the share of a unit\u2019s received citations where authors refer to their own papers. The calculation of the self-citation is as follows: count the total number of citations to the unit\u2019s publications during the analyzed time span. Check where citations are coming from and count the number coming from the unit itself. Divide the second number with the first to get share of self citedness. The requirement for getting self-citation is that it requires data from a comprehensive citation database\u00a0<\/span><span style=\"font-size: 1em;text-align: initial\">such as the Thomson citation indices, validation of publications and analysis of citing articles, which can be done in the ISI Web of Science.<\/span><\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<p><strong style=\"text-align: initial;font-size: 1em\">4.3 <\/strong><strong style=\"text-align: initial;font-size: 1em\">Journal Indicators<\/strong><\/p>\n<\/div>\n<div>\n<ul>\n<li style=\"text-align: justify\"><strong>Impact factor<\/strong>: The impact factor (IF) of an academic journal is a measure reflecting the average number of citations to recent articles published in the journal and intended to gauge the importance of a journal in its given field. It is perceived that higher impact factor of a journal more important it is in that field than those with lower ones. The impact factor was devised by Eugene Garfield, the founder of the Institute for Scientific Information. Impact factor is calculated yearly for those journals that are indexed in the Journal Citation Reports. IFs are available in the SCI (Science Citation Index) Journal Citation Reports and on the Web of Knowledge for more than 8000 selected scientific journals. The IF does have several limitations (Durieux &amp; Gevenois, 2010). First, although a higher IF can suggest a greater impact of a journal, it does not reflect the quality of each particular article published by that journal. Consequently, it is not clear whether a high IF is due to a moderate degree of citation of all of the articles published or to a high degree of citation of only some articles. Second, multidisciplinary journals usually have a higher IF than specialized journals. Third, there are differences between research fields, including in research intensity. The highest ranking journal in each specialized field may have a very different IF from specialty to specialty. Fourth, the types of articles published by a journal also influence its IF. Review articles and technical reports are more frequently quoted than are original research articles, case reports, and pictorial essays.<\/li>\n<li style=\"text-align: justify\"><strong style=\"font-size: 1em\">Normalized Journal Impact Factor<\/strong><span style=\"font-size: 1em\">: This indicator corresponds to the relative number of citations to publications in one specific journal, compared to the world average of citations to publications of the same document type, age and subject area. The indicator is stated as a decimal number that shows the relation of the number of citations to the world average. As an example, 0.9 means that publications in this journal are cited 10% below average and 1.2 that they are cited 20% above average.<\/span><\/li>\n<li style=\"text-align: justify\"><strong style=\"font-size: 1em\">Immediacy Index<\/strong><span style=\"font-size: 1em\">: It is an indicator which measures the current importance of the work published by a journal by calculating the average number of times articles published during a particular year by a specific journal is cited over the course of that same year. The immediacy index is useful for identifying the journals publishing the articles in the emerging areas. It is said that immediacy index has an unintended bias towards articles published in the earlier part of the year as they would have better and more chance to get cited than those articles published later in the year.<\/span><\/li>\n<li style=\"text-align: justify\"><strong style=\"font-size: 1em\">Journal-to-field impact score<\/strong><span style=\"font-size: 1em\">: The journal-to-field impact score has been proposed by the Center for Science and Technologies Studies of Leiden University (Leiden, the Netherlands) as an alternative to the IF. It measures the average number of cited articles in a specific journal and compares this number with that of other journals in the same research field category. The field categorization of journals is based on the journal subject categories, which are defined by Thomson Reuters. By ranking journals in a given subject category, this score overcomes the limitations of IF related to research field characteristics such as productivity, citation habits, and citation dynamics<\/span><\/li>\n<\/ul>\n<\/div>\n<div>\n<p>&nbsp;<\/p>\n<p><strong>5.0 Conclusion<\/strong><\/p>\n<p>&nbsp;<\/p>\n<p style=\"text-align: justify\">Bibliometric and Scientometric analysis are based on many indicators. These indicators seek to measure the quantity and impact of research publications. The indicators are used increasingly in evaluation processes in universities, and public and private research institutes. Each of these indicators has its own merits and limitations. Interpreted as exhaustive measures of scientific\/research output, the indicators would present a biased story. However, when used with caution, they can reveal some insights through trends regarding aspects of scientific\/research production at global level.<\/p>\n<p>&nbsp;<\/p>\n<p style=\"text-align: justify\">As a conclusion, let us bear in mind the following words-of-caution given by Durieux and Gevenois (2010) while using the bibliometric and scientometric indicators for analysis:<\/p>\n<p>&nbsp;<\/p>\n<ul>\n<li style=\"text-align: justify\">Performance indicators are based on the assumption that the quality of a particular article is reflected by the frequency of its citations in other articles.<\/li>\n<li style=\"text-align: justify\">Given differences between fields of research in terms of productivity, citation habits, and citation dynamics, bibliometric indicators should not be used for comparing researchers, research groups, or journals from different fields.<\/li>\n<li style=\"text-align: justify\">It is recommended to measure the quality and the impact of scientific journals, research groups, or particular researchers through several indicators rather than only one.<\/li>\n<\/ul>\n<\/div>\n<div>\n<p>&nbsp;<\/p>\n<p><strong>6.0 Summary<\/strong><\/p>\n<p>&nbsp;<\/p>\n<p style=\"text-align: justify\">Bibliometrics is a set of mathematical and statistical tool used to measure quantity and quality of books, articles, and other genera of publications. Studies indicate that bibliometrics, as a metric, is objective, quantitative and un-obstructive method used for. However, it is not without any limitations. The limitations in citation analysis is discussed in the Unit Critics have also shown the flaws in most of the indicators used in bibliometric studies. Each of these indicators along with their advantages and limitations has been explained. The bibliometric analysis and the use of indicators would serve the purpose when used with care. This unit provides an overview of the currently used bibliometric indicators and summarizes the limitations and characteristics one should be aware of when evaluating the quantity and quality of scientific output.<\/p>\n<\/div>\n<table>\n<tbody>\n<tr>\n<td><strong>you can view video on Challenges of Bibliometric and Scientometric Studies<\/strong><\/td>\n<td><a href=\"https:\/\/youtu.be\/79qFPZZKrSc\" target=\"_blank\" rel=\"noopener\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-120\" src=\"http:\/\/epgpbooks.inflibnet.ac.in\/wp-content\/uploads\/2018\/11\/download.png\" alt=\"\" width=\"36\" height=\"36\" \/><\/a><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p><strong>References<\/strong><\/p>\n<p>&nbsp;<\/p>\n<ul>\n<li style=\"text-align: justify\">Durieux, V., &amp; Gevenois, P. A. (2010). Bibliometric Indicators: Quality Measurements of Scientific Publication 1. <em>Radiology<\/em>, <em>255<\/em>(2), 342-351.<\/li>\n<li style=\"text-align: justify\">Garfield, E. (1979). <em style=\"text-align: initial;font-size: 1em\">Citation indexing: Its theory and application in science, technology, and\u00a0<\/em><em style=\"font-size: 1em\">humanities <\/em><span style=\"font-size: 1em\">(Vol. 8). New York: Wiley.<\/span><\/li>\n<li style=\"text-align: justify\">Lalo\u00eb, F., &amp; Mosseri, R. (2009). Bibliometric evaluation of individual researchers: not even right&#8230; not even wrong!. <em style=\"font-size: 1em\">Europhysics News<\/em><span style=\"font-size: 1em\">, <\/span><em style=\"font-size: 1em\">40<\/em><span style=\"font-size: 1em\">(5), 26-29.<\/span><\/li>\n<li style=\"text-align: justify\">Lundberg, J. (2006). <em style=\"font-size: 1em\">Bibliometrics as a research assessment tool: impact beyond the impact<\/em> <em style=\"font-size: 1em\">factor. <\/em><span style=\"font-size: 1em\">Doctoral Thesis. Sweden:Korolinska Instituet.<\/span><\/li>\n<li style=\"text-align: justify\">Lundberg, J. (2007). Lifting the crown\u2014citation z-score. <em style=\"text-align: initial;font-size: 1em\">Journal of informetrics<\/em><span style=\"text-align: initial;font-size: 1em\">, <\/span><em style=\"text-align: initial;font-size: 1em\">1<\/em><span style=\"text-align: initial;font-size: 1em\">(2), 145-154.<\/span><\/li>\n<li style=\"text-align: justify\">Martyn, J. (1964). Bibliographic coupling. <em style=\"text-align: initial;font-size: 1em\">Journal of documentation<\/em><span style=\"text-align: initial;font-size: 1em\">, <\/span><em style=\"text-align: initial;font-size: 1em\">20<\/em><span style=\"text-align: initial;font-size: 1em\">(4), 236-236.<\/span><\/li>\n<li style=\"text-align: justify\">Naseer, M. M., &amp; Mahmood, K. (2009). Use of bibliometrics in LIS research. <em style=\"font-size: 1em\">LIBRES: Library<\/em> <em style=\"font-size: 1em\">and Information Science Research Electronic Journal<\/em><span style=\"font-size: 1em\">,<\/span><em style=\"font-size: 1em\"> 19<\/em><span style=\"font-size: 1em\">(2).<\/span><\/li>\n<li style=\"text-align: justify\">Pendlebury, D.A. (2009). Whitepaper: Using bibliometrics: A guide to evaluating research performance with citation data. Philadelphia: Thomson Reuters.<\/li>\n<li style=\"text-align: justify\">Rehn, C., &amp; Kronman, U. (2008). Bibliometric handbook for Karolinska Institutet. Huddinge: Karolinska Institutet.<\/li>\n<li style=\"text-align: justify\">Rehn, U. K. C. (2007). Bibliometric indicators\u2013definitions and usage at Karolinska Institutet.<\/li>\n<li style=\"text-align: justify\">Smith, L. C. (1981). Citation analysis. <em style=\"text-align: initial;font-size: 1em\">Library trends<\/em><span style=\"text-align: initial;font-size: 1em\">, <\/span><em style=\"text-align: initial;font-size: 1em\">30<\/em><span style=\"text-align: initial;font-size: 1em\">(1), 83-106.<\/span><\/li>\n<\/ul>\n","protected":false},"author":3,"menu_order":16,"template":"","meta":{"_acf_changed":false,"pb_show_title":"on","pb_short_title":"","pb_subtitle":"","pb_authors":["dr-n-s-harinarayana"],"pb_section_license":""},"chapter-type":[],"contributor":[60],"license":[],"class_list":["post-199","chapter","type-chapter","status-publish","hentry","contributor-dr-n-s-harinarayana"],"part":3,"_links":{"self":[{"href":"https:\/\/ebooks.inflibnet.ac.in\/liscp10\/wp-json\/pressbooks\/v2\/chapters\/199","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ebooks.inflibnet.ac.in\/liscp10\/wp-json\/pressbooks\/v2\/chapters"}],"about":[{"href":"https:\/\/ebooks.inflibnet.ac.in\/liscp10\/wp-json\/wp\/v2\/types\/chapter"}],"author":[{"embeddable":true,"href":"https:\/\/ebooks.inflibnet.ac.in\/liscp10\/wp-json\/wp\/v2\/users\/3"}],"version-history":[{"count":7,"href":"https:\/\/ebooks.inflibnet.ac.in\/liscp10\/wp-json\/pressbooks\/v2\/chapters\/199\/revisions"}],"predecessor-version":[{"id":356,"href":"https:\/\/ebooks.inflibnet.ac.in\/liscp10\/wp-json\/pressbooks\/v2\/chapters\/199\/revisions\/356"}],"part":[{"href":"https:\/\/ebooks.inflibnet.ac.in\/liscp10\/wp-json\/pressbooks\/v2\/parts\/3"}],"metadata":[{"href":"https:\/\/ebooks.inflibnet.ac.in\/liscp10\/wp-json\/pressbooks\/v2\/chapters\/199\/metadata\/"}],"wp:attachment":[{"href":"https:\/\/ebooks.inflibnet.ac.in\/liscp10\/wp-json\/wp\/v2\/media?parent=199"}],"wp:term":[{"taxonomy":"chapter-type","embeddable":true,"href":"https:\/\/ebooks.inflibnet.ac.in\/liscp10\/wp-json\/pressbooks\/v2\/chapter-type?post=199"},{"taxonomy":"contributor","embeddable":true,"href":"https:\/\/ebooks.inflibnet.ac.in\/liscp10\/wp-json\/wp\/v2\/contributor?post=199"},{"taxonomy":"license","embeddable":true,"href":"https:\/\/ebooks.inflibnet.ac.in\/liscp10\/wp-json\/wp\/v2\/license?post=199"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}