Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

The number of citations received by the publication shows how much it has been used in research since its publication. The citations can be thought to indicate the benefit of the research presented in the publication to the research community, and thus its impact. However, impact is a broad concept, and it can be interpreted in many different ways, so we will use the term citation impact in this guide.  Learn Learn more about the number of citations as an impact indicator in the chapter Citations (link).

Responsible use

  • Consider the different publishing and citation practices of different fields of science as well as the publications’ publishing date.
  • The number of citations is database dependent. The coverage of publications from different disciplines in databases may vary greatly.
  • See also the questions related to responsible evaluation from the page Indicators.

...

The mean number of citations can be calculated for different publication sets. The mean values are utilised, for example, in normalised indicators. However, for skewed citation distributions, mean values may not always be an illustrative indicators.

Responsible use

...

Normalised indicators refer to indicators that take into account the publication’s field of science, age and type. Determining the publication’s field is a key step in normalisation. In databases, publications are classified under different scientific disciplines based on various grounds and methods. Many international databases use classifications based on field of science classification of publication series:  a a publication (e.g. a scientific article)  is is categorized to the same subject category as the publication series (e.g. a journal) in which it has been published. More information about the classifications is available in the chapter Differences between fields of science

Publications are grouped in terms of their age, discipline/field and publication type. A citation distribution for each group is formed by ordering publications based on their received citations. A mean value of citations is calculated for each distribution. Normalisation is based on the distibutions and mean values. The use of field-normalised indicators aims to allow for comparisons of publications accross disciplines. The sections below present these various field-normalised indicators.

Field-normalised

...

Top x% indicators

The field-normalised Top% Top x% indicators are based on the database’s field-specific citation distributions. The Top % x% indicators show the proportion of the analyzed publication set that belongs to the most frequently cited x percentile of the publications of the same field, publication year and publication type.  Top% Top x% indicators are used as indicators of high citation impact. For example, Top10% and Top1% Top 10% share and Top 1% share demonstrate the relative share of publications reaching both high (10%) and top (1%) impact within the publication set.

Top x% -

...

indices

The Top x% -index show the relative proportion of the analyzed publication set that belongs to the most frequently cited x percentile of the publications of the same field, publication year and publication type. For example, a Top 1% index value exceeding one 1 means that more than 1% of the publications in the analysed publication set belong to the most cited 1% of the field of science in question.

...

  • Calculate the citation distribution: In 2014, 25,000 publications were published in the field of science Y. This means that the Top 10% of the citation distribution includes 2,500 publications.
  • The analysed set of publications: Faculty Z works within the same field of science. The researchers of this faculty published 500 publications in 2014. Of these publications, 100 are within the Top 10% of the aforementioned citation distribution. Statistically, the expected number of the faculty’s publications included in the top 10% is 50 publications, i.e. 10% of the faculty’s publications.
  • Calculating the Top 10% index: The Top 10% index is calculated by dividing the number of the faculty’s publications within the top 10% by the expected value, i.e. 100/50 = 2.
  • Please note that this is a simplified example; in reality,   as the publications belong to different fields of science and have been published in different years. Thus, the analysed publications will be compared to many different citation distributions.  AdditionallyAdditionally, the Top x% class rarely includes an exact x% of the publications, meaning that the Top 10% class hardly ever includes exactly 10% of the publications. This is due to the fact that the citation number is a discrete variable that is only assigned integer values.

...

The Highly Cited Papers status is granted to publications no older than ten years old that 
that exceed the field-normalised limit value of citations required to belong to the Top 1% of most cited papers.

...

Responsible use

The Top x% indicators seek to account for disciplinary differences regarding publication and citation practices as well as accounting for the publication date. They are not sensitive to individual publications with a high number of citations.

Remember that

  • Top% Top x% indicators only assign value to a small proportion of the publications, while others are ignored.
  • Drawing the limit at a certain percentile is arbitrary; instead of Top 1% and Top 10% we could just as well analyse the Top 5% and Top 15%.
  • The indicators are based on classifications of fields of science that are not entirely unproblematic (more information on this can be found in the chapter Classification of fields of science (link).
  • When reviewing the Top x% indicators of fairly recent publications (published less than five years ago), it should be noted that the citation numbers are low in certain fields of science. In such cases, a meaningful distribution for calculating the Top x% indicator does not yet exist. 
  • Different types of publications accumulate citations in different ways. A conference publication, for example, can become included in the Top x% publications with far fewer citations than a journal article.
  • See also the questions related to assessing responsibility in the chapter Indicators.

Tieteenalanormalisoidut viittausindikaattorit

Tieteenalanormalisoidut viittausindikaattorit kertovat julkaisujoukon viittausvaikuttavuudesta tieteenalallaan. 

Nämä indikaattorit kuvaavat julkaisun tai julkaisujoukon saaman viittausmäärän suhdetta samalla tutkimusalalla, samana vuonna ilmestyneiden samaa julkaisutyyppiä olevien julkaisujen viittausten keskiarvoon.  Keskimääräistä viittausvaikuttavuutta vastaava arvo on 1. Sen alittavat arvot kertovat keskimääräistä pienemmästä viittausmäärästä ja sen ylittävät keskimääräistä suuremmasta viittausmäärästä. Kun yksikkö saa esimerkiksi arvon 1,78. merkitsee se 78 prosenttia maailman keskiarvoa suurempaa viittausmäärää.

Esim. kuinka Tieteenalanormalisoidut viittausindikaattorit lasketaan


Field-normalised citation indicators

Field-normalised citation indicators reflect the citation impact of the publications in their respective scientific fields. The use of field-normalised indicators aims to allow for comparisons of citation impact of publications accross disciplines.

These indicators describe the relationship between the number of citations received by a publication or a set of publications and the mean value of citations received by the same type of publications that were published within the same scientific field in the same year. The value corresponding the average citation impact is 1. Values below 1 indicate a lower than average number of citations while values above 1.0 indicate a number of citations that is higher than average. When a unit is assigned score of 1.78, for example, this means that it has 78% higher number of citations than the global average.

Examples: how to calculate field-normalised citation indicators.

Example 1. A review article has been cited 15 times. Review articles in journals of the same field that have been published in the same year have received an average of 12 citations. Calculating the normalised citation index of the review articleEsimerkki 1. Katsausartikkeli on saanut 15 viittausta. Saman aihepiirin lehdissä, samana vuonna ilmestyneet katsausartikkelit ovat saaneet keskimäärin 12 viittausta. Katsausartikkelin normalisoitu viittausindeksi lasketaan: 15/12= 1,.25.

Esimerkki 2. Kun lasketaan normalisoitua viittausindeksiä julkaisujoukolle, yksittäisten julkaisujen viittausindeksit täytyy yhdistää. Lasketaan tieteenalanormalisoitu viittausindeksi kolmen julkaisun joukolle.

Example 2. When calculating a normalised citation index for a set of publications, the citation indices of individual publications need to be combined. Calculating a field-normalised citation index for a set of three publications:

Julkaisuartikkelin saamat viittauksetsamanlaisten artikkelien
viittausten keskiarvojulkaisun viittausindeksi
Publication Citations received by the articleMean value of the citations of similar articlesCitation index of the article
1.151215/12= 1, 25
2.10085100/85=1,17
3.603060/30
=2

...

=2
The citation index of the publication set is (1,25+1,17+2)/3 =

...

1,

...

47 = 1,5


Responsible use

The field-normalised citation indicators seek to account for the differences between fields of science regarding publication and citation practices as well as accounting for the publication date.

Remember that

  • The indicators are based on mean values. Individual publications with a high number of citations can have a major impact on the indicator’s value. 
  • When reviewing fairly recent publications, it should be taken into account that the citation numbers are lower within certain fields, due to which small changes in the number of citations can lead to major changes in the indicator value.
  • The indicators are based on classifications of fields of science that are not entirely unproblematic (more information on this in chapter Classification of fields of science.
  • See also the questions related to assessing responsibility in the chapter Indicators.

Normalised indicators in databases and other sources


Top x% indicesData source

Comments about the indicator

Link to method description
PP(top x%)CWTS

Vastuullinen käyttö

Tieteenalanormalisoidut viittausindikaattorit pyrkivät ottamaan huomioon tieteenalojen väliset erot julkaisu- ja viittauskäytännöissä ja julkaisuajankohdan.  

Ota huomioon, että

  • perustuvat keskiarvoihin, jolloin yksittäiset paljon viittauksia saaneet julkaisut voivat vaikuttaa indikaattorin arvoon huomattavasti. 
  • verrattain tuoreiden julkaisujen  tarkasteltaessa on huomioitava, että joillain aloilla viittauskertymät ovat pieniä, jolloin pienet muutokset viittausmäärissä johtavat suuriin muutoksiin indikaattorin arvossa. 
  • perustuvat tieteenalaluokituksiin, jotka eivät ole ongelmattomia (lisätietoja kappaleesta Tieteenalaluokitukset)
  • katso myös vastuullisuuden arvioimiseen liittyvät kysymykset Indikaattoreita -sivulta

Normalisoitujen indikaattoreiden toteutuksia tietokannoissa ja muissa lähteissä

Top x% indeksitTietokanta/lähdeLinkki menetelmän kuvaukseenPP(topx%)
Leiden ranking


Indicators -The CWTS Leiden Ranking

2021

top 10-
indeksiTieteen tila
indexState of scientific research in Finland


Bibliometrisiin analyyseihin liittyviä käsitteitä

 

(in Finnish only)

Top x%
osuudet
shares


% Documents in Top 1%
% Documents in Top 10%

InCites
Katso


View the InCites: Understanding the Metrics

s välilehti Percentiles
Myös: Documents in Top 1% and 10%

tab `Percentiles´
See also: Documents in Top 1% and 10%

Outputs in Top Citation Percentiles

SciVal

Non-field-normalized "Outputs in Top Citation Percentile" indicator is based on citations.

The field-normalized "Outputs in Top Citation Percentile" indicator is determined based on the publications' FWCI values. The citation window for FWCI values is the year of publication plus the following three full years.


View SciVal

Outputs in Top Citation Percentiles

SciValkatso SciVal

Metric: Outputs in Top Citation Percentiles

Yrjö Leino & Marianne

Gauffriaun

Gauffriau.

 Guest

Guest Post: Understanding SciVal’s calculation of field-weighted percentile indicators – The Bibliomagician 

SciValissa on myös tieteenalanormalisoimaton

SciVal also features the Outputs in Top Citation

Percentile - indikaattori

Percentiles -indicator , which is not normalised by the scientific field.

Top %
julkaisut
publications


Highly cited papersEssential Science Indicators, 
Web of Science, InCites


Essential Science Indicators - Highly Cited Papers
Highly Cited Thresholds

Hot papers

Essential Science Indicators,
Web of Science, InCites.


Hot Paper Thresholds

Normalisoidut viittausindikaattoritTietokanta
Normalised citation indicators


Category Normalized Citation Impact (CNCI) 
InCites


InCites: Understanding the Metrics
See tab "Normalized"

Field-Weighted Citation Impact (FWCI)
SciVal
Research Metrics Guidebook
Mean Normalized Citation Score (MNCS)
Leiden ranking
Indicators The CWTS Leiden Ranking
2021
The Field Citation Ratio (FCR) Dimensions
What is the FCR?
Co-citation Percentile Rank (CPR)JYUcite
JYUcite: What is CPR?

...

H-

...

index

One of the best known bibliometric indicators is the h-index, also known as Hirsch index. It was developed by

...

Yksi tunnetuimmista bibliometrisistä indikaattoreista on h-indeksi, jota kutsutaan myös Hirsch-indeksiksi. Sen kehitti Jorge E. Hirsch vuonna in 2005. Lue lisää alkuperäisestä artikkelistaRead more about the topic in the original article

Tutkijan A researcher’s h-indeksi määritellään seuraavasti: tutkijan h-indeksin arvo on h, jos h kappaletta hänen julkaisuistaan ovat jokainen saaneet vähintään h viittausta ja loput julkaisut ovat saaneet korkeintaan h viittausta.

Esimerkki.
Tutkijan h-indeksin arvo 10 tarkoittaa, että tutkijalla on 10 julkaisua, joihin kaikkiin on viitattu vähintään 10 kertaa. Hänen  mahdollisiin muihin julkaisuihinsa on viitattu korkeintaan kymmenen kertaa tai ei lainkaan.
 

Esimerkki. 

Tutkijoiden h-indeksin arvo voi olla sama vaikka heidän julkaisuprofiilinsa (julkaisuidensa määrä ja niiden saamien viittausten määrä) poikkeaisivat toisistaan paljon.  

index is determined as follows: the researcher’s h-index value is h, if h number of their publications have received at least h citations and rest of their publications have received a maximum of h citations.

Example.
An h-index value of 10 means that a researcher has 10 publications that have all at least 10 citations. Their potential other publications have been cited a maximum of ten times.

Example.
The h-index value of two researchers can be the same even if their publication profiles (number of publications and the number of citations received by them) are very different.

  • Researcher 1 has published five articles that have been cited the following times, respectivelyTutkija 1 on julkaissut viisi artikkelia joihin on viitattu seuraavasti: 9, 9, 7, 6, 5 
  • Researcher 2 has published 11 articles that have been cited the following times, respectivelyTutkija 2 on julkaissut 11 artikkelia, joihin on viitattu seuraavasti: 200, 150, 99, 70, 5, 4, 4, 3, 2, 1, 1 
  • Kummankin tutkijan h-indeksin arvo on 5 

Vastuullinen käyttö

  • Ota huomioon tieteenalojen erilaiset julkaisu- ja viittauskäytännöt ja julkaisujen ilmestymisajankohta.
  • H-indeksi on riippuvainen käytetystä tietokannasta. Eri tieteenalojen julkaisujen kattavuus eri viittaustietokannoissa voi vaihdella paljon.
  • H-indeksi on riippuvainen julkaisujen määrästä. H-indeksi ei voi olla suurempi kuin julkaisujen lukumäärä. Esim. Jos tutkija on julkaissut 10 julkaisua, h-indeksin maksimiarvo on 10 vaikka kaikkiin kyseisen tutkijan julkaisuihin olisi viitattu satoja kertoja.  
  • H-indeksi on kumuloituva mittari, se ei voi pienentyä. Se voidaan määritellä myös lyhyemmälle tarkastelujaksolle (esim. 5 vuotta) kuin koko uralle. 
  • Julkaisujen tekijöiden lukumäärä vaikuttaa h-indeksiin. Se suosii aloja, joissa on suuret tutkimusryhmät ja tutkijoilla siten paljon julkaisuja. 
  • H-indeksissä ei huomioida kirjoittajien roolia julkaisussa. Keskeinen rooli kirjoitustyössä ja muut roolit vaikuttavat yhtä paljon. 
  • Tutkijan uran pituus vaikuttaa h-indeksiin. Pidempään julkaisseella tutkijalla on aloittelevaa tutkijaa suurempi todennäköisyys saada korkea h-indeksi, koska hänellä on ollut enemmän aikaa julkaista ja julkaisuilla on ollut enemmän aikaa saada viittauksia. 
  • H-indeksissä ei huomioida milloin tekijä on julkaissut tai onko hän lopettanut julkaisemisen. Lopettamisen jälkeen h-indeksi voi jatkaa kasvuaan viittausten kertymisen myötä.
  • Tutkijan merkittäviä yksittäisiä julkaisuja ei tule esille h-indeksissä
  • Katso myös vastuullisuuden arvioimiseen liittyvät kysymykset Indikaattoreita-luvusta.

H-indeksin toteutuksia tietokannoissa

  • Both researchers have an h-index value of 5.


Responsible use

  • Consider the different publishing and citation practices of different fields of science as well as the publication date.
  • The number of citations is database dependent. The coverage of publications from different disciplines in databases may vary greatly.
  • The h-index cannot be greater than the number of publications. For example, if the researcher has published 10 publications, the maximum value is of h-index is 10 even if the publications of the researcher in question have been cited hundreds of times.
  • The h-index is a cumulative indicator and cannot decrease. It can also be determined for a shorter review period (such as for five years) instead of the researcher’s entire career. 
  • The h-index tends to favour disciplines with larger research groups and hence greater number of authors per publication. 
  • The h-index does not take into account the authors’ roles in the publication. A key role in the actual writing process is counted the same as any other role.
  • The length of a researcher’s career impacts their h-index. A researcher who has been publishing works for a long time is more likely to have a high h-index than a researcher who is at the early stages of their career. The more experienced researcher has had a longer time to publish work and more time to accumulate citations. 
  • The h-index does not take into account when the author published his/her work or whether they have stopped publishing altogether. The h-index may continue to grow even after the researcher has stopped publishing as their publications continue to be cited.
  • The h-index does not highlight a researcher’s individual publications with a high impact.
  • See also the questions related to assessing responsibility in the chapter Indicators.

H-index in data sources

Data sourceDescription
TietokantaMenetelmän kuvaus
Web of Science

The h-index value is based on a list of publications ranked in descending order by the Times Cited count. An index of h means that there are h papers that have each been cited at least h times.

Lue lisää

Read more: Web of Science: h-index information

Scopus

A scientist has an index h if h of his/her Np papers has at least h citations each, and the other (Np h) papers have no more than h citations each.

Lue lisää The

Read more: The Scopus h-index, what’s it all about?

Google Scholar

The h-index of a publication is the largest number h such that at least h articles in that publication were cited at least h times each. For example, a publication with five articles cited by, respectively, 17, 9, 6, 3, and 2, has the h-index of 3.

Lue lisää

Read more: Google Scholar metrics