{"id":237971,"date":"2023-11-15T08:00:10","date_gmt":"2023-11-15T08:00:10","guid":{"rendered":"https:\/\/clarivate.com\/?p=237971"},"modified":"2025-08-04T16:22:06","modified_gmt":"2025-08-04T16:22:06","slug":"highly-cited-researchers-2023-the-evolution-of-our-evaluation-and-selection-policy-to-support-a-robust-scholarly-landscape","status":"publish","type":"post","link":"https:\/\/clarivate.com\/academia-government\/blog\/highly-cited-researchers-2023-the-evolution-of-our-evaluation-and-selection-policy-to-support-a-robust-scholarly-landscape\/","title":{"rendered":"Highly Cited Researchers 2023: The evolution of our evaluation and selection policy to support a robust scholarly landscape"},"content":{"rendered":"<p>Every year, the unveiling of the Highly Cited Researchers\u2122 list sparks anticipation within the global research community as both researchers and their affiliated institutions or organizations scrutinize the list. Today, we present our <a href=\"\/highly-cited-researchers\/?campaignname=Highly_Cited_Researchers_Retention_AG_Global_2023&amp;campaignid=7014N000001zmyjQAA&amp;utm_campaign=Highly_Cited_Researchers_Retention_AG_Global_2023&amp;utm_source=blog&amp;utm_medium=press\">2023 list<\/a>, recognizing 6,849 individuals from more than 1,300 institutions across 67 countries and regions.<\/p>\n<p>These Highly Cited Researchers stand out for their significant and broad influence in various scientific and social science domains, representing a small fraction of the researcher population whose contributions disproportionately extend the frontiers of knowledge and gain societal innovations that make the world healthier, more sustainable and more secure.<\/p>\n<h3><strong>Our 2023 evaluation and selection policy<\/strong><\/h3>\n<p>As the need for high-quality data from rigorously selected sources is becoming ever more important, the Institute for Scientific Information (ISI)\u2122 has had to adapt and respond to technological advances and changes in the publishing landscape when selecting individuals for inclusion. Just as we have applied stringent standards and selection criteria to identify trusted journals in the Web of Science\u2122, we have evolved our evaluation and selection policies for our annual Highly Cited Researchers program to address the challenges of an increasingly complex and polluted scholarly record.<\/p>\n<p>Our process for identifying individuals to our Highly Cited Researchers list includes the consideration of many qualitative and quantitative factors. The published list is determined by combining the inter-related information available to us.<\/p>\n<p>We start with the creation of a new preliminary list each year based on our citation data from the papers published from the previous 11-year rolling window. We then refine it with the information that lies beneath, using\u00a0qualitative analysis and expert judgement.<\/p>\n<p>After the citation triage stage, we look at a growing number of factors when evaluating papers including, but not but limited to:<\/p>\n<ul>\n<li><em>Hyper-authorship of papers <\/em>&#8211; Our expectation is that an author has provided a meaningful contribution to any paper which bears their name and the publication of multiple papers per week over long periods strains our understanding of normative authorship and credit.<\/li>\n<li>We exclude papers which reveal an <em>excessive level of self-citation<\/em> for the field of research \u2013 our paper outlines how we determine <a href=\"https:\/\/link.springer.com\/article\/10.1007\/s11192-020-03417-5\" target=\"_blank\" rel=\"noopener\"><em>How much is too much<\/em><\/a><a href=\"https:\/\/link.springer.com\/article\/10.1007\/s11192-020-03417-5\" target=\"_blank\" rel=\"noopener\">?\u00a0<\/a><\/li>\n<li>We look for evidence of extraordinary, very recent publications that represent research of incremental value, accompanied by high levels of author self-citation.<\/li>\n<li>Unusual patterns of collaborative group citation activity and anomalous levels of citations from co-authors. The identification of networks of co-authors raises the possibility that an individual\u2019s high citation counts may be highly reliant on citations from this network; if more than half of a researcher\u2019s citations derive from co-authors, we consider this to be narrow influence, rather than the broad community influence we seek to reflect.<\/li>\n<\/ul>\n<p>With the continuing assistance of Retraction Watch and its unparalleled database of retractions we enhanced our qualitative analysis in 2022; this exercise has continued. This year we also took account of expressions of concern from identified representatives at research institutes, national research managers and our institutional customers,\u00a0along with information shared with us by other collective community groups, e.g. <a href=\"https:\/\/forbetterscience.com\/\" target=\"_blank\" rel=\"noopener\">For Better Science<\/a>, <a href=\"https:\/\/pubpeer.com\/\" target=\"_blank\" rel=\"noopener\">Pub Peer<\/a>. Some of these resources include anonymous\u00a0or whistleblower sources. We also consider such evidence from trusted sources &#8211; where we can verify\u00a0claims through direct observation.<\/p>\n<blockquote><p>By implementing an increasing number of qualitative criteria and markers this year, the number of preliminary candidates excluded from our final list increased from 500 in 2022 to more than 1,000 for 2023.<\/p><\/blockquote>\n<p><a href=\"https:\/\/clarivate.com\/academia-government\/wp-content\/uploads\/sites\/3\/2023\/11\/Slide5-e1699954241916.jpg\" target=\"_blank\" rel=\"noopener\"><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-237973 aligncenter\" src=\"https:\/\/clarivate.com\/academia-government\/wp-content\/uploads\/sites\/3\/2023\/11\/Slide5-e1699954241916.jpg\" alt=\"\" width=\"1209\" height=\"633\" srcset=\"https:\/\/clarivate.com\/academia-government\/wp-content\/uploads\/sites\/3\/2023\/11\/Slide5-e1699954241916.jpg 1209w, https:\/\/clarivate.com\/academia-government\/wp-content\/uploads\/sites\/3\/2023\/11\/Slide5-e1699954241916-300x157.jpg 300w, https:\/\/clarivate.com\/academia-government\/wp-content\/uploads\/sites\/3\/2023\/11\/Slide5-e1699954241916-1024x536.jpg 1024w, https:\/\/clarivate.com\/academia-government\/wp-content\/uploads\/sites\/3\/2023\/11\/Slide5-e1699954241916-768x402.jpg 768w, https:\/\/clarivate.com\/academia-government\/wp-content\/uploads\/sites\/3\/2023\/11\/Slide5-e1699954241916-76x40.jpg 76w\" sizes=\"auto, (max-width: 1209px) 100vw, 1209px\" \/><\/a><\/p>\n<p><small>Click on the image to expand. <\/small><\/p>\n<p>Learn more about our Highly Cited Researchers <a href=\"\/highly-cited-researchers\/evaluation-and-selection\/?campaignname=Highly_Cited_Researchers_Retention_AG_Global_2023&amp;campaignid=7014N000001zmyjQAA&amp;utm_campaign=Highly_Cited_Researchers_Retention_AG_Global_2023&amp;utm_source=blog&amp;utm_medium=press\">evaluation and selection process<\/a> on our website.<\/p>\n<h3><strong>Exclusion of ESI field of Mathematics<\/strong><\/h3>\n<p>We have excluded the Mathematics category from our analysis for 2023.\u00a0The field of Mathematics differs from other categories in Essential Science Indicators (ESI)\u2122. It is a highly fractionated research domain, with few individuals working on a number of specialty topics. The average rate of publication and citation in Mathematics is relatively low, so small increases in publication and citation tend to distort the representation and analysis of the overall field. Because of this, the field of Mathematics is more vulnerable to strategies to optimize status and rewards through publication and citation manipulation.<\/p>\n<p>The responsible approach now is to afford this category additional analysis and judgement to identify individuals with significant and broad influence in the field. We are consulting with leading bibliometricians and mathematicians to discuss our future approach to the analysis of this field.<\/p>\n<h3><strong>Recognizing Highly Cited Researchers 2023<\/strong><\/h3>\n<p>We seek to use stringent standards and clear evaluation and selection criteria for our Highly Cited Researchers program as we celebrate exceptional and broad influence of individuals in their field or fields of research.<\/p>\n<p>Congratulations to the Highly Cited Researchers 2023. They have demonstrated a significant impact on their research colleagues and their work, already reshaping the scientific and scholarly landscape, and can be expected to provide a foundation for future advances.<\/p>\n<p>See the full list of <a href=\"\/highly-cited-researchers\/?campaignname=Highly_Cited_Researchers_Retention_AG_Global_2023&amp;campaignid=7014N000001zmyjQAA&amp;utm_campaign=Highly_Cited_Researchers_Retention_AG_Global_2023&amp;utm_source=blog&amp;utm_medium=press\">Highly Cited Researchers 2023<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Every year, the unveiling of the Highly Cited Researchers\u2122 list sparks anticipation within the global research community as both researchers and their affiliated institutions or organizations scrutinize the list. Today,&#8230;<\/p>\n","protected":false},"author":18,"featured_media":156305,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[16],"tags":[287,171,291],"class_list":["post-237971","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-academia-government","tag-highly-cited-researchers","tag-institute-for-scientific-information","tag-research-integrity","clarivate-industry-academia"],"acf":[],"lang":"en","translations":{"en":237971},"publishpress_future_workflow_manual_trigger":{"enabledWorkflows":[]},"pll_sync_post":[],"_links":{"self":[{"href":"https:\/\/clarivate.com\/academia-government\/wp-json\/wp\/v2\/posts\/237971","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/clarivate.com\/academia-government\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/clarivate.com\/academia-government\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/clarivate.com\/academia-government\/wp-json\/wp\/v2\/users\/18"}],"replies":[{"embeddable":true,"href":"https:\/\/clarivate.com\/academia-government\/wp-json\/wp\/v2\/comments?post=237971"}],"version-history":[{"count":4,"href":"https:\/\/clarivate.com\/academia-government\/wp-json\/wp\/v2\/posts\/237971\/revisions"}],"predecessor-version":[{"id":285984,"href":"https:\/\/clarivate.com\/academia-government\/wp-json\/wp\/v2\/posts\/237971\/revisions\/285984"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/clarivate.com\/academia-government\/wp-json\/wp\/v2\/media\/156305"}],"wp:attachment":[{"href":"https:\/\/clarivate.com\/academia-government\/wp-json\/wp\/v2\/media?parent=237971"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/clarivate.com\/academia-government\/wp-json\/wp\/v2\/categories?post=237971"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/clarivate.com\/academia-government\/wp-json\/wp\/v2\/tags?post=237971"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}