Skip to Main Content

Research Impact Metrics & Visibility

This guide, targeted towards faculty and researchers, provides an introduction to the various metrics used to measure scholarly research impact.

TOP (Transparency and Openness Promotion) Factor

Journal policies can be evaluated based on the degree to which they comply with the TOP Guidelines. Published in Science in 2015 (OA), the Transparency and Openness Promotion Guidelines include eight modular standards, each with three levels (disclosure, requirement, verification) of increasing stringency. The eight TOP Guidelines are:

The aim of the TOP guidelines is to raise standards for research transparency and reproducibility by inviting journals to self-certify their compliance with open science practices, such as data sharing, study pre-registration and replication. 

TOP factor is a metric that reports the extent to which a journal adheres to open science practices, practices that are based on the core principles of the scientific community. 

TOP factor is an alternative way to assess journal qualities, and is an improvement over traditional metrics that measure mean citation rates. 

SourceTOP Guidelines (cos.io)

Scite: Citation Metric

Scite is a subscription-based platform for discovering and evaluating scientific articles via Smart Citations. Smart Citations allow users to see how a publication has been cited by providing the context of the citation and a classification describing whether it provides supporting or contrasting evidence for the cited claim.

The scite browser extension is a free extension that gives you the power of scite on the go so that you can see how any research article has been cited. The extension gives you the ability to:

  • See how any research article is supported, contrasted, or mentioned by showing a widget on the left hand side with that data
  • See scite badges on reference lists, search results and more in popular platforms like google scholar, pubmed, and more
  • Highlight any term or phrase and see what experts say about that topic in Citation Statements Search

Sourcehttps://scite.ai/extension-install 

Rigor and Transparency Index (SciScore)

The Rigor and Transparency Index (RTI) is a metric that reflects the yearly average SciScore for a given journal. RTI assesses how many rigor and transparency criteria are present in the average article. It can be used as a selection criterion for authors who want to be associated with more reproducible journals.

Sourcehttps://www.sciscore.com/rti/

The Rigor and Transparency Index score is not correlated with the Impact Factor.

 

Ripeta

Ripeta is an automated tool that uses machine learning and natural language processing to evaluate research manuscripts for evidence of reproducibility. Ripeta is designed to advance the credibility, reproducibility, and trustworthiness of scientific research papers. Ripeta focuses on assessing the quality of the reporting and robustness of the scientific method rather than the quality of the science.

The ripetaReview quickly scans any research manuscript or article with a DOI to identify and record key reproducibility and responsible reporting variables that indicate trust in research, professionalism, and reproducibility. This individual report provides critical feedback to authors, peer reviewers, and editors about the robustness of the reported science and how the reporting and writing could be enhanced.

The ripetaReport provides a concise snapshot or baseline review of key reproducibility and responsible reporting variables across a period for a specific journal, publisher, funding agency, or portfolio. This product allows stakeholders to effectively take stock of their reproducibility and responsible reporting program and enhance their practices.

SourceRipeta