Project Library >

Metrics that Credit All Contributions

A new credit or reputation system is proposed – one that tracks and measures participation in all aspects of team-based research, including often-overlooked contributions of more junior investigators as well as open and collaborative behaviors.

Submit Your Project
I'm Interested

Goals

  1. Define research roles and open collaborative activities on a real-time, funded research project.
  2. Design technology and processes for defined activities to be reliably measured and credited to all individuals on research consortia.
  3. Develop a reporting system for researcher credits and the work they represent.
  4. Survey the attitudes and behaviors of researchers regarding alternative reputation systems.
  5. Facilitate the translation of credits to incentives and rewards by funders and academic institutions.

Community Projects

Agreement on Reforming Research Assessment (AGORRA)
In progress

| Updated: 17 May 2024

Solution: Metrics that Credit All Contributions

AGORRA is a global observatory of responsible research assessment that aims to generate comparative data, evidence and analysis to support and accelerate the transformation across national assessment systems.

Organization:

Research on Research Institute
Home page | Project page

Keywords:
Assessment/Evaluation, Metrics, Monitoring/Tracking

CHAOSS: Community Health Analytics Open Source Software
In progress

| Updated: 6 Nov 2022

Solution: Metrics that Credit All Contributions

Developing metrics, practices, and software for open source projects in community health; one goal is to identify all contributions made in this sphere and the organizations and individuals that make them; another to improve the transparency and actionability of open source tools.

Organization:

CHAOSS/Linux Foundation

Keywords:
Credits, Metrics, Monitoring/Tracking

Data Citation Corpus
Launched

| Updated: 24 Jun 2024

Solution: Metrics that Credit All Contributions

The Data Citation Corpus is a trusted central aggregate of all data citations to further the understanding of data usage and advance meaningful data metrics.

Organization:

Make Data Count

Home page | Project page

Keywords:
Best Practices, Metrics, Monitoring/Tracking

Epiverse Values-Based Approach to Open Source Ecosystems
In progress

| Updated: 21 Nov 2022

Solution: Metrics that Credit All Contributions

This project has developed a values-based open source implementation and assessment program, crucial to developing a trustworthy data analysis ecosystem. While building standardized, easily accessible epidemiological software tools, Epiverse will be applying this values-based framework to metrics gauging the initiative’s success.

Organization:

Epiverse / data.org
Home page  |  Project page

Keywords:
Credits, Early Sharing, Metrics, Technology

Epiverse: The Global Epidemic Response of the Future
In progress

| Updated: 6 Nov 2022

Solution: Metrics that Credit All Contributions

A global data analysis ecosystem creating standardized, accessible epidemiological software tools to solve real-world health problems. Three prongs include TRACE – the interoperable tools and software; BUILD – scaffolding for interdisciplinary engagement; and CONNECT – global community dedicated to innovation and health equity.

Organization:

data.org
Home page  |  Project page

Keywords:
Credits, Early Sharing, Metrics, Technology

Higher Education Leadership Initiative for Open Scholarship (HELIOS Open)
Launched

| Updated: 16 May 2024

Solution: Metrics that Credit All Contributions

The Higher Education Leadership Initiative for Open Scholarship (HELIOS Open) is a cohort of colleges and universities committed to collective action to advance open scholarship within and across their campuses. Leaders from US colleges and universities have joined this community of practice, working together to promote a more transparent, inclusive, and trustworthy research ecosystem.

Organization:

Open Research Funders Group (ORFG)

Home page | Project page

Keywords:
Assessment/Evaluation, Best Practices, Collaboration, Facilitation, Incentives, Rewards

Howard Hughes Medical Institute (HHMI): De-emphasizing journal name in researcher assessment
Launched

| Updated: 14 Jun 2024

Solution: Metrics that Credit All Contributions

In 2023, HHMI began removing journal names from researcher assessment materials to make it clearer HHMI values the discovery not the journal. They created a citation style for Zotero and built a digital form for the bibliography to generate citations that replace journal names with PMIDs or dois.

Organization:

Howard Hughes Medical Institute

Home page | Project page

Keywords:
Assessment/Evaluation, Metrics

More Than Our Rank
Launched

| Updated: 23 Aug 2024

Solution: Metrics that Credit All Contributions

The More Than Our Rank initiative has been developed in response to some of the problematic features and effects of the global university rankings. It provides an opportunity for academic institutions to highlight the many and various ways they serve the world that are not reflected in their ranking position.

Organization:

More Than Our Rank

Home page | Project page

Keywords:
Assessment/Evaluation, Best Practices, Credits

Open Science Monitoring Initiative (OSMI)
Planning

| Updated: 12 Jun 2024

Solution: Metrics that Credit All Contributions

The Open Science Monitoring Initiative (OSMI) brings together institutions and individuals involved in monitoring open science. OSMI aims to encourage the adoption of open science monitoring principles and to promote their practical implementation.

Organization:

Open Science Monitoring Initiative (OSMI)

Project Page

Keywords:
Assessment/Evaluation, Best Practices, Monitoring/Tracking, Research on Research

PLOS’ Open Science Indicators (OSI) initiative
Launched

| Updated: 14 May 2024

Solution: Metrics that Credit All Contributions

The OSI initiative aims to better understand researchers and to inform the development and monitoring of solutions intended to improve adoption of Open Science practices, such as sharing of research data, sharing code and protocols, and posting of preprints.

Organization:

Public Library of Science (PLOS)
Home page | Project page

Keywords:
Best Practices, Credits, Incentives, Metrics, Monitoring/Tracking

Rapid Science: The Collaboration Score
Planning

| Updated: 22 Nov 2022

Solution: Metrics that Credit All Contributions

Developing metrics that reflect team members’ collaborative research activities – e.g., sharing/posting early research, reviewing, revising, commenting – as well as the rapid, open dissemination of their findings.

Organization:

Rapid Science
Home page  |  Project page

Keywords:
Collaboration, Credits, Metrics, Rewards

Tools to Advance Research Assessment (TARA)
In progress

| Updated: 16 May 2024

Solution: Metrics that Credit All Contributions

Tools to Advance Research Assessment (TARA) is a project to facilitate the development of new policies and practices for academic career assessment.

Organization:

The Declaration on Research Assessment (DORA)
Home page | Project page

Keywords:
Assessment/Evaluation, Best Practices, Incentives, Metrics, Policy, Rewards

TOP Factor
Mature

| Updated: 21 May 2024

Solution: Metrics that Credit All Contributions

TOP Factor is an assessment of a scientific journal’s policies based on the framework provided by the Transparency and Openness Promotion (TOP) Guidelines. TOP Factor is a more ideal means to evaluate journal quality because it is based on practices that are fundamental to the conduct of science.

Organization:

Center of Open Science

Home page | Project page

Keywords:
Best Practices, Incentives, Peer Review, Policy

Metrics that Credit All Contributions