Towards reliable pathway enrichment

The objective is to improve the quality of enrichment analysis in the scientific literature.

2024–ongoing

We are using a comprehensive multi-pronged approach:

1. We screen published journal articles for the presence of statistical errors and missing methodological data.
2. For selected high impact articles, we will reproduce their work using valid methods, and report any studies whose conclusions were invalidated.
3. Using bioinformatics investigations, we quantify how these statistical errors distort research findings.
4. Using a survey questionnaire of biomedical researchers, we will investigate root causes of the issue.
5. We are initiating a consortium of experts to contribute towards a community led set of guidelines for conducting and reporting enrichment analysis.
6. We are publishing “gold standard” methods and to enable researchers to avoid these pitfalls.
7. If necessary, we will develop new computational software/web resources if we have reason to believe it will help researchers avoid these pitfalls.
8. Tangentially, we are investigating whether web-based bioinformatics tools are in violation of NHMRC/NIH research data preservation guidelines.

The research does not directly impact communities, however improved methodology in this area will have future benefits:

• If successful, biomedical researchers will take reproducibility more seriously when it comes to their computational methods.
• Reduced research waste by avoiding methodological pitfalls.
• Avoiding such pitfalls reduces the failure rate of research translation, helping new therapies materialize sooner.
• Improving quality will enhance community perception of investing in biomedical research.