MHRA-led study reveals major inconsistencies in global microbiome research

A landmark international study led by the UK’s Medicines and Healthcare products Regulatory Authority (MHRA) has exposed significant variability in microbiome research methods across the world, highlighting an urgent need to adopt unified standards for the global harmonisation of gut microbiome research. 

The study involved leading laboratories across multiple countries testing identical samples of gut microbiome bacteria. Results revealed startling inconsistencies, with accuracy measures varying dramatically between laboratories – despite analysing the same samples. 

Key findings 

23 laboratories from 11 countries across 4 continents were asked to use the newly developed World Health Organization (WHO) International Reference Reagents – containing DNA of known bacterial compositions – to determine whether the methodologies were suitable. When they analysed these samples 

• Species identification varied from 63% to 100% accuracy across different methods, meaning that some laboratories failed to detect a third of the bacterial species present in the sample 

• False positive rates ranged from 0% to 41%, meaning some labs incorrectly identified bacteria that weren’t present in the sample 

• Sample diversity estimates varied considerably, with labs identifying as few as 12 or as many as 185 different bacterial species in the same sample 

Why this matters 

Microbiome research increasingly informs treatments for conditions including inflammatory bowel disease, metabolic syndrome, irritable bowel syndrome and colorectal cancer. However, contradictory findings between studies have undermined confidence in this rapidly expanding field. 

The study identified that a key source of variation may arise from the application of “high throughput sequencing” methods applied to characterise gut microbiome samples. These variations arise from multiple steps in this method including 

• Choice of DNA sequencing technology 

• Bioinformatics software and databases used for analysis 

• Version of reference databases (even minor updates significantly affected results) 

• Laboratory protocols and techniques 

Notably, the research demonstrated that appropriate analysis methods could achieve accurate results with far fewer resources than previously thought (depending on the sample) – one laboratory achieved quality standards using approximately 890,000 DNA sequence reads, compared with others using an average of 25.4 million reads. 

Moving the field forward 

The study establishes Minimum Quality Criteria for four key reporting measures that laboratories worldwide can now use to validate their microbiome analysis methods. These standards are based on real-world data rather than theoretical predictions. 

The WHO International DNA Gut Reference Reagents are now available for laboratories globally to benchmark their performance and optimise their methodologies. 

What this means for patients 

This UK government-funded research has created physical quality standards that laboratories worldwide can now use to assess the accuracy of their own detection methods. This means 

• Future gut health research will be more reliable 

• Medical treatments based on microbiome science will be more trustworthy 

• Your test results should become more reliable than before 

• Progress towards new therapies for gut-related diseases should accelerate 

Bottom line This research is helping ensure that when doctors or researchers analyse your gut health, they’re getting accurate information – which means better diagnosis and treatment for everyone. 

Saba Anwar, lead author of the study and Senior Research and Development Scientist at the MHRA, said  

“This benchmark study highlights the true level of variability in microbiome data across the world and across sectors, underscoring the critical need for the use of WHO International DNA Gut Reference Reagents to elevate the quality of data in microbiome research. By pinpointing the sources of bias in existing methodologies using reference reagents, we can accelerate innovation and method optimisation.” 

Government investment in regulatory science 

This research was commissioned and funded by the Department of Health and Social Care Policy Research Programme through the MHRA Regulatory Science Research Unit, with additional support from an Innovate UK Small Business Research Initiative Award for “Creating Standards for Microbiome Therapies.” 

The work exemplifies the UK government’s commitment to advancing regulatory science and supporting innovation in healthcare technologies whilst ensuring robust quality standards. 

Notes to editors  

1. The Medicines and Healthcare products Regulatory Agency (MHRA) is responsible for regulating all medicines and medical devices in the UK by ensuring they work and are acceptably safe.  All our work is underpinned by robust and fact-based judgements to ensure that the benefits justify any risks.  

2. The MHRA is an executive agency of the Department of Health and Social Care.  

3. For media enquiries, please contact the [email protected], or call on 020 3080 7651.  

4. The full study is published in mSystems journal DNA reference reagents isolate biases in microbiome profiling a global multi-lab study.

5. All sequencing data are publicly available on the NCBI Sequence Read Archive under BioProject PRJNA1238537 

6. Reference reagents are available at www.nibsc.org/products.aspx. 

7. The research involved 34 participating institutions, including academic institutions, government laboratories, and industry, across multiple countries including the UK, USA, Netherlands, Germany, Korea, Australia, Mexico and Turkey. 

8. The study tested both shotgun sequencing and 16S rRNA gene amplicon sequencing methods.