An automated environmental DNA (eDNA) metabarcoding pipeline that converts raw NCBI SRA sequencing data into taxonomically annotated species tables.
This pipeline was created as a collaboration between the Genome Damage and Stability Centre (GDSC), and Ecology and Evolution (EE) department at the University of Sussex (UoS). It is built for research and meant to serve as an alternative to external FASTQ analysis.
Currently only works for 12S MiFish-U and 16S MarVer3 Primers.
The upload here is hardcoded to the example dataset "SR normalised Clark et al 2024" (Clark, et al,. 2024) but the file location is easily adapatable.
-
If FASTQ files already exist, create a folder named fqconvert in your working directory and place them in there and ensure they end in _1.fastq or _2.fastq.
-
If working with similar archived files change line 16 TARGET_NAME="SR normalised Clark et al 2024" of 00_sra_to_fastq.sh to your chosen folder and ensure it is in the same directory as the pipeline.
After running your outputs can be traced and validated at every stage through the folders in the generated runs folder. A run will be created with the date of running the pipeline.
If only interested in the final report, type master_species_composition_taxonomy.csv in your root directory.
This repository includes:
- The complete eDNA metabarcoding pipeline for MiFish-U 12S and MarVer3 16S primers
- Benchmark NCBI SRA sequencing data
- An example of the output species table (
master_species_composition.csv) - The original Nature Metrics reference dataset (
reference_data.xlsx)
This pipeline was validated on WSL Ubuntu and built on Ubuntu and the Linux Rocky 9 Artemis High-Performance-Computing (HPC) Cluster. Your experience on other operating systems may vary.
Install:
- Python 3.11+
- SRA Toolkit
- Cutadapt
- USEARCH v12+
Then install the Python packages:
pip install -r requirements.txtMake the launcher executable:
chmod +x run_pipeline.shRun the complete workflow:
./run_pipeline.shThe pipeline automatically performs:
- SRA → FASTQ conversion
- Primer trimming
- Dereplication
- Denoising
- BLAST identification
- NCBI taxonomy annotation
A new results folder is created inside:
runs/
The final output file is:
master_species_composition.csv
On supported Linux systems, this file opens automatically when the pipeline finishes.
If you simply wish to inspect the benchmark results without running the pipeline, the repository already includes:
master_species_composition.csv— the completed taxonomic annotation generated by the pipeline.reference_data.xlsx— the original Nature Metrics reference report used for comparison and validation.
If you use this pipeline in research or publications, please cite:
Rudie Kauhanen. UoS eDNA Bioinformatics Pipeline version 1.0., 2026. https://github.com/Rudie-K/UoS-eDNA-Bioinformatics
Please also cite the software used by this workflow where appropriate, including:
- Cutadapt
- USEARCH
- NCBI BLAST
- NCBI Taxonomy