nf-core/methylseq Output

This document describes the output produced by the pipeline. Most of the plots are taken from the MultiQC report, which summarises results at the end of the pipeline.

Note that nf-core/methylseq contains two workflows - one for Bismark, one for bwa-meth. The results files produced will vary depending on which variant is run.

Pipeline overview

The pipeline is built using Nextflow and processes data using the following steps:

• FastQC - read quality control
• TrimGalore - adapter trimming
• Alignment - aligning reads to reference genome
• Deduplication - deduplicating reads
• Methylation Extraction - calling cytosine methylation steps
• Bismark Reports - single-sample and summary analysis reports
• Qualimap - tool for genome alignments QC
• Preseq - tool for estimating sample complexity
• MultiQC - aggregate report, describing results of the whole pipeline
• Pipeline Info - reports from nextflow about the pipeline run

FastQC

FastQC gives general quality metrics about your reads. It provides information about the quality score distribution across your reads, the per base sequence content (%T/A/G/C). You get information about adapter contamination and other overrepresented sequences.

For further reading and documentation see the FastQC help.

NB: The FastQC plots displayed in the MultiQC report shows untrimmed reads. They may contain adapter sequence and potentially regions with low quality. To see how your reads look after trimming, look at the FastQC reports in the trim_galore directory.

Output directory: results/fastqc

• sample_fastqc.html
• FastQC report, containing quality metrics for your untrimmed raw fastq files
• sample_fastqc.zip
• zip file containing the FastQC report, tab-delimited data file and plot images

TrimGalore

The nf-core/methylseq pipeline uses TrimGalore! for removal of adapter contamination and trimming of low quality regions. TrimGalore is a wrapper around Cutadapt and runs FastQC after it finishes.

MultiQC reports the percentage of bases removed by Cutadapt in the General Statistics table, along with a line plot showing where reads were trimmed.

Output directory: results/trim_galore

Contains FastQ files with quality and adapter trimmed reads for each sample, along with a log file describing the trimming.

• sample_val_1.fq.gz, sample_val_2.fq.gz
• Trimmed FastQ data, reads 1 and 2.
• NB: Only saved if --save_trimmed has been specified.
• logs/sample_val_1.fq.gz_trimming_report.txt
• Trimming report (describes which parameters that were used)
• FastQC/sample_val_1_fastqc.zip
• FastQC report for trimmed reads

Single-end data will have slightly different file names and only one FastQ file per sample.

Alignment

Bismark and bwa-meth convert all Cytosines contained within the sequenced reads to Thymine in-silico and then align against a three-letter reference genome. This method avoids methylation-specific alignment bias. The alignment produces a BAM file of genomic alignments.

Bismark output directory: results/bismark_alignments/ Note that bismark can use either use Bowtie2 (default) or HISAT2 as alignment tool and the output file names will not differ between the options.

• sample.bam
• Aligned reads in BAM format.
• NB: Only saved if --save_align_intermeds, --skip_deduplication or --rrbs is specified when running the pipeline.
• logs/sample_PE_report.txt
• Log file giving summary statistics about alignment.
• unmapped/unmapped_reads_1.fq.gz, unmapped/unmapped_reads_2.fq.gz
• Unmapped reads in FastQ format.
• Only saved if --unmapped specified when running the pipeline.

bwa-meth output directory: results/bwa-mem_alignments/

• sample.bam
• Aligned reads in BAM format.
• NB: Only saved if --save_align_intermeds is used
• sample.sorted.bam
• Aligned reads in a sorted BAM file.
• NB: Only saved if --save_align_intermeds, --skip_deduplication or --rrbs is specified when running the pipeline.
• sample.sorted.bam.bai
• Index of sorted BAM file
• NB: Only saved if --save_align_intermeds, --skip_deduplication or --rrbs is specified when running the pipeline.
• logs/sample_flagstat.txt
• Summary file describing the number of reads which aligned in different ways.
• logs/sample_stats.txt
• Summary file giving lots of metrics about the aligned BAM file.

Deduplication

This step removes alignments with identical mapping position to avoid technical duplication in the results. Note that it is skipped if --save_align_intermeds, --skip_deduplication or --rrbs is specified when running the pipeline.

Bismark output directory: results/bismark_deduplicated/

• deduplicated.bam
• BAM file with only unique alignments.
• logs/deduplication_report.txt
• Log file giving summary statistics about deduplication.

bwa-meth output directory: results/bwa-mem_markDuplicates/

NB: The bwa-meth step doesn't remove duplicate reads from the BAM file, it just labels them.

• sample.sorted.markDups.bam
• BAM file with only unique alignments.
• sample.sorted.markDups.bam.bai
• Index for markDups BAM file.
• logs/sample.sorted.markDups_metrics.txt
• Log file giving summary statistics about deduplication.

Methylation Extraction

The methylation extractor step takes a BAM file with aligned reads and generates files containing cytosine methylation calls. It produces a few different output formats, described below.

Note that the output may vary a little depending on whether you specify --comprehensive or --non_directional when running the pipeline.

Filename abbreviations stand for the following reference alignment strands:

• OT - original top strand
• OB - original bottom strand
• CTOT - complementary to original top strand
• CTOB - complementary to original bottom strand

Bismark output directory: results/bismark_methylation_calls/

NB: CTOT and CTOB are not aligned unless --non_directional specified.

• methylation_calls/XXX_context_sample.txt.gz
• Individual methylation calls, sorted into files according to cytosine context.
• methylation_coverage/sample.bismark.cov.gz
• Coverage text file summarising cytosine methylation values.
• bedGraph/sample.bedGraph.gz
• Methylation statuses in bedGraph format, with 0-based genomic start and 1- based end coordinates.
• m-bias/sample.M-bias.txt
• QC data showing methylation bias across read lengths. See the bismark documentation for more information.
• logs/sample_splitting_report.txt
• Log file giving summary statistics about methylation extraction.

bwa-meth workflow output directory: results/MethylDackel/

• sample.bedGraph
• Methylation statuses in bedGraph format.

Bismark Reports

Bismark generates a HTML reports describing results for each sample, as well as a summary report for the whole run.

Output directory: results/bismark_reports

Output directory: results/bismark_summary

Qualimap

Qualimap BamQC is a general-use quality-control tool that generates a number of statistics about aligned BAM files. It's not specific to bisulfite data, but it produces several useful stats - for example, insert size and coverage statistics.

Output directory: results/qualimap

• sample/qualimapReport.html
• Qualimap HTML report
• sample/genome_results.txt, sample/raw_data_qualimapReport/*.txt
• Text-based statistics that can be loaded into downstream programs

Preseq

Preseq estimates the complexity of a library, showing how many additional unique reads are sequenced for increasing the total read count. A shallow curve indicates that the library has reached complexity saturation and further sequencing would likely not add further unique reads. The dashed line shows a perfectly complex library where total reads = unique reads.

Note that these are predictive numbers only, not absolute. The MultiQC plot can sometimes give extreme sequencing depth on the X axis - click and drag from the left side of the plot to zoom in on more realistic numbers.

Output directory: results/preseq

• sample_ccurve.txt
• This file contains plot values for the complexity curve, plotted in the MultiQC report.

MultiQC

MultiQC is a visualisation tool that generates a single HTML report summarising all samples in your project. Most of the pipeline QC results are visualised in the report and further statistics are available in within the report data directory.

The pipeline has special steps which allow the software versions used to be reported in the MultiQC output for future traceability.

Output directory: results/multiqc

• Project_multiqc_report.html
• MultiQC report - a standalone HTML file that can be viewed in your web browser
• Project_multiqc_data/
• Directory containing parsed statistics from the different tools used in the pipeline

For more information about how to use MultiQC reports, see MultiQC

Pipeline Info

Nextflow has several built-in reporting tools that give information about the pipeline run.

Output directory: results/pipeline_info

• pipeline_dag.svg
• DAG graph giving a diagrammatic view of the pipeline run.
• NB: If Graphviz was not installed when running the pipeline, this file will be in DOT format instead of SVG.
• execution_report.html
• Nextflow report describing parameters, computational resource usage and task bash commands used.
• execution_timeline.html
• A waterfall timeline plot showing the running times of the workflow tasks.
• execution_trace.txt
• A text file with machine-readable statistics about every task executed in the pipeline.
• pipeline_report.html
• A pipeline-specific HTML report describing the running of the pipeline.
• This is the same as sent in an email if --email was specified.
• pipeline_report.txt
• A text-only version of the same report.