filtering ASVs by abundance

[yanxianl (Yanxian Li)]

Hi,

I used to have the same question. Here's my two cents:

@hsapers

My understanding is that there is some sort of built-in algorithm when inferring ASVs using Dada2 that infers true biological sequences and spurious features are filtered out based on error modeling such that the singleton removal and threshold removal required with OTU based clustering is deprecated.

Yes. The abundance based filtering ("threshold removal"), which was implemented in QIIME1 to remove spurious OTUs, is generally considered as unnecessary for feature tables generated by sequence denoisers such as DADA2 and Deblur. The singletons detected in each sample are still removed, when the DADA2 processess sequences independently for each sample. In some cases, such as differential abundance testing, filtering low-abundant and/or low-prevalent features is still warranted to reduce the burden of multiple hypothesis testing. See more discussions here about the abundance based filtering.

@hsapers

My understanding is this can be run either sample by sample (least computationally expensive) or on all samples together (increased probability of resolving low-abundance ASVs) or using a ‘pseudo-pooling’ method. Currently it seems that the qiime2 plug in only allows for the per-sample implementation of dada2.

Yes. Samples are processed independently by DADA2 in Qiime2 at the moment, which removes singletons detected in each sample. But "pseudo-pooling", which allows for the detection of rare features, will be available in the coming release of QIIME2 this month.

@hsapers

Does this mean that I should interpret all resulting ASVs as ‘true’ biological sequences - even those that appear in < 0.1% of the data?

Yes. The inferred ASVs are still reliable even if they account for < 0.1% of the total reads.

@hsapers

I also want to make sure that I’m understanding the feature table summary statistics correctly: Number of features: 7427, frequency: 2079818. This means that I have 7427 ASVs observed a total of 2079818 times across all of my samples.

Yes, that's correct.

@hsapers

How would this change if I constructed ASVs by pooling samples - could I still removed samples without fundamentally affecting the compositional nature of the data?

"Data that are naturally described as proportions or probabilities, or with a constant or irrelevant sum, are referred to as compositional data (Gloor et al., 2017)." The compositinal nature of the microbiome data refers to the pratice of normalizing sequencing depth by total sum scaling, i.e., relative abundance. When we talk about the relative abundance of features, it usually refers to the proportion of reads assigned to a particular feature in a sample, not in all the samples. Removing samples in your project, whether processed by the DADA2 independently or jointly, is not related to the compositinal data analysis.