# Loosing 60% of my reads although good quality scores

**URL:** https://forum.qiime2.org/t/loosing-60-of-my-reads-although-good-quality-scores/22459
**Category:** User Support
**Tags:** dada2
**Created:** [March 14, 2022, 8:49am UTC](https://forum.qiime2.org/t/loosing-60-of-my-reads-although-good-quality-scores/22459 "2022-03-14T08:49:05Z")
**Posts on this page:** 11
**Page:** 1

<div class="post-metadata">

### Author: ![Wieneke](https://forum.qiime2.org/letter_avatar_proxy/v4/letter/w/dfb087/32.png) [@Wieneke](https://forum.qiime2.org/u/Wieneke)
#### Post date: [March 14, 2022, 8:49am UTC](https://forum.qiime2.org/t/loosing-60-of-my-reads-although-good-quality-scores/22459/1 "2022-03-14T08:49:05Z")

</div>

Hi, I have seen many posts about this subject on the forum. But saw rthat there where mostly three problems: Primers not removed/ primers removed before filtering on read length/ low quality data.  
I did control for these steps, but still I loose 60-85% of my reads. Which is way more than was shown in the percentages table shown in one of the earlier posts ( sorry cannot find it back, so I can't link it anymore) .  
So I hope someone can help me with what I do wrong or can change?  
Wieneke

I am denoising gut microbiome data 16S V3-V4 with 250bp .  
primers: 341f (CCTACGGGNGGCWGCAG) 785/805r (GACTACHVGGGTATCTAATCC)

code run ( vs 2021.8)  
qiime dada2 denoise-paired --i-demultiplexed-seqs HBSpaired-end-demux.qza  
--p-trim-left-f 18  
--p-trim-left-r 21  
--p-trunc-len-f 250  
--p-trunc-len-r 232  
--o-table tableHBS.qza --o-representativ e-sequences rep-seqs-HBS.qza --o-denoising-stats denoising-statsHBS.qza --verbose

Quality scores of the demux file:

 ![qualityscore demux](https://forum-qiime2-org.s3.dualstack.us-west-2.amazonaws.com/original/2X/e/e4012454181db7ecdfdb4bf1deb00a2bc81ba2e3.png)  
Result high end of the sample:  
 ![denoising high end](https://forum-qiime2-org.s3.dualstack.us-west-2.amazonaws.com/original/2X/8/8a07f6bb5401f540d25f841550d98284fdc1ed72.png)  
result bottom samples:  
 ![denoising low end](https://forum-qiime2-org.s3.dualstack.us-west-2.amazonaws.com/original/2X/c/ca0d0cb96a53374a98093933059948ddff67f0cd.png)  
[HBSpaired-end-demux.qzv](https://forum.qiime2.org/uploads/short-url/1C4stq31yrAMXTuJfYOjYbEzmj3.qzv) (316.8 KB)  
[denoising-statsHBSses1.qzv](https://forum.qiime2.org/uploads/short-url/rnSpKQsmoeuJh1kZC9i8u6ObGXP.qzv) (1.2 MB)

---

<div class="post-metadata">

### Author: ![timanix](https://forum.qiime2.org/user_avatar/forum.qiime2.org/timanix/32/17879_2.png) [@timanix](https://forum.qiime2.org/u/timanix)
#### Post date: [March 14, 2022, 8:59am UTC](https://forum.qiime2.org/t/loosing-60-of-my-reads-although-good-quality-scores/22459/2 "2022-03-14T08:59:56Z")

</div>

Welcome to the forum!  
I think the problem is in the truncating value for forward reads:

> [@Wieneke](#):
>
> --p-trunc-len-f 250

You need to set forward reads to a lower value for truncation or disable it since all the reads that are shorter than 250 are filtered out (check 'percentage of input passed filter' column).

> [@Wieneke](#):
>
> I am denoising gut microbiome data 16S V3-V4 with 250bp

Since you are working with v3-v4 region, that is quite long, if in the stats after setting lower truncation for forward reads you will loose a lot of reads on the merging step, you also can decrease minimum overlap parameter and/or completely disable truncation.

---

<div class="post-metadata">

### Author: ![Wieneke](https://forum.qiime2.org/letter_avatar_proxy/v4/letter/w/dfb087/32.png) [@Wieneke](https://forum.qiime2.org/u/Wieneke)
#### Post date: [March 14, 2022, 9:27am UTC](https://forum.qiime2.org/t/loosing-60-of-my-reads-although-good-quality-scores/22459/3 "2022-03-14T09:27:14Z")

</div>

HiThanks for you quick reply. I tried disabling truncation by putting --trunc len -f at 0, but that gave the same result in denoising. is there another way that I can disable it?

---

<div class="post-metadata">

### Author: ![timanix](https://forum.qiime2.org/user_avatar/forum.qiime2.org/timanix/32/17879_2.png) [@timanix](https://forum.qiime2.org/u/timanix)
#### Post date: [March 14, 2022, 9:58am UTC](https://forum.qiime2.org/t/loosing-60-of-my-reads-although-good-quality-scores/22459/4 "2022-03-14T09:58:11Z")

</div>

No, you did it in the right way.  
Could you share denoising stats from your last run with disabled truncation?

---

<div class="post-metadata">

### Author: ![Wieneke](https://forum.qiime2.org/letter_avatar_proxy/v4/letter/w/dfb087/32.png) [@Wieneke](https://forum.qiime2.org/u/Wieneke)
#### Post date: [March 14, 2022, 11:09am UTC](https://forum.qiime2.org/t/loosing-60-of-my-reads-although-good-quality-scores/22459/5 "2022-03-14T11:09:19Z")

</div>

[denoising-statsHBSses2.qzv](https://forum.qiime2.org/uploads/short-url/npxda3qEEEUN2M0uUbLdezm8XPK.qzv) (1.2 MB)  
That is this oneI Only disabled truncation on the forward reads, but the one on the reverse stayed at 232. Trim parameters stayed the same.  
I also looked at my length summary in the demux file and it says all my reads are 251.

 ![length summary](https://forum-qiime2-org.s3.dualstack.us-west-2.amazonaws.com/original/2X/7/7536b66625aa2107e4b6acc35939fa7b415c43cf.png)

---

<div class="post-metadata">

### Author: ![timanix](https://forum.qiime2.org/user_avatar/forum.qiime2.org/timanix/32/17879_2.png) [@timanix](https://forum.qiime2.org/u/timanix)
#### Post date: [March 14, 2022, 1:55pm UTC](https://forum.qiime2.org/t/loosing-60-of-my-reads-although-good-quality-scores/22459/9 "2022-03-14T13:55:01Z")

</div>

Thank you for sharing your stats.  
I think that percentage of features pasted through the filters is relatively low due to high probability of errors in filtered out reads. At the same time, as @jwdebelius (thanks!) noticed, you still have more than enough of the reads to proceed with the analysis.  
Because of the natural variation of V3-V4 length among bacteria, I would like although to suggest to decrease minimum ovelapping region parameter to recover more reads on the joining step.

---

<div class="post-metadata">

### Author: ![Wieneke](https://forum.qiime2.org/letter_avatar_proxy/v4/letter/w/dfb087/32.png) [@Wieneke](https://forum.qiime2.org/u/Wieneke)
#### Post date: [March 14, 2022, 2:26pm UTC](https://forum.qiime2.org/t/loosing-60-of-my-reads-although-good-quality-scores/22459/10 "2022-03-14T14:26:25Z")

</div>

Thank you for your help I will try that.

---

<div class="post-metadata">

### Author: ![Wieneke](https://forum.qiime2.org/letter_avatar_proxy/v4/letter/w/dfb087/32.png) [@Wieneke](https://forum.qiime2.org/u/Wieneke)
#### Post date: [March 30, 2022, 7:57am UTC](https://forum.qiime2.org/t/loosing-60-of-my-reads-although-good-quality-scores/22459/11 "2022-03-30T07:57:51Z")

</div>

Eventually the first option I used gave the best results. I will perform he analyses on the remaining reads ( which are indeed a lot ) Still I'm curious though about the reason why the reads are discarded in the filtering step. Can this be introducing a bias? is this becaquse I had such a high amount of reads to start witrh, that it included many duplicates? etc

---

<div class="post-metadata">

### Author: ![lizgehret](https://forum.qiime2.org/user_avatar/forum.qiime2.org/lizgehret/32/17128_2.png) [@lizgehret](https://forum.qiime2.org/u/lizgehret)
#### Post date: [March 31, 2022, 11:14pm UTC](https://forum.qiime2.org/t/loosing-60-of-my-reads-although-good-quality-scores/22459/12 "2022-03-31T23:14:13Z")

</div>

An off-topic reply has been split into a new topic: [Losing high percentage of reads with good quality scores](https://forum.qiime2.org/t/losing-high-percentage-of-reads-with-good-quality-scores/22643)

Please keep replies on-topic in the future.

---

<div class="post-metadata">

### Author: ![timanix](https://forum.qiime2.org/user_avatar/forum.qiime2.org/timanix/32/17879_2.png) [@timanix](https://forum.qiime2.org/u/timanix)
#### Post date: [April 14, 2022, 8:59am UTC](https://forum.qiime2.org/t/loosing-60-of-my-reads-although-good-quality-scores/22459/15 "2022-04-14T08:59:45Z")

</div>

Hi @Wieneke  
Sorry for a long silence.  
This new quality plots based on NovaSeq-like are always confusing me. But one can see that there are some declines in the quality scores starting from the middle of the reads in both orientations, and I think it is a main reason for the loss in the number of reads passing the filter. It is only my opinion, but probably the reason for it is on the sequencing center side or somehow were caused at the PCR step (I had one plate that gave me a lot of reads with low quality meanwhile samples from other plates sequenced at the same run were fine. It is very strange to me).  
In any case the fact that filters removed those reads will lead to less bias in the data than if they would remain in the analysis.

---

<div class="post-metadata">

### Author: ![system](https://forum-qiime2-org.s3.dualstack.us-west-2.amazonaws.com/original/3X/2/1/21af5fe23cb6f4579467c66a9ed94e55274ca7bd.svg) [@system](https://forum.qiime2.org/u/system)
#### Post date: [May 15, 2022, 2:59pm UTC](https://forum.qiime2.org/t/loosing-60-of-my-reads-although-good-quality-scores/22459/16 "2022-05-15T14:59:45Z")

</div>

This topic was automatically closed 31 days after the last reply. New replies are no longer allowed.
