# Joining paired end reads using QIIME2 , QIIME1.9 and usearch10

**URL:** <https://forum.qiime2.org/t/joining-paired-end-reads-using-qiime2-qiime1-9-and-usearch10/4970>\
**Category:** User Support\
**Tags:** joining\
**Created:** [July 10, 2018, 4:25pm UTC](https://forum.qiime2.org/t/joining-paired-end-reads-using-qiime2-qiime1-9-and-usearch10/4970 "2018-07-10T16:25:31Z")\
**Posts on this page:** 14\
**Page:** 1

<div class="post-metadata">

**Author:** ![mol](https://forum.qiime2.org/letter_avatar_proxy/v4/letter/m/dbc845/32.png) [@mol](https://forum.qiime2.org/u/mol)\
**Post date:** [July 10, 2018, 4:25pm UTC](https://forum.qiime2.org/t/joining-paired-end-reads-using-qiime2-qiime1-9-and-usearch10/4970/1 "2018-07-10T16:25:31Z")

</div>

I used my 16s rRNA paired end reads to compare the joining-paried-end-reads methods,including QIIME2(vsearch), QIIME1.9(fast-join), QIIME1.9( SeqPrep) and usearch10 . All the parameters were default. The results shows below:

```auto
           No. of raw data QIIME2(vsearch) QIIME1.9(fast-join) QIIME1.9(SeqPrep) usearch10   
sample1 31487 7883 20566 28966 1689
sample2 43406 11435 29377 39957 2458
sample3 33070 8937 22612 30736 2226

```

Why did the results show high variance among these methods？ which method should I choose to analysis my data?  
Thanks!

---

<div class="post-metadata">

**Author:** ![ebolyen](https://forum.qiime2.org/user_avatar/forum.qiime2.org/ebolyen/32/11_2.png) [@ebolyen](https://forum.qiime2.org/u/ebolyen)\
**Post date:** [July 10, 2018, 4:47pm UTC](https://forum.qiime2.org/t/joining-paired-end-reads-using-qiime2-qiime1-9-and-usearch10/4970/2 "2018-07-10T16:47:50Z")

</div>



---

<div class="post-metadata">

**Author:** ![Nicholas\_Bokulich](https://forum.qiime2.org/user_avatar/forum.qiime2.org/nicholas_bokulich/32/19937_2.png) [@Nicholas\_Bokulich](https://forum.qiime2.org/u/Nicholas_Bokulich)\
**Post date:** [July 10, 2018, 6:27pm UTC](https://forum.qiime2.org/t/joining-paired-end-reads-using-qiime2-qiime1-9-and-usearch10/4970/3 "2018-07-10T18:27:11Z")

</div>

> [@mol](#):
>
> Why did the results show high variance among these methods？

Probably because the default parameters and algorithms are very different between these methods.

The high variability makes me think something else is going on.

Did you perform any kind of read trimming or quality filtering prior to joining?

> [@mol](#):
>
> which method should I choose to analysis my data?

You should evaluate the joining, too, if you are concerned that they may be joining differently. Look at read length distributions and compare those to your expected amplicon length distribution (keep in mind that some level of length variation exists for 16S, so there is a distribution).

You could also process all of these through QIIME2 to see if, e.g,. you get more unclassified reads from the qiime1 methods (implying that these are bad joins). (as an alternative, use vsearch or another global aligner to see how well these align to full-length 16S reads).

If length distribution and taxonomic abundances/alignment look okay, I'd use the method that gives me the most reads!

---

<div class="post-metadata">

**Author:** ![Nicholas\_Bokulich](https://forum.qiime2.org/user_avatar/forum.qiime2.org/nicholas_bokulich/32/19937_2.png) [@Nicholas\_Bokulich](https://forum.qiime2.org/u/Nicholas_Bokulich)\
**Post date:** [July 10, 2018, 6:27pm UTC](https://forum.qiime2.org/t/joining-paired-end-reads-using-qiime2-qiime1-9-and-usearch10/4970/4 "2018-07-10T18:27:18Z")

</div>



---

<div class="post-metadata">

**Author:** ![SoilRotifer](https://forum.qiime2.org/user_avatar/forum.qiime2.org/soilrotifer/32/21071_2.png) [@SoilRotifer](https://forum.qiime2.org/u/SoilRotifer)\
**Post date:** [July 10, 2018, 6:50pm UTC](https://forum.qiime2.org/t/joining-paired-end-reads-using-qiime2-qiime1-9-and-usearch10/4970/5 "2018-07-10T18:50:34Z")

</div>

To echo the points by @Nicholas_Bokulich, check out some of the older but related discussions in the QIIME 1 forum:

1. [join\_paired\_ends.py](http://qiime.org/scripts/join_paired_ends.html) help documentation
2. See this QIIME 1 forum thread: [join\_paired\_ends.py questions](https://groups.google.com/d/msg/qiime-forum/fU8d7NwQe2I/pDp6w2Qp9C0J)
3. See this QIIME 1 forum thread: [number of reads after joining](https://groups.google.com/d/topic/qiime-forum/5mGbAXtdbRM/discussion)

I think there are several other threads in the QIIME 1 forum. But these should help get you started. You can browse through [mergepairs](https://www.drive5.com/usearch/manual/merge_options.html) parameters for usearch. Also check out this [post](https://groups.google.com/d/msg/vsearch-forum/AWPAQ7-Er5w/knbGiroHBAAJ) on why there may be differences between vsearch and usearch.

In brief, I try to trim off the low-quality tails prior to joining the reads. This will reduce the number of mismatches, as if there are to many the merge will fail. This is one reason why DADA2 takes this approach, as outlined [here](https://docs.qiime2.org/2018.6/tutorials/moving-pictures/#option-1-dada2). Also, it is generally a good idea to remove primers from each of the reads prior to merging, especially if you get read-through, which can also cause mismatches during merging. In which case you may need to check if both of your primers appear in each read separately.

-Hope this helps!  
-Cheers!

---

<div class="post-metadata">

**Author:** ![mol](https://forum.qiime2.org/letter_avatar_proxy/v4/letter/m/dbc845/32.png) [@mol](https://forum.qiime2.org/u/mol)\
**Post date:** [July 11, 2018, 5:40pm UTC](https://forum.qiime2.org/t/joining-paired-end-reads-using-qiime2-qiime1-9-and-usearch10/4970/6 "2018-07-11T17:40:23Z")

</div>

Thanks!  
I tried to change the parameters to keep them same. QIIME1.9(fast-join and SeqSrep) and usearch10 got similar results, vsearch still howed high variance. I removed the primers for the data piior to join, and dindt do quality filtering.

---

<div class="post-metadata">

**Author:** ![mol](https://forum.qiime2.org/letter_avatar_proxy/v4/letter/m/dbc845/32.png) [@mol](https://forum.qiime2.org/u/mol)\
**Post date:** [July 11, 2018, 5:40pm UTC](https://forum.qiime2.org/t/joining-paired-end-reads-using-qiime2-qiime1-9-and-usearch10/4970/7 "2018-07-11T17:40:26Z")

</div>

Thank you！  
I tested to trim off the low-quality base using parameter '--p-truncqual' in QIIME2 and '-fastq\_trunctail' in usearch10. The results showed below:

```
                                                  sample1 sample2

```

rawdata 31487 43406  
QIIME2(--p-truncqual=33) 2601 3864  
QIIME2(--p-truncqual=20) 12135 17478  
QIIME2(--p-truncqual=10) 20046 27966  
QIIME2(--p-truncqual=5) 27291 38214  
QIIME2(--p-truncqual=2) 27291 38214  
QIIME2(--p-truncqual=1) 7883 11435  
QIIME2(--p-truncqual=0) 7883 11435  
QIIME2(default) 7883 11435  
usearch(-fastq\_trunctail=30） 30187 41582  
usearch(-fastq\_trunctail=20） 28187 39220  
usearch(-fastq\_trunctail=10） 23324 33123  
usearch(-fastq\_trunctail=5） 20344 29222  
usearch(-fastq\_trunctail=defalut） 20344 29222

It showed differenct trends with increasing cutoff between QIIME2 and usearch.  
Is there something wrong durning my processes?

---

<div class="post-metadata">

**Author:** ![thermokarst](https://forum.qiime2.org/letter_avatar_proxy/v4/letter/t/8e7dd6/32.png) [@thermokarst](https://forum.qiime2.org/u/thermokarst)\
**Post date:** [July 11, 2018, 5:41pm UTC](https://forum.qiime2.org/t/joining-paired-end-reads-using-qiime2-qiime1-9-and-usearch10/4970/8 "2018-07-11T17:41:05Z")

</div>



---

<div class="post-metadata">

**Author:** ![Nicholas\_Bokulich](https://forum.qiime2.org/user_avatar/forum.qiime2.org/nicholas_bokulich/32/19937_2.png) [@Nicholas\_Bokulich](https://forum.qiime2.org/u/Nicholas_Bokulich)\
**Post date:** [July 11, 2018, 6:38pm UTC](https://forum.qiime2.org/t/joining-paired-end-reads-using-qiime2-qiime1-9-and-usearch10/4970/9 "2018-07-11T18:38:00Z")

</div>

> [@mol](#):
>
> It showed differenct trends with increasing cutoff between QIIME2 and usearch.

The results are pretty similar in the Q=5-10 range. You did not test lower for usearch (default is obviously Q=5) but I'd expect similar.

read yield drops off in the low range because as @SoilRotifer described there is too much bad sequence there, preventing suitable alignment.

read yield drops off in the high range because you would be trimming off too much sequence and the reads are unlikely to overlap at all since there are not overlapping tails!

Higher is not corresponding between usearch/vsearch — this really comes down to differences between those algorithms (QIIME 2 is just wrapping vsearch here, not doing anything special), which as far as I know are supposed to be very similar (perhaps not for read joining, though).

Without seeing other evaluation evidence (length distribution, classification/alignment to reference) I would actually trust the vsearch yields more here, based on my explanation above. usearch might just be gluing together two reads that don't actually overlap — there may be different minimum overlap parameters or something along those lines.

> [@mol](#):
>
> Is there something wrong durning my processes?

No, probably not. I think this still looks like different parameters and/or possibly differences in the algorithms.

In any case (again, lacking evals like read length and alignment to reference), joining with `--p-truncqual` in the Q=5-10 range looks pretty good! Looks like you've done a good evaluation to figure out what works best for your data!

---

<div class="post-metadata">

**Author:** ![Nicholas\_Bokulich](https://forum.qiime2.org/user_avatar/forum.qiime2.org/nicholas_bokulich/32/19937_2.png) [@Nicholas\_Bokulich](https://forum.qiime2.org/u/Nicholas_Bokulich)\
**Post date:** [July 11, 2018, 6:38pm UTC](https://forum.qiime2.org/t/joining-paired-end-reads-using-qiime2-qiime1-9-and-usearch10/4970/10 "2018-07-11T18:38:03Z")

</div>



---

<div class="post-metadata">

**Author:** ![SoilRotifer](https://forum.qiime2.org/user_avatar/forum.qiime2.org/soilrotifer/32/21071_2.png) [@SoilRotifer](https://forum.qiime2.org/u/SoilRotifer)\
**Post date:** [July 11, 2018, 8:10pm UTC](https://forum.qiime2.org/t/joining-paired-end-reads-using-qiime2-qiime1-9-and-usearch10/4970/11 "2018-07-11T20:10:43Z")

</div>

> [@mol](#):
>
> It showed differenct trends with increasing cutoff between QIIME2 and usearch.  
> Is there something wrong durning my processes?

As @Nicholas_Bokulich mentioned, QIIME 2 is simply wrapping vsearch. You may have missed that I had updated my original post with this additional caveat:

> [@SoilRotifer](#):
>
> You can browse through [mergepairs](https://www.drive5.com/usearch/manual/merge_options.html) parameters for usearch. Also check out this [post](https://groups.google.com/d/msg/vsearch-forum/AWPAQ7-Er5w/knbGiroHBAAJ) on why there may be differences between vsearch and usearch.

This should help to answer your questions about usearch vs vsearch merging. 🙂

-Best wishes.

---

<div class="post-metadata">

**Author:** ![mol](https://forum.qiime2.org/letter_avatar_proxy/v4/letter/m/dbc845/32.png) [@mol](https://forum.qiime2.org/u/mol)\
**Post date:** [July 12, 2018, 12:03pm UTC](https://forum.qiime2.org/t/joining-paired-end-reads-using-qiime2-qiime1-9-and-usearch10/4970/12 "2018-07-12T12:03:39Z")

</div>

Thanks.  
I have got most of the points ablout the question. However, I used the same data and the same parameters to test QIIME2(vsearch) and usearch. In QIIME2(vsearch), when the Q increased(except 0 -1), the reads yield drop off. In usearch, when the Q increased, the reads yield increased. I thought the only reason is the algorithm?

---

<div class="post-metadata">

**Author:** ![Nicholas\_Bokulich](https://forum.qiime2.org/user_avatar/forum.qiime2.org/nicholas_bokulich/32/19937_2.png) [@Nicholas\_Bokulich](https://forum.qiime2.org/u/Nicholas_Bokulich)\
**Post date:** [July 12, 2018, 7:24pm UTC](https://forum.qiime2.org/t/joining-paired-end-reads-using-qiime2-qiime1-9-and-usearch10/4970/13 "2018-07-12T19:24:47Z")

</div>

> [@mol](#):
>
> the Q increased(except 0 -1), the reads yield drop off. In usearch, when the Q increased, the reads yield increased. I thought the only reason is the algorithm?

Probably yes. As I explained above (or at least predicted, since I have not seen read length distribution results to evaluate):

> [@Nicholas\_Bokulich](#):
>
> read yield drops off in the high range because you would be trimming off too much sequence and the reads are unlikely to overlap at all since there are not overlapping tails!
> 
> Higher is not corresponding between usearch/vsearch — this really comes down to differences between those algorithms (QIIME 2 is just wrapping vsearch here, not doing anything special), which as far as I know are supposed to be very similar (perhaps not for read joining, though).
> 
> Without seeing other evaluation evidence (length distribution, classification/alignment to reference) I would actually trust the vsearch yields more here, based on my explanation above. usearch might just be gluing together two reads that don’t actually overlap — there may be different minimum overlap parameters or something along those lines.

So check out the length distributions after joining. I suspect usearch may be gluing together two non-overlapping reads. The vsearch results make more sense to me, because aggressive Q-score trimming will lead to shorter sequences and lower likelihood of successful joining.

---

<div class="post-metadata">

**Author:** ![system](https://forum-qiime2-org.s3.dualstack.us-west-2.amazonaws.com/original/3X/2/1/21af5fe23cb6f4579467c66a9ed94e55274ca7bd.svg) [@system](https://forum.qiime2.org/u/system)\
**Post date:** [August 13, 2018, 1:24am UTC](https://forum.qiime2.org/t/joining-paired-end-reads-using-qiime2-qiime1-9-and-usearch10/4970/14 "2018-08-13T01:24:51Z")

</div>

This topic was automatically closed 31 days after the last reply. New replies are no longer allowed.
