# ITS classification - nothing beyond phylum level

**URL:** <https://forum.qiime2.org/t/its-classification-nothing-beyond-phylum-level/15022>\
**Category:** User Support\
**Tags:** feature-classifier, its, fungi, unite, taxonomy\
**Created:** [May 19, 2020, 11:59pm UTC](https://forum.qiime2.org/t/its-classification-nothing-beyond-phylum-level/15022 "2020-05-19T23:59:55Z")\
**Posts on this page:** 8\
**Page:** 1

<div class="post-metadata">

**Author:** ![spongebob](https://forum.qiime2.org/letter_avatar_proxy/v4/letter/s/90db22/32.png) [@spongebob](https://forum.qiime2.org/u/spongebob)\
**Post date:** [May 19, 2020, 11:59pm UTC](https://forum.qiime2.org/t/its-classification-nothing-beyond-phylum-level/15022/1 "2020-05-19T23:59:55Z")

</div>

Hi there,

I recently migrated over to qiime2 from mothur. I am processing the same ITS sequence data, that i did with mothur and i am using the same UNITE database for ITS classification. When i used the mothur pipeline i get good family and genus level resolution, however using qiime2 \>90% of the sequences are not classified beyond "kingdom; fungi". I am a bit puzzled and wonder if i have done something incorrect along the the way. I have posted by command log below. Wondering if anyone can help me see where i have gone wrong?

**I am using qiime2-2019.10, installed through conda on ubuntu.**

**qiime tools import**  
--type 'SampleData[PairedEndSequencesWithQuality]'  
--input-path //path\_to\_file/samples.txt  
--input-format PairedEndFastqManifestPhred33V2  
--output-path /path\_to\_file\_output/samples\_demux-paired-end.qza

**qiime demux summarize**  
--i-data samples\_demux-paired-end.qza  
--o-visualization samples\_demux.qzv

**qiime cutadapt trim-paired**  
--i-demultiplexed-sequences samples\_demux-paired-end.qza   
--p-cores 2   
--p-front-f GAACGCAGCRAANNGYGA   
--p-front-r TCCTCCGCTTATTGATATGC   
--p-adapter-r TCRCNNTTYGCTGCGTTC   
--p-adapter-f GCATATCAATAAGCGGAGGA   
--o-trimmed-sequences samples\_demux-paired-end\_PT.qza   
--verbose \

**qiime demux summarize**  
--i-data samples\_demux-paired-end\_PT.qza  
--o-visualization samples\_demux-paired-end\_PT.qzv

**DENOISE WITH DADA2 - did not trim as ITS**  
qiime dada2 denoise-paired  
--i-demultiplexed-seqs samples\_demux-paired-end\_PT.qza  
--p-trunc-len-f 0  
--p-trunc-len-r 0  
--p-max-ee-f 2  
--p-max-ee-r 2  
--p-n-threads 2  
--o-table samples\_demux-paired-end\_PT\_table-dada2.qza  
--o-representative-sequences samples\_demux-paired-end\_PT\_rep-seqs-dada2.qza  
--o-denoising-stats samples\_demux-paired-end\_PT\_denoising-stats.qza

**qiime metadata tabulate**  
--m-input-file samples\_demux-paired-end\_PT\_denoising-stats.qza  
--o-visualization samples\_demux-paired-end\_PT\_denoising-stats.qzv

**REMOVE SINGLETONS FROM TABLE**  
qiime feature-table filter-features  
--i-table samples\_demux-paired-end\_PT\_table-dada2.qza  
--p-min-frequency 2  
--o-filtered-table samples\_demux-paired-end\_PT\_table-dada2\_single.qza

**REMOVE SINGLETONS FROM SEQUENCE FILE**  
qiime feature-table filter-seqs  
--i-data samples\_demux-paired-end\_PT\_rep-seqs-dada2.qza  
--i-table samples\_demux-paired-end\_PT\_table-dada2\_single.qza  
--o-filtered-data samples\_demux-paired-end\_PT\_rep-seqs-dada2\_single.qza

**qiime feature-table summarize**  
--i-table samples\_demux-paired-end\_PT\_table-dada2\_single.qza  
--o-visualization samples\_demux-paired-end\_PT\_table-dada2\_single.qzv

**qiime feature-table tabulate-seqs**  
--i-data samples\_demux-paired-end\_PT\_rep-seqs-dada2\_single.qza  
--o-visualization samples\_demux-paired-end\_PT\_rep-seqs-dada2\_single.qzv

make UNITE database following [https://github.com/gregcaporaso/2017.06.23-q2-fungal-tutorial:](https://github.com/gregcaporaso/2017.06.23-q2-fungal-tutorial:)

> **[PlutoF DOI](https://doi.plutof.ut.ee/doi/10.15156/BIO/786334)**
>
> PlutoF DOI

Includes singletons set as RefS (in dynamic files).  
sh\_refs\_qiime\_ver8\_dynamic\_s\_02.02.2019.fasta  
sh\_taxonomy\_qiime\_ver8\_dynamic\_s\_02.02.2019.txt

\*_qiime tools import \*_  
--type FeatureData[Sequence]  
--input-path sh\_refs\_qiime\_ver8\_dynamic\_s\_02.02.2019.fasta  
--output-path UNITE\_seqs\_v8\_dynamic\_02022019.qza  
Imported sh\_refs\_qiime\_ver8\_dynamic\_s\_02.02.2019.fasta as DNASequencesDirectoryFormat to UNITE\_seqs\_v8\_dynamic\_02022019.qza

**qiime tools import**  
--type FeatureData[Taxonomy]  
--input-format HeaderlessTSVTaxonomyFormat  
--input-path sh\_taxonomy\_qiime\_ver8\_dynamic\_s\_02.02.2019.txt  
--output-path UNITE\_tax\_v8\_dynamic\_02022019.qza

Imported sh\_taxonomy\_qiime\_ver8\_dynamic\_s\_02.02.2019.txt as HeaderlessTSVTaxonomyFormat to UNITE\_tax\_v8\_dynamic\_02022019.qza

**Train the classifier on this region**  
qiime feature-classifier fit-classifier-naive-bayes  
--i-reference-reads UNITE\_seqs\_v8\_dynamic\_02022019.qza  
--i-reference-taxonomy UNITE\_tax\_v8\_dynamic\_02022019.qza  
--o-classifier classifier\_UNITE\_v8.qza  
--verbose

UserWarning: The TaxonomicClassifier artifact that results from this method was trained using scikit-learn version 0.21.2. It cannot be used with other versions of scikit-learn. (While the classifier may complete successfully, the results will be unreliable.)  
warnings.warn(warning, UserWarning)  
Saved TaxonomicClassifier to: classifier\_UNITE\_v8.qza

**Classify reads by taxon using a fitted classifier**  
qiime feature-classifier classify-sklearn  
--i-classifier /path\_to\_database/qimme2\_databases/UNITE/UNITEv8\_DynamicClassifier/dynamic/classifier\_UNITE\_v8.qza  
--i-reads samples\_demux-paired-end\_PT\_rep-seqs-dada2\_single.qza  
--o-classification samples\_demux-paired-end\_PT\_rep-seqs-dada2\_single\_classification.qza

**qiime metadata tabulate**  
--m-input-file samples\_demux-paired-end\_PT\_rep-seqs-dada2\_single\_classification.qza   
--o-visualization samples\_demux-paired-end\_PT\_rep-seqs-dada2\_single\_classification\_taxonomy.qzv

**I also tried to classify the samples using**

1. qiime feature-classifier classify-consensus-vsearch as suggested on the forum.
2. using the developer version of UNITE as suggested on the forum.

But the results were still unclassified.

Thanks for any help

---

<div class="post-metadata">

**Author:** ![Nicholas\_Bokulich](https://forum.qiime2.org/user_avatar/forum.qiime2.org/nicholas_bokulich/32/19937_2.png) [@Nicholas\_Bokulich](https://forum.qiime2.org/u/Nicholas_Bokulich)\
**Post date:** [May 20, 2020, 3:19am UTC](https://forum.qiime2.org/t/its-classification-nothing-beyond-phylum-level/15022/2 "2020-05-20T03:19:40Z")

</div>

Welcome @spongebob !

What a puzzling problem! The fact that classify-consensus-vsearch is also failing is a pretty good indicator that _something_ has gone seriously wrong.

A few things could be at fault, but it sounds like it's probably an issue with the query sequences themselves. Could you walk through the following to troubleshoot? Stop once you find the problem.

1. This is a better tutorial to work from: [Fungal ITS analysis tutorial](https://forum.qiime2.org/t/fungal-its-analysis-tutorial/7351)
2. that tutorial (and the older one you linked to) both use mock community data as a toy dataset... want to try classifying the mock community data with your classifier? If you get the same issue, we know it's a classifier issue. If it works, then we know that your data are at fault!
3. try NCBI BLASTing a few to see what you hit (e.g., if you hit non-fungal sequences that's a clear answer. Most ITS primers also hit plants and other euks, so maybe it's just non-target? That should be unclassified or classified at kingdom level since such seqs are not in the UNITE db)

If those steps don't shake out the issue, could you please share all of the QZVs that you listed above? Then I can work backwards through them to see if I spot any clues... you can share via DM if you don't want these posted publicly here.

Let me know what you find!

---

<div class="post-metadata">

**Author:** ![spongebob](https://forum.qiime2.org/letter_avatar_proxy/v4/letter/s/90db22/32.png) [@spongebob](https://forum.qiime2.org/u/spongebob)\
**Post date:** [May 22, 2020, 1:44am UTC](https://forum.qiime2.org/t/its-classification-nothing-beyond-phylum-level/15022/3 "2020-05-22T01:44:18Z")

</div>

Thanks for the response. I have tried as you suggested and here are the results:

1. I tried using my classifer with the mock community and the results are the same. So not a classifier problem.

2. I did blast some of the representative sequences and many were not fungal. Looking back at my mothur log i used "remove.lineage" so i only retained the fungal sequences. Would it make sense to use the UNITE database version called "All eukaryotes" ([PlutoF DOI](https://doi.org/10.15156/BIO/786386)) to re-classify my data? Then is it possible to remove the non fugal sequences from analysis?

Thanks again for your helpful suggestions.

---

<div class="post-metadata">

**Author:** ![Nicholas\_Bokulich](https://forum.qiime2.org/user_avatar/forum.qiime2.org/nicholas_bokulich/32/19937_2.png) [@Nicholas\_Bokulich](https://forum.qiime2.org/u/Nicholas_Bokulich)\
**Post date:** [May 22, 2020, 2:54am UTC](https://forum.qiime2.org/t/its-classification-nothing-beyond-phylum-level/15022/4 "2020-05-22T02:54:07Z")

</div>

> [@spongebob](#):
>
> I did blast some of the representative sequences and many were not fungal. Looking back at my mothur log i used “remove.lineage” so i only retained the fungal sequences.

That would explain the issue! A few options:

> [@spongebob](#):
>
> 1. Would it make sense to use the UNITE database version called “All eukaryotes” ([PlutoF DOI](https://doi.org/10.15156/BIO/786386)) to re-classify my data? Then is it possible to remove the non fugal sequences from analysis?

Yes that is certainly one option. The disadvantage is that including all eukaryote sequences would make a much larger and slower classifier, when you presumably don't care what the other euks are, you just want to get rid of them. If you know what non-fungal reads you expect to find, you could just selectively add those to your database to provide an "outgroup" for identifying those non-fungal reads.

Option 2 is to just take the data you have now and filter out all unclassified/phylum only sequences with `qiime taxa filter-table`. The advantage is that you don't need to re-classify again, the disadvantage is that you are assuming that these indeed represent non-fungal seqs.

Option 3 is to use `qiime quality-control exclude-seqs` to filter out sequences that do not align against the UNITE fungal ITS database. The advantage is that you are explicitly filtering out anything that does not hit within a specified % identity, the disadvantage is that it adds more time.

I'd personally try option 2, see what I'm left with, and then maybe move onto option 3 if I'm still harboring some doubts.

---

<div class="post-metadata">

**Author:** ![spongebob](https://forum.qiime2.org/letter_avatar_proxy/v4/letter/s/90db22/32.png) [@spongebob](https://forum.qiime2.org/u/spongebob)\
**Post date:** [May 25, 2020, 7:54pm UTC](https://forum.qiime2.org/t/its-classification-nothing-beyond-phylum-level/15022/5 "2020-05-25T19:54:39Z")

</div>

Has anyone else had issues getting the "all euks" UNITE databases from Pluto?

If you try to access the databases below you don't end up downloaded anything.

> **[PlutoF Biodiversity Platform](https://plutof.ut.ee/#/doi/10.15156/BIO/786388)**
>
> Biological data workbench PlutoF

> **[PlutoF Biodiversity Platform](https://plutof.ut.ee/#/doi/10.15156/BIO/786386)**
>
> Biological data workbench PlutoF

I have emailed them but no response......thoughts?

---

<div class="post-metadata">

**Author:** ![Nicholas\_Bokulich](https://forum.qiime2.org/user_avatar/forum.qiime2.org/nicholas_bokulich/32/19937_2.png) [@Nicholas\_Bokulich](https://forum.qiime2.org/u/Nicholas_Bokulich)\
**Post date:** [May 25, 2020, 7:56pm UTC](https://forum.qiime2.org/t/its-classification-nothing-beyond-phylum-level/15022/6 "2020-05-25T19:56:17Z")

</div>

You need to click on the "media" tab to get the file download link. So e.g., this is probably what you are looking for:  
[https://files.plutof.ut.ee/public/orig/99/D0/99D026A5A6EE65E6F8D736A1B02BB18D44724F8BAD7B103D6CB14FC09BFD20A8.gz](https://files.plutof.ut.ee/public/orig/99/D0/99D026A5A6EE65E6F8D736A1B02BB18D44724F8BAD7B103D6CB14FC09BFD20A8.gz)

---

<div class="post-metadata">

**Author:** ![spongebob](https://forum.qiime2.org/letter_avatar_proxy/v4/letter/s/90db22/32.png) [@spongebob](https://forum.qiime2.org/u/spongebob)\
**Post date:** [June 6, 2020, 2:20am UTC](https://forum.qiime2.org/t/its-classification-nothing-beyond-phylum-level/15022/7 "2020-06-06T02:20:16Z")

</div>

seemed to be a browser issue! thanks

---

<div class="post-metadata">

**Author:** ![system](https://forum-qiime2-org.s3.dualstack.us-west-2.amazonaws.com/original/3X/2/1/21af5fe23cb6f4579467c66a9ed94e55274ca7bd.svg) [@system](https://forum.qiime2.org/u/system)\
**Post date:** [July 7, 2020, 8:28am UTC](https://forum.qiime2.org/t/its-classification-nothing-beyond-phylum-level/15022/8 "2020-07-07T08:28:55Z")

</div>

This topic was automatically closed 31 days after the last reply. New replies are no longer allowed.
