# Nanopore reads analysis using qiime2 **URL:** https://forum.qiime2.org/t/nanopore-reads-analysis-using-qiime2/11364 **Category:** General Discussion **Tags:** taxonomy, dada2, demux **Created:** [September 3, 2019, 7:08am UTC](https://forum.qiime2.org/t/nanopore-reads-analysis-using-qiime2/11364 "2019-09-03T07:08:19Z") **Posts on this page:** 20 **Page:** 1
### Author: ![uddalok06](https://forum.qiime2.org/letter_avatar_proxy/v4/letter/u/5f9b8f/32.png) [@uddalok06](https://forum.qiime2.org/u/uddalok06) #### Post date: [September 3, 2019, 7:08am UTC](https://forum.qiime2.org/t/nanopore-reads-analysis-using-qiime2/11364/1 "2019-09-03T07:08:19Z")
While using the manifest tutorial i got it alright till Alpha Beta diversity analysis. All went fine after importing and I was following the moving pictures tutorial to get an abundance plot but in the core metrics step the table.qza isn’t working and I tried to go on skipping it directly to alpha rarefaction plotting still same error persisted. I am using the manifest file as metadata as it was mentioned equivalent in the tutorial. I used sampling depth 1600+ as I am using full length 16s sequences, is that okay? after demux I used DADA2 for QC and I think afterwards there is some errors, although the process gave no error but I think it discarded a lot of my sequences as they're having lesser phred scores than illumina data (\<20). Let me know more about DADA2 and clustering steps. ![Screenshot%20from%202019-09-03%2011-59-41](https://forum-qiime2-org.s3.dualstack.us-west-2.amazonaws.com/original/2X/0/00f2c035edb5195b8aefaf802c8d9b603f9e2df0.png) [per-sample-fastq-counts.csv](https://forum.qiime2.org/uploads/short-url/l7JAoAgTcpfV49L7ynhoxCDLPP1.csv) (70 Bytes) ![Screenshot%20from%202019-09-03%2012-14-01](https://forum-qiime2-org.s3.dualstack.us-west-2.amazonaws.com/original/2X/9/995a4c225f650760c5f2bb438bd7fb1af60f8499.png) thanks, Uddalok ---
### Author: ![colinbrislawn](https://forum.qiime2.org/user_avatar/forum.qiime2.org/colinbrislawn/32/6221_2.png) [@colinbrislawn](https://forum.qiime2.org/u/colinbrislawn) #### Post date: [September 3, 2019, 1:40pm UTC](https://forum.qiime2.org/t/nanopore-reads-analysis-using-qiime2/11364/2 "2019-09-03T13:40:02Z")
Hello Uddalok, Thanks for posting! > [@uddalok06](#): > > I think it discarded a lot of my sequences as they’re having lesser phred scores than illumina data (\<20). I think you are right. Very few nanopore reads will have \>20 qscore, so performing the filtering again using a much lower number, like \>10, could help preserve more of your data. I also would like to know how many samples you have total? I see 4 total samples made it through filtering, so how many samples were removed by filtering? We should try to save these samples! Colin ---
### Author: ![MaestSi](https://forum.qiime2.org/user_avatar/forum.qiime2.org/maestsi/32/12152_2.png) [@MaestSi](https://forum.qiime2.org/u/MaestSi) #### Post date: [September 3, 2019, 4:02pm UTC](https://forum.qiime2.org/t/nanopore-reads-analysis-using-qiime2/11364/3 "2019-09-03T16:02:04Z")
Hi uddalok06, > [@uddalok06](#): > > I used sampling depth 1600+ as I am using full length 16s sequences, is that okay? The sampling depth is the minimum number of reads assigned to a sample for it to be included in the analysis; "sampling\_depth" reads are subsampled for each sample that survives this filtering, so it is not related with the length of the 16S sequences. > [@uddalok06](#): > > Let me know more about DADA2 and clustering steps. Personally, when dealing with nanopore reads, I directly Blast each read against a reference database. This is what is done by the "official" EPI2ME 16S workflow too. In fact, due to the high error rate, it is very difficult to cluster nanopore reads without setting a very low identity threshold; in the latter case, however, you would pool together in an OTU reads coming from very different organisms, losing a lot of information: that's the reason why most people avoid it. If you would like to analyse Nanopore reads in QIIME2 environment you might also be interested in having a look at [this](https://github.com/MaestSi/MetONTIIME). I am currently testing it, so each feedback or suggestion is welcome. ---
### Author: ![uddalok06](https://forum.qiime2.org/letter_avatar_proxy/v4/letter/u/5f9b8f/32.png) [@uddalok06](https://forum.qiime2.org/u/uddalok06) #### Post date: [September 4, 2019, 9:11am UTC](https://forum.qiime2.org/t/nanopore-reads-analysis-using-qiime2/11364/4 "2019-09-04T09:11:53Z")
Hello Simone, actually EPI2ME seems a total blackbox to me, like don't have any idea about the tools working in background. I am a bit confused with the sampling depth and sample frequency here. About MetONTIIME, I was checking this too after you reported in ONT community, I have a question, like do we need to go for guppy? if I want to proceed with already basecalled data, like lowering the OTU clustering to 90~85% identity and using SILVA, and how to train silva with qiime2? ---
### Author: ![MaestSi](https://forum.qiime2.org/user_avatar/forum.qiime2.org/maestsi/32/12152_2.png) [@MaestSi](https://forum.qiime2.org/u/MaestSi) #### Post date: [September 4, 2019, 9:48am UTC](https://forum.qiime2.org/t/nanopore-reads-analysis-using-qiime2/11364/5 "2019-09-04T09:48:26Z")
Hi! > [@uddalok06](#): > > actually EPI2ME seems a total blackbox to me, like don’t have any idea about the tools working in background On the ONT website you can find the description of each EPI2ME workflow, and of the underlying tools. The [16S workflow](https://community.nanoporetech.com/technical_documents/epi2me-tech-doc/v/metd_5000_v1_revap_29feb2016/16s-taxonomic-classificati) is reported to Blast each read against the [NCBI Bacterial 16S database](https://www.ncbi.nlm.nih.gov/bioproject?db=bioproject&Cmd=DetailsSearch&Term=33175%5Buid%5D), and Blast parameters are reported too. > [@uddalok06](#): > > do we need to go for guppy? The [MetONTIIME](https://github.com/MaestSi/MetONTIIME) pipeline is meant to be a fast5-to-taxonomy\_assignment solution, but if you already have basecalled and preprocessed your reads, then you could simply run: > cd MetONTIIME > nohup ./MetONTIIME.sh \ \ \ \ \ & Note that the fastq.gz demultiplexed files (one per sample) should be in \, that the \ does not have to be created before necessarily but can, and that the QIIME2 artifacts can be generated with the `Import_database.sh` script. > [@uddalok06](#): > > lowering the OTU clustering to 90~85% identity and using SILVA, and how to train silva with qiime2 This is something outside the scope of [MetONTIIME](https://github.com/MaestSi/MetONTIIME), that doesn't perform any OTU clustering. I hope I was clear enough, but feel free to ask any further clarifications. ---
### Author: ![uddalok06](https://forum.qiime2.org/letter_avatar_proxy/v4/letter/u/5f9b8f/32.png) [@uddalok06](https://forum.qiime2.org/u/uddalok06) #### Post date: [September 4, 2019, 1:13pm UTC](https://forum.qiime2.org/t/nanopore-reads-analysis-using-qiime2/11364/6 "2019-09-04T13:13:50Z")
@MaestSi Thanks for the EPI2ME information. About the MetONTIIME I tried the silva.fasta and with import\_database.sh it generated the qiime artifact silva\_sequence.qza but the \*\_taxonomy.qza wasn't obtained, it showed \*\_accession\_taxonomy.txt was missing. attaching the screenshot. Thanks for the discussion, uddalok ![Screenshot%20from%202019-09-04%2017-23-08](https://forum-qiime2-org.s3.dualstack.us-west-2.amazonaws.com/original/2X/1/1f8d11027934ebc5a8e843b51f19b26ec0ef655b.png) ---
### Author: ![MaestSi](https://forum.qiime2.org/user_avatar/forum.qiime2.org/maestsi/32/12152_2.png) [@MaestSi](https://forum.qiime2.org/u/MaestSi) #### Post date: [September 4, 2019, 2:12pm UTC](https://forum.qiime2.org/t/nanopore-reads-analysis-using-qiime2/11364/7 "2019-09-04T14:12:00Z")
Hi, Import\_database.sh is not working in this case because it is intended to work only with fasta sequences downloaded from the NCBI website. Only in the latter case it is able to retrieve automatically the associated taxonomy file. However, for Silva and for another few [databases](https://docs.qiime2.org/2019.7/data-resources/), a set of QIIME2-preformatted files exist, that can be easily imported as QIIME2 artifacts. For example, if you want to import Silva database clustered at 99% identity, these are the instructions that you can use: ``` source activate qiime2-2019.7 wget https://www.arb-silva.de/fileadmin/silva_databases/qiime/Silva_132_release.zip unzip Silva_132_release.zip qiime tools import \ --type FeatureData[Sequence] \ --input-path SILVA_132_QIIME_release/rep_set/rep_set_16S_only/99/silva_132_99_16S.fna \ --output-path silva_132_99_16S_sequence.qza qiime tools import \ --type FeatureData[Taxonomy] \ --input-path SILVA_132_QIIME_release/taxonomy/16S_only/99/taxonomy_7_levels.txt \ --input-format HeaderlessTSVTaxonomyFormat \ --output-path silva_132_99_16S_taxonomy.qza ``` At this point, you will have silva\_132\_99\_16S\_sequence.qza and silva\_132\_99\_16S\_taxonomy.qza QIIME2 artifacts, containing sequences and their taxonomy respectively. ---
### Author: ![uddalok06](https://forum.qiime2.org/letter_avatar_proxy/v4/letter/u/5f9b8f/32.png) [@uddalok06](https://forum.qiime2.org/u/uddalok06) #### Post date: [September 6, 2019, 7:23am UTC](https://forum.qiime2.org/t/nanopore-reads-analysis-using-qiime2/11364/8 "2019-09-06T07:23:09Z")
I obtained the silva\_132\_99\_16S\_sequence.qza and silva\_132\_99\_16S\_taxonomy.qza afterwards ran the Launch\_MinION\_mobile\_lab.sh, I think basecalling was fine and demultiplexing was okay and PycoQC report was obtained too. but next Porechop trimming started and it kinda failed or something wrong happened at BC02. I am attaching the logfile can you suggest based on that? From previous exploration of same data through EPI2ME all I know is BC02 had very less read counts arround 4k+ while BC01~77k, BC03~93k, BC04~14k. I also ran the MetONTIIME.sh as per you said and manifest.txt(just mainfest format like sample-id absolute-filepath was written on it) and species\_counts.txt was obtained as blank files. So I checked the nohup.out file I think it may got stuck in parsing further qiime2 commands, sharing the screenshot. Thanks, Uddalok ![Screenshot%20from%202019-09-06%2011-08-45](https://forum-qiime2-org.s3.dualstack.us-west-2.amazonaws.com/original/2X/a/ac11fef1dce8fc4243e2f310d9404d066c03920f.png) [logfile.txt](https://forum.qiime2.org/uploads/short-url/pDgNdtQk3tUlsIUiecInWSHR6Qi.txt) (1.4 KB) ---
### Author: ![MaestSi](https://forum.qiime2.org/user_avatar/forum.qiime2.org/maestsi/32/12152_2.png) [@MaestSi](https://forum.qiime2.org/u/MaestSi) #### Post date: [September 6, 2019, 7:37am UTC](https://forum.qiime2.org/t/nanopore-reads-analysis-using-qiime2/11364/9 "2019-09-06T07:37:05Z")
Hi! Yes, it failed because none of the reads from BC02 survived the demultiplexing and the read-length filtering. The only thing you can do is to exclude BC02 in the config\_MinION\_mobile\_lab.R file. Let me know what happens. Maybe, if something is still not working it is better if you open an issue in the GitHub page. Remember to delete /home/dranil/Desktop/fast5\_pass\_analysis directory first. Moreover, if you only included BC01, BC02, BC03 and BC04 samples, you should remove samples from BC05 to BC12 (and BC02) from the config\_MinION\_mobile\_lab.R file. Thanks ---
### Author: ![uddalok06](https://forum.qiime2.org/letter_avatar_proxy/v4/letter/u/5f9b8f/32.png) [@uddalok06](https://forum.qiime2.org/u/uddalok06) #### Post date: [September 7, 2019, 4:47am UTC](https://forum.qiime2.org/t/nanopore-reads-analysis-using-qiime2/11364/10 "2019-09-07T04:47:06Z")
@MaestSi I tried modifying the config\_MinION\_mobile\_lab.R file, MetONTIIME seems to have error in using qiime2 as generated manifest file isn't okay to proceed then there are multistep error as I checked the nohup.out. I have already gone through some basic qiime2 tutorials so can you tell me steps (like pick it from the moving pictures tutorial) I need to pick for my Nanopore data analysis, I will be manually doing it then. Thanks ---
### Author: ![MaestSi](https://forum.qiime2.org/user_avatar/forum.qiime2.org/maestsi/32/12152_2.png) [@MaestSi](https://forum.qiime2.org/u/MaestSi) #### Post date: [September 7, 2019, 5:11am UTC](https://forum.qiime2.org/t/nanopore-reads-analysis-using-qiime2/11364/11 "2019-09-07T05:11:30Z")
Could you please share the generated manifest file, the sample-metadata file, the logfile.txt and the config\_MinION\_mobile\_lab.R? > [@uddalok06](#): > > generated manifest file isn’t okay to proceed This looks strange to me, it used to work with my own data. Also, the first error in the nohup.out file would help. Thanks ---
### Author: ![uddalok06](https://forum.qiime2.org/letter_avatar_proxy/v4/letter/u/5f9b8f/32.png) [@uddalok06](https://forum.qiime2.org/u/uddalok06) #### Post date: [September 7, 2019, 5:57am UTC](https://forum.qiime2.org/t/nanopore-reads-analysis-using-qiime2/11364/12 "2019-09-07T05:57:47Z")
well I didn't provide the metadata file as there was option for automatic creation. Still attaching the one I created while going through MVP\_tutorial.[config\_MinION\_mobile\_lab.R.gz](https://forum.qiime2.org/uploads/short-url/mi2XNfFBcrYwi3ViEKNItkge9Jq.gz) (1.7 KB) [logfile.txt.gz](https://forum.qiime2.org/uploads/short-url/dbj6onzOVXuzvbaqdYVqE2G5g87.gz) (667 Bytes) [manifest.txt.gz](https://forum.qiime2.org/uploads/short-url/vcTPO1Z9PXLvQ3KfDocjvHNVIpQ.gz) (61 Bytes) [qiime2\_fastq\_manifest.csv.gz](https://forum.qiime2.org/uploads/short-url/pup2wNBLrRJk4OvMNSAj4yUh8F3.gz) (139 Bytes) ---
### Author: ![MaestSi](https://forum.qiime2.org/user_avatar/forum.qiime2.org/maestsi/32/12152_2.png) [@MaestSi](https://forum.qiime2.org/u/MaestSi) #### Post date: [September 7, 2019, 10:01am UTC](https://forum.qiime2.org/t/nanopore-reads-analysis-using-qiime2/11364/13 "2019-09-07T10:01:41Z")
I'll look into it further tomorrow, but I saw that you did not specify the path to the sample-metadata file. You should specify one path and one file on your computer. The file might not exist yet, but the path should. I'll let you know something more. ---
### Author: ![uddalok06](https://forum.qiime2.org/letter_avatar_proxy/v4/letter/u/5f9b8f/32.png) [@uddalok06](https://forum.qiime2.org/u/uddalok06) #### Post date: [September 7, 2019, 10:04am UTC](https://forum.qiime2.org/t/nanopore-reads-analysis-using-qiime2/11364/14 "2019-09-07T10:04:11Z")
Okay and the MetONTIIME.sh I am trying with that but there also errors but that might be the qiime command run and path issue I am going through those and I will let you know. Thanks 🙂 ---
### Author: ![MaestSi](https://forum.qiime2.org/user_avatar/forum.qiime2.org/maestsi/32/12152_2.png) [@MaestSi](https://forum.qiime2.org/u/MaestSi) #### Post date: [September 8, 2019, 9:39am UTC](https://forum.qiime2.org/t/nanopore-reads-analysis-using-qiime2/11364/15 "2019-09-08T09:39:06Z")
Hi, I did some further checks. First of all, can you confirm that you are working with a Linux distribution? I tested it with Ubuntu 14.04. As for the errors you had, my guess is that Porechop is not recognising the barcodes you used; however this looks strange to me, since I tried with SQK-RAB204 too and Porechop worked as expected. For example, in my logfile, for sample BC04 I had: > Now trimming adapters with Porechop for sample BC04 > Mean read length (stdev) for sample BC04: 1373 (55) > Now filtering out reads shorter than 1250 and longer than 1550 bp for sample BC04 > Mean read length for sample BC04 after filtering: 1373 (40) while for your three samples you have: > Now trimming adapters with Porechop for sample BC01 > Now trimming adapters with Porechop for sample BC03 > Now trimming adapters with Porechop for sample BC04 This probably means that the read length filtering for all your samples was skipped since Porechop did not assign any reads to them. To confirm this, you should look if files: > /home/dranil/Desktop/fast5\_pass\_analysis/preprocessing/BC01\_porechop\_dir\_tmp/BC01.fastq > /home/dranil/Desktop/fast5\_pass\_analysis/preprocessing/BC03\_porechop\_dir\_tmp/BC03.fastq > /home/dranil/Desktop/fast5\_pass\_analysis/preprocessing/BC04\_porechop\_dir\_tmp/BC04.fastq exist or not. If they don't, it means that there were some errors with Porechop. Another difference I recognised is that you are working with Anaconda instead of Miniconda, but I am not sure if it should make any difference or not. I tested it with Miniconda only. ---
### Author: ![MaestSi](https://forum.qiime2.org/user_avatar/forum.qiime2.org/maestsi/32/12152_2.png) [@MaestSi](https://forum.qiime2.org/u/MaestSi) #### Post date: [September 8, 2019, 6:00pm UTC](https://forum.qiime2.org/t/nanopore-reads-analysis-using-qiime2/11364/16 "2019-09-08T18:00:42Z")
Hi, I just uploaded [here](https://github.com/MaestSi/MetONTIIME/blob/master/Test_BC04_FLO-FLG001_SQK-RAB204.zip) 1000 raw fast5 reads for testing purposes. The kit used is the same you are using (SQK-RAB204), flow-cell is FLO-FLG001 (Flongle) and sample ID is BC04. If you want, try running the pipeline with this dataset after unzipping it, so that we can understand if it is an installation or a data-related issue. ---
### Author: ![uddalok06](https://forum.qiime2.org/letter_avatar_proxy/v4/letter/u/5f9b8f/32.png) [@uddalok06](https://forum.qiime2.org/u/uddalok06) #### Post date: [September 9, 2019, 11:38am UTC](https://forum.qiime2.org/t/nanopore-reads-analysis-using-qiime2/11364/17 "2019-09-09T11:38:40Z")
Hi, Thanks for the discussion but it seems very odd as I don't have BC0\*.fastq in the temp directory of preprocessing hence I thought I have some issues with Porechop but the Fast5 files you gave it ran perfectly and I do have the results. I checked the log file it suggests I may have some issues with Porechop but then how can it run with your file (the only significant change is you have only BC04 and I have mulrtiple. Let me know about it. ---
### Author: ![MaestSi](https://forum.qiime2.org/user_avatar/forum.qiime2.org/maestsi/32/12152_2.png) [@MaestSi](https://forum.qiime2.org/u/MaestSi) #### Post date: [September 9, 2019, 12:06pm UTC](https://forum.qiime2.org/t/nanopore-reads-analysis-using-qiime2/11364/18 "2019-09-09T12:06:42Z")
I really don't know, it might be that porechop is not recognising your adapters, but I don't know how it could be like that. I think you are using some of the the 12x barcoded primer pairs included in the SQK-RAB204 kit, aren't you? Anyways, if you manage to get demultiplexed and trimmed fastqs in some way, you can compress each file with gzip and then, after saving the BC\*.fastq.gz files to dir \ you can run the following. > cd MetONTIIME > nohup ./MetONTIIME.sh \ \ \ \ \ & Note that the metadata file might not exist yet, and in that case it will be created exactly were you specify with \ input argument. Let me know if you manage to get some results. ---
### Author: ![uddalok06](https://forum.qiime2.org/letter_avatar_proxy/v4/letter/u/5f9b8f/32.png) [@uddalok06](https://forum.qiime2.org/u/uddalok06) #### Post date: [September 9, 2019, 12:09pm UTC](https://forum.qiime2.org/t/nanopore-reads-analysis-using-qiime2/11364/19 "2019-09-09T12:09:14Z")
I am using the Fast5\_pass directory so multiple Fast5 files are there is that an issue? ---
### Author: ![MaestSi](https://forum.qiime2.org/user_avatar/forum.qiime2.org/maestsi/32/12152_2.png) [@MaestSi](https://forum.qiime2.org/u/MaestSi) #### Post date: [September 9, 2019, 12:10pm UTC](https://forum.qiime2.org/t/nanopore-reads-analysis-using-qiime2/11364/20 "2019-09-09T12:10:26Z")
No, it is not. I ran the pipeline on the full dataset with many multi-fast5 too. If you want, you can share the nohup.out file with porechop errors, but I doubt I might be able to find out why Porechop is failing, if you are not using different primers/tags than those included in the SQK-RAB204 kit. [Next page](https://forum.qiime2.org/t/nanopore-reads-analysis-using-qiime2/11364.md?page=2)