Hi! I'm trying to import my data, but I'm not sure where I've gone wrong. I have this error after 5 hours of running the command:
Blockquote Plugin error from deblur:
Blockquote Duplicate sample IDs!
Blockquote Debug info has been saved to /var/folders/yg/wtspl3kd78z1mymc99k3zkl00000gp/T/qiime2-q2cli-err-pi766zjc.log
Here are the commands I have used that have run OK until the last command:
qiime tools import
--type 'SampleData[PairedEndSequencesWithQuality]'
--input-path fastq_manifest_16S_sarah.txt
--output-path 16S-demux.qza
--input-format PairedEndFastqManifestPhred33
I've opened the demux files (both filtered and unfiltered) and downloaded the .csv for the sample names and double checked for duplicates and there weren't any. Here are the relevant files:
could you please post the full error message? (re-run with the --verbose flag, or open the log file where debug info has been saved)
It sounds like you are possibly running an outdated version of deblur that could not handle sample IDs with underscores in the names, as described here:
If that is the case, just install the latest version of QIIME 2 and your problems should dissolve away!
I'm currently re-running with --verbose as you've said, but here is the file with all the debug info copied and pasted into a text document (as I can't upload .log files): deblur_log.txt (199.2 KB)
Is the worst case scenario just me changing all the underscores to dashes?
Thanks for all your help!
Update: I've tried denoising my data with DADA2, and it's worked. I think it did take a bit less time than deblur. I still came back with the same error for the deblur run though.
Yes, it looks like that is the solution here if you want to use deblur.
I was mistaken about that bug having been fixed in more recent releases; I did a little more digging, and it looks like underscores in sample ids are still not supported in q2-deblur. This is specific to q2-deblur; you can use q2-dada2 and other plugins in QIIME 2 without an issue (as you found) if your sample ids contain underscores.