dada2 denoise-paired R

User Support
1

Hello everyone!

I am a predoctoral student and I am using QIIME2 to analyze results. I have been used qiime2 without any problem until I used another dataset. The data is formed by 12 paired-end sequences with were previously demultiplexed. I imported then with

«qiime tools import » command with the flags --type as 'SampleData[PairedEndSequencesWithQuality]' and the --input-format with Casava paired end option. The import didn't show problems.

However, when I tried to run the «qiime dada2 denoise-paired» command (that I had used before without any problems),

qiime dada2 denoise-paired --i-demultiplexed-seqs demux-16sdic2019.qza --p-trunc-len-f 215 --p-trunc-len-r 215 --o-table table16sdic2019.qza --o-representative-sequences reps-seq-16sdic2019.qza --o-denoising-stats denoising-stats.qza --verbose

The shell showed the next message:

Running external command line application(s). This may print messages to stdout and/or stderr.
The command(s) being run are below. These commands cannot be manually re-run as they will depend on temporary files that no longer exist.

Command: run_dada_paired.R /tmp/tmpxg8hi8t5/forward /tmp/tmpxg8hi8t5/reverse /tmp/tmpxg8hi8t5/output.tsv.biom /tmp/tmpxg8hi8t5/track.tsv /tmp/tmpxg8hi8t5/filt_f /tmp/tmpxg8hi8t5/filt_r 215 215 0 0 2.0 2.0 2 12 independent consensus 1.0 1 1000000

R version 4.0.3 (2020-10-10)
Loading required package: Rcpp
DADA2: 1.18.0 / Rcpp: 1.0.6 / RcppParallel: 5.1.4

  1. Filtering Error in validObject(.Object) :
    invalid class “SRFilterResult” object: superclass "Mnumeric" not defined in the environment of the object's class
    Ejecución interrumpida
    Traceback (most recent call last):
    File "/home/elsa/miniconda3/envs/qiime2-2021.4/lib/python3.8/site-packages/q2_dada2/_denoise.py", line 266, in denoise_paired
    run_commands([cmd])
    File "/home/elsa/miniconda3/envs/qiime2-2021.4/lib/python3.8/site-packages/q2_dada2/_denoise.py", line 36, in run_commands
    subprocess.run(cmd, check=True)
    File "/home/elsa/miniconda3/envs/qiime2-2021.4/lib/python3.8/subprocess.py", line 516, in run
    raise CalledProcessError(retcode, process.args,
    subprocess.CalledProcessError: Command '['run_dada_paired.R', '/tmp/tmpxg8hi8t5/forward', '/tmp/tmpxg8hi8t5/reverse', '/tmp/tmpxg8hi8t5/output.tsv.biom', '/tmp/tmpxg8hi8t5/track.tsv', '/tmp/tmpxg8hi8t5/filt_f', '/tmp/tmpxg8hi8t5/filt_r', '215', '215', '0', '0', '2.0', '2.0', '2', '12', 'independent', 'consensus', '1.0', '1', '1000000']' returned non-zero exit status 1.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/home/elsa/miniconda3/envs/qiime2-2021.4/lib/python3.8/site-packages/q2cli/commands.py", line 329, in call
results = action(**arguments)
File "", line 2, in denoise_paired
File "/home/elsa/miniconda3/envs/qiime2-2021.4/lib/python3.8/site-packages/qiime2/sdk/action.py", line 244, in bound_callable
outputs = self.callable_executor(scope, callable_args,
File "/home/elsa/miniconda3/envs/qiime2-2021.4/lib/python3.8/site-packages/qiime2/sdk/action.py", line 390, in callable_executor
output_views = self._callable(**view_args)
File "/home/elsa/miniconda3/envs/qiime2-2021.4/lib/python3.8/site-packages/q2_dada2/_denoise.py", line 279, in denoise_paired
raise Exception("An error was encountered while running DADA2"
Exception: An error was encountered while running DADA2 in R (return code 1), please inspect stdout and stderr to learn more.

Anyone knows how can I resolve it? I have installed RESCRIPT library, but I didn't change anything else. I also looked for other solutions in the forum (because Casava is really specific about file's format name), but any of them worked.

Thank you so much for your help!

Elsa

2

Hi there @elsamdea!

This is a very rare error, we've only seen it here once or twice before. I don't have any immediate advice, but it would be helpful to us if you confirmed some information about your QIIME 2 env. Can you please activate the conda environment that produced the failing command above, then run the following, and copy-and-paste the complete results:

conda list '^r-matrix$'

After that command, please run the following (also in the active QIIME 2 conda env):

conda list --revisions

Thanks!

2 Likes
3

Hi @thermokarst!

Thank you so much for you quick reply!

When I run the first command you wrote:

conda list '^r-matrix

The results are:

packages in environment at /home/elsa/miniconda3/envs/qiime2-2021.4:

Name Version Build Channel

r-matrix 1.3_2 r40he454529_0 conda-forge

And with the second one:

conda list --revisions
2021-06-05 13:21:45 (rev 0)
+_libgcc_mutex-0.1 (conda-forge/linux-64)
+_openmp_mutex-4.5 (conda-forge/linux-64)
+_r-mutex-1.0.1 (conda-forge/noarch)
+alsa-lib-1.2.3 (conda-forge/linux-64)
+argon2-cffi-20.1.0 (conda-forge/linux-64)
+async_generator-1.10 (conda-forge/noarch)
+attrs-20.3.0 (conda-forge/noarch)
+backcall-0.2.0 (conda-forge/noarch)
+backports-1.0 (conda-forge/noarch)
+backports.functools_lru_cache-1.6.4 (conda-forge/noarch)
+bibtexparser-1.1.0 (conda-forge/noarch)
+binutils_impl_linux-64-2.35.1 (conda-forge/linux-64)
+binutils_linux-64-2.35 (conda-forge/linux-64)
+bioconductor-biobase-2.50.0 (bioconda/linux-64)
+bioconductor-biocgenerics-0.36.0 (bioconda/noarch)
+bioconductor-biocparallel-1.24.1 (bioconda/linux-64)
+bioconductor-biostrings-2.58.0 (bioconda/linux-64)
+bioconductor-dada2-1.18.0 (bioconda/linux-64)
+bioconductor-delayedarray-0.16.3 (bioconda/linux-64)
+bioconductor-genomeinfodb-1.26.4 (bioconda/noarch)
+bioconductor-genomeinfodbdata-1.2.4 (bioconda/noarch)
+bioconductor-genomicalignments-1.26.0 (bioconda/linux-64)
+bioconductor-genomicranges-1.42.0 (bioconda/linux-64)
+bioconductor-iranges-2.24.1 (bioconda/linux-64)
+bioconductor-matrixgenerics-1.2.1 (bioconda/noarch)
+bioconductor-rhtslib-1.22.0 (bioconda/linux-64)
+bioconductor-rsamtools-2.6.0 (bioconda/linux-64)
+bioconductor-s4vectors-0.28.1 (bioconda/linux-64)
+bioconductor-shortread-1.48.0 (bioconda/linux-64)
+bioconductor-summarizedexperiment-1.20.0 (bioconda/noarch)
+bioconductor-xvector-0.30.0 (bioconda/linux-64)
+bioconductor-zlibbioc-1.36.0 (bioconda/linux-64)
+biom-format-2.1.10 (conda-forge/linux-64)
+blas-1.1 (conda-forge/linux-64)
+blast-2.11.0 (bioconda/linux-64)
+bleach-3.3.0 (conda-forge/noarch)
+bokeh-2.3.1 (conda-forge/linux-64)
+bowtie2-2.4.2 (bioconda/linux-64)
+brotlipy-0.7.0 (conda-forge/linux-64)
+bwidget-1.9.14 (conda-forge/linux-64)
+bzip2-1.0.8 (conda-forge/linux-64)
+c-ares-1.17.1 (conda-forge/linux-64)
+ca-certificates-2020.12.5 (conda-forge/linux-64)
+cachecontrol-0.12.6 (conda-forge/noarch)
+cached-property-1.5.2 (conda-forge/noarch)
+cached_property-1.5.2 (conda-forge/noarch)
+cairo-1.16.0 (conda-forge/linux-64)
+certifi-2020.12.5 (conda-forge/linux-64)
+cffi-1.14.5 (conda-forge/linux-64)
+chardet-4.0.0 (conda-forge/linux-64)
+click-7.1.2 (conda-forge/noarch)
+cryptography-3.4.7 (conda-forge/linux-64)
+curl-7.76.1 (conda-forge/linux-64)
+cutadapt-3.4 (bioconda/linux-64)
+cycler-0.10.0 (conda-forge/noarch)
+cython-0.29.23 (conda-forge/linux-64)
+dbus-1.13.6 (conda-forge/linux-64)
+deblur-1.1.0 (bioconda/noarch)
+decorator-4.4.2 (conda-forge/noarch)
+defusedxml-0.7.1 (conda-forge/noarch)
+dendropy-4.5.2 (bioconda/noarch)
+dnaio-0.5.0 (bioconda/linux-64)
+emperor-1.0.3 (conda-forge/linux-64)
+entrez-direct-13.9 (bioconda/linux-64)
+entrypoints-0.3 (conda-forge/noarch)
+expat-2.3.0 (conda-forge/linux-64)
+fastcluster-1.1.26 (conda-forge/linux-64)
+fasttree-2.1.10 (bioconda/linux-64)
+font-ttf-dejavu-sans-mono-2.37 (conda-forge/noarch)
+font-ttf-inconsolata-3.000 (conda-forge/noarch)
+font-ttf-source-code-pro-2.038 (conda-forge/noarch)
+font-ttf-ubuntu-0.83 (conda-forge/noarch)
+fontconfig-2.13.1 (conda-forge/linux-64)
+fonts-conda-ecosystem-1 (conda-forge/noarch)
+fonts-conda-forge-1 (conda-forge/noarch)
+freetype-2.10.4 (conda-forge/linux-64)
+fribidi-1.0.10 (conda-forge/linux-64)
+future-0.18.2 (conda-forge/linux-64)
+gcc_impl_linux-64-9.3.0 (conda-forge/linux-64)
+gcc_linux-64-9.3.0 (conda-forge/linux-64)
+gettext-0.19.8.1 (conda-forge/linux-64)
+gfortran_impl_linux-64-9.3.0 (conda-forge/linux-64)
+gfortran_linux-64-9.3.0 (conda-forge/linux-64)
+glib-2.68.1 (conda-forge/linux-64)
+glib-tools-2.68.1 (conda-forge/linux-64)
+gneiss-0.4.6 (bioconda/noarch)
+graphite2-1.3.13 (conda-forge/linux-64)
+gsl-2.6 (conda-forge/linux-64)
+gst-plugins-base-1.18.4 (conda-forge/linux-64)
+gstreamer-1.18.4 (conda-forge/linux-64)
+gxx_impl_linux-64-9.3.0 (conda-forge/linux-64)
+gxx_linux-64-9.3.0 (conda-forge/linux-64)
+h5py-3.2.1 (conda-forge/linux-64)
+harfbuzz-2.8.0 (conda-forge/linux-64)
+hdf5-1.10.6 (conda-forge/linux-64)
+hdmedians-0.14.2 (conda-forge/linux-64)
+hmmer-3.1b2 (bioconda/linux-64)
+htslib-1.12 (bioconda/linux-64)
+icu-68.1 (conda-forge/linux-64)
+idna-2.10 (conda-forge/noarch)
+ijson-3.1.3 (conda-forge/noarch)
+importlib-metadata-3.10.1 (conda-forge/linux-64)
+iniconfig-1.1.1 (conda-forge/noarch)
+ipykernel-5.5.3 (conda-forge/linux-64)
+ipython-7.22.0 (conda-forge/linux-64)
+ipython_genutils-0.2.0 (conda-forge/noarch)
+ipywidgets-7.6.3 (conda-forge/noarch)
+iqtree-2.1.2 (bioconda/linux-64)
+isa-l-2.30.0 (conda-forge/linux-64)
+jedi-0.18.0 (conda-forge/linux-64)
+jinja2-2.11.3 (conda-forge/noarch)
+joblib-1.0.1 (conda-forge/noarch)
+jpeg-9d (conda-forge/linux-64)
+jsonschema-3.2.0 (conda-forge/noarch)
+jupyter_client-6.1.12 (conda-forge/noarch)
+jupyter_core-4.7.1 (conda-forge/linux-64)
+jupyterlab_pygments-0.1.2 (conda-forge/noarch)
+jupyterlab_widgets-1.0.0 (conda-forge/noarch)
+kernel-headers_linux-64-2.6.32 (conda-forge/noarch)
+kiwisolver-1.3.1 (conda-forge/linux-64)
+krb5-1.17.2 (conda-forge/linux-64)
+lcms2-2.12 (conda-forge/linux-64)
+ld_impl_linux-64-2.35.1 (conda-forge/linux-64)
+libblas-3.9.0 (conda-forge/linux-64)
+libcblas-3.9.0 (conda-forge/linux-64)
+libclang-11.1.0 (conda-forge/linux-64)
+libcurl-7.76.1 (conda-forge/linux-64)
+libdeflate-1.7 (conda-forge/linux-64)
+libedit-3.1.20191231 (conda-forge/linux-64)
+libev-4.33 (conda-forge/linux-64)
+libevent-2.1.10 (conda-forge/linux-64)
+libffi-3.3 (conda-forge/linux-64)
+libgcc-7.2.0 (conda-forge/linux-64)
+libgcc-devel_linux-64-9.3.0 (conda-forge/linux-64)
+libgcc-ng-9.3.0 (conda-forge/linux-64)
+libgfortran-ng-9.3.0 (conda-forge/linux-64)
+libgfortran5-9.3.0 (conda-forge/linux-64)
+libglib-2.68.1 (conda-forge/linux-64)
+libgomp-9.3.0 (conda-forge/linux-64)
+libiconv-1.16 (conda-forge/linux-64)
+liblapack-3.9.0 (conda-forge/linux-64)
+libllvm11-11.1.0 (conda-forge/linux-64)
+libnghttp2-1.43.0 (conda-forge/linux-64)
+libogg-1.3.4 (conda-forge/linux-64)
+libopenblas-0.3.12 (conda-forge/linux-64)
+libopus-1.3.1 (conda-forge/linux-64)
+libpng-1.6.37 (conda-forge/linux-64)
+libpq-13.1 (conda-forge/linux-64)
+libsodium-1.0.18 (conda-forge/linux-64)
+libssh2-1.9.0 (conda-forge/linux-64)
+libstdcxx-devel_linux-64-9.3.0 (conda-forge/linux-64)
+libstdcxx-ng-9.3.0 (conda-forge/linux-64)
+libtiff-4.2.0 (conda-forge/linux-64)
+libuuid-2.32.1 (conda-forge/linux-64)
+libuv-1.41.0 (conda-forge/linux-64)
+libvorbis-1.3.7 (conda-forge/linux-64)
+libwebp-base-1.2.0 (conda-forge/linux-64)
+libxcb-1.13 (conda-forge/linux-64)
+libxkbcommon-1.0.3 (conda-forge/linux-64)
+libxml2-2.9.10 (conda-forge/linux-64)
+libxslt-1.1.33 (conda-forge/linux-64)
+lockfile-0.12.2 (conda-forge/noarch)
+lxml-4.6.3 (conda-forge/linux-64)
+lz4-3.1.3 (conda-forge/linux-64)
+lz4-c-1.9.3 (conda-forge/linux-64)
+mafft-7.475 (bioconda/linux-64)
+make-4.3 (conda-forge/linux-64)
+markupsafe-1.1.1 (conda-forge/linux-64)
+matplotlib-3.4.1 (conda-forge/linux-64)
+matplotlib-base-3.4.1 (conda-forge/linux-64)
+mistune-0.8.4 (conda-forge/linux-64)
+more-itertools-8.7.0 (conda-forge/noarch)
+msgpack-python-1.0.2 (conda-forge/linux-64)
+mysql-common-8.0.23 (conda-forge/linux-64)
+mysql-libs-8.0.23 (conda-forge/linux-64)
+natsort-7.1.1 (conda-forge/noarch)
+nbclient-0.5.3 (conda-forge/noarch)
+nbconvert-6.0.7 (conda-forge/linux-64)
+nbformat-5.1.3 (conda-forge/noarch)
+ncurses-6.2 (conda-forge/linux-64)
+nest-asyncio-1.5.1 (conda-forge/noarch)
+networkx-2.5.1 (conda-forge/noarch)
+nodejs-15.14.0 (conda-forge/linux-64)
+nose-1.3.7 (conda-forge/noarch)
+notebook-6.3.0 (conda-forge/noarch)
+nspr-4.30 (conda-forge/linux-64)
+nss-3.64 (conda-forge/linux-64)
+numpy-1.20.2 (conda-forge/linux-64)
+olefile-0.46 (conda-forge/noarch)
+openblas-0.3.12 (conda-forge/linux-64)
+openjdk-11.0.1 (conda-forge/linux-64)
+openjpeg-2.4.0 (conda-forge/linux-64)
+openssl-1.1.1k (conda-forge/linux-64)
+packaging-20.9 (conda-forge/noarch)
+pandas-1.2.4 (conda-forge/linux-64)
+pandoc-2.12 (conda-forge/linux-64)
+pandocfilters-1.4.2 (conda-forge/noarch)
+pango-1.48.4 (conda-forge/linux-64)
+parso-0.8.2 (conda-forge/noarch)
+patsy-0.5.1 (conda-forge/noarch)
+pcre-8.44 (conda-forge/linux-64)
+pcre2-10.36 (conda-forge/linux-64)
+perl-5.26.2 (conda-forge/linux-64)
+perl-app-cpanminus-1.7044 (bioconda/linux-64)
+perl-archive-tar-2.32 (bioconda/linux-64)
+perl-base-2.23 (bioconda/linux-64)
+perl-business-isbn-3.004 (bioconda/linux-64)
+perl-business-isbn-data-20140910.003 (bioconda/linux-64)
+perl-carp-1.38 (bioconda/linux-64)
+perl-common-sense-3.74 (bioconda/linux-64)
+perl-compress-raw-bzip2-2.087 (bioconda/linux-64)
+perl-compress-raw-zlib-2.087 (bioconda/linux-64)
+perl-constant-1.33 (bioconda/linux-64)
+perl-data-dumper-2.173 (bioconda/linux-64)
+perl-digest-hmac-1.03 (bioconda/linux-64)
+perl-digest-md5-2.55 (bioconda/linux-64)
+perl-encode-2.88 (bioconda/linux-64)
+perl-encode-locale-1.05 (bioconda/linux-64)
+perl-exporter-5.72 (bioconda/linux-64)
+perl-exporter-tiny-1.002001 (bioconda/linux-64)
+perl-extutils-makemaker-7.36 (bioconda/linux-64)
+perl-file-listing-6.04 (bioconda/linux-64)
+perl-file-path-2.16 (bioconda/linux-64)
+perl-file-temp-0.2304 (bioconda/linux-64)
+perl-html-parser-3.72 (bioconda/linux-64)
+perl-html-tagset-3.20 (bioconda/linux-64)
+perl-html-tree-5.07 (bioconda/linux-64)
+perl-http-cookies-6.04 (bioconda/linux-64)
+perl-http-daemon-6.01 (bioconda/linux-64)
+perl-http-date-6.02 (bioconda/linux-64)
+perl-http-message-6.18 (bioconda/linux-64)
+perl-http-negotiate-6.01 (bioconda/linux-64)
+perl-io-compress-2.087 (bioconda/linux-64)
+perl-io-html-1.001 (bioconda/linux-64)
+perl-io-socket-ssl-2.066 (bioconda/linux-64)
+perl-io-zlib-1.10 (bioconda/linux-64)
+perl-json-4.02 (bioconda/linux-64)
+perl-json-xs-2.34 (bioconda/linux-64)
+perl-libwww-perl-6.39 (bioconda/noarch)
+perl-list-moreutils-0.428 (bioconda/linux-64)
+perl-list-moreutils-xs-0.428 (bioconda/linux-64)
+perl-lwp-mediatypes-6.04 (bioconda/linux-64)
+perl-lwp-protocol-https-6.07 (bioconda/linux-64)
+perl-mime-base64-3.15 (bioconda/linux-64)
+perl-mozilla-ca-20180117 (bioconda/linux-64)
+perl-net-http-6.19 (bioconda/noarch)
+perl-net-ssleay-1.88 (bioconda/linux-64)
+perl-ntlm-1.09 (bioconda/linux-64)
+perl-parent-0.236 (bioconda/linux-64)
+perl-pathtools-3.75 (bioconda/linux-64)
+perl-scalar-list-utils-1.52 (bioconda/linux-64)
+perl-socket-2.027 (bioconda/linux-64)
+perl-storable-3.15 (bioconda/linux-64)
+perl-test-requiresinternet-0.05 (bioconda/linux-64)
+perl-time-local-1.28 (bioconda/linux-64)
+perl-try-tiny-0.30 (bioconda/linux-64)
+perl-types-serialiser-1.0 (bioconda/linux-64)
+perl-uri-1.76 (bioconda/linux-64)
+perl-www-robotrules-6.02 (bioconda/linux-64)
+perl-xml-namespacesupport-1.12 (bioconda/linux-64)
+perl-xml-parser-2.44_01 (conda-forge/linux-64)
+perl-xml-sax-1.02 (bioconda/noarch)
+perl-xml-sax-base-1.09 (bioconda/linux-64)
+perl-xml-sax-expat-0.51 (bioconda/linux-64)
+perl-xml-simple-2.25 (bioconda/linux-64)
+perl-xsloader-0.24 (bioconda/linux-64)
+pexpect-4.8.0 (conda-forge/noarch)
+pickleshare-0.7.5 (conda-forge/noarch)
+pigz-2.6 (conda-forge/linux-64)
+pillow-8.1.2 (conda-forge/linux-64)
+pip-21.0.1 (conda-forge/noarch)
+pixman-0.40.0 (conda-forge/linux-64)
+pluggy-0.13.1 (conda-forge/linux-64)
+prometheus_client-0.10.1 (conda-forge/noarch)
+prompt-toolkit-3.0.18 (conda-forge/noarch)
+psutil-5.8.0 (conda-forge/linux-64)
+pthread-stubs-0.4 (conda-forge/linux-64)
+ptyprocess-0.7.0 (conda-forge/noarch)
+py-1.10.0 (conda-forge/noarch)
+pycparser-2.20 (conda-forge/noarch)
+pygments-2.8.1 (conda-forge/noarch)
+pyopenssl-20.0.1 (conda-forge/noarch)
+pyparsing-2.4.7 (conda-forge/noarch)
+pyqt-5.12.3 (conda-forge/linux-64)
+pyqt-impl-5.12.3 (conda-forge/linux-64)
+pyqt5-sip-4.19.18 (conda-forge/linux-64)
+pyqtchart-5.12 (conda-forge/linux-64)
+pyqtwebengine-5.12.1 (conda-forge/linux-64)
+pyrsistent-0.17.3 (conda-forge/linux-64)
+pysocks-1.7.1 (conda-forge/linux-64)
+pytest-6.2.3 (conda-forge/linux-64)
+python-3.8.8 (conda-forge/linux-64)
+python-dateutil-2.8.1 (conda-forge/noarch)
+python-isal-0.10.0 (conda-forge/linux-64)
+python_abi-3.8 (conda-forge/linux-64)
+pytz-2021.1 (conda-forge/noarch)
+pyyaml-5.4.1 (conda-forge/linux-64)
+pyzmq-22.0.3 (conda-forge/linux-64)
+q2-alignment-2021.4.0 (qiime2/label/r2021.4/linux-64)
+q2-composition-2021.4.0 (qiime2/label/r2021.4/linux-64)
+q2-cutadapt-2021.4.0 (qiime2/label/r2021.4/linux-64)
+q2-dada2-2021.4.0 (qiime2/label/r2021.4/linux-64)
+q2-deblur-2021.4.0 (qiime2/label/r2021.4/linux-64)
+q2-demux-2021.4.0 (qiime2/label/r2021.4/linux-64)
+q2-diversity-2021.4.0 (qiime2/label/r2021.4/linux-64)
+q2-diversity-lib-2021.4.0 (qiime2/label/r2021.4/linux-64)
+q2-emperor-2021.4.0 (qiime2/label/r2021.4/linux-64)
+q2-feature-classifier-2021.4.0 (qiime2/label/r2021.4/linux-64)
+q2-feature-table-2021.4.0 (qiime2/label/r2021.4/linux-64)
+q2-fragment-insertion-2021.4.0 (qiime2/label/r2021.4/linux-64)
+q2-gneiss-2021.4.0 (qiime2/label/r2021.4/linux-64)
+q2-longitudinal-2021.4.0 (qiime2/label/r2021.4/linux-64)
+q2-metadata-2021.4.0 (qiime2/label/r2021.4/linux-64)
+q2-mystery-stew-2021.4.0 (qiime2/label/r2021.4/linux-64)
+q2-phylogeny-2021.4.0 (qiime2/label/r2021.4/linux-64)
+q2-quality-control-2021.4.0 (qiime2/label/r2021.4/linux-64)
+q2-quality-filter-2021.4.0 (qiime2/label/r2021.4/linux-64)
+q2-sample-classifier-2021.4.0 (qiime2/label/r2021.4/linux-64)
+q2-taxa-2021.4.0 (qiime2/label/r2021.4/linux-64)
+q2-types-2021.4.0 (qiime2/label/r2021.4/linux-64)
+q2-vsearch-2021.4.0 (qiime2/label/r2021.4/linux-64)
+q2cli-2021.4.0 (qiime2/label/r2021.4/linux-64)
+q2galaxy-2021.4.0 (qiime2/label/r2021.4/linux-64)
+q2templates-2021.4.0 (qiime2/label/r2021.4/linux-64)
+qiime2-2021.4.0 (qiime2/label/r2021.4/linux-64)
+qt-5.12.9 (conda-forge/linux-64)
+r-assertthat-0.2.1 (conda-forge/noarch)
+r-backports-1.2.1 (conda-forge/linux-64)
+r-base-4.0.3 (conda-forge/linux-64)
+r-bh-1.75.0_0 (conda-forge/noarch)
+r-bitops-1.0_6 (conda-forge/linux-64)
+r-brio-1.1.1 (conda-forge/linux-64)
+r-callr-3.6.0 (conda-forge/noarch)
+r-cli-2.4.0 (conda-forge/noarch)
+r-cluster-2.1.1 (conda-forge/linux-64)
+r-colorspace-2.0_0 (conda-forge/linux-64)
+r-crayon-1.4.1 (conda-forge/noarch)
+r-desc-1.3.0 (conda-forge/noarch)
+r-diffobj-0.3.3 (conda-forge/linux-64)
+r-digest-0.6.27 (conda-forge/linux-64)
+r-ellipsis-0.3.1 (conda-forge/linux-64)
+r-evaluate-0.14 (conda-forge/noarch)
+r-fansi-0.4.2 (conda-forge/linux-64)
+r-farver-2.1.0 (conda-forge/linux-64)
+r-formatr-1.9 (conda-forge/noarch)
+r-futile.logger-1.4.3 (conda-forge/noarch)
+r-futile.options-1.0.1 (conda-forge/noarch)
+r-ggplot2-3.3.3 (conda-forge/noarch)
+r-glue-1.4.2 (conda-forge/linux-64)
+r-gtable-0.3.0 (conda-forge/noarch)
+r-hwriter-1.3.2 (conda-forge/noarch)
+r-isoband-0.2.4 (conda-forge/linux-64)
+r-jpeg-0.1_8.1 (conda-forge/linux-64)
+r-jsonlite-1.7.2 (conda-forge/linux-64)
+r-labeling-0.4.2 (conda-forge/noarch)
+r-lambda.r-1.2.4 (conda-forge/noarch)
+r-lattice-0.20_41 (conda-forge/linux-64)
+r-latticeextra-0.6_29 (conda-forge/noarch)
+r-lifecycle-1.0.0 (conda-forge/noarch)
+r-magrittr-2.0.1 (conda-forge/linux-64)
+r-mass-7.3_53.1 (conda-forge/linux-64)
+r-matrix-1.3_2 (conda-forge/linux-64)
+r-matrixstats-0.58.0 (conda-forge/linux-64)
+r-mgcv-1.8_34 (conda-forge/linux-64)
+r-munsell-0.5.0 (conda-forge/noarch)
+r-nlme-3.1_152 (conda-forge/linux-64)
+r-permute-0.9_5 (conda-forge/noarch)
+r-pillar-1.6.0 (conda-forge/noarch)
+r-pkgconfig-2.0.3 (conda-forge/noarch)
+r-pkgload-1.2.1 (conda-forge/linux-64)
+r-plyr-1.8.6 (conda-forge/linux-64)
+r-png-0.1_7 (conda-forge/linux-64)
+r-praise-1.0.0 (conda-forge/noarch)
+r-processx-3.5.1 (conda-forge/linux-64)
+r-ps-1.6.0 (conda-forge/linux-64)
+r-r6-2.5.0 (conda-forge/noarch)
+r-rcolorbrewer-1.1_2 (conda-forge/noarch)
+r-rcpp-1.0.6 (conda-forge/linux-64)
+r-rcppparallel-5.1.2 (conda-forge/linux-64)
+r-rcurl-1.98_1.3 (conda-forge/linux-64)
+r-rematch2-2.1.2 (conda-forge/noarch)
+r-reshape2-1.4.4 (conda-forge/linux-64)
+r-rlang-0.4.10 (conda-forge/linux-64)
+r-rprojroot-2.0.2 (conda-forge/noarch)
+r-rstudioapi-0.13 (conda-forge/noarch)
+r-scales-1.1.1 (conda-forge/noarch)
+r-snow-0.4_3 (conda-forge/noarch)
+r-stringi-1.5.3 (conda-forge/linux-64)
+r-stringr-1.4.0 (conda-forge/noarch)
+r-testthat-3.0.2 (conda-forge/linux-64)
+r-tibble-3.1.1 (conda-forge/linux-64)
+r-utf8-1.2.1 (conda-forge/linux-64)
+r-vctrs-0.3.7 (conda-forge/linux-64)
+r-vegan-2.5_7 (conda-forge/linux-64)
+r-viridislite-0.4.0 (conda-forge/noarch)
+r-waldo-0.2.5 (conda-forge/noarch)
+r-withr-2.4.2 (conda-forge/noarch)
+r-zeallot-0.1.0 (conda-forge/noarch)
+raxml-8.2.12 (bioconda/linux-64)
+readline-8.1 (conda-forge/linux-64)
+requests-2.25.1 (conda-forge/noarch)
+samtools-1.12 (bioconda/linux-64)
+scikit-bio-0.5.6 (conda-forge/linux-64)
+scikit-learn-0.24.1 (conda-forge/linux-64)
+scipy-1.6.2 (conda-forge/linux-64)
+seaborn-0.11.1 (conda-forge/noarch)
+seaborn-base-0.11.1 (conda-forge/noarch)
+sed-4.8 (conda-forge/linux-64)
+send2trash-1.5.0 (conda-forge/noarch)
+sepp-4.3.10 (bioconda/linux-64)
+setuptools-49.6.0 (conda-forge/linux-64)
+six-1.15.0 (conda-forge/noarch)
+sortmerna-2.0 (bioconda/linux-64)
+sqlite-3.35.4 (conda-forge/linux-64)
+statsmodels-0.12.2 (conda-forge/linux-64)
+sysroot_linux-64-2.12 (conda-forge/noarch)
+tbb-2020.2 (conda-forge/linux-64)
+terminado-0.9.4 (conda-forge/linux-64)
+testpath-0.4.4 (conda-forge/noarch)
+threadpoolctl-2.1.0 (conda-forge/noarch)
+tk-8.6.10 (conda-forge/linux-64)
+tktable-2.10 (conda-forge/linux-64)
+toml-0.10.2 (conda-forge/noarch)
+tornado-6.1 (conda-forge/linux-64)
+traitlets-5.0.5 (conda-forge/noarch)
+typing_extensions-3.7.4.3 (conda-forge/noarch)
+tzlocal-2.1 (conda-forge/noarch)
+unifrac-0.20.2 (bioconda/linux-64)
+urllib3-1.26.4 (conda-forge/noarch)
+vsearch-2.7.0 (bioconda/linux-64)
+wcwidth-0.2.5 (conda-forge/noarch)
+webencodings-0.5.1 (conda-forge/noarch)
+wheel-0.36.2 (conda-forge/noarch)
+widgetsnbextension-3.5.1 (conda-forge/linux-64)
+xopen-1.1.0 (conda-forge/linux-64)
+xorg-kbproto-1.0.7 (conda-forge/linux-64)
+xorg-libice-1.0.10 (conda-forge/linux-64)
+xorg-libsm-1.2.3 (conda-forge/linux-64)
+xorg-libx11-1.7.0 (conda-forge/linux-64)
+xorg-libxau-1.0.9 (conda-forge/linux-64)
+xorg-libxdmcp-1.1.3 (conda-forge/linux-64)
+xorg-libxext-1.3.4 (conda-forge/linux-64)
+xorg-libxrender-0.9.10 (conda-forge/linux-64)
+xorg-libxt-1.2.1 (conda-forge/linux-64)
+xorg-renderproto-0.11.1 (conda-forge/linux-64)
+xorg-xextproto-7.3.0 (conda-forge/linux-64)
+xorg-xproto-7.0.31 (conda-forge/linux-64)
+xz-5.2.5 (conda-forge/linux-64)
+yaml-0.2.5 (conda-forge/linux-64)
+zeromq-4.3.4 (conda-forge/linux-64)
+zipp-3.4.1 (conda-forge/noarch)
+zlib-1.2.11 (conda-forge/linux-64)
+zstd-1.4.9 (conda-forge/linux-64)

2021-06-05 14:01:18 (rev 1)
ca-certificates {2020.12.5 (conda-forge/linux-64) -> 2021.5.30 (conda-forge/linux-64)}
certifi {2020.12.5 (conda-forge/linux-64) -> 2021.5.30 (conda-forge/linux-64)}
+xmltodict-0.12.0 (conda-forge/noarch)

2021-06-06 13:09:28 (rev 2)
certifi {2021.5.30 (conda-forge/linux-64) -> 2021.5.30 (defaults/linux-64)}
+q2-metabolomics-0.0.6 (mwang87/noarch)

2021-06-06 13:10:39 (rev 3)
ca-certificates {2021.5.30 (conda-forge/linux-64) -> 2021.5.25 (defaults/linux-64)}
openssl {1.1.1k (conda-forge/linux-64) -> 1.1.1k (defaults/linux-64)}

2021-06-06 14:40:48 (rev 4)
ca-certificates {2021.5.25 (defaults/linux-64) -> 2021.5.30 (conda-forge/linux-64)}
certifi {2021.5.30 (defaults/linux-64) -> 2021.5.30 (conda-forge/linux-64)}
openssl {1.1.1k (defaults/linux-64) -> 1.1.1k (conda-forge/linux-64)}
pip {21.0.1 (conda-forge/noarch) -> 21.1.2 (conda-forge/noarch)}
+appdirs-1.4.4 (conda-forge/noarch)
+cobra-0.22.0 (conda-forge/noarch)
+colorama-0.4.4 (conda-forge/noarch)
+commonmark-0.9.1 (conda-forge/noarch)
+depinfo-1.5.4 (conda-forge/noarch)
+diskcache-5.2.1 (conda-forge/noarch)
+glpk-4.65 (conda-forge/linux-64)
+gmp-6.2.1 (conda-forge/linux-64)
+gmpy2-2.1.0b1 (conda-forge/linux-64)
+h11-0.12.0 (conda-forge/noarch)
+h2-4.0.0 (conda-forge/linux-64)
+hpack-4.0.0 (conda-forge/noarch)
+httpcore-0.13.3 (conda-forge/noarch)
+httpx-0.18.1 (conda-forge/linux-64)
+hyperframe-6.0.1 (conda-forge/noarch)
+importlib_resources-5.1.4 (conda-forge/noarch)
+libflint-2.7.1 (conda-forge/linux-64)
+mpc-1.1.0 (conda-forge/linux-64)
+mpfr-4.0.2 (conda-forge/linux-64)
+mpmath-1.2.1 (conda-forge/noarch)
+optlang-1.5.2 (conda-forge/noarch)
+pipdeptree-1.0.0 (conda-forge/noarch)
+pydantic-1.8.2 (conda-forge/linux-64)
+python-libsbml-5.19.0 (conda-forge/linux-64)
+python-symengine-0.7.2 (conda-forge/linux-64)
+rfc3986-1.5.0 (conda-forge/noarch)
+rich-10.2.2 (conda-forge/linux-64)
+ruamel.yaml-0.17.7 (conda-forge/linux-64)
+ruamel.yaml.clib-0.2.2 (conda-forge/linux-64)
+sniffio-1.2.0 (conda-forge/linux-64)
+swiglpk-5.0.3 (conda-forge/linux-64)
+symengine-0.7.0 (conda-forge/linux-64)
+sympy-1.8 (conda-forge/linux-64)
+typing-extensions-3.7.4.3 (conda-forge/noarch)

2021-06-07 14:12:07 (rev 5)
certifi {2021.5.30 (conda-forge/linux-64) -> 2021.5.30 (defaults/linux-64)}

2021-06-07 14:27:48 (rev 6)
certifi {2021.5.30 (defaults/linux-64) -> 2021.5.30 (conda-forge/linux-64)}
+colormath-3.0.0 (conda-forge/noarch)
+coverage-5.5 (conda-forge/linux-64)
+epa-ng-0.3.8 (bioconda/linux-64)
+gappa-0.7.1 (bioconda/linux-64)
+picrust2-2.0.3_b (bioconda/noarch)
+pytest-cov-2.12.1 (conda-forge/noarch)
+r-castor-1.6.7 (conda-forge/linux-64)
+r-naturalsort-0.1.3 (conda-forge/noarch)
+r-nloptr-1.2.2.2 (conda-forge/linux-64)
+r-rcppeigen-0.3.3.9.1 (conda-forge/linux-64)
+r-rspectra-0.16_0 (conda-forge/linux-64)
+spectra-0.0.11 (conda-forge/noarch)

Maybe the problem is related to pycrust2 installation? I had completed it succesfully, but it didn't work and didn't appear as qiime plugging when I run

qiime

The results are:

Usage: qiime [OPTIONS] COMMAND [ARGS]...

QIIME 2 command-line interface (q2cli)

To get help with QIIME 2, visit https://qiime2.org.

To enable tab completion in Bash, run the following command or add it to
your .bashrc/.bash_profile:

  source tab-qiime

To enable tab completion in ZSH, run the following commands or add them to
your .zshrc:

  autoload -Uz compinit && compinit
  autoload bashcompinit && bashcompinit
  source tab-qiime

Options:
--version Show the version and exit.
--help Show this message and exit.

Commands:
info Display information about current deployment.
tools Tools for working with QIIME 2 files.
dev Utilities for developers and advanced users.
alignment Plugin for generating and manipulating alignments.
composition Plugin for compositional data analysis.
cutadapt Plugin for removing adapter sequences, primers, and
other unwanted sequence from sequence data.

dada2 Plugin for sequence quality control with DADA2.
deblur Plugin for sequence quality control with Deblur.
demux Plugin for demultiplexing & viewing sequence quality.
diversity Plugin for exploring community diversity.
diversity-lib Plugin for computing community diversity.
emperor Plugin for ordination plotting with Emperor.
feature-classifier Plugin for taxonomic classification.
feature-table Plugin for working with sample by feature tables.
fragment-insertion Plugin for extending phylogenies.
gneiss Plugin for building compositional models.
longitudinal Plugin for paired sample and time series analyses.
metabolomics Plugin for the creation of a biom feature table for
metabolomics data.

metadata Plugin for working with Metadata.
micom Plugin for metabolic modeling of microbial communities.
phylogeny Plugin for generating and manipulating phylogenies.
quality-control Plugin for quality control of feature and sequence data.
quality-filter Plugin for PHRED-based filtering and trimming.
rescript Pipeline for reference sequence annotation and curation.
sample-classifier Plugin for machine learning prediction of sample
metadata.

taxa Plugin for working with feature taxonomy annotations.
vsearch Plugin for clustering and dereplicating with vsearch.

And after that qiime dada2 problems started.

Thank you so much!

Regards,

Elsa

4

Hi,

I've been having the same problem and so had a look on the dada2 issues pages (Error when running fastqPairedFilter · Issue #212 · benjjneb/dada2 · GitHub). It seems like the problem is to do with the version of Matrix.

conda list --revisions showed:
+r-matrix-1.3_2 (conda-forge/linux-64)

However, when inside R and using the packageVersion("Matrix") command, it was actually version 1.3.3.

To resolve this I had to do the following, as specified in the earier link:

remove.packages("Matrix")
install.packages("devtools")
devtools::install_version("Matrix", version = "1.3.2", repos = "http://cran.us.r-project.org")

I also needed to install conda install -c conda-forge r-gert too, as for some reason I couldn't install this inside of R!

Hope this helps,
Sam

2 Likes
5

Oh thanks for pointing this out @SamMc, this is a really useful piece of information! I'm not a fan of removing and reinstalling via R in this case though, since now it is kind of ignoring the root of the issue (the environmental mismatch) that was already present, rather than dealing with it, but if it works for you, great!

My guess is that there are additional entries in your r libpath that is driving the mismatch, lets check (@elsamdea can you run this too):

# run this _inside_ the activated offending conda env
R -e ".libPaths()"

:qiime2:

1 Like
6

Just the one -

"/home/smcgreig/miniconda2/envs/qiime2-2021.2/lib/R/library"

7

Oh, thank you @SamMc!!

I will wait for @thermokarst reply. If he thinks that this is a good solution at the end, I will follow your instructions!

8

Hi @thermokarst

Sorry for the late reply. When I run this command inside conda qiime2-2021.4 env

R -e ".libPaths()"

The reply is:

R version 4.0.3 (2020-10-10) -- "Bunny-Wunnies Freak Out"
Copyright (C) 2020 The R Foundation for Statistical Computing
Platform: x86_64-conda-linux-gnu (64-bit)

R es un software libre y viene sin GARANTIA ALGUNA.
Usted puede redistribuirlo bajo ciertas circunstancias.
Escriba 'license()' o 'licence()' para detalles de distribucion.

R es un proyecto colaborativo con muchos contribuyentes.
Escriba 'contributors()' para obtener más información y
'citation()' para saber cómo citar R o paquetes de R en publicaciones.

Escriba 'demo()' para demostraciones, 'help()' para el sistema on-line de ayuda,
o 'help.start()' para abrir el sistema de ayuda HTML con su navegador.
Escriba 'q()' para salir de R.

> .libPaths()
[1] "/home/elsa/miniconda3/envs/qiime2-2021.4/lib/R/library"
9

Hmm, thanks @SamMc & @elsamdea - it looks like both of you have nice clean R paths.... That's strange, I'm not sure where the contamination is coming from...

@elsamdea, can you run the following, inside your conda env with QIIME 2 in it, and share the output:

R -e 'packageVersion("Matrix")'
10

Sure @thermokarst!

The output of that command is:

> packageVersion("Matrix")
[1] ‘1.3.4’
12

Hmmm, this is interesting!

I have another verification for you to run:

head -n 5 /home/elsa/miniconda3/envs/qiime2-2021.4/lib/R/library/Matrix/DESCRIPTION

This should help us orient ourselves in this environment a bit better :crossed_fingers:

14

There it is!

head -n 5 /home/elsa/miniconda3/envs/qiime2-2021.4/lib/R/library/Matrix/DESCRIPTION

Package: Matrix
Version: 1.3-4
Date: 2021-05-24
Priority: recommended
Title: Sparse and Dense Matrix Classes and Methods

16

Thanks @elsamdea. Somehow you have managed to get your hands on a different version of r-matrix than what the QIIME 2 environment ships with. I just ran a completely fresh install and wound up with r-matrix 1.3-2, rather than 1.3-4. Perhaps you can recreate your QIIME 2 env, paying careful attention to what packages change when you install different plugins or tools in the environment. That head command you ran previously is probably the most "authoritative" check to confirm you have the right version.

:qiime2:

18

Thanks for your advice @thermokarst!

I have remove and reinstall qiime and now I have the correct r-matrix version. But, when I was installing the new qiime environment, I saw the next "errors":

(base) elsa@elsa-TUris:~/miniconda3/envs$ wget https://data.qiime2.org/distro/core/qiime2-2021.4-py38-linux-conda.yml
--2021-06-25 13:06:30-- https://data.qiime2.org/distro/core/qiime2-2021.4-py38-linux-conda.yml
Resolviendo data.qiime2.org... 54.200.1.12
Conectando con data.qiime2.org[54.200.1.12]:443... conectado.
Petición HTTP enviada, esperando respuesta... 302 FOUND
Localización: https://raw.githubusercontent.com/qiime2/environment-files/master/2021.4/release/qiime2-2021.4-py38-linux-conda.yml [siguiendo]
--2021-06-25 13:06:31-- https://raw.githubusercontent.com/qiime2/environment-files/master/2021.4/release/qiime2-2021.4-py38-linux-conda.yml
Resolviendo raw.githubusercontent.com... 185.199.108.133, 185.199.111.133, 185.199.110.133, ...
Conectando con raw.githubusercontent.com[185.199.108.133]:443... conectado.
Petición HTTP enviada, esperando respuesta... 200 OK
Longitud: 9794 (9,6K) [text/plain]
Grabando a: “qiime2-2021.4-py38-linux-conda.yml”

qiime2-2021.4-py38-linux-conda. 100%[=====================================================>] 9,56K --.-KB/s en 0s

2021-06-25 13:06:32 (36,5 MB/s) - “qiime2-2021.4-py38-linux-conda.yml” guardado [9794/9794]
(base) elsa@elsa-TUris:~/miniconda3/envs$ ls
blc2fastqenv qiime2-2021.4-py38-linux-conda.yml
(base) elsa@elsa-TUris:~/miniconda3/envs$ conda env create -n qiime2-2021.4 --file qiime2-2021.4-py38-linux-conda.yml
Collecting package metadata (repodata.json): done
Solving environment: done

Downloading and Extracting Packages
_openmp_mutex-4.5 | 22 KB | ################################################################################### | 100%
cython-0.29.23 | 2.2 MB | ################################################################################### | 100%
python_abi-3.8 | 4 KB | ################################################################################### | 100%
xopen-1.1.0 | 20 KB | ################################################################################### | 100%
Preparing transaction: done
Verifying transaction: /
SafetyError: The package for r-base located at /home/elsa/miniconda3/pkgs/r-base-4.0.3-h349a78a_8
appears to be corrupted. The path 'lib/R/doc/html/packages.html'
has an incorrect size.
reported size: 2946 bytes
actual size: 25012 bytes

ClobberError: This transaction has incompatible packages due to a shared path.
packages: conda-forge/linux-64::openjdk-11.0.1-h516909a_1016, conda-forge/linux-64::freetype-2.10.4-h0708190_1
path: 'lib/libfreetype.so'

ClobberError: This transaction has incompatible packages due to a shared path.
packages: bioconda/linux-64::perl-compress-raw-bzip2-2.087-pl526he1b5a44_0, bioconda/linux-64::perl-digest-hmac-1.03-pl526_3, bioconda/linux-64::perl-digest-md5-2.55-pl526_0, bioconda/linux-64::perl-extutils-makemaker-7.36-pl526_1, bioconda/linux-64::perl-html-tagset-3.20-pl526_3, bioconda/linux-64::perl-io-html-1.001-pl526_2, bioconda/linux-64::perl-io-zlib-1.10-pl526_2, conda-forge/linux-64::perl-xml-parser-2.44_01-pl5262hc3e0081_1002, bioconda/linux-64::perl-json-4.02-pl526_0
path: 'lib/5.26.2/x86_64-linux-thread-multi/perllocal.pod'

done
Executing transaction: \ Enabling notebook extension jupyter-js-widgets/extension...
- Validating: OK

done

To activate this environment, use

$ conda activate qiime2-2021.4

To deactivate an active environment, use

$ conda deactivate

(base) elsa@elsa-TUris:~/miniconda3/envs$ rm qiime2-2021.4-py38-linux-conda.yml
(base) elsa@elsa-TUris:~/miniconda3/envs$ conda activate qiime2-2021.4
(qiime2-2021.4) elsa@elsa-TUris:~/miniconda3/envs$ head -n 5 /home/elsa/miniconda3/envs/qiime2-2021.4/lib/R/library/Matrix/DESCRIPTION
Package: Matrix
Version: 1.3-2
Date: 2021-01-05
Priority: recommended
Title: Sparse and Dense Matrix Classes and Methods
(qiime2-2021.4) elsa@elsa-TUris:~/miniconda3/envs$

Pershaps of those errors during installation, I could run dada2 denoise-paired!!!

However, I do not know it that erros could influence in some other qiime2's commands. I will let you know in other topic if that happens!

Again, thank you so much for your help!!

Regards,

Elsa

1 Like
19

This topic was automatically closed 31 days after the last reply. New replies are no longer allowed.