QIIME 2 2021.4 is now available!

The QIIME 2 2021.4 release is now available! Thanks to everyone involved for their hard work!

As a reminder, our next planned QIIME 2 release is scheduled for August, 2021 (QIIME 2 2021.8), but please stay tuned for updates.

Check out the QIIME 2 2021.4 docs for details on installing the latest QIIME 2 release, as well as tutorials and other resources. Get in touch on the QIIME 2 Forum if you run into any issues!

Virtual machine builds will be available sometime within the next week - watch this topic thread for an update!


Here are the highlights of the release:

  • New Interface: q2galaxy :milky_way: by @Oddant1 and @ebolyen
    • This is an alpha release of an interface which automatically generates tool descriptions for Galaxy
      • This means that as plugins are created and evolve, we can automatically generate complete Galaxy tools in a few seconds, rather than developing them by hand as is typically done.
      • This interface is tested with a new plugin named q2-mystery-stew, which produces 553 integration tests.
    • For more information on how to get started, check out the README, or watch this video on setting up Docker on Windows (please see below, at the bottom of this list item).
      • Please note that this is still very experimental, if you run into issues, do let us know!
    • As it is an alpha release, there are still some limitations:
      • No importing (yet! - exporting is available however)
      • The conda environment is not pre-installed on docker, so the first QIIME 2 command will take some time as it is installed. Jobs run afterwards will start immediately.
      • Visualizations have to be viewed manually in q2view unless your galaxy deployment is configured with HTTPS and CORS headers (you may need a Galaxy sys-admin to help you).
      • Semantic properties are not quite working yet, this may impact some actions which use them as the history-selector will not recognize some valid inputs.
      • TypeMap does not enforce any constraints in the UI at this time. (The framework will of course error as usual if any constraint is violated.)
      • Only TSV metadata is supported, there is not yet a mechanism to view artifacts as metadata or to convert them to a tabular format (this will be available soon).
  • New plugin: q2-mystery-stew :shallow_pan_of_food: by @Oddant1 and @ebolyen
    • This plugin is designed to test interfaces by generating a large number of actions with different inputs and parameters. It currently has 553 tests and was instrumental in testing q2galaxy’s generated tools.
    • Future work will include connecting this plugin with other interfaces such as q2cli and the Artifact API.
  • New version of Python (3.8) :snake:
    • All QIIME 2 packages in the Core Distribution now are built using Python 3.8! :partying_face:
    • Not all Community plugins have had a chance to update their conda packages to work with Python 3.8, so we will continue supporting QIIME 2 2021.2 until the 2021.8 release (currently scheduled for late August 2021) :calendar:
    • For some examples of interesting things that can be done in this version, check out this older post by @ebolyen :necktie:
  • QIIME 2 Framework
    • @thermokarst and @ebolyen fixed an issue in the framework that prevented users from generating data in certain conditions, most notably on some networked filesystems, such as BeeGFS, (common in HPC environments). The issue would crop up when attempting to move files (behind the scenes) before zipping them up into Artifacts - we solved this by falling back to a filesystem copy operation (which might be a little bit slower, but should work as expected in those off cases). :t_rex:
  • docs
    • @andrewsanchez updated the Read Joining tutorial to reflect the latest and greatest visualizations available! :woman_genie:
    • @BenKaehler added new weighted Naive Bayes classifiers will be published shortly after this release - please watch this topic thread for updates when they are made available! :milky_way:
  • q2cli
    • @lizgehret fixed a :bug: affecting Zsh users that prevented tab auto-completion from being enabled by default.
  • q2-dada2
    • @Oddant1 added a new parameter to denoise-paired that allows users of this method to control that minimum length for forward/reverse overlap. The default value of 12 remains unchanged from previous versions of this method. :face_with_hand_over_mouth:
  • q2-phylogeny
    • @SoilRotifer updated several IQ-TREE 2 and RAxML related tests, to support a new version of RAxML (2). :racing_car:
  • q2-types
    • @SoilRotifer refactored DNASequence :dna: to only accept DNA, and not RNA, sequences.
    • @SoilRotifer added the RNASequence and AlignedRNASequence types. :alien:
    • @SoilRotifer added RNAFASTAFormat and other related RNA formats. :derelict_house:
    • This means future and existing plugins can be updated to handle RNA sequence data directly. :diamond_shape_with_a_dot_inside:
  • q2-sample-classifier
    • @jwchen added a link to download the raw data of RFE plots. :butterfly:
    • @adamova updated SVC and SVC_linear to return calibrated probability values (as described here) and to adjust the SVC_linear classifier to be defined by SVC(kernel=‘linear’) instead of LinearSVC(). :bowling:
    • This update also includes a verification for all classifiers to output predicted probabilities in a range from 0 to 1. :100:
  • q2-diversity
    • procrustes-analysis: GH User @adhdilmore added a ProcrustesStatistics output that stores the disparity (m^2), a permutation-based p-value, and the number of permutations for a procrustes fit. :peacock:
    • procrustes-analysis: @yoshiki added a --p-permutations parameter to select the number of permutations to compute the Procrustes analysis’ p-value. :pretzel:
  • q2-emperor
    • procrustes-plot: GH User @adhdilmore added a way to view ProcrustesStatistics values in the top left of a Procrustes plot in Emperor (p and m^2 values). :chart_with_upwards_trend:
    • @yoshiki updated to depend on the newest Emperor :penguin: release (1.0.3).
  • view.qiime2.org
    • @lizgehret updated the gallery links to reflect the newest release version (2021.4). :game_die:
  • q2-taxa
    • @Keegan-Evans changed barplot :bar_chart: so that providing sample metadata is now optional. The visualization will display the number of columns of sample metadata provided or 0 if no sample metadata is provided. :garlic:
    • @fedarko created an improvement for barplot :bar_chart: so that at all levels, the color scheme displays with the same color topmost. :broccoli:
    • @wasade made an update that avoids a dense representation of the FeatureTable when performing a taxonomy collapse. :curly_loop:
  • q2-longitudinal
    • @thermokarst fixed a :bug: where the matplotlib canvas would occasionally fail to clear, leading to downstream errors with things like setting axis labels. :lollipop:

Happy QIIMEing! :mage:

17 Likes

Wow! Virtual machines for the new release are all set! :lollipop: :spaghetti:

Please try them out and let us know how you fare!

:coffee: :jack_o_lantern: :honeybee:

https://docs.qiime2.org/2021.4/install/virtual/

Cheers!

:qiime2:

2 Likes

Hi there,
I checked VirtualBox images but could not find the 2021.4 version. The latest version there is 2021.2
Regards
MAN

Hi @Man - please make sure you’re looking at the latest link for the docs:

https://docs.qiime2.org/2021.4/install/virtual/

The 2021.4 VirtualBox image can be found here:

https://docs.qiime2.org/2021.4/install/virtual/virtualbox/#download-the-qiime-2-core-virtualbox-image

1 Like

Sorry for the delay, but the remaining pre-trained feature classifiers are now available!

https://docs.qiime2.org/2021.4/data-resources/#taxonomy-classifiers-for-use-with-q2-feature-classifier

2 Likes