# QIIME2 using too many nodes

**URL:** https://forum.qiime2.org/t/qiime2-using-too-many-nodes/23160
**Category:** Technical Support
**Created:** [May 24, 2022, 7:41pm UTC](https://forum.qiime2.org/t/qiime2-using-too-many-nodes/23160 "2022-05-24T19:41:44Z")
**Posts on this page:** 5
**Page:** 1

<div class="post-metadata">

### Author: ![biozervas](https://forum.qiime2.org/user_avatar/forum.qiime2.org/biozervas/32/13505_2.png) [@biozervas](https://forum.qiime2.org/u/biozervas)
#### Post date: [May 24, 2022, 7:41pm UTC](https://forum.qiime2.org/t/qiime2-using-too-many-nodes/23160/1 "2022-05-24T19:41:44Z")

</div>

Hi,

Similar post was found here: ['qiime diversity alpha-rarefaction' consume too much cpus and run weird slow](https://forum.qiime2.org/t/qiime-diversity-alpha-rarefaction-consume-too-much-cpus-and-run-weird-slow/21868) but it was closed so I cannot reply.

I started noticing that the newest versions of QIIME2 are using too many nodes, specifically when we run this commands:

qiime diversity alpha-rarefaction   
--i-table table.qza   
--i-phylogeny rooted-tree.qza   
--p-max-depth 15000   
--p-steps 50   
--m-metadata-file metadata.tsv   
--o-visualization alpha-rarefaction.qzv

When I check system resources it showed that at that step, qiime2 was using close to 200 nodes out of a total of 256.

Thanks in advance!!

---

<div class="post-metadata">

### Author: ![colinbrislawn](https://forum.qiime2.org/user_avatar/forum.qiime2.org/colinbrislawn/32/6221_2.png) [@colinbrislawn](https://forum.qiime2.org/u/colinbrislawn)
#### Post date: [May 24, 2022, 7:59pm UTC](https://forum.qiime2.org/t/qiime2-using-too-many-nodes/23160/2 "2022-05-24T19:59:20Z")

</div>

Good afternoon,

Welcome to the fourms! :qiime2:

Can you tell us more about your computer and how you are running this script, and any other clues you can provide?

Are you running this on a SLURM queue, or a torq queue, or a single computer?

> [@biozervas](#):
>
> When I check system resources it showed that at that step, qiime2 was using close to 200 nodes out of a total of 256.

When you say nodes, do you mean cores, or threads, whole compute nodes?

---

<div class="post-metadata">

### Author: ![biozervas](https://forum.qiime2.org/user_avatar/forum.qiime2.org/biozervas/32/13505_2.png) [@biozervas](https://forum.qiime2.org/u/biozervas)
#### Post date: [May 25, 2022, 5:28am UTC](https://forum.qiime2.org/t/qiime2-using-too-many-nodes/23160/3 "2022-05-25T05:28:46Z")

</div>

Thank you for your reply and for welcoming me to the QIIME2 forum! Apologies for the misleading terminology; I used the same one I found in the last post just in case. Our server has basically 128 cores and 256 threads, and QIIME2 is using close to 200 threads when we run the command I posted above.

We have a couple of QIIME2 installations (with conda) in our system and I am 100% certain we have seen this issue with version 2021.8 and I will need to verify with my colleagues who run version 2022.2.

As far as I know we don't use slurm or torq queues. The script is run exactly as posted above, just with nohup so that it can run in the background as we connect to the server through our personal computers.

---

<div class="post-metadata">

### Author: ![colinbrislawn](https://forum.qiime2.org/user_avatar/forum.qiime2.org/colinbrislawn/32/6221_2.png) [@colinbrislawn](https://forum.qiime2.org/u/colinbrislawn)
#### Post date: [May 25, 2022, 12:57pm UTC](https://forum.qiime2.org/t/qiime2-using-too-many-nodes/23160/5 "2022-05-25T12:57:11Z")

</div>

> [@biozervas](#):
>
> Our server has basically 128 cores and 256 threads, and QIIME2 is using close to 200 threads when we run the command I posted above.

Got it!

This sounds like a known issue with the backend of the `alpha-rarefaction` plugin. See  
[https://forum.qiime2.org/t/qiime2-2022-2-slow-alpha-rarefaction/22893/2](https://forum.qiime2.org/t/qiime2-2022-2-slow-alpha-rarefaction/22893/2)

I wanted to check in on how many _nodes_ were being used, as that could be a new issue. But fortunately it sounds like this existing one.

---

<div class="post-metadata">

### Author: ![system](https://forum-qiime2-org.s3.dualstack.us-west-2.amazonaws.com/original/3X/2/1/21af5fe23cb6f4579467c66a9ed94e55274ca7bd.svg) [@system](https://forum.qiime2.org/u/system)
#### Post date: [June 25, 2022, 6:57pm UTC](https://forum.qiime2.org/t/qiime2-using-too-many-nodes/23160/6 "2022-06-25T18:57:46Z")

</div>

This topic was automatically closed 31 days after the last reply. New replies are no longer allowed.
