I encountered this error while running “qiime sidle reconstruct-counts”. How can I resolve this issue?
distributed.core - ERROR - 2643296484 exceeds max_bin_len(2147483647)
I encountered this error while running “qiime sidle reconstruct-counts”. How can I resolve this issue?
distributed.core - ERROR - 2643296484 exceeds max_bin_len(2147483647)
Hello Jian Wang,
Welcome to the forums!
That distributed.core
error is coming from Dask, the parallel processing library used by SIDLE. The max_bin_len (2,147,483,647, which is 2^31 - 1) refers to the maximum size of a "bin" or chunk of data that Dask is trying use, and some part is generating a chunk larger than this limit.
This can sometimes happen with very large feature tables or a very high number of features/alignments being processed simultaneously during the reconstruct-counts step.
To start, can you post the full command you ran?