Error while getting plenty of data from NCBI

[SoilRotifer (Mike Robeson)]

@TurboQiimer

A worker process managed by the executor was unexpectedly terminated. This could be caused by a segmentation fault while calling the function or by an excessive memory usage causing the Operating System to kill the worker.

The exit codes of the workers are {SIGKILL(-9)}

It looks like you figured this out as per:

@TurboQiimer

I used a server (remote machine)to prevent memory-associated limitation

Your next error:

@TurboQiimer

Download did not finish. Reason unknown.

can be problematic to figure out. There are many "out of our hands" reasons that fetching data from NCBI can fail:

rescript get-ncbi-data ‘dict’ object has no attribute ‘add’

Hey @the_dummy, Just to follow on @SoilRotifer’s comments to clarify — we see various server-side issues with NCBI so sometimes using get-ncbi-data can be a bit bumpy depending on: the time of day the size/content of your query which way the wind is blowing (just kidding ) Usually trying again later works (e.g., if you are trying to run the job during peak hours) and we have some pending changes to rescript to make these failures more graceful in the future. Good luck!

I'd suggest trying to add more selective terms to your query, or try to download in batches. This is a great place to start:

Building a COI database from NCBI references

Citation: If you use the following COI resources or RESCRIPt for COI database preparation, please cite the following: Michael S Robeson II, Devon R O’Rourke, Benjamin D Kaehler, Michal Ziemski, Matthew R Dillon, Jeffrey T Foster, Nicholas A Bokulich. RESCRIPt: Reproducible sequence taxonomy reference database management for the masses. bioRxiv 2020.10.05.326504; …

Good luck!