BUSCO db fetching for MAG

General Discussion
1

I download BUSCO db for MAG quality control using “--p-lineages prokaryota” and after 10hr i got only 10 files so far (from the log file). Is it usually take long, or is there any qza file available for moshpit-2025.10?

2

Hi @Natchaphon_Rajudom, that sounds slow indeed. What arguments are you using for fetch-busco-db? If you add the argument --verbose, it will give you a more detail look into what files are being downloaded. Also, is there any test you can run (e.g., Speedtest) to see whether your internet connection is slow in general or if it just in this specific instance?

I am currently running fetch-busco-db using the lineage --p-lineages prokaryota and I will let you know how long it took once it finishes running. I can also share the artifact here with you.

1 Like
3

@felicia I also use fetch-busco-db with --p-lineages prokaryota, I rerun, and now I have around 30 files after 10 hrs. Does it take long for you? I would appreciate it if you could share the artifact with me.

4

So for the actual download to finish it took me about ~1 hour. I’m currently stuck at the point where the files are being moved into their final location and this is rather slow on my laptop. I’m realizing that the size of the artifact could potentially end up being a problem so sharing it may not be as easy as I first thought.

Is it possible for you to work a more specific lineage to reduce the size and download time? Or, do you think you could try running the action from another computer? Perhaps in a cluster environment? Ideally in a different location to test if your network is causing the slow download.

5

I try downloading on my own laptop, and it’s much faster than using HPC. I think it’s because of network issues. Thank you very much!

1 Like
6

That sounds good and please let us know how it went. I can add that it took me ~3 hours to finish running the action. Again, the download part took about 1 hour. The resulting artifact is approximately 10 GB in size.

1 Like
7

There is an error about disk space after the download finishes. It took around 1 hr, same as you. I try on my own MacBook M3. (I have more than 80GB free storage)