I'm developing a package I'm hoping to eventually turn into a QIIME 2 plugin. (So feel free to kick this over to other tools if its not appropriate here.) Its relatively memory intensive, so there are steps that are broken into smaller, parallelizable loops. The package is currently in pure python …

Hey @jwdebelius , I think there's a few options depending on how involved the parallelism needs to be: The multiprocessing module is probably the first things to reach for, as it handles your basic "do the same thing, but X times on these X things", it gets a little more annoying when you need to c…

QIIME 2 Forum

Prefered parallel processing approach?

Developer Discussion

show post in topic

Home
Categories
Guidelines
Terms of Service
Privacy Policy

Powered by Discourse, best viewed with JavaScript enabled