Is there a way to parallelize evaluate-fit-classifier?

[alexkrohn]

Loving rescript! Is there a way to parallelize evaluate-fit-classifier? I put --p-n-jobs -2 while running it on a computer with 80 cores, but after looking at top, it's still only using one CPU. Are there any other ways to speed the calculations along? Thanks!

[Nicholas_Bokulich]

@alexkrohn

Is there a way to parallelize evaluate-fit-classifier? I put --p-n-jobs -2

that's the correct option!

@alexkrohn

while running it on a computer with 80 cores, but after looking at top, it's still only using one CPU

This is a pipeline with different steps in a series, some paralellizable, others not. Unfortunately, one of the most time-consuming steps — fitting the classifier — is not parallelizable. So when you check top this step is most likely still running.

good luck!