Loving rescript! Is there a way to parallelize evaluate-fit-classifier? I put --p-n-jobs -2 while running it on a computer with 80 cores, but after looking at top, it's still only using one CPU. Are there any other ways to speed the calculations along? Thanks!
that's the correct option!
This is a pipeline with different steps in a series, some paralellizable, others not. Unfortunately, one of the most time-consuming steps — fitting the classifier — is not parallelizable. So when you check top this step is most likely still running.
good luck!