How many samples are in this dataset? And what is the sequencing technology?
My suspicion is that one very large or very noisy (or both) sample is exceeding the 16GB of memory even when dereplicated. This can happen when there are a very large number of unique sequences, as it is that number, not the raw number of reads, that controls the peak memory requirements.