I was able to fix the problem by following the two step instruction that I found in this discussion
After proper primer sequences removal, I performed DADA2 denoising and I got a satisfactory coverage in the column "# of Samples Observed In".
Thank you @jphagen for pointing out that primer removal that I performed was inducing the error!