You may need to account for differences in sequencing depth somehow. Subsampling to an equal depth (rarifying) is one way to do that.