Hi @Nasute!
Have you tried the steps indicated on this post? Specifically, the second section, titled "Creating a BIOM table with taxonomy annotations"? I think you should be able to use that file as input to phyloseq (but I am not 100% sure - we aren't developers on the phyloseq project), but maybe you can give that a try? Let us know how it goes!