I have a question about statistical analysis of alpha diversity between groups.
Qiime2 gives the result of Kruskal-Wallis test and that of Kruskal-Wallis(pairwirse) test between group with the score of alpha diversity after qiime diversity core-metrics-phylogenetic.
If I understand correctly, Kruskal-Wallis test isn't a pairwise test.
Which pairwise test was used in Qiime2?
Great question! Can you post the full command you ran? You mentioned it's core-metrics-phylogenetic, and the full method would help us validate what it's doing.
Kruskal-Wallis can be applied to two or more groups, so it can be applied in a pairwise manner (i.e. comparing two groups at a time), or to all groups simultaneously. alpha-group-significance uses the Kruskal-Wallis test for both "all groups" and "pairwise" tests.
Kruskal-Wallis is a non-parametric version of the one-way ANOVA test. Just as ANOVA can be applied to 2+ groups and is a generalization of the t-test (which works with 2 groups only), Kruskal-Wallis can be applied to 2+ groups and is a generalization of the Mann-Whitney U test. See this Wikipedia page for more details. Hope this helps!
Just an additional question on this topic. What is the q-value shown in the alpha diversity pairwise comparison table (as produced in the output from above). Is this an adjusted P value? If so, what type of adjustment method have been used? This would be good to know for reporting in a paper.
Aha! I guessed as much, thanks for looking into it! Perhaps a little text indicating that should be placed by the outcome table? Or replace q-value with adj.p as is more commonly used?
We have an open issue to add a description of the p-value correction method to alpha-group-significance. We'll follow up here when that's available in a release!