# Checkerboard score?

**URL:** https://forum.qiime2.org/t/checkerboard-score/7078
**Category:** Ideas and Suggestions
**Tags:** feature-table
**Created:** [November 19, 2018, 3:47pm UTC](https://forum.qiime2.org/t/checkerboard-score/7078 "2018-11-19T15:47:49Z")
**Posts on this page:** 6
**Page:** 1

<div class="post-metadata">

### Author: ![jwdebelius](https://forum.qiime2.org/user_avatar/forum.qiime2.org/jwdebelius/32/9655_2.png) [@jwdebelius](https://forum.qiime2.org/u/jwdebelius)
#### Post date: [November 19, 2018, 3:47pm UTC](https://forum.qiime2.org/t/checkerboard-score/7078/1 "2018-11-19T15:47:49Z")

</div>

I'm wondering if the [checkerboard score](https://link.springer.com/article/10.1007%2FBF00317345) has been implemented in QIIME 2? I know it was part of QIIME 1 and wasn't sure if its been ported?

Thanks,  
Justine

---

<div class="post-metadata">

### Author: ![Nicholas\_Bokulich](https://forum.qiime2.org/user_avatar/forum.qiime2.org/nicholas_bokulich/32/19937_2.png) [@Nicholas\_Bokulich](https://forum.qiime2.org/u/Nicholas_Bokulich)
#### Post date: [November 20, 2018, 2:02pm UTC](https://forum.qiime2.org/t/checkerboard-score/7078/2 "2018-11-20T14:02:08Z")

</div>

Hi @jwdebelius,  
No, we do not have that implemented anywhere in QIIME 2. Looking back over this, I think the reason is that the checkerboard score may not be appropriate for compositional data (correct me if I am wrong! That is the reason why none of the correlation methods used in `observation_metadata_correlation.py` were ported over).

---

<div class="post-metadata">

### Author: ![jwdebelius](https://forum.qiime2.org/user_avatar/forum.qiime2.org/jwdebelius/32/9655_2.png) [@jwdebelius](https://forum.qiime2.org/u/jwdebelius)
#### Post date: [November 20, 2018, 2:12pm UTC](https://forum.qiime2.org/t/checkerboard-score/7078/3 "2018-11-20T14:12:44Z")

</div>

Hi @Nicholas_Bokulich,

Thanks for the reply.

Checkerboard score is a presence/absence method, or should be based on my reading of the paper. So, Im not thinking it's as sensitive to compositionality as abundance-based methods. (Although if one of the people who is better at compositionality than I am, like @mortonjt wants to weigh in and let me know if I'm wrong, it would be good.)

I'm looking for something better than abundance-based tests when I'm dealing with data with a stronger signal in unweighted metrics than weighted metrics. I could apply something like a chi-square or logistic regression as well, but I'm a little bit wary of those tests at ASV scales.

Thanks,  
Justine

---

<div class="post-metadata">

### Author: ![Nicholas\_Bokulich](https://forum.qiime2.org/user_avatar/forum.qiime2.org/nicholas_bokulich/32/19937_2.png) [@Nicholas\_Bokulich](https://forum.qiime2.org/u/Nicholas_Bokulich)
#### Post date: [November 20, 2018, 2:15pm UTC](https://forum.qiime2.org/t/checkerboard-score/7078/4 "2018-11-20T14:15:48Z")

</div>

Got it — we may have thrown out the baby with the bathwater operating on the assumption that all methods in `observation_metadata_correlation.py` had the same test assumptions.

I will wait for @mortonjt and others to weigh in — if this sounds like a useful test to add to QIIME 2 I will open an issue for it.

Thanks!

---

<div class="post-metadata">

### Author: ![mortonjt](https://forum.qiime2.org/user_avatar/forum.qiime2.org/mortonjt/32/3488_2.png) [@mortonjt](https://forum.qiime2.org/u/mortonjt)
#### Post date: [November 29, 2018, 4:47pm UTC](https://forum.qiime2.org/t/checkerboard-score/7078/5 "2018-11-29T16:47:28Z")

</div>

I think the default point of view for qiime2 is to not endorse any particular method - so any developers that want to contribute a published method can. It's allow make it easier for others to benchmark said method.

Wrt my opinion - its highly doubtful that this will work on compositional data. When implementing, it'll be important to run simulations to confirm this (for example negative binomial sampling from lokta volterra simulated dynamics)

---

<div class="post-metadata">

### Author: ![jwdebelius](https://forum.qiime2.org/user_avatar/forum.qiime2.org/jwdebelius/32/9655_2.png) [@jwdebelius](https://forum.qiime2.org/u/jwdebelius)
#### Post date: [November 29, 2018, 7:14pm UTC](https://forum.qiime2.org/t/checkerboard-score/7078/6 "2018-11-29T19:14:41Z")

</div>

Thanks @mortonjt. for your insight. I'm looking (continously) for presence-absence based methods. Maybe I should double check Sophie's paper, to see if she benchmarked them, and if not, potentially undertake some benchmarking on m yown.
