# Visualization of large data sets is inadequate and needs optimization
**URL:** https://forum.qiime2.org/t/visualization-of-large-data-sets-is-inadequate-and-needs-optimization/6616
**Category:** User Support
**Tags:** pending-development, barplot
**Created:** [October 25, 2018, 2:17pm UTC](https://forum.qiime2.org/t/visualization-of-large-data-sets-is-inadequate-and-needs-optimization/6616 "2018-10-25T14:17:06Z")
**Posts on this page:** 14
**Page:** 1
### Author:  [@ben](https://forum.qiime2.org/u/ben)
#### Post date: [October 25, 2018, 2:17pm UTC](https://forum.qiime2.org/t/visualization-of-large-data-sets-is-inadequate-and-needs-optimization/6616/1 "2018-10-25T14:17:06Z")
Hi all,
[taxa bar plot](https://view.qiime2.org/visualization/?type=html&src=https%3A%2F%2Fdl.dropbox.com%2Fs%2Flil0sgh29irs1uv%2Ftaxa-bar-plots.qzv%3Fdl%3D1)
I Hope you're well. One issue we've been coming across is visualization of our bar plots. We have a multi-run set of samples which we've combine and then filtered. When we want to see a set of samples, it is impossible as it crashes multiple browsers (e.g., safari and chrome). Or runs out of the cache memory, this results in safari re-setting the page.
Loading the page isn't an issue, but any manipulation, e.g, looking at different levels lags. Any help with this would be much appreciated.
Sincerely, Ben
---
### Author:  [@Nicholas\_Bokulich](https://forum.qiime2.org/u/Nicholas_Bokulich)
#### Post date: [October 25, 2018, 8:44pm UTC](https://forum.qiime2.org/t/visualization-of-large-data-sets-is-inadequate-and-needs-optimization/6616/2 "2018-10-25T20:44:27Z")
---
### Author:  [@thermokarst](https://forum.qiime2.org/u/thermokarst)
#### Post date: [October 30, 2018, 12:04am UTC](https://forum.qiime2.org/t/visualization-of-large-data-sets-is-inadequate-and-needs-optimization/6616/3 "2018-10-30T00:04:06Z")
Hey there @ben! I can't say I am surprised --- that visualization has pretty poor performance benchmarks, and is on the shortlist of _Things To Fix_ ™ here at QIIME 2 HQ (:qiime2:). A few options to make things work a bit better:
- Reduce the number features by filtering your feature table
- Collapse to a specific taxonomic level prior to plotting - this will require a customized `FeatureData[Taxonomy]`
- Group your samples in your feature table - this will require a new Sample Metadata file
- Plot this in another tool
Sorry, none of those options are ideal, but, if you can reduce the size of the feature table, that will help out a bit. Thanks! :qiime2:
---
### Author:  [@thermokarst](https://forum.qiime2.org/u/thermokarst)
#### Post date: [October 30, 2018, 12:04am UTC](https://forum.qiime2.org/t/visualization-of-large-data-sets-is-inadequate-and-needs-optimization/6616/4 "2018-10-30T00:04:08Z")
---
### Author:  [@ben](https://forum.qiime2.org/u/ben)
#### Post date: [October 31, 2018, 1:54pm UTC](https://forum.qiime2.org/t/visualization-of-large-data-sets-is-inadequate-and-needs-optimization/6616/5 "2018-10-31T13:54:03Z")
Yeah, I think editing the file would be ideal. Maybe we can filter samples of the bar plots after using [view.qiime2.org](http://view.qiime2.org)? That would be a great addition to the view options.
---
### Author:  [@thermokarst](https://forum.qiime2.org/u/thermokarst)
#### Post date: [October 31, 2018, 7:05pm UTC](https://forum.qiime2.org/t/visualization-of-large-data-sets-is-inadequate-and-needs-optimization/6616/6 "2018-10-31T19:05:42Z")
---
### Author:  [@thermokarst](https://forum.qiime2.org/u/thermokarst)
#### Post date: [November 2, 2018, 3:00pm UTC](https://forum.qiime2.org/t/visualization-of-large-data-sets-is-inadequate-and-needs-optimization/6616/7 "2018-11-02T15:00:26Z")
Hey @ben,
> [@ben](#):
>
> Maybe we can filter samples of the bar plots after using [view.qiime2.org](http://view.qiime2.org)? That would be a great addition to the view options.
I'm not sure I follow... [view.qiime2.org](http://view.qiime2.org) is just a tool for viewing QZVs (same as `qiime tools view` in q2cli).
You can filter samples (and/or features) using [q2-feature-table](https://docs.qiime2.org/2018.8/plugins/available/feature-table/) - then you can use that filtered table as input to `taxa barplot`.
---
### Author:  [@thermokarst](https://forum.qiime2.org/u/thermokarst)
#### Post date: [November 2, 2018, 3:00pm UTC](https://forum.qiime2.org/t/visualization-of-large-data-sets-is-inadequate-and-needs-optimization/6616/8 "2018-11-02T15:00:34Z")
---
### Author:  [@ben](https://forum.qiime2.org/u/ben)
#### Post date: [November 2, 2018, 3:18pm UTC](https://forum.qiime2.org/t/visualization-of-large-data-sets-is-inadequate-and-needs-optimization/6616/9 "2018-11-02T15:18:09Z")
@thermokarst Hm, good point, it's a couple of extra steps to filter using Qiime2, I sure you get what I mean, but if you're able to manipulate the samples themselves (e.g., organize by subtype etc.) my specific recommendation may be to actually just show particular samples (show only subtype e.g., only cecal samples). Instead of only view all of the samples at the same time.
If this functionality can be built into the artifacts would be very helpful. Especially in large data sets. Ben
---
### Author:  [@Nicholas\_Bokulich](https://forum.qiime2.org/u/Nicholas_Bokulich)
#### Post date: [November 5, 2018, 1:41pm UTC](https://forum.qiime2.org/t/visualization-of-large-data-sets-is-inadequate-and-needs-optimization/6616/10 "2018-11-05T13:41:16Z")
@ben — there are a number of open issues to add the functionality that you describe, e.g., [here](https://github.com/qiime2/q2-taxa/issues/19). So it's on our radar but would require a fairly substantial re-write of this tool — I do not have an ETA but we can report back here when progress occurs.
---
### Author:  [@thermokarst](https://forum.qiime2.org/u/thermokarst)
#### Post date: [November 5, 2018, 3:21pm UTC](https://forum.qiime2.org/t/visualization-of-large-data-sets-is-inadequate-and-needs-optimization/6616/11 "2018-11-05T15:21:09Z")
Also, you can filter independently of this viz using the handful of generic filtering functions found in QIIME 2. The idea here is that we don't need to re-implement filtering in every single viz or method if there are independent, stand-alone filtering functions (see the [filtering tutorial](https://docs.qiime2.org/2018.8/tutorials/filtering/) for more details).
---
### Author:  [@ben](https://forum.qiime2.org/u/ben)
#### Post date: [November 5, 2018, 3:48pm UTC](https://forum.qiime2.org/t/visualization-of-large-data-sets-is-inadequate-and-needs-optimization/6616/12 "2018-11-05T15:48:15Z")
@thermokarst @Nicholas_Bokulich thanks yeah @Nicholas_Bokulich, that would be good with the bar\_plots since I think that functionality is already present in the emperor plots or beta-diversity?
@thermokarst yeah, it's not hard to re-filter and then re-run the code, but if it's all done in one place already, I feel that it's quite redundant to re-do the plots if they're already done in one place. I can certainly filter and re-do the last step for each and every sub-sample/sub-type I have, and it seems that for these bar plots I will have to.
Ben
---
### Author:  [@colinbrislawn](https://forum.qiime2.org/u/colinbrislawn)
#### Post date: [November 5, 2018, 7:40pm UTC](https://forum.qiime2.org/t/visualization-of-large-data-sets-is-inadequate-and-needs-optimization/6616/13 "2018-11-05T19:40:33Z")
Hello Ben,
I really like your idea of including filtering in the visualizations themselves, so that end users can change their filtering settings and the graphs themselves are "done in one place."
> [@ben](#):
>
> it seems that for these bar plots I will have to.
I always filter my bar plots because it greatly increases legibility. This can't be a main text figure with dozens of similar colors! Which is another good reason to include filtering as part of the bar-plot visualization.
Colin
---
### Author:  [@system](https://forum.qiime2.org/u/system)
#### Post date: [December 7, 2018, 1:42am UTC](https://forum.qiime2.org/t/visualization-of-large-data-sets-is-inadequate-and-needs-optimization/6616/14 "2018-12-07T01:42:43Z")
This topic was automatically closed 31 days after the last reply. New replies are no longer allowed.