Datashader Revealing the Structure of Genuinely Big Data | SciPy 2016 | James A Bednar

Current plotting tools are inadequate for revealing the distributions of large, complex datasets, both because of technical limitations and because the results vary dramatically depending on the dataset itself. Avoiding these problems requires either prior knowledge of the distribution or tedious trial-and-error parameter adjustment, neither of which is necessarily feasible for the data now being collected. The new datashader library (github.com/bok...) makes it practical to work with data at a large scale, easily and interactively visualizing millions or billions of points. In this talk, we'll demonstrate how datashader provides a flexible pipeline for data processing that allows automatic or custom-defined algorithms at every stage. Datashader makes it easier to reveal the underlying structure of the dataset and to focus on the specific aspects of interest.

[@enthought]

See the complete SciPy 2016 Conference talk & tutorial playlist here: ruclips.net/p/PLYx7XA2nY5Gf37zYZMw6OqGFRPjB1jCy6

[@habib.bhatti]

I am having trouble reading the parquet data file; any way it can be reuploaded, checked for errors. thanks

[@LinwoodCreekmoreIII]

I cannot get the interactive plot to work on this; it doesn't redraw as your video shows and I'm working from the nyc_taxi file in the datashader/examples folder. Any help?

[@jbednar]

We're playing catchup with Bokeh recently, which has had a flurry of releases as it gears up for its major 1.0 release. Each new release has subtly modified the interface that the InteractiveImage class uses to update these plots dynamically, and so you'll need to use the right combination of datashader+bokeh for it to work. E.g. the current datashader 0.4.0 release works well with Bokeh 0.12.0, and should also work well with 0.12.2 (not yet released). This should all settle down soon as Bokeh reaches 1.0. If matching the versions doesn't help, feel free to file a detailed Github issue at our web site (github.com/bokeh/datashader/issues).

[@LinwoodCreekmoreIII]

Thanks! Love how you all stay involved and connected with the user base. I got it working. Bryan (I think) responded and told me to update the version.

[@revanthvardhan5829]

where is nyc_taxi in examples folder?
i cannot find it

[@alekseykozin8108]

Fascinating!