Data Visualization on the Tech Side
4 likes5,792 views
This document discusses various tools for data visualization, including D3.js, WebGL, the ELK stack, R, Processing, Open Refine, and 3D printing. It provides examples of visualizations created with each tool and suggests when each tool may be best to use. D3.js is described as a low-level library that provides full control but requires more work, while tools like the ELK stack allow for quickly visualizing system and business data. R is presented as useful for exploring and analyzing large datasets, and Open Refine is recommended for cleaning and preparing CSV files for export.
Data Visualization on the Tech Side
- 1. DATA VISUALIZATION ON THE TECH SIDE #dbtalks languages - tools - ideas
- 2. Mathieu ELIE Data Visualization Freelance @mathieuel http://www.mathieu-elie.net #dbtalks
- 3. DATA VISUALIZATION #dbtalks Infinite number of tools, because dataviz domain is infinite. From data art, system administration, led walls to business intelligence. Lets see some trending tools, and explore some ideas !
- 4. CHAPTERS #dbtalks - d3.js the web standard, not so alone - ELK stack, system and BI dataviz super fast - WebGL, 3d dataviz entry point - R, explore data like a data scientist boss ! - 3d printing, dataviz in real life - processing - meet the data art - open refine, import csv, enrich, export
- 6. D3.JS #dbtalks THINK D3 AS: - a javascript library with helpers - dom, array, scales, color swatches etc... - a dom manipulation library - a low level lib: make a bart chart maybe painfull at the beginning - but you can make really advanced visualization, with full control
- 11. D3.JS #dbtalks As you can see, every examples are made of graphic svg primitives like square, path and so on. Possibilities are infinite and can be stuning but quite lot of work.
- 12. D3.JS #dbtalks d3 is a great tools for dataviz experts, or those who want to lear basics. For your own need you can use more high level tools like d3 wrapper lib, or lib focused on specific viz (bar chart, map etc..).
- 13. WEBGL #dbtalks Low level 3d API in browser (HTML5). three.js : the perfect lib to go on. Not really the job of d3.
- 19. WEBGL #dbtalks Many possibilities. 3d and data works together too. so dont miss WebGL for your dataviz projects
- 21. ELK STACK #dbtalks - logstash -> elasticsearch -> kibana - extra cheap dataviz and stuning - but ! you can query es too -> d3.js - elasticsearch + aggregations framework ajax call -> amazing stats to d3.js ! - explore timeline data quickly: very handy
- 22. R #dbtalks ouch ! ready to console ??
- 23. R #dbtalks - explore large sets of data - load csv and so on - explore data, aggregate, apply stats, find max, min, percentiles, and so on.. - produce graphs - R is not for producing dataviz - it is the perfect tool to explore your data
- 25. OPEN REFINE #dbtalks - when you have large / inconsistent csv - explore, correct, enrich - export templates: json / es / php, anything text based !!!
- 27. OPEN REFINE #dbtalks - ok for non programmers - not similar to R: has its own advantage - open source / free : run in browser - export templates are really amazing , endless possibilities - any time you have csv, think «open refine»
- 28. PROCESSING #dbtalks - not a dataviz standard tool but... - great community including data art - so i think you should care.... - .... and open your mind !
- 31. PROCESSING #dbtalks - community give more insights on the visual part of your dataviz - imagine some part of this graph are drived by data: - length of some path ? - brightness of some points ? - add maybe 3d or geo located data ?
- 32. 3D PRINTING #dbtalks so ? why not 3d print data ? - print bars / histogram 3d - print curves: think about lines chart in 3d - and many possibilities...
- 33. 3D PRINTING EXAMPLE #dbtalksObama 3d voice print
- 34. USE CASE : LASTFM HISTORY #dbtalks http://www.mathieu-elie.net
- 35. USE CASE : LASTFM HISTORY #dbtalks 1 ) grab lastfm api data from ruby 2 ) store in csv 3 ) import in open refine 4 ) export to elasticseach 5 ) call elasticsearch with ajax 6 ) display data with d3.js
- 36. #dbtalks QUESTIONS ? HELP ? Mathieu ELIE Data Visualization Freelance @mathieuel http://www.mathieu-elie.net