Advanced visualization
0 likes293 views
The document discusses emerging trends in business intelligence and data visualization. It summarizes Gartner's definition of big data and how the volume of data is growing exponentially. It then covers techniques for visualizing and extracting insights from large datasets, including dimensionality reduction methods, data mining, and advanced visualization tools. Emerging technologies are enabling new forms of interactive data visualization to help analyze trends and outliers in massive amounts of information.
Advanced visualization
- 1. Advanced Visualization Bijilash Babu Technical Architect Technology Development Centre NeST Software bijilash.babu@nestgroup.net Session on Emerging trends in Business Intelligence 20 July 2012: Zenith Hall Bhavani, Technopark, Trivandrum
- 2. Big Data, It’s Visualization • Gartner’s definition of big data refers to high-volume, high-velocity and high- variety information assets that demand cost-effective, innovative forms of information processing for enhanced insight and decision making. • Big Data is the convergence of three v’s: volume, variety and velocity.. • Internet of things (with different sensors), CRM, social media, etc.. • Improved use of Big Data could add t to the economy and create N jobs. • Volume of data keeps creeping, Decision makers would struggle.. • Data visualisation would be a key for better perception. 8-Aug-12 NeST Controlled/Confidential 2
- 3. Roadmap • Big Data • Dimensionality • Current trends • Ordinary analytics • Applied maths • Advanced Technology 8-Aug-12 NeST Controlled 3
- 4. When big wasn’t that big Track rises and falls over time • Line graph • Stack graph • Categories Stack graph See relationships among data points • Scatterplot • Matrix chart • Network Diagram Compare a set of values • Bar chart • Block histogram • Bubble chart See parts of a whole • Pie Chart • Tree Map • Analyze a text • Word tree • Wordle See the world • Mapping 8-Aug-12 NeST Controlled/Confidential 4
- 5. Timeline Source: The Economist 8-Aug-12 NeST Controlled/Confidential 5
- 6. Better Representation Source: www.cia.gov 9876546765 987-654-6765 8-Aug-12 NeST Controlled/Confidential 6
- 7. Better Representation Source: The New York Times 8-Aug-12 NeST Controlled/Confidential 7
- 8. The volcano 8-Aug-12 NeST Controlled/Confidential 8
- 9. Create your own visual Tag Cloud, NSF proposals Source: www.wordle.net George K. Thiruvathukal, Associate Editor in Chief Computing in Science & Engineering 8-Aug-12 NeST Controlled/Confidential 9
- 10. Create your own visual Created in R with wordcloud package. Data from country population. Note that the proportional sizes of China and India were reduced in half. 8-Aug-12 NeST Controlled/Confidential 10
- 11. Big Data • With the exponential growth in data acquisition and generation. • High-resolution sensors • More disk space and more CPU cycles... • You know, there are couple of walls around the CPU, • and GPUs come into picture! 8-Aug-12 NeST Controlled/Confidential 11
- 12. How to go around • Need to bring in better methods for extracting a smaller set of relevant data • Big Data isn’t just about numbers or volume, but the trends – how they change over time. • Visualisation is an invaluable tool in identifying trends within massive data sets. • spotting anomalies as well as outliers 8-Aug-12 NeST Controlled/Confidential 12
- 13. Calling in Maths • Scientific Data Analysis techniques • Numerical Linear Algebra • SVD - The prize, compression • PCA/ NLPCA – to reduce the dimensionality, feature extraction Latent Semantic Indexing (LSI) • SVM - classification, regression, and anomaly detection. • SOM - neural network algorithm based on unsupervised learning 8-Aug-12 NeST Controlled/Confidential 13
- 14. Log plots • Response to skewness towards large values; i.e., cases in which one or a few points are much larger than the bulk of the data. • To show percent change or multiplicative factors. • Base of ten is useful when the data range over several orders of magnitude, a base of two is useful when the data have a smaller range 8-Aug-12 NeST Controlled/Confidential 14
- 15. Better Mixing + =? 8-Aug-12 NeST Controlled/Confidential 15
- 16. Visual data Mining Source: S.J. Simoff et al. (Eds.): Visual Data Mining, LNCS 4404 8-Aug-12 NeST Controlled/Confidential 16
- 17. Advanced technology 8-Aug-12 NeST Controlled/Confidential 17
- 18. Hans Rosling... ...What’s next? 8-Aug-12 NeST Controlled/Confidential 18
- 19. Thank you!!! 8-Aug-12 NeST Controlled/Confidential 19