Data Visualization Tools and Techniques for Datasets in Big Data

International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056
Volume: 04 Issue: 08 | Aug -2017 www.irjet.net p-ISSN: 2395-0072
© 2017, IRJET | Impact Factor value: 5.181 | ISO 9001:2008 Certified Journal | Page 1667
Data Visualization Tools and Techniques For Datasets In Big Data
Arockia Panimalar.S 1, Komal M.Khule2, Karthika.S3, Nirmala Kumari.T4
1 Assistant Professor, Department of BCA & M.Sc SS, Sri Krishna Arts and Science College, Coimbatore, India
2,3,4 III BCA, Department of BCA & M.Sc SS, Sri Krishna Arts and Science College, Coimbatore, India
---------------------------------------------------------------------***---------------------------------------------------------------------
Abstract - The growth of data in the present world is
drastically increased, where tons of data is produced from
different fields. Due to this enormous growth of data the value
of data becomes an important factor in everyaspect. TheData
exploration and visualization systems play a vital role in the
Big Data era. It is a complex task for the companies to explore
and visualize verylarge datasets. Everycompany shouldfollow
some protocol to have accurate insight from analysis of large
volume of data. This strategy helps organizations to enhance
their process and to find the new product and service
opportunities that they may have otherwise missed. Inthis, we
explain the major prerequisites and challenges that should be
addressed by the recent explorationandvisualizationsystems.
It also describes about the different techniques and tools
currently used for the visualization of datasets and their
capabilities to support massive volume of data from variety of
data sources.
Key Words: Data Visualization, Big Data, SNA, BA, SMA,
BIA, BDA
1. INTRODUCTION
The term data analytics is also known as Data Analysis,
which is used to study raw data to gain knowledge aboutthe
information. The data analytics is used by the company can
gain the knowledge about the needs of the customers and to
improve the business strategies of the company. The
company can categorize the collected data from different
sources and they can be separated according to the patterns
and techniques for proper data analysis. The classifications
of data analysis are a) Social Network Analytics b) Business
Analytics c) Business Impact Analytics d) Big data Analytics
are some of the important analysis which is carried in the
present world for analyzing the data.
2. TYPES OF ANALYTICS
A. Social Network Analysis (SNA)
The qualitative and quantitative analysis process of the
social network such as (Facebook, Twitter, Research Gate,
LinkedIn etc) is carried in SNA. Such kind of method is done
to measure the activities of the customers. This process of
analyzing is done by monitoring their interaction through
chat, post, comments etc[1]. This type of social network
analysis can be carried in groups, community and
organization by measuring the flow of data among the
customers. It helps to provide the information in both
analysis methods like mathematical or visual so that they
can understand the needs of the customer and it also helps
to improve their business strategies.
B. Business Analytics (BA)
This type of analysis is used by the organization to measure
the performance of their company. It also carried for
evaluating their position in the market and to find where
they should improve their strategies. This type of analytics
uses statistical methods that can be applied for specific
product or process by the company. The main goal of
company to run the business analytics is to monitor their
flow of business and to identify the disadvantages of the
existing processes and highlight meaningful data[2]. This
helps the company to know the area of improving in their
business for future growth and to handle the challenges. The
business analytics plays a vital role to make decisions,
improves the business strategies to keep a business
competitive.
C. Social Media Analytics (SMA)
The term Social media analytics is used to collect and
analyze the data from different social Medias and blogs etc.
The monitoring of data is done after the data is collectedand
this strategy is used for improving the process of the
company and makes them to produce a better and quality
product. This analytics helps to understand the concept
carried in the business functions such as marketing,
customer service etc. It also helps to improve the customer
experience[2]. The Social Media Analytics is the best way to
understand real-time choices and behaviour of the
customers. The tactics followed by the organization or
company behind social media analytics is they can get
detailed information about customer base on a more
emotional level. The main task during the social media
analytics is to find out the which business objective can gain
profit to the company, the company maximizetheir earnings
by reducing the extra expenditure of the customer service,
the suggestions can be collected fromdifferentcustomers on
the services and products, it also able to enhance the
business strategy by collecting the public opinions about
their product which helps to improve the growth of the
company[3].

D. Business Impact Analysis (BIA)
The analytics carried by the businessimpacthelpsto identify
impact of critical and non-critical systems. The companycan
gain knowledge by processing the business analytics and
they can take some precautionary steps at the time of
disaster. This type analysis includes information about the
estimated recovery times and recovery requirement, it also
used for measuring the risks of failure against the costs of
upgrading a particular system, find out the major risks and
their fallout like losing all the data on the company main
servers[5]. These strategies should be carried out by every
organization so that it helps to improve their methodologies
and their strategies to understand the impact of their
decisions at present and into the future.
E. Big Data Analytics (BDA)
The very important type of analytic in the present world, is
known as big data analytics, which has the ability to analyze
massive volume of data. It refers to the strategy of analyzing
massive volumes of data, whichisknownbigdata.Theorigin
of big data can be collected anywhere, such as social
networking sites, the sensors used to collect climate data,
videos and digital images, sale transaction records and cell
phone GPS signals[6]. It helps to explore concealed patterns,
unidentified connections and provide accurate and valuable
information about the data. The main task of big data
analytics is to assist organizations in making better business
decisions. It also helps data scientists and other users to
evaluate or process massive volumesoftransactiondata and
other data sources, which might be not, exploited by
traditional Business Intelligence (BI) systems. This is
because traditional systems often fail to analyze large data
sources, which include Web server logs, social networking
activity reports, Internet click-stream data and sensor-
captured data. The regular data warehouse cannot be suited
to process big data. So they use some new technologies such
as Hadoop, MapReduce and NoSQL databases. This
technology is used for managing large volume of data in an
efficient way for analytics purpose. The big data analytics
helps to extract significant value from big data from the
overall analytics, and they have fast analyses of data. The
new type of visualizations and analytic techniques helps to
capitalize on the unique characteristics of big data.
3. DATA VISUALIZATION
The definition of data visualization explains the importance
of the data by placing the data in terms of visual context [5].
It involves the creation and study of the visual
representation of data which is known as information. The
data visualization provides the user to acquire more
knowledge about the raw data which is collected from the
variety of sources. The visualizationcanbedonebyusingthe
dashboards, where the undetected text, patterns and
correlations can be easily visualized by using the
visualization software. The main uses of data visualization
are:
A. Improve In Decision Making
The data visualization helps the organization to view their
position and the process carried by the organization.
According to the visualization and analyzes of data the
company can take better decision and they can also change
their business flow according to it[7].
B. Improvement In ROI
They can also increase the company ROI by knowing their
plus and minus of their business flow. Once analyzing
process is done the visualization gives the company a clear
idea about their mistake. By rectifying it the company can
have their increase in return on investment.
C. Information Sharing
The data visualization helps the company to gain knowledge
about their previous and present business flow. The plays a
vital role in improving the process to gain information from
the raw data and they can share to avoid misconceptions.
D. Time Saving
It is one of the main advantages of using data visualization in
company[8]. Instead of going for trail error method, the
company can identified the problem and the immediate
countermeasures is taken, so that the saving of time is done
by retrieving accurate insights of data in short span of time.
4. BIG DATA VISUALIZATION
The Big data visualization explains about the description of
data by providing the user with effective visualization
techniques. The real time data changes, complex data
processing results can be easily shown by using the big data
visualization. It can displayed in the form of charts, graphs
etc. The business people are forced to know about the every
piece of information about their data[9]. Some of the
important features of data visualization and the role of data
visualizations in big data environment are as follows:
A. Real-time Data Analysis
The most important feature of data visualization istheyplay
a vital role on real time data by providing deep insights to
the user about every pieceof informationaboutthedata[10].
So that the business people can make a better decision by
seeing the result displayed by the dashboards.

B. Dynamic Nature
The massive data collected from variety of sources can be
dynamic by changing the view in different types such as
graph (bar, line) charts (pie, bar) scatter plots etc.
C. Interactive Presentations
The usage of the data visualization tools by the company
provides them an interactive presentation of data with
reports. It displays all details about the data to the user, so
that the user can makes some effective changes according to
the result.
D. In-Memory
The data can be visualized by multiple users, so that each
user will produce different opinion inorder to improve their
business strategies[9]. Many types of data visualizations
result are stored in memory for easy access.
E. Secured
Most of the data displayed in big data environment will be
secured by putting some right access to the user. Some data
can be viewed by certain users to have security and the data
can be compressed to have low memory space.
5. ERRORS TO AVOID IN DATA VISUALIZATIONS
The data visualization inbigdata environmenthelpsthe user
to know about the value of data. But they also face some
complex problems while handling large volume of data in
bigdata environment[1]. Some of the error carried by the
business people while displaying the data and makes the
user or data analyst in trouble.
A. Exposing All Data
It is one of the errors occurred while carrying the data
visualization. The importance of data visualization is to give
a visual treat for the users and business people. It will give
the Knowledge aboutinsightsofthedata[12].Thedashboard
is used to give clear cut information, but some companies
will give a clumsy view of data. This kind of approach makes
the user in a confused state, where they can't get a proper
conclusion on the data.
B. Displaying Errors
It is another factor to be noted while visualizing data. The
company should know about the wrong side of their
business strategies. These methods help the company to
know the unnecessary data for making decision. The
problem facing while displaying the wrong data is they
makes the user to take incorrect decision[11].
C. Lack Of Planning
Before displaying the data,theorganizationshouldselect the
proper dashboard for displaying the data. This is because,
certain data can be displayed in the formofgraphsandit will
look worse if the user use some kind of inappropriate
dashboards. So they need a proper planning by selecting
effective and proper dashboards for displaying the data.
6. DATA VISUALIZATION TOOLS IN BIG DATA
A. Data Wrapper
It is used to create data visualization and make it very easy
for the end user to grasp the knowledge from the raw
data[9]. By using the data wrapper tool the user can easily
generate graph and it can be done by simple steps with good
web based GUI (Graphics User Interface).The user can save
time for creating visualizations. The user should upload the
data and they should choose which kindof visualizationthey
need for analyzing.
B. Dygraphs
It is one of the main data visualization tool used for
representing large volumeof data.They usejava scriptbased
charting library. Even though they use some scripting
language they are user friendly with an effective output
interface. The user can able to get knowledge due to its
flexibility interface. The user should have prior knowledge
about web programming to get started with a chart.
C. Chart JS
From the name we can understand that it data visualize is
carried in the form of chart [15]. The user should include the
library in your frontend code. Once the process is completed
the user can use the API from the library to work withcharts
and assign values.
D. Charted
It is simple to use and the user can upload their data file as
input data in .csv file format. If the user needs to customize
the chart, they should have simple coding knowledge for
fetching the data.
E. D3
The term D3 refers to the data driven documents. Itcontains
JavaScript library to help user bind random data to the DOM
(document object model). They have the ability to apply
data-driven transformations to the document. As you know,
DOM is a programming API that allows programmers to
access documents as objects. These objects indicate the
structure of document they need to model. The user should
know about programming knowledge for creating graphs.

The result can be generated in the form of HTML, CSS
documents and SVG.
F. Raw
It is a web-based tool that allows user to simply paste the
data. It has very simple steps for creating graphs. The Raw is
completely based on the D3.js library, which makes the user
to easily accessible, so that the user can have all components
in packed form of D3 into a format that is readyto be used by
non-programmers.
G. Timeline
Sometimes the user needs to analyze the data and display
events as sequential timelines. In this scenario timelinedata
visualization tool, helps user to complete the task [10]. The
user should need to do before goingtotimelinevisualization,
where they should change the format of data to timeline
template, inorder to have quick and effective result.
H. Leaflet
It is a lightweight mobile friendlydata visualizationtool used
to study the data generated by high traffic and good
conversion rates. It has JavaScript library to help user for
developing interactive maps [12]. It is simple to use and
works on both desktop and mobile with good performance.
I. Tableau
It is one of the important and most usable data visualization
tool in big data environment [8]. The user can gain
knowledge with their data, by creating charts, graphs, maps
and many other graphics [10]. It helps non-programmers
and business types to have deep insights and perfect data
ingestion; they can also have fast exploration with
interactivity, animation etc.
J. Infogram
It is used to access large data sets and it has three simple
step processes. The user can customizetheirvisualization by
selecting the perfect template and enhance them by having
their own idea like charts, map, images and even videos,and
you are ready to share your visualization.
K. ChartBlocks
It is an online tool that doesn't require any sort of
programming skills. The input data can be in databases, live
feeds and spreadsheets. The backend process is done in
HTML5 by using the powerful JavaScript library D3.js. The
visualizations will be responsive and compatible with any
screen size and device.
L. Plotly
It is very simple to use, where the user can create chart in
quick time. The input data can begivenfromthespreadsheet
[15]. The interface is very user-friendly and the user can
know the insights of data with short span of time.
M. Ember Charts
The name indicates that this tool is completely based on the
Ember.js framework and usesD3.jsunderthehood.Theyare
mostly used for visualize the data in the form time series,
bar, pie and scatter charts. The user can provide more
amounts of data and the availability is high, where they
won't crash when they have bad data on it.
N. NVD3
The NVD3 runs top of D3.js, where they have re-usable
charts and components. The main of using NVD3 is to
provide the user an easily understandable chart which can
be reusable and customize according to the need of the user.
O. FusionCharts
The java Script chart library is used for creating chart. The
user can build own chart in a simple way. It has 90 charts
and 900 maps and the FusionCharts integrates easily with
libraries like jQuery[16]. It also frameworks such as
AngularJS and React, and they can also support languages
like ASP.NET and PHP. JSON and XML data also used in
FusionCharts, the result can be derived in formats like PNG,
JPEG, SVG and PDF.
P. Highcharts
It is one of the main data visualization tool used by most
companies and it has JavaScript API that integrates easily
with jQuery. It also contains Highmaps and highstock for
carrying data visualization [11].
Q. Polymaps
The geographical related data which is generated from
country wide level can be visualize by using polymaps.It has
JavaScript library that uses SVG to represent geographical
data. The user can create a map with integrative data.
7. TECHNIQUES IN BIG DATA VISUALIZATION
The existing visualization methods for analyzing data canbe
categorized based on several factors. According to user task
or their requirements the visualization techniques are
decided [13]. The visualization techniques include 1D, 2D,
3D, multidimensional, temporal, tree, andnetwork.Theuser
tasks comprises of history, detailed representation of data,
general overview of data. Sometimes interaction/distortion

techniques are also used for visualize massive volume of
data. Some of the important data visualization techniques
used by the big data environment to get deep insights about
the large volume of data are discussed. Most of the
companies are using these techniquesforanalyzingthedata.
A. One Dimensional (1-D)
The data set which comes under the 1 d consists of one
variable and it has only a value per each data item. The
histograms are used for carrying data visualizations for one
dimensional data
B. Two Dimensional (2-D)
Mostly two dimensional is used for visualize the data set,
which contains two variables. It can be done easily by
knowing the relationship between two variables. The 2D
visualizations can be represented in the form of line graphs,
by comparing the relationship between two variables ad
plotting can be done according to it. The 2d can also be
represented in form of bar charts, area charts, pie charts,
maps, scatter plots and stream line andarrowvisualizations.
C. Three Dimensional (3-D)
The 3 d representation of data will give more knowledge to
the user, where they can easily find the merits and demerits
of their business flow, study etc. It contains values in three
dimensional spaces. it gives information in the form of
slicing techniques, 3D bar charts, Iso-surface and realistic
renderings.
D. Multi-Dimensional
The multi dimensional visualization gives the user a clear
idea in different perspective. The different techniques used
such as parallel coordinates, maps, scatterplot matrices,
auto-glyphs.
E. Temporal Technique
It is a technique, where most of the data can be easily
displayed and the temporal technique has the ability to
display the data in many views such as timeline, time series
and scatter plot.
F. Tree Map
It is also known as hierarchical model, where the data is
nested in form of rectangle and it represents each branch of
the tree[14]. The sub branch is represented as in form of
smaller rectangles and leaf node is used for describing the
specified dimensiononthedata.Sometimesthecoloured leaf
nodes are used to display a separate dimension of data. It
also provides the user a proper display of data in a
hierarchical manner.
G. Network Technique
It is mostly used for analyzing all kinds of data extracted
from variety of data fields. It has the ability to collect the
data in social media, website and blog and present in the
form of network. The end user can know which area has to
be improved and where the company gains more profit etc.
By gaining knowledge from these results the company will
have some global idea about their products and place
themselves in a better position in the market [13].
8. CONCLUSION
Data visualization may not be an exact solutionforanalyzing
the large volume of data, where they need to carry pre
process like proper extraction of data from variety of data
sources. They should know the 3v's of data such as volume,
variety, velocity and value. According to it, the company
should select the proper database, process, scripting
language and last the proper data visualization tool. These
strategies help the business peopletoknowthevalueof each
data and how to process the data and analyze it and how to
improve their business value. By using data visualization,
company can control and analyze the exact value of big data
by accelerating the understanding value of the data, gaining
deep insights and enabling the company executives to make
perfect and quick decisions on the advantageous business
opportunities.
9. REFERENCES
[1] C.L. Philip Chen, Chun-Yang Zhang "Data-intensive
applications, challenges, techniques and technologies: A
survey on Big Data" Information Sciences (2014) 314–347.
[2] T. Giri Babu Dr. G. Anjan Babu" A Survey on Data Science
Technologies & Big Data Analytics "International Journal of
Advanced Research in Computer Science and Software
Engineering Volume 6, Issue 2, February 2016
[3] Leishi Zhang, Andreas Stoffel, Michael Behrisch"Visual
Analytics for the Big Data Era – A Comparative Review of
State-of-the-Art Commercial Systems"
[4] Guo-Dao, Rong-Hua Liang, Shi-Xia Liu"A Survey of Visual
Analytics Techniques and Applications: State-of-the-Art
Research and Future Challenges" Journal Of Computer
Science and Technology 28(5): 852{867 Sept. 2013. DOI
10.1007/s11390-013-1383-8
[5] Ekaterina Olshannikova, Aleksandr Ometov, Yevgeni
Koucheryavy and Thomas Olsson"Visualizing Big Data with
Augmented and virtual reality: challenges and research
agenda"Journal of Big Data (2015) 2:22
[6] Likhitha Ravi, Qiping Yan, Sergiu M. Dascalu, Frederick C.
Harris, Jr." A Survey of Visualization Techniques and Tools
for Environmental Data"
[7] Shixia Liu, Weiwei Cui, YingcaiWu, Mengchen Liu "A
survey on information visualization: recent advances and
Challenges" Springer- 2014

[8] Mahalakshmi R, Suseela S "Big-SoSA: Social Sentiment
Analysis and Data Visualization on Big Data" International
Journal of Advanced Research in Computer and
Communication Engineering Vol. 4, Issue 4, April 2015
[9] S. Syed Fiaz, N. Asha, D. Sumathi, A.S. Syed Navaz “Data
Visualization: Enhancing Big Data More Adaptable and
Valuable " International Journal of Applied Engineering
Research ISSN 0973- 4562 Volume 11, Number 4 (2016) pp
2801-2804
[10] M. Khan, S.S. Khan, "Data and Information Visualization
Methods and Interactive Mechanisms: A Survey",
International Journal of ComputerApplications,34(1),2011,
pp. 1-14
[11] P. Simon, "The Visual Organization: Data Visualization,
Big Data, and the Quest for Better Decisions", Harvard
Business Review, June 13, 2014, pp. 1-8.
[12] C.L.P.Chen, C.-Y.Zhang "Data-intensive applications,
Challenges, Techniques and Technologies: A survey on Big
Data", Information Sciences, 275 (10), August 2014,pp.314-
347.
[13] B. Porter,” Visualizing Big Data in Drupal: Using Data
Visualizations to Drive Knowledge Discovery" Report,
University of Washington, October 2012, pp. 1-38.
[14] T. A. Keahey," Using visualization to understand big
data, Technical Report, IBM Corporation", 2013, pp. 1-16.
[15] P. Fox and J. Hendler," Changing the Equation on
Scientific Data Visualization", Science, 331(11), February
2011, pp. 705-708.
[16] B. Otjacques, UniGR Workshop:" BigData-Thechallenge
of visualizing big data", Gabriel Lippmann, 2013, pp. 1-24.

Data Visualization Tools and Techniques for Datasets in Big Data

More Related Content

What's hot (20)

Similar to Data Visualization Tools and Techniques for Datasets in Big Data (20)

More from IRJET Journal (20)

Recently uploaded (20)

Data Visualization Tools and Techniques for Datasets in Big Data