LSPE Meetup talk on Graphite
2 likes5,211 views
Graphite is a tool designed for real-time graphing and visualization rather than monitoring, enabling users to create complex graphs from various data sources with a focus on ad-hoc capabilities. It supports horizontal scalability, rapid prototyping, and integration with various data storage solutions, though it lacks dashboard functionalities and hover details. Future developments include enhancing APIs and introducing new components like Ceres for better data visualization and interaction.
LSPE Meetup talk on Graphite
- 1. Realtime Enterprise Graphing and Visualization with Graphite Dave Mangot tech.mangot.com www.tagged.com
- 2. Graphite Overview Not monitoring, graphing!
- 3. Complex graph creation Web / Dashboard, “CLI” and API interfaces
- 7. Oooh...
- 8. Ahhh...
- 9. What Graphite Provides EASY to get data into visualization tool from any source
- 10. Zooming on arbitrary time periods
- 11. Ability to create ad-hoc graphs from ANY metric
- 12. Metric Storage
- 14. Graphite Pros Horizontally scalable
- 15. Rapid graph prototyping (CLI)
- 16. Graph disparate data points
- 17. Numerous formulas available (derive, transform, average, sum, etc... )
- 18. Share graphs with other users
- 19. Supports existing RRD databases
- 20. Empower any user to create their own graphs, no advance configuration required
- 21. Graphite Cons Not a dashboard
- 22. No hover details
- 23. No collector
- 24. Unfortunate name
- 26. Demo Time!
- 28. Getting data into Graphite Java: Socket socket = new Socket( "graphite01" , 2003 ); PrintStream printStream = new PrintStream(socket.getOutputStream()); printStream.println("tagged.sitemon.active_users" + country + " " + count + " " + (int) (System.currentTimeMillis() / 1000)); Perl: sub graphite_submit { my $path = shift; my $values = shift; # hash ref of values by name my $time = shift; $time = time() unless defined($time); my ($host, $port) = qw(localhost 2003); my $sock = IO::Socket::INET->new( PeerAddr => $host, PeerPort => $port, Proto => 'tcp', ); die "Could not connect to $host:$port : $!\n" unless defined($sock); foreach my $key (keys %$values) { print $sock "$path.$key $values->{$key} $time\n"; } } Shell! $echo tagged.sample.data.point1 31337 `date +%s` | nc -w 3 graphite01 2003
- 29. Coming Attractions Ceres – replaces Whisper
- 30. Dashboard – give targeted view of the data
- 32. API improvements
- 33. Multiple Y axes
- 34. Cool things folks are doing with Graphite ESNet: Written by John Dugan
- 35. Takes data from EsxSNMP and NetAlmanac
- 36. Integrates with Internal Java tool for event correlation JMXtrans: (http://code.google.com/p/jmxtrans/) Written by Jon Stevens
- 37. writers for Graphite (recommended), cacti/rrdtool and stdout
- 38. Cool things folks are doing with Graphite Esty Statsd: https://github.com/etsy/statsd
- 39. Inspired by Flickr project
- 40. “A network daemon for aggregating statistics, rolling them up, then sending them to graphite.”
- 42. Can do counting, timing, sampling
- 43. Flushes to Graphite on interval
- 44. Cool things folks are doing with Graphite Rocksteady: http://code.google.com/p/rocksteady/
- 45. Graphite can consume AMQP
- 46. Integrates with Esper (http://esper.codehaus.org/)
- 47. Special Thanks Chris Davis Jason Dixon Corey Hickey Yaakov Nemoy Gary Larsen
Editor's Notes
- #3: Not Nagios, other monitoring, fooled ya
- #11: Who has heard of or knows what a key value pair is? How about epoch time or unix time? Then you can use graphite.
- #13: Ceres does not use space for time periods which contain no datapoints, uses 33% less disk space, able to store the datapoints for a single metric across multiple servers. Dashboard trunk: Save graphs drag'n'drop reordering & merging graphs, all the composer features are there (graph options, functions, etc) plus a few more (breakout a graph with wildcards into separate graphs,