Monitoring with exometer at AdRoll
1 like2,471 views
The document discusses the use of Exometer for monitoring VM statistics and application-specific metrics with minimal resource impact. It covers key concepts such as metrics, entries, reporters, and subscriptions, alongside examples of creating these components. The text also highlights the ease of adding custom reporters and the responsiveness of the authors to issues.
![C R E AT I N G E N T R I E S
exometer:new([rtb,bodhi,metrics_srv,packets_in],
histogram,
[{time_span, timer:seconds(60)}])
!
exometer:new([erlang, system_info],
{function, erlang, system_info, ['$dp'], value,
[port_count, process_count, thread_pool_size]}])](https://image.slidesharecdn.com/monitoringwithexometeratadroll-140201195854-phpapp01/85/Monitoring-with-exometer-at-AdRoll-8-320.jpg)
![C R E AT I N G S U B S C R I P T I O N S
{ report,
[{ subscribers,
[ { exometer_report_statsd, [rtb, bodhi, metrics_srv, packets_in], max,
1000, true }
, { exometer_report_statsd, [rtb, bodhi, metrics_srv, packets_in], median,
1000, true }
, { exometer_report_statsd, [rtb, bodhi, metrics_srv, packets_in], mean,
1000, true }
, { exometer_report_statsd, [erlang, system_info], port_count, 10000, true }
…](https://image.slidesharecdn.com/monitoringwithexometeratadroll-140201195854-phpapp01/85/Monitoring-with-exometer-at-AdRoll-9-320.jpg)
![C R E AT I N G R E P O R T E R S
{ reporters,
[{ exometer_report_statsd,
[{hostname, "localhost"}, {port, 8125},
{type_map,
[ { [rtb, bodhi, metrics_srv, packets_in, max], gauge }
, { [rtb, bodhi, metrics_srv, packets_in, median], gauge }
, { [rtb, bodhi, metrics_srv, packets_in, mean], gauge }
, { [erlang, system_info, port_count], gauge }
…](https://image.slidesharecdn.com/monitoringwithexometeratadroll-140201195854-phpapp01/85/Monitoring-with-exometer-at-AdRoll-10-320.jpg)
Monitoring with exometer at AdRoll
- 1. AN ONGOING LOVE STORY E X P E R I E N C E R E P O R T: M O N I T O R I N G W I T H E X O M E T E R AT A D R O L L
- 2. W H AT ARE WE LOOKING FOR?
- 3. • VM statistics • Application-specific statistics • Configurable reporting to multiple backends • Very low impact in terms of CPU time, memory consumption and network bandwidth
- 4. W H AT ARE WE T RY I N G TO AV O I D ?
- 5. • VM killers • Application performance regressions • Abnormal application behavior • Surprises
- 6. How do you use exometer?
- 7. I M P O R TA N T T E R M S • METRIC: a measurement • ENTRY: a receiver and aggregator of metrics • REPORTER: an entity which samples entries on a regular interval and optionally ships these samples onto a thirdsystem • SUBSCRIPTION: the definition of the regular interval on which reporters sample entries
- 8. C R E AT I N G E N T R I E S exometer:new([rtb,bodhi,metrics_srv,packets_in], histogram, [{time_span, timer:seconds(60)}]) ! exometer:new([erlang, system_info], {function, erlang, system_info, ['$dp'], value, [port_count, process_count, thread_pool_size]}])
- 9. C R E AT I N G S U B S C R I P T I O N S { report, [{ subscribers, [ { exometer_report_statsd, [rtb, bodhi, metrics_srv, packets_in], max, 1000, true } , { exometer_report_statsd, [rtb, bodhi, metrics_srv, packets_in], median, 1000, true } , { exometer_report_statsd, [rtb, bodhi, metrics_srv, packets_in], mean, 1000, true } , { exometer_report_statsd, [erlang, system_info], port_count, 10000, true } …
- 10. C R E AT I N G R E P O R T E R S { reporters, [{ exometer_report_statsd, [{hostname, "localhost"}, {port, 8125}, {type_map, [ { [rtb, bodhi, metrics_srv, packets_in, max], gauge } , { [rtb, bodhi, metrics_srv, packets_in, median], gauge } , { [rtb, bodhi, metrics_srv, packets_in, mean], gauge } , { [erlang, system_info, port_count], gauge } …
- 11. OTHER NICE THINGS • Very easy to add your own reporters and entries. • Reporters and entries can be proprietary. Just have to be loaded at runtime. • Authors are responsive to issues.
- 12. W H Y N O T… …FOLSOM? … S TAT M A N ? … V M S TAT ?
- 13. Things that don’t quite work.
- 14. QUESTIONS? <3
- 15. CONCERNS? >:(
- 17. ps. Come see me talk at Erlang Factory SF Bay on this very subject!