Network Visibility For Openstack Operations
3 likes1,366 views
This document discusses the importance of network visibility for efficient OpenStack operations. It outlines how Cisco collects data from OpenStack including network flows, logs, and metrics. This data is analyzed and visualized in AVOS to provide insights such as how workloads are performing, hotspots in the cloud, and virtual and physical status. Anomalies can be detected by classifying system states and analyzing patterns over multiple metrics. Future plans include incorporating more data sources and network distance metrics for more integrated analytics and data-driven diagnostics.
![© 2013 Cisco and/or its affiliates. All rights reserved.
Cisco
Confidential
Data insights - How to troubleshoot?
INFO org.apache.hadoop.hdfs.DFSClient: Exception in
createBlockOutputStream …
java.io.IOException: Bad connect ack with firstBadLink
as 192.168.0.7:…
INFO org.apache.hadoop.hdfs.DFSClient: Abandoning
blk_…
INFO org.apache.hadoop.hdfs.DFSClient: Excluding
datanode 192.168.0.7:…
WARNING nova.compute.manager … [instance:
6a475088-...] Instance shutdown by itself. Calling the
stop API." …](https://image.slidesharecdn.com/networkvisibilityatlanta2014-140514171959-phpapp02/85/Network-Visibility-For-Openstack-Operations-16-320.jpg)
Network Visibility For Openstack Operations
- 1. © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential Cisco Confidential© 2013 Cisco and/or its affiliates. All rights reserved. Network Visibility For Efficient OpenStack Operations
- 2. © 2013 Cisco and/or its affiliates. All rights reserved. Cisco ConfidentialCisco ConfidentialCisco Confidential© 2013 Cisco and/or its affiliates. All rights reserved. Cloud/Big-data Winnovation Team Alex Holden Damian Van VuurenAiling Zhang Marc Solanas Matt Weeks Pengfei Zhang Kai Zhang Xinyuan Huang Debo Dutta Yathiraj Udupi
- 3. © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential Today...
- 4. © 2013 Cisco and/or its affiliates. All rights reserved. Cisco ConfidentialCisco ConfidentialCisco Confidential© 2013 Cisco and/or its affiliates. All rights reserved.
- 5. © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential Outline • Data Gathering • Network Visibility • Network Analysis • Conclusion
- 6. © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential Virtual status Performance Why is my job slow? Operators Physical status Hotspots What are they doing in my cloud? Users
- 7. © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
- 8. © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential Network flows New ceilometer agent Collects and aggregates data from Neutron VM-VM flow traffic insight
- 9. © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential Application logs OpenStack Logs Server Syslogs VM Syslogs Application (Hadoop, etc) Logs ...
- 10. © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential AVOS: Analytics and Visualization on OpenStack Demo
- 11. © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential Cisco Confidential© 2013 Cisco and/or its affiliates. All rights reserved. Data Insights
- 12. © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential Data insights - What is going on in a Hadoop cluster? Networkflows(bit/s) Outgoing network flows from VMs Time (s) Time (s) Incoming network flows to VMs Networkflows(bit/s)
- 13. © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential Data insights - What is going on in a Hadoop cluster? Time (s) Networkflows(bit/s) Outgoing network flows master <-> slave
- 14. © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential Data insights - What is going on in a Hadoop cluster? Time (s) Networkflows(bit/s) Outgoing network flows slave <-> slave
- 15. © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential Data insights - How to troubleshoot? Normal Server down
- 16. © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential Data insights - How to troubleshoot? INFO org.apache.hadoop.hdfs.DFSClient: Exception in createBlockOutputStream … java.io.IOException: Bad connect ack with firstBadLink as 192.168.0.7:… INFO org.apache.hadoop.hdfs.DFSClient: Abandoning blk_… INFO org.apache.hadoop.hdfs.DFSClient: Excluding datanode 192.168.0.7:… WARNING nova.compute.manager … [instance: 6a475088-...] Instance shutdown by itself. Calling the stop API." …
- 17. © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential ● Collect Multiple Metrics ● Analyze Patterns ● Classify System States Data insights - How to detect anomalies?
- 18. © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential Future Plans Network Distance Data-driven Diagnostics More data sources & integrated analysis
- 19. © 2013 Cisco and/or its affiliates. All rights reserved. Cisco Confidential Thank you. Please take our survey: http://goo.gl/CMAZje Coming Talk: Storage Visibility and Optimization for OpenStack: Wednesday, May 14 • 3:30pm - 4:10pm