SlideShare a Scribd company logo
Network Characteristics of Cloud Architecture1
Performance Dimensions
2
¨  Application performance differs according to perspective.
¤  For a user, an ideal application would deliver high performance
and responsiveness.
¤  For an administrator, an ideal application would consume the
least amount of network resources.
¨  Performance also differs based on application type.
¤  Performance for a bulk file transfer application might have
different implications than performance for a transactional
application.
Stakeholders: Users and Administrators
¨  Users want applications to be fast
and predictable.
¨  Users judge application performance
by their experience:
¤  Is the application quick to respond?
¤  Is an hourglass icon/pinwheel
displayed while background
operations are carried out?
¤  Does the application launch and close
quickly?
¤  Are errors handled in an
understandable way?
¨  Administrators want applications to scale.
¨  Administrators often judge an
application's performance on how
efficiently it uses network resources.
¨  Administrators may ask:
¤  Does the application have low overhead
and efficient network usage?
¤  Are the minimum number of connections
used, so my server can service as many
users at once as possible?
¤  Am I constantly calling helpdesk?
3
Measuring application performance
4
¨  Round Trip Time (RTT)
¤  Time for a request to make a trip from a source to a destination and back
¤  Factors affecting RTT:
n  Network infrastructure, distance between nodes, network conditions, and packet size,
congestion payload compressibility, forward error correction and data compression
¨  Goodput
¤  Measure of useful application data successfully processed by the receiver, in
bits-per-second.
n  Enables the measurement of effective or useful throughput and includes only
application data
n  Packet, protocol, and media headers are considered overhead, and are not part of
goodput
Measuring application performance
5
¨  Protocol Overhead
¤  Non-application bytes (protocol and media framing) divided by the total
number of bytes transmitted (expressed as percent).
¨  Bandwidth-Delay Product
¤  Bits-per-second bandwidth of the network X the RTT (in seconds)
¤  # of bits it takes to fill available network bandwidth
¤  When the value for bandwidth-delay product is high, the TCP/IP stack must
handle large amounts of unacknowledged data in order to keep the pipeline full
¤  A key end-to-end metric for streaming applications
Network Characteristics of Cloud Apps
6
¨  Network/protocol characteristics of cloud apps
depend broadly on the app type
¨  Transactional versus Streaming Apps
¤  Transactional apps are also called interactive
¤  Streaming apps are also referred to as batch
processing applications
Environmental Factors
7
¨  Application that perform fine on a
local computer may cause significant
performance degradation/resource
consumption when run across a
network
¨  Environment affects application
performance
¤  Transactional applications are more
sensitive to RTT
¤  Streaming applications are more sensitive
to bandwidth-delay product
LAN
Dial up Satellite / WAN
Internet and
VPN
LOW HIGH
LOW
HIGH
Bandwidth
RTT
Transactional versus Streaming Apps
¨  Transactional applications
¤  Stop-and-go
¤  Perform request/reply
operations
n  Data is ordered (often)
¤  Examples
n  synchronous remote
procedure call (RPC)
n  some HTTP and (DNS)
implementations
¨  Streaming applications
¤  Move data
¤  Pedal-to-the-metal data
transmission philosophy
n  Less concern for data
ordering
¤  Examples
n  network backup
n  file transfer protocol (FTP)
8
Avoidable Behaviors
9
¨  Chatty Applications
¤  Some applications perform many small transactions. When combined with the network overhead
associated with each such transaction, the effect is multiplied. In networking, small transactions can
consume as many resources and as much time as large transactions. A better approach is to combine
many small transactions into a single large transaction.
¨  Serialized Transactions
¤  Unnecessary serialization of transactions can result in poor performance, and affect scalability. For
example, 1000 serialized transactions take at least 1000 * RTT to complete. A better approach is to
run unrelated transactions in parallel
¨  Fat Transactions
¤  Applications that send unnecessary bytes on the network are considered fat applications. Applications
that send unnecessary bytes on the network increase network overhead, and performance is hampered.
This situation often comes from inefficient data structures or inefficient data streaming. To remedy this,
optimize data structures, or consider using compression
Questions and discussion on topic
10
11
Thank you.

More Related Content

PDF
Effective Service Mesh to turbocharge Cloud Resiliency
PDF
NETFLOW ANALYZER 9600 - AN OVERVIEW
PDF
Grinding the java monolith
PPTX
Solving Complex Scaling Problems by Prashant Kumar and Abhishek Jain of Myntr...
PPTX
Rust and Redis - Solving Problems for Kubernetes by Ravi Jagannathan of VMwar...
PDF
Digital transformation: Highly resilient streaming architecture and strategie...
PDF
Monitoring Network Performance in China
PDF
DNMTT - Synchrophasor Data Delivery Efficiency GEP Testing Results at Peak RC
Effective Service Mesh to turbocharge Cloud Resiliency
NETFLOW ANALYZER 9600 - AN OVERVIEW
Grinding the java monolith
Solving Complex Scaling Problems by Prashant Kumar and Abhishek Jain of Myntr...
Rust and Redis - Solving Problems for Kubernetes by Ravi Jagannathan of VMwar...
Digital transformation: Highly resilient streaming architecture and strategie...
Monitoring Network Performance in China
DNMTT - Synchrophasor Data Delivery Efficiency GEP Testing Results at Peak RC

What's hot (20)

PPTX
OpManager training - Device discovery and classification.
PDF
momentum dns security case study
PPTX
Network and server performance monitoring training
PDF
PLNOG15: Network Monitoring&Data Analytics at 10/40/100GE speeds. Why spend a...
PPTX
Free training on NCM - Discovery & Disaster recovery
PDF
CROC'S VIRTUAL DATA CENTER
PDF
Continuous Intelligence for Customer Service Using Kafka Event Streams | Simo...
PDF
Software Defined Networking - 1
PPTX
Advanced Change Data Streaming Patterns in Distributed Systems | Gunnar Morli...
PDF
Software Defined Networking - 2
PDF
Fan-out, fan-in & the multiplexer: Replication recipes for global platform di...
PDF
Work is a Stream of Applications (Audun Strand, NAV) Kafka Summit London 2019
PDF
Software Defined Networking - 3
PDF
RedHat MRG and Infinispan for Large Scale Integration
PDF
Kafka Summit NYC 2017 - Stream it Together: 3 Realities of Modern Programming
PPTX
Fast and secure protocol (fasp)
PDF
Accela Ericsson Rehome Module
PPT
地产知识.ppt
PDF
RedSplice_Network_Traffic_Examiner_Datasheet
PDF
A Review on Congestion Control Approaches for Real-Time Streaming Application...
OpManager training - Device discovery and classification.
momentum dns security case study
Network and server performance monitoring training
PLNOG15: Network Monitoring&Data Analytics at 10/40/100GE speeds. Why spend a...
Free training on NCM - Discovery & Disaster recovery
CROC'S VIRTUAL DATA CENTER
Continuous Intelligence for Customer Service Using Kafka Event Streams | Simo...
Software Defined Networking - 1
Advanced Change Data Streaming Patterns in Distributed Systems | Gunnar Morli...
Software Defined Networking - 2
Fan-out, fan-in & the multiplexer: Replication recipes for global platform di...
Work is a Stream of Applications (Audun Strand, NAV) Kafka Summit London 2019
Software Defined Networking - 3
RedHat MRG and Infinispan for Large Scale Integration
Kafka Summit NYC 2017 - Stream it Together: 3 Realities of Modern Programming
Fast and secure protocol (fasp)
Accela Ericsson Rehome Module
地产知识.ppt
RedSplice_Network_Traffic_Examiner_Datasheet
A Review on Congestion Control Approaches for Real-Time Streaming Application...
Ad

Similar to Network characteristics of the cloud (20)

PPT
Chapter 2 - Analyzing Technical Goals and Tradeoffs.ppt
PPT
PDF
Your Applications Are Distributed, How About Your Network Analysis Solution?
PPT
Advanced Computer Networks Lecture 2.ppt
PPT
Chapter02
PDF
A COMPREHENSIVE SOLUTION TO CLOUD TRAFFIC TRIBULATIONS
PDF
A COMPREHENSIVE SOLUTION TO CLOUD TRAFFIC TRIBULATIONS
PDF
A COMPREHENSIVE SOLUTION TO CLOUD TRAFFIC TRIBULATIONS
PDF
A COMPREHENSIVE SOLUTION TO CLOUD TRAFFIC TRIBULATIONS
PDF
A COMPREHENSIVE SOLUTION TO CLOUD TRAFFIC TRIBULATIONS
PPTX
High performance browser networking ch1,2,3
PPTX
Chapter04
PPTX
Managing a Widely Distributed Network
PPT
service methodology, service description, service characteristics, performanc...
PDF
Computer network physical layer
PDF
A3: application-aware acceleration for wireless data networks
PDF
Going Cloud, Going Mobile: Will Your Network Drag You Down?
PPT
Cp7101 design and management of computer networks-requirements analysis
PPTX
Internet Architecture and Design Philosophy
PDF
Application-Aware Acceleration for Wireless Data Networks: Design Elements an...
Chapter 2 - Analyzing Technical Goals and Tradeoffs.ppt
Your Applications Are Distributed, How About Your Network Analysis Solution?
Advanced Computer Networks Lecture 2.ppt
Chapter02
A COMPREHENSIVE SOLUTION TO CLOUD TRAFFIC TRIBULATIONS
A COMPREHENSIVE SOLUTION TO CLOUD TRAFFIC TRIBULATIONS
A COMPREHENSIVE SOLUTION TO CLOUD TRAFFIC TRIBULATIONS
A COMPREHENSIVE SOLUTION TO CLOUD TRAFFIC TRIBULATIONS
A COMPREHENSIVE SOLUTION TO CLOUD TRAFFIC TRIBULATIONS
High performance browser networking ch1,2,3
Chapter04
Managing a Widely Distributed Network
service methodology, service description, service characteristics, performanc...
Computer network physical layer
A3: application-aware acceleration for wireless data networks
Going Cloud, Going Mobile: Will Your Network Drag You Down?
Cp7101 design and management of computer networks-requirements analysis
Internet Architecture and Design Philosophy
Application-Aware Acceleration for Wireless Data Networks: Design Elements an...
Ad

More from Cloud Genius (8)

PDF
Cloud computing Security
PDF
Netflix cloud architecture...continued
PDF
From DVD in the mail to Streaming from the Cloud
PDF
Architecting applications in the AWS cloud
PDF
Meeting application performance needs: Scaling up versus scaling out
PDF
Understanding application requirements
PDF
Understanding business_requirements: Security_legal_compliance_budgets
PDF
1. introduction to_cloud_services_architecture
Cloud computing Security
Netflix cloud architecture...continued
From DVD in the mail to Streaming from the Cloud
Architecting applications in the AWS cloud
Meeting application performance needs: Scaling up versus scaling out
Understanding application requirements
Understanding business_requirements: Security_legal_compliance_budgets
1. introduction to_cloud_services_architecture

Recently uploaded (20)

PPT
“AI and Expert System Decision Support & Business Intelligence Systems”
PPTX
Programs and apps: productivity, graphics, security and other tools
PPTX
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
PDF
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
PDF
Dropbox Q2 2025 Financial Results & Investor Presentation
PDF
Empathic Computing: Creating Shared Understanding
PDF
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
PDF
Approach and Philosophy of On baking technology
PDF
Agricultural_Statistics_at_a_Glance_2022_0.pdf
PDF
Building Integrated photovoltaic BIPV_UPV.pdf
PDF
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
PDF
Advanced methodologies resolving dimensionality complications for autism neur...
PDF
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
PPTX
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
PDF
Encapsulation theory and applications.pdf
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
PDF
MIND Revenue Release Quarter 2 2025 Press Release
PDF
Chapter 3 Spatial Domain Image Processing.pdf
PDF
Review of recent advances in non-invasive hemoglobin estimation
PDF
KodekX | Application Modernization Development
“AI and Expert System Decision Support & Business Intelligence Systems”
Programs and apps: productivity, graphics, security and other tools
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
Dropbox Q2 2025 Financial Results & Investor Presentation
Empathic Computing: Creating Shared Understanding
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
Approach and Philosophy of On baking technology
Agricultural_Statistics_at_a_Glance_2022_0.pdf
Building Integrated photovoltaic BIPV_UPV.pdf
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
Advanced methodologies resolving dimensionality complications for autism neur...
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
Encapsulation theory and applications.pdf
Per capita expenditure prediction using model stacking based on satellite ima...
MIND Revenue Release Quarter 2 2025 Press Release
Chapter 3 Spatial Domain Image Processing.pdf
Review of recent advances in non-invasive hemoglobin estimation
KodekX | Application Modernization Development

Network characteristics of the cloud

  • 1. Network Characteristics of Cloud Architecture1
  • 2. Performance Dimensions 2 ¨  Application performance differs according to perspective. ¤  For a user, an ideal application would deliver high performance and responsiveness. ¤  For an administrator, an ideal application would consume the least amount of network resources. ¨  Performance also differs based on application type. ¤  Performance for a bulk file transfer application might have different implications than performance for a transactional application.
  • 3. Stakeholders: Users and Administrators ¨  Users want applications to be fast and predictable. ¨  Users judge application performance by their experience: ¤  Is the application quick to respond? ¤  Is an hourglass icon/pinwheel displayed while background operations are carried out? ¤  Does the application launch and close quickly? ¤  Are errors handled in an understandable way? ¨  Administrators want applications to scale. ¨  Administrators often judge an application's performance on how efficiently it uses network resources. ¨  Administrators may ask: ¤  Does the application have low overhead and efficient network usage? ¤  Are the minimum number of connections used, so my server can service as many users at once as possible? ¤  Am I constantly calling helpdesk? 3
  • 4. Measuring application performance 4 ¨  Round Trip Time (RTT) ¤  Time for a request to make a trip from a source to a destination and back ¤  Factors affecting RTT: n  Network infrastructure, distance between nodes, network conditions, and packet size, congestion payload compressibility, forward error correction and data compression ¨  Goodput ¤  Measure of useful application data successfully processed by the receiver, in bits-per-second. n  Enables the measurement of effective or useful throughput and includes only application data n  Packet, protocol, and media headers are considered overhead, and are not part of goodput
  • 5. Measuring application performance 5 ¨  Protocol Overhead ¤  Non-application bytes (protocol and media framing) divided by the total number of bytes transmitted (expressed as percent). ¨  Bandwidth-Delay Product ¤  Bits-per-second bandwidth of the network X the RTT (in seconds) ¤  # of bits it takes to fill available network bandwidth ¤  When the value for bandwidth-delay product is high, the TCP/IP stack must handle large amounts of unacknowledged data in order to keep the pipeline full ¤  A key end-to-end metric for streaming applications
  • 6. Network Characteristics of Cloud Apps 6 ¨  Network/protocol characteristics of cloud apps depend broadly on the app type ¨  Transactional versus Streaming Apps ¤  Transactional apps are also called interactive ¤  Streaming apps are also referred to as batch processing applications
  • 7. Environmental Factors 7 ¨  Application that perform fine on a local computer may cause significant performance degradation/resource consumption when run across a network ¨  Environment affects application performance ¤  Transactional applications are more sensitive to RTT ¤  Streaming applications are more sensitive to bandwidth-delay product LAN Dial up Satellite / WAN Internet and VPN LOW HIGH LOW HIGH Bandwidth RTT
  • 8. Transactional versus Streaming Apps ¨  Transactional applications ¤  Stop-and-go ¤  Perform request/reply operations n  Data is ordered (often) ¤  Examples n  synchronous remote procedure call (RPC) n  some HTTP and (DNS) implementations ¨  Streaming applications ¤  Move data ¤  Pedal-to-the-metal data transmission philosophy n  Less concern for data ordering ¤  Examples n  network backup n  file transfer protocol (FTP) 8
  • 9. Avoidable Behaviors 9 ¨  Chatty Applications ¤  Some applications perform many small transactions. When combined with the network overhead associated with each such transaction, the effect is multiplied. In networking, small transactions can consume as many resources and as much time as large transactions. A better approach is to combine many small transactions into a single large transaction. ¨  Serialized Transactions ¤  Unnecessary serialization of transactions can result in poor performance, and affect scalability. For example, 1000 serialized transactions take at least 1000 * RTT to complete. A better approach is to run unrelated transactions in parallel ¨  Fat Transactions ¤  Applications that send unnecessary bytes on the network are considered fat applications. Applications that send unnecessary bytes on the network increase network overhead, and performance is hampered. This situation often comes from inefficient data structures or inefficient data streaming. To remedy this, optimize data structures, or consider using compression