Internet/DNS
Measurements
Africa DNS Forum 2017
Josiah Chavula, Amreesh Phokeer
AFRINIC Ltd Research & Innovation
Overview
Internet Measurements
● Motivation for DNS Measurements
● RIPE Atlas measurements
● Tools, Techniques and Metrics
● Use Cases
Why Internet Measurements
● Monitor the performance of your network in real time from
thousands of vantage points
● Troubleshoot problems close to your customers
● Validate your peering strategies (e.g. TraceMON routing
anomalies)
● Plan your content distribution (e.g reachability and latency)
● Research (e.g. IPv6 and DNSSEC deployment and
performance)
• Large-scale monitoring of Authoritative DNS
(Roots, ccTLDs, etc…)
• automatically detect failures
• monitoring performance
• Determine which instances of a name server
clients/networks use
• assess the impact of issues with one or more root name
servers
DNS Measurements (Active Measurements)
Passive DNS Measurements
Analysis of zone files / resolvers’ data
• Prevalence of DNS Authoritative Name servers running V6
• DNS Resolvers: prevalence of resolvers requesting AAAA
records.
• DNS Queries: the distribution of actual IPv6-related DNS
queries.
Please share DNS data!
RIPE Atlas: Probes
•Global network of
"probes" to measure
Internet connectivity
•Monitor network
reachability from
hundreds of vantage
points
•Monitor
responsiveness of
DNS infrastructure,
such as root name
servers
RIPE Atlas: Anchors
•More powerful
probes, monitoring
regional
connectivity
•7 anchors in
Africa
Accessing Ripe Atlas: https://atlas.ripe.net
• Root Server Performance
• Server responsiveness
• Performance comparison between TCP and UDP
• Root Instances
• which root DNS server instance gets queried by clients
• Root server latencies
• compare response times for DNS SOA queries to all the
root DNS servers
DNS Measurements
DNSMON: monitoring root zone servers
DNSMON: monitoring root zone servers
DomainMON
- Up-to-date
performance
overview of your
DNS zone
DomainMON
- longitudinal
performance
overview of your
DNS zone
Root Server Performance
Performance
comparison between
TCP and UDP (ratio).
Which DNS root server instance is used by clients?
• measure "gravitational
radius" of root server
instances (for servers
employing anycasting)
• What is the latency of
different root server
instances?
Which root DNS server
instance is used by clients?
Example: Some South African client
experiences 482ms response time to
Sydney versus 39ms response time to
Cape Town
• Query for popular domain names to hit caches and local
resolvers where appropriate
Measuring end-user DNS experience?
DNS Latency
Visualization:
List latencies to a DNS
server per probe
DNS Latency
Visualization:
Latency-color-coded map of
probes
compare: 15ms versus 361ms DNS latency
• Compare multiple
latency trends to
resolvers
• Charts updated in
real time as data
is received from
the probes
LatencyMON
RIPE Atlas live streaming (https://atlas.ripe.net/docs/result-streaming/,
http://sg-pub.ripe.net/demo-area/atlas-stream/conn/ )
Receive measurement results as
soon as they are sent by the
probes
- Real-time connectivity monitoring
- Publish/subscribe through web
sockets
Three types of data:
- Measurement results
- Probe connection status events
- Measurements metadata
The Root Canary
• Measuring and monitoring the impact of the KSK rollover
• Track operational impact of the root KSK
• Measure validation during the KSK rollover from a global
perspective
• Gain immediate insight into which operators have
validation problems
• Monitor the state of DNSSEC validation from multiple
angles
• Ripe Atlas probes + test validation
• using signed and bogus records
Validation status based on RIPE Atlas probes that have
successfully executed tests (https://portal.rootcanary.org/rcmstats.html )
~ 0.6% validation
failures
• Monitoring DNS Propagation Time / DNS Consistency
• monitoring SOA timestamp propagation time
• looking at the moment when a change is made by one of the registrars,
and following how quickly these changes propagate.
• DNS resolver hijack checker
• how do we protect from “bad actors” on the Internet? How do we know
that DNS resolution is coming from the “proper” place?
• use RIPE Atlas probes to query a pre-set DNS record on your own server,
and use a public DNS resolver with known IP addresses; match the
responses; mark the probes that show inconsistent responses.
• Reverse DNS statistics
• dig into reverse DNS data: what percentage of delegations has issues
(lame), latency in domain object creation, coverage of address space with
reverse delegations.
Other DNS Use Cases (From Ripe Atlas Hackathon:
https://labs.ripe.net/Members/becha/results-dns-measurements-hackathon )
Web Interface Measurements (https://atlas.ripe.net/measurements/form/ )
RIPE Atlas Cousteau
• A python wrapper around RIPE Atlas API
- https://github.com/RIPE-NCC/ripe-atlas-cousteau
- pip install ripe.atlas.cousteau
• Manage measurements:
- Create a measurement
- Stop a measurement - Change probes involved
• Fetch results from API, streaming and probes
RIPE Atlas
Cousteau
+ Python
More about Ripe Atlas
• Atlas Tools: https://atlas.ripe.net/measurements-and-tools/tools/
• RESTfulAPI –
https://atlas.ripe.net/docs/measurement-creation-api/
• Atlas API description – https://atlas.ripe.net/docs/rest/
• AtlasAPI tutorial –
https://atlas.ripe.net/docs/measurement-creation-api/
• Public measurements – https://atlas.ripe.net/measurements/
• Map of results – https://atlas.ripe.net/results/maps/
• List of probes – https://atlas.ripe.net/probes/
• Geographical mapsof probes –
https://atlas.ripe.net/results/maps/network-coverage/
AFRINIC-27
27 November to 2nd
December 2017
Lagos, Nigeria
AFRICOMM 2017
International Workshop on Internet
Measurements Research in Africa
DECEMBER 11–12, 2017 | LAGOS,
NIGERIA
http://africommconference.org/2017/show/IMRA
Upcoming Internet Measurements Workshops

More Related Content

PDF
Testing Rolling Roots
PDF
Data Aggregation At Scale Using Apache Flume
PDF
RedisConf18 - Active-Active Geo-Distributed Apps with Redis CRDTs (conflict f...
PPTX
RedisConf18 - Application of Redis in IOT Edge Devices
PDF
Rolling the Root Zone DNSSEC Key Signing Key
PDF
Big Data Day LA 2015 - Always-on Ingestion for Data at Scale by Arvind Prabha...
PPTX
Fraud Detection Architecture
PDF
Stream Processing Everywhere - What to use?
Testing Rolling Roots
Data Aggregation At Scale Using Apache Flume
RedisConf18 - Active-Active Geo-Distributed Apps with Redis CRDTs (conflict f...
RedisConf18 - Application of Redis in IOT Edge Devices
Rolling the Root Zone DNSSEC Key Signing Key
Big Data Day LA 2015 - Always-on Ingestion for Data at Scale by Arvind Prabha...
Fraud Detection Architecture
Stream Processing Everywhere - What to use?

What's hot (20)

PDF
Using ~300 Billion DNS Queries to Analyse the TLD Name Collision Problem
PDF
What no one tells you about writing a streaming app
PPTX
Streaming in the Wild with Apache Flink
PPTX
Dealing with an Upside Down Internet
PDF
Hadoop application architectures - using Customer 360 as an example
PPTX
Free Code Friday - Spark Streaming with HBase
PDF
Introduction to Apache NiFi And Storm
PDF
Architecting a next generation data platform
PPTX
Embeddable data transformation for real time streams
PDF
Streaming architecture patterns
PPTX
Bridging the gap of Relational to Hadoop using Sqoop @ Expedia
PPTX
Design Patterns For Real Time Streaming Data Analytics
PPTX
Design Patterns For Real Time Streaming Data Analytics
PDF
Architecting next generation big data platform
PDF
Hadoop application architectures - Fraud detection tutorial
PPTX
In Flux Limiting for a multi-tenant logging service
PPTX
Tracking Crime as It Occurs with Apache Phoenix, Apache HBase and Apache NiFi
PPTX
Real time fraud detection at 1+M scale on hadoop stack
PPTX
Faster, Faster, Faster: The True Story of a Mobile Analytics Data Mart on Hive
PPTX
Using Spark Streaming and NiFi for the next generation of ETL in the enterprise
Using ~300 Billion DNS Queries to Analyse the TLD Name Collision Problem
What no one tells you about writing a streaming app
Streaming in the Wild with Apache Flink
Dealing with an Upside Down Internet
Hadoop application architectures - using Customer 360 as an example
Free Code Friday - Spark Streaming with HBase
Introduction to Apache NiFi And Storm
Architecting a next generation data platform
Embeddable data transformation for real time streams
Streaming architecture patterns
Bridging the gap of Relational to Hadoop using Sqoop @ Expedia
Design Patterns For Real Time Streaming Data Analytics
Design Patterns For Real Time Streaming Data Analytics
Architecting next generation big data platform
Hadoop application architectures - Fraud detection tutorial
In Flux Limiting for a multi-tenant logging service
Tracking Crime as It Occurs with Apache Phoenix, Apache HBase and Apache NiFi
Real time fraud detection at 1+M scale on hadoop stack
Faster, Faster, Faster: The True Story of a Mobile Analytics Data Mart on Hive
Using Spark Streaming and NiFi for the next generation of ETL in the enterprise
Ad

Similar to DNS Measurements (20)

PDF
DINR 2021 Virtual Workshop: Passive vs Active Measurements in the DNS
PDF
Monitoring DNS Records and Servers
PDF
Measuring CDN performance and why you're doing it wrong
PDF
DNS in IR: Collection, Analysis and Response
PDF
Never Stop Exploring - Pushing the Limits of Solr: Presented by Anirudha Jadh...
PDF
Authoritative Nameserver Selection and Recursive Resolvers
PDF
Measuring CDN performance and why you're doing it wrong
PDF
1 technical-dns-workshop-day1
PPTX
6421 b Module-03
PDF
NZNOG 2013 - Experiments in DNSSEC
PPTX
Abuse of DNS wildcards in China - from passiveDNS perspective
PPTX
How DNS works and How to secure it: An Introduction
PDF
ION Hangzhou - Why Deploy DNSSEC?
PDF
CNIT 40: 4: Monitoring and detecting security breaches
PDF
DNS Survival Guide
PDF
DNS Survival Guide.
PDF
Internet Week 2018: 1.1.1.0/24 A report from the (anycast) trenches
PPTX
Computer Networks & internet protocols.pptx
PPTX
DNS - MCSE 2019
PDF
Kentik Network@Scale (Dan Ellis)
DINR 2021 Virtual Workshop: Passive vs Active Measurements in the DNS
Monitoring DNS Records and Servers
Measuring CDN performance and why you're doing it wrong
DNS in IR: Collection, Analysis and Response
Never Stop Exploring - Pushing the Limits of Solr: Presented by Anirudha Jadh...
Authoritative Nameserver Selection and Recursive Resolvers
Measuring CDN performance and why you're doing it wrong
1 technical-dns-workshop-day1
6421 b Module-03
NZNOG 2013 - Experiments in DNSSEC
Abuse of DNS wildcards in China - from passiveDNS perspective
How DNS works and How to secure it: An Introduction
ION Hangzhou - Why Deploy DNSSEC?
CNIT 40: 4: Monitoring and detecting security breaches
DNS Survival Guide
DNS Survival Guide.
Internet Week 2018: 1.1.1.0/24 A report from the (anycast) trenches
Computer Networks & internet protocols.pptx
DNS - MCSE 2019
Kentik Network@Scale (Dan Ellis)
Ad

More from AFRINIC (20)

PDF
AIS19 - Policies under discussion
PDF
AIS19 Newcomers Session (EN)
PDF
AFRINIC 101 2017
PDF
AFRINIC 101 2016 (Fr)
PDF
Internet development in Africa: a content use, hosting and distribution persp...
PDF
Insight Into Africa’s Country-level Latencies
PDF
Deep Diving into Africa’s Inter-Country Latencies
PDF
Studying performance barriers to cloud services in Africa's public sector
PDF
Routing security and implications for NRENs
PDF
APRICOT Latency Clustering
PDF
Latency clustering AfPIF2017
PDF
AFRINIC RIA MoU
PDF
AFRINIC DNSSEC Infrastructure and Signer Migration
PDF
Tampering With the Open Internet: Experiences From Africa
PDF
Assessing Internet Freedom and the Digital Resilience
PDF
Measuring quality of Internet links in NRENs
PDF
State of Internet measurement Infrastructure/tools in Africa
PDF
TraceMON - a new RIPE Atlas tool
PDF
Measuring the complexity of the Internet: indexes and indicators
PDF
Beyond access: measuring digital inequalities
AIS19 - Policies under discussion
AIS19 Newcomers Session (EN)
AFRINIC 101 2017
AFRINIC 101 2016 (Fr)
Internet development in Africa: a content use, hosting and distribution persp...
Insight Into Africa’s Country-level Latencies
Deep Diving into Africa’s Inter-Country Latencies
Studying performance barriers to cloud services in Africa's public sector
Routing security and implications for NRENs
APRICOT Latency Clustering
Latency clustering AfPIF2017
AFRINIC RIA MoU
AFRINIC DNSSEC Infrastructure and Signer Migration
Tampering With the Open Internet: Experiences From Africa
Assessing Internet Freedom and the Digital Resilience
Measuring quality of Internet links in NRENs
State of Internet measurement Infrastructure/tools in Africa
TraceMON - a new RIPE Atlas tool
Measuring the complexity of the Internet: indexes and indicators
Beyond access: measuring digital inequalities

Recently uploaded (20)

PPT
12 Things That Make People Trust a Website Instantly
PDF
Smart Home Technology for Health Monitoring (www.kiu.ac.ug)
PDF
📍 LABUAN4D EXCLUSIVE SERVER STAR GAMING ASIA NO.1 TERPOPULER DI INDONESIA ! 🌟
PPT
FIRE PREVENTION AND CONTROL PLAN- LUS.FM.MQ.OM.UTM.PLN.00014.ppt
PDF
Session 1 (Week 1)fghjmgfdsfgthyjkhfdsadfghjkhgfdsa
PPTX
Layers_of_the_Earth_Grade7.pptx class by
PDF
Exploring VPS Hosting Trends for SMBs in 2025
PDF
📍 LABUAN4D EXCLUSIVE SERVER STAR GAMING ASIA NO.1 TERPOPULER DI INDONESIA ! 🌟
PPT
Ethics in Information System - Management Information System
PDF
Exploring The Internet Of Things(IOT).ppt
PPTX
artificialintelligenceai1-copy-210604123353.pptx
PPTX
Reading as a good Form of Recreation
DOCX
Powerful Ways AIRCONNECT INFOSYSTEMS Pvt Ltd Enhances IT Infrastructure in In...
PDF
simpleintnettestmetiaerl for the simple testint
PPTX
TITLE DEFENSE entitle the impact of social media on education
PPTX
Mathew Digital SEO Checklist Guidlines 2025
PPT
250152213-Excitation-SystemWERRT (1).ppt
PDF
Course Overview and Agenda cloud security
PDF
Containerization lab dddddddddddddddmanual.pdf
PDF
The Evolution of Traditional to New Media .pdf
12 Things That Make People Trust a Website Instantly
Smart Home Technology for Health Monitoring (www.kiu.ac.ug)
📍 LABUAN4D EXCLUSIVE SERVER STAR GAMING ASIA NO.1 TERPOPULER DI INDONESIA ! 🌟
FIRE PREVENTION AND CONTROL PLAN- LUS.FM.MQ.OM.UTM.PLN.00014.ppt
Session 1 (Week 1)fghjmgfdsfgthyjkhfdsadfghjkhgfdsa
Layers_of_the_Earth_Grade7.pptx class by
Exploring VPS Hosting Trends for SMBs in 2025
📍 LABUAN4D EXCLUSIVE SERVER STAR GAMING ASIA NO.1 TERPOPULER DI INDONESIA ! 🌟
Ethics in Information System - Management Information System
Exploring The Internet Of Things(IOT).ppt
artificialintelligenceai1-copy-210604123353.pptx
Reading as a good Form of Recreation
Powerful Ways AIRCONNECT INFOSYSTEMS Pvt Ltd Enhances IT Infrastructure in In...
simpleintnettestmetiaerl for the simple testint
TITLE DEFENSE entitle the impact of social media on education
Mathew Digital SEO Checklist Guidlines 2025
250152213-Excitation-SystemWERRT (1).ppt
Course Overview and Agenda cloud security
Containerization lab dddddddddddddddmanual.pdf
The Evolution of Traditional to New Media .pdf

DNS Measurements

  • 1. Internet/DNS Measurements Africa DNS Forum 2017 Josiah Chavula, Amreesh Phokeer AFRINIC Ltd Research & Innovation
  • 2. Overview Internet Measurements ● Motivation for DNS Measurements ● RIPE Atlas measurements ● Tools, Techniques and Metrics ● Use Cases
  • 3. Why Internet Measurements ● Monitor the performance of your network in real time from thousands of vantage points ● Troubleshoot problems close to your customers ● Validate your peering strategies (e.g. TraceMON routing anomalies) ● Plan your content distribution (e.g reachability and latency) ● Research (e.g. IPv6 and DNSSEC deployment and performance)
  • 4. • Large-scale monitoring of Authoritative DNS (Roots, ccTLDs, etc…) • automatically detect failures • monitoring performance • Determine which instances of a name server clients/networks use • assess the impact of issues with one or more root name servers DNS Measurements (Active Measurements)
  • 5. Passive DNS Measurements Analysis of zone files / resolvers’ data • Prevalence of DNS Authoritative Name servers running V6 • DNS Resolvers: prevalence of resolvers requesting AAAA records. • DNS Queries: the distribution of actual IPv6-related DNS queries. Please share DNS data!
  • 6. RIPE Atlas: Probes •Global network of "probes" to measure Internet connectivity •Monitor network reachability from hundreds of vantage points •Monitor responsiveness of DNS infrastructure, such as root name servers
  • 7. RIPE Atlas: Anchors •More powerful probes, monitoring regional connectivity •7 anchors in Africa
  • 8. Accessing Ripe Atlas: https://atlas.ripe.net
  • 9. • Root Server Performance • Server responsiveness • Performance comparison between TCP and UDP • Root Instances • which root DNS server instance gets queried by clients • Root server latencies • compare response times for DNS SOA queries to all the root DNS servers DNS Measurements
  • 10. DNSMON: monitoring root zone servers
  • 11. DNSMON: monitoring root zone servers
  • 14. Root Server Performance Performance comparison between TCP and UDP (ratio).
  • 15. Which DNS root server instance is used by clients? • measure "gravitational radius" of root server instances (for servers employing anycasting) • What is the latency of different root server instances?
  • 16. Which root DNS server instance is used by clients? Example: Some South African client experiences 482ms response time to Sydney versus 39ms response time to Cape Town
  • 17. • Query for popular domain names to hit caches and local resolvers where appropriate Measuring end-user DNS experience?
  • 18. DNS Latency Visualization: List latencies to a DNS server per probe
  • 20. compare: 15ms versus 361ms DNS latency
  • 21. • Compare multiple latency trends to resolvers • Charts updated in real time as data is received from the probes LatencyMON
  • 22. RIPE Atlas live streaming (https://atlas.ripe.net/docs/result-streaming/, http://sg-pub.ripe.net/demo-area/atlas-stream/conn/ ) Receive measurement results as soon as they are sent by the probes - Real-time connectivity monitoring - Publish/subscribe through web sockets Three types of data: - Measurement results - Probe connection status events - Measurements metadata
  • 23. The Root Canary • Measuring and monitoring the impact of the KSK rollover • Track operational impact of the root KSK • Measure validation during the KSK rollover from a global perspective • Gain immediate insight into which operators have validation problems • Monitor the state of DNSSEC validation from multiple angles • Ripe Atlas probes + test validation • using signed and bogus records
  • 24. Validation status based on RIPE Atlas probes that have successfully executed tests (https://portal.rootcanary.org/rcmstats.html )
  • 26. • Monitoring DNS Propagation Time / DNS Consistency • monitoring SOA timestamp propagation time • looking at the moment when a change is made by one of the registrars, and following how quickly these changes propagate. • DNS resolver hijack checker • how do we protect from “bad actors” on the Internet? How do we know that DNS resolution is coming from the “proper” place? • use RIPE Atlas probes to query a pre-set DNS record on your own server, and use a public DNS resolver with known IP addresses; match the responses; mark the probes that show inconsistent responses. • Reverse DNS statistics • dig into reverse DNS data: what percentage of delegations has issues (lame), latency in domain object creation, coverage of address space with reverse delegations. Other DNS Use Cases (From Ripe Atlas Hackathon: https://labs.ripe.net/Members/becha/results-dns-measurements-hackathon )
  • 27. Web Interface Measurements (https://atlas.ripe.net/measurements/form/ )
  • 28. RIPE Atlas Cousteau • A python wrapper around RIPE Atlas API - https://github.com/RIPE-NCC/ripe-atlas-cousteau - pip install ripe.atlas.cousteau • Manage measurements: - Create a measurement - Stop a measurement - Change probes involved • Fetch results from API, streaming and probes
  • 30. More about Ripe Atlas • Atlas Tools: https://atlas.ripe.net/measurements-and-tools/tools/ • RESTfulAPI – https://atlas.ripe.net/docs/measurement-creation-api/ • Atlas API description – https://atlas.ripe.net/docs/rest/ • AtlasAPI tutorial – https://atlas.ripe.net/docs/measurement-creation-api/ • Public measurements – https://atlas.ripe.net/measurements/ • Map of results – https://atlas.ripe.net/results/maps/ • List of probes – https://atlas.ripe.net/probes/ • Geographical mapsof probes – https://atlas.ripe.net/results/maps/network-coverage/
  • 31. AFRINIC-27 27 November to 2nd December 2017 Lagos, Nigeria AFRICOMM 2017 International Workshop on Internet Measurements Research in Africa DECEMBER 11–12, 2017 | LAGOS, NIGERIA http://africommconference.org/2017/show/IMRA Upcoming Internet Measurements Workshops