SlideShare a Scribd company logo

All thingsrtc finding hidden issues with ml

Download as PPTX, PDF
C
Carl Blume

The document discusses the use of machine learning in identifying call quality issues within WebRTC applications by analyzing big data. It highlights the capabilities of callstats.io in monitoring and troubleshooting WebRTC performance, including anomaly detection and root cause analysis. The integration of AI-driven tools aids in improving user experiences by addressing connectivity and performance metrics effectively.

Software
Related topics:
Call Center Insights
1 of 46
Download to read offline
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
Finding Hidden Call Quality Issues with Machine Learning chad hart 13 June 2019 1 Deliver Better User Experiences
Callstats.io: The WebRTC Monitoring Leader • Founded in 2014 by IETF and W3C authors • Customers across vertical industries • Over 1B collected WebRTC datapoints each month • Integrated into Amazon Connect 2 NXTEC CORP
callstats.io Voice Quality Solutions 3 WebRTC Monitoring • Network status • Service metrics AI-Driven Troubleshooting • Anomaly detection • Root cause analysis • Notifications Active Network Testing • Connectivity verification • Performance metrics
Data Collection and Monitoring Architecture 4
Why do we need ML? 5
Why do we need ML? Dealing with Big Data 6 Photo credit: Flickr User Gavin Bell (CC BY-NC-ND 2.0) https://www.flickr.com/photos/gavinbell/535261899/
Challenge: getStats provides a lot of data Example: • Go to https://webrtc.github.io/samples/src/content/peerconnection/pc1/ • Start the sample • Type: 7 pc1.getStats().then(stats=>stats.forEach(stat=>console.log(stat)))
• [{"id":"RTCCertificate_70:47:DC:96:5C:24:A1:C1:F0:A2:89:39:FC:B1:D9:69:66:EB:4A:F6:12:F0:68:43:1B:F9:D4:ED:D6:E2:D1:FE","timestamp":1560111536209.789,"type":"certificate","fingerprint":"70:47:DC:96:5C:24:A1:C1:F0:A2:89:39:FC:B1:D9:69:66:EB:4A:F6:12:F0:68:43:1B:F9:D4:ED:D6:E2:D1:FE","fingerprintAlgorithm":"sha- 256","base64Certificate":"MIIBFjCBvaADAgECAgkAhuXyX8OJm0EwCgYIKoZIzj0EAwIwETEPMA0GA1UEAwwGV2ViUlRDMB4XDTE5MDYwODIwMTU0MFoXDTE5MDcwOTIwMTU0MFowETEPMA0GA1UEAwwGV2ViUlRDMFkwEwYHKoZIzj0CAQYIKoZIzj0DAQcDQgAEQ6ZyQYSC7xZHSUhq6mxCWa+/VwRdO0U1GuMAUYjYSkAmgzfJ0mW TZbZWJ12V7LlimkOZtdXCv2UPSh3sDOHu/DAKBggqhkjOPQQDAgNIADBFAiBDBGAgqa2dxlewHn5661OgMK6xfanL13l9aLoyuvdCgAIhAOmal8xD0S0ZLRKO/WDOb3 RRLAqxCcn0Jmur/OPdoEDl"},{"id":"RTCCertificate_D1:3F:71:1A:FE:32:78:3D:AA:93:06:F3:E6:AF:22:E9:5A:BC:B7:D2:AD:D6:A4:49:FD:9F:FB:00:49:89:4C:5A","timestamp":1560111536209.789,"type":"certificate","fingerprint":"D1:3F:71:1A:FE:32:78:3D:AA:93:06:F3:E6:AF:22:E9:5A:BC:B7:D2:AD:D6:A4:49:FD:9F:FB:00:49:89:4C:5A","fingerprintAlgorithm":"sha- 256","base64Certificate":"MIIBFzCBvaADAgECAgkA7svx50DzS6swCgYIKoZIzj0EAwIwETEPMA0GA1UEAwwGV2ViUlRDMB4XDTE5MDYwODIwMTU0MFoXDTE5MDcwOTIwMTU0MFowETEPMA0GA1UEAwwGV2ViUlRDMFkwEwYHKoZIzj0CAQYIKoZIzj0DAQcDQgAEg3VCpwhtcNE3rEaBH8GTrWpQTcbnPGWEz0i2XAYE/A8pATEPoXb7mPojyEy8LxkmPSjkwrEodppNzA7X8Yjv2TAKBggqhkjOPQQDAgNJADBGAiEA3MWsKxnwNWssNhZ+mSGhZca63A8tvFIdRyf+CBOzNYwCIQD1JTiEdHntgBQ9/ZcaRVbQK MBU1X6+xYmtnwjJ+x2umw=="},{"id":"RTCCodec_0_Inbound_0","timestamp":1560111536209.789,"type":"codec","payloadType":0,"mimeType":"audio/PCMU","clockRate":8000},{"id":"RTCCodec_0_Inbound_103","timestamp":1560111536209.789,"type":"codec","payloadType":103,"mimeType":"audio/ISAC","clockRate":16000},{"id":"RTCCodec_0_Inbound_104","timestamp":1560111536209.789,"type":"codec","payloadType":104,"mimeType":"audio/ISAC","clockRate":32000},{"id":"RTCCodec_0_Inbound_105","t imestamp":1560111536209.789,"type":"codec","payloadType":105,"mimeType":"audio/CN","clockRate":16000},{"id":"RTCCodec_0_Inbound_106","timestamp":1560111536209.789,"type":"codec","payloadType":106,"mimeType":"audio/CN","clockRate":32000},{"id":"RTCCodec_0_Inbound_110","timestamp":1560111536209.789,"type":"codec","payloadType":110,"mimeType":"audio/telephone- event","clockRate":48000},{"id":"RTCCodec_0_Inbound_111","timestamp":1560111536209.789,"type":"codec","payloadType":111,"mimeType":"audio/opus","clockRate":48000},{"id":"RTCCodec_0_Inbound_112","timestamp":1560111536209.789,"type":"codec","payloadType":112,"mimeType":"audio/telephone-event","clockRate":32000},{"id":"RTCCodec_0_Inbound_113","timestamp":1560111536209.789,"type":"codec","payloadType":113,"mimeType":"audio/telephone- event","clockRate":16000},{"id":"RTCCodec_0_Inbound_126","timestamp":1560111536209.789,"type":"codec","payloadType":126,"mimeType":"audio/telephone- event","clockRate":8000},{"id":"RTCCodec_0_Inbound_13","timestamp":1560111536209.789,"type":"codec","payloadType":13,"mimeType":"audio/CN","clockRate":8000},{"id":"RTCCodec_0_Inbound_8","timestamp":1560111536209.789,"type":"codec","payloadType":8,"mimeType":"audio/PCMA","clockRate":8000},{"id":"RTCCodec_0_Inbound_9","timestamp":1560111536209.789,"type":"codec","payloadType":9,"mimeType":"audio/G722","clockRate":8000},{"id":"RTCCodec_0_Outbound_0","timestamp":1560111 536209.789,"type":"codec","payloadType":0,"mimeType":"audio/PCMU","clockRate":8000},{"id":"RTCCodec_0_Outbound_103","timestamp":1560111536209.789,"type":"codec","payloadType":103,"mimeType":"audio/ISAC","clockRate":16000},{"id":"RTCCodec_0_Outbound_104","timestamp":1560111536209.789,"type":"codec","payloadType":104,"mimeType":"audio/ISAC","clockRate":32000},{"id":"RTCCodec_0_Outbound_105","timestamp":1560111536209.789,"type":"codec","payloadType":105,"mimeType":"a udio/CN","clockRate":16000},{"id":"RTCCodec_0_Outbound_106","timestamp":1560111536209.789,"type":"codec","payloadType":106,"mimeType":"audio/CN","clockRate":32000},{"id":"RTCCodec_0_Outbound_110","timestamp":1560111536209.789,"type":"codec","payloadType":110,"mimeType":"audio/telephone- event","clockRate":48000},{"id":"RTCCodec_0_Outbound_111","timestamp":1560111536209.789,"type":"codec","payloadType":111,"mimeType":"audio/opus","clockRate":48000},{"id":"RTCCodec_0_Outbound_112","timestamp":1560111536209.789,"type":"codec","payloadType":112,"mimeType":"audio/telephone-event","clockRate":32000},{"id":"RTCCodec_0_Outbound_113","timestamp":1560111536209.789,"type":"codec","payloadType":113,"mimeType":"audio/telephone- event","clockRate":16000},{"id":"RTCCodec_0_Outbound_126","timestamp":1560111536209.789,"type":"codec","payloadType":126,"mimeType":"audio/telephone- event","clockRate":8000},{"id":"RTCCodec_0_Outbound_13","timestamp":1560111536209.789,"type":"codec","payloadType":13,"mimeType":"audio/CN","clockRate":8000},{"id":"RTCCodec_0_Outbound_8","timestamp":1560111536209.789,"type":"codec","payloadType":8,"mimeType":"audio/PCMA","clockRate":8000},{"id":"RTCCodec_0_Outbound_9","timestamp":1560111536209.789,"type":"codec","payloadType":9,"mimeType":"audio/G722","clockRate":8000},{"id":"RTCCodec_1_Inbound_100","timestamp":15 60111536209.789,"type":"codec","payloadType":100,"mimeType":"video/VP9","clockRate":90000},{"id":"RTCCodec_1_Inbound_101","timestamp":1560111536209.789,"type":"codec","payloadType":101,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Inbound_102","timestamp":1560111536209.789,"type":"codec","payloadType":102,"mimeType":"video/H264","clockRate":90000},{"id":"RTCCodec_1_Inbound_107","timestamp":1560111536209.789,"type":"codec","payloadType":107,"mimeType":"vi deo/rtx","clockRate":90000},{"id":"RTCCodec_1_Inbound_108","timestamp":1560111536209.789,"type":"codec","payloadType":108,"mimeType":"video/H264","clockRate":90000},{"id":"RTCCodec_1_Inbound_109","timestamp":1560111536209.789,"type":"codec","payloadType":109,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Inbound_114","timestamp":1560111536209.789,"type":"codec","payloadType":114,"mimeType":"video/red","clockRate":90000},{"id":"RTCCodec_1_Inbound_115","times tamp":1560111536209.789,"type":"codec","payloadType":115,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Inbound_116","timestamp":1560111536209.789,"type":"codec","payloadType":116,"mimeType":"video/ulpfec","clockRate":90000},{"id":"RTCCodec_1_Inbound_119","timestamp":1560111536209.789,"type":"codec","payloadType":119,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Inbound_120","timestamp":1560111536209.789,"type":"codec","payloadType":120,"mimeT ype":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Inbound_121","timestamp":1560111536209.789,"type":"codec","payloadType":121,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Inbound_122","timestamp":1560111536209.789,"type":"codec","payloadType":122,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Inbound_123","timestamp":1560111536209.789,"type":"codec","payloadType":123,"mimeType":"video/H264","clockRate":90000},{"id":"RTCCodec_1_Inbound_124", "timestamp":1560111536209.789,"type":"codec","payloadType":124,"mimeType":"video/H264","clockRate":90000},{"id":"RTCCodec_1_Inbound_125","timestamp":1560111536209.789,"type":"codec","payloadType":125,"mimeType":"video/H264","clockRate":90000},{"id":"RTCCodec_1_Inbound_127","timestamp":1560111536209.789,"type":"codec","payloadType":127,"mimeType":"video/H264","clockRate":90000},{"id":"RTCCodec_1_Inbound_96","timestamp":1560111536209.789,"type":"codec","payloadType":9 6,"mimeType":"video/VP8","clockRate":90000},{"id":"RTCCodec_1_Inbound_97","timestamp":1560111536209.789,"type":"codec","payloadType":97,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Inbound_98","timestamp":1560111536209.789,"type":"codec","payloadType":98,"mimeType":"video/VP9","clockRate":90000},{"id":"RTCCodec_1_Inbound_99","timestamp":1560111536209.789,"type":"codec","payloadType":99,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Outbound_ 100","timestamp":1560111536209.789,"type":"codec","payloadType":100,"mimeType":"video/VP9","clockRate":90000},{"id":"RTCCodec_1_Outbound_101","timestamp":1560111536209.789,"type":"codec","payloadType":101,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Outbound_102","timestamp":1560111536209.789,"type":"codec","payloadType":102,"mimeType":"video/H264","clockRate":90000},{"id":"RTCCodec_1_Outbound_107","timestamp":1560111536209.789,"type":"codec","payload Type":107,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Outbound_108","timestamp":1560111536209.789,"type":"codec","payloadType":108,"mimeType":"video/H264","clockRate":90000},{"id":"RTCCodec_1_Outbound_109","timestamp":1560111536209.789,"type":"codec","payloadType":109,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Outbound_114","timestamp":1560111536209.789,"type":"codec","payloadType":114,"mimeType":"video/red","clockRate":90000},{"id":"RTC Codec_1_Outbound_115","timestamp":1560111536209.789,"type":"codec","payloadType":115,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Outbound_116","timestamp":1560111536209.789,"type":"codec","payloadType":116,"mimeType":"video/ulpfec","clockRate":90000},{"id":"RTCCodec_1_Outbound_119","timestamp":1560111536209.789,"type":"codec","payloadType":119,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Outbound_120","timestamp":1560111536209.789,"typ e":"codec","payloadType":120,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Outbound_121","timestamp":1560111536209.789,"type":"codec","payloadType":121,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Outbound_122","timestamp":1560111536209.789,"type":"codec","payloadType":122,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Outbound_123","timestamp":1560111536209.789,"type":"codec","payloadType":123,"mimeType":"video/H264","clockRate" :90000},{"id":"RTCCodec_1_Outbound_124","timestamp":1560111536209.789,"type":"codec","payloadType":124,"mimeType":"video/H264","clockRate":90000},{"id":"RTCCodec_1_Outbound_125","timestamp":1560111536209.789,"type":"codec","payloadType":125,"mimeType":"video/H264","clockRate":90000},{"id":"RTCCodec_1_Outbound_127","timestamp":1560111536209.789,"type":"codec","payloadType":127,"mimeType":"video/H264","clockRate":90000},{"id":"RTCCodec_1_Outbound_96","timestamp":15 60111536209.789,"type":"codec","payloadType":96,"mimeType":"video/VP8","clockRate":90000},{"id":"RTCCodec_1_Outbound_97","timestamp":1560111536209.789,"type":"codec","payloadType":97,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Outbound_98","timestamp":1560111536209.789,"type":"codec","payloadType":98,"mimeType":"video/VP9","clockRate":90000},{"id":"RTCCodec_1_Outbound_99","timestamp":1560111536209.789,"type":"codec","payloadType":99,"mimeType":"video/r tx","clockRate":90000},{"id":"RTCIceCandidatePair_eDlSn4+Z_o4HO2DpI","timestamp":1560111536209.789,"type":"candidate- pair","transportId":"RTCTransport_0_1","localCandidateId":"RTCIceCandidate_eDlSn4+Z","remoteCandidateId":"RTCIceCandidate_o4HO2DpI","state":"succeeded","priority":9115038255631187000,"nominated":true,"writable":true,"bytesSent":43425072,"bytesReceived":196122,"totalRoundTripTime":0.031,"currentRoundTripTime":0.001,"availableOutgoingBitrate":3539445,"requestsReceived":82,"requestsSent":1,"responsesReceived":82,"responsesSent":82,"consentRequestsSent":81},{"id":"RTCIceCandidate_ eDlSn4+Z","timestamp":1560111536209.789,"type":"local-candidate","transportId":"RTCTransport_0_1","isRemote":false,"networkType":"wifi","ip":"10.10.100.49","port":63479,"protocol":"udp","candidateType":"host","priority":2122260223,"deleted":false},{"id":"RTCIceCandidate_o4HO2DpI","timestamp":1560111536209.789,"type":"remote- candidate","transportId":"RTCTransport_0_1","isRemote":true,"ip":"10.10.100.49","port":52235,"protocol":"udp","candidateType":"host","priority":2122260223,"deleted":false},{"id":"RTCMediaStreamTrack_sender_3","timestamp":1560111536209.789,"type":"track","trackIdentifier":"93c3b5d1-5ad2-4d6f-b4ef- 9026d140cd12","remoteSource":false,"ended":false,"detached":false,"kind":"audio","audioLevel":0,"totalAudioEnergy":0,"totalSamplesDuration":0},{"id":"RTCMediaStreamTrack_sender_4","timestamp":1560111536209.789,"type":"track","trackIdentifier":"a6b75d65-225e-4a17-8566- 5ebfde288572","remoteSource":false,"ended":false,"detached":false,"kind":"video","frameWidth":640,"frameHeight":480,"framesSent":5883,"hugeFramesSent":3},{"id":"RTCMediaStream_OIL9zTwVhYSpGstFDdnOlBGaKGbLz16BJnlb","timestamp":1560111536209.789,"type":"stream","streamIdentifier":"OIL9zTwVhYSpGstFDdnOlBGaKGbLz16BJnlb","trackIds":["RTCMediaStreamTrack_sender_3","RTCMediaStreamTrack_sender_4"]},{"id":"RTCOutboundRTPAudioStream_3291843167","timestamp":156011153 6209.789,"type":"outbound-rtp","ssrc":3291843167,"isRemote":false,"mediaType":"audio","kind":"audio","trackId":"RTCMediaStreamTrack_sender_3","transportId":"RTCTransport_0_1","codecId":"RTCCodec_0_Outbound_111","packetsSent":9748,"retransmittedPacketsSent":0,"bytesSent":856558,"retransmittedBytesSent":0},{"id":"RTCOutboundRTPVideoStream_3763384231","timestamp":1560111536209.789,"type":"outbound- rtp","ssrc":3763384231,"isRemote":false,"mediaType":"video","kind":"video","trackId":"RTCMediaStreamTrack_sender_4","transportId":"RTCTransport_0_1","codecId":"RTCCodec_1_Outbound_96","firCount":0,"pliCount":0,"nackCount":0,"qpSum":31335,"packetsSent":39380,"retransmittedPacketsSent":0,"bytesSent":42009407,"retransmittedBytesSent":0,"framesEncoded":5883,"totalEncodeTime":24.969},{"id":"RTCPeerConnection","timestamp":1560111536209.789,"type":"peer- connection","dataChannelsOpened":0,"dataChannelsClosed":0},{"id":"RTCTransport_0_1","timestamp":1560111536209.789,"type":"transport","bytesSent":43425072,"bytesReceived":196122,"dtlsState":"connected","selectedCandidatePairId":"RTCIceCandidatePair_eDlSn4+Z_o4HO2DpI","localCertificateId":"RTCCertificate_70:47:DC:96:5C:24:A1:C1:F0:A2:89:39:FC:B1:D9:69:66:EB:4A:F6:12:F0:68:43:1B:F9:D4:ED:D6:E2:D1:FE","remoteCertificateId":"RTCCertificate_D1:3F:71:1A:FE:32:78:3D:AA:93:06:F3:E6: AF:22:E9:5A:BC:B7:D2:AD:D6:A4:49:FD:9F:FB:00:49:89:4C:5A"},{"id":"RTCCertificate_70:47:DC:96:5C:24:A1:C1:F0:A2:89:39:FC:B1:D9:69:66:EB:4A:F6:12:F0:68:43:1B:F9:D4:ED:D6:E2:D1:FE","timestamp":1560111849871.613,"type":"certificate","fingerprint":"70:47:DC:96:5C:24:A1:C1:F0:A2:89:39:FC:B1:D9:69:66:EB:4A:F6:12:F0:68:43:1B:F9:D4:ED:D6:E2:D1:FE","fingerprintAlgorithm":"sha- 256","base64Certificate":"MIIBFjCBvaADAgECAgkAhuXyX8OJm0EwCgYIKoZIzj0EAwIwETEPMA0GA1UEAwwGV2ViUlRDMB4XDTE5MDYwODIwMTU0MFoXDTE5MDcwOTIwMTU0MFowETEPMA0GA1UEAwwGV2ViUlRDMFkwEwYHKoZIzj0CAQYIKoZIzj0DAQcDQgAEQ6ZyQYSC7xZHSUhq6mxCWa+/VwRdO0U1GuMAUYjYSkAmgzfJ0mW TZbZWJ12V7LlimkOZtdXCv2UPSh3sDOHu/DAKBggqhkjOPQQDAgNIADBFAiBDBGAgqa2dxlewHn5661OgMK6xfanL13l9aLoyuvdCgAIhAOmal8xD0S0ZLRKO/WDOb3 RRLAqxCcn0Jmur/OPdoEDl"},{"id":"RTCCertificate_D1:3F:71:1A:FE:32:78:3D:AA:93:06:F3:E6:AF:22:E9:5A:BC:B7:D2:AD:D6:A4:49:FD:9F:FB:00:49:89:4C:5A","timestamp":1560111849871.613,"type":"certificate","fingerprint":"D1:3F:71:1A:FE:32:78:3D:AA:93:06:F3:E6:AF:22:E9:5A:BC:B7:D2:AD:D6:A4:49:FD:9F:FB:00:49:89:4C:5A","fingerprintAlgorithm":"sha- 256","base64Certificate":"MIIBFzCBvaADAgECAgkA7svx50DzS6swCgYIKoZIzj0EAwIwETEPMA0GA1UEAwwGV2ViUlRDMB4XDTE5MDYwODIwMTU0MFoXDTE5MDcwOTIwMTU0MFowETEPMA0GA1UEAwwGV2ViUlRDMFkwEwYHKoZIzj0CAQYIKoZIzj0DAQcDQgAEg3VCpwhtcNE3rEaBH8GTrWpQTcbnPGWEz0i2XAYE/A8pATEPoXb7mPojyEy8LxkmPSjkwrEodppNzA7X8Yjv2TAKBggqhkjOPQQDAgNJADBGAiEA3MWsKxnwNWssNhZ+mSGhZca63A8tvFIdRyf+CBOzNYwCIQD1JTiEdHntgBQ9/ZcaRVbQK MBU1X6+xYmtnwjJ+x2umw=="},{"id":"RTCCodec_0_Inbound_0","timestamp":1560111849871.613,"type":"codec","payloadType":0,"mimeType":"audio/PCMU","clockRate":8000},{"id":"RTCCodec_0_Inbound_103","timestamp":1560111849871.613,"type":"codec","payloadType":103,"mimeType":"audio/ISAC","clockRate":16000},{"id":"RTCCodec_0_Inbound_104","timestamp":1560111849871.613,"type":"codec","payloadType":104,"mimeType":"audio/ISAC","clockRate":32000},{"id":"RTCCodec_0_Inbound_105","t imestamp":1560111849871.613,"type":"codec","payloadType":105,"mimeType":"audio/CN","clockRate":16000},{"id":"RTCCodec_0_Inbound_106","timestamp":1560111849871.613,"type":"codec","payloadType":106,"mimeType":"audio/CN","clockRate":32000},{"id":"RTCCodec_0_Inbound_110","timestamp":1560111849871.613,"type":"codec","payloadType":110,"mimeType":"audio/telephone- event","clockRate":48000},{"id":"RTCCodec_0_Inbound_111","timestamp":1560111849871.613,"type":"codec","payloadType":111,"mimeType":"audio/opus","clockRate":48000},{"id":"RTCCodec_0_Inbound_112","timestamp":1560111849871.613,"type":"codec","payloadType":112,"mimeType":"audio/telephone-event","clockRate":32000},{"id":"RTCCodec_0_Inbound_113","timestamp":1560111849871.613,"type":"codec","payloadType":113,"mimeType":"audio/telephone- event","clockRate":16000},{"id":"RTCCodec_0_Inbound_126","timestamp":1560111849871.613,"type":"codec","payloadType":126,"mimeType":"audio/telephone- event","clockRate":8000},{"id":"RTCCodec_0_Inbound_13","timestamp":1560111849871.613,"type":"codec","payloadType":13,"mimeType":"audio/CN","clockRate":8000},{"id":"RTCCodec_0_Inbound_8","timestamp":1560111849871.613,"type":"codec","payloadType":8,"mimeType":"audio/PCMA","clockRate":8000},{"id":"RTCCodec_0_Inbound_9","timestamp":1560111849871.613,"type":"codec","payloadType":9,"mimeType":"audio/G722","clockRate":8000},{"id":"RTCCodec_0_Outbound_0","timestamp":1560111 849871.613,"type":"codec","payloadType":0,"mimeType":"audio/PCMU","clockRate":8000},{"id":"RTCCodec_0_Outbound_103","timestamp":1560111849871.613,"type":"codec","payloadType":103,"mimeType":"audio/ISAC","clockRate":16000},{"id":"RTCCodec_0_Outbound_104","timestamp":1560111849871.613,"type":"codec","payloadType":104,"mimeType":"audio/ISAC","clockRate":32000},{"id":"RTCCodec_0_Outbound_105","timestamp":1560111849871.613,"type":"codec","payloadType":105,"mimeType":"a udio/CN","clockRate":16000},{"id":"RTCCodec_0_Outbound_106","timestamp":1560111849871.613,"type":"codec","payloadType":106,"mimeType":"audio/CN","clockRate":32000},{"id":"RTCCodec_0_Outbound_110","timestamp":1560111849871.613,"type":"codec","payloadType":110,"mimeType":"audio/telephone- event","clockRate":48000},{"id":"RTCCodec_0_Outbound_111","timestamp":1560111849871.613,"type":"codec","payloadType":111,"mimeType":"audio/opus","clockRate":48000},{"id":"RTCCodec_0_Outbound_112","timestamp":1560111849871.613,"type":"codec","payloadType":112,"mimeType":"audio/telephone-event","clockRate":32000},{"id":"RTCCodec_0_Outbound_113","timestamp":1560111849871.613,"type":"codec","payloadType":113,"mimeType":"audio/telephone- event","clockRate":16000},{"id":"RTCCodec_0_Outbound_126","timestamp":1560111849871.613,"type":"codec","payloadType":126,"mimeType":"audio/telephone- event","clockRate":8000},{"id":"RTCCodec_0_Outbound_13","timestamp":1560111849871.613,"type":"codec","payloadType":13,"mimeType":"audio/CN","clockRate":8000},{"id":"RTCCodec_0_Outbound_8","timestamp":1560111849871.613,"type":"codec","payloadType":8,"mimeType":"audio/PCMA","clockRate":8000},{"id":"RTCCodec_0_Outbound_9","timestamp":1560111849871.613,"type":"codec","payloadType":9,"mimeType":"audio/G722","clockRate":8000},{"id":"RTCCodec_1_Inbound_100","timestamp":15 60111849871.613,"type":"codec","payloadType":100,"mimeType":"video/VP9","clockRate":90000},{"id":"RTCCodec_1_Inbound_101","timestamp":1560111849871.613,"type":"codec","payloadType":101,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Inbound_102","timestamp":1560111849871.613,"type":"codec","payloadType":102,"mimeType":"video/H264","clockRate":90000},{"id":"RTCCodec_1_Inbound_107","timestamp":1560111849871.613,"type":"codec","payloadType":107,"mimeType":"vi deo/rtx","clockRate":90000},{"id":"RTCCodec_1_Inbound_108","timestamp":1560111849871.613,"type":"codec","payloadType":108,"mimeType":"video/H264","clockRate":90000},{"id":"RTCCodec_1_Inbound_109","timestamp":1560111849871.613,"type":"codec","payloadType":109,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Inbound_114","timestamp":1560111849871.613,"type":"codec","payloadType":114,"mimeType":"video/red","clockRate":90000},{"id":"RTCCodec_1_Inbound_115","times tamp":1560111849871.613,"type":"codec","payloadType":115,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Inbound_116","timestamp":1560111849871.613,"type":"codec","payloadType":116,"mimeType":"video/ulpfec","clockRate":90000},{"id":"RTCCodec_1_Inbound_119","timestamp":1560111849871.613,"type":"codec","payloadType":119,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Inbound_120","timestamp":1560111849871.613,"type":"codec","payloadType":120,"mimeT ype":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Inbound_121","timestamp":1560111849871.613,"type":"codec","payloadType":121,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Inbound_122","timestamp":1560111849871.613,"type":"codec","payloadType":122,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Inbound_123","timestamp":1560111849871.613,"type":"codec","payloadType":123,"mimeType":"video/H264","clockRate":90000},{"id":"RTCCodec_1_Inbound_124", "timestamp":1560111849871.613,"type":"codec","payloadType":124,"mimeType":"video/H264","clockRate":90000},{"id":"RTCCodec_1_Inbound_125","timestamp":1560111849871.613,"type":"codec","payloadType":125,"mimeType":"video/H264","clockRate":90000},{"id":"RTCCodec_1_Inbound_127","timestamp":1560111849871.613,"type":"codec","payloadType":127,"mimeType":"video/H264","clockRate":90000},{"id":"RTCCodec_1_Inbound_96","timestamp":1560111849871.613,"type":"codec","payloadType":9 6,"mimeType":"video/VP8","clockRate":90000},{"id":"RTCCodec_1_Inbound_97","timestamp":1560111849871.613,"type":"codec","payloadType":97,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Inbound_98","timestamp":1560111849871.613,"type":"codec","payloadType":98,"mimeType":"video/VP9","clockRate":90000},{"id":"RTCCodec_1_Inbound_99","timestamp":1560111849871.613,"type":"codec","payloadType":99,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Outbound_ 100","timestamp":1560111849871.613,"type":"codec","payloadType":100,"mimeType":"video/VP9","clockRate":90000},{"id":"RTCCodec_1_Outbound_101","timestamp":1560111849871.613,"type":"codec","payloadType":101,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Outbound_102","timestamp":1560111849871.613,"type":"codec","payloadType":102,"mimeType":"video/H264","clockRate":90000},{"id":"RTCCodec_1_Outbound_107","timestamp":1560111849871.613,"type":"codec","payload Type":107,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Outbound_108","timestamp":1560111849871.613,"type":"codec","payloadType":108,"mimeType":"video/H264","clockRate":90000},{"id":"RTCCodec_1_Outbound_109","timestamp":1560111849871.613,"type":"codec","payloadType":109,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Outbound_114","timestamp":1560111849871.613,"type":"codec","payloadType":114,"mimeType":"video/red","clockRate":90000},{"id":"RTC Codec_1_Outbound_115","timestamp":1560111849871.613,"type":"codec","payloadType":115,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Outbound_116","timestamp":1560111849871.613,"type":"codec","payloadType":116,"mimeType":"video/ulpfec","clockRate":90000},{"id":"RTCCodec_1_Outbound_119","timestamp":1560111849871.613,"type":"codec","payloadType":119,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Outbound_120","timestamp":1560111849871.613,"typ e":"codec","payloadType":120,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Outbound_121","timestamp":1560111849871.613,"type":"codec","payloadType":121,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Outbound_122","timestamp":1560111849871.613,"type":"codec","payloadType":122,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Outbound_123","timestamp":1560111849871.613,"type":"codec","payloadType":123,"mimeType":"video/H264","clockRate" :90000},{"id":"RTCCodec_1_Outbound_124","timestamp":1560111849871.613,"type":"codec","payloadType":124,"mimeType":"video/H264","clockRate":90000},{"id":"RTCCodec_1_Outbound_125","timestamp":1560111849871.613,"type":"codec","payloadType":125,"mimeType":"video/H264","clockRate":90000},{"id":"RTCCodec_1_Outbound_127","timestamp":1560111849871.613,"type":"codec","payloadType":127,"mimeType":"video/H264","clockRate":90000},{"id":"RTCCodec_1_Outbound_96","timestamp":15 60111849871.613,"type":"codec","payloadType":96,"mimeType":"video/VP8","clockRate":90000},{"id":"RTCCodec_1_Outbound_97","timestamp":1560111849871.613,"type":"codec","payloadType":97,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Outbound_98","timestamp":1560111849871.613,"type":"codec","payloadType":98,"mimeType":"video/VP9","clockRate":90000},{"id":"RTCCodec_1_Outbound_99","timestamp":1560111849871.613,"type":"codec","payloadType":99,"mimeType":"video/r tx","clockRate":90000},{"id":"RTCIceCandidatePair_eDlSn4+Z_o4HO2DpI","timestamp":1560111849871.613,"type":"candidate- pair","transportId":"RTCTransport_0_1","localCandidateId":"RTCIceCandidate_eDlSn4+Z","remoteCandidateId":"RTCIceCandidate_o4HO2DpI","state":"succeeded","priority":9115038255631187000,"nominated":true,"writable":true,"bytesSent":114210539,"bytesReceived":509086,"totalRoundTripTime":0.085,"currentRoundTripTime":0.001,"availableOutgoingBitrate":3580817,"requestsReceived":207,"requestsSent":1,"responsesReceived":207,"responsesSent":207,"consentRequestsSent":206},{"id":"RTCIceCandi date_eDlSn4+Z","timestamp":1560111849871.613,"type":"local-candidate","transportId":"RTCTransport_0_1","isRemote":false,"networkType":"wifi","ip":"10.10.100.49","port":63479,"protocol":"udp","candidateType":"host","priority":2122260223,"deleted":false},{"id":"RTCIceCandidate_o4HO2DpI","timestamp":1560111849871.613,"type":"remote- candidate","transportId":"RTCTransport_0_1","isRemote":true,"ip":"10.10.100.49","port":52235,"protocol":"udp","candidateType":"host","priority":2122260223,"deleted":false},{"id":"RTCMediaStreamTrack_sender_3","timestamp":1560111849871.613,"type":"track","trackIdentifier":"93c3b5d1-5ad2-4d6f-b4ef- 9026d140cd12","remoteSource":false,"ended":false,"detached":false,"kind":"audio","audioLevel":0,"totalAudioEnergy":0,"totalSamplesDuration":0},{"id":"RTCMediaStreamTrack_sender_4","timestamp":1560111849871.613,"type":"track","trackIdentifier":"a6b75d65-225e-4a17-8566- 5ebfde288572","remoteSource":false,"ended":false,"detached":false,"kind":"video","frameWidth":640,"frameHeight":480,"framesSent":15281,"hugeFramesSent":3},{"id":"RTCMediaStream_OIL9zTwVhYSpGstFDdnOlBGaKGbLz16BJnlb","timestamp":1560111849871.613,"type":"stream","streamIdentifier":"OIL9zTwVhYSpGstFDdnOlBGaKGbLz16BJnlb","trackIds":["RTCMediaStreamTrack_sender_3","RTCMediaStreamTrack_sender_4"]},{"id":"RTCOutboundRTPAudioStream_3291843167","timestamp":15601118 49871.613,"type":"outbound-rtp","ssrc":3291843167,"isRemote":false,"mediaType":"audio","kind":"audio","trackId":"RTCMediaStreamTrack_sender_3","transportId":"RTCTransport_0_1","codecId":"RTCCodec_0_Outbound_111","packetsSent":25431,"retransmittedPacketsSent":0,"bytesSent":2185963,"retransmittedBytesSent":0},{"id":"RTCOutboundRTPVideoStream_3763384231","timestamp":1560111849871.613,"type":"outbound- rtp","ssrc":3763384231,"isRemote":false,"mediaType":"video","kind":"video","trackId":"RTCMediaStreamTrack_sender_4","transportId":"RTCTransport_0_1","codecId":"RTCCodec_1_Outbound_96","firCount":0,"pliCount":0,"nackCount":0,"qpSum":85518,"packetsSent":103425,"retransmittedPacketsSent":0,"bytesSent":110558779,"retransmittedBytesSent":0,"framesEncoded":15281,"totalEncodeTime":65.099},{"id":"RTCPeerConnection","timestamp":1560111849871.613,"type":"peer- connection","dataChannelsOpened":0,"dataChannelsClosed":0},{"id":"RTCTransport_0_1","timestamp":1560111849871.613,"type":"transport","bytesSent":114210539,"bytesReceived":509086,"dtlsState":"connected","selectedCandidatePairId":"RTCIceCandidatePair_eDlSn4+Z_o4HO2DpI","localCertificateId":"RTCCertificate_70:47:DC:96:5C:24:A1:C1:F0:A2:89:39:FC:B1:D9:69:66:EB:4A:F6:12:F0:68:43:1B:F9:D4:ED:D6:E2:D1:FE","remoteCertificateId":"RTCCertificate_D1:3F:71:1A:FE:32:78:3D:AA:93:06:F3:E 6:AF:22:E9:5A:BC:B7:D2:AD:D6:A4:49:FD:9F:FB:00:49:89:4C:5A"},{"id":"RTCCertificate_70:47:DC:96:5C:24:A1:C1:F0:A2:89:39:FC:B1:D9:69:66:EB:4A:F6:12:F0:68:43:1B:F9:D4:ED:D6:E2:D1:FE","timestamp":1560111929491.604,"type":"certificate","fingerprint":"70:47:DC:96:5C:24:A1:C1:F0:A2:89:39:FC:B1:D9:69:66:EB:4A:F6:12:F0:68:43:1B:F9:D4:ED:D6:E2:D1:FE","fingerprintAlgorithm":"sha- 256","base64Certificate":"MIIBFjCBvaADAgECAgkAhuXyX8OJm0EwCgYIKoZIzj0EAwIwETEPMA0GA1UEAwwGV2ViUlRDMB4XDTE5MDYwODIwMTU0MFoXDTE5MDcwOTIwMTU0MFowETEPMA0GA1UEAwwGV2ViUlRDMFkwEwYHKoZIzj0CAQYIKoZIzj0DAQcDQgAEQ6ZyQYSC7xZHSUhq6mxCWa+/VwRdO0U1GuMAUYjYSkAmgzfJ0mW TZbZWJ12V7LlimkOZtdXCv2UPSh3sDOHu/DAKBggqhkjOPQQDAgNIADBFAiBDBGAgqa2dxlewHn5661OgMK6xfanL13l9aLoyuvdCgAIhAOmal8xD0S0ZLRKO/WDOb3 RRLAqxCcn0Jmur/OPdoEDl"},{"id":"RTCCertificate_D1:3F:71:1A:FE:32:78:3D:AA:93:06:F3:E6:AF:22:E9:5A:BC:B7:D2:AD:D6:A4:49:FD:9F:FB:00:49:89:4C:5A","timestamp":1560111929491.604,"type":"certificate","fingerprint":"D1:3F:71:1A:FE:32:78:3D:AA:93:06:F3:E6:AF:22:E9:5A:BC:B7:D2:AD:D6:A4:49:FD:9F:FB:00:49:89:4C:5A","fingerprintAlgorithm":"sha- 256","base64Certificate":"MIIBFzCBvaADAgECAgkA7svx50DzS6swCgYIKoZIzj0EAwIwETEPMA0GA1UEAwwGV2ViUlRDMB4XDTE5MDYwODIwMTU0MFoXDTE5MDcwOTIwMTU0MFowETEPMA0GA1UEAwwGV2ViUlRDMFkwEwYHKoZIzj0CAQYIKoZIzj0DAQcDQgAEg3VCpwhtcNE3rEaBH8GTrWpQTcbnPGWEz0i2XAYE/A8pATEPoXb7mPojyEy8LxkmPSjkwrEodppNzA7X8Yjv2TAKBggqhkjOPQQDAgNJADBGAiEA3MWsKxnwNWssNhZ+mSGhZca63A8tvFIdRyf+CBOzNYwCIQD1JTiEdHntgBQ9/ZcaRVbQK MBU1X6+xYmtnwjJ+x2umw=="},{"id":"RTCCodec_0_Inbound_0","timestamp":1560111929491.604,"type":"codec","payloadType":0,"mimeType":"audio/PCMU","clockRate":8000},{"id":"RTCCodec_0_Inbound_103","timestamp":1560111929491.604,"type":"codec","payloadType":103,"mimeType":"audio/ISAC","clockRate":16000},{"id":"RTCCodec_0_Inbound_104","timestamp":1560111929491.604,"type":"codec","payloadType":104,"mimeType":"audio/ISAC","clockRate":32000},{"id":"RTCCodec_0_Inbound_105","t imestamp":1560111929491.604,"type":"codec","payloadType":105,"mimeType":"audio/CN","clockRate":16000},{"id":"RTCCodec_0_Inbound_106","timestamp":1560111929491.604,"type":"codec","payloadType":106,"mimeType":"audio/CN","clockRate":32000},{"id":"RTCCodec_0_Inbound_110","timestamp":1560111929491.604,"type":"codec","payloadType":110,"mimeType":"audio/telephone- event","clockRate":48000},{"id":"RTCCodec_0_Inbound_111","timestamp":1560111929491.604,"type":"codec","payloadType":111,"mimeType":"audio/opus","clockRate":48000},{"id":"RTCCodec_0_Inbound_112","timestamp":1560111929491.604,"type":"codec","payloadType":112,"mimeType":"audio/telephone-event","clockRate":32000},{"id":"RTCCodec_0_Inbound_113","timestamp":1560111929491.604,"type":"codec","payloadType":113,"mimeType":"audio/telephone- event","clockRate":16000},{"id":"RTCCodec_0_Inbound_126","timestamp":1560111929491.604,"type":"codec","payloadType":126,"mimeType":"audio/telephone- event","clockRate":8000},{"id":"RTCCodec_0_Inbound_13","timestamp":1560111929491.604,"type":"codec","payloadType":13,"mimeType":"audio/CN","clockRate":8000},{"id":"RTCCodec_0_Inbound_8","timestamp":1560111929491.604,"type":"codec","payloadType":8,"mimeType":"audio/PCMA","clockRate":8000},{"id":"RTCCodec_0_Inbound_9","timestamp":1560111929491.604,"type":"codec","payloadType":9,"mimeType":"audio/G722","clockRate":8000},{"id":"RTCCodec_0_Outbound_0","timestamp":1560111 929491.604,"type":"codec","payloadType":0,"mimeType":"audio/PCMU","clockRate":8000},{"id":"RTCCodec_0_Outbound_103","timestamp":1560111929491.604,"type":"codec","payloadType":103,"mimeType":"audio/ISAC","clockRate":16000},{"id":"RTCCodec_0_Outbound_104","timestamp":1560111929491.604,"type":"codec","payloadType":104,"mimeType":"audio/ISAC","clockRate":32000},{"id":"RTCCodec_0_Outbound_105","timestamp":1560111929491.604,"type":"codec","payloadType":105,"mimeType":"a udio/CN","clockRate":16000},{"id":"RTCCodec_0_Outbound_106","timestamp":1560111929491.604,"type":"codec","payloadType":106,"mimeType":"audio/CN","clockRate":32000},{"id":"RTCCodec_0_Outbound_110","timestamp":1560111929491.604,"type":"codec","payloadType":110,"mimeType":"audio/telephone- event","clockRate":48000},{"id":"RTCCodec_0_Outbound_111","timestamp":1560111929491.604,"type":"codec","payloadType":111,"mimeType":"audio/opus","clockRate":48000},{"id":"RTCCodec_0_Outbound_112","timestamp":1560111929491.604,"type":"codec","payloadType":112,"mimeType":"audio/telephone-event","clockRate":32000},{"id":"RTCCodec_0_Outbound_113","timestamp":1560111929491.604,"type":"codec","payloadType":113,"mimeType":"audio/telephone- event","clockRate":16000},{"id":"RTCCodec_0_Outbound_126","timestamp":1560111929491.604,"type":"codec","payloadType":126,"mimeType":"audio/telephone- event","clockRate":8000},{"id":"RTCCodec_0_Outbound_13","timestamp":1560111929491.604,"type":"codec","payloadType":13,"mimeType":"audio/CN","clockRate":8000},{"id":"RTCCodec_0_Outbound_8","timestamp":1560111929491.604,"type":"codec","payloadType":8,"mimeType":"audio/PCMA","clockRate":8000},{"id":"RTCCodec_0_Outbound_9","timestamp":1560111929491.604,"type":"codec","payloadType":9,"mimeType":"audio/G722","clockRate":8000},{"id":"RTCCodec_1_Inbound_100","timestamp":15 60111929491.604,"type":"codec","payloadType":100,"mimeType":"video/VP9","clockRate":90000},{"id":"RTCCodec_1_Inbound_101","timestamp":1560111929491.604,"type":"codec","payloadType":101,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Inbound_102","timestamp":1560111929491.604,"type":"codec","payloadType":102,"mimeType":"video/H264","clockRate":90000},{"id":"RTCCodec_1_Inbound_107","timestamp":1560111929491.604,"type":"codec","payloadType":107,"mimeType":"vi deo/rtx","clockRate":90000},{"id":"RTCCodec_1_Inbound_108","timestamp":1560111929491.604,"type":"codec","payloadType":108,"mimeType":"video/H264","clockRate":90000},{"id":"RTCCodec_1_Inbound_109","timestamp":1560111929491.604,"type":"codec","payloadType":109,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Inbound_114","timestamp":1560111929491.604,"type":"codec","payloadType":114,"mimeType":"video/red","clockRate":90000},{"id":"RTCCodec_1_Inbound_115","times tamp":1560111929491.604,"type":"codec","payloadType":115,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Inbound_116","timestamp":1560111929491.604,"type":"codec","payloadType":116,"mimeType":"video/ulpfec","clockRate":90000},{"id":"RTCCodec_1_Inbound_119","timestamp":1560111929491.604,"type":"codec","payloadType":119,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Inbound_120","timestamp":1560111929491.604,"type":"codec","payloadType":120,"mimeT ype":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Inbound_121","timestamp":1560111929491.604,"type":"codec","payloadType":121,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Inbound_122","timestamp":1560111929491.604,"type":"codec","payloadType":122,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Inbound_123","timestamp":1560111929491.604,"type":"codec","payloadType":123,"mimeType":"video/H264","clockRate":90000},{"id":"RTCCodec_1_Inbound_124", "timestamp":1560111929491.604,"type":"codec","payloadType":124,"mimeType":"video/H264","clockRate":90000},{"id":"RTCCodec_1_Inbound_125","timestamp":1560111929491.604,"type":"codec","payloadType":125,"mimeType":"video/H264","clockRate":90000},{"id":"RTCCodec_1_Inbound_127","timestamp":1560111929491.604,"type":"codec","payloadType":127,"mimeType":"video/H264","clockRate":90000},{"id":"RTCCodec_1_Inbound_96","timestamp":1560111929491.604,"type":"codec","payloadType":9 6,"mimeType":"video/VP8","clockRate":90000},{"id":"RTCCodec_1_Inbound_97","timestamp":1560111929491.604,"type":"codec","payloadType":97,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Inbound_98","timestamp":1560111929491.604,"type":"codec","payloadType":98,"mimeType":"video/VP9","clockRate":90000},{"id":"RTCCodec_1_Inbound_99","timestamp":1560111929491.604,"type":"codec","payloadType":99,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Outbound_ 100","timestamp":1560111929491.604,"type":"codec","payloadType":100,"mimeType":"video/VP9","clockRate":90000},{"id":"RTCCodec_1_Outbound_101","timestamp":1560111929491.604,"type":"codec","payloadType":101,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Outbound_102","timestamp":1560111929491.604,"type":"codec","payloadType":102,"mimeType":"video/H264","clockRate":90000},{"id":"RTCCodec_1_Outbound_107","timestamp":1560111929491.604,"type":"codec","payload Type":107,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Outbound_108","timestamp":1560111929491.604,"type":"codec","payloadType":108,"mimeType":"video/H264","clockRate":90000},{"id":"RTCCodec_1_Outbound_109","timestamp":1560111929491.604,"type":"codec","payloadType":109,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Outbound_114","timestamp":1560111929491.604,"type":"codec","payloadType":114,"mimeType":"video/red","clockRate":90000},{"id":"RTC Codec_1_Outbound_115","timestamp":1560111929491.604,"type":"codec","payloadType":115,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Outbound_116","timestamp":1560111929491.604,"type":"codec","payloadType":116,"mimeType":"video/ulpfec","clockRate":90000},{"id":"RTCCodec_1_Outbound_119","timestamp":1560111929491.604,"type":"codec","payloadType":119,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Outbound_120","timestamp":1560111929491.604,"typ e":"codec","payloadType":120,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Outbound_121","timestamp":1560111929491.604,"type":"codec","payloadType":121,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Outbound_122","timestamp":1560111929491.604,"type":"codec","payloadType":122,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Outbound_123","timestamp":1560111929491.604,"type":"codec","payloadType":123,"mimeType":"video/H264","clockRate" :90000},{"id":"RTCCodec_1_Outbound_124","timestamp":1560111929491.604,"type":"codec","payloadType":124,"mimeType":"video/H264","clockRate":90000},{"id":"RTCCodec_1_Outbound_125","timestamp":1560111929491.604,"type":"codec","payloadType":125,"mimeType":"video/H264","clockRate":90000},{"id":"RTCCodec_1_Outbound_127","timestamp":1560111929491.604,"type":"codec","payloadType":127,"mimeType":"video/H264","clockRate":90000},{"id":"RTCCodec_1_Outbound_96","timestamp":15 60111929491.604,"type":"codec","payloadType":96,"mimeType":"video/VP8","clockRate":90000},{"id":"RTCCodec_1_Outbound_97","timestamp":1560111929491.604,"type":"codec","payloadType":97,"mimeType":"video/rtx","clockRate":90000},{"id":"RTCCodec_1_Outbound_98","timestamp":1560111929491.604,"type":"codec","payloadType":98,"mimeType":"video/VP9","clockRate":90000},{"id":"RTCCodec_1_Outbound_99","timestamp":1560111929491.604,"type":"codec","payloadType":99,"mimeType":"video/r tx","clockRate":90000},{"id":"RTCIceCandidatePair_eDlSn4+Z_o4HO2DpI","timestamp":1560111929491.604,"type":"candidate- pair","transportId":"RTCTransport_0_1","localCandidateId":"RTCIceCandidate_eDlSn4+Z","remoteCandidateId":"RTCIceCandidate_o4HO2DpI","state":"succeeded","priority":9115038255631187000,"nominated":true,"writable":true,"bytesSent":132172362,"bytesReceived":588712,"totalRoundTripTime":0.097,"currentRoundTripTime":0,"availableOutgoingBitrate":3580817,"requestsReceived":239,"requestsSent":1,"responsesReceived":239,"responsesSent":239,"consentRequestsSent":238},{"id":"RTCIceCandidate _eDlSn4+Z","timestamp":1560111929491.604,"type":"local-candidate","transportId":"RTCTransport_0_1","isRemote":false,"networkType":"wifi","ip":"10.10.100.49","port":63479,"protocol":"udp","candidateType":"host","priority":2122260223,"deleted":false},{"id":"RTCIceCandidate_o4HO2DpI","timestamp":1560111929491.604,"type":"remote- candidate","transportId":"RTCTransport_0_1","isRemote":true,"ip":"10.10.100.49","port":52235,"protocol":"udp","candidateType":"host","priority":2122260223,"deleted":false},{"id":"RTCMediaStreamTrack_sender_3","timestamp":1560111929491.604,"type":"track","trackIdentifier":"93c3b5d1-5ad2-4d6f-b4ef- 9026d140cd12","remoteSource":false,"ended":false,"detached":false,"kind":"audio","audioLevel":0,"totalAudioEnergy":0,"totalSamplesDuration":0},{"id":"RTCMediaStreamTrack_sender_4","timestamp":1560111929491.604,"type":"track","trackIdentifier":"a6b75d65-225e-4a17-8566- 5ebfde288572","remoteSource":false,"ended":false,"detached":false,"kind":"video","frameWidth":640,"frameHeight":480,"framesSent":17672,"hugeFramesSent":3},{"id":"RTCMediaStream_OIL9zTwVhYSpGstFDdnOlBGaKGbLz16BJnlb","timestamp":1560111929491.604,"type":"stream","streamIdentifier":"OIL9zTwVhYSpGstFDdnOlBGaKGbLz16BJnlb","trackIds":["RTCMediaStreamTrack_sender_3","RTCMediaStreamTrack_sender_4"]},{"id":"RTCOutboundRTPAudioStream_3291843167","timestamp":15601119 29491.604,"type":"outbound-rtp","ssrc":3291843167,"isRemote":false,"mediaType":"audio","kind":"audio","trackId":"RTCMediaStreamTrack_sender_3","transportId":"RTCTransport_0_1","codecId":"RTCCodec_0_Outbound_111","packetsSent":29412,"retransmittedPacketsSent":0,"bytesSent":2502933,"retransmittedBytesSent":0},{"id":"RTCOutboundRTPVideoStream_3763384231","timestamp":1560111929491.604,"type":"outbound- rtp","ssrc":3763384231,"isRemote":false,"mediaType":"video","kind":"video","trackId":"RTCMediaStreamTrack_sender_4","transportId":"RTCTransport_0_1","codecId":"RTCCodec_1_Outbound_96","firCount":0,"pliCount":0,"nackCount":0,"qpSum":98593,"packetsSent":119697,"retransmittedPacketsSent":0,"bytesSent":127973312,"retransmittedBytesSent":0,"framesEncoded":17672,"totalEncodeTime":75.133},{"id":"RTCPeerConnection","timestamp":1560111929491.604,"type":"peer- connection","dataChannelsOpened":0,"dataChannelsClosed":0},{"id":"RTCTransport_0_1","timestamp":1560111929491.604,"type":"transport","bytesSent":132172362,"bytesReceived":588712,"dtlsState":"connected","selectedCandidatePairId":"RTCIceCandidatePair_eDlSn4+Z_o4HO2DpI","localCertificateId":"RTCCertificate_70:47:DC:96:5C:24:A1:C1:F0:A2:89:39:FC:B1:D9:69:66:EB:4A:F6:12:F0:68:43:1B:F9:D4:ED:D6:E2:D1:FE","remoteCertificateId":"RTCCertificate_D1:3F:71:1A:FE:32:78:3D:AA:93:06:F3:E 6:AF:22:E9:5A:BC:B7:D2:AD:D6:A4:49:FD:9F:FB:00:49:89:4C:5A"}]
Several data dimensions Transport Endpoint Platform Infrastructure ISP name / AS number Device type Topology (P2P / SFU / MCU) User network: End-user location , Network Type Operating system Server locations Media engine: Audio and video frame rate and size variations Browser / RTC stack Server network Packetization: Round Trip Time, Jitter, Packet loss CPU type App Version
Challenge: dealing with lots of data appVer buildVer buildName osName osVer totalMeanAudioRtt totalMeanVideoRtt countVideoRtt countAudioRtt totalInboundAudioPacketsLost totalInboundVideoPacketsLost totalOutboundAudioPacketsLost totalOutboundVideoPacketsLost totalInboundAudioPackets totalInboundVideoPackets totalOutboundAudioPackets totalOutboundVideoPackets totalMeanInboundVideoThroughput countInboundVideoThroughput totalMeanInboundAudioThroughput countInboundAudioThroughput totalMeanOutboundAudioThroughput countOutboundAudioThroughput totalMeanOutboundVideoThroughput Many Metrics
Challenge: dealing with lots of data appVer buildVer buildName osName osVer totalMeanAudioRtt totalMeanVideoRtt countVideoRtt countAudioRtt totalInboundAudioPacketsLost totalInboundVideoPacketsLost totalOutboundAudioPacketsLost totalOutboundVideoPacketsLost totalInboundAudioPackets totalInboundVideoPackets totalOutboundAudioPackets totalOutboundVideoPackets totalMeanInboundVideoThroughput countInboundVideoThroughput totalMeanInboundAudioThroughput countInboundAudioThroughput totalMeanOutboundAudioThroughput countOutboundAudioThroughput totalMeanOutboundVideoThroughput Many Metrics Measures× • Average • Mean • Percentile • Skew • Kurtosis
Challenge: dealing with lots of data appVer buildVer buildName osName osVer totalMeanAudioRtt totalMeanVideoRtt countVideoRtt countAudioRtt totalInboundAudioPacketsLost totalInboundVideoPacketsLost totalOutboundAudioPacketsLost totalOutboundVideoPacketsLost totalInboundAudioPackets totalInboundVideoPackets totalOutboundAudioPackets totalOutboundVideoPackets totalMeanInboundVideoThroughput countInboundVideoThroughput totalMeanInboundAudioThroughput countInboundAudioThroughput totalMeanOutboundAudioThroughput countOutboundAudioThroughput totalMeanOutboundVideoThroughput Many Metrics Measures× × n samples • Average • Mean • Percentile • Skew • Kurtosis • Sample rate • Number of participants • Call duration
Challenge: dealing with lots of data appVer buildVer buildName osName osVer totalMeanAudioRtt totalMeanVideoRtt countVideoRtt countAudioRtt totalInboundAudioPacketsLost totalInboundVideoPacketsLost totalOutboundAudioPacketsLost totalOutboundVideoPacketsLost totalInboundAudioPackets totalInboundVideoPackets totalOutboundAudioPackets totalOutboundVideoPackets totalMeanInboundVideoThroughput countInboundVideoThroughput totalMeanInboundAudioThroughput countInboundAudioThroughput totalMeanOutboundAudioThroughput countOutboundAudioThroughput totalMeanOutboundVideoThroughput Many Metrics Measures× × n samples • Average • Mean • Percentile • Skew • Kurtosis • Sample rate • Number of participants • Call duration × m customers • Customer segments
Why do we need ML? Reducing costs 1 Image source: http://xingwu.me/2014/12/10/My-AWS-Account-Got-Compromised/
Challenge: figuring out what matters Customer Value Operating Complexity
Why do we need ML? Saving users from analytics overload 1
Typical troubleshooting approach 17 Generate hypothesis Look for anomalies Filter Evaluate sub- segment
Traditional troubleshooting challenges 18 Generate hypothesis Look for anomalies Filter Evaluate sub- segment Experience required to generate good hypotheses Not all anomalies are obvious Many filters to define Many sub- segments to review
Ideal solution: the system should tell you where to look 19
Finding Hidden Call Quality Issues with Machine Learning 20 Deliver Better User Experiences
Machine Learning approaches 21 Image source: https://towardsdatascience.com/deep-learning-for-image-classification-why-its-challenging-where-we-ve-been-and-what- s-next-93b56948fcef
Machine Learning approaches 22 Image source: https://towardsdatascience.com/deep-learning-for-image-classification-why-its-challenging-where-we-ve-been-and-what- s-next-93b56948fcef
Methodology 23 Collect data Check the data Clean the data Feature reduction Clustering Labeling
Collect data 24
Check your data 25
Clean your data • Missing values • Duplicates • Outliers • Balancing • Normalization 26
Dimension reduction 27 Feature elimination Feature selection Feature extraction Reducing unnecessary complexity
Feature selection Correlation matrix to determine significance 28 meanAudioRtt meanVideoRtt Local Latitude Local Longitude Server Latitude Server Longitude meanAudioRtt 100% 42% -24% 59% 0% 0% meanVideoRtt 42% 100% -15% 29% 0% 0% Local Latitude -24% -15% 100% -23% 0% 0% Local Longitude 59% 29% -23% 100% 0% 0% Server Latitude 0% 0% 0% 0% 100% -100% Server Longitude 0% 0% 0% 0% -100% 100%
Round Trip Time (RTT) 29 Round-trip time is the time it takes for a packet to travel through an IP network, from a sending endpoint to a receiving endpoint and back, not including the time to process the packet at its destination. Many factors affect RTT, like propagation delay, processing delay, queuing delay, and transmission delay. Sender ReceiverNetwork 𝑡 𝑠𝑡𝑎𝑟𝑡 𝑡 𝑎𝑐𝑘 𝑅𝑇𝑇 = 𝑡 𝑎𝑐𝑘 − 𝑡 𝑠𝑡𝑎𝑟𝑡 − 𝑡 𝑠𝑙𝑟 𝑡 𝑠𝑙𝑟
Feature reduction Principal Component Analysis 30 http://setosa.io/ev/principal-component-analysis/ • Find feature-combinations that have the most variation • Creates a new set of dimensions to maximize these variations • Remove the feature-combinations that don’t show much variation
Clustering with Gaussian Mixture Model (GMM) 31
Optimizing the model 32 Overfit model Fit model Minimize the number of variables needed in your model Minimize the number of clusters Maintain predictiveness on new datasets
Determining the optimal cluster size with Bayesian Inference Criterion (BIC) 33Number of Clusters BICScore Number of PCA dimensions
Methodology: Iterative in practice 34 Collect data Check the data Clean the data Dimension reduction Clustering Labeling
Example of a customer handling Millions of calls a day 3
RTT distribution for this service is 36 Range Proportion of the data (%) Low 0 < RTT < 150 68% Medium 150 < RTT < 250 19% Large 250 < RTT < 700 12% Very large RTT > 700 1%
RTT distribution for this service is 37 Area for exploration Range Proportion of the data (%) Low 0 < RTT < 150 68% Medium 150 < RTT < 250 19% Large 250 < RTT < 700 12% Very large RTT > 700 1%
Cluster results 38
Cluster analysis results 39
Cluster analysis results 40
Cluster 0: 16% of high RTTs • Network conditions are good • Local users in a specific country • Distance can be the main cause for large RTTs
Cluster 5: 20% of high RTTs • Bad network conditions • Large jitter, Large fraction loss • Users all over the world • Roughly large distance • Network congestion and distance can be the main cause of large RTTs 42
Cluster 3: 50% of high RTTs • Good Network condition • Local users in Asia • Main cause of large RTT can be large distance
Analysis summary 44 32% of calls have high RTT's 20% due to congestion 2 geographic problem areas Check server infrastructure & network Add/move servers
Real solution: the system tells you where to look 45
All thingsrtc finding hidden issues with ml

More Related Content

PPTX
Ensuring Voice Quality for Amazon Connect
Carl Blume
 
PDF
Barry Russel - AWS and Marketplace :: AWS 20151120 Partner Techshift
Amazon Web Services Korea
 
PDF
AWS Marketplace Enabling Digital Innovation (David Wright, AWS BD) :: AWS Tec...
Amazon Web Services Korea
 
PDF
Hub Unified Presales Productivity Platform - AWS Marketplace Private Offering
Freddy Mangum
 
PPTX
AWS Partner Network (APN) Visión General
GeneXus
 
PPTX
API Management Part 1 - An Introduction to Azure API Management
BizTalk360
 
PPTX
Finding Hidden Call Quality Issues with Machine Learning
callstats.io
 
PDF
ClueCon 2018: AI For Real-time Communications by Binoy Chemmagate
callstats.io
 
Ensuring Voice Quality for Amazon Connect
Carl Blume
 
Barry Russel - AWS and Marketplace :: AWS 20151120 Partner Techshift
Amazon Web Services Korea
 
AWS Marketplace Enabling Digital Innovation (David Wright, AWS BD) :: AWS Tec...
Amazon Web Services Korea
 
Hub Unified Presales Productivity Platform - AWS Marketplace Private Offering
Freddy Mangum
 
AWS Partner Network (APN) Visión General
GeneXus
 
API Management Part 1 - An Introduction to Azure API Management
BizTalk360
 
Finding Hidden Call Quality Issues with Machine Learning
callstats.io
 
ClueCon 2018: AI For Real-time Communications by Binoy Chemmagate
callstats.io
 

Similar to All thingsrtc finding hidden issues with ml (17)

PDF
Getting Started with callstats.io
callstats.io
 
PPTX
How Active WebRTC Connectivity Tests Are Improving User Experiences
callstats.io
 
PDF
ClueCon 2018: Real-time Communications Monitoring 101 by Varun Singh
callstats.io
 
PDF
WebRTC - an analytics perspective by callstats.io
callstats.io
 
PDF
Graph Gurus 21: Integrating Real-Time Deep-Link Graph Analytics with Spark AI
TigerGraph
 
PDF
Spark stack for Model life-cycle management
datamantra
 
PDF
Telecom Network & SIEM logs analysis using machine learning
ALTANAI BISHT
 
PDF
One year of measuring WebRTC service quality
callstats.io
 
PDF
Using machine learning for customer service (Data Talks Club)
Neal Lathia
 
PDF
A Rich Alternative to webrtc-internals
callstats.io
 
PPTX
Phone Fraud Detection
Sri Kanajan
 
PDF
Machine Learning applications in Voice over IP
ALTANAI BISHT
 
PDF
Graph Gurus Episode 3: Anti Fraud and AML Part 1
TigerGraph
 
PDF
Lessons Learned: 3 Insights from Enterprise Organizations to Improve the Digi...
panagenda
 
PDF
Real-Time Fraud Detection at Scale—Integrating Real-Time Deep-Link Graph Anal...
Databricks
 
PDF
Accelerate ROI for Microsoft 365 through Improved Digital Experience Monitoring
panagenda
 
PPTX
20151021_DataScienceMeetup_revised
rerngvit yanggratoke
 
Getting Started with callstats.io
callstats.io
 
How Active WebRTC Connectivity Tests Are Improving User Experiences
callstats.io
 
ClueCon 2018: Real-time Communications Monitoring 101 by Varun Singh
callstats.io
 
WebRTC - an analytics perspective by callstats.io
callstats.io
 
Graph Gurus 21: Integrating Real-Time Deep-Link Graph Analytics with Spark AI
TigerGraph
 
Spark stack for Model life-cycle management
datamantra
 
Telecom Network & SIEM logs analysis using machine learning
ALTANAI BISHT
 
One year of measuring WebRTC service quality
callstats.io
 
Using machine learning for customer service (Data Talks Club)
Neal Lathia
 
A Rich Alternative to webrtc-internals
callstats.io
 
Phone Fraud Detection
Sri Kanajan
 
Machine Learning applications in Voice over IP
ALTANAI BISHT
 
Graph Gurus Episode 3: Anti Fraud and AML Part 1
TigerGraph
 
Lessons Learned: 3 Insights from Enterprise Organizations to Improve the Digi...
panagenda
 
Real-Time Fraud Detection at Scale—Integrating Real-Time Deep-Link Graph Anal...
Databricks
 
Accelerate ROI for Microsoft 365 through Improved Digital Experience Monitoring
panagenda
 
20151021_DataScienceMeetup_revised
rerngvit yanggratoke
 
Ad

Recently uploaded (20)

PDF
Odoo Companies in India – Driving Business Transformation.pdf
azhuhardeen1968
 
PDF
Adobe Premiere Pro 2025 (v24.5.0.057) Crack free
ghrom2211g
 
PDF
System and Network Administraation Chapter 3
jaramharo
 
PPTX
CHAPTER 2 - PM Management and IT Context
KevinPutra14
 
PDF
Designing Intelligence for the Shop Floor.pdf
nikglvk
 
PDF
Design an Analysis of Algorithms II-SECS-1021-03
DilanEscobar1
 
PDF
medical staffing services at VALiNTRY
Tiyan Grayson
 
PPTX
Reimagine Home Health with the Power of Agentic AI​
AutomationEdge Technologies
 
PDF
Internet Downloader Manager (IDM) Crack 6.42 Build 42 Updates Latest 2025
itskinga12
 
PDF
top salesforce developer skills in 2025.pdf
CloudMetic
 
PDF
Digital Strategies for Manufacturing Companies
Virendra Rai, PMP
 
PDF
How to Choose the Right IT Partner for Your Business in Malaysia
Asian Business Services & Technologies
 
PPTX
Operating system designcfffgfgggggggvggggggggg
rmskumara09
 
PDF
2025 Textile ERP Trends: SAP, Odoo & Oracle
Aetos Technologies
 
PPTX
assetexplorer- product-overview - presentation
nonameist3434
 
PDF
Adobe Illustrator 28.6 Crack My Vision of Vector Design
ghrom2211g
 
PDF
EN-Survey-Report-SAP-LeanIX-EA-Insights-2025.pdf
deepakkhaitan3
 
PDF
Raksha Bandhan Grocery Pricing Trends in India 2025.pdf
Actowiz Solustions
 
PPTX
Lecture 3: Operating Systems Introduction to Computer Hardware Systems
hci7se
 
PDF
PTS Company Brochure 2025 (1).pdf.......
pts464036
 
Odoo Companies in India – Driving Business Transformation.pdf
azhuhardeen1968
 
Adobe Premiere Pro 2025 (v24.5.0.057) Crack free
ghrom2211g
 
System and Network Administraation Chapter 3
jaramharo
 
CHAPTER 2 - PM Management and IT Context
KevinPutra14
 
Designing Intelligence for the Shop Floor.pdf
nikglvk
 
Design an Analysis of Algorithms II-SECS-1021-03
DilanEscobar1
 
medical staffing services at VALiNTRY
Tiyan Grayson
 
Reimagine Home Health with the Power of Agentic AI​
AutomationEdge Technologies
 
Internet Downloader Manager (IDM) Crack 6.42 Build 42 Updates Latest 2025
itskinga12
 
top salesforce developer skills in 2025.pdf
CloudMetic
 
Digital Strategies for Manufacturing Companies
Virendra Rai, PMP
 
How to Choose the Right IT Partner for Your Business in Malaysia
Asian Business Services & Technologies
 
Operating system designcfffgfgggggggvggggggggg
rmskumara09
 
2025 Textile ERP Trends: SAP, Odoo & Oracle
Aetos Technologies
 
assetexplorer- product-overview - presentation
nonameist3434
 
Adobe Illustrator 28.6 Crack My Vision of Vector Design
ghrom2211g
 
EN-Survey-Report-SAP-LeanIX-EA-Insights-2025.pdf
deepakkhaitan3
 
Raksha Bandhan Grocery Pricing Trends in India 2025.pdf
Actowiz Solustions
 
Lecture 3: Operating Systems Introduction to Computer Hardware Systems
hci7se
 
PTS Company Brochure 2025 (1).pdf.......
pts464036
 
Ad

All thingsrtc finding hidden issues with ml