Microsoft Windows Azure - Diagnostics Presentation

Windows Azure DiagnosticsLogging and Monitoring in the CloudMatthew KernerProgram Manager, Windows AzurePDC09-SVC15

Diagnostics: Single Server vs. the CloudSingle ServerCloudStatic EnvironmentSingle well-known instanceTraceable local transactionsLocal Access FeasibleAll in one TS sessionData & tools co-locatedIn-Place ChangesDynamic EnvironmentMulti-instance, elastic capacityDistributed transactionsLocal Access InfeasibleMany nodesDistributed, scaled-out dataService Upgrades

Windows Azure DiagnosticsSDK component providing distributed monitoring & data collection for cloud appsSupport Standard Diagnostics APIsCloud-FriendlyManage multiple role instances centrallyScalableBuilt on Windows Azure Storage & used by scale-out Windows Azure platform componentsDeveloper In ControlWhat to collect & when to collect it

Hello WorldWindows Azure DiagnosticsDemo

Windows Azure DiagnosticsConfigurationRole InstanceRoleData collection(traces, logs, crash dumps)Quota enforcement Diagnostic MonitorLocal directory storageWindows Data SourcesIIS Logs & Failed Request LogsPerf CountersWindows Event Logs

Windows Azure DiagnosticsRequest uploadRole InstanceWindows Azure StorageRoleDiagnostic MonitorLocal directory storageWindows Data SourcesScheduled or on-demand upload

Windows Azure DiagnosticsDevelopmentFabricWindows AzureHosted Service

DevelopmentFabricWindows Azure DiagnosticsWindows AzureHosted ServiceDiagnostic ManagerDesktop Diag ApplicationController CodeConfigure

How-ToActivate Windows Azure DiagnosticsGenerate DataEnable Local BufferingTransfer to Windows Azure Storage

Sample: Activate WA Diagnostics// This is done for you automatically by // Windows Azure Tools for Visual Studio// Add a reference to Microsoft.WindowsAzure.DiagnosticsusingMicrosoft.WindowsAzure.Diagnostics; // Activate diagnostics in the role's OnStart() methodpublicoverrideboolOnStart(){ // Use the connection string contained in the // application configuration setting named // "DiagnosticsConnectionString” // If the value of this setting is // "UseDevelopmentStorage=true" then will use dev stgDiagnosticMonitor.Start("DiagnosticsConnectionString"); ...}

Sample: Web.Config Changes<!– This is automatically inserted by VS.The listener routes System.Diagnostics.Trace messages to Windows Azure Diagnostics.--><system.diagnostics> <trace> <listeners> <addtype="Microsoft.WindowsAzure.Diagnostics.DiagnosticMonitorTraceListener, Microsoft.WindowsAzure.Diagnostics, Version=1.0.0.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35" name="AzureDiagnostics"> <filtertype="" /> </add> </listeners> </trace></system.diagnostics>

Sample: Generate Diagnostics DatastringmyRoleInstanceName =RoleEnvironment.CurrentRoleInstance.Id;// Trace with standard .Net tracing APIsSystem.Diagnostics.Trace.TraceInformation( "Informational trace from " + myRoleInstanceName); // Capture full crash dumpsCrashDumps.EnableCollection(true);// Capture mini crash dumpsCrashDumps.EnableCollection(false);

Sample: Enable Local Data Buffering// Managed traces, IIS logs, failed request logs, // crashdumps and WA diags internal logs are buffered // in local storage by default. Other data sources must be // added explicitlyDiagnosticMonitorConfigurationdiagConfig = DiagnosticMonitor.GetDefaultInitialConfiguration();// Add performance counter monitoringPerformanceCounterConfigurationprocTimeConfig = newPerformanceCounterConfiguration();// Run typeperf.exe /q to query for counter namesprocTimeConfig.CounterSpecifier = @"\Processor(*)\% Processor Time";procTimeConfig.SampleRate = System.TimeSpan.FromSeconds(1.0);diagConfig.PerformanceCounters.DataSources.Add(procTimeConfig);// Continued on next slide...

Sample: Enable Local Data Buffering// Continued from previous slide... // Add event collection from the Windows Event Log// Syntax: <Channel>!<xpath query> // http://msdn.microsoft.com/en-us/library/dd996910(VS.85).aspx diagConfig.WindowsEventLog.DataSources.Add("System!*");// Restart diagnostics with this custom local buffering // configurationDiagnosticMonitor.Start( "DiagnosticsConnectionString", diagConfig);

Sample: Web.Config Changes<system.webServer> <tracing> <traceFailedRequests> <addpath="*"> <traceAreas> <addprovider="ASP"verbosity="Verbose" /> <addprovider="ASPNET"areas="Infrastructure,Module,Page,AppService"verbosity="Verbose" /> <addprovider="ISAPI Extension"verbosity="Verbose"/> <addprovider="WWW Server"verbosity="Verbose"/> </traceAreas> <failureDefinitionsstatusCodes="200-599"/> </add> </traceFailedRequests> </tracing></system.webServer>

Sample: Scheduled Data Transfer// Start off with the default initial configurationDiagnosticMonitorConfiguration dc =DiagnosticMonitor.GetDefaultInitialConfiguration();dc.WindowsEventLog.DataSources.Add("Application!*");dc.WindowsEventLog.ScheduledTransferPeriod = System.TimeSpan.FromMinutes(5.0);DiagnosticMonitor.Start("DiagnosticsConnectionString", dc);

Sample: On-Demand Data Transfer// On-Demand transfer of buffered files.// This code can live in the role, or on the desktop,// or even in another service.varddm = newDeploymentDiagnosticManager(storageAccount, deploymentID);varridm = ddm.GetRoleInstanceDiagnosticManager(roleName,roleInstanceName);vardataBuffersToTransfer = DataBufferName.Logs;OnDemandTransferOptionstransferOptions = newOnDemandTransferOptions();transferOptions.From = DateTime.MinValue;transferOptions.To = DateTime.UtcNow;transferOptions.LogLevelFilter = LogLevel.Critical;GuidrequestID = ridm.BeginOnDemandTransfer(dataBuffersToTransfer,transferOptions);

Storage ConsiderationsStandard WA Storage costs apply for transactions, storage & bandwidthData RetentionLocal buffers are aged out by the Diagnostic Monitor according to configurable quotasYou control data retention for data in table/blob storageQuery Performance on Tabular DataPartitioned by high-order bits of the tick countQuery by time is efficientFilter by verbosity level at transfer time

Feature SummaryLocal data bufferingConfigurable trace, perf counter, Windows event log, IIS log & file bufferingLocal buffer quota managementQuery & modify config from the cloud or from the desktop per role instanceTransfer to WA StorageScheduled & on-demandFilter by data type, verbosity & time rangeTransfer completion notificationQuery & modify from the cloud and from the desktop per role instanceUnder the hood

Role runs in Performance Log Users group

Coming Soon: IIS Logs generated in role’s local data directoryCommon Diagnostic TasksPerformance measurementResource usageTroubleshooting and debuggingProblem detectionQuality of Service MetricsCapacity planningTraffic analysis (users, views, peak times)BillingAuditing

Performance Measurement Resource UsageTroubleshootingWindows Azure DiagnosticsDemo

http://diags.cloudapp.netWeb RoleSurveyMy Utility ClassesPowerShell scriptsDesktopCloudDiagnostic ManagerDiagnostic MonitorDiagsDiagController.exeSurveyResultsBlobControllerTableMy Utility ClassesWindows Azure Storage

Windows Azure DiagnosticsSDK component providing distributed monitoring & data collection for cloud appsStandard diagnostics APIsCloud-Friendly and ScalableDeveloper In ControlAvailable now in the WA SDK

YOUR FEEDBACK IS IMPORTANT TO US!Please fill out session evaluation forms online atMicrosoftPDC.com

Learn More On Channel 9Expand your PDC experience through Channel 9Explore videos, hands-on labs, sample code and demos through the new Channel 9 training courseschannel9.msdn.com/learnBuilt by Developers for Developers….

Microsoft Windows Azure - Diagnostics Presentation

More Related Content

Viewers also liked (6)

Similar to Microsoft Windows Azure - Diagnostics Presentation (20)

More from Microsoft Private Cloud (20)

Recently uploaded (20)

Microsoft Windows Azure - Diagnostics Presentation