Recognize This?Recognize This?

SPA’ OpinionSPA’ Opinion

ObjectivesObjectives

After attending this presentation, you After attending this presentation, you will be able to:will be able to:

Know when to use Server Performance Know when to use Server Performance AdvisorAdvisor

Assist customers troubleshoot and Assist customers troubleshoot and collect data for common server collect data for common server performance problemsperformance problems

Recommend to customers where to find Recommend to customers where to find detailed information about AD and IIS detailed information about AD and IIS serversservers

Server Performance AdvisorServer Performance Advisor

Diagnoses root causesDiagnoses root causesRecommends corrective actionRecommends corrective action

Configured to collect the right dataConfigured to collect the right dataIIS, Active Directory, … Server RoleIIS, Active Directory, … Server Role

available across multiple servers for available across multiple servers for centralized per-server analysis & centralized per-server analysis & reportingreporting

Wealth of hard to find dataWealth of hard to find dataReports response time and resource Reports response time and resource usageusage

Ready made for PSS for expert’s viewReady made for PSS for expert’s view

Where Does The Tool Fit?Where Does The Tool Fit?

Microscope for a single serverMicroscope for a single server

Safe for customer production serversSafe for customer production servers

Administrator ToolAdministrator ToolTroubleshoot peak loadsTroubleshoot peak loads

Look for well known problemsLook for well known problems

Trend normal performanceTrend normal performance

New Perfmon ReportNew Perfmon Report

Not Microsoft Operations ManagerNot Microsoft Operations Manager

Problem SpaceProblem Space

Detecting performance problems is Detecting performance problems is difficultdifficult

IssuesIssuesInterconnected server componentsInterconnected server components

Server problem detection and resolution Server problem detection and resolution ReactiveReactive

Affects availability for many peopleAffects availability for many people

Performance problems are even harderPerformance problems are even harderSensitive to workload, configuration and Sensitive to workload, configuration and hardwarehardware

Problems SPA SolvesResponsivenessProblems SPA SolvesResponsiveness

Response TimeResponse TimeShow long response time on the serverShow long response time on the serverWeb page slow to render Web page slow to render

Failing RequestsFailing RequestsPatterns of failuresPatterns of failuresSource of failuresSource of failures

Hung ApplicationHung ApplicationNo response from Web Server for pageNo response from Web Server for pageEvents backing up behind other eventsEvents backing up behind other events

Problems SPA Solves Resource UsageProblems SPA Solves Resource Usage

Rogue clientsRogue clientsContinuous failed logons taking CPUContinuous failed logons taking CPU

Single client repeating an actionSingle client repeating an action

Bad scripts / applicationsBad scripts / applicationsWeb scripts requiring high CPU per Web scripts requiring high CPU per operationoperation

Binding too oftenBinding too often

Out of resourcesOut of resourcesLow memory availableLow memory available

Network utilization too highNetwork utilization too high

Problems SPA Solves Tuning and ConfigurationProblems SPA Solves Tuning and Configuration

Cache size too smallCache size too smallIIS Registry key set wrongIIS Registry key set wrongAvailable memory for AD DIT cacheAvailable memory for AD DIT cache

Password expiration policyPassword expiration policyToo many password change operationsToo many password change operations

Not enough dynamic portsNot enough dynamic portsUnexplained failures on networkUnexplained failures on networkClients unhappy with service while Clients unhappy with service while server appears to be okayserver appears to be okay

Diagnostic ApproachesCurrent ApplicationDiagnostic ApproachesCurrent Application

Each Admin has favorite approachEach Admin has favorite approachtypically they ignore the other methodstypically they ignore the other methods

20 Questions with Support20 Questions with Supportwhat versionwhat version

how many CPUshow many CPUs

which Perfmon counterswhich Perfmon counters

DCR level questionsDCR level questionssend me the crash dumpsend me the crash dump

hook up the Kernel debuggerhook up the Kernel debugger

Server Performance AdvisorDiagnostic Approach

Server Performance AdvisorDiagnostic Approach

Gathers multiple data sources per problemGathers multiple data sources per problemWindows Operating System / Application TracesWindows Operating System / Application Traces

Performance CountersPerformance Counters

Configuration / Registry SettingsConfiguration / Registry Settings

Diagnoses root causes and recommends Diagnoses root causes and recommends corrective actioncorrective action

Puts the various data sources in one reportPuts the various data sources in one report

Reduces / Hides marginally useful dataReduces / Hides marginally useful data

Adds warnings and actionsAdds warnings and actions

Diagnostic Building Blocks TroubleshootingDiagnostic Building Blocks Troubleshooting

Where we are Where we are today:today:

Hundreds of tools are Hundreds of tools are poorly documented, poorly documented, distributed distributed inconsistentlyinconsistently

Future:Future:Integration with MOM Integration with MOM for time-scoped for time-scoped troubleshooting tools.troubleshooting tools.

Windows Diagnostic Windows Diagnostic InfrastructureInfrastructure

Create generic, Create generic, updateable WDI updateable WDI troubleshooter to be troubleshooter to be applied to different applied to different domains.domains.

Dozens of scenarios Dozens of scenarios automatically automatically detected and detected and repairedrepaired

TechnologyTechnology DescriptionDescription PlatforPlatformm

OwnerOwner

PSS ToolsPSS Tools HundredsHundreds W2K+W2K+ PSSPSS

PerfmonPerfmon Performance Performance counter Logger counter Logger

W2K+W2K+ WCFWCF

SPASPA Server Server performance performance diagnosticsdiagnostics

W2K3W2K3

Watson Watson (Windows Error (Windows Error Reporting)Reporting)

Resolution of Resolution of crashes and crashes and hangshangs

XP+XP+

MOMMOM VariousVarious W2K+W2K+ EMDEMD

Help and Help and Support CenterSupport Center

Self assisted Self assisted W2K+W2K+ APAP

AP– Assisted PlatformEMD – Enterprise Management DivisionWCF – Windows Core Fundamentals

ArchitectureArchitectureServer system

Application Request Trace

Kernel Resource Trace

Performance Counter Data

Registry Data

Monitoring module

PLA Layer

DiagnosisReport

...

...

...…

Diagnostic EngineSPA Report

Request Tracking State

Machine

Diagnostic Rules

Schema for Counting and

Reporting

Possible InstrumentationPossible Instrumentation

Where we are today:Where we are today:Lots of instrumentation Lots of instrumentation technologies exists across the technologies exists across the companycompanyETW has become the de-facto ETW has become the de-facto standard for diagnostic and standard for diagnostic and performance tracingperformance tracing

Future:Future:Ongoing:Ongoing:

Identify and document existing Identify and document existing instrumentation within shipping instrumentation within shipping versions of windows that can be used to versions of windows that can be used to resolve top PSS support issues todayresolve top PSS support issues today

Drive diagnostic instrumentation in Drive diagnostic instrumentation in important modules and scenarios for important modules and scenarios for Win2K3 SP1Win2K3 SP1

LonghornLonghorn

Aggressively drive prescriptive Aggressively drive prescriptive guidelines and tools for instrumentation guidelines and tools for instrumentation coverage and methodology for coverage and methodology for Longhorn. Longhorn.

Instrumentation enhancements to Instrumentation enhancements to support end-to-end tracingsupport end-to-end tracing

Long Term: Long Term: Extend Mom to collect and store away Extend Mom to collect and store away trace filestrace files

TechnologTechnologyy

DescriptionDescription PlatforPlatformm

In In SPA?SPA?

ETWETW Event Tracing for Event Tracing for Windows : Hi Perf Windows : Hi Perf tracing facilitytracing facility

W2K+W2K+ YesYes

Perf ctrsPerf ctrs Performance Performance CountersCounters

W2K+W2K+ YesYes

Nt Event Nt Event LogLog

NT Event LogNT Event Log W2K+W2K+ No, No, soon…soon…

WMI WMI Windows Mgmt Windows Mgmt instrumentation instrumentation

W2K+W2K+ No, No, but…but…

WPPWPP Debug tracing Debug tracing based on ETWbased on ETW

W2K+W2K+ NoNo

SQM SQM Software Quality Software Quality Metrics Metrics

AllAll NoNo

Private Private LogsLogs

IIS type logs, IIS type logs, private formatsprivate formats

AllAll NoNo

Key Data Source ETWKey Data Source ETW

Event Tracing for Windows (Event Tracing for Windows (ETWETW) is now the de facto ) is now the de facto diagnostic instrumentation technology due to its scalability diagnostic instrumentation technology due to its scalability and performanceand performance

Efficient per-processor buffering schemeEfficient per-processor buffering scheme

Non-blocking logging mechanismNon-blocking logging mechanism

Buffers directly to consumers or flushed to disk by a separate Buffers directly to consumers or flushed to disk by a separate thread thread

Buffering in the kernel allows data resilience to application Buffering in the kernel allows data resilience to application crashescrashes

Schematized events for programmatic analysis Schematized events for programmatic analysis

Supports user mode applications and kernel mode driver Supports user mode applications and kernel mode driver providersproviders

Supports logging at DPC level or from ISRSupports logging at DPC level or from ISR

1500 cycles per event of 100 bytes1500 cycles per event of 100 bytes

72K events per second @5% CPU cost on a 3GHz machine72K events per second @5% CPU cost on a 3GHz machine

Enable or disable dynamically in production systems without Enable or disable dynamically in production systems without a debugger, checked builds, reboots or App restartsa debugger, checked builds, reboots or App restarts

Enables diagnosis of issues that disappear under the Enables diagnosis of issues that disappear under the debuggerdebugger

Server Performance AdvisorServer Performance Advisor

Key ScenariosKey Scenarios

Windows 2003Windows 2003Not XPNot XP

Not Window 2000Not Window 2000

High server CPU of any server roleHigh server CPU of any server role

Performance spikesPerformance spikesCollect a whileCollect a while

Zoom InZoom In

Unknown performance problemUnknown performance problemServer Performance Advisor rulesServer Performance Advisor rules

FutureFuture

V1.1V1.1V2.0 PlannedV2.0 Planned

W2003 SP1 TimeframeW2003 SP1 TimeframeFile Server, DNS Server and other rolesFile Server, DNS Server and other rolesTrending with Perfmon SQL DBTrending with Perfmon SQL DBEvent Log problem diagnosticsEvent Log problem diagnostics

Long TermLong TermIntegrate into Windows Diagnostic Integrate into Windows Diagnostic InfrastructureInfrastructureIntegrate into Perfmon V2.0Integrate into Perfmon V2.0MOM workMOM work

Best practicesBest practices

Pick key serversPick key serversDaily collectionsDaily collections

Send to central report serverSend to central report server

Set up MOM triggers to run Server Set up MOM triggers to run Server Performance AdvisorPerformance Advisor

Run on demand when CPU highRun on demand when CPU high

ConclusionConclusion

Server Performance Advisor can help Server Performance Advisor can help you find root cause of performance you find root cause of performance problems in Active Directory and IIS problems in Active Directory and IIS 6.06.0

Consider it when unable to pin down Consider it when unable to pin down performance problemsperformance problems

For external or internal customersFor external or internal customersWWW.Microsoft.ComWWW.Microsoft.Com/downloads/downloads

Keyword SPAKeyword SPA

Questions

© 2004 Microsoft Corporation. All rights reserved.This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.