Visual Studio 2005 Team SystemWinning the testing space with advanced testing tools

Visual Studio 2005 Team SystemWinning the testing space with advanced testing tools

Eric AdamsEric AdamsProgram ManagerProgram ManagerVisual Studio 2005 Team SystemVisual Studio 2005 Team SystemMicrosoft CorporationMicrosoft Corporation

Technical Breakout Session: DEV345Technical Breakout Session: DEV345

Visual Studio 2005 Team SystemTesting Tools

Visual Studio 2005 Team SystemTesting Tools

Presentation today coversPresentation today coversVisual Studio 2005 Team SystemVisual Studio 2005 Team System

Unit testingUnit testing

Web testingWeb testing

Load testingLoad testing

Note:Note:Everything is integrated into VS ShellEverything is integrated into VS Shell

If you know VS, you know the testing If you know VS, you know the testing toolstools

    

Rational

16.9%

Com puw are

8.5%

Em pirix

7.1%

Parasoft

4.5%

Quest Softw are

0.9%Telelogic

1.1%Segue

3.7%

RadView

0.9%MKS

0.6%

Others

2.2%

Mercury Interactive

53.6%

Mercury Interactive Rational Compuware Empirix

Parasoft Segue Telelogic Quest Software

RadView MKS Others

Worldwide Distributed TestingTotal License Revenue Share

Worldwide Distributed TestingTotal License Revenue Share

SourceSource: : IDC 2003IDC 2003

Visual Studio Team SystemVisual Studio Team System

Change Management

Project Site

Visual Studio

Team Foundation

Integration Services

Project Management

Pro

cess

an

d A

rch

itect

ure

G

uid

an

ce

Dynamic Code Analyzer

Visual Studio

Team Architect

Static Code Analyzer

Code Profiler

Visio and UML Modeling

Team Foundation Client

VS Pro

Class Modeling

Application Modeling

Logical Infra. Modeling

Deployment Modeling

Visual Studio

Team DeveloperVisual Studio

Team Test

Vis

ual S

tud

io In

du

stry

Part

ners

Unit Testing

Code Coverage

Load Testing

Manual Testing

Test Case Management

Work Item Tracking

Reporting

Development TeamsDevelopment Teams

DeveloperDeveloper

InfrastructureInfrastructureArchitectArchitect

SolutionSolutionArchitectArchitect

Project ManagerProject Manager

TesterTester

End UserEnd User

DeveloperDeveloper

TesterTester

A Day in the Life of a TesterA Day in the Life of a Tester

Create a unit test for “framework” Create a unit test for “framework” components components

Create a web test for ASPX pagesCreate a web test for ASPX pages

Create a load testCreate a load test

Run the tests, analyze the resultsRun the tests, analyze the results

Identify problem areas, work with dev Identify problem areas, work with dev to pinpoint bug, apply fix and retestto pinpoint bug, apply fix and retest

Unit Testing Customer FeedbackUnit Testing Customer Feedback

““Writing unit tests is too tedious”Writing unit tests is too tedious”

““I need to know what code is I need to know what code is sufficiently tested and what isn’t”sufficiently tested and what isn’t”

““How do I know that my unit tests are How do I know that my unit tests are running correctly?”running correctly?”

““Running tests and viewing results is Running tests and viewing results is very cumbersome”very cumbersome”

Unit Testing Unit Testing

Unit Testing Unit Testing

““Writing unit tests is too tedious”Writing unit tests is too tedious” Code GenerationCode Generation

Customer Feedback VS Team System Support

““I need to know what code is I need to know what code is sufficiently tested and what sufficiently tested and what isn’t”isn’t”

Code CoverageCode Coverage

““Running tests and viewing Running tests and viewing results is very cumbersome”results is very cumbersome”

Test ViewTest View

Test ResultsTest Results

* NYI - Not Yet Implemented

““How do I know that my unit How do I know that my unit tests are running correctly?”tests are running correctly?”

Test ResultsTest Results

Testing Reports (NYI*)Testing Reports (NYI*)

Web Testing Customer FeedbackWeb Testing Customer Feedback

““It needs to be simpler”It needs to be simpler”

““It’s hard to customize tests with It’s hard to customize tests with different data”different data”

““I don’t want to hire Internet protocol I don’t want to hire Internet protocol experts to write tests”experts to write tests”

““I want to use my favorite .NET I want to use my favorite .NET language to write web tests”language to write web tests”

Web Testing Web Testing

Web Testing Web Testing

““It needs to be simpler”It needs to be simpler”

Browser Recorder/ Browser Recorder/ Visual Test Visual Test VerificationVerification

Automatic ViewstateAutomatic Viewstate

Record/Playback Record/Playback Secure and Secure and Authenticated sitesAuthenticated sites

Customer Feedback VS Team System Support

““It’s hard to customize tests with It’s hard to customize tests with different data”different data” Automatic Data Automatic Data

BindingBinding

““I don’t want to hire Internet I don’t want to hire Internet protocol experts to write tests”protocol experts to write tests”

Protocol knowledge Protocol knowledge not requirednot required

XML based web testsXML based web tests

““I want to use my favorite .NET I want to use my favorite .NET language to write web tests”language to write web tests” Coded Web TestsCoded Web Tests

Load Testing Customer FeedbackLoad Testing Customer Feedback

““It’s expensive to write and execute It’s expensive to write and execute load tests in yet another tool”load tests in yet another tool”

““I need an easy way to identify my I need an easy way to identify my biggest performance problems”biggest performance problems”

““Monitoring servers while running tests Monitoring servers while running tests is difficult”is difficult”

““It’s very difficult to share test results”It’s very difficult to share test results”

Load Testing Load Testing

Load Testing Load Testing

““It’s expensive to write and It’s expensive to write and execute load tests in yet execute load tests in yet another tool”another tool”

Familiar VS IDEFamiliar VS IDE

Re-use test artifactsRe-use test artifacts

Customer Feedback VS Team System Support

““Monitoring servers while Monitoring servers while running tests is difficult”running tests is difficult”

Perf Counter SetsPerf Counter Sets

Counter ThresholdsCounter Thresholds

““I need an easy way to identify I need an easy way to identify my biggest performance my biggest performance problems”problems”

Transaction SummaryTransaction Summary

Request SummaryRequest Summary

Resource UtilizationResource Utilization

““It’s very difficult to share test It’s very difficult to share test results”results”

Test ResultsTest Results

Results StoreResults Store

Developer RoadmapDeveloper Roadmap

Call to ActionCall to Action

What should you do What should you do nownow??Educate yourself and your customer on Educate yourself and your customer on VSTSVSTS

Internal site: Internal site: http://team/sites/teamsystemhttp://team/sites/teamsystem

External site: External site: http://msdn.microsoft.com/vstudio/teamsystehttp://msdn.microsoft.com/vstudio/teamsystemm

Send questions, comments, suggestions Send questions, comments, suggestions to to burtfdbk@microsoft.comburtfdbk@microsoft.com (internal (internal alias)alias)

What should you do What should you do 6 months from 6 months from nownow??

Start pre-selling Visual Studio 2005 Start pre-selling Visual Studio 2005 Team SystemTeam System

Related Content - newsgroups Related Content - newsgroups

http://communities.microsoft.com/newsgroups/default.asp?icp=whidbey&slcid=us

Microsoft.private.whidbey.teamsystem.general - VSTS overall Microsoft.private.whidbey.teamsystem.tester - testing tools Microsoft.private.whidbey.teamsystem.projectmanager - project management tools Microsoft.private.whidbey.teamsystem.teamfoundation - source control, change management, work item tracking Microsoft.private.whidbey.teamsystem.architect - modeling and design tools (Whitehorse) Microsoft.private.whidbey.teamsystem.architect.appdesign - Whitehorse app designer Microsoft.private.whidbey.teamsystem.architect.deployment - Whitehorse deployment designer Microsoft.private.whidbey.teamsystem.developer - developer tools (PreFast, FxCop, Perf tools) Microsoft.private.whidbey.teamsystem.developer.classdesign - Whitehorse class designer

http://communities.microsoft.com/newsgroups/default.asp?icp=whidbey&slcid=us

Microsoft.private.whidbey.teamsystem.general - VSTS overall Microsoft.private.whidbey.teamsystem.tester - testing tools Microsoft.private.whidbey.teamsystem.projectmanager - project management tools Microsoft.private.whidbey.teamsystem.teamfoundation - source control, change management, work item tracking Microsoft.private.whidbey.teamsystem.architect - modeling and design tools (Whitehorse) Microsoft.private.whidbey.teamsystem.architect.appdesign - Whitehorse app designer Microsoft.private.whidbey.teamsystem.architect.deployment - Whitehorse deployment designer Microsoft.private.whidbey.teamsystem.developer - developer tools (PreFast, FxCop, Perf tools) Microsoft.private.whidbey.teamsystem.developer.classdesign - Whitehorse class designer

Other SessionsOther SessionsJulyJuly TimeTime TitleTitle RoomRoom

1717 12:30-12:30-13:4513:45

DEV240 Team System OverviewDEV240 Team System Overview B314B314

1818 1:15-2:301:15-2:30 DEV346 Modeling StrategyDEV346 Modeling Strategy Sydney Sydney MarcusMarcus

1919 12:30-12:30-1:451:45

DEV347 Project ManagementDEV347 Project Management B304B304

1919 12:30-12:30-1:451:45

DEV345 Software TestingDEV345 Software Testing GA BallroomGA Ballroom

1919 4-5:154-5:15 DEV348 Change ManagementDEV348 Change Management B304B304

1919 4-5:154-5:15 DEVCT344 Load Testing Chalk DEVCT344 Load Testing Chalk TalkTalk

A316A316

2020 8-9:158-9:15 DEVCT343 Work Item Chalk TalkDEVCT343 Work Item Chalk Talk A303A303

2020 2:15-3:302:15-3:30 DEVCT342 Practicing Agile DEVCT342 Practicing Agile MethodsMethods

A316A316http://team/sites/vs2005http://team/sites/vs2005

Three ways to access Online Evaluation Forms:Three ways to access Online Evaluation Forms:

1.1. MGB Evaluation Kiosks MGB Evaluation Kiosks

2.2. CommNet CommNet

3.3. From your laptop or Pocket PC, From your laptop or Pocket PC, onsite Wireless Access or any wired connection to: onsite Wireless Access or any wired connection to: http://mgb2004.com/evalhttp://mgb2004.com/eval

Please Complete An Evaluation FormYour input is important!

Please Complete An Evaluation FormYour input is important!

For more information please refer to the Registration GuideFor more information please refer to the Registration Guide

© 2004 Microsoft Corporation. All rights reserved.This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.