test automation: coded ui test

Jan 25th 2013

Test Automation:Coded UI Test

1.Introduction2.Internal Class Structure (Generic

Structure)3.Program architecture 4.Framework function5.Demo6.Reliability7.Usability & Reusability 8.Efficiency9.Build Process in the Future

1.Introduction2.Internal Class Structure (Generic

Structure)3.Program architecture 4.Framework function5.Demo6.Reliability7.Usability & Reusability 8.Efficiency9.Build Process in the Future

Automated Testing• Ensures you don’t miss out on running a test• Can actually enforce and drive clean design decisions• Have training value

Coded UI Test• Automated tests that drive your application through

its user interface (UI) are also known as coded UI tests (CUITs).

• These tests include functional testing of the UI controls. They let you verify that the whole application, including its user interface, is functioning correctly.

• Coded UI Tests are particularly useful where there is validation or other logic in the user interface, for example in a web page. They are also frequently used to automate an existing manual test.

Coding Process with Coded UI Test• Test Cases• Recording the actions• Coding with testing strategies• Auto-compile and run• If tests fail • Fault in test script-> make appropriate modifications• Bug in the application -> report (PF OOTB)

• If tests pass -> move aheadThey are fun and challenging to write

One has to carefully think of design for reusability and coverage

Recording the actionsCoded UI Test Builder

Start recordingAdd assertion

Show recorded stepsGenerate code

The Coded UI Test builder enables you to record actions and add theminto your existing Coded UI Test

Test Window• Test View window• Test List Editor

Understanding the tests

Identify Portal Framework Defects

• Bugs can be identified by Coded UI Test

Habanero Portal Framework Out Of The Box

Identify Portal Framework Defects

• Bugs cannot be identified by Coded UI Test

Habanero PF Habanero OOTB

1.Introduction2.Internal Class Structure (Generic

Structure)3.Program architecture 4.Framework function5.Demo6.Reliability7.Usability & Reusability 8.Efficiency9.Build Process in the Future

UI Map Class• The real work takes place• An assortment of supporting classes are generated• Class diagram helps you to understand the relationships and the classes involved.

Generic Library• Using the auto-generated code in designer.cs

Class is very inefficient• Construct an efficient, reusable, beautiful

libraries

Even More Generic

Class Diagram• Document Library• List• Calendar• Page• Asset

1.Introduction2.Internal Class Structure (Generic

Structure)3.Program architecture 4.Framework function5.Demo6.Reliability7.Usability & Reusability 8.Efficiency9.Build Process in the Future

The Automated Test Framework

Program Pattern

1.Introduction2.Internal Class Structure (Generic

Structure)3.Program architecture 4.Framework function5.Demo6.Reliability7.Usability & Reusability 8.Efficiency9.Build Process in the Future

Framework function

https://h.habaneros.com/teamsites/QA/Lists/Framework%20Functions/AllItems.aspx

or visit QA site:

• These framework functions will be documented in our Habanero QA site

1.Introduction2.Internal Class Structure (Generic

Structure)3.Program architecture 4.Framework function5.Demo6.Reliability7.Usability & Reusability 8.Efficiency9.Build Process in the Future

Demo

• ContentPF• Test Cases: 1. Add content to a page

2. Edit the content of a page 3. Apply a markup style to content on a page 4. Edit the HTML of the content on a page

• ListInheritancePF• Test Cases: 1. Break inheritance on a list

2. Break inheritance on a single list item• ListWorkflowPF

• Test Cases: 1. Define a workflow for a list 2. Perform workflow on a list item

• PagePF• Test Cases: 1. Create new page

2. Modify page properties 3. Check in/ Check out a page 4. Delete a page 5. Email a link to a page

I will run the following tests if time permits:

1.Introduction2.Internal Class Structure (Generic

Structure)3.Program architecture 4.Framework function5.Demo6.Reliability7.Usability & Reusability 8.Efficiency9.Build Process in the Future

Reliability• Controls & Actions

• Ensure the program find the correct controls• Ensure the actions get executed

• Unstable Tests• Some tests may wander between Pass and Fail

• Use Meaningful name • helps identify the purpose of the method

• Limit each recorded method to fewer than 10 actions• Makes it easier to replace a method if the environment changes

• Use the data from app.config file instead of hardcoding the data• Increase the reliability of making an assertion

1.Introduction2.Internal Class Structure (Generic

Structure)3.Program architecture 4.Framework function5.Demo6.Reliability7.Usability & Reusability 8.Efficiency9.Build Process in the Future

Usability & Reusability • Coded UI Tests are completely reusable

• Need to setup a continuous integration server• Create libraries as the codebase

• Customize Search Properties• Overwrite Search properties with parameters

• Customize Complete Functions• Atomic Tests

• Tests are not depend on other tests

• Reusable modules (The BaseTest Class)• Common test functions

“

Customized Search Properties

Customized Search Properties

Customized Functions

Customized Methods

1.Introduction2.Internal Class Structure (Generic

Structure)3.Program architecture 4.Framework function5.Demo6.Reliability7.Usability & Reusability 8.Efficiency9.Build Process in the Future

Efficiency• Web Page Navigation

Efficiency• Eliminate Delay

Efficiency• Add Delay

Sometimes, the control runs faster than the web browser

1.Introduction2.Internal Class Structure (Generic

Structure)3.Program architecture 4.Framework function5.Demo6.Reliability7.Usability & Reusability 8.Efficiency9.Build Process in the Future

Test Cases

Coded UI Test

TFS

MTM

Client Projects

BuildProcess

Test Cases

Build ProcessAt this point, we have created numerous Test Cases.

We can execute a Coded UI Test Case simply by taking the compiled assembly and executing it with Visual Studio or MSTest from the command line,which require us to sit there and do nothing while the test executes

Another way:

Associate Coded UI Tests and Test CasesRun the tests from Microsoft Test Manager

MSTest

Associating Coded UI Tests and Test Cases (TFS)

Microsoft Test Manager

Next Step ( a typical way)• Set Up Team Build

• With correct build definition and configuration• So that the automated test can be found in the share location for the

build definition and then it can be run from MTM

• Create Test Settings and Virtual (Physical) Environment• We cannot run Coded UI Tests using MTM without an

environment• Create an environment that contains the roles in the test

settings and then use this environment in the test plan

Sometimes, things don’t work the way you want it to be.

Thank you

If you have any comments on the coded UI test,feel free to let me know