test generator customization

12
Slide 1 Test Generator Customization Test Generator Customization

Upload: test-generator

Post on 25-Dec-2014

184 views

Category:

Education


2 download

DESCRIPTION

To Customize or Not to Customize?

TRANSCRIPT

Page 1: Test generator customization

Slide 1

Test Generator Customization

Test Generator

Customization

Page 2: Test generator customization

Slide 2

Test Generator Customization

Overview

1. To Customize or not to Customize?

2. Off the Shelf Customization

3. Customization After the Fact

Source: Test Generator – Test Generator Customization

Page 3: Test generator customization

Slide 3

Test Generator Customization

To Customize or not to Customize

– Shopping for software that will enable you to make tests?

– Looking for a test generator that will allow you to deliver tests online?

– Haven't quite found what you're looking for?

• To Customize or Not to Customize? – It could be that your testing requirements don't match what most folks are

looking for.

• If that's the case then your options include: – 1- Have your IT staff create an application for you.

– 2- Hire an outside developer to create what you want

– 3- Wait until someone develops exactly what you want and keep looking

– 4- Take an existing, off-the-shelf application and have the company customize it.

Source: Test Generator – Test Generator Customization

Page 4: Test generator customization

Slide 4

Test Generator Customization

To Customize or not to Customize

• #1's an option if you have a good relationship with your IT department and if they have time are their hands and can get it to you when you want it... and, IT has a big pot of money and they are going to pay for it.

• You're laughing. Ok, let's consider #2. – #2's an option if you have the time, patience and lot's of money to spend

on having someone develop something for you.

– This is a time and money-intensive process. If you've been done this path before and had a successful outcome, then this is a good option for you.

– If you've been down this road and been beaten down despite your best efforts, don't go there again.

– If you don't have the experience taking on such a project, we advise that you stay away.

Source: Test Generator – Test Generator Customization

Page 5: Test generator customization

Slide 5

Test Generator Customization

To Customize or not to Customize

• #3 suggests that your really not in a hurry because: – a- You've been doing paper and pencil testing for years and you're

comfortable with that

– b- Management doesn't seem to be particularly interested in doing online testing

– c- You don't have a budget, or you have been authorized to spend as much as $200 for a fully-featured test creation application but haven't found one that fits your budget.

• #4's probably the best option for those of you who: – a- Have a pretty good idea what you want

– b- Don't have technical resources to get the job done or

– c- Have technical resources, but your aren't talking to each other or

– d- Have technical resources, but they can't get to your project for X number of months or years

– e- You have some money, but don't have the time, patience and/or technical expertise to start a project from scratch.

Source: Test Generator – Test Generator Customization

Page 6: Test generator customization

Slide 6

Test Generator Customization

Off the Shelf Customization

• In Part 2 we'll focus on scenario #4: Take an existing, off-the-shelf application and have the software company customize it.

• We think this is a good option for those of you who: – a- Have a pretty good idea what you want

– b- Don't have technical resources to get the job done or

– c- Have technical resources, but your aren't talking to each other or

– d- Have technical resources, but they can't get to your project for X number of months or years

– e- You have some money, but don't have the time, patience and/or technical expertise to start a project from scratch.

– You have evaluated the software and found it to be "most like" what they are looking for. You’ve identified 1 or 2 features/behaviors that are either not available in the current program, or that you would like to enhance/modify. It’s a tricky proposition to embark on the customization of a product without having some mastery of, and experience with, the product.

Source: Test Generator – Test Generator Customization

Page 7: Test generator customization

Slide 7

Test Generator Customization

Off the Shelf Customization

• To the best of your ability, determine if the product meets the majority of your testing requirements. – Find out/confirm that the software company will customize their

application.

– If possible, provide the software company with details regarding your proposed customization.

– Make sure they would be willing to make the types of changes you are considering. You may also want to get that in writing.

• Time-frame / Deliverables – Be realistic: don't assume that it's going to be done tomorrow or next

week.

– Most software companies already have a set of projects prioritized and scheduled.

– You should ask for and get a date/date range within which your customization will be delivered.

– If you have a tight schedule and the software company needs to escalate development, expect to pay more.

Source: Test Generator – Test Generator Customization

Page 8: Test generator customization

Slide 8

Test Generator Customization

Off the Shelf Customization

• A Statement of Work is a document that clearly defines the project. – It should include the specification, or a summary of the specification

detailing key points and/or behaviors that will be included in the software.

– Changes made after the SOW is approved and work has begun will cost you extra, so it's always a good idea to make sure you have been thorough in thinking through and presenting your request.

• Conference Calls – Getting to a SOW usually involves emails, calls, a written spec, sample

docs and possibly one or more online conference calls.

– The process can get a little messy and confusing, especially if more than one person is involved.

– We recommend recording online conferences in order to minimize misunderstanding and confusion regarding project details.

– Recordings of these sessions should be shared with everyone involved.

Source: Test Generator – Test Generator Customization

Page 9: Test generator customization

Slide 9

Test Generator Customization

Customization After the Fact

• Part 3’s scenario: You have already purchased the software and have been using it for some time.

• Software Purchasing Profiles – Some individuals know exactly what they want and they come armed with

a list of requirements. They have budgets, they buy.

– Some aren’t really sure what they want/need. They just know they can’t continue doing paper-and-pencil testing.

– Others form committees and embark on software searches and prepare RFPs which are then sent to companies that meet/match their requirements.

– Some take the run-and-gun approach, buying the brightest, least expensive bauble that catches their attention.

– Some individuals search for months or years looking for that perfect solution that does everything but pour coffee—and at a budget price.

– They’re still looking.

Source: Test Generator – Test Generator Customization

Page 10: Test generator customization

Slide 10

Test Generator Customization

Customization After the Fact

• For those of you who have actually purchase test-authoring software, it might never have occurred to you that you might need/want to tweak it. – You've now determined that you need to modify an existing

feature/behavior, or add something new.

– You didn't ask the “customization question” when you purchased the software, but you need to ask now.

– If the software company says YES, they will customize the software--that's a good start.

• If you absolutely need to go out and find something new, don’t forget to ask if customization services are available before you purchase the software.

• Even though you may not think you need customization, it’s always a good idea to allow for the possibility later on, budget for it if you can.

Source: Test Generator – Test Generator Customization

Page 11: Test generator customization

Slide 11

Test Generator Customization

Customization After the Fact • Give the software company some background regarding your

current product: – 1_ What works

– 2_ What doesn’t work

– 3_ What do you need that the current product does not provide?

• Make a list of your top 3 to 5 requirements. For example: – 1_ We want to deliver tests over the intra- or internet

– 2_ We want to be able to randomize our tests

– 3_ We would like to be able to create multiple question banks… and so on.

• Also: – Can you download a demo version of the software?

– Can you pick up the phone and talk to an actual person?

– Can you discuss pricing and can you get a quote?

– Does the company offer support? What does support include?

– Does the company offer customization services? Ask plenty of questions.

Source: Test Generator – Test Generator Customization