km6 system testing & deployment

8/3/2019 KM6 System Testing & Deployment

1/32

SYSTEM TESTING ANDDEPLOYMENT

Lecture Six


2/32

Chapter 7: System Testing and Deployment

7-2

System Testing & Deployment after

Knowledge Codification

KNOWLEDGECAPTURE(Creation)

KNOWLEDGETRANSFER

KNOWLEDGESHARING

TESTING ANDDEPLOYMENT

KNOWLEDGECODIFICATION

KNOWLEDGEBASE

DATABASES

Shells, tables,tools, framesmaps, rules

Capture ToolsPrograms,

books, articles,experts

Intelligencegathering

Explicit Knowledge


3/32


7-3

Key Definitions

Logical testing answers the question, Are webuilding the system right?

User acceptance testing checks the systems

behavior in a realistic environment. Answersthe question, Have we built the right

system?

Deployment refers to the physical transfer ofthe technology to the organizations operating

unit


4/32


7-4

Stages of KMSLC

Evaluate ExistingInfrastructure

Knowledge Capture

Design KM Blueprint

Verify and validate the KMSystem

Implement the KM System

Manage Change andRewards Structure

Form the KM Team

Post-system evaluation

Iterative RapidPrototyping


5/32


7-5

Quality Assurance KM system should meet expectations of

members represented in the KM team.

Performance depend highly on quality ofexplicit/tacit knowledge stored in KB.

For expert, quality relates to reasoningprocess that produces reliable and accuratesolutions.

For user, quality relates to systems ease ofuse and efficiency.

For knowledge developer, quality relates tohow valid the knowledge sources are and

how well they are codified into KB.


6/32


7-6

KMS Testing

To control quality, performanceand efficiency of both KB andKMS.

Types of Testing Logical Testing, make sure that

the system produces correctresults.

User Acceptance Testing,follows logical testing and checksystems behaviour in a realistic

environment.


7/32


7-7

Hurdles in KMS Testing

Subjective nature of tacitknowledge.

Lack of reliable specificationsto guide testing

How to decide whetherknowledge is complete

Human errors

Lack of time

User interface un-friendly


8/32


7-8

Logical Testing Approaches

Knowledge base formationStructure of knowledge as it

relates to circular or redundant

errorsConsistency, correctness, and

completeness of knowledgebase rules

Knowledge base functionality

Confidence

Reliability of knowledge base


9/32


10/32


7-10

User Acceptance Testing

ApproachSelect a person or a team for testing

Decide on user acceptance test criteria

Develop a set of test cases unique tothe system

Maintain a log on various versions ofthe tests and test results

Field-test the system


11/32


7-11

Requirements for Test Team

Independent of the design orcodification of the system

Understand the knowledge

problem and computertechnology

Well versed in theorganizations goals

Know how the system beingtested will fit into thedesignated area of operation


12/32


7-12

Content of Test Plan

Items of KM system thatrequire testing

Schedule of useracceptance testing

Description of test methodsthat are approved by userand company

Guidelines for documentingtest results


13/32


7-13

User Acceptance Criteria

Accuracy and correctness ofoutcome for test items

Adequacy of the solutions

Adaptability to novel input

Ease of use

Face validity or credibilityRobustness

Technical/operational test


14/32


7-14

User Acceptance Test

Techniques

Face validation

Test Cases

Sub-systemsvalidation


15/32


7-15

Face Validation

Developer, users and experts to evaluate theperformance of the KM system

Can be used to test chunks of knowledge atany phase of the knowledge-based systemdevelopment life cycle.

It is mainly a group effort of the knowledgedeveloper,the domain expert, and the end user.

This ad hoc tool is quite useful testing user-systeminterfaces, user friendliness, and explanation

facilities.


16/32


7-16

Test Cases

Developer, users and experts providecases

It is more of a black-box approach, inwhich only system inputs and outputsare significant.


17/32


7-17

Issues Related to Deployment

Selection of the knowledge base problem

Ease of understanding the KM System

Knowledge transfer

Integration alternatives

The issue of maintenance

Organizational factors


18/32


7-18

Successful KM System

Deployment User has prior experience with

computer applications

User has been involved in thebuilding of the KM system

Benefits of the KM system isimmediate and measurable

First impression

Management support thesystem from start

Adequate user training


19/32


7-19

Ease of understanding the KM

System

Level of motivation of the user

Computer literacy and technical

background of the userCommunication skills of the trainer

Time availability and funding for training

Place of training


20/32


7-20

Knowledge Transfer

Transfer approach The KM system is actually transferred from the developer

directly to the working unit (end user) in the organization.

The KM is transferred of knowledge-based system

technology skills. Transfer ways

One time transfer

Gradually

Implementation Stand alone implementation

Integrate with other implementation


21/32


7-21

Integration Alternative

Technical integration through the companysLAN or existing information systeminfrastructure

Knowledge-sharing integration when the KMsystem is usable company-wide

Decision-making flow integration when the

system matches the users style of thinking

Workflow reengineering when the KM system

triggers changes in the workplace


22/32


7-22

Organizational Factors

Top management support

Support of the work of the champion

Ensure a clean and supportive

organizational climate

De-emphasize role of politics

Knowledge developer should remain neutral

within the political arena

Return on investment

Ch S i d l


23/32


7-23

Steps in KMS Deployment

Transfer of KM Systemfrom knowledge developerto the organizations

operating unit.

Transfer of KMs skillsfrom knowledge developerto the organizations

operators.

Ch 7 S T i d D l


24/32


7-24

Factors affecting User Training

Primary

The users knowledge ofknowledge-based system

Complexity of KM system anduser interfaces ease of use

Secondary

Trainers technical experience/communication skills

Environment of training venue

Ch t 7 S t T ti d D l t


25/32


7-25

Pre User Training Session

Define how the KM systemagrees with organizationalmission

Demonstrate how the systemcan support organizational goals

Allocate adequate resources forthe training project

Advocate positive effects of thesystem

Explain cost-benefit analysis ofthe KM system

Ch t 7 S t T ti d D l t


26/32


7-26

Overcome Resistances to

Change

User attitude survey

Communicationsessions

Role negotiation


27/32



28/32


7-28

Security Issues

The new system shouldprovide password /protocol protection.

Security proceduresshould be consistentlyobserved.

Access should berestricted regardingupdate of the KB.



29/32


7-29

Circular Errors

Rule 1:

IF John and Rob are co-owners ofcompany A

THEN John and Rob own the samecompany

Rule 2:

IF John and Rob own the samecompany

THEN John and Rob are co-owners


30/32



31/32


7-31

Unusable Knowledge

IF humidity is 5% ANDheavy_rain = yes

THEN some actions


32/32

km6 system testing & deployment

Documents