reviewer training material callis reviewer version 1.1

Copyright © 2009, Callis

Why are Peer Reviews interesting?Peer reviews are the only technique available to detect defects in life-cycle work products in the early phases of developmentPeer reviews are a reliable way of measuring the quality of the work that has been performedPeer reviews reduces cost and time in later phases of development, e.g. test and integrationPeer reviews reduces total system maintenance cost dramatically (up til 10 to 1 according to Kasse, 2007)

Are You a believer?


Often, this is the situation!Peer review process is poorly definedProcess is often not followedNo controlled use of checklistsPeople are not thoroughly trainedIssues are not systematically tracked to closureNo or limited tool support means low efficiencyData are not collected and used to improve processLimited visibility into scheduling and results

Callis Reviewer helps these issues by providing a

standardized review solution

Callis Reviewer isA standard solution supporting the peer review process• Planning including roles, documents, focus areas, and checklists,

generating standard invitation• Reporting defects including description, type and severity of defect, if

found by checklist• Processing defects including presenting defects in relevant order,

defining actions, allocating responsibility• Approval and reporting including presenting defect distribution, defect

density, prepation rate, approval categories, and generating review report in pdf

• Presenting overviews and indicators, e.g. ”my reviews”, reviews performed, defects found, checklist efficiency, and review timeline

• Configuration of relevant parameters easy, including roles, document categories, severity and type codes, approval types, checklists, etc.


Overview of Review Process


Four Phases: • Plan: Add purpose, roles, documents, generate invitation• Prepare: Reviewers registers findings and can get an personal reciept• Conclude: Conclusion are made on documents, meeting data are registered• Follow up: Corrector corrects document and sets resolution state on findings. Review report

can be generated.

Three documents: Invitation, My findings, and Review reportMetrics collected in database

Callis Reviewer

Callis Reviewer Tech. Overview


MSSQL

Rich Web2.0 user interface

Review report

Indicators/data

MS IIS

Review Invitation

Callis ApS, Copyright © 2010

My Reviews

”My Reviews” lists all reviews that you are invited to (or have created=Owner)• Selecting a node in the ”Projects” tree below will show reviews sorted on specific projects

When ”Show all” is selected, both opened and closed reviews are listed • The state of a specific review is displayed in the ”Status” coloumn – both using colors and text

The ”New Review” button is used to create a new reviewAn existing review can be opened by double clicking on the relevant row in the list

Review process and status overview


State

Participants

Phases

Process and work products

Metrics


Short-cut keys supported (from help)


Review Planning

Coloring groups tabs into review phases (plan, prepare, conclude, follow up)Numbers on tab (1+2+3) documents sequence in actions needed to plan review)Please notice that an asterisk (*) will indicate unsaved data on tab (not shown here)


Participants – Select user

Press ”New” to define new review participantSelect participant in list and press ”Edit” to change participant data”Can Manage Review” gives the user rights to change review meeting setup data, e.g. documents to review etc.”Can view all findings” makes it possible to view findings made by other reviewers


Participants – Select user

User name on review participants are fetched from MS Active DirectoryShort names can also be typed directly, if knownSelect user in list and press OK


Build-in display of configuration dataDescription text on all configurable data can be displayed by hovering the parameter.

This includes • Review types• Role definitions• Document types• Severity codes• Defect type codes• Conclusion types• Resolution types

Hover this!


Documents

HTTP-links to document can be entered or use file browser to browse to file locationSize data are used to produce metrics and indicators

HTTP-link here!


Documents - Browse to file location

Alternatively, select the icon to browse to the file in a shared part of your file system.

Only supported in in MS Internet Explorer...


Generate review invitation


Additional Material

Add background information / additional material, as needed• Same method as when adding documents...


Prepare

Please notice that the prepare phase starts with entering findings (next tab and next slide!)”Minutes used preparing” is used to calculate prepation rates, indicators etc.”Mark as completed” indicates to review leader and other reviewers, that your are ready to meet and review the documents


My Findings


All Findings

To refresh for new findings from other users, use


Conclude – part 1

Approval of the individual documents

Conclude – part 2



Follow up

Complete the reviewGenerate the review report (can also be done from the “Overview” tabPlease notice that you can set resolution on findings on the findings tabData on tabs can not be changed, when the review is closed (without opening the review first)


Generate review report

Generate the review report (can also be done from the “Overview” tab


An sustainable solutionCallis Reviewer is an easy sustainable peer review solution• Tool supporting the review process including planning, reporting in and

processing defects and generating review report• Predefined indicators for sustaining implementation, management

insight and continuous improvement• Training material supporting use of the tool

With the following customer business characteristics• Reduced risk – By offering a complete and ready-to-go solution in

stead of a internal development project or inefficient spread sheets/paper solutions

• Reduced cost – By making your reviews more effective and efficient -with a break even measured in (a few) months for most organizations

• Reduced schedule – By providing a COTS solution including tool, process descriptions and training material – and a trainer, if needed

• Building on a proven solution which is maintained, improved and extended with new functionality

Thank you for using Callis Reviewer!

Please point anyone you think could benefit from Callis Reviewer to our website: www.callis.dk

• This will help us add more and more functionality into the solution – and your organization will benefit from that!

Copyright © 2007 - 10, Callis

http://www.callis.dk/

reviewer training material callis reviewer version 1.1

Documents

specific review

review reportmetrics

review planningcolori

peer review processplanning

list review process

integrationpeer reviews

reviewsmy reviews

performedpeer reviews