ISACS Assessment Tool Basic Guide

2015

Purpose of the ISACS-AT

• To support the practical application of the International Small Arms Control Standards (ISACS)

• To conduct self-assessment on the implementation of small arms control commitments in line with the standards

• To establish baselines on small arms control policy, programmes and practices in line with the standards

• To promote the ISACS for educational and awareness-raising purposes

About this guideThis guide is designed to detail this software’s functions and

features. Before getting started please note the instructions below:

• Please read this guide before using the software to ensure its proper use.

• Descriptions are based on the software’s default settings.• Images and screenshots may differ in appearance from the

actual product.• Content in this guide may differ from the final product and

is subject to change without prior notice. For the latest version of the software and the guide, refer to the ISACS website, www.smallarmsstandards.org

• The computer operating system may affect the overall performance of the software. Software may not work properly depending on the computer hardware specifications and the environment that it is used in.

• The software and this guide are currently available in English only.

• UNIDIR is not liable for performance issues or incompatibilities caused by efforts to modify the software. Attempting to customize the operating system may cause the software to work improperly.

Lesson overviewFour lessons:1. Basic tool flow 2. Configuration • Set up personal information• Create password• Create / connect to storage file

3. Assessments• Design a questionnaire• Collect data• Analyze results

4. Manage assessments

Lesson one: Basic tool flow

Lesson objectives• Become familiar with the tool’s

homepage, flow and interface

Expected outcome• Users are familiar with the basic

flow of the tool

Tool homepage

Basic homepage functions

Click on the banner to return to homepage

Click on the title to expand the features of the tool

Each of the functions are linked to another page

Lesson two: ConfigurationLesson objective• Learn how to:– Create/connect to storage file– Secure storage file– Import/export assessments data

Expected outcome• Users are able to create / connect to their

storage file• Users are able to secure their storage file• Users are able to share their assessment data

Create/connect to storage file

1) Click on “Configure”

2) Click on the link “Create storage file”

Create new storage file

Click on tab “create new storage file”, then click on

browse to select a location to save the file

Encrypt storage file to protect user data

Enter personal information

2) Click on tab “Personal info” to enter personal information

1) Click on the tab “Secure storage file” to

assign a password to storage file

Protect user storage file: Password

2) Click on tab “password settings” to assign a

password to a storage file

1) Click on the tab “Secure storage file” to assign a password to a

storage file

Connect to a storage file

Click on tab “open an existing storage file”, then select the

existing file. Click on the open icon to get connected.

Lesson tip

Why encrypt your storage file?A storage file that is encrypted can only be accessed on the operating system where the file was created. The encryption ensure that external users cannot access the user data from another operating system. If users are interested in sharing user data from their storage file, they must use the import/export function.

Lesson three: Assessment

Learning objectives• Become familiar with the purpose of small

arms control assessments• Learn how to conduct assessments on

implementation efforts of existing global small arms control commitments as outlined in the ISACS

Expected outcomes• Users understand the need of conducting

assessments on small arms programmes, practices, and policies

• User demonstrate their competency in the use of the ISACS-AT to conduct assessments

Lesson tip

Why conduct assessments?• Existing implementation challenges cannot be

addressed effectively until current implementation status is understood sufficiently

• Effective implementation requires adequate and accurate information collection and analysis

• Better understanding of implementation effort helps determine the need for an intervention by relevant stakeholders (What needs exists, how and who to intervene)

Lesson tip

Steps for conducting assessments

Step 1:Design

D Step 2:Collect

C Step 3:Analyze

A

Step one: Design a questionnaire

Designing a questionnaire is the first step in the assessment process

Purpose • To respond to an identified information need• To establish assessment criteria based on the ISACS

Design a questionnaire

DRAFT

Click on the tab “Assess”, and then click on the link, “Design

questionnaire”

Enter creator information

DRAFT

Enter creator information and click continue to create a

questionnaire

Select and load an ISACS module

DRAFT

1) Select the module to load using the Load Module bar.

2) Once selected, ISACS indicators will be loaded on the configuration panel (left

hand side column)

Select the indicators to design the assessment

criteria

Select (by checking the boxes) the indicators based on the ISACS module, clause, and

subclause

Generate and review indicators

DRAFT

Checking relevant boxes will generate indicators in the content

panel (right-hand side panel).

Filter indicators by priority (optional)

DRAFT

Clicking on the filter button allows users to filter measures by priorities

defined by the standards

Complete the design phase

DRAFT

Click on Save & Complete to conclude the design phase

Summary

How to design a questionnaire:

1. Click on Design Questionnaire from the homepage under the Assessment link

2. Enter creator information3. Load ISACS module using the Load Module bar4. Generate ISACS indicators through selecting

module/clause/subclause from Navigation Panel5. Add filter to indicator by designating a priority

(optional)6. Click on Save & Complete Questionnaire to

conclude the design process

Step two: Collect responsesData collection makes implementation

efforts measurable

Purpose• To gather quantitative and qualitative

data to establish implementation status on small arms control measures undertaken (and/or not taken), and to inform the analysis process

Lesson tip

Have you already created a questionnaire?

• Having an existing questionnaire in your storage file is a prerequisite to data collection. Make sure you have either 1) created a questionnaire, 2) already have an existing questionnaire in the storage file, and/or 3) imported a questionnaire into your storage file.

Collect responses

Click on the tab “Assess”, and then click on the link “Collect

Responses”

DRAFT

Select a questionnaire to collect data

2) Select the questionnaire you wish to answer then click

on Collect Responses

DRAFT

1) Select the ISACS module you wish to work on

Enter respondent information

Enter respondent information and click

Continue to provide answers to the questionnaire

DRAFT

Data collection page

Flag indicators Provide data Indicate sensitive

Add comments

View ISACS text

Save to complete data collection

Once answers are provided, click on Save & Complete to

continue

DRAFT

Guide tipHow do I update my responses to the questionnaire?• Note that users can save a questionnaire without answering all the

indicators within a questionnaire. This is called an in progress questionnaire. With in progress questionnaires, users can return to the questionnaire to update the answers provided. Note that users cannot designate a questionnaire as complete without answering all existing questions (i.e. questionnaire cannot be designated as complete if there are “Not Answered” status).

What is the difference between in progress and complete questionnaires?

• An in progress questionnaire allows users to update the responses they provide to a questionnaire, thereby enabling them to measure implementation progress and analyze its results as measures are undertaken. In contrast, responses in a completed questionnaire cannot be updated - it serves the purpose of benchmarking progress upon which users can analyze the results in relation to particular time period.

SummaryHow to collect response data:

1. Start at Homepage under Assess Box, and click on collect responses

2. Load the ISACS module of your interest from the Load Module bar

3. Select (click) a questionnaire from the table4. Click on collection responses icon5. Provide Status answer to the questionnaire (mandatory)6. Flag indicator(s) (optional)7. Sensitive (optional)8. Add comments (optional)9. Reference to original text (optional)10.Click on Save & Complete to conclude data collection

process

Collect data using paper formatExport questionnaire to PDF

Collect data in paper format and feedback into the tool

Purpose• To allow users to export the questionnaire

to paper format, in order to distribute the questionnaires created by the tool to those who may have limited access to computers and/or may not own an ISACS-AT, as well as for those who are less favorable to using software platforms

Export questionnaire to PDF

Click on the PDF icon to export questionnaire to

paper format

Example: Questionnaire in PDF

Step three: Analyze resultsAnalysis of findings allows users to better

understand implementation status and needs based on the baselines established

Purpose• To allow users to examine the data

findings and better understand implementation status, identify potential priorities, challenges and opportunities, in order to make informed follow-up action on their small arms control policies, programmes, and practices.

Guide tip

How does analysis of findings help evaluate the implementation of existing small arms control programmes?

• Establishing baselines and conducting analysis allows users to avoid situations in which small arms and light weapons control efforts are carried out based on assumptions that later turn out to be incorrect – resulting in wastage of money, failing to deal with problems effectively and preventatively, and leaving potential control issues unaddressed.

Access analysis platform

Click on the tab “Assess”, and then click on the link,

“Analyze Results”

Select questionnaire to analyze

Select a questionnaire you wish to analyze, then click on

“Analyze Results”

Analysis dashboard (interactive)

Composition panel (what is in the questionnaire) Overall

statusStatus by priority

Detail of implementation

Analysis dashboard: Target results

Step 1: Clicking on composition panel

informs status overview

Step 2: Clicking on status overview

informs priority overview Step 3: Clicking on

priority overview inform the detailed

overview

Step 4: Detailed overview reflects the filters applied in steps

1-3

Example: How to conduct targeted analysis

Composition panel (step one): Select relevant clauses –

this will update results presented in

the entire dashboard

Implementation Status Overview

(Step two): Click on a status in the

subsection of the pie to filter and

display results you wish to examine

Priority overview (step three): Click on the priority bar to filter and display

only the priority category you wish to

examine

Detail overview (step four): Analysis

of the results are displayed in the

detail table based on the filters applied

in step one, two, and three.

Present analysis as a reportExport analysis to PDF

Share your findings and analysis in a customizable report

Purpose• To allow users to export the findings and analysis

to a paper-format report, in order to distribute the analysis of the results to those who may have limited access to computers and/or may not own an ISACS-AT, as well as for those who are less favorable to using software platforms. In essence, the generation of the analysis in paper format serves as a reporting mechanism in the tool.

Export analysis to PDF

Click on the generate report icon to export the analysis to PDF

Example: Sample sections in report

Detailed overview

Priority overview

Status overview

Guide tipMaximize screen and image size when generating report• Make sure to maximize the tool screen when conducting

analysis and generating a report. This ensures that detail of the results are displayed clearly on the PDF.

• Each section in the analysis dashboard is size-adjustable. Users are recommended to expand the pie charts and bar graphs by dragging the borders of the sections before generating a report.

Reports can be generated on both comprehensive and targeted analysis

• Note that reports are generated based on the filters applied in your analysis. To generate a targeted report (e.g. report on only implemented measures), filter the analysis then click on generate report. By default (i.e. when no filters are applied) the tool will generate a comprehensive report with all the findings from the assessment.

Lesson 4: Manage assessments

Learning objective• Become familiar with the interface, flow,

and functions related to managing assessments

Expected outcomes• Improved understanding on– how to access existing assessments– how to organize assessments– how to design questionnaire, collect data,

and analyze results

Centralize location to manage assessments:The Assessment HomeDesign, collect responses, and analyze

assessments from one location

Purpose• To allow users to access all relevant

assessment-related features, as well as organize the existing assessments from a single interface location, in order to facilitate user experience in conducting self-assessments.

Guide tipBecome familiar with the Assessment Home• The Assessment Home is the starting point for

all users working on assessments. The Assessment Home is accessible directly through the Homepage, under the Assess box, through the “Manage Assessment” link. The 1) Assessment table, and 2) Task bar make up a single interface where users can manage, create, answer, and analyze ISACS assessments. It is important that all users become familiar with the flow and functions in the Assessment Home in order to effectively use the ISACS-AT.

Assessment Home page

Assessment Home functions

Task bar: Total of seven functions

Duplicate questionnaire

Delete assessments

Load modules

Guide tipMake sure to check the ISACS module you are working

on• The assessment are organized and presented in the

assessment table based on the ISACS modules. Make sure to select and load the ISACS module you wish to work with through the use of the ISACS Module Load bar when accessing assessment home.

The first icon under each section in the task bar provide access to Design, Collect, and Analyze functions (D-C-A)

• The task bar in the Assessment Home is divided in three sections: Design, Collection, and Analysis. Note that the first icon in each section of the task bar corresponds to the three key functions of conducting an assessment: Design, Collect, and Analyze. Becoming familiar with the use of the task bar will greatly facilitate the effort to conduct assessments.

What’s next?

See ISACS-AT: Advanced