Upload
timothy-jenkins
View
218
Download
0
Tags:
Embed Size (px)
Citation preview
ISACS Assessment Tool Basic Guide
2015
Purpose of the ISACS-AT
• To support the practical application of the International Small Arms Control Standards (ISACS)
• To conduct self-assessment on the implementation of small arms control commitments in line with the standards
• To establish baselines on small arms control policy, programmes and practices in line with the standards
• To promote the ISACS for educational and awareness-raising purposes
About this guideThis guide is designed to detail this software’s functions and
features. Before getting started please note the instructions below:
• Please read this guide before using the software to ensure its proper use.
• Descriptions are based on the software’s default settings.• Images and screenshots may differ in appearance from the
actual product.• Content in this guide may differ from the final product and
is subject to change without prior notice. For the latest version of the software and the guide, refer to the ISACS website, www.smallarmsstandards.org
• The computer operating system may affect the overall performance of the software. Software may not work properly depending on the computer hardware specifications and the environment that it is used in.
• The software and this guide are currently available in English only.
• UNIDIR is not liable for performance issues or incompatibilities caused by efforts to modify the software. Attempting to customize the operating system may cause the software to work improperly.
Lesson overviewFour lessons:1. Basic tool flow 2. Configuration • Set up personal information• Create password• Create / connect to storage file
3. Assessments• Design a questionnaire• Collect data• Analyze results
4. Manage assessments
Lesson one: Basic tool flow
Lesson objectives• Become familiar with the tool’s
homepage, flow and interface
Expected outcome• Users are familiar with the basic
flow of the tool
Tool homepage
Basic homepage functions
Click on the banner to return to homepage
Click on the title to expand the features of the tool
Each of the functions are linked to another page
Lesson two: ConfigurationLesson objective• Learn how to:– Create/connect to storage file– Secure storage file– Import/export assessments data
Expected outcome• Users are able to create / connect to their
storage file• Users are able to secure their storage file• Users are able to share their assessment data
Create/connect to storage file
1) Click on “Configure”
2) Click on the link “Create storage file”
Create new storage file
Click on tab “create new storage file”, then click on
browse to select a location to save the file
Encrypt storage file to protect user data
Enter personal information
2) Click on tab “Personal info” to enter personal information
1) Click on the tab “Secure storage file” to
assign a password to storage file
Protect user storage file: Password
2) Click on tab “password settings” to assign a
password to a storage file
1) Click on the tab “Secure storage file” to assign a password to a
storage file
Connect to a storage file
Click on tab “open an existing storage file”, then select the
existing file. Click on the open icon to get connected.
Lesson tip
Why encrypt your storage file?A storage file that is encrypted can only be accessed on the operating system where the file was created. The encryption ensure that external users cannot access the user data from another operating system. If users are interested in sharing user data from their storage file, they must use the import/export function.
Lesson three: Assessment
Learning objectives• Become familiar with the purpose of small
arms control assessments• Learn how to conduct assessments on
implementation efforts of existing global small arms control commitments as outlined in the ISACS
Expected outcomes• Users understand the need of conducting
assessments on small arms programmes, practices, and policies
• User demonstrate their competency in the use of the ISACS-AT to conduct assessments
Lesson tip
Why conduct assessments?• Existing implementation challenges cannot be
addressed effectively until current implementation status is understood sufficiently
• Effective implementation requires adequate and accurate information collection and analysis
• Better understanding of implementation effort helps determine the need for an intervention by relevant stakeholders (What needs exists, how and who to intervene)
Lesson tip
Steps for conducting assessments
Step 1:Design
D Step 2:Collect
C Step 3:Analyze
A
Step one: Design a questionnaire
Designing a questionnaire is the first step in the assessment process
Purpose • To respond to an identified information need• To establish assessment criteria based on the ISACS
Design a questionnaire
DRAFT
Click on the tab “Assess”, and then click on the link, “Design
questionnaire”
Enter creator information
DRAFT
Enter creator information and click continue to create a
questionnaire
Select and load an ISACS module
DRAFT
1) Select the module to load using the Load Module bar.
2) Once selected, ISACS indicators will be loaded on the configuration panel (left
hand side column)
Select the indicators to design the assessment
criteria
Select (by checking the boxes) the indicators based on the ISACS module, clause, and
subclause
Generate and review indicators
DRAFT
Checking relevant boxes will generate indicators in the content
panel (right-hand side panel).
Filter indicators by priority (optional)
DRAFT
Clicking on the filter button allows users to filter measures by priorities
defined by the standards
Complete the design phase
DRAFT
Click on Save & Complete to conclude the design phase
Summary
How to design a questionnaire:
1. Click on Design Questionnaire from the homepage under the Assessment link
2. Enter creator information3. Load ISACS module using the Load Module bar4. Generate ISACS indicators through selecting
module/clause/subclause from Navigation Panel5. Add filter to indicator by designating a priority
(optional)6. Click on Save & Complete Questionnaire to
conclude the design process
Step two: Collect responsesData collection makes implementation
efforts measurable
Purpose• To gather quantitative and qualitative
data to establish implementation status on small arms control measures undertaken (and/or not taken), and to inform the analysis process
Lesson tip
Have you already created a questionnaire?
• Having an existing questionnaire in your storage file is a prerequisite to data collection. Make sure you have either 1) created a questionnaire, 2) already have an existing questionnaire in the storage file, and/or 3) imported a questionnaire into your storage file.
Collect responses
Click on the tab “Assess”, and then click on the link “Collect
Responses”
DRAFT
Select a questionnaire to collect data
2) Select the questionnaire you wish to answer then click
on Collect Responses
DRAFT
1) Select the ISACS module you wish to work on
Enter respondent information
Enter respondent information and click
Continue to provide answers to the questionnaire
DRAFT
Data collection page
Flag indicators Provide data Indicate sensitive
Add comments
View ISACS text
Save to complete data collection
Once answers are provided, click on Save & Complete to
continue
DRAFT
Guide tipHow do I update my responses to the questionnaire?• Note that users can save a questionnaire without answering all the
indicators within a questionnaire. This is called an in progress questionnaire. With in progress questionnaires, users can return to the questionnaire to update the answers provided. Note that users cannot designate a questionnaire as complete without answering all existing questions (i.e. questionnaire cannot be designated as complete if there are “Not Answered” status).
What is the difference between in progress and complete questionnaires?
• An in progress questionnaire allows users to update the responses they provide to a questionnaire, thereby enabling them to measure implementation progress and analyze its results as measures are undertaken. In contrast, responses in a completed questionnaire cannot be updated - it serves the purpose of benchmarking progress upon which users can analyze the results in relation to particular time period.
SummaryHow to collect response data:
1. Start at Homepage under Assess Box, and click on collect responses
2. Load the ISACS module of your interest from the Load Module bar
3. Select (click) a questionnaire from the table4. Click on collection responses icon5. Provide Status answer to the questionnaire (mandatory)6. Flag indicator(s) (optional)7. Sensitive (optional)8. Add comments (optional)9. Reference to original text (optional)10.Click on Save & Complete to conclude data collection
process
Collect data using paper formatExport questionnaire to PDF
Collect data in paper format and feedback into the tool
Purpose• To allow users to export the questionnaire
to paper format, in order to distribute the questionnaires created by the tool to those who may have limited access to computers and/or may not own an ISACS-AT, as well as for those who are less favorable to using software platforms
Export questionnaire to PDF
Click on the PDF icon to export questionnaire to
paper format
Example: Questionnaire in PDF
Step three: Analyze resultsAnalysis of findings allows users to better
understand implementation status and needs based on the baselines established
Purpose• To allow users to examine the data
findings and better understand implementation status, identify potential priorities, challenges and opportunities, in order to make informed follow-up action on their small arms control policies, programmes, and practices.
Guide tip
How does analysis of findings help evaluate the implementation of existing small arms control programmes?
• Establishing baselines and conducting analysis allows users to avoid situations in which small arms and light weapons control efforts are carried out based on assumptions that later turn out to be incorrect – resulting in wastage of money, failing to deal with problems effectively and preventatively, and leaving potential control issues unaddressed.
Access analysis platform
Click on the tab “Assess”, and then click on the link,
“Analyze Results”
Select questionnaire to analyze
Select a questionnaire you wish to analyze, then click on
“Analyze Results”
Analysis dashboard (interactive)
Composition panel (what is in the questionnaire) Overall
statusStatus by priority
Detail of implementation
Analysis dashboard: Target results
Step 1: Clicking on composition panel
informs status overview
Step 2: Clicking on status overview
informs priority overview Step 3: Clicking on
priority overview inform the detailed
overview
Step 4: Detailed overview reflects the filters applied in steps
1-3
Example: How to conduct targeted analysis
Composition panel (step one): Select relevant clauses –
this will update results presented in
the entire dashboard
Implementation Status Overview
(Step two): Click on a status in the
subsection of the pie to filter and
display results you wish to examine
Priority overview (step three): Click on the priority bar to filter and display
only the priority category you wish to
examine
Detail overview (step four): Analysis
of the results are displayed in the
detail table based on the filters applied
in step one, two, and three.
Present analysis as a reportExport analysis to PDF
Share your findings and analysis in a customizable report
Purpose• To allow users to export the findings and analysis
to a paper-format report, in order to distribute the analysis of the results to those who may have limited access to computers and/or may not own an ISACS-AT, as well as for those who are less favorable to using software platforms. In essence, the generation of the analysis in paper format serves as a reporting mechanism in the tool.
Export analysis to PDF
Click on the generate report icon to export the analysis to PDF
Example: Sample sections in report
Detailed overview
Priority overview
Status overview
Guide tipMaximize screen and image size when generating report• Make sure to maximize the tool screen when conducting
analysis and generating a report. This ensures that detail of the results are displayed clearly on the PDF.
• Each section in the analysis dashboard is size-adjustable. Users are recommended to expand the pie charts and bar graphs by dragging the borders of the sections before generating a report.
Reports can be generated on both comprehensive and targeted analysis
• Note that reports are generated based on the filters applied in your analysis. To generate a targeted report (e.g. report on only implemented measures), filter the analysis then click on generate report. By default (i.e. when no filters are applied) the tool will generate a comprehensive report with all the findings from the assessment.
Lesson 4: Manage assessments
Learning objective• Become familiar with the interface, flow,
and functions related to managing assessments
Expected outcomes• Improved understanding on– how to access existing assessments– how to organize assessments– how to design questionnaire, collect data,
and analyze results
Centralize location to manage assessments:The Assessment HomeDesign, collect responses, and analyze
assessments from one location
Purpose• To allow users to access all relevant
assessment-related features, as well as organize the existing assessments from a single interface location, in order to facilitate user experience in conducting self-assessments.
Guide tipBecome familiar with the Assessment Home• The Assessment Home is the starting point for
all users working on assessments. The Assessment Home is accessible directly through the Homepage, under the Assess box, through the “Manage Assessment” link. The 1) Assessment table, and 2) Task bar make up a single interface where users can manage, create, answer, and analyze ISACS assessments. It is important that all users become familiar with the flow and functions in the Assessment Home in order to effectively use the ISACS-AT.
Assessment Home page
Assessment Home functions
Task bar: Total of seven functions
Duplicate questionnaire
Delete assessments
Load modules
Guide tipMake sure to check the ISACS module you are working
on• The assessment are organized and presented in the
assessment table based on the ISACS modules. Make sure to select and load the ISACS module you wish to work with through the use of the ISACS Module Load bar when accessing assessment home.
The first icon under each section in the task bar provide access to Design, Collect, and Analyze functions (D-C-A)
• The task bar in the Assessment Home is divided in three sections: Design, Collection, and Analysis. Note that the first icon in each section of the task bar corresponds to the three key functions of conducting an assessment: Design, Collect, and Analyze. Becoming familiar with the use of the task bar will greatly facilitate the effort to conduct assessments.
What’s next?
See ISACS-AT: Advanced