16a guard and response performance testinglevel i 13 performance testing: guard and rfs mission...
TRANSCRIPT
The Twenty-Sixth International Training CoursePage 1
16 –Performance Testing – Guard/Response Forces
16 . Pe r fo rmance Tes t i ng : Gua rd and Response Fo r ces
October 24 – November 11, 2016Albuquerque, New Mexico, USA
Bud Siple
Performance Testing: Guard and RFs
Learn ing Object ives
After completing this module, you should be able to:• Recognize performance testing recommendations from
INFCIRC/225/Rev.5• Identify purpose and importance of guard/response
testing program• Provide an overview of what guard/response
performance testing program must accomplish• Recognize performance measures for guard/response
force• Recognize three levels and associated tests of guard/
response performance testing
2
The Twenty-Sixth International Training CoursePage 2
16 –Performance Testing – Guard/Response Forces
Performance Testing: Guard and RFs
Gu idance on Per formance Test ing ( INFCIRC/225/Rev.5)• Evaluations, including performance testing, of the
physical protection measures and of the PPS, including timely response of the guards and response forces, should be conducted regularly to determine their reliability and effectiveness
• Evaluations include exercises to test integrated system, including training and readiness of guards and response forces
• Operator should develop and implement means and procedures for evaluations, including performance testing and maintenance of the PPS
3
Performance Testing: Guard and RFs
Performance Test ing Program
• Response performance testing is part of an overall performance testing program
• Must be developed to: Validate the performance of response protection elements Ensure that response protection elements are performing as
designed Test response elements whose failure would reduce protection to
unacceptable levels Conduct at a frequency to achieve high level of confidence in the
reliability of the element Establish a documented performance testing process
4
The Twenty-Sixth International Training CoursePage 3
16 –Performance Testing – Guard/Response Forces
Performance Testing: Guard and RFs
Purpose
• Performance testing is a means to realistically test the effectiveness of response force programs
• Tests performance of People (response force, guards, emergency services) Equipment (weapons, vehicles, body armor) Procedures (response, entry control, CAS)
• Performance testing considers the following areas: Planning (Chain of command; area knowledge) Tactics (Cover and concealment; weapons limitations) Training (Protected targets; adversary scenarios) Practice (Maintain skills; Contingency plans)
5
Performance Testing: Guard and RFs
Performance Test ing Methodology
• A combination of performance testing is used to evaluate performance of guard/response force
• Grouped into two categories: Subsystem Performance Testing Whole System Performance Testing
6
The Twenty-Sixth International Training CoursePage 4
16 –Performance Testing – Guard/Response Forces
Subsystem Performance Test ing
Subsystem performance testing narrowly focuses on the performance and effectiveness of either part of a whole system or an individual component of the guard/response force function
Used to determine whether: Guard and response procedures are effective Personnel understand and follow the procedures Personnel and equipment interact effectively
Tests individual components of the whole system
Performance Testing: Guard and RFs
7
Performance Testing: Guard and RFs
Leve ls of Performance Test ing
• Subsystem Performance Testing Level I
• Time Motion Studies • Limited Scope Performance Test
Level II• Mission Drills (To demonstrate sustainability)• Alarm Response Assessments Performance Test
Level III• Enhanced Limited Scope Performance Test
• Each level Becomes more complex to conduct Consists of specialized controller / evaluator training
8
The Twenty-Sixth International Training CoursePage 5
16 –Performance Testing – Guard/Response Forces
Performance Testing: Guard and RFs
Contro l ler / Evaluator Roles
Controllers: People responsible for enforcing rules of engagement, safety rules, and other control measuresEvaluators: People responsible for observing and documenting exercise activities and conditions• Controllers and evaluators should be specifically trained
for each type of test Ensure all safety and security requirements are met Maintain an environment free of hazards associated with each
test and method
9
Performance Testing: Guard and RFs
T ime Mot ion Studies
• Considered foundation for the response element Tests ability of responders to arrive at a designated response
point by a required time Determines and validates required response times for arrival at
various response locations (as derived from a response plan)
• Large number of studies should be conducted for each tactical position to quantitatively justify the average response time per position
Level ILevel I
10
The Twenty-Sixth International Training CoursePage 6
16 –Performance Testing – Guard/Response Forces
Performance Testing: Guard and RFs
T ime Mot ion Study “How i t Works”
• Time begins at the responder’s origination point and is measured to the dedicated response point
• Included in the overall response time: Donning all required equipment and firearms Traveling or traversal time Entering through entry gates, doors, or other type of barriers
Total Response Time
Level ILevel I
11
Performance Testing: Guard and RFs
L imited Scope Performance Tests
• Narrow focus on performance and effectiveness of a subset of response elements
• Used to Determine or verify that the tested response elements work
together Determine level of a security force’s skill or capability Validate possession of a requisite knowledge or skill to perform a
specific task Validate the individual human element in the PPS
• Continuous process to validate probabilities documented in the vulnerability analysis
Level ILevel I
12
The Twenty-Sixth International Training CoursePage 7
16 –Performance Testing – Guard/Response Forces
Performance Testing: Guard and RFs
L imited Scope Performance Test “Example”Handheld Metal Detector Start-Up No Yes
Did guard turn-on the detector and conduct operability test? Power up the detector away from the area where the inspection is to be performed,
with the detector end away from the body. Touch and hold the power pad. Release the power button after the monitor beeps.
Unauthorized Contraband Inspection using Handheld Metal Detector Did guard instruct person to stand with feet apart at shoulder width and arms extended out to each side?
Did guard scan person’s entire body with bottom of detector facing subject 5 to 10 cm (2 to 4 inches) from person?
Did guard first perform an inverted “U” type scan on the front side of person: Start at either of the person's feet Scan up same side of the body including arm and sides of neck to the top of the
head Search other side and scan the body in same manner scanning down other foot
Did guard instruct person to turn around and repeat the same inverted “U” type scanning the back surface of the individual?
Did the guard scan all hand-carried packages and containers? Finding Unauthorized ContrabandIf unauthorized contraband is found, did the guard detain the person and notify the Guard Supervisor?
Level ILevel I
13
Performance Testing: Guard and RFs
M iss ion Dr i l l s
• Considered rehearsals for Limited Scope Performance Tests
• Used to Maintain sustainability Train for Limited Scope Performance Tests Train the Trainer (Supervisors) Determine the level of a security force’s skill or capability Reinforce the level of a security force’s skill or capability
• Practice before you Play!
Level IILevel II
14
The Twenty-Sixth International Training CoursePage 8
16 –Performance Testing – Guard/Response Forces
Performance Testing: Guard and RFs
M iss ion Dr i l l “Example”
Handheld Metal Detector Start-Up No Yes
Instruct guard how to turn-on the detector and conduct operability test Power up the detector away from the area where the inspection is to be performed,
with the detector end away from the body. Touch and hold the power pad. Release the power button after the monitor beeps.
Unauthorized Contraband Inspection using Handheld Metal Detector Instruct guard how to instruct person to stand with feet apart at shoulder width and arms extended out to each side
Instruct guard how to scan person’s entire body with bottom of detector facing subject 5 to 10 cm (2 to 4 inches) from person
Instruct guard how to first perform an inverted “U” type scan on the front side of person: Start at either of the person's feet Scan up same side of the body including arm and sides of neck to the top of the head Search other side and scan the body in same manner scanning down other foot
Instruct guard how to instruct person to turn around and repeat the same inverted “U” type scanning the back surface of the individual
Instruct guard how to scan all hand-carried packages and containers Finding Unauthorized ContrabandInstruct guard how to detain a person and notify the Guard Supervisor when unauthorized contraband is found
Level IILevel II
15
Performance Testing: Guard and RFs
A la rm Response and Assessment Per formance Tests• Tests response force readiness and response to an alarm at a
specific location• Measures specific performance actions:
Communications Personnel protective measures Equipment availability and serviceability Coordination activities Tactical movement
• Tests are “no notice” performance tests • Must be coordinated with facility representatives so that
Safety requirements are met Security is not compromised Disruption to operations is limited
Level IILevel II
16
The Twenty-Sixth International Training CoursePage 9
16 –Performance Testing – Guard/Response Forces
Performance Testing: Guard and RFs
A la rm Response and Assessment Per formance Tests “How I t Works”Picture In Time: A representation of response force patrol locations at a specific time.
Create a Picture In Time Position controllers with selected security force according to the Picture In Time A controller will intentionally simulate a breach at a designated alarm point to
stimulate the security force response Each controller evaluates the response and documents results
Level IILevel II
17
Performance Testing: Guard and RFs
Enhanced L imited Scope Performance Test
• Modified Force-on-Force exercise minimizing resources Multiple Integrated Laser Engagement System or inert weapon
systems is required Ensures security personnel know how to respond according to
their contingency plans Parts of detection, delay, and response functions are tested
against fictitious yet credible adversary attack Ensures personnel are trained in command and control;
communications; tactics; equipment; and weapons Uses adversary scenarios from DBT with reduced adversaries
Level IIILevel III
18
The Twenty-Sixth International Training CoursePage 10
16 –Performance Testing – Guard/Response Forces
Performance Testing: Guard and RFs
Enhanced L imi ted Scope Per formance Test“How I t Works”• Create a Picture in Time• Position controllers with selected guard, response force, and adversary role
player(s)• Minimum of one adversary will intentionally trip a sensor to simulate a
breach at a designated alarm point to initiate the security force response• Each controller evaluates the response and documents results
Adversary Time Line
Level IIILevel III
19
Performance Testing: Guard and RFs
Whole System Performance Test ing
• Testing sections of the whole system Ensure individual components work together Evaluate the overall performance of the PPS
• Two performance measure criteria are evaluated: Interruption – The successful arrival of the response force at an
appropriate location to stop the adversary Neutralization – When the response force kills, captures, or causes
the adversary to flee before the adversary can complete the task
• Types of simulation methods to evaluate overall PPS performance Tabletops Computer Simulations Force-on-Force
20
The Twenty-Sixth International Training CoursePage 11
16 –Performance Testing – Guard/Response Forces
Performance Testing: Guard and RFs
Tabletop Exerc ise
• Method of simulating an adversary attack on a site’s existing or proposed PPS
• Analyzes PPS Functions (Detection, Delay, Response)• Provides insight into a PPS that can stand alone or be
used in other analysis tools Evaluation Team
Protective
Force
Adversary Team
ExerciseModerator
SiteMap
21
Performance Testing: Guard and RFs
Computer S imulat ions
• Computer simulation of small force engagement• Used to
Determine effectiveness for tactical movement, weapon and explosive calculations, etc.
Provide real-time results of engagements between the response force and an adversary
Determine probabilistic PH/PK calculations
22
The Twenty-Sixth International Training CoursePage 12
16 –Performance Testing – Guard/Response Forces
Performance Testing: Guard and RFs
Force-on-Force Exerc ise
Force-on-Force Exercise: A performance test of the physical protection system that uses designated personnel in the role of an adversary force to simulate an attack consistent with the threat or the design basis (IAEA INFCIRC/225/Rev.5)• A full-scale field simulation of an attack on a site
involving all onsite guards and response forces
23
Whole System Data Points• Methods concurrently determine two types of data PE for a PPS Guard and response force subsystem performance testing
data
Tabletops Force on Force ComputerSimulations
PE
Subsystem Data•Rules of engagement•Poor tactics•Poor communication
Subsystem Data•Chain of command•Equipment failure•Lack of knowledge of contingency plan
Subsystem Data•Training issues•Poor tactics•Poor communication
Performance Testing: Guard and RFs
24
The Twenty-Sixth International Training CoursePage 13
16 –Performance Testing – Guard/Response Forces
Performance Testing: Guard and RFs
Summary
• Performance Testing is a means to realistically test the effectiveness of guard/response force programs
• Ensures that guard/response protection elements are performing as designed and provide the required protection level
• Subsystem and whole system performances tests are used to evaluate the performance of the guard and response force functions
• Three levels of response performance testing Level I: Time Motion Studies and Limited Scope Performance Tests Level II: Mission Drills and Alarm Response and Assessment
Performance Tests Level III: Enhanced Limited Scope Performance Tests
25