t&e: keeping pace with a fast-changing world
TRANSCRIPT
Mr. Chris PaustCTEIP, Deputy Program Manager
Test Resource Management Center26 April 2012
T&E: Keeping Pace with a Fast-Changing World
International Test and Evaluation Association
Over the last decade, the nature of Warfare has changed drastically Asymmetric warfare/non-conventional systems Unmanned and Autonomous Systems Networked Systems of Systems Cyber warfare escalation
Test and Evaluation has been struggling to keep up
Test Resource Management Center Created to ensure DoD T&E doesn’t fall behind
2
A Changing World…
0
2,000,000
4,000,000
6,000,000
8,000,000
10,000,000
12,000,000
RDT&E (Non-MRTFB)DT&EOT&EOperationsCapability Investments
DoD Test: A $10B EnterpriseTypically 1-2% of total system acquisition cost
Source: FY12 BES R-3 and September 2010 MRTFB
5
Test Resource Management CenterOversight of the Enterprise
Oversight of MRTFBBiennial 10-YearStrategic Planning
AdministerT&E Investment Programs
•CTEIP•T&E/S&T•JMETC
Annual T&E Budget CertificationMilitary Departments& Defense Agencies
•DoD Field Activity •Direct Report to USD(AT&L)
SES Director4 Major Roles:
Legend: 24 sitesArmy (9), Navy (6), AF (7), Defense Agency (2)
Steward of the DoD Test Infrastructure Major Range and Test Facility Base (MRTFB)
Keyport
NAWC-WD China Lake
30th Space Wing
NAWC-WD Point Mugu
Air Force Flight Test Center
Yuma Test Center
Nevada Test and Training Range
Utah Test and Training Range
West Desert Test Center
White Sands Test Center
High Energy Laser Systems Test Facility
Electronic Proving Ground
PMRF
U.S Army Kwajalein AtollReagan Test Site
DISA,JITC 46th Test Wing (Includes 46th
Test Group)
Atlantic Undersea Test and Evaluation Center
45th Space Wing
Arnold Engineering Development Center
NAWC-AD Patuxent River
Aberdeen Test Center
DISA,NCR
Cold Regions Test Center
Tropic Regions Test Center, HI & Puerto Rico
6
18,000 sq. mi. of land180,000 sq. mi. of air space( > ½ of all DoD land)
30,000 personnelMilitary, Gov, Contractor
Replacement Value = $25B
7
Risk mitigation needsTechnology shortfalls
Risk mitigation solutions Advanced development
Capabilities
Service Modernization and
Improvement Programs
Acquisition Programs and Advanced Concept
Technology Demonstrations
T&E Multi-Service/Agency
Capabilities
DoD Corporate Distributed
Test Capability
TRMC Joint
Investment Programs
Transition
Requirements
DoD T&EStrategic Plan*
Service T&E Needs and
Solutions Process
Annual T&E Budget
Certification*
Quadrennial Defense ReviewStrategic Planning Guidance
(6.3 Funding) (6.5 Funding)(6.4 Funding)
Department of DefenseTest Investment Strategy
7
Mission: Develop Technologies Required to Test Future Warfighting Capabilities
Established in FY02 Joint DDR&E / DOT&E Initiative Transitioned to TRMC in FY05
6.3 RDT&E Funds Purpose
High Risk / High Payoff R&D for Testing Foster technology transition to major DoD test ranges Risk reduction for test capabilities developments
80 ActiveProjects
Annual Broad Agency Announcements (BAAs) Academia Industry Government Laboratories
Tri-Service working groups Validate requirements Evaluate proposals Facilitate technology transition
Central Oversight – Distributed Execution
High SpeedSystems
13 Active Projects
Eight Test Technology Areas
Directed Energy17 Active Projects
Cyberspace2 Active Projects
Net-Centric Systems7 Active Projects
Electronic Warfare16 Active Projects
Unmanned & Autonomous Systems
3 Active Projects
AdvancedInstrumentation8 Active Projects
Shaping Technology into Tomorrow’s T&E Capabilities
T&E/Science &Technology Program
Spectrum Efficiency
14 Active Projects
Resource Enhancement Project
(REP)
Joint Improvement& Modernization
(JIM)Threat Systems Project
(TSP)
• 3-5 year requirement horizon• EMD of Major Test Capabilities• Must address joint requirements• Services & Agencies budget for
O&M over Life-Cycle of delivered capabilities
• 1-2 year requirement horizon• EMD of target capabilities• Address shortfalls in threat
systems representation• Coordinated with DOT&E
• 1-2 year requirement horizon• EMD of instrumentation
needed to address an emergent requirements
• Must address OT shortfalls• Coordinated with DOT&E
T&E Master Plans (TEMP) References Submarine Launched Countermeasure Emulator CBASS torpedo effectiveness testing against enemy
countermeasure threatsMILSATCOM Atmospheric Scintillation Simulator AEHF survivability and effectiveness testing in realistic
atmospheric environmentsGround Mounted Seeker Simulation Advanced open-air SAM simulator to support IDECM Block IV
effectiveness testing
Initiated DEPSECDEF – 9 November 1988 Established in FY91 by Congress 6.4 RDT&E funds Purpose
Have multi-Service utility Be developmental Be non-procurement
Mission: Develop or Improve Major Test Capabilities that have Multi-Service Utility
47 ActiveProjects
9
Central T&E Investment Program
3 Project Portfolios
Joint Mission Environment Test Capability Program
Ft Huachuca: (4) JITC, JTDL, CMIS, JTRS
Charleston (2):IPC, MEF-MEU
Ft Hood (2): CTSF, TTEC
WPAFB: SIMAF
As of 05 Apr 20120
20
40
60
80
FY06 FY07 FY08 FY09 FY10 FY11
JMETC Site Expansion
Sites
Dedicated, trusted connectivity on SDREN (part of the GIG) Encrypted for Secret – System High DISA-registered IP address space Active monitoring of network performance Capable of supporting multiple simultaneous test events
Bethpage: NGC BAMS
Functional Sites: 67New Sites Planned: 10Connection Points to Other Networks: 7
Ft. Greely: CRTC
MHPCCPMRF: Bldg 105
Pax River:(8)ESTEL E2C/D, MCL,
ACETEF, SAIL, ATR,E-2C SIL, UASIL, MFS
JMETC SYSCONEast Agg Rtr.
Aberdeen: ACCN
Langley (2): C-GIIF, TDLITC
JS J8 DDC4: C4AD
Wallops Island: (2) SCSC, SSDS
Dahlgren (2): CEDL,IWSL
Dam Neck: CDSA
Newport News: NGC VASCIC
Norfolk: COMOPTEVFOR
McLean: MITRE NCEL
Bethpage: NGC BCN
Eglin AFB (5):AOC, DTF, GWEF, KHILS, JDAT
Hurlburt Field: C2DAC
Camp Pendleton:MCTSSA
China Lake (3):F/A-18, IBAR,TSPIL
Edwards (2):
Corona: NSWC
Point Loma :SSC-PAC 59140 SSC-PAC HAIPE
Point Mugu (2):ITEC, EA-6B
West Agg Rtr.Rancho Bernardo, NGC BAMS
412th EWG IFASTRidley
Palmdale, NGC BAMS
Redstone (10): SMDCRTC: DTCC, GMANSED: Patriot, THAAD, FAAD, GSIL, JLENS, MUSE, SIV(2) SED-PSEM, AMRDEC
LMCO Global Vision Network, Arlington, VA
Moorestown: CSEDS
Crane: NWSC RDT&E
ArmyAir ForceNavyMarines
JointIndustryAcademia
GTRI
Sites in Hawaii
Site in Alaska
11
The T&E community is in constant battle…• Technology is moving at lightning speed.• Formal Acquisition does not.• Innovations and asymmetrical threats drive us
to be “reactive” to urgent needs.• Warfighters need us to be “proactive”
“Technology Push” vs.“Acquisition Pull”
0
5
10
15
20
25
30
Total DoD S&T Industry-IT R&D Industry-Electronics R&D
2011 Research Investments ($B)
Microsoft – $9B
IBM – $6B
Google – $3B
Motorola – $3B
Cisco – $5B
Intel –$6B
Investors in Tomorrow’s Technology
Rest of Top 10
Rest of Top 10
12
Trends in Software Complexity
13
Trends in Devices & Adoption
14
Trends in Devices & Adoption
15
Your cell phone in 2012 is…
1,000 x more powerful 100,000 x smaller 1,000,000 x cheaper
than 1 MIT computer in 1965
Trends in Power, Size & Cost
16
17
Why is this relevant to us?…
OTH
ER R
AN
GES
Mobile AdaptiveMesh NetworksMobile AdaptiveMesh Networks
OTH
ER R
AN
GES
CEC
C2 CONTROL NETC2 CONTROL NET
Unmanned SystemNetworks
Unmanned SystemNetworks
A Very Complex Test Environment
Range ControlFacility
Range ControlFacility
JointTaskForce
Joint Task Force
TAC NET
C4I ProvidersC4I Providers
Bidirectional Secure Range NetworkBidirectional Secure Range Network
SPEC
TRU
M, L
AN
D, S
EA A
ND
AIR
RES
OU
RC
ESSP
ECTR
UM
, LA
ND
, SEA
AN
D A
IR R
ESO
UR
CES
These technologies are being integrated into weapon systems Ours……and theirs!
These same technologies need to be matured and integrated into our test capabilities
Critical to ensure S&T technologies have solid transition partners CTEIP and Service T&E Investments
19
Ensuring Technology Transition
Spectrum EfficienciesAdvanced aeronautical telemetry at Open Air Test Ranges
Cyberspace & Network Centric SystemsTechnologies and capabilities to emulate, visualize, and assess our abilities to defend cyberspace
Testing in Urban EnvironmentsA robust, realistic environment to test electromagnetic effects, mission effectiveness, and interoperability of systems under test
Safe Test of Large Footprint WeaponsReconfigurable, modular, low power design suitable for high dynamic environments
Accurate TSPI (Time Space Positioning Information)Precision tracking capability for high-dynamic aircraft
Infrared Countermeasure TestingCapability to present IRCM system-under-test with a realistic representation of an incoming missile
20
T&E Investments for the Future
T&E/S&T Technology Areas Directed Energy Test
Net Centric Systems Test
Non-Intrusive Instrumentation
Spectral Efficient Technology
Cyber Space Test Technologies
Electronic Warfare Test
Unmanned Autonomous Systems Test
Advanced Instrumentation Systems Test
Key Investments & Successes•Broadband Telemetry Antenna (L/S/C Bands)
•Linear Power Amplifier (50% efficiency increase)
•Adaptive Orthogonal Frequency Division Multiplexing (AOFDM) Low Cost OFDM Telemetry Transceiver
•Network management tools
•Spectrum “hopping” radio to access unused portions of spectrum
S&T Investments for the Future
21
Spectrum Efficient Testing
Program ExampleTest Capability Driver
Challenge
100,000
10,000
1,000
100
10
Bit
Rat
e (K
bps)
1970 1975 1980 1985 1990 1995 2000 2005 2010
F-14
F-15E
A-10
B-1
F-16
F-18
B-52
B-2
SM I
YF-22YF-23
F-22
JDAM
SRAM II
F-18 E/F
E-2D
VH-71
ESSM
F-35 2v4
AIM-9XSM 6
NASA CEV
F-22 1v2
OBRA 93BBA 97
Future ThreatsDAB, PCS,
300
275
250
225
200Sp
ectr
um (M
Hz)
Historic
Spectrum and Data Rates Trends
• Develop a Range Telemetry capability that: Provides more efficient/effective ways to
use available spectrum. Reduces test and re-test time by fixing
data drop-outs. Enables selective data acquisition during
tests.
• Integrated Network Enhanced Telemetry (iNET) Block 1 ProjectEnhances current 1-way Serial
Streaming Telemetry (SST) systems with a 2-way network capability.Leverages Service and TRMC
initiatives to develop C-band telemetryLeverages T&E/S&T projects
addressing: 1) dynamic frequency assignments, 2) multi-path mitigation, and 3) forward error correction.
Goal• Test iNET Block 1 capability at Edwards Air
Force Base and Patuxent River Naval Air Station by FY13.
• Completed Preliminary Design Review.• Completed prototype hardware performance
testing at the Southwest Research Institute (SwRI) System Integration Laboratory.
Program Status
Net-Centric Warfare Testing Net Enabled Weapons Testing
• Spiral 2 Development Complete JITC accredited for Joint Interoperability Certification test use
• Spiral 3 (Release 1) System Acceptance Testing Completed in November 2010
CND Scenario that linked IO Range and JMETC networks for the first timeJITC interim accreditation for NR-KPP Certification test use
Full (Spiral 3) Operational Capability in 2013
• Joint service test & training exercises are increasing in frequency and complexity
• Testing of Net Enabled Weapons• Interoperability testing of systems of
systems.• Distributed Live, Virtual and Constructive
Testing
• Interoperability Test and Evaluation Capability (InterTEC)
Construct, control, instrument, capture joint C4ISR data Stimulate and analyze an operationally relevant distributed test environment Perform post-event analysis Support interoperability certification
Program Example
Development Status-SuccessesChallenge
Drivers
• Resolve battle space interoperability problems before networked systems are brought to war
Urban Environment Testing
Challenge
Program Example
Goal
Drivers
• Joint Urban Test Capability (JUTC) Project FY2010 New StartAddresses Critical Capability Gap in DoD
Strategic Plan for T&E Resources Leverage results of Urban Environment
Test Capability StudyLeverage S&T investments in advanced
instrumentation
• Develop test capabilities that measure both the effects of Urban Environment (UE) on systems under test (SUT) and SUT interactions in UE Technical performance Operational effectiveness Suitability and survivability
• Develop robust, realistic, technically relevant, urban test environment:Accurate physical, electro-magnetic and population effects Test-Quality Instrumentation and Data Collection
Development Status
• Completed Test Capability Requirements Document (TCRD)• Expected to enter EMD in FY12
Safe Testing of Large Footprint Weapons
Challenge
Program Example
Goals
Drivers
• Longer range (large footprint) of new missiles necessitates the use of flight termination systems for flight safety.
• Limited unused space inside modern missiles requires flight termination systems to be subminiature in size (11 to 16 inch3).
• Subminiature Flight Safety System (SFSS) Leverages completed CTEIP projects:
Joint Advanced Missile Instrumentation (JAMI) provides GPS-based TSPI and real time post flight data processing.Enhanced Flight Termination System
(EFTS) provides new digital and encrypted flight termination link.
• More realistic operational test of long range weapons- eliminate range safety constraints.
• Reconfigurable, modular, low power design suitable for high dynamic environments.
• Completed PDR• IOC expected in FY14
Development Status-Successes
Accurate Time Space Position Information (TSPI)
Challenge
DriversProgram Example
Goal
• Common Range Integrated Instrumentation System (CRIIS) - First real-time, high-precision (sub-meter) TSPI range system.
• Replace ARDS starting in 2014:Fielded for 25 years on 10 MRTFB ranges,
training venues, foreign military end-usersVariants: P5 Combat Training System, others
Development Status- Successes• Successful prototype flight demonstrations • Completed PDR, on-track to CDR
Provide precise “Ground Truth” TSPI for high accuracy future Systems Under Test (SUT)
CRIISGPS ARDS
Infra-Red Countermeasure (IRCM) Test Capability Portfolio
Challenge
Drivers Program Examples
Development Status -SuccessesPresent IRCM system-under-test with a realistic representation of an incoming missile
Not feasible to fire missiles at manned aircraft to test IRCM system effectiveness
• Ground Based Missile SimulatorsJMITS - Joint Mobile IRCM Test System MSALTS- Multi-Spectral Sea and Land
Target Simulator• Airborne Threat Missile Simulator
TAPS - Towed Airborne Plume Simulator• Installed System Environments
JDIGS - Joint Distributed IRCM Ground Test System Missile Signal Processors in the Loop
• Advanced IR Missiles• Advanced IRCM Systems
Ground Based (JMITS)
Missile Simulators
Airborne (TAPS)
• TAPS Flight Testing CompletedIOC in 2010, accredited for use in LAIRCM
NexGen Operational Testing• Completed MSALTS CDR
IOC in 2013• Completed JDIGS Risk Reduction Demonstrations
Verified acceptable end-to-end (distributed test) data throughput and latencyIOC in 2013
• IRCM Test Resource Requirements Study UpdateAddressing urgent HFI testing needs
Closing Thoughts
Technology is moving at a blinding pace…. Most of it will come from industry and will be rapidly
acquired, adapted, and fielded to meet operational needs…. It will certainly push our test resources beyond their
current limits
To ensure the Department’s T&E infrastructure keeps pace We must grow existing capabilities We must invest in new technologies
And ensure we have well-defined/supported transition partners
We can’t do it alone! We must partner with Academia, Industry, and other
stakeholders to meet these challenges28