tectonic changg, ge, “big data” and the test & evaluation ...€¦ · • requires a...

Tectonic Change, “Big Data” g , gand the Test & Evaluation

Ch llChallengeMG, USA ® John M. Custer

1© Copyright 2011EMC Corporation. All rights reserved.

Food & WaterFood & WaterCovert Action Nuclear ProgramsCovert Action Nuclear Programs

Hybrid WarfareHybrid Warfare

Islamic ExtremismIslamic Extremism

UNCLASSIFIED

Cloud ComputingCloud ComputingArab Spring Hybrid WarfareHybrid Warfare

Energy DemandsEnergy Demands

Terrorist AttacksTerrorist Attacks

BIG DATABIG DATAAmplifiers…Seismic…..TECTONICAmplifiers…Seismic…..TECTONIC

Arab Spring

A Transformed WorldA Transformed World••Globalization….Globalization….VirtualizationVirtualization

••Demographic TrendsDemographic TrendsDemographic TrendsDemographic Trends••Resource CompetitionResource Competition

••WMD ProliferationWMD Proliferation••Failed / Failing StatesFailed / Failing States

••Climate ChangeClimate Change

Find Fix FinishFind Fix FinishUnits / Individuals / NETWORKS Units / Individuals / NETWORKS

-- Knowledge Management Knowledge Management -- Power of Anonymity…Identity ResolutionPower of Anonymity…Identity Resolution-- Age of the Strategic Private LES/CES Age of the Strategic Private LES/CES -- Age of the Strategic InnovatorAge of the Strategic Innovator

CultureCulture…….…….ACCESSACCESS••Expertise has moved to the EdgeExpertise has moved to the Edge

••No more Order of BattleNo more Order of BattlePREDICTIVE ANALYTICS


Every Paradigm Has ChangedEvery Paradigm Has Changed

No more Order of BattleNo more Order of Battle

F3EADF3EAD

UNCLASSIFIED

R

We live in a society exquisitely dependent onexquisitely dependent on science and technology, in which hardly anyonein which hardly anyone knows anything about science and technologyscience and technology

- Carl Sagan


902.4 PB – Size of YouTube $187/second – Cost of last Ebay Outage

282 Milli I t t b it

6.9 Billion People….4.3 Billion Mobile Devices800 Million Facebook Users294 Billion – Average emails/Day282 Million – Internet websites

30 Billion – Pieces shared on Facebook/MonthF-35 A Terabyte per Sortie 460,000 New Twitter Accounts per Day

y p

1 Billion PCs and Laptops

100 Million Gigabytes – Size of Google’s Index

1 Billion Tweets/Week, 177 Million 3/1/11152 Million – Internet Blogs 107 Trillion – emails sent in 2010

340x1023 – Size of IPv6 Address Space

100 Million Gigabytes Size of Google s Index

6,939 1/1/11 Current Tweets Per Second record - Japan 4 seconds after Midnight*

1.98 Billion – Internet Users


7/25/2008 – Google passes 1 trillion URLs

The Information Being Created Today is “Big Data”… Massive Amounts of File-based, Unstructured Data

Video Surveillanceand Graphics

Satellite Imagery


UNCLASSIFIED

HOW DO WE MANAGE AND MAKE SENSE OF THE “BIG DATA” WE ARE COLLECTING ?

If a Grain of Sand were One Byte of Information . . .

A Vocabulary for Measuring Information Data

1 Megabyte =1 million bytesa tablespoon of sand

1 Exabyte =1,000 petabytesthe same beach—from Maine to North Carolina

1 Gigabyte =1 billion bytespatch of sand—9” square 1’ deep

a tablespoon of sand1 Zettabyte =1,000 exabytesthe same beach—along the entire US coast9 square, 1 deep

1 Terabyte =1 trillion bytesa sandbox—24’ 1’ d

g

1 Yottabyte =1,000 zetabytes (24 Zeroes)enough info to bury the entireUS under 296 feet of sand24’ square, 1’ deep

1 Petabyte =1,000 terabytesa mile long beach—

US under 296 feet of sand

……And if you’re talking aboutcommunications…….bits…….

MULTIPLY BY EIGHT!


g100’ wide , 1’ deep (1 Byte equals 8 Bits)

The Ever Growing Volume and Complexity of Data Collection, Warehousing and Discovery

Tectonic Shift, g y

• A DIGITAL FOOTPRINT.....IN THE MODERN WORLD, EVERY HUMAN AND MECHANICAL ACTIVITY LEAVES A TRAIL OF DATA....

• Phone calls, credit card transactions, blogs, medical records, cash withdrawals, bar code swipes, bank interaction, passports, visas, Tweets, web use, e-mail messages, Government data…

CONSTELLATIONS OF PLATFORMS TIED TO NETWORKS OF SENSORS ALL INTEGRATED INTO THE INTERNET• High- capacity microwave radio-relay systems, satellite links, fibre optic submarine cables

carrying mixed traffic of voice/VOIP/video/fax/e-mail and internet data video surveillancecarrying mixed traffic of voice/VOIP/video/fax/e-mail and internet data, video surveillance cameras, fingerprint scanners, CBRNE (chemical, biological, radiological, nuclear, explosive) detection devices, Airline Passenger Name Records, Phone call detail records, satellite and UAV images, 4.5 million CCTV cameras in UK ....30 million in US

• New families of sensors are constantly being created, each sending an increasing amount of data (High Density Images, Video, Voice, Data, Multispectral).data (High Density Images, Video, Voice, Data, Multispectral).

NETWORK SECURITY, DATA FORENSICS AND TRACKINGIS INCREASINGLY DIFFICULT –SMALLER DATA PACKETS – MULTIPLE ROUTES – DEEP PACKET INSPECTION (DPI) AND CLOUD TRUST ARE KEYs TO FUTURE SUCCESS

INTELLIGENCE


INTELLIGENCE

“Our problem is we have historically been platform and sensor-centric giving only lip-service to theand sensor centric, giving only lip service to the crucial processing and analytic activities which transform information into intelligence. More and more constellations of platforms each withmore constellations of platforms each with increasingly more capable families of sensors only provide us with more mountains of data, making actionable intelligence even more difficult to gderive. Developing technologies to sift and analyze mind-numbing amounts of data while interacting with analysts in real time has got to be our priority in the future.” General John P. AbizaidCommander, US Central Command


March 2007

The ISR T&E DilemmaCloud

NETWORK SECURITY

BIG DATAIntelligence

Cloud

BIG DATA

BACK-UP & RECOVERY

TAGGING

REAL-TIME

CONUS

PREDICTIVEANALYSIS

BIG DATASTORAGE

ANALYTICTOOLS

Launch & Recovery

Ground Control Station


Tactical Operations CenterC2 and Analysis

How do you Test and Evaluate BIG DATA Systems of Systems Architecturesbased on Multi-Platform, Joint, and Interagency Interoperability?

Where We Stand Today• AN EMERGING ERA OF CLOUD COMPUTING AND

BIG DATABIG DATA• How do we Test in a New Data Paradigm?

• Can Data Overwhelm Testing?• Requires a Relevant and Contested Environment• What does PreDeployment Testing Look Like?at does e ep oy e t est g oo e• Speeds and Capabilities of Operational Systems • How to Evaluate and Validate ‘The Cloud?”• A Ubiquitous Cyber Security Envelope

• Real-Time Analytics will Define the Era• Data Minutes Old is Stale

• SIMULATING AND EVALUATING KNOWLEDGE MGMT

• Cyber Security Design Test requirements• By 2013…50% of Devices on Internet will not be PCs…By

2015 only 20% PCsIn Every Future War we will use 2015 only 20% PCs• Transitioning to Billions of Concurrent Users• Platforms Will Produce a Petabyte a Day• No Future US Monopoly on Situational Awareness…ISR will

Globalize and Commoditize• Storage is a Commodity…but Raw vs Usable matters

In Every Future War we will use ONE TENTH the Force utilized in the Previous Conflict and ONE HUNDRED Times the


Storage is a Commodity…but Raw vs Usable mattersPetabytes…Hyperscale…The New Normal

1. -

Bandwidth

T&E Infrastructure Study• The Under Secretary of Defense (Acquisition,

Technology and Logistics) has requested TRMC toTechnology and Logistics) has requested TRMC to assemble an objective expert team to conduct a study to determine how T&E resource costs canstudy to determine how T&E resource costs can be significantly reduced to provideadequate and robust testing at incrementally lower budget levels.


Identify high payoff areas for potential savings

Scope of the T&E Infrastructure Study Identify high-payoff areas for potential savingsDetermine DoD T&E infrastructure requirements and proper stewardship of specific test capabilities to include:

Capabilities at other Federal AgenciesCapabilities at commercial contractors

Based on infrastructure requirements, identify capabilities required to meet future weapon system needsIdentify alternatives and develop recommendations for operation and maintenance support of test facilities

Develop recommendations with advantages/disadvantages of alternativesAssess potential business model alternatives, funding policy alternatives and technology initiatives


alternatives and technology initiatives

The Testing Capability GapGap

How Do You Test a PetabyteSensor Network?Sensor Network?

BBBBSensors and DataGrowing Exponentially


Around The Corner• KEY DRIVERS OF THE FUTURE

– Virtualization VDC/VDI– Containerized Data Centers Enable the

Cloud– Broadband will Enable the Video

Explosion– Hi-Fidelity Search y

• “Predictive Learning Curiosity Engines”

– Increasingly Intelligent and Independent NETWORKS

THE ENTERPRISE IS THE EDGE• THE ENTERPRISE IS THE EDGE– The Network is the Formation of the

Future• All Information Will Be Digital• Users Will Employ Any and All

How Do We Create a N T t d p y y

Devices• All Devices will be Network Nodes • Stand Alone Products will Die

– CONVERGED INFRASTRUCTURE• Virtualized Integrated and

New Test and Evaluation Regime?


Virtualized ,Integrated and Preconfigured Networks, Compute, Storage and Security

Implications for Test and EvaluationVolume• PETABYTES are the New Normal HYPERSCALE How Long Until EXABYTES?PETABYTES are the New Normal ….HYPERSCALE ….How Long Until EXABYTES?• Store, Manage and Analyze Vast Amounts of Data• Scale-out Virtualized, Dynamic, Elastic Architectures

Velocity• Real Time Situational Awareness• Real Time Situational Awareness• Converged Compute, Storage, Networking and Security….Encrypted Enterprises

Variety• Structured and Unstructured Data• Subtle Networks of Connections Simulated Assets and Feeds• Subtle Networks of Connections…Simulated Assets and Feeds• Detect Non-Obvious Patterns and Links between Systems, Events, Places and Timeframes

Complexity and Speed of Analysis• Rapid, Rich, Enhanced Analytics for Big Data Sets… CHAFF IS THE NEW WHEAT• Correlation NOT Search…Ad Hoc, Interactive Analysis ….NOT Simple Structured Reports • Provide Analysts the Ability to Explore and Manipulate the Data

Budget• Maintain SLAs as Volume Dramatically Expands….$$$


UNCLASSIFIED

a ta S s as o u e a at ca y pa ds $$$• Reduce Datacenter Footprint and Costs….$$$

MetaData Challenges for21st Century Test and Evaluation21 Century Test and Evaluation

• Exponential growth in data quantity, sources, types and required analysis capability

• Metadata Creation must be Automated for Test and Evaluation…Must be a New Priority

• Insufficient bandwidth to move data forInsufficient bandwidth to move data for centralized analysis necessitates federated massively parallel analytics

• Lack of performance for advanced analyticsLack of performance for advanced analytics, complex queries and predictive results

• Necessary shift from Network Centricity to Data Centricity


Data Centricity

Down The Road• COLLABORATION….PRODUCTIVITY

TOOL OF THE FUTURETOOL OF THE FUTURE– Collaboration -No Longer an Option– Smart Networks…Collaboration will

Dictate T&E Efficiencies&– SIPR and NIPR will vanish….replaced

by Functional CoEs in the Cloud– Data-Centric NOT Net-Centric—

Operate Under the Assumption ofOperate Under the Assumption of Breach

– Network Technology…so deeply embedded it can no longer be separated from the Missionseparated from the Mission

– IT is driving a Confluence of Intelligence - Operations – Logistics across the Military


Down The Road• TEST & EVALUATION

CHALLENGES– Modern Telemetry– Fifth Generation Aircraft– Cyberspace– Autonomous Vehicles– Electronic Warfare

H D W C tALL BIG DATA PROBLEMS

- How Do We Create a Contested Architecture for Testing? PROBLEMS

• Finding Emerging Technologies to Assess and Evaluate Emergent Threats

g- What Are The Tenets of 21st Century T&E Cyber Security?


Evaluate Emergent ThreatsSecurity?

A Look Ahead1. Prepare for Disruption2. Cloud will enable2. Cloud will enable

Next Generation IT3. Next Killer App:3. Next Killer App:

Big Data Analytics4. Trust Will Be The KeyThe Toughest

C lt t Ch i 4. Trust Will Be The Key5. BIG Data Demands a

New T&E Paradigm

Culture to Change is One that’s been

Successful


e & a ad gSuccessful

tectonic changg, ge, “big data” and the test & evaluation ...€¦ · • requires a...

Documents