infrastructure designed for cognitive workloads: why is it crucial? - xavier vasques

Infrastructure designed for cognitive workloads: Why is it crucial?Xavier Vasques, Technical Director, Systems Hardware, IBM France

@VasquesXavier

Artificial intelligence (AI) ….the term "artificial intelligence" is applied when a machine mimics "cognitive" functions that

humans associate with other human minds, such as "learning" and "problem solving

https://en.wikipedia.org/wiki/Human_mind

© 2015 IBM Corporation

AI …. To Do What ?

LEARN

TRANSMIT

IMPROVE



LEARN, What ?

Expertise/skills Knowledge

DATA is transforming industries and

professions

Determine a Cognitive Strategy

A foundation of data

Becoming a cognitive business

Analytics


AI …. To Do What ?IMPROVE,

What ? Your Business !

Hybrid Cloud services optimized for industry,

data and cognitive APIs


The world is being reinvented in ………………… code



TRANSMIT, HOW ? Systems !

IT infrastructure tuned for cognitive workloads

Security


Cognitive …. COMPUTING


Systems : The Brain

The Brain ? Some Facts …

Serving size 1 per Person (1300 g) Calories: 1958 (Calories from Fat 1239)

Total Fat: 137.6 g Cholesterol: 40.30 g Carbohydrates: 19.88 g Protein 151.41 g

Memory > 2.5 Million Giga Bytes Neurons: 80 000 000 000 Synapses: 100 000 000 000 000

Power: 20W Dimensions: 1450 cm3


Systems : The Brain

The Brain ? “Non-Cognitive” abilities

Sweating to keep cool Checking Blood Sugar Digesting Breakfast Raising “goose bumps” Pupils adjusting to sunlight Tears forming due to pollen Adjusting breathing rate Lowering heart rate


Systems : The Brain

The Brain ? “Cognitive” abilities


Systems : The Brain

May 3, 20239

If the brain doesn’t not work as expected ?


Systems

May 3, 202310

It’s the same for any Systems ! The System has to work as it has to work … at the speed of the brain

What happens if :

The System doesn't reach the expected speed ?

The System looses memory

The System has I/O bottlenecks

The System doesn’t store the data in the right location

The System is not able to process all needed data

…

…

The System is not designed for cognitive


Cognitive SYSTEMS Era

IA was born Pragmatism and Humble : The emergence of Machine Learning

Welcome to the Cognitive Era

1956 70s & 80s Today

© 2015 INTERNATIONAL BUSINESS MACHINES CORPORATION

Cognitive Business is poweredby IBM Watson.

Watson is a cloud-based, open platform of expanding cognitive capabilities. With Watson, you can build cognition into digital applications, products and operations.

12


Relationship Extraction

Questions&

Answers

LanguageDetection

PersonalityInsights

Keyword Extraction

Image LinkExtraction

Feed Detection

VisualRecognition

Concept Expansion

ConceptInsights

Dialog Sentiment Analysis

Text to Speech

Tradeoff Analytics

Natural LanguageClassifier

Author Extraction

Speech toText

Retrieve&

Rank

WatsonNews

LanguageTranslation

EntityExtraction

Tone Analyzer

ConceptTagging

Taxonomy

TextExtraction

MessageResonance

ImageTagging

FaceDetection

Answer Generation

Usage Insights

Fusion Q&A

Video Augmentation

Decision Optimization

Knowledge Graph

Risk Stratification

Policy Identification

Emotion Analysis

Decision Support

Criteria Classification

Knowledge Canvas

Easy Adaptation

Knowledge Studio Service

Statistical Dialog

Q&A Qualification

Factoid Pipeline

CaseEvaluation

13

IBM Watson

The Waston that competed on Jeopardy! in 2011 comprised what is now a single API—Q&A—built on five underlying technologies.

Since then, Watson has grown to a family of 28 APIs.

By the end of 2016, there will be nearly 50 Watson APIs—with more added every year.

Natural Language

Processing

Machine Learning

Question Analysis

Feature Engineering

Ontology Analysis

© 2015 INTERNATIONAL BUSINESS MACHINES CORPORATION 14

IBM Watson

These APIs are underpinned by 50 technologies:

Anaphoric Co-referencingColloquialism ProcessingContent Management -- VersioningConvolutional Neural NetworksCurationDeep LearningDialog FramingEllipsesEmbedded Table ProcessingEnsembles and FusionEntity ResolutionFactoid AnsweringFeature Engineering

Feature NormalizationFocus and Spurious Phrase ResolutionHTML Page AnalysisImage ManagementInformation RetrievalKnowledge (Property) GraphsKnowledge AnsweringKnowledge Extraction AnnotatorsKnowledge Validation and ExtrapolationLanguage ModelingLatent Semantic Analysis

Learn To RankLinguistic AnalysisLogical Reasoning AnalysisLogistical RegressionMachine LearningMulti-Dimensional ClusteringMultilingual trainingn-Gram Analysis (word combinations and distance)Ontology AnalysisPareto AnalysisPassage AnsweringPDF ConversionPhoneme Aggregation

Question AnalysisQuestion-answering Reasoning StrategiesRecursive Neural NetworksRules ProcessingScalable SearchSimilarity AnalyticsStatistical Language ParsingSupport Vector MachinesSyllable AnalysisTable AnsweringVisual AnalysisVisual RenderingVoice Synthesis

© 2015 INTERNATIONAL BUSINESS MACHINES CORPORATION 15

IBM Watson

These technologies draw onfive distinct fields of study:

Big Data &AnalyticsData Mining,Optimization,Text Analytics

Artificial IntelligenceMachine Learning, Natural Language Processing, Algorithms & Theory

Cognitive ExperienceHCI, Speech, Translation, Machine Vision, Visualization

Cognitive KnowledgeKnowledge Representation, Ontologies, Semantics, Context

Computing InfrastructureHigh Performance Computing, Distributed Systems, Programming Models & Tools

Architecting the future with IT infrastructure for the cognitive era

The IBM point-of-view on IT infrastructure for the cognitive eraJuly 2016

IBM Systems | 17

of CEOs feel technological disruption is making them reassess strategic direction“We see the business models changing as a result of the creative use of new technologies.”

-Eelco Blok, CEO, KPN, Netherlands1

of global business leaders say that a substantial part of their revenue is at risk from technology shifts2

52%

67%

Technology is the most important external influence among the C-Suite today

Source: 1) IBM Institute for Business Value, Redefining Competition, Insights from the Global C-suite Study – The CEO Perspective, 2015Source: 2) Harvard Business Review Analytic Services, The Ecosystem Equation: Competing in the Connected Economy, 2016

Organizations struggle with key technology challenges supporting insights, change, and speed

Understanding Data

Digital intelligence is a primary competitive advantage

Yet 88% of all data today is unstructured and invisible to computers1

“The next wave will be all about connecting dots and correlating data to produce actionable insights.” –CIO, Retail, United States2

Keeping Pace

Superior technology delivers superior performance

Yet the pace of innovation (72%) is now the top CEO challenge, even greater than security (66%)3

“Disruptive technologies could change the fundamentals of our business” –Kazuo Hirai, CEO, Sony Corporation, Japan4

Accelerating Time-to-Market

Sustainable success is now measured in days, not weeks

Outperforming CxOs are 95% more likely to focus on being first to market4

“We’ve been charged with speeding up time-to-market, both for the products we sell and for our own internal tools.”⎯Kalev Reiljan, CIO, TeliaSonera, Finland2

Source: 1) IBM ResearchSource: 2) IBM Institute for Business Value, Redefining Connections, Insights from the Global C-suite Study – The CIO PerspectiveSource: 3) Fortune, Myth-busting the Fortune 500, 2015Source: 4) IBM Institute for Business Value, Redefining Boundaries: Insights from the Global C-Suite Study, 2015

IBM Systems | 18

IBM Systems | 19

Architects of the future require IT infrastructure that can do more than ‘just work’Servers and storage are no longer inanimate.

They can understand, reason, and learn.

Today, they can think.

Outthink status quo.Think IT infrastructure for thecognitive era.

Detect anomalies to proactively

resolve issues

Move data to right location

based on usage patterns

IBM Systems | 20

IT infrastructure for the cognitive era means thinking differently about how you design, build, and deliver services

Design for Cognitive Business

Act at the speed of thought

Gives meaning to unstructured data and can perform

when the window of action is milliseconds.

Build withCollaborative

Innovation

Deliver through Cloud

PlatformAccelerate technology

breakthroughs

Takes advantage of perpetual motion for what is still unknown

yet possible with future innovations.

Extend the value of systems and data

Extends existing business

investments to integrate with the

ecosystem and accelerate innovation.

IBM Systems | 21

Design for Cognitive Business

IBM Systems | 22

Designing for cognitive business means thinking differently about analytics acceleration and data centric design

Solve complex business problems faster than competitors?

Deliver better decisions by taking advantage of oceans of data?

Analytics acceleration to deliver the fastest insights with infrastructure designed specifically for complex analytics and machine learning

Data centric design to capture the largest variety and volume of data while efficiently locating data and applications in the right place

How do I?

IBM Systems | 23

Leading USHealthcare SystemsAccelerated the sequencing of 3.5 PB of human genome data by a factor of 10x for faster cancer diagnosis

Created real-time pricing models to speed decision making by increasing response times by 60x

Infrastructure in the cognitive era delivers ground-breaking research, faster cancer diagnostics and real-time pricing models

Allowed scientists to produce ground breaking research faster by accessing PB of data in minutes, not days

IBM Systems | 24

Key technologies to design for cognitive business

AnalyticsAcceleration

Servers designed specifically for cognitive with fast processors, accelerators, memory and interconnect technology

IBM Power Systems

Flash storage that delivers consistent, highly efficient and fast microsecond data delivery

IBM FlashSystem

Intelligent workload management to orchestrate computing resources to solve the most challenging workloads

IBM Spectrum Computing

Data CentricDesign

Unified data access to file and object-based storage that scales up to petabytes of data and billions of files

IBM Spectrum Scale

Automatic, cognitive-based data management to optimize storage costs and application performance

IBM Spectrum Control

Run analytics applications next to the data or within the transaction to deliver real-time insights

IBM z Systems with IBM DB2 Analytics Accelerator

IBM Systems | 25

Design for cognitive business with IBM Systems

IBM Systems | 26

Build withCollaborativeInnovation

IBM Systems | 27

Building with Collaborative Innovation means thinking differently about open technologies and choice

Optimize my services to support the dynamic needs of the business?

Accelerate adoption of the latest technology advances without risk?

Innovating with open technologies to deliver new solutions faster to market through community collaboration in support of a shared visionChoice for optimization to select the right platforms, runtimes and deployment models required of the workload

How do I?

IBM Systems | 28

Key technologies to build with collaborative innovation

Innovate with Open Technologies

Open systems design and ecosystem to customize solutions to meet unique business needsThe OpenPOWER Foundation and

POWER CPU Architecture

Infrastructure that combines attributes of Linux and open communities with the best of enterprise computing

IBM LinuxONE

Systems optimized for blockchain with advanced cryptography, transaction processing and integration

IBM z Systems

Key technologies to build with collaborative innovation

IBM z Systems Spark Demo: A Use Case Demo

IBM Systems | 30

Build with Collaborative Innovation with IBM Systems

IBM Systems | 31

Deliver throughCloud Platform

IBM Systems | 32

Delivering through Cloud Platforms means thinking differently about securely opening up and controlled iteration at scale

Open up to partners while protecting data from unauthorized users?

Accelerate response times and development cycles at scale?

The ability to securely open up to enable partners to connect to your core systems and data while enhancing security to mitigate risk

Controlled iteration at scale to deliver microsecond performance and agile DevOps processes while supporting millions of users

How do I?

IBM Systems | 33

Key technologies to deliver through cloud platformSecurely

Open UpSecurely connect cloud services to core business assets through APIs to extend the value of data and systems

IBM z Systems with z/OSConnect, IBM Power Systems

with API Connect

Enable complete workload isolation and deliver high-speed encryption to protect data without sacrificing performance

IBM z Systems, IBM LinuxONE

Provide encryption down to the chip, transaction and file-level for highly sensitive data

IBM z Systems, IBM Spectrum Scale

Deliver microsecond response times for mobile applications to exceed customer expectations for immediate service

IBM z Systems,IBM LinuxONE

Support billions of web interactions, millions of transactions and billions of files for continuous service

IBM z Systems, IBM LinuxONE,IBM Spectrum Scale

Invest in enterprise DevOps processes and tools to improve quality and reduce risk in application development

IBM z Systems withEnterprise DevOps

Controlled Iteration at

Scale

IBM Systems | 34

Deliver through cloud platform with IBM Systems

IBM Systems | 35

Infrastructure: New Computing Frontiers

cognitive storage

SyNAPSE quantum computing


@VasquesXavier