grid computing for financial services

Grid Computing for

Financial Services

Steve Conn, Sales Development Manager at Intel

Yinal Ozkan, Financial Services Technology Leader at AWS

April 14, 2016

Motivations for Cloud in a Simulation-Driven World

Scalability and agility

Secure global collaboration

Enterprise data governance

Agility Is Enabled by Global Scale

Over 1 million active customers across 190 countries

800+ government agencies

3,000+ educational institutions

12 regions

33 availability zones

54 edge locations

HPC Today

1965-2015: 50 Years of Moore’s Law

The Rise of the Microprocessor

† Codename Knights Landing, not drawn to scale

28MTIMES FASTER

Intel® 4004 (1971)10,000nm, 2300 Transistors

92 KOPS

Intel® Xeon

Phi™(2015)†

14nm 3D Tri-Gate, >8B Transistors

3 TFLOPS (peak DP-F.P.)

Supercomputing Pulls All HPC Along

Source: Top500.org

’90 ’95 ’00 ’05 ’10 ’15 ’20 ’25

1,000,000,000

10,000,000

100,000

Top Machine

500th Machine

Sum of All

Top 500 FLOPS >50%1 CAGR For Past Decade

#500 system on Top 500 in 2005:

~1 TFLOP

10 years later…

…One 2S Xeon server today:

~1 TFLOP

Capability Waterfalls

Source: Intel

HPC Fuels Insight and Innovation

Astrophysics

ManufacturingEnergy

Security

FinancialLife Sciences

Weather

Source: www.hpcwire.com/2014/01/02/top-supercomputing-discoveries-2013/

HPC Today: Two (Connected) Worlds

Supercomputing

The “rest” of HPC

Intel Cloud Edition for Lustre Software

Innovate Faster. Experiment Risk-Free • Enterprises are adopting HPC clouds…

• To increase and augment legacy infrastructure

• Aggregates capacity and I/O bandwidth

• Brings Lustre performance to dynamic cloud resources

• Instant, pay-as-you-go access to scalable clustered

storage

• Available today from Amazon Web Services

• Support directly from Lustre experts at Intel

Big Data

Cloud Edition for Lustre Client Cluster &

Lustre Cluster Model

Performance

• The Intel Lustre solution is a fast,

scalable storage platform positioned to

accelerate application performance,

even with complex workloads.

• Intel Cloud Edition for Lustre software is

an ideal foundation for SAS Grid

workloads that require fast, scalable, and

cost-effective storage. 0

4 OSS 8 OSS 16 OSS

OSS Write / Read Scaling

Write MB/s Read MB/s

Grid Computing on AWS

Our Pricing Structure

On-Premise (or “Private Cloud”)

The New Way

Use only what you need,

using on-demand, reserved, or spot

Flexible

The Old Way

High upfront capital cost,

high cost of ongoing support

Inflexible

AWS lets you pay for the grid infrastructure you need, when

you need it.

The Old Way – Low Utilization, High Costs

Typical service utilization rates are low due to need to deploy

for peak needs…

The Old Way – Managing Utilization with Grid

Higher grid utilization rates result in hidden costs, such as

longer queue wait times and delayed results.

The High Cost of Queues for Grid Computing

Conflicting goals

• Grid users seek fastest possible time-to-results

• Grid workloads are not steady-state

• IT support teams seek highest possible utilization

Result

• The job queue becomes the capacity buffer

• Job completion times are hard to predict

• Users are frustrated and run fewer jobs

• Innovation is throttled by IT resources

The World According to Central IT

Grid utilization over one week

The World According to Business Lines

Queue wait times over one week

Business

impact!

The Cloud Way – Scalability When Needed

Scale higher to reduce time-to-results: shorter wait times,

greater agility, and faster innovation cycles.

In a secure Virtual Private Cloud

Automation and Auto Scaling allows easier

grid management and monitoring

AWS Enables Lower TCO than On-Premise

Utilization fundamentally higher in

AWS cloud

• Aggregating non-correlated

workloads, scale, spot market

Amazon specific hardware designs

• Amazon custom servers & network

• Direct purchasing of disk, memory,

AWS Immense scale

• New data centers built each year

• 12 global regions, 33availability

• Volume purchasing with highly

automated, highly optimized supply

chainTraditional

Data Center

Virtualized

Data Center

UPFRONT

VARIABLECOSTS

VARIABLE COSTS

UPFRONT

VARIABLE COST

Cost savings from running

internal IT more efficiently

Cost savings from moving to a

public cloud provider

Customer Spotlight: FINRA

Customer Spotlight: Dow Jones International

• From over 40 data centers down to 6

• Planning to migrate 3000 apps by 2015

• Saving $100M over 3 Years

1. Evaluate infrastructure

costs & architecture

2. Make business case 3. Enable decision to

move to the cloud

Multiple Consumption Models

On-Demand

Pay for compute

capacity by the hour

with no long-term

commitments

For spiky workloads,

or to define needs

Reserved

Make a low, one-time

payment and receive

a significant discount

on the hourly charge

For committed

utilization

Bid for unused

capacity, charged at a

Spot Price which

fluctuates based on

supply and demand

For time-insensitive or

transient workloads

Spot is a

game-changer

for grid

computing.

Reserved Instances

On-demand

Optimizing AWS Spending with RI, On-Demand,

All-In on Spot: Advertising Technology Company

Minimal use of RI

and on-demand, for

persistent database

tiers.

Use-case is time-critical

bid-for-placement

advertising analytics.

Spot is used by this customer for a wide range of use-cases, including

Hadoop analytics and test/dev. Customer has implemented automation to

reduce impact of Spot terminations.

Fully Optimized:

Enterprise SaaS Solutions Provider

3-Year RI

On-Demand $

Spot $

1-Year RI

3-Year RI

1-Year RI 1-Year RI

1-Year RI 1-Year RI 1-Year RI

Price reductions

New instance types

Optimization

Performance

Optimization

Reduced Spending Over Time for Increasing

Performance

Proactive Cost Optimization with Trusted Advisor

AWS is more cost-effective than on-premises environments in both the short-term and long-

term, and at scale, for both variable and steady-state workloads, while also delivering return on

agility and enabling new experiences.

In Summary

Thank you!

Steve Conn, Sales Development Manager at Intel

Yinal Ozkan, Financial Services Technology Leader at AWS

grid computing for financial services

Technology

grid computing - aau 14/11-051 grid computing josva kleist...

grid computing cloud computing

gc3: grid computing competence center · gc3: grid...

bob thome senior manager, grid computing enterprise grid...

grid computing ali yildirim emre uzuncakara. agenda what is...

financial services grid omputing on amazon web services ·...

grid computing now! making the case for grid computing

worldwide lhc computing grid · 2018. 11. 16. · worldwide...

grid computing grid systems and scheduling grid computing...

grid computing for financial services-+grid+computing… ·...

the worldwide lhc computing grid -...

financial services grid computing on amazon web services ·...

grid computing