high performance data center computing using manageable distributed computing

23
Copyright © 2014 Juniper Networks, Inc. 1 High Performance Data Center Computing using Manageable Distributed Computing Andrew Bach, Chief Architect for Financial Services, Juniper Networks Lawrence Van Deusen II , Director – Networking Business Unit, Dimension Data Chicago Trading Show Thursday , June 4 th , 2015, 3:10 – 3:40

Upload: juniper-networks

Post on 31-Jul-2015

1.018 views

Category:

Business


1 download

TRANSCRIPT

Page 1: High performance data center computing using manageable distributed computing

Copyright © 2014 Juniper Networks, Inc. 1

High Performance Data Center Computing using Manageable Distributed Computing

Andrew Bach, Chief Architect for Financial Services, Juniper Networks

Lawrence Van Deusen II , Director – Networking Business Unit, Dimension Data

Chicago Trading Show

Thursday , June 4th, 2015, 3:10 – 3:40

Page 2: High performance data center computing using manageable distributed computing

Copyright © 2014 Juniper Networks, Inc. 2 Copyright © 2015 Juniper Networks, Inc.

Agenda

Redistribute Computing as a Solution

The Limitations Today

Automation in a distributed environment

The Challenges

Page 3: High performance data center computing using manageable distributed computing

Copyright © 2014 Juniper Networks, Inc. 3 Copyright © 2015 Juniper Networks, Inc.

Agenda

Redistribute Computing as a Solution

The Limitations Today

Automation in a distributed environment

The Challenges

Page 4: High performance data center computing using manageable distributed computing

Copyright © 2014 Juniper Networks, Inc. 4 Copyright © 2015 Juniper Networks, Inc.

• Requirement for long term retention of data

• Requirement to archive meta data

• Real time risk management is now required

• Requirement for precision timing

• Increasing focus on cyber security

• Time to market must be faster

• Product life time is shorting

• Margins are driving OPEX reduction

• Regulation is increasing the cost of business

• Technology is a strategic weapon

• Fueling the race to the triple crown of technology (0 cost, 0 latency, 0 time to market)

• Bandwidth demand continues to grow at >30% per year

• Rate of data growth is also increasing

• Analytics, automation, orchestration are critical

• Exchange trading floors continue to fade away

• Machine assisted trading dominates

• Heuristic trading based on hyper-contextual information is growing

• Risk assessment is now routinely based on massive near real time data bases

• Shared public/private cloud solutions

• Operational excellence is now table stakes

Regulatory Model is Driving Change

FSS is Evolving to a Commodity Industry

Technology Adoption is Accelerating to Meet Accelerating Business Needs

Business Model Continues to Evolve

Financial Services Sector (FSS) Challenges

Page 5: High performance data center computing using manageable distributed computing

Copyright © 2014 Juniper Networks, Inc. 5

Next Challenge – Heuristic Based TradingMarket data

feeds

News feeds

Social feeds

Streaming news video

Ticker Plant

Heuristic Processing

Heuristic Processing

Heuristic Processing

Heuristic Processing

Historical Data Base

Heuristic Processing

Human Oversight

and control

Execution Venues

Trade Plant

Page 6: High performance data center computing using manageable distributed computing

Copyright © 2014 Juniper Networks, Inc. 6 Copyright © 2015 Juniper Networks, Inc.

Agenda

Redistribute Computing as a Solution

The Limitations Today

Automation in a distributed environment

The Challenges

Page 7: High performance data center computing using manageable distributed computing

Copyright © 2014 Juniper Networks, Inc. 7

Slowing of Processor Speed

Gigahertz

Page 8: High performance data center computing using manageable distributed computing

Copyright © 2014 Juniper Networks, Inc. 8

Latency Reduction TrendsIndustry tracking to ≈ 450ns

Page 9: High performance data center computing using manageable distributed computing

Copyright © 2014 Juniper Networks, Inc. 9 Copyright © 2015 Juniper Networks, Inc.

Agenda

Redistribute Computing as a Solution

The Limitations Today

Automation in a distributed environment

The Challenges

Page 10: High performance data center computing using manageable distributed computing

Copyright © 2014 Juniper Networks, Inc. 10

Customer

Risk Management embedded in Data center

Switch

Symbol routing

embedded in Data center

Switch

Data pre/post processing

Customer

40% lessports Latencydown 50µS

Total Latency ≈100.0µSTrade Plant Size:≈ 60 Servers≈ 1000 Ports

Total Latency ≈150.0µSTrade Plant Size:≈ 100 Servers≈ 1500 Ports

A Different Approach: Distributed Computing for an Exchange Gateway Trade Plant

Page 11: High performance data center computing using manageable distributed computing

Copyright © 2014 Juniper Networks, Inc. 11

A Different Approach: Market Data Ticker Plant

Internal Users

Feed handler & publishing servers

Pub/sub server farm

Client subscriber servers

World Wide Market Data

Feeds

Internal Users

World Wide Market Data

Feeds

Feed handler & publishing in top of

rack switch

Pub/sub server farm

Client subscriber imbedded in top of

rack switch

Page 12: High performance data center computing using manageable distributed computing

Copyright © 2014 Juniper Networks, Inc. 12

Network Switch/Application Acceleration/Packet Forwarding Accelerator

PFE

Intel X86 , DDR3, SSD

HYPERVISOR

NETWORK OS

ACTIVE

NETWORK OS

STANDBYGUEST APPLICATION(S)

FPGA

Page 13: High performance data center computing using manageable distributed computing

Copyright © 2014 Juniper Networks, Inc. 13 Copyright © 2015 Juniper Networks, Inc.

At about 200 – 500NS for a reasonable switch

Need to focus on a different approach

Lower latency

Eliminate servers

Reduce network ports

Application can be embedded in

A VM in the switch

A FPGA in the data path of the switch

ASIC Packet forwarding engine (PFE)

The Race to Zero is Ending

Embed Application Snippets into the Switching Fabric

Embed Snippets at the Control or Data Plane of the Network

Compute-Integrated Networking The new way to reduce latency and cost.

Page 14: High performance data center computing using manageable distributed computing

Copyright © 2014 Juniper Networks, Inc. 14 Copyright © 2015 Juniper Networks, Inc.

• Processors and network switches are hitting natural limits

• To achieve a high performance infrastructure compute resource must be distributed

• Optimize computing in the server, NIC (FPGA), and data flow engines

• Architect compute resources across the data center - not just one place

Centralize Processing Where You Can, Distribute Where You Must

Impact on Compute and Network

Page 15: High performance data center computing using manageable distributed computing

Copyright © 2014 Juniper Networks, Inc. 15 Copyright © 2015 Juniper Networks, Inc.

Agenda

Redistribute Computing as a Solution

The Limitations Today

Automation in a distributed environment

The Challenges

Page 16: High performance data center computing using manageable distributed computing

Automation

Our networking Skills Transformation

Page 17: High performance data center computing using manageable distributed computing

Dimension Data today

2014 global

revenues of

USD 6.8 billion

73% of Global Fortune 100 and

59% of Global Fortune 500

are Dimension Data clients

Client-centric,

services-focused business

Extensive experience in

emerging markets

Over 25,000 employees with operations in

54 countries

across 5 regions

Over 6,000

clients across all industry sectors

Page 18: High performance data center computing using manageable distributed computing

accelerate your ambition 18Copyright © 2014 Dimension Data  

Evolving Networking skills

new products & services are software centric

clients are becoming dev centric

bus function abstracted from infrastructure through software

engineering skillsets switching to dev

Moving from configuration to policy management

Page 19: High performance data center computing using manageable distributed computing

Copyright © 2014 Dimension Data  

Evolving Networking skills challenge

Open APIs based on REST or other standards

Vendor APIs

Cisco OnePK

Standard Protocols

OpenFlow, Netconf

Virtual Overlays

VXLAN / NVGRE / STT

Data Centre Controller

WAN ControllerCampus

ControllerVirtual Overlay

Controller

Control Plane

Network services (FW, IPS, ADC, DDI, etc)

Data Plane

Automation ToolsOrchestration ToolsApplication Plane

NWBU business of the future

NWBU business today

New world with new skills, new language, new approach

Page 20: High performance data center computing using manageable distributed computing

Copyright © 2014 Dimension Data  

The Dimension Data Value proposition

The ability to build SDN applications

The experience working with OpenDaylight and OpenStack

The consulting services to evolve IT operational models

(business process)

Transforming from engineering to development

Page 21: High performance data center computing using manageable distributed computing

Copyright © 2014 Dimension Data  

Our Managed Cloud Platform network is

SDN-enabled

USD

20m SDN revenue in FY14

Contribution to and projects with

Broad SDN

project experience

NSX trained

engineers

30+ Investments in software

development and

lifecycle management

USD 1.5m investment in multi-vendor SDN labs

Our SDN capabilities have depth

Page 22: High performance data center computing using manageable distributed computing

Copyright © 2014 Dimension Data  

SDN development model Strategy definition, assist with business case and roadmap

Detailed Design & Migration Plan

Production SDN DeploymentScale out pilot environments

Evaluation LabWorking test environment

(simulators, cloud labs, vendor POCs)

SDN readiness assessment

Applications, Integration, operations, migration

Limited Scale Pilot and POC’s

Dimension Data packaged POC service

Dimension Data SDN Services

Page 23: High performance data center computing using manageable distributed computing

Lawrence Van Deusen IIDirector – Networking Business Unit212 560 7973Email: [email protected]

Andy BachChief Architect for Financial Services, Juniper Networks516-804-9500Email: [email protected]

Thank You