high performance data center computing using manageable distributed computing
TRANSCRIPT
Copyright © 2014 Juniper Networks, Inc. 1
High Performance Data Center Computing using Manageable Distributed Computing
Andrew Bach, Chief Architect for Financial Services, Juniper Networks
Lawrence Van Deusen II , Director – Networking Business Unit, Dimension Data
Chicago Trading Show
Thursday , June 4th, 2015, 3:10 – 3:40
Copyright © 2014 Juniper Networks, Inc. 2 Copyright © 2015 Juniper Networks, Inc.
Agenda
Redistribute Computing as a Solution
The Limitations Today
Automation in a distributed environment
The Challenges
Copyright © 2014 Juniper Networks, Inc. 3 Copyright © 2015 Juniper Networks, Inc.
Agenda
Redistribute Computing as a Solution
The Limitations Today
Automation in a distributed environment
The Challenges
Copyright © 2014 Juniper Networks, Inc. 4 Copyright © 2015 Juniper Networks, Inc.
• Requirement for long term retention of data
• Requirement to archive meta data
• Real time risk management is now required
• Requirement for precision timing
• Increasing focus on cyber security
• Time to market must be faster
• Product life time is shorting
• Margins are driving OPEX reduction
• Regulation is increasing the cost of business
• Technology is a strategic weapon
• Fueling the race to the triple crown of technology (0 cost, 0 latency, 0 time to market)
• Bandwidth demand continues to grow at >30% per year
• Rate of data growth is also increasing
• Analytics, automation, orchestration are critical
• Exchange trading floors continue to fade away
• Machine assisted trading dominates
• Heuristic trading based on hyper-contextual information is growing
• Risk assessment is now routinely based on massive near real time data bases
• Shared public/private cloud solutions
• Operational excellence is now table stakes
Regulatory Model is Driving Change
FSS is Evolving to a Commodity Industry
Technology Adoption is Accelerating to Meet Accelerating Business Needs
Business Model Continues to Evolve
Financial Services Sector (FSS) Challenges
Copyright © 2014 Juniper Networks, Inc. 5
Next Challenge – Heuristic Based TradingMarket data
feeds
News feeds
Social feeds
Streaming news video
Ticker Plant
Heuristic Processing
Heuristic Processing
Heuristic Processing
Heuristic Processing
Historical Data Base
Heuristic Processing
Human Oversight
and control
Execution Venues
Trade Plant
Copyright © 2014 Juniper Networks, Inc. 6 Copyright © 2015 Juniper Networks, Inc.
Agenda
Redistribute Computing as a Solution
The Limitations Today
Automation in a distributed environment
The Challenges
Copyright © 2014 Juniper Networks, Inc. 7
Slowing of Processor Speed
Gigahertz
Copyright © 2014 Juniper Networks, Inc. 8
Latency Reduction TrendsIndustry tracking to ≈ 450ns
Copyright © 2014 Juniper Networks, Inc. 9 Copyright © 2015 Juniper Networks, Inc.
Agenda
Redistribute Computing as a Solution
The Limitations Today
Automation in a distributed environment
The Challenges
Copyright © 2014 Juniper Networks, Inc. 10
Customer
Risk Management embedded in Data center
Switch
Symbol routing
embedded in Data center
Switch
Data pre/post processing
Customer
40% lessports Latencydown 50µS
Total Latency ≈100.0µSTrade Plant Size:≈ 60 Servers≈ 1000 Ports
Total Latency ≈150.0µSTrade Plant Size:≈ 100 Servers≈ 1500 Ports
A Different Approach: Distributed Computing for an Exchange Gateway Trade Plant
Copyright © 2014 Juniper Networks, Inc. 11
A Different Approach: Market Data Ticker Plant
Internal Users
Feed handler & publishing servers
Pub/sub server farm
Client subscriber servers
World Wide Market Data
Feeds
Internal Users
World Wide Market Data
Feeds
Feed handler & publishing in top of
rack switch
Pub/sub server farm
Client subscriber imbedded in top of
rack switch
Copyright © 2014 Juniper Networks, Inc. 12
Network Switch/Application Acceleration/Packet Forwarding Accelerator
PFE
Intel X86 , DDR3, SSD
HYPERVISOR
NETWORK OS
ACTIVE
NETWORK OS
STANDBYGUEST APPLICATION(S)
FPGA
Copyright © 2014 Juniper Networks, Inc. 13 Copyright © 2015 Juniper Networks, Inc.
At about 200 – 500NS for a reasonable switch
Need to focus on a different approach
Lower latency
Eliminate servers
Reduce network ports
Application can be embedded in
A VM in the switch
A FPGA in the data path of the switch
ASIC Packet forwarding engine (PFE)
The Race to Zero is Ending
Embed Application Snippets into the Switching Fabric
Embed Snippets at the Control or Data Plane of the Network
Compute-Integrated Networking The new way to reduce latency and cost.
Copyright © 2014 Juniper Networks, Inc. 14 Copyright © 2015 Juniper Networks, Inc.
• Processors and network switches are hitting natural limits
• To achieve a high performance infrastructure compute resource must be distributed
• Optimize computing in the server, NIC (FPGA), and data flow engines
• Architect compute resources across the data center - not just one place
Centralize Processing Where You Can, Distribute Where You Must
Impact on Compute and Network
Copyright © 2014 Juniper Networks, Inc. 15 Copyright © 2015 Juniper Networks, Inc.
Agenda
Redistribute Computing as a Solution
The Limitations Today
Automation in a distributed environment
The Challenges
Automation
Our networking Skills Transformation
Dimension Data today
2014 global
revenues of
USD 6.8 billion
73% of Global Fortune 100 and
59% of Global Fortune 500
are Dimension Data clients
Client-centric,
services-focused business
Extensive experience in
emerging markets
Over 25,000 employees with operations in
54 countries
across 5 regions
Over 6,000
clients across all industry sectors
accelerate your ambition 18Copyright © 2014 Dimension Data
Evolving Networking skills
new products & services are software centric
clients are becoming dev centric
bus function abstracted from infrastructure through software
engineering skillsets switching to dev
Moving from configuration to policy management
Copyright © 2014 Dimension Data
Evolving Networking skills challenge
Open APIs based on REST or other standards
Vendor APIs
Cisco OnePK
Standard Protocols
OpenFlow, Netconf
Virtual Overlays
VXLAN / NVGRE / STT
Data Centre Controller
WAN ControllerCampus
ControllerVirtual Overlay
Controller
Control Plane
Network services (FW, IPS, ADC, DDI, etc)
Data Plane
Automation ToolsOrchestration ToolsApplication Plane
NWBU business of the future
NWBU business today
New world with new skills, new language, new approach
Copyright © 2014 Dimension Data
The Dimension Data Value proposition
The ability to build SDN applications
The experience working with OpenDaylight and OpenStack
The consulting services to evolve IT operational models
(business process)
Transforming from engineering to development
Copyright © 2014 Dimension Data
Our Managed Cloud Platform network is
SDN-enabled
USD
20m SDN revenue in FY14
Contribution to and projects with
Broad SDN
project experience
NSX trained
engineers
30+ Investments in software
development and
lifecycle management
USD 1.5m investment in multi-vendor SDN labs
Our SDN capabilities have depth
Copyright © 2014 Dimension Data
SDN development model Strategy definition, assist with business case and roadmap
Detailed Design & Migration Plan
Production SDN DeploymentScale out pilot environments
Evaluation LabWorking test environment
(simulators, cloud labs, vendor POCs)
SDN readiness assessment
Applications, Integration, operations, migration
Limited Scale Pilot and POC’s
Dimension Data packaged POC service
Dimension Data SDN Services
Lawrence Van Deusen IIDirector – Networking Business Unit212 560 7973Email: [email protected]
Andy BachChief Architect for Financial Services, Juniper Networks516-804-9500Email: [email protected]
Thank You