101 ab 1445-1515
DESCRIPTION
TRANSCRIPT
© Copyright 2012 EMC Corporation. All rights reserved.
ACCELERATE SUCCESS IN THE NEW WORLD OF
BIG DATA EMC Isilon Scale-Out Storage
© Copyright 2012 EMC Corporation. All rights reserved.
大資料的定義
AWS(亞馬遜網路服務):任何超過了一台電腦處理能力的龐大資料量。
– 大資料是最大的宣傳技術、是最時髦的技術,當這種現象出現時,定義就變得很混亂。
– 三大挑戰:大資料使用的三個術語都含有字母“V”:volume(數據量大),velocity(數據增長速度快)和variety(數據種類繁多).
– 第四個V:vendor
大資料不是關於如何定義,最重要的是如何使用 – 最大的挑戰在於哪些技術能更好的使用資料
– 大數據的應用情況如何
– 不是IT部門發現大資料,而是業務部門。
© Copyright 2012 EMC Corporation. All rights reserved.
大資料處理特點
它能處理幾乎各種類型的海量資料,無論是微博、文章、電子郵件、文檔、音訊、視頻,還是其它形態的資料。
它工作的速度非常快速:實際上幾乎即時。
它具有普及性:因為它所用的都是最普通低成本的硬件
事實上大資料處理並非一項新的技術,它僅僅是小部分技術的一個術語簡稱。其中的某些技術已經與我們生活了數度春秋,然而時間推移到2012年,其中更小的部分技術就讓大資料一下子火了起來。
© Copyright 2012 EMC Corporation. All rights reserved.
Sources: “How Much Information?” Peter Lyman and Hal Varian, UC Berkeley,. 2011 IDC Digital Universe Study.
IN 2000 THE WORLD GENERATED
TWO EXABYTES OF NEW INFORMATION
© Copyright 2012 EMC Corporation. All rights reserved.
Sources: “How Much Information?” Peter Lyman and Hal Varian, UC Berkeley,. 2011 IDC Digital Universe Study.
IN 2000 THE WORLD GENERATED
TWO EXABYTES OF NEW INFORMATION
EVERY DAY
© Copyright 2012 EMC Corporation. All rights reserved.
In 2012, 80% Of New Storage
Capacity Installed Will Be For
FILE-BASED DATA
Source: IDC, 2011
© Copyright 2012 EMC Corporation. All rights reserved.
Big Data World…Requirements
OPERATIONAL SIMPLICITY
HIGH EFFICIENCY
HIGH PERFORMANCE
MASSIVE SCALE
Big Data
© Copyright 2012 EMC Corporation. All rights reserved.
Enterprise IT World…Requirements
PREDICTABLE PERFORMANCE
INTEROPERABILITY DATA
PROTECTION
DATA SECURITY
Enterprise IT
© Copyright 2012 EMC Corporation. All rights reserved.
These Two Worlds are Converging
Enterprise IT
Big Data
Scale-Out IT
© Copyright 2012 EMC Corporation. All rights reserved.
Typical Scale-Out IT Applications
VIRTUALIZED EVERYTHING
LARGE-SCALE ANALYTICS
HIGH PERFORMANCE
ARCHIVES
MASSIVE HOME DIRECTORIES
Scale-Out IT
© Copyright 2012 EMC Corporation. All rights reserved.
All Data Faster Answers Elastic & Scalable 1
The Journey To Big Data
Big Data Infrastructure Technology Focus
Analytics Engines
Cloud Infrastructure
Analytic Engines
© Copyright 2012 EMC Corporation. All rights reserved.
All Data Faster Answers Elastic & Scalable 1
The Journey To Big Data
2 Data Science Collaboration Self-Service
Agile Analytics People & Productivity Focus
Analytic Productivity Platform
Agile Process & Tools
Big Data Infrastructure Technology Focus
Analytics Engines
Cloud Infrastructure
Analytic Engines
© Copyright 2012 EMC Corporation. All rights reserved.
All Data Faster Answers Elastic & Scalable 1
The Journey To Big Data
2 Data Science Collaboration Self-Service
Agile Analytics People & Productivity Focus
Analytic Productivity Platform
Agile Process & Tools
Big Data Infrastructure Technology Focus
Analytics Engines
Cloud Infrastructure
Analytic Engines
© Copyright 2012 EMC Corporation. All rights reserved.
Old Analytic Processes
Administrator Bottleneck
Opaque, No Collaboration
Reactive, Unresponsive
© Copyright 2012 EMC Corporation. All rights reserved.
Shouldn’t Collaboration Work More Like Facebook ? (purchased 28P isilon)
© Copyright 2012 EMC Corporation. All rights reserved.
Iterative, Agile
Self-Service
Transparent, Real Time Collaboration
New Analytic Processes Are Different
© Copyright 2012 EMC Corporation. All rights reserved.
The Organization Must Evolve From This…
Line Of Business User
Business
I.T. Department
Database Administrator
Business Intelligence Analyst
© Copyright 2012 EMC Corporation. All rights reserved.
To A Data Science Team
Line Of Business User
Data Platform Administrator
Business Intelligence Analysts
Data Scientists
© Copyright 2012 EMC Corporation. All rights reserved.
All Data Faster Answers Elastic & Scalable 1
The Journey To Big Data
2 Data Science Collaboration Self-Service
Agile Analytics People & Productivity Focus
Analytic Productivity Platform
Agile Process & Tools
3 Real Time Decisions New Applications Data Monetization
Predictive Enterprise Application Focus
Big Data Enabled Apps
Big Data Infrastructure Technology Focus
Analytics Engines
Cloud Infrastructure
Analytic Engines
© Copyright 2012 EMC Corporation. All rights reserved.
All Data Faster Answers Elastic & Scalable 1
The Big Data Stack
2 Data Science Collaboration Self-Service
Agile Analytics People & Productivity Focus
3 Real Time Decisions New Applications Data Monetization
Predictive Enterprise Application Focus
Big Data Infrastructure Technology Focus
Self-Service(互動,共用式) Iterative, Agile Transparent, Real-time Collaboration
Predictions Built-In Data At The Point Of Decision Scale Big Data Insights (即時展現)
Analytic Productivity Platform
Agile Process & Tools
Big Data Enabled Apps
Analytics Engines
Cloud Infrastructure
Analytic Engines Structured & Unstructured Data Analyze Petabytes Of Current Data Virtual, Scale Out Architecture 易擴展(容量,性能),易管理,安全 提供多種資料介面方式
© Copyright 2012 EMC Corporation. All rights reserved.
Your Approach To Enterprise Storage Must Change
Big Data Apps Require Big Data Storage
Storage Islands
More Capacity, More Admins
Performance Optimization “Whack-A-Mole”
One Storage Pool To 10+PB
More Capacity, Same Admins
Linear Performance Scalability
Scale Up, Manual Scale Out, Automated
© Copyright 2012 EMC Corporation. All rights reserved.
The EMC Isilon Advantage For The World Of Big Data
Scales To Over 15 PB In A Single File System
Single File System, Single Volume, Global Namespace
>80% Storage Utilization & Automated Storage Tiering
1.6 Million CIFS File Operations Per Second
© Copyright 2012 EMC Corporation. All rights reserved.
The EMC Isilon Advantage For The World Of Enterprise IT
Support For Industry-standard Protocols: NFS, SMB, HTTP, FTP And iSCSI;
World’s Only Scale-out Storage System With Native Hadoop HDFS Support
N+1 Through N+4 Redundancy; Efficient Snapshot Data Back-up and Restore; Rapid Data Replication for Disaster Recovery Protection
WORM Data Retention, RBAC, Authentication Zones
>100GB/second Throughput
© Copyright 2012 EMC Corporation. All rights reserved.
OneFS Scale-Out Operating System
EMC Isilon Core Innovation
© Copyright 2012 EMC Corporation. All rights reserved.
Linear Scaling Of Performance And Capacity
The Isilon Hardware Family Perf
orm
ance
Capacity
S-Series
PERFORMANCE
X-Series
FLEXIBILITY
NL-Series
CAPACITY
© Copyright 2012 EMC Corporation. All rights reserved.
Best-Of-Breed Capabilities For The Needs Of Scale-Out IT
Introducing OneFS “Mavericks”
PERFORMANCE
INTEROPERABILITY
DATA PROTECTION
DATA SECURITY
PERFORMANCE
MASSIVE SCALE
EFFICIENCY
OPERATIONAL SIMPLICITY
OneFS “Mavericks”
© Copyright 2012 EMC Corporation. All rights reserved.
Increase Productivity & Unlock New Opportunities
OneFS “Mavericks” Performance
50% Less Latency
724MB/s Single Stream
1.6M IO/s World’s Fastest NAS
106GB/s Concurrent
Big Data Performance
Throughput
Enterprise IT Performance
Random/IO Intensive
© Copyright 2012 EMC Corporation. All rights reserved.
New Snapshot Restore
Lower Risk For Business Critical Data
OneFS “Mavericks” Data Protection
Fast
Efficient
Simple
© Copyright 2012 EMC Corporation. All rights reserved.
Lower Risk For Business Critical Data
OneFS “Mavericks” Data Protection
New York London New One-Click Failover/Failback
Full SnapshotIQ™ Integration Identifies Changes
Improved RPO/RTO
For Business Continuance
Multi-Threaded, Multi-Node Scale-Out Replication
© Copyright 2012 EMC Corporation. All rights reserved.
Secure Separation
New Roles-Based Administration
Administration & Data Access Separated
Meets Enterprise Governance & Compliance Requirements
OneFS “Mavericks” Security
Secure Compliance
New Compliance SmartLock™
SEC 17a-4 Regulation
Secure Isolation
New Authentication Zones Legal
IT
Accounting
Marketing
Accounting Legal
IT Marketing
© Copyright 2012 EMC Corporation. All rights reserved.
Scale-Out NAS For Virtualization. Simplified Management.
OneFS “Mavericks” Application Integration
CIFS NFS
FTP HTTP
HDFS (Hadoop)
VAAI VASA
OneFS API
VAAI – Vstorage APIs For Array Integration
VASA – Vsphere APIs For Storage Awareness
Virtual Server Writeable Clones
Latency Improvements
New Levels of VMware integration
Simple
Platform OneFS REST API
Simplifies Management And Integration
3rd-Party Application Integration For Unique Value Proposition
Flexible
38 © Copyright 2012 EMC Corporation. All rights reserved.
For More Information Web: www.isilon.com/onefs-directions
Email: [email protected]
Blog: www.isilon.com/blog
Web: www.emc.com/bigdata