c2_1547

34
© 2014 IBM Corporation 日本アイ・ビー ソフトウ C-2 Hadoopは何に使えるのか。  これからどこへ向かうのか。  

Upload: hython

Post on 13-Oct-2015

14 views

Category:

Documents


0 download

DESCRIPTION

IBM Software XCITE Spring 2014

TRANSCRIPT

  • 2014 IBM Corporation

    C-2

    Hadoop

  • 2 2014 IBM Corporation

    Hadoop Hadoop Hadoop

    BigInsights IBMHadoop

  • 3 2014 IBM Corporation

    WHAT IS HADOOP Hadoop

  • 4 2014 IBM Corporation

    Hadoop HadoopHDFS

    Java

    MapReduce

    Hadoop

    HiveHbaseScoop

    3

    x86

  • 5 2014 IBM Corporation

    Hadoop

    1

  • 6 2014 IBM Corporation

    Hadoop

    Hadoop

    2 SQL Hadoop5 100TB

    SQL 20

  • 7 2014 IBM Corporation

    Hadoop

    GB HDFS

    IO

    MapReduce

    HDFSMapReduce

    Hadoop

  • 8 2014 IBM Corporation

    RDBMSHadoop RDBMS Hadoop

    Update Update OLTP

  • 9 2014 IBM Corporation

    InfoSphere Streams

    /

    DB DWH

    DB/DWH

    InfoSphere BigInsights (Hadoop)

    &

    &

    &

    &

    PureData Systems for Analytics Netezza

  • 10 2014 IBM Corporation

    HOW TO SUCCESS WITH HADOOP Hadoop

  • 11 2014 IBM Corporation

    Email

    Capabilities

    InfoSphere BigInsights, IBM PureData for Analytics powered by Netezza technology, Cognos BI

    Need 350Email

    Benefits 40

    Email15-25%

    ConstantContact

  • 12 2014 IBM Corporation 12 12

    Vestas 2.5PB

    Vestas Wind Systems 2030

    Need

    Benefits

    IT 2.5PB

    6PB

    Vestas

  • 13 2014 IBM Corporation

    Hadoop

    ETL

    Modeling

    Scoring

    BI/Reporting

  • 14 2014 IBM Corporation

    Information Server , MDM, Guardium , Optim

    Streams, Data Replication

    BigInsights

    PureData System for

    Hadoop

    DB2, Informix

    PureData System for

    Transactions

    PureData System for Analytics

    DB2 BLU PureData

    System for Analytics

    SPSS MODELER

    COGNOS BI COGNOS TM1

    SPSS MODELER GOLD

    WATSON EXPLORER

  • 15 2014 IBM Corporation

    BUSINESS ENV OF HADOOP Hadoop

  • 16 2014 IBM Corporation

    Hadoop

    HDFS

    RDBHadoopSQLHadoop2

    Analytics

  • 17 2014 IBM Corporation

    IBM InfoSphere BigInsights

    HDFS GPFS-FPO

    GUI

    RDBHadoopSQLHadoop2 BigSQL

    Analytics Watson Explorer RBigR

    BI/Streams/ETL

  • 18 2014 IBM Corporation

    Forrester WaveIBM Hadoop

    Areas where IBM had or tied for highest score

    Score 0 (weak) to 5 (strong)

    Data and Processing

    4.5

    Setup, management and monitoring tools

    5.0

    Strategy 4.7

    Licensing & Pricing 3.0

    Ability to Execute 5.0

    Product road map 5.0

    Customer support 5.0

    Source: Forrester Research, Inc.

    FORRESTER

  • 19 2014 IBM Corporation

    DETAIL OF BIGINSIGHTS BigInsights

  • 20 2014 IBM Corporation

    BigInsights

    IBM Open Source

    Visualization & Discovery Data Ingest

    Cluster Optimization and Management Streams

    Netezza

    Nutch

    DB2

    DataStage

    IBM InfoSphere BigInsights

    Runtime

    Analytics Engines

    File System

    MapReduce

    HDFS

    Data Store HBase

    Text Processing Engine and Extractor Library (AQL+HIL)

    JDBC

    Application Support and Development Tooling

    App infrastructure

    MapReduce Pig Hive

    Splittable Text Compression

    ZooKeeper High Availability

    Integrated Installer Admin Console

    Sqoop

    SystemML

    Eclipse Big SQL

    Security

    HCatalog

    R

    Gnip

    BoardReader

    GPFS-FPO Guardium

    Flume

    Jaql

    Avro

    BigSheets

    Dashboard /

    visualization

    Data Explorer Lucene Oozie

    PAM

    LDAP

    Private firewall

    Derby

    Adaptive MapReduce Enhanced Monitoring

    Teradata

  • 21 2014 IBM Corporation

    Adaptive MapReduce

    Apache MapReduce

    TaskTracker

    IBM Platform SymphonyHadoopMapReduce

    Apache MR Adaptive MR

    Java C Java

    Polling push

    / /

  • 22 2014 IBM Corporation

    BigSheets Hadoop

    Excel

    CSVExport

  • 23 2014 IBM Corporation

    BigSQL HadoopANSISQL

    ANSI Joins, unions, aggregates . . . VARCHAR, decimal, TIMESTAMP, . . .

    JDBC/ODBC

    Prepared statements Cancel Database metadata API Secure socket connections (SSL)

    MapReduce

    Local

    HiveHbase

    Eclipse DB2, Netezza, Teradata, etc. (via LOAD) Cognos Business Intelligence , , ,

  • 24 2014 IBM Corporation

    1. R BigInsightsBig R

    2. R R JaqlMap/ReduceR

    R

    scalable statistics engine R

    IBM BigInsights v2.1.2R

    BigR HadoopR

  • 25 2014 IBM Corporation

    IBM InfoSphere Data Explorer (Vivisimo) &

    InfoSphere Streams :

    InfoSphere Guardium :

    Netezza : UDFJOIN

    Cognos Business Intelligence & : BIHive

    InfoSphere BigInsights

    Hadoop

    InfoSphere DataStage ETL

    Platform Computing :

    R : WebR

    DB2 and JDBC DB2JDBC

    WebSphere : WAS 8.5 Liberty

    Rational & Data Studio RAD RTCData Studio

    BigInsights

  • 26 2014 IBM Corporation

    PUREDATA SYSTEMS FOR HADOOP IBMHadoop

  • 27 2014 IBM Corporation

    IBM BigInsights + H/W = PureData System for Hadoop

    IBM

    System for Hadoop

    Hadoop

  • 28 2014 IBM Corporation

    PureData System for Hadoop: 18CPU216 216TBHDFS1PB

  • 29 2014 IBM Corporation

    CPU

    Web

  • 30 2014 IBM Corporation

    DWHGUI HadoopImport/Export

    Map/Reduce Processing

    PureData System for Analytics

    PureData System for Hadoop

    EasyArchive Import/Export

    NPS Host

    Import From NPS

    Export to NPS

    HDFS (Hive) NPS Tables

  • 31 2014 IBM Corporation

    Hadoop

    Hadoop

    HadoopRDBRDB

    Hadoop

    IBMANSISQLRBI

    DWH

  • 32 2014 IBM Corporation

    BigData/DWH/Netezza Technical Sales IBM Software | Information Mgmt.

    IBM Japan, Ltd. 19-21, Nihonbashi Hakozaki-cho Chuo-ku, Tokyo 103-8510 Japan

    Tel 81 80 6706 2752 [email protected]

  • 33 2014 IBM Corporation

  • 34 2014 IBM Corporation

    IBMIBM IBMIBM IBMIBMIBM IBM IBM IBMIBM ibm.com CognosBIDB2InformixInfoSphereGuardiumOptimPureDataRationalSPSSInternational Business Machines Corporation IBM IBM www.ibm.com/legal/copytrade.shtml

    HadoopWhat is HadoopHadoopHadoopHadoopHadoopRDBMSHadoop 9How to success with Hadoop 11 12Business env of HadoopHadoopIBM InfoSphere BigInsightsForrester WaveIBM Hadoopdetail of biginsightsBigInsights Adaptive MapReduceBigSheetsHadoopBigSQLHadoopANSISQLBigRHadoopRBigInsights Puredata systems for hadoopIBM BigInsights + H/W = PureData System for HadoopPureData System for Hadoop:DWHGUIHadoopImport/Export 32 33 34