spark in the hadoop ecosystem-(mike olson, cloudera)

Download Spark in the Hadoop Ecosystem-(Mike Olson, Cloudera)

Post on 16-Aug-2015

615 views

Category:

Data & Analytics

0 download

Embed Size (px)

TRANSCRIPT

  1. 1. 1Cloudera,Inc.Allrightsreserved. MikeOlson|co-founderandchiefstrategyocer SparkintheHadoopEcosystem
  2. 2. 2Cloudera,Inc.Allrightsreserved. Hadoop:FromMapReducetoanEnterpriseDataHub Hadoopdelivers: Oneplaceforunlimiteddata Unied,mulM-frameworkdataaccess Enterprisesrequire: LeadingPerformance OpenSource,OpenStandards EnterpriseSecurity DataGovernance CompleteManagement SecurityandAdministraMon UnlimitedStorage Process Discover Model Serve Deployment Flexibility On-Premises Appliances EngineeredSystems PublicCloud PrivateCloud HybridCloud AmoderndataplaSormpluswhattheenterpriserequires.
  3. 3. 3Cloudera,Inc.Allrightsreserved. WhereSparkFitsintheHadoopEcosystem YARN: Shared resource management HDFS and HBase: Shared storage Impala Hive Pig MapReduce2 Search Spark Spark Streaming Hive (beta) Pig (beta) Withcommon Security Datagovernance ConguraMon, deploymentand operaMons acrossall componentsinthe stack
  4. 4. 4Cloudera,Inc.Allrightsreserved. Processmillionsof equityandbond marketposiMons,and evaluateagainst futurescenariosin minutes,versusdays withMapReduce. MajorGlobal FinancialInsMtuMon
  5. 5. 5Cloudera,Inc.Allrightsreserved. Monitoron-lineuser acMvityandopMmize contentdeliveryand searchresultsinreal Mme. LargeConsumer Company
  6. 6. 6Cloudera,Inc.Allrightsreserved. Ingestandanalyze complexdatafroma varietyofsources conMnually,building newriskandvalue modelsinrealMme
  7. 7. 7Cloudera,Inc.Allrightsreserved. Combinegenomicand phenotypedatawith otherdatasourcesto understanddisease onsetandprogression
  8. 8. 8Cloudera,Inc.Allrightsreserved. Sparkextendsthe Hadoopecosystem withnewanalyMc andprocessing capabiliMes. 8Cloudera,Inc.Allrightsreserved.
  9. 9. 9Cloudera,Inc.Allrightsreserved. Thankyou! MikeOlson,chiefstrategyocer mike.olson@cloudera.com @mikeolson

Recommended

View more >