gdg varna - hadoop
TRANSCRIPT
Dimitar Danailov
Software
Architect
Image source: https://www.linkedin.com/pulse/20140817172419-206881211-software-architect-explained
Topics Today
● What is BigData
● Big Data Vs
● Hadoop
● Hadoop EcoSystem
Video: President Barack Obama's Big Data Keynote -- Strata + Hadoop World 2015
https://www.udacity.com/courses/ud617
https://www.coursera.org/learn/hadoop
https://www.coursera.org/learn/bigdata-analytics
Cloudera
Quickstart VM
Image source: Amazon
Image source: wiki.genexus.com/
Image source: http://www.qnap.com
Image source: http://tarrysingh.com/
Store and
Process
https://hackadaycom.files.wordpress.com/2013/11/8-pi-cluster-3.jpg?w=800
Big Data Vs
Image source: https://media.licdn.com/mpr/mpr/p/1/005/047/21c/08d279d.jpg
Image source: IBM
Volume
$ 100, 000+ price/GB
1980
$ 0.10 price/GB
2013
Variety
Image source: Lynn Langit, BigData and Cloud Architect. Technical Author
Image source: http://media.truelocal.com.au
GPSPlan
TrafficCurrent Load
Fuel Efficiency
Velocity
Doug Cutting
Image source: Wikipedia
Video: Doug Cutting: The Origins of Hadoop - Intro to Hadoop and MapReduce
Store and
Process
Mydata.txt - 150 MB
64 MB
64 MB
22 MB
Block 1
Block 2
Block 3
Image source: http://s3.thinkaurelius.com/docs/titan/0.5.4/images/hdfs-logo.jpg
Image source: http://www.fraudtechwire.com/wp-content/uploads/2015/03/hdfs-arch.jpg
Image source: http://image.slidesharecdn.com/slide-140911081300-phpapp02/95/automatic-synthesis-of-combiners-in-the-mapreduce-framework-2-638.jpg?cb=1410423512
Hadoop
EcoSystem
Image source: http://thebigdatablog.weebly.com/uploads/3/2/3/2/32326475/87375_orig.jpg
HDFS
Image source: http://i.stack.imgur.com/SsK5I.png
HDFS
Image source: http://xiaochongzhang.me/blog/wp-content/uploads/2013/05/MapReduce_Work_Structure.png
QuestionsDimitar Danailov
Software Architect at MentorMate
dimityr.danailov[at]gmail.com
Slideshare.net
Github
YouTube
Founder at VarnaIT