distributed computing systems current issues in dcs
DESCRIPTION
Distributed Computing Systems Current Issues in DCS. Dr. Sunny Jeong. [email protected] Mr. Colin Zhang [email protected] With Thanks to Prof. G. Coulouris, Prof. A.S. Tanenbaum and Prof. S.C Joo. Cluster, Grid, Cloud … Now … Hadoop?. To Support hadling Big data - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Distributed Computing Systems Current Issues in DCS](https://reader036.vdocuments.mx/reader036/viewer/2022062408/56813ad6550346895da310ee/html5/thumbnails/1.jpg)
Distributed Computing Systems
Current Issues in DCS
Dr. Sunny Jeong. [email protected]
Mr. Colin Zhang [email protected] Thanks to Prof. G. Coulouris, Prof. A.S. Tanenbaum
and Prof. S.C Joo
![Page 2: Distributed Computing Systems Current Issues in DCS](https://reader036.vdocuments.mx/reader036/viewer/2022062408/56813ad6550346895da310ee/html5/thumbnails/2.jpg)
Cluster, Grid, Cloud …Now…Hadoop?
To Support hadling Big data
Hadoop HDFS + MapReduce– designed so that any node failures are automatically handled by the
framework.
– enables applications to work with thousands of computation-independent computers and petabytes of data.
Facebook Yahoo..of course GOOGLE
![Page 3: Distributed Computing Systems Current Issues in DCS](https://reader036.vdocuments.mx/reader036/viewer/2022062408/56813ad6550346895da310ee/html5/thumbnails/3.jpg)
Overview
Hadoop Computer Cluster Grid Computing Grid Computing Projects
3
![Page 4: Distributed Computing Systems Current Issues in DCS](https://reader036.vdocuments.mx/reader036/viewer/2022062408/56813ad6550346895da310ee/html5/thumbnails/4.jpg)
Hadoop Architecture
Wikipedia
![Page 5: Distributed Computing Systems Current Issues in DCS](https://reader036.vdocuments.mx/reader036/viewer/2022062408/56813ad6550346895da310ee/html5/thumbnails/5.jpg)
MapReduce Architecture
Yuan Luo
![Page 6: Distributed Computing Systems Current Issues in DCS](https://reader036.vdocuments.mx/reader036/viewer/2022062408/56813ad6550346895da310ee/html5/thumbnails/6.jpg)
HDFS Architecture
Dhruba Borthakur
![Page 7: Distributed Computing Systems Current Issues in DCS](https://reader036.vdocuments.mx/reader036/viewer/2022062408/56813ad6550346895da310ee/html5/thumbnails/7.jpg)
Clustering Computing
Consists of a set of loosely connected computers that work together as a single system.
The components of a cluster are usually connected to each other through fast LAN, each node with own OS
Availability of low cost microprocessors, high speed networks, and software for high performance distributed computing
7
![Page 8: Distributed Computing Systems Current Issues in DCS](https://reader036.vdocuments.mx/reader036/viewer/2022062408/56813ad6550346895da310ee/html5/thumbnails/8.jpg)
Grid Computing
Computational Grid: – Focus on CPU scavenging/stealing technology for
complicated operation
Data Grid): Managing and sharing distributed intensive data
Access Grid: For Cooperation between remote computer using audio or video applications
Equipment Grid : Controlling remote machine and analyzing data from the machine.
![Page 9: Distributed Computing Systems Current Issues in DCS](https://reader036.vdocuments.mx/reader036/viewer/2022062408/56813ad6550346895da310ee/html5/thumbnails/9.jpg)
Grid Project
•SETI@home•BOINC•holding@home•korea@home(stopped in 2011)
![Page 10: Distributed Computing Systems Current Issues in DCS](https://reader036.vdocuments.mx/reader036/viewer/2022062408/56813ad6550346895da310ee/html5/thumbnails/10.jpg)
Cloud Computing( comparison with Grid)
Service Oriented Transaction oriented No standardization Organization No Standard Technology More less homogeneous gathering (compare to
Grid) Loosely connected
10
![Page 11: Distributed Computing Systems Current Issues in DCS](https://reader036.vdocuments.mx/reader036/viewer/2022062408/56813ad6550346895da310ee/html5/thumbnails/11.jpg)
Barriers of the Concepts
Shim young cheol