tecnologia dei servizi grid e cloud computing - lezione 001a 0 lezione 1a - 13 ottobre 2009 il...
TRANSCRIPT
Tecnologia dei Servizi “Grid e cloud computing” - Lezione 001a 1
Lezione 1a - 13 ottobre 2009
Il materiale didattico usato in questo corso è stato mutuato da quello utilizzato da Paolo Veronesi per il corso di Griglie Computazionali per la Laurea Specialistica in Informatica tenuto nell’anno accademico 2008/09 presso l’Università degli Studi di Ferrara.
Paolo [email protected], [email protected]://www.cnaf.infn.it/~pveronesi/unife/
Università degli Studi di Bari – Corso di Laurea Specialistica in Informatica
“Tecnologia dei Servizi “Grid e cloud computing” A.A. 2009/2010
Giorgio Pietro Maggi [email protected], http://www.ba.infn.it/~maggi
Tecnologia dei Servizi “Grid e cloud computing” - Lezione 001a 2
The technological “offer”
Tecnologia dei Servizi “Grid e cloud computing” - Lezione 001a 3
Computing and Communication Technologies Evolution: 1960-2010!
* Sputnik
1960 1970 1975 1980 1985 1990 1995 2000
* ARPANET
* Email* Ethernet
* TCP/IP* IETF
* Internet Era * WWW Era
* Mosaic
* XML
* PC Clusters* Crays * MPPs
* Mainframes
* HTML
* W3C
* P2P
* Grids
* XEROX PARC worm
COMPUTING
Communication
* Web Services
* Minicomputers * PCs
* WS Clusters
* PDAs* Workstations
* HTC
2010
* e-Science
Computing as Utility
* e-Business
* SocialNets
ControlCentralised Decentralised
Tecnologia dei Servizi “Grid e cloud computing” - Lezione 001a 4
Performance, Capability, Value of ICT asdefined by the three Laws of Computing
Moore’s Law. Transistors on a
single chip doubles ~ every 18 months.
Gilder’s Law. Aggregate bandwidth
triples ~ every year. Metcalfe’s Law.
The value of a network may grow exponentially with the number of participants.
Source: Cambridge Energy Resource Associates
Tecnologia dei Servizi “Grid e cloud computing” - Lezione 001a 5
“Increase” of network technologies Network vs. Computer perfomances
Computer speed doubles every 18 months Data storage density doubles every 12 months Network speed doubles every 9 months
1986 → 2000 Computers: x500 Networks: x 340,000
2001 → 2010 Computers: x60 Networks: x4,000
Scientific American (Jan-2001) by Cleo Vilett, source VinedKhoslan, Kleiner, Caufieldand Perkins
Tecnologia dei Servizi “Grid e cloud computing” - Lezione 001a 6
Entry Price-Points For HPC Has Dropped
Sample System
Performance
Price
Customers
Cray Y-MP C916 Sun HPC10000 [email protected]
~10 GFlops ~10 GFlops ~10 GFlops
$40,000,000 $1,000,000(40x drop)
$4,000 (250x drop)
Government Labs Large Enterprises Every Engineer and Scientist
1991 1998 2005
Tecnologia dei Servizi “Grid e cloud computing” - Lezione 001a 7
Distributed Memory Becoming The Norm
Clusters over 70%
Tecnologia dei Servizi “Grid e cloud computing” - Lezione 001a 8
COTS Components Gaining Ground
GigaE is gaining (50% of systems)
x86 is leading (Pentium 41%, EM64T
16%, Opteron 11%
Tecnologia dei Servizi “Grid e cloud computing” - Lezione 001a 9
The GÉANT2 network and the rest of the world
USA
Latin America
Asia
South-East Europe
Mediterranean Area
Pan-European coverage (40+ countries/3900 Universities/30+ millions of students) Hybryd architecture:
Connectivity at 10 Gbps Dark fiber wavelengths
Tecnologia dei Servizi “Grid e cloud computing” - Lezione 001a 10
The “global” network
Corso Introduttivo di Grid Computing, Catania, 25.03.2008
10
Tecnologia dei Servizi “Grid e cloud computing” - Lezione 001a 11
The Grid: networked data processing centres and ”middleware” software as the “glue” of resources.
Researchers perform their activities regardless geographical location, interact with colleagues, share and access data
Scientific instruments and experiments provide huge amount of data
The Grid Vision for e-Science
Grids are both a “dream” and a tool for realizing even larger “dreams”.
(http://access.ncsa.uiuc.edu/witg/)
Tecnologia dei Servizi “Grid e cloud computing” - Lezione 001a 12
eScience Science is becoming increasingly digital, needs to deal with increasing amounts
of data and computational needs
Simulations get ever more detailed Nanotechnology – design of new materials from
the molecular scale Modelling and predicting complex systems
(weather forecasting, river floods, earthquake) Decoding the human genome
Experimental Science uses ever moresophisticated sensors to make precisemeasurements Need high statistics Huge amounts of data Serves user communities around the world
Tecnologia dei Servizi “Grid e cloud computing” - Lezione 001a 14
Definitions e-Sciencee-Science is used to describe computationally intensive science that is carried
out in highly distributed network environments, or science that uses immense data sets that require grid computing; the term sometimes includes technologies that enable distributed collaboration
(The term was created by John Taylor, the Director General of the United Kingdom's Office of Science and Technology in 1999 and was used to describe a large funding initiative starting in November 2000)
e-Researche-Research extends e-Science and e-Infrastructure to all sciences and denotes the use of Information Technology to support existing and new forms of research.
The main features are : Collaborative; uses GRID technologies; data intensive;
and the adoption in research activities of a spectrum of advanced Information and Communication Technology (ICT) capabilities. It embraces new research methodologies emerging from increasing access to: Networks; Services; Tools.
Tecnologia dei Servizi “Grid e cloud computing” - Lezione 001a 15
e-Knowledge
Tecnologia dei Servizi “Grid e cloud computing” - Lezione 001a 16
La strategia di Lisbona
È stata definita dall’Agenda Sociale Europea nei Consigli Europei di Lisbona (2000), Nizza (2000), Göteborg (2001), Barcellona (2002) e Bruxelles (2005);
Obiettivo qualitativo: Trasformare l'Unione Europea, entro il 2010, “nell’economia basata
sulla conoscenza più competitiva e dinamica del mondo, in grado di realizzare una crescita economica sostenibile con nuovi e migliori posti di lavoro e una maggiore coesione sociale“;
Obiettivi quantitativi (da raggiungere entro il 2010): Un tasso di crescita economica pari al 3%; Un tasso di occupazione del 70%; Un tasso di partecipazione della forza femminile al lavoro pari al
60%.
Tecnologia dei Servizi “Grid e cloud computing” - Lezione 001a 17
The European Research Area
Network infrastructure(GÉANT2)
Op
erat
ion
s,
Su
pp
ort
an
d
trai
nin
g
Collaboration
Pan-European Grid
Tecnologia dei Servizi “Grid e cloud computing” - Lezione 001a 18
REL-PROJ'sEGEE Related projects co-vering several regions of the world
GÉANT .
INFRASTRUCTURE
GRID .
INFRASTRUCTURE
EGEE
Production quality Grid, HEP, Biomed..., int. links (67M€ – CERN)
GÉANTPan-European Research Network,3900 inst., 30+ million users, 40+ countries(~100 M€ - DANTE)
DEISA
Grid of EU supercomputers networked at Gbps, focus on global filing systems,>40 Tflop/s, several user communities(15M€ - CNRS) .
L’e-Infrastruttura Europea oggi
300 M€ in FP64 G€ in FP7 !
Tecnologia dei Servizi “Grid e cloud computing” - Lezione 001a 19
Summary of How e-Infrastructures help e-Science
e-Infrastructures provide easier access for Geographically distributed researchers Small research groups Scientists from many different fields Remote and still developing countries
To new technologies Produce and store massive amounts
of data Transparent access to millions of files
across different administrative domains Low cost access to resources
Mobilise large amounts of CPU & storage on short notice (PC clusters)
High-end facilities (supercomputers)
And help to find new ways to collaborate Develops applications using distributed
complex workflows Eases distributed collaborations Provides new ways of community building Gives easier access to higher education
NETWORK .
INFRASTRUCTURE
GRID .
INFRASTRUCTURE
KNOWLEDGE .
INFRASTRUCTURE
Tecnologia dei Servizi “Grid e cloud computing” - Lezione 001a 20
Evolution
European e-Infrastructure
Testbeds Utility ServiceRoutine Usage
National
Global
Tecnologia dei Servizi “Grid e cloud computing” - Lezione 001a 21
21
Slide courtesy of Kyriakos Baxevanidis, EC
Broad scale test-beds
Production quality facilities
Sustainable grid/data-based e-Infrastructures (utility model)
Towards sustainable e-Infrastructures
Tecnologia dei Servizi “Grid e cloud computing” - Lezione 001a 22
Le opportunità future in Europa: l’FP7
http://cordis.europa.eu/fp7/ict/e-infrastructure/projects_en.html
>100 M€ già spesi
> 100 M€ disponibili in call aperte
Per informazioni sulle call aperte:
http://cordis.europa.eu/fp7/dc/index.cfm
Tecnologia dei Servizi “Grid e cloud computing” - Lezione 001a 23
Le opportunità future in Italia: il PON 2007-2013
Il PON 2007-2013 “Ricerca e Competitività” ha l’obiettivo di cofinanziare progetti nei campi della ricerca scientifica, dello sviluppo tecnologico, della competitività e dell’innovazione industriale nel periodo di programmazione 2007-2013.
Il PON 2007-2013 si articolerà su 3 Assi prioritari: Asse I: Sostegno ai mutamenti strutturali Asse II: Sostegno all’innovazione Asse III: Assistenza tecnica e attività di accompagnamento
Le azioni dell’Asse I e dell’Asse II saranno tra loro fortemente correlate ed interdipendenti
Tecnologia dei Servizi “Grid e cloud computing” - Lezione 001a 24
Alessandro Volta in Paris in 1801 at the French National Institute shows the battery while in the presence of Napoleon I
Fresco by N. Cianfanelli (1841) (Zoological Section "La Specula" of National History Museum of Florence University)
Tecnologia dei Servizi “Grid e cloud computing” - Lezione 001a 25
….and in the future, I imagine a WorldwidePower (Electrical) Grid …...
What ?!?!This is a mad man…
Oh, monDieu !
Tecnologia dei Servizi “Grid e cloud computing” - Lezione 001a 26
2008 - 1801 = 207 years(Recent R&D: Delivering Internet services via Electric cables).
Tecnologia dei Servizi “Grid e cloud computing” - Lezione 001a 27
4 Essential Utilities and Delivery Networks
(2) WaterWater
Distribution Network
(4) TelephoneTelecom Networks
(3) Gas
(1) ElectricityPower Grid
Tecnologia dei Servizi “Grid e cloud computing” - Lezione 001a 28
A citation …
(The father of “ubiquitous computing”)
Telephone, Light bulb, Telegraph, Radio, TV, Computer, Network, PC, Web, …(in the same order as they were invented)