1 teaching grid computing across north carolina and beyond dr. clayton ferner university of north...
Post on 21-Dec-2015
218 views
TRANSCRIPT
![Page 1: 1 Teaching Grid Computing across North Carolina and Beyond Dr. Clayton Ferner University of North Carolina Wilmington Dr. Barry Wilkinson University of](https://reader031.vdocuments.mx/reader031/viewer/2022032310/56649d555503460f94a32c6e/html5/thumbnails/1.jpg)
1
Teaching Grid Computing across North Carolina and Beyond
Dr. Clayton FernerUniversity of North Carolina
Wilmington
Dr. Barry WilkinsonUniversity of North Carolina
Charlotte
Education Program Plenary Session
Sunday, Nov. 13th, 2011, 8:30 am -10:00 am
SC11 Int. Conf. for High Performance Computing, Networking, Storage and Analysis, Seattle, WA
![Page 2: 1 Teaching Grid Computing across North Carolina and Beyond Dr. Clayton Ferner University of North Carolina Wilmington Dr. Barry Wilkinson University of](https://reader031.vdocuments.mx/reader031/viewer/2022032310/56649d555503460f94a32c6e/html5/thumbnails/2.jpg)
Undergraduate Grid Computing Course
Key features: Distributed computing resources – Production-level Grid
platform set up between UNC-Charlotte and UNC-Wilmington Distributed students – Taught on North Carolina Research
and Education televideo network across North Carolina Undergraduate level – perhaps first such course.
Fall 2004: 8 sites 43 students Fall 2005: 12 sites 32 students Spr. 2007: 3 sites 19 students Fall 2008: 5 sites 35 students Spr. 2010: 8 sites 73 students Fall 2011: 6 sites 67 students
![Page 3: 1 Teaching Grid Computing across North Carolina and Beyond Dr. Clayton Ferner University of North Carolina Wilmington Dr. Barry Wilkinson University of](https://reader031.vdocuments.mx/reader031/viewer/2022032310/56649d555503460f94a32c6e/html5/thumbnails/3.jpg)
Grid Computing Course Participants
16 institutions - major research universities, comprehensive universities, several minority serving schools, 4-year colleges, private and public.
![Page 4: 1 Teaching Grid Computing across North Carolina and Beyond Dr. Clayton Ferner University of North Carolina Wilmington Dr. Barry Wilkinson University of](https://reader031.vdocuments.mx/reader031/viewer/2022032310/56649d555503460f94a32c6e/html5/thumbnails/4.jpg)
Fall 2011 Course Virtual Organization
Sites originally scheduled to receive course:
•Six sites in North Carolina•Universidad Católica del Norte, Antofagasta, Chile
Continuing student unrest in Chile so had to drop – Plan will pursue in future.
University of Arkansas Fayetteville as a site also explored
www.vacationstogo.com
![Page 5: 1 Teaching Grid Computing across North Carolina and Beyond Dr. Clayton Ferner University of North Carolina Wilmington Dr. Barry Wilkinson University of](https://reader031.vdocuments.mx/reader031/viewer/2022032310/56649d555503460f94a32c6e/html5/thumbnails/5.jpg)
Course Grid Structure - Primary Sites
UNC-W
UNC-C
Course portal
torvalds.cis.uncw.edu(Cluster of 15 machines)
coit-grid01.uncc.educoit-grid02.uncc.educoit-grid03.uncc.educoit-grid04.uncc.educoit-grid05.uncc.educoit-grid06.uncc.educoit-grid07.uncc.edu
• Certificate Authorities on both UNCC cluster and UNCW cluster
• Globus (GT4)• Gridsphere Portal, Purse, MyProxy• Condor • CUDA on two Fermi GPU servers in
UNCC cluster, grid06 and grid07
![Page 6: 1 Teaching Grid Computing across North Carolina and Beyond Dr. Clayton Ferner University of North Carolina Wilmington Dr. Barry Wilkinson University of](https://reader031.vdocuments.mx/reader031/viewer/2022032310/56649d555503460f94a32c6e/html5/thumbnails/6.jpg)
• Job management, schedulers
• Workflow editor• Grid infrastructure design• Grid computing security• Portal software design• Grid-enabling applications• Intro to distributed
computing using pattern-programming HPC cloud computing
• 7 hands-on assignments
Topics
Some assignments require students to install significant software on their computer (Globus core, GridNexus workflow editor, GridSphere, ...)
2011 course home pagehttp://coitweb.uncc.edu/~abw/ITCS4146F11
![Page 7: 1 Teaching Grid Computing across North Carolina and Beyond Dr. Clayton Ferner University of North Carolina Wilmington Dr. Barry Wilkinson University of](https://reader031.vdocuments.mx/reader031/viewer/2022032310/56649d555503460f94a32c6e/html5/thumbnails/7.jpg)
Course Portal
Portal provides single sign-on to all grid resources.
![Page 8: 1 Teaching Grid Computing across North Carolina and Beyond Dr. Clayton Ferner University of North Carolina Wilmington Dr. Barry Wilkinson University of](https://reader031.vdocuments.mx/reader031/viewer/2022032310/56649d555503460f94a32c6e/html5/thumbnails/8.jpg)
8
Assignment 1Using a Grid Portal – registration step
New User
PURSe on-line registration form
CA/SystemAdministrator
Create accounts, set access control, sign certificate, …
Fill in formProvide password and other information
Email confirmation, Acknowledgement
Pass information to other sites to set up remote sites
![Page 9: 1 Teaching Grid Computing across North Carolina and Beyond Dr. Clayton Ferner University of North Carolina Wilmington Dr. Barry Wilkinson University of](https://reader031.vdocuments.mx/reader031/viewer/2022032310/56649d555503460f94a32c6e/html5/thumbnails/9.jpg)
Assignment 1Simple Distributed Job thro Portal
Computation: Compute mulch to cover flowerbed to depth of 4 inches.
Flowerbed
File staging and job executionUNC-C UNC-W
This computation is repeated using the Globus command line, a GUI workflow editor, and Condor DAGman in other
assignments for comparison, together with other tasks.
![Page 10: 1 Teaching Grid Computing across North Carolina and Beyond Dr. Clayton Ferner University of North Carolina Wilmington Dr. Barry Wilkinson University of](https://reader031.vdocuments.mx/reader031/viewer/2022032310/56649d555503460f94a32c6e/html5/thumbnails/10.jpg)
10
Assignment 2 Using command-line
Students submit jobs through command-line
Proxy obtained from MyProxy server (or manual process of getting certificate signed and creating a proxy from it)
Submit various jobs with globusrun-ws
Repeat flowerbed computation but using the command line
xml job description files with automatic input/output file staging/cleanup
![Page 11: 1 Teaching Grid Computing across North Carolina and Beyond Dr. Clayton Ferner University of North Carolina Wilmington Dr. Barry Wilkinson University of](https://reader031.vdocuments.mx/reader031/viewer/2022032310/56649d555503460f94a32c6e/html5/thumbnails/11.jpg)
11
Assignment 3 GridNexus
Get proxy
Create and execute flowerbed computation
Assignment requires students to install GridNexus on their computer
![Page 12: 1 Teaching Grid Computing across North Carolina and Beyond Dr. Clayton Ferner University of North Carolina Wilmington Dr. Barry Wilkinson University of](https://reader031.vdocuments.mx/reader031/viewer/2022032310/56649d555503460f94a32c6e/html5/thumbnails/12.jpg)
12
Assignment 4 Using Condor
Submit jobs and check status
Using different Condor universes (Vanilla/C, Java)
Test email acknowledgment feature
Creating ClassAds to select suitable resources
Creating DAGMAN workflows, for flowerbed computation and other workflows
![Page 13: 1 Teaching Grid Computing across North Carolina and Beyond Dr. Clayton Ferner University of North Carolina Wilmington Dr. Barry Wilkinson University of](https://reader031.vdocuments.mx/reader031/viewer/2022032310/56649d555503460f94a32c6e/html5/thumbnails/13.jpg)
13
Assignment 5Creating and deploying a Grid Service
Create, deploy, and test simple GT4 Grid Services with clients
Add functionality Re-name services
Need to modify WSDL and other files
Assignment requires students to install Globus core and associated packages on their computer
![Page 14: 1 Teaching Grid Computing across North Carolina and Beyond Dr. Clayton Ferner University of North Carolina Wilmington Dr. Barry Wilkinson University of](https://reader031.vdocuments.mx/reader031/viewer/2022032310/56649d555503460f94a32c6e/html5/thumbnails/14.jpg)
14
Assignment 6 GridNexus web service workflows
Create various web/grid service workflows.
Flowerbed computation using web/grid services for each part
Assignment done of students own computer, which acts a client to remote services
![Page 15: 1 Teaching Grid Computing across North Carolina and Beyond Dr. Clayton Ferner University of North Carolina Wilmington Dr. Barry Wilkinson University of](https://reader031.vdocuments.mx/reader031/viewer/2022032310/56649d555503460f94a32c6e/html5/thumbnails/15.jpg)
15
Create/deploy portletsFinal design - create portlet interface for distributed application.
Assignment 7JSR 168 Portlets in Gridsphere
Assignment requires students to install GridSphere on their computer
![Page 16: 1 Teaching Grid Computing across North Carolina and Beyond Dr. Clayton Ferner University of North Carolina Wilmington Dr. Barry Wilkinson University of](https://reader031.vdocuments.mx/reader031/viewer/2022032310/56649d555503460f94a32c6e/html5/thumbnails/16.jpg)
© copyright 2008, Barry Wilkinson, UNC CharlotteClayton S. Ferner, UNC Wilmington
Information on course offering, publications, etc. http://coitweb.uncc.edu/~abw/gridcourse
![Page 17: 1 Teaching Grid Computing across North Carolina and Beyond Dr. Clayton Ferner University of North Carolina Wilmington Dr. Barry Wilkinson University of](https://reader031.vdocuments.mx/reader031/viewer/2022032310/56649d555503460f94a32c6e/html5/thumbnails/17.jpg)
Course Text – direct outcome of courseHome page:http://coitweb.uncc.edu/~abw/GridComputingBook/
![Page 18: 1 Teaching Grid Computing across North Carolina and Beyond Dr. Clayton Ferner University of North Carolina Wilmington Dr. Barry Wilkinson University of](https://reader031.vdocuments.mx/reader031/viewer/2022032310/56649d555503460f94a32c6e/html5/thumbnails/18.jpg)
18
AcknowledgementsSupport for the work described here was provided by the National Science Foundation under grants 0410667/0533334 and 0737318/0737269/0737208, and two grants from University of North Carolina Office of the President.
SummaryPerhaps the first course to have both distributed resources and distributed students to teach Grid computing at the undergraduate level.
Many universities participated
Special features include many hands-on assignments, comparing a portal, command line, a GUI workflow editor (developed at UNC-Wilmington) and workflow with a job scheduler, and portlet interface design.
Also resulted in the first Grid computing course textbook at the undergraduate level.