resources for getting started: the culinary art of grids mary fran yafchak, mary trauner

20
Resources for Getting Started: The Culinary Art of Grids Mary Fran Yafchak, Mary Trauner SURA Cyberinfrastructure Workshop: Grid Application Planning & Implementation December 8, 2005 The Grid Technology Cookbook A guide to building and using grids Acknowledgements Preface Introduction What Grids Can Do For You Grid Case Studies Technology For Grids Standards & Emerging Technologies Programming Concepts & Challenges Building Your Own Grid Installation Procedure Examples Typical Usage Examples Practical Tips Glossary Appendices

Upload: rosina

Post on 11-Feb-2016

39 views

Category:

Documents


0 download

DESCRIPTION

The Grid Technology Cookbook A guide to building and using grids. Acknowledgements Preface Introduction What Grids Can Do For You Grid Case Studies Technology For Grids Standards & Emerging Technologies Programming Concepts & Challenges Building Your Own Grid - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Resources for Getting Started: The Culinary Art of Grids Mary Fran Yafchak, Mary Trauner

Resources for Getting Started:

The Culinary Art of Grids

Mary Fran Yafchak, Mary Trauner

SURA Cyberinfrastructure Workshop:Grid Application Planning & Implementation

December 8, 2005

The Grid Technology CookbookA guide to building and using grids

Acknowledgements

Preface

Introduction

What Grids Can Do For You

Grid Case Studies

Technology For Grids

Standards & Emerging Technologies

Programming Concepts & Challenges

Building Your Own Grid

Installation Procedure Examples

Typical Usage Examples

Practical Tips

Glossary

Appendices

Page 2: Resources for Getting Started: The Culinary Art of Grids Mary Fran Yafchak, Mary Trauner

Outline• Why a cookbook on grids• Why a cookbook model works• Experiences, lessons learned• Overview of the cookbook• The writing team and sponsors• Timetable, next steps• Resources to get you started• How you (!) can join in

Confessions of a Grid MasterA guide to building and using grids

Acknowledgements

Preface

Introduction

What Grids Can Do For You

Grid Case Studies

Technology For Grids

Standards & Emerging Technologies

Programming Concepts & Challenges

Building Your Own Grid

Installation Procedure Examples

Typical Usage Examples

Practical Tips

Glossary

Appendices

Page 3: Resources for Getting Started: The Culinary Art of Grids Mary Fran Yafchak, Mary Trauner

Why a cookbook on grids•Using grids still requires understanding•We want to see more use of grids•Grid standards are still in infancy•Books exist but are often too general or very complex, sometimes expensive•We feel a lighter, friendlier, maintainable resource is needed•We want to collaborate across grid projects

Great Grids Made SimpleA guide to building and using grids

Acknowledgements

Preface

Introduction

What Grids Can Do For You

Grid Case Studies

Technology For Grids

Standards & Emerging Technologies

Programming Concepts & Challenges

Building Your Own Grid

Installation Procedure Examples

Typical Usage Examples

Practical Tips

Glossary

Appendices

Page 4: Resources for Getting Started: The Culinary Art of Grids Mary Fran Yafchak, Mary Trauner

Why a cookbook model works•Other cookbooks have been highly successful•The flexibility of the resource provides for delivery of more timely material•The layout and outline smooth under-standing of scattered and diverse material•The approach promotes development for the community, by the community

The Grid ConnoisseurA guide to building and using grids

Acknowledgements

Preface

Introduction

What Grids Can Do For You

Grid Case Studies

Technology For Grids

Standards & Emerging Technologies

Programming Concepts & Challenges

Building Your Own Grid

Installation Procedure Examples

Typical Usage Examples

Practical Tips

Glossary

Appendices

Page 5: Resources for Getting Started: The Culinary Art of Grids Mary Fran Yafchak, Mary Trauner

Experiences, lessons learned•Development, revision - cycle & method•Two editors work best

•Recruitment and nurturing•Site work•First edits

•Quality control is key•One year revision cycle, “recovery” period•Funding for revisions is important

Humble Grid PieA guide to building and using grids

Acknowledgements

Preface

Introduction

What Grids Can Do For You

Grid Case Studies

Technology For Grids

Standards & Emerging Technologies

Programming Concepts & Challenges

Building Your Own Grid

Installation Procedure Examples

Typical Usage Examples

Practical Tips

Glossary

Appendices

Page 6: Resources for Getting Started: The Culinary Art of Grids Mary Fran Yafchak, Mary Trauner

Cookbook Overview

The Grid Lover’s CompanionA guide to building and using grids

Acknowledgements

Preface

Introduction

What Grids Can Do For You

Grid Case Studies

Technology For Grids

Standards & Emerging Technologies

Programming Concepts & Challenges

Building Your Own Grid

Installation Procedure Examples

Typical Usage Examples

Practical Tips

Glossary

Appendices

Page 7: Resources for Getting Started: The Culinary Art of Grids Mary Fran Yafchak, Mary Trauner

Who is the audience• Beginners:

•Users/researchers•Higher level administrators•Those just curious

• Programmers• New developers or Integrators• All of the above

The Joy of GridsA guide to building and using grid

resources

Acknowledgements

Preface

Introduction

What Grids Can Do For You

Grid Case Studies

Technology For Grids

Standards & Emerging Technologies

Programming Concepts & Challenges

Building Your Own Grid

Installation Procedure Examples

Typical Usage Examples

Practical Tips

Glossary

Appendices

Page 8: Resources for Getting Started: The Culinary Art of Grids Mary Fran Yafchak, Mary Trauner

• Acknowledgements• Preface

•Why this guide•Intended readers•How to use

• Introduction•What is a grid•Heterogeneous versus homogenous grids•Research grids versus enterprise grids•Instruments, resources and services on a grid•How grids work•Security factors on a grid

Betty Crocker’s Guide to GridsA guide to building and using grid resources

Acknowledgements

Preface

Introduction

What Grids Can Do For You

Grid Case Studies

Technology For Grids

Standards & Emerging Technologies

Programming Concepts & Challenges

Building Your Own Grid

Installation Procedure Examples

Typical Usage Examples

Practical Tips

Glossary

Appendices

Beginners:• Users/researchers• Higher level administrators• Those just curiousProgrammersNew developers or IntegratorsAll of the above

Page 9: Resources for Getting Started: The Culinary Art of Grids Mary Fran Yafchak, Mary Trauner

• What Grids Can Do for You

•Payoffs and tradeoffs

•Trends in computational and networked services

•The future of grids

• Case Studies

•Overview of 3-6 grid technologies with

discussion of applications using them

Five Star Grid CookingA guide to building and using grid resources

Acknowledgements

Preface

Introduction

What Grids Can Do For You

Grid Case Studies

Technology For Grids

Standards & Emerging Technologies

Programming Concepts & Challenges

Building Your Own Grid

Installation Procedure Examples

Typical Usage Examples

Practical Tips

Glossary

Appendices

Beginners:• Users/researchers• Higher level administrators• Those just curiousProgrammersNew developers or IntegratorsAll of the above

Page 10: Resources for Getting Started: The Culinary Art of Grids Mary Fran Yafchak, Mary Trauner

• Technology for Grids•An overview of grid fabric•Computing services•Data services• Instrumentation (and other unique services)•Networks, switches, and interconnects for grids•Grid domains (single and multiple)•Middleware & service directories•Authentication and authorization•Account management and reporting•Popular grid building projects/software/tool kits

The Culinary Art of GridsA guide to building and using grid resources

Acknowledgements

Preface

Introduction

What Grids Can Do For You

Grid Case Studies

Technology For Grids

Standards & Emerging Technologies

Programming Concepts & Challenges

Building Your Own Grid

Installation Procedure Examples

Typical Usage Examples

Practical Tips

Glossary

Appendices

Beginners:• Users/researchers• Higher level administrators• Those just curiousProgrammersNew developers or IntegratorsAll of the above

Page 11: Resources for Getting Started: The Culinary Art of Grids Mary Fran Yafchak, Mary Trauner

• Standards & Emerging Technologies•Standards initiatives

•Web services

•Portals

•Schedulers and metaschedulers

•Certificate and registry services

•Grid in a box?

•Enhanced resources: visualization engines,

specialized instruments, collaboratories

Calculated Cooking with GridsA guide to building and using grid resources

Acknowledgements

Preface

Introduction

What Grids Can Do For You

Grid Case Studies

Technology For Grids

Standards & Emerging Technologies

Programming Concepts & Challenges

Building Your Own Grid

Installation Procedure Examples

Typical Usage Examples

Practical Tips

Glossary

Appendices

Beginners:• Users/researchers• Higher level administrators• Those just curiousProgrammersNew developers or IntegratorsAll of the above

Page 12: Resources for Getting Started: The Culinary Art of Grids Mary Fran Yafchak, Mary Trauner

• Programming concepts and challenges•Access to and scheduling of resources

•Security and security integration with existing

authn/z structures

•Job submission, management, and monitoring

•Data access, movement, and storage

•Workflow processing

•Network communication

•Usage/programming examples

The Grid GourmetA guide to building and using grid resources

Acknowledgements

Preface

Introduction

What Grids Can Do For You

Grid Case Studies

Technology For Grids

Standards & Emerging Technologies

Programming Concepts & Challenges

Building Your Own Grid

Installation Procedure Examples

Typical Usage Examples

Practical Tips

Glossary

Appendices

Beginners:• Users/researchers• Higher level administrators• Those just curiousProgrammersNew developers or IntegratorsAll of the above

Page 13: Resources for Getting Started: The Culinary Art of Grids Mary Fran Yafchak, Mary Trauner

• Building your own grid•Designing your grid

•Grid system administrator, manpower

requirements

•Software repositories, distribution services

• Installation and configuration, deployment

•Management and monitoring

•Security notes (certificates, firewall issues,

patching, etc.)

Grids Throughout the WorldA guide to building and using grid resources

Acknowledgements

Preface

Introduction

What Grids Can Do For You

Grid Case Studies

Technology For Grids

Standards & Emerging Technologies

Programming Concepts & Challenges

Building Your Own Grid

Installation Procedure Examples

Typical Usage Examples

Practical Tips

Glossary

Appendices

Beginners:• Users/researchers• Higher level administrators• Those just curiousProgrammersNew developers or IntegratorsAll of the above

Page 14: Resources for Getting Started: The Culinary Art of Grids Mary Fran Yafchak, Mary Trauner

• Example grid: installation procedure(s)

•Simple basic grid example, and/or

•Grid specific material

• Example grid: usage example(s)

•For simple example grid, &/or

•For specific grid solution

The Science of GridsA guide to building and using grid resources

Acknowledgements

Preface

Introduction

What Grids Can Do For You

Grid Case Studies

Technology For Grids

Standards & Emerging Technologies

Programming Concepts & Challenges

Building Your Own Grid

Installation Procedure Examples

Typical Usage Examples

Practical Tips

Glossary

Appendices

Beginners:• Users/researchers• Higher level administrators• Those just curiousProgrammersNew developers or IntegratorsAll of the above

Page 15: Resources for Getting Started: The Culinary Art of Grids Mary Fran Yafchak, Mary Trauner

• Practical Tips, FAQ, other

•How long does it take to build a grid?

•Grids and AFS

•Grids across multiple OS platforms (aka. Image

consistency)

•War stories

•more

Foolproof Grid CookingA guide to building and using grid resources

Acknowledgements

Preface

Introduction

What Grids Can Do For You

Grid Case Studies

Technology For Grids

Standards & Emerging Technologies

Programming Concepts & Challenges

Building Your Own Grid

Installation Procedure Examples

Typical Usage Examples

Practical Tips

Glossary

Appendices

Beginners:• Users/researchers• Higher level administrators• Those just curiousProgrammersNew developers or IntegratorsAll of the above

Page 16: Resources for Getting Started: The Culinary Art of Grids Mary Fran Yafchak, Mary Trauner

• Glossary (or links to glossaries)• Appendices

•Related links•Resources•Organizations•Grid solutions and research projects•Grid software distributions•National and regional facilities•Alliances and application communities

•Grid bulletin boards and mailing lists•Benchmarks and performance•Bibliography

The Best of Grid CookingA guide to building and using grid resources

Acknowledgements

Preface

Introduction

What Grids Can Do For You

Grid Case Studies

Technology For Grids

Standards & Emerging Technologies

Programming Concepts & Challenges

Building Your Own Grid

Installation Procedure Examples

Typical Usage Examples

Practical Tips

Glossary

Appendices

Beginners:• Users/researchers• Higher level administrators• Those just curiousProgrammersNew developers or IntegratorsAll of the above

Page 17: Resources for Getting Started: The Culinary Art of Grids Mary Fran Yafchak, Mary Trauner

The Writing TeamAmy Apon

University of ArkansasVictor Bolet

Georgia State UniversityNeil Bright

Georgia Institute of TechnologyVikram Gazula

University of KentuckyJames Patton Jones

JRAC, Inc.Harmut Kaiser

Louisiana State University and CCTScott Koranda

Univa CorporationRavi Madduri

Argonne National LaboratoryWarren Matthews

Georgia Institute of TechnologyJohn McGee

Renaissance Computing InstituteShawn McKee

University of MichiganRob Quick

Indiana UniversityLavanya Ramakrishnan

Renaissance Computing InstituteJohn-Paul Robinson

University of Alabama at BirminghamJorge Rodriguez

University of Florida and OSGJudith Utley

Old Dominion UniversityArt Vandenberg

Georgia State UniversityBarry Wilkinson

University of North Carolina at Chapel HillMatthew Wolf

Georgia Institute of TechnologyKatie Yurkewicz

Fermilab and OSG

Adventures in Grid CookingA guide to building and using grid resources

Acknowledgements

Preface

Introduction

What Grids Can Do For You

Grid Case Studies

Technology For Grids

Standards & Emerging Technologies

Programming Concepts & Challenges

Building Your Own Grid

Installation Procedure Examples

Typical Usage Examples

Practical Tips

Glossary

Appendices

Page 18: Resources for Getting Started: The Culinary Art of Grids Mary Fran Yafchak, Mary Trauner

Timetable, next steps•Outline Development, Vetting September-October•Assemble Writing Teams October-December•Develop Web Structure November-December•Writing Process Underway November-March•Material Edited and Entered December-April•Review of First Draft May•Edits to First Draft Entered Early June•Review of Final Draft Late June•Release of Version 1 July 2006

The South Beach of GridsA guide to building and using grid resources

Acknowledgements

Preface

Introduction

What Grids Can Do For You

Grid Case Studies

Technology For Grids

Standards & Emerging Technologies

Programming Concepts & Challenges

Building Your Own Grid

Installation Procedure Examples

Typical Usage Examples

Practical Tips

Glossary

Appendices

Page 19: Resources for Getting Started: The Culinary Art of Grids Mary Fran Yafchak, Mary Trauner

Resources to get started (just a few!)•Grid Café - http://gridcafe.web.cern.ch/gridcafe/

•The Grid: Defining the Future of the Net - Gentzsch, in International Lab Mate, Feb 05, http://www.internationallabmate.com/•NMI Case Study Series - http://www1.sura.org/3000/NMI-

Testbed.html#NMI•GT4 Documentation - Quick Start Guide -http://www.globus.org/toolkit/docs/4.0/admin/docbook/quickstart.html•IBM Redbooks: Grid Computing with the IBM Grid Toolbox - http://www.redbooks.ibm.com/abstracts/sg246332.html?Open

If you have pointers to share, please send to: [email protected], [email protected]

The Grid Builder’s ApprenticeA guide to building and using grid resources

Acknowledgements

Preface

Introduction

What Grids Can Do For You

Grid Case Studies

Technology For Grids

Standards & Emerging Technologies

Programming Concepts & Challenges

Building Your Own Grid

Installation Procedure Examples

Typical Usage Examples

Practical Tips

Glossary

Appendices

Page 20: Resources for Getting Started: The Culinary Art of Grids Mary Fran Yafchak, Mary Trauner

How you (!) can join in•Check out the outlinehttp://www.hpc.gatech.edu/gtcb/outline

•Pick a section, send us a brief abstract•Volunteer to be a reviewer•Contact us

Mary [email protected]

Mary Fran [email protected]

Zen and the Art of GridsA guide to building and using grid resources

Acknowledgements

Preface

Introduction

What Grids Can Do For You

Grid Case Studies

Technology For Grids

Standards & Emerging Technologies

Programming Concepts & Challenges

Building Your Own Grid

Installation Procedure Examples

Typical Usage Examples

Practical Tips

Glossary

Appendices