tg09 gateway face to face please make yourself comfortable at the front of the room! nancy...

TG09 Gateway Face to Face

Please make yourself comfortable at the front of

the room!

Nancy Wilkins-DiehrTeraGrid Area Director for Science Gateways

[email protected]

TeraGrid 09, June 24, 2009

First, humor me with a short gameThen we’ll look at where we’ve been and where we’re going


Gateway JeopardyGateway

Statistics1Science

ApplicationsSecurity Att-based auth Gateway Trivia

10 10 10 10 10

20 20 20 20 20

30 30 30 30 30

40 40 40 40 40

50 50 50 50 50TeraGrid 09, June 24, 2009Source: James Madison University Get me out of here

Which gateway used the most CPU time in 2008?

SCEC, 1M hours


Which gateway ran the most jobs in 2008?

SIDGrid, 118, 256 = 325 jobs/day


How many gateways did we start with and how many do

we have today?

10 and 35


Name 2 gateways that use Condor to submit jobs

nanoHUB, TeraGrid Bioportal


Which site runs the most community account jobs?

NCSA, 83% of all jobs in 2008


Which gateway makes video available to its users for

analysis?

Social Informatics Data (SID) Grid


Which gateway’s success depended on the launch of a

satellite?

Asteroseismology Modeling Portal, the Kepler sattelite


Which gateway serves science domains from plant biology

to linguistics?

Geographic Information (GI) Science Gateway


Which gateway is accessible from igoogle?

Open Life Science GatewayLog in at google.com, click add stuff, search for TeraGrid


Which gateway has over 600 google scholar references?

Google scholar reports 601 references to the Robetta gateway, including many PubMed

publications


What does a PI agree to on the user responsibility form?

2.2.1 Additional required information for community accountsIP address or DNS name of the portal machineLogging of requester's IP address, UTC timestamp and username on the portalCurrent estimated long-term disk storage requirements for the community account (this can be modified in the future to accommodate gateway growth)Paths to directories on the RP cluster where scripts and executables can be run by an un-verified user from the portal, e.g. $HOME/binOptionally, for each script or executable in the named directory, provide

Estimated maximum number of processors/nodesEstimated maximum run timeEstimated short-term storage requirements per user per job


What does the gateway support kit include?

GridShib, commsh


What was the summary from last year’s gateway risk analysis

Most of the Gateways that answered our questionnaire seemed to be well managed and in fact cared about security issues. We were pleased to see things like patch management systems in place and checksums being used to detect code changes. We did not examine any Gateway code, but hope that the Gateways will check all user input for saneness and appropriateness. TeraGrid would like to assume that the Gateways are secure so that Gateway accounts may be treated like any other user account.


What PY5 activity is a direct result of the gateway security summit?

Victor Hazlewood’s work to pursue standardized treatment of community accounts


What are two examples of observed security problems to date?

Credential management, passwordless ssh


By what date do all gateways need to implement attribute-

based authentication?

September, 2009


Which gateways have implemented attribute-based

authentication?


gisolve, amp, and bioportal are done.nanohub, jimmy neutron, and tera3d are in progress.

Who was the first RP site to install the gateway support

kit?

NCSA


Besides not having Nancy bug you about user counts, name one potential benefit of

attribute-based authentication

TeraGrid can do per-user accounting for a gateway


What is the string called that identifies a gateway?

entityID


Who makes sure gateways can use the TeraGrid in

production?Who answers gateway help

desk tickets?

Stu Martin and Yan Liu


What year did the gateway program start?

2004


Who can become a TeraGrid gateway?

Anyone who is approved for an allocation


How often are update slides requested?

Quarterly


Who did the first build-a-gateway-in-a-day tutorial?

Shaowen Wang and Yan Lius


Five years!

•84 presentations–And that’s only by me

•>70 gateway calls•Hundreds of [email protected] emails•Scores of quarterly slides•5 annual TG meetings

•Where did we begin?•What have we achieved?•Where are we going?


30

Nancy’s Excellent TeraGrid Adventures

31TeraGrid 09, June 24, 2009

32

RATS

Requirements Analysis Teams

Gathering requirements from Gateways

Looking for commonalities, methodologies

Determine how funded Gateway participants and TG staff can work together to accomplish goals


33

Gateway RAT timeline February (1-2 week): -put together RATs team -define/refine timeline and deliverables February (2 weeks): -Review survey -send survey to gateway leaders for

information collection -Review LEAD requirements (Dennis’s

document) -Review user models (Von’s document) -Put together all relevant documents and

articles (hotgrid,community allocation) etc -Review SGW milestones from the GIG

proposal, understand them February (1-2 week) -Analyze survey -Adjust user models -Identify commonality and uncommonality -Create outline of primer -Identify possible time constraints for science

gateway before AHM (test accounts)

March (2 weeks) -Address possible clarification of survey

answers with gateway leaders. -Contact Gateway developers to check user

model -Start writing primer -if any, jump start gateways for demo

scenarios. March (2 weeks) -Identify tasks/issues to be raised to specific

working group -Identify GIG sgw team -finish draft of primer/requirements -Send draft to

esc,security,portals,accounting,gateways wg. March (1week) -Get ready for AHM (presentation, copies,

agenda) April (1 week) -Hold workshop at AHM -Present draft of SGW RAT primer -Demo -Define new timeline and deliverables


34

Summarizing Gateway needs in the following areas

What apps will you run Allocation model User models Cert requirements Security Accounting Status of operation,

plans Critical deadlines Long term software

requirements On Demand Other

Leaders and technical contacts

Scientific community Description URL Funding - source and

personnel Middleware

infrastructureWhat features do you need from TG

What do you use outside of TG TeraGrid 09, June 24, 2009

35

Original surveys and reports still available

http://www.teragridforum.org/mediawiki/index.php?title=Science_Gateways:_Internal Click on Past

Management


How far have we come?What have we done?

Most importantly, what can we do better?

•Community accounts - established–Security policies– Improvements still needed?

•Community software areas – established–Any improvements needed?

•Gateway community - established–Recommended software–Searchable email archives–Shared experiences, model for other organizations– Improvements?

•Reliability, scaling– I don’t think we’re there yet, but what specifically can we do–GRAM5?


•Allocations–Recommendations for PIs–Built support with reviewers–Still challenges?

•Scheduling–Metascheduling, on demand, per user limits - community

account support–Still challenges

•Common software/services–Never really panned out

•Documentation– In good shape?

•Persistent funding for gateways


What are we working toward?Previously stated PY4-5 goals

•TeraGrid integration will be straightforward for new and existing gateway developers–Great documentation in 2008–Current focus – streamlined community accounts

•There will be a set of easy to discover general services provided by and for Gateways– In progress

•The targeted support program will adapt to changing needs–Done

•We will be able to routinely count end gateway users– In progress, done by September 2009

•There will be avenues for sustained Gateway funding–Some good progress


What am I excited about right now?

•Gadgets, Twitter, Yahoo YUI, interesting young people in science•Gateway software advertised along with command line TG software•Ability to charge user allocations for the use of gateways

– Gateways as a useful tool for science!

•Pursuing a sustained funding program for gateways– Possibly starting with directorate workshops

•Quarry hosting packaged with gateway software– OGCE, SimpleGrid

•Attribute-based authentication•Standardized community account treatment•GRAM5•New groups interested in developing gateways

– Center for Analytical Ultracentrifugation of Macromolecular Assemblies– J. Craig Venter Institute– Roche Pharmaceuticals

•Support from Vice President of engineering of the 454 Life Sciences division

•PY6 planning starts soon (goals, SOWs to meet those goals)TeraGrid 09, June 24, 2009

tg09 gateway face to face please make yourself comfortable at the front of the room! nancy...

Documents

teragrid bioportal teragrid

robetta gateway

gateway growthpaths

gateway jeopardyteragrid

gateway support kit

tg09 gateway face

community account jobs

science domains