a pparc funded project astro-wise meeting 06-07 april 2004 omegacen, kapteyn institute, groningen...
TRANSCRIPT
![Page 1: A PPARC funded project Astro-Wise meeting 06-07 April 2004 OmegaCEN, Kapteyn Institute, Groningen Tony Linde AstroGrid Project Manager University of Leicester](https://reader035.vdocuments.mx/reader035/viewer/2022062309/5697c0071a28abf838cc6139/html5/thumbnails/1.jpg)
A PPARC funded project
Astro-Wise meeting
06-07 April 2004OmegaCEN,Kapteyn Institute,Groningen
Tony LindeAstroGrid Project Manager
University of Leicester
![Page 2: A PPARC funded project Astro-Wise meeting 06-07 April 2004 OmegaCEN, Kapteyn Institute, Groningen Tony Linde AstroGrid Project Manager University of Leicester](https://reader035.vdocuments.mx/reader035/viewer/2022062309/5697c0071a28abf838cc6139/html5/thumbnails/2.jpg)
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 2
AstroGrid OverviewApproachArchitectureUsageItn05/06Astro-Wise & VObsFollow-up
![Page 3: A PPARC funded project Astro-Wise meeting 06-07 April 2004 OmegaCEN, Kapteyn Institute, Groningen Tony Linde AstroGrid Project Manager University of Leicester](https://reader035.vdocuments.mx/reader035/viewer/2022062309/5697c0071a28abf838cc6139/html5/thumbnails/3.jpg)
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 3
Overview of AstroGrid/-2Duration: Sept 2001 – Dec 2007Funding: £7.7M (PPARC)Personnel: ~26 (23.4 FTE)Goal: Develop VObs Infrastructure
Deploy UK VObsScope: Astrophysics, Solar, STP, …
Optical, X-Ray, Radio, …Phase A: Sept 2001 – Dec 2002
Analysis, R&D, ArchitecturePhase B: Jan 2003 – Dec 2004
Build, test & deliverAstroGrid-2: Jan 2005 – Dec 2007Structure tbd
![Page 4: A PPARC funded project Astro-Wise meeting 06-07 April 2004 OmegaCEN, Kapteyn Institute, Groningen Tony Linde AstroGrid Project Manager University of Leicester](https://reader035.vdocuments.mx/reader035/viewer/2022062309/5697c0071a28abf838cc6139/html5/thumbnails/4.jpg)
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 4
AstroGrid consortiumEdinburghLeicesterCambridgeMSSLJBORALQUB
AstroGrid-2 + Bristol Exeter Leeds Portsmouth
![Page 5: A PPARC funded project Astro-Wise meeting 06-07 April 2004 OmegaCEN, Kapteyn Institute, Groningen Tony Linde AstroGrid Project Manager University of Leicester](https://reader035.vdocuments.mx/reader035/viewer/2022062309/5697c0071a28abf838cc6139/html5/thumbnails/5.jpg)
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 5
Lead PersonnelProject Lead Andy Lawrence (Edinburgh)
Project Scientist Nic Walton (Cambridge)
Project Manager Tony Linde (Leicester)
Technical Lead Keith Noddle (Leicester)
![Page 6: A PPARC funded project Astro-Wise meeting 06-07 April 2004 OmegaCEN, Kapteyn Institute, Groningen Tony Linde AstroGrid Project Manager University of Leicester](https://reader035.vdocuments.mx/reader035/viewer/2022062309/5697c0071a28abf838cc6139/html5/thumbnails/6.jpg)
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 6
Links
FP5 AVO, FP6 Euro-VO (UK rep)US-NVOIVOA Standards workgroups
GGF, Globus, OGSA-DAIOther e-Science projects in UK GridPP, myGrid, EGSO, …
![Page 7: A PPARC funded project Astro-Wise meeting 06-07 April 2004 OmegaCEN, Kapteyn Institute, Groningen Tony Linde AstroGrid Project Manager University of Leicester](https://reader035.vdocuments.mx/reader035/viewer/2022062309/5697c0071a28abf838cc6139/html5/thumbnails/7.jpg)
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 7
Project ApproachAgile: iterative & incremental development
Open project: Wiki
http://wiki.astrogrid.org/bin/view/Astrogrid/WebHome
Forum http://forum.astrogrid.org/index.php
News http://news.astrogrid.org/index.php
Jabber via jabber.astrogrid.org
Open Source code http://www.astrogrid.org/maven/build/index.html
![Page 8: A PPARC funded project Astro-Wise meeting 06-07 April 2004 OmegaCEN, Kapteyn Institute, Groningen Tony Linde AstroGrid Project Manager University of Leicester](https://reader035.vdocuments.mx/reader035/viewer/2022062309/5697c0071a28abf838cc6139/html5/thumbnails/8.jpg)
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 8
Development ApproachIterative full cycle each iteration 3 month(-ish) iterations
Incremental add functionality each iteration refactor wherever necessary
Use-case driven from ‘key 10’ science cases http://wiki.astrogrid.org/bin/view/Astrogrid/ScienceProblems
Architecture led http://wiki.astrogrid.org/bin/view/Agdoc/ArchVision http://wiki.astrogrid.org/bin/view/Agdoc/ArchOverview http://wiki.astrogrid.org/bin/view/AG2/ArchitectureNotes
![Page 9: A PPARC funded project Astro-Wise meeting 06-07 April 2004 OmegaCEN, Kapteyn Institute, Groningen Tony Linde AstroGrid Project Manager University of Leicester](https://reader035.vdocuments.mx/reader035/viewer/2022062309/5697c0071a28abf838cc6139/html5/thumbnails/9.jpg)
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 9
Technology choices
design : UML, TogetherSoft ControlCenterdevelopment language : Java
Web services
source control : CVSIDE/build/integrate : Eclipse/Ant/MavenJava libraries: ApachePortal : Apache Cocoon
![Page 10: A PPARC funded project Astro-Wise meeting 06-07 April 2004 OmegaCEN, Kapteyn Institute, Groningen Tony Linde AstroGrid Project Manager University of Leicester](https://reader035.vdocuments.mx/reader035/viewer/2022062309/5697c0071a28abf838cc6139/html5/thumbnails/10.jpg)
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 10
VObs StructureComponent-based can install any/all components
Decentralised no single product nor centre
Service-based web services
![Page 11: A PPARC funded project Astro-Wise meeting 06-07 April 2004 OmegaCEN, Kapteyn Institute, Groningen Tony Linde AstroGrid Project Manager University of Leicester](https://reader035.vdocuments.mx/reader035/viewer/2022062309/5697c0071a28abf838cc6139/html5/thumbnails/11.jpg)
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 11
ComponentsPortalRegistrySecurityCommunityWorkflowData AccessMySpaceApplications
![Page 12: A PPARC funded project Astro-Wise meeting 06-07 April 2004 OmegaCEN, Kapteyn Institute, Groningen Tony Linde AstroGrid Project Manager University of Leicester](https://reader035.vdocuments.mx/reader035/viewer/2022062309/5697c0071a28abf838cc6139/html5/thumbnails/12.jpg)
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 12
AstroGrid-2Aspects Extension
Infrastructure Grid (GT4+) integration Intelligent resource discovery (semantic grid)
Additional components Data exploration Agents: eStar integration Client-based access: VO Workbench
Technical Scope http://wiki.astrogrid.org/bin/view/AG2/TechnicalScope
![Page 13: A PPARC funded project Astro-Wise meeting 06-07 April 2004 OmegaCEN, Kapteyn Institute, Groningen Tony Linde AstroGrid Project Manager University of Leicester](https://reader035.vdocuments.mx/reader035/viewer/2022062309/5697c0071a28abf838cc6139/html5/thumbnails/13.jpg)
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 13
AstroGrid-2 Layer Diagram
![Page 14: A PPARC funded project Astro-Wise meeting 06-07 April 2004 OmegaCEN, Kapteyn Institute, Groningen Tony Linde AstroGrid Project Manager University of Leicester](https://reader035.vdocuments.mx/reader035/viewer/2022062309/5697c0071a28abf838cc6139/html5/thumbnails/14.jpg)
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 14
AstroGrid usePortal WorkflowWorkflow is key to AstroGrid
![Page 15: A PPARC funded project Astro-Wise meeting 06-07 April 2004 OmegaCEN, Kapteyn Institute, Groningen Tony Linde AstroGrid Project Manager University of Leicester](https://reader035.vdocuments.mx/reader035/viewer/2022062309/5697c0071a28abf838cc6139/html5/thumbnails/15.jpg)
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 15
WorkflowSequence Sequential steps
Flow Steps executed in parallel
Step Application/Tool, Data query Configured via XForm specification
To be enhanced later or Query form
Workflow definition Subset of BPEL
![Page 16: A PPARC funded project Astro-Wise meeting 06-07 April 2004 OmegaCEN, Kapteyn Institute, Groningen Tony Linde AstroGrid Project Manager University of Leicester](https://reader035.vdocuments.mx/reader035/viewer/2022062309/5697c0071a28abf838cc6139/html5/thumbnails/16.jpg)
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 16
Create Workflow
![Page 17: A PPARC funded project Astro-Wise meeting 06-07 April 2004 OmegaCEN, Kapteyn Institute, Groningen Tony Linde AstroGrid Project Manager University of Leicester](https://reader035.vdocuments.mx/reader035/viewer/2022062309/5697c0071a28abf838cc6139/html5/thumbnails/17.jpg)
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 17
Add tools to steps
![Page 18: A PPARC funded project Astro-Wise meeting 06-07 April 2004 OmegaCEN, Kapteyn Institute, Groningen Tony Linde AstroGrid Project Manager University of Leicester](https://reader035.vdocuments.mx/reader035/viewer/2022062309/5697c0071a28abf838cc6139/html5/thumbnails/18.jpg)
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 18
Configure step: data query
![Page 19: A PPARC funded project Astro-Wise meeting 06-07 April 2004 OmegaCEN, Kapteyn Institute, Groningen Tony Linde AstroGrid Project Manager University of Leicester](https://reader035.vdocuments.mx/reader035/viewer/2022062309/5697c0071a28abf838cc6139/html5/thumbnails/19.jpg)
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 19
Configure step: tool
![Page 20: A PPARC funded project Astro-Wise meeting 06-07 April 2004 OmegaCEN, Kapteyn Institute, Groningen Tony Linde AstroGrid Project Manager University of Leicester](https://reader035.vdocuments.mx/reader035/viewer/2022062309/5697c0071a28abf838cc6139/html5/thumbnails/20.jpg)
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 20
Submit workflow, Check status
![Page 21: A PPARC funded project Astro-Wise meeting 06-07 April 2004 OmegaCEN, Kapteyn Institute, Groningen Tony Linde AstroGrid Project Manager University of Leicester](https://reader035.vdocuments.mx/reader035/viewer/2022062309/5697c0071a28abf838cc6139/html5/thumbnails/21.jpg)
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 21
Data query step
Insert valid ADQL (v0.7.?)Assisted query builder this iteration
![Page 22: A PPARC funded project Astro-Wise meeting 06-07 April 2004 OmegaCEN, Kapteyn Institute, Groningen Tony Linde AstroGrid Project Manager University of Leicester](https://reader035.vdocuments.mx/reader035/viewer/2022062309/5697c0071a28abf838cc6139/html5/thumbnails/22.jpg)
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 22
MySpace: virtual storage
Operations: Copy, Delete, Move Upload from file, URL
End-point Multiple servers per manager Usually hidden from user
![Page 23: A PPARC funded project Astro-Wise meeting 06-07 April 2004 OmegaCEN, Kapteyn Institute, Groningen Tony Linde AstroGrid Project Manager University of Leicester](https://reader035.vdocuments.mx/reader035/viewer/2022062309/5697c0071a28abf838cc6139/html5/thumbnails/23.jpg)
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 23
eg Copy file, Upload file
![Page 24: A PPARC funded project Astro-Wise meeting 06-07 April 2004 OmegaCEN, Kapteyn Institute, Groningen Tony Linde AstroGrid Project Manager University of Leicester](https://reader035.vdocuments.mx/reader035/viewer/2022062309/5697c0071a28abf838cc6139/html5/thumbnails/24.jpg)
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 24
Registry: Query
![Page 25: A PPARC funded project Astro-Wise meeting 06-07 April 2004 OmegaCEN, Kapteyn Institute, Groningen Tony Linde AstroGrid Project Manager University of Leicester](https://reader035.vdocuments.mx/reader035/viewer/2022062309/5697c0071a28abf838cc6139/html5/thumbnails/25.jpg)
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 25
Registry detailsConforms to IVOA stdExtended: ApplicationDefinitio
n
AstroGrid CEA
![Page 26: A PPARC funded project Astro-Wise meeting 06-07 April 2004 OmegaCEN, Kapteyn Institute, Groningen Tony Linde AstroGrid Project Manager University of Leicester](https://reader035.vdocuments.mx/reader035/viewer/2022062309/5697c0071a28abf838cc6139/html5/thumbnails/26.jpg)
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 26
Registry harvest
Admin function, so usually invisible
![Page 27: A PPARC funded project Astro-Wise meeting 06-07 April 2004 OmegaCEN, Kapteyn Institute, Groningen Tony Linde AstroGrid Project Manager University of Leicester](https://reader035.vdocuments.mx/reader035/viewer/2022062309/5697c0071a28abf838cc6139/html5/thumbnails/27.jpg)
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 27
Itn05: Complex workflow: AVO Demo
Canned imagesACE
AstroGrid wrapping of SExtractor
VOTMerge AstroGrid VOTable
‘federation’
HyperZ AstroGrid wrapping
of HyperZ
CEA
![Page 28: A PPARC funded project Astro-Wise meeting 06-07 April 2004 OmegaCEN, Kapteyn Institute, Groningen Tony Linde AstroGrid Project Manager University of Leicester](https://reader035.vdocuments.mx/reader035/viewer/2022062309/5697c0071a28abf838cc6139/html5/thumbnails/28.jpg)
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 28
Itn06: Jan 2005 AVO DemoBuild on the Itn05 tool
Image access (SIAP) Add in extra redshift
applications Bpz ANNz
Access wider data resources
WFS GOODS plus IR
Deploy on 'real' machines
Disk Compute
![Page 29: A PPARC funded project Astro-Wise meeting 06-07 April 2004 OmegaCEN, Kapteyn Institute, Groningen Tony Linde AstroGrid Project Manager University of Leicester](https://reader035.vdocuments.mx/reader035/viewer/2022062309/5697c0071a28abf838cc6139/html5/thumbnails/29.jpg)
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 29
Itn06: Solar science case: CMEs
![Page 30: A PPARC funded project Astro-Wise meeting 06-07 April 2004 OmegaCEN, Kapteyn Institute, Groningen Tony Linde AstroGrid Project Manager University of Leicester](https://reader035.vdocuments.mx/reader035/viewer/2022062309/5697c0071a28abf838cc6139/html5/thumbnails/30.jpg)
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 30
Astro-Wise & VObsKey points Make data available Publish metadata
Rapid dissemination (push harvesting) Versioning / describing / retiring of products
Other Pipeline services available
Custom UIs Re-process data
User-derived products Agent interfaces
![Page 31: A PPARC funded project Astro-Wise meeting 06-07 April 2004 OmegaCEN, Kapteyn Institute, Groningen Tony Linde AstroGrid Project Manager University of Leicester](https://reader035.vdocuments.mx/reader035/viewer/2022062309/5697c0071a28abf838cc6139/html5/thumbnails/31.jpg)
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 31
Astro-Wise linksData model IVOA DM group (Jonathan McDowell) AstroGrid Interop group (Anita Richards)
Beta testing AstroGrid software AstroGrid deployment AVO demos
![Page 32: A PPARC funded project Astro-Wise meeting 06-07 April 2004 OmegaCEN, Kapteyn Institute, Groningen Tony Linde AstroGrid Project Manager University of Leicester](https://reader035.vdocuments.mx/reader035/viewer/2022062309/5697c0071a28abf838cc6139/html5/thumbnails/32.jpg)
06-May-2004 Astro-Wise meeting, Kapteyn Institute, Groningen 32
Follow-upBeta testing
Contact Nic Walton
Component Deployment Data Centre MySpace Local Registry Community
Contact Nic Walton
Software cooperation MySpace Workflow Data Centre Registry metadata updating
Contact Tony Linde, Keith Noddle