the telescience project - atomic (applications to middleware interaction components) transparent...
TRANSCRIPT
The Telescience Project - ATOMIC (Applications to Middleware Interaction Components)
https://telescience.ucsd.edu
Transparent Grid Access for Scientific Communities
Jason [email protected]
Abel W. [email protected]
National Center for Microscopy and Imaging Research
University of California San Diego
Scales of NS data from Maryann MartoneScales of NS data from Maryann Martone
Mission:
Develop and implement technologies to determine and
reveal supramolecular details in their cellular and tissue contexts.
NCMIR forges innovations in CI and IT to enable solutions
for grand challenges in biomedical imaging research
NCMIR is an Accessible Resource Center for
Advanced Biomedical Research Fielding High-throughput Imaging Instruments, Computational
Analysis Tools and Databases
The Telescience Core Methodology
Partnership
RemoteInstrumentation
Databases &Digital Libraries
Computation
VisualizationNetwork
Connectivity
Training and Dissemination
Integrate resources, technologies and applications using standardized Grid middleware technologies and advanced
networking to provide an end-to-end solution for challenges like multi-scale biomedical imaging.
Interacting with the Grid
Portal and Applications
NMI
Compute Resources
Interaction with Middleware appears to be unified ...
MyProxy
Portals and Applications
CoG GridPort
Globus
GridFTP GRAM MDSSRB NWS
Physical Resources
CAS
Grid Security Infrastructure
CACL
Pegasus
LDAP
DataCutter
Condor(-G)
but is actually very fragmented
For example, some or all, of these components are necessary for end-to-end computation
Portal and Applications
Physical Resources: Data Storage, Compute Resources, etc.
Telescience ATOMIC bridges the Gap betweenmiddleware and applications
Local (Services): GSI, Globus, Condor, RLS, SRB, NWS, etc.
Collective Services : MyProxy, Pegasus, DataCutter, GridFTP, etc.
ATOMIC
Telescience Portal and Applications
ATOMIC provides tools for users and developers
Provides an intuitive GUI for end-users to launch jobs and manage data
ATOMIC: TeleAuth/GAMA, TeleWrap, TeleRun, etc.
Provides a programming interface and other tools for developers (Telescience Portal and others) to access to
Telescience Grid (compatible with other Scientific Grids).
Telescience is reducing the threshold to the use of Grid technologies
Gridsphere Portals framework serves as a rich GUI for end-users (bench scientists)
ATOMIC services scientific applications developers (mathematicians, physicists, etc…)
ATOMIC supports legacy applications and native grid applications with equal intensity.
Motivation for ATOMIC: The Grid should be brought to bear for scientific processes...scientific processes should not necessarily have to conform to the Grid
Telescience spurs development, integration, and interoperability along all levels of CI
Telescience is realized in the context of microscopy but extendsdirectly to analogous applications that are data and compute intensive
and require parity between computers and instruments
This model is for all data generator devices: microscopes (EM/LM), shaker tables, particle accelerators, oceanic observers, ecological
sensor networks
Telescience Infrastructure
Richly integrated user environment
ATOMIC: applications (portal) enabler
NMI
Data Devices: generate, compute, store
ATOMIC Bundles Available
GAMA/TeleAuth: End-to-End GSI Security
TeleWrap: Transparent Data Grid I/O for applications
TeleRun: Information Gathering for Globus/MPI based applications
GAMA/TeleAuth
GAMA is complete GSI credential management and integration solution tailored for use in emerging cyberinfrastructure through web portals or web
service-based clients.
GAMA makes grid security as easy to use as any commercial web site while maintaining the security and delegation capabilities of GSI.
Interactive Applications: TeleWrap
ATOMIC also motivated by Data Generation and Computation Resources and Requirements
Heterogeneity places increase burden on application developers
Telescience CA recently
accepted by TeraGrid (1st
non-CS organization)
Utrecht Univ./ SARAOsaka Univ.KBSI/KISTI
NCHC
Portals
“The portal ecosystem and portal fabric will become the dominant models of application delivery by 2005."
- Gartner Research Group
Telescience Portal is built on the JSR168 GridSphere Project:
• extends the suite of richly integrated, grid enabled tools for the end user
• provides a new level of flexibility, customization, and seamless (administration free) harnessing of the power of global grids
• accomplishes this while also reducing the complexity of its own creation and management.
• amplifies the extensibility of its underpinnings to other scientific domains with analogous needs.
Portals: Single Sign-On
Portals: Launching Heterogeneous GridApplications
No CS information, onlybiologically relevant parameters
Portals: Data Grid Acces
ATOMIC is built out of Applied Experience, not only leading CS concepts…
ATOMIC is more than just a packaging of technologies, it is the bundling of nearly a decade of interdisciplinary experience in bringing these
technologies to bear for scientific applications.
Especially critical at this juncture, given the growing sophistication of GUI interface components
Future activities
• ATOMIC Web/Grid Services
• Extension of GTS (Generalized Telemicroscopy System) as ATOMIC-based services
• Telescience ATOMIC "Rocks Rolls"
For more information:https://telescience.ucsd.eduhttp://ncmir.ucsd.edu
Acknowledgments
Expressing and Executing Workflows
Laboratory Process
Application Pipelines
Recruit Subject Scan Visit Subject Analysis Group Analysis
Pre-Processing
Analysis
Post-Processing
Localizer
Structural
Functional