how to: spin up apache oodt faster with radix

12
HOW TO: Spin Up Apache OODT Faster with RADiX Paul Ramirez & Cameron Goodale NASA – Jet Propulsion Laboratory November 9 th , 2011

Upload: benjy

Post on 23-Mar-2016

36 views

Category:

Documents


1 download

DESCRIPTION

HOW TO: Spin Up Apache OODT Faster with RADiX. Paul Ramirez & Cameron Goodale NASA – Jet Propulsion Laboratory November 9 th , 2011. Our Background. Cameron Goodale NASA – Jet Propulsion Laboratory (6 years) Software Engineer Your area of interest Geospatial / Data Visualization - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: HOW TO: Spin Up Apache OODT Faster with  RADiX

HOW TO: Spin Up Apache OODT Faster with RADiX

Paul Ramirez & Cameron Goodale NASA – Jet Propulsion Laboratory

November 9th, 2011

Page 2: HOW TO: Spin Up Apache OODT Faster with  RADiX

Our Background Cameron Goodale NASA – Jet Propulsion

Laboratory (6 years) Software Engineer Your area of interest• Geospatial / Data

Visualization • Python• Working on my Road

Racing License

Paul Ramirez NASA – Jet Propulsion

Laboratory (10 years) Software Engineer Your area of interest• Geospatial • Search• Java• My family (wife, son, 2

dogs)

Page 3: HOW TO: Spin Up Apache OODT Faster with  RADiX

Roadmap Apache OODT – Brief Intro Working With OODT What is RADiX Technical Details RADiX your next OODT Deployment

Page 4: HOW TO: Spin Up Apache OODT Faster with  RADiX

Apache OODT Data Management System (DMS) Framework History at JPL Medical, Astronomy, Climate Research, etc… Collection of Loosely Coupled Components

Crawler File Manager Workflow

Driven by Metadata and Product Types

Page 5: HOW TO: Spin Up Apache OODT Faster with  RADiX

Working With OODT Now Download the source and build Grab one of the component distribution

tarballs Install and Configure

Repeat for each component you want For our webapps grab the war and configure User ensures that configuration matches

across components Launch each of the components individually

Page 6: HOW TO: Spin Up Apache OODT Faster with  RADiX

Using OODT Crawler Actions Metadata Extractors Versioners Tasks Configuration

Crawler Policy FileManager Policy Workflow Policy PGE (Product Generation Executive) Configuration

Page 7: HOW TO: Spin Up Apache OODT Faster with  RADiX

RADiX What and Why Distribution of Apache OODT Define deployment and development Reduce ramp up time Eliminate confusion with documentation Eliminate some configuration Focus on data management Focus on component extensions Bored of repeating Create shared experience

Page 8: HOW TO: Spin Up Apache OODT Faster with  RADiX

RADiX Technical Details Uses Apache Maven 2.2 Maven Archetype

Used to drive creation of a template OODT project

Resultant project can be used for development

Maven Assembly Descriptor

Page 9: HOW TO: Spin Up Apache OODT Faster with  RADiX

OODT RADiX in Action % wget http://www.apache.org/dist/oodt/radix-0.4.tgz

% tar –xzvf radix-0.4.tgz

% export PATH=${PATH}:/usr/local/radix

% oodt-radix my-oodt-dms my.package.name

% ./deploy/bin/oodt_pcs start

% ls

deploy mvn-repo my-oodt-dms

Page 10: HOW TO: Spin Up Apache OODT Faster with  RADiX

What did that give me? Deployment of OODT Sample configuration to show things in

action Development structure that you can

check in That’s it for now

Page 11: HOW TO: Spin Up Apache OODT Faster with  RADiX

Closing Remarks Available in OODT 0.4 Worked under OODT-140 https://cwiki.apache.org/confluence/

display/OODT/RADiX+Powered+By+OODT Future Work

Screencasts Integrate more components More documentation and links to existing

Promote deploying with RADiX

Page 12: HOW TO: Spin Up Apache OODT Faster with  RADiX

Contact Cameron Goodale• [email protected]• @sigep311

Paul Ramirez• [email protected]• @pramirez624