iti final presentations’ day satellite data dissemination via jpeg2000 and java technologies

ITI Final Presentations’ DaySatellite Data Dissemination via JPEG2000 and Java Technologies

D. Burridge 16th October 2007

Visual Information Solutions

Agenda

1. Context

2. Objectives

3. Implementation

4. Project Information

5. Results

6. Demonstration


Context

• Satellite data size increasing

• Dissemination via Internet

• Bandwidth increasing but variable

• Web Services use becoming more widespread

• Standards for image/geographic data services– OGC

– JPEG2000/JPIP

• Searching multiple servers currently an issue


Objectives I

• Stakeholders– EUSC

– DMCII

– Spacemetric AB

– Dartcom

• Letters of Intent

• Questionnaires

• Requirements Capture

• Stakeholder Reviews


Objectives II - Requirements

• Timeliness: Sensor to end-user time– JPEG2000 Compression

• Connectivity, interoperability and cost– Standards-based, application server (JBoss)

• Availability, robustness, scalability and extensibility– J2EE Enterprise-level SOA


Objectives III - Use Cases

• Administer System– Administer Data (via Web Client or Web Service)

– Log File / Performance Metrics Analysis

– Administer Users

• Retrieve Imagery– From WCS

– From WFS

– From WMS

• Stream Imagery


Implementation

• Features

• Architecture

• System Components


Implementation I – System Features

1. JPIP Streaming

2. Web Coverage Service

3. Web Map Service

4. Web Feature Service

5. OGC Catalogue Service

6. Data Encryption

7. Authentication & Authorization

9. Load Balancing

10.Fault Tolerance

11.Cluster Administration

12.EJB Component Administration

13.User Account Administration

14.System Auditing

15.SOAP Administration Services

16.Multi-platform server support:

1. Windows

2. Linux


Implementation II – Features vs Use Cases

ID Feature Use Case

1 JPIP Streaming Stream Image

2 Web Coverage Service Retrieve from Web Coverage Service

3 Web Map Service Retrieve from Web Map Service

4 Web Feature Service Retrieve from Web Feature Service

5 OGC Catalogue Service All

6 FTP Retrieve from a File Server

7 Data Encryption Retrieve Imagery

8 Authentication & Authorization Log In

9 Load Balancing Retrieve Imagery

10 Fault Tolerant Retrieve Imagery

11 Administer Cluster Administer System

12 Administer J2EE EJB components Administer System

13 Administer User Accounts Administer System

14 Audit System Administer System

15 SOAP administration services Administer System, Retrieve Imagery

16 System runs on Windows

17 System runs on Linux


Implementation III - Server Architecture

Client(s) Remote Data Server(s)Osprey Server Deployment

OGC Client

JPIP Client(e.g. Kakadu)

Osprey Client(Web Browser)

OGC via HTTP

JPIP via HTTP

HTML via HTTP

JPIP Server

OpenGIS Server

OGC

FTP Server

CatalogueInterface

FTP

Osprey Server DatabaseOGC via HTTP

JPIP via HTTP

Monitoring Client(Web Browser)

HTML via HTTP

JPEG 2000Local Cache


Implementation IV - System Components

• Main Applications– OMAR: ebXML Registry-Repository– POSTGRES/PostGIS: Geospatial Database– JBOSS: HTTP Server/ EJB Container– GeoServer W*S

• Supporting Applications– Java– Subversion– OpenSSL– Maven– JWSDP– Swig– Ant– JAI & JAI Image I/O– GDAL


Project Information

• Development Team

• Work Packages

• Milestones


Project I – Development Team

• ITT VIS Project Team– David Burridge Scheduling, Reporting

– Norman Barker Design, Development

– Peter Giacovelli Integration, Testing, Deployment

– Graham Thackrah Infrastructure

• Subcontractors– OSGEO GDAL Library Enhancements

– Geosolutions Catalogue Development


Project II – Work Breakdown Structure

ESA Osprey Project

DesignWP1100

ImplementationWP1200 – WP1900

TestingWP2000

Management of Activity WP2100

GeoTIFF EJB ConverterWP1200

GML in JPEG2000WP1300

Client Converter & Mon Tool WP1400

W*S Front & Back End Import WP1500

J2EE ClusterWP1600

JPIP Streaming ResourceWP1700

Client ApplicationWP1800

Catalogue IntegrationWP1900

Internal System TestWP2000(a)

Customer System TestWP2000(b)

Project ManagementWP2100(a)

Final report PreparationWP2100(b)

InfrastructureWP1100(a)

RequirementsWP1100(b)

High-Level DesignWP1100(c)

Low-Level DesignWP1100(d)

Questionnaire

Analysis

Prototypes

InfrastructureWP1100(e)


Project III – Milestones

Date Status

M1: Kick-off (35%) 27th Mar 06 Complete

M2: Infrastructure Ready 31st Mar 06 Complete

M3: User Requirements Defined 26th May 06 Complete

M4: Interim Delivery (35%) 15th Aug 06 Complete

M5: Development Complete 7th Jul 07 Complete

M6: Final Delivery (30%) 21st Sep 07 In Progress


Results - System Functionality

• Publish– Upload image data to JPIP streaming service

– Register existing W*S service with catalogue

• Search– Query catalogue via web-based form

– Map tool to facilitate geographic subset query

– Ability to specify service source type (WCS, JPIP, etc)

• Discover– Query results displayed in web page

– Preview displayed for image data

– Click to access selected data

• Retrieve– Data is downloaded to preferred client (browser-based or standalone)


Demonstration – Catalogue Search

Geospatial Query

Attribute Query


Demonstration – JP2K Conversion Service

JPIP Server URL

Source file

JPIP Conversion Profile


Demonstration – JP2K Streaming / Display

JPIP Viewer Client (chosen by user)

Data streamed from Osprey into viewer


Demonstration – WMS Registration


Demonstration – WMS Data Query Results


Demonstration – WFS Registration


Demonstration – WFS Data Query Results


Demonstration – WCS Registration


Demonstration – WCS Data Display


Demonstration – WCS to JP2K Conversion


Demonstration – JP2K Display of WCS Data


Demonstration – Displaying Maps & Features (1)


Osprey Server Deployment Status

• Osprey Deployed on 3 Servers– ESA (issues with libraries on 64-bit RHEL)

– ITT VIS Test

– Geo-Solutions

• Remaining Deployment Tasks– Complete ESA Server Deployment (in progress)

– EUSC Stakeholder Deployment (in progress)

– Stakeholder Reviews (in progress)

iti final presentations’ day satellite data dissemination via jpeg2000 and java technologies

Documents

web client

imagery16 system

windows17 system

variableweb services

clusteradminister system12

geospatial databasejboss

java technologiesd