themis/gbo engineering peer review 1 ucb, oct. 17, 2003 themis preliminary design review november...

THEMIS/GBO Engineering Peer Review 1 UCB, Oct. 17, 2003

THEMISPreliminary Design Review

November 13, 2003

THEMIS ASI Array

Eric Donovan on behalf of the NORSTAR TeamUniversity of Calgary & Athabasca University


THEMIS - Canada

• Motivation for Canadian Involvement

• Prototyping the ASI

• Data Retrieval and Distribution

• Canadian Involvement

• Data Management• Summary • Searching, Sophisticated Analysis• Real-time Website

• Building on Existing Infrastructure


CANOPUS ASI images (one CANOPUS ASI images (one minute cadence; 557 nm filter) minute cadence; 557 nm filter) for the late growth phase, early for the late growth phase, early expansive phase of a substorm. expansive phase of a substorm. The bottom panel is a keogram The bottom panel is a keogram showing high resolution MSP showing high resolution MSP data from the CANOPUS MSP, data from the CANOPUS MSP, also located at Gillam. also located at Gillam.

Note the spiral at 0332 UT, and Note the spiral at 0332 UT, and well defined north-south well defined north-south structure at 0337 UT. Events such structure at 0337 UT. Events such as this illustrate both the as this illustrate both the limitations and advantages of limitations and advantages of ground-based optical ground-based optical observations. The advantage is observations. The advantage is resolution (spatial here, and resolution (spatial here, and temporal not here, but easily temporal not here, but easily obtainable). The disadvantage is obtainable). The disadvantage is limitation to spatial scales smaller limitation to spatial scales smaller than ALL relevant substorm than ALL relevant substorm phenomena.phenomena.


THEMIS & Canada


THEMIS - Canada








Deployment


Existing “backbone” internet (BEST) ATHA, CONT (Ekati), CHUR, INUV, FSMI, ….ATHA, CONT (Ekati), CHUR, INUV, FSMI, ….

Local ISP & RF Link

[A]DSL Telus, Manitoba Telecom, Aliant, …..

Hardcopy via traditional mail

3k 1k/yr

5k 9k/yr

0.1k 1k/yr

8k 3k/yr

FSIM, INUV, FSMI, RANK, PBQ (2005+), …FSIM, INUV, FSMI, RANK, PBQ (2005+), …

PGEO, ATHA, FLIN, PINA, KAPU, HEBR, CART, ….PGEO, ATHA, FLIN, PINA, KAPU, HEBR, CART, ….

Telesat HSI Canadian Satellite

NOT INUVNOT INUV

“VSAT” 45k 1k/yr All sitesAll sites

Glentel, Nanometrics, PolarSat, Stratos, ….

Never fails (well almost never); Not at all sexy!Never fails (well almost never); Not at all sexy!

Sta

ndar

d In

tern

et

Dial up to local ISP

All sites; Not real time; Not very sexy.All sites; Not real time; Not very sexy.

0.1k 1k/yr

1k 1k/yr

Telus Cell Phone (Really)

Many sites in BC and Alberta (MacMurray, P. George, High Level ….)Many sites in BC and Alberta (MacMurray, P. George, High Level ….)

0.1k 1k/yr

Data Recovery


• 5 imagers 2003-2004 • 5 imagers 2004-2005• 6 imagers 2005-2006

• Mike Greffen (Team Leader)• Trond Trondsen• Mikko Syrjäsuo• Brian Jackel• Hercules Olivier• Eric Donovan• Igor Voronkov• P. T. Jayachandran

Canadian Personnel Involved in Deployment

Deployment Milestones for Canadian ASIs

DeploymentDeployment


U. Calgary Heritage & Team

• ISIS II Scanning Photometer• Other ground-based instruments (MSPs; FP; Spect.; First ASI, POCA)• CANOPUS (ASI; MSPs; Communications Infrastructure)• Viking UV• Freja UV• Interball II UVAI• Nozomi TPA• Numerous rocket optical and particle instruments• NORSTAR• MIRACLE ASI array (experience via Mikko Syrjäsuo)• Portable Auroral Imager; High Speed Photometer; Induction Coil Mags

Brief History of Relevant U. Calgary Space Group Experience


Canadian THEMIS ASI Team

• Eric Donovan (Team Leader).• Brian Jackel, Trond Trondsen (ASI specialists; Space Scientists)• Mikko Syrjäsuo (ASI specialist; Machine Vision)• Noora Partamies (PDF – as of 2004)• Leroy Cogger (senior advisor)• Mike Greffen (Deployment, Site Manager, Operations, Public Outreach)• Emma Spanswick (riometers, NORSTAR/THEMIS Web Site Project Manager)• Hercules Olivier (Electrical Engineering; Communications; Operations)• Cliff Marcellus, Greg Enno, Peter King (Technical/Engineering support as needed)

U. Calgary

Athabasca U.• Martin Connors (Athabasca Geophysical Observatory - PI).• TBD (Technician and Site Manager)

Contractors• Fokke Creutzberg (Keometrics – MSP Specialist)• Don Wallis (Magnametrics – Riometer Specialist)


THEMIS - Canada








Starlight Xpress MX716 w/all-sky optics

Linux Red Hat 9 w/MX716 driver

Image interval 5 sec; 1-sec exposures

NORSTAR/MIRACLE imaging code

Web server provides real-time access

Network time protocol

Instrument & Housing

Deployed at Athabasca Summer ‘03

Assessment by Calgary Team Fall ‘03


Athabasca Alberta

Deployment


http://www.phys.ucalgary.ca/NORSTAR/themis/data/Movies/

athabasca_2003_10_04.mov


THEMIS - Canada








Existing “backbone” internet (BEST) ATHA, CONT (Ekati), CHUR, INUV, FSMI, ….ATHA, CONT (Ekati), CHUR, INUV, FSMI, ….

Local ISP & RF Link

[A]DSL Telus, Manitoba Telecom, Aliant, …..

Hardcopy via traditional mail

3k 1k/yr

5k 9k/yr

0.1k 1k/yr

5k 3k/yr

FSIM, INUV, FSMI, RANK, PBQ (2005+), …FSIM, INUV, FSMI, RANK, PBQ (2005+), …

PGEO, ATHA, FLIN, PINA, KAPU, HEBR, CART, ….PGEO, ATHA, FLIN, PINA, KAPU, HEBR, CART, ….

Telesat HSI Canadian Satellite

NOT INUVNOT INUV

“VSAT” 45k 1k/yr All sitesAll sites

Glentel, Nanometrics, PolarSat, Stratos, ….

Never fails (well almost never); Not at all sexy!Never fails (well almost never); Not at all sexy!

Sta

ndar

d In

tern

et

Dial up to local ISP

All sites; Not real time; Not very sexy.All sites; Not real time; Not very sexy.

0.1k 1k/yr

1k 1k/yr

Telus Cell Phone (Really)

Many sites in BC and Alberta (MacMurray, P. George, High Level ….)Many sites in BC and Alberta (MacMurray, P. George, High Level ….)

0.1k 1k/yr

Data Recovery


Data Recovery


THEMIS - Canada








CGSM - NowCGSM - Now


CGSM - EnhancedCGSM - Enhanced


THEMIS - Canada





• Data Management• Summary • Searching, Sophisticated Analysis• Real-time Website• CDF files & FTP tree



Station

Imager

Filters

Summary Images

Calibration Data

Classification

Top 60

Entire Dataset

Name, location, mag midnight, history of operation, …

Rel

atio

nal D

atab

ase

--

130

GB

Online publicly accessible storage of complete high-res data for subset of nights of greatest interest for mission scientific objectives (ie., the Top 60 Substorms).

Great big pile of data online & in hardcopy at UCalgary and at UCB. This will not be culled.

THEMIS ASI UCalgary Data Management


Mapping


Thumbnails


Merging in Real Time


Data Summary


Data Searching

Machine Vision – Content Based Image Retrieval

We are exploring automatic classification of images, rapid retrieval of images from large datasets, and determination of motion of auroral forms, all using sophisticated machine vision techniques.

This classification and CBIR exercise reduces each image to a 48 element feature vector.


A classification of 300000 CANOPUS Gillam ASI images yielded these magnetic local time occurrence distributions for arcs, patches and omega bands. This took about 6 hours on a 1.5 GHz pentium. An equivalent manual survey, which yielded the same results, took 4 months of dedicated effort by a student (who miraculously stayed in the field!). This figure from Syrjäsuo and Donovan [Ann. Geophys., in press].

Data Searching


Optical Flow – a technique in which two-dimensional velocity distributions are obtained from image sequences [Partamies, Syrjäsuo, Janhunen (FMI), Hiebert].

Other techniques under development include…

Tomography – sophisticated technique to infer heights from multiple overlapping fields of view [Jackel, Donovan, Partamies].

Energy Flux Determination – modification Janhunen [2001] method for THEMIS imagers to estimate energy flux [Partamies, Donovan, Janhunen (FMI)].

Data Analysis


Data Distribution

Our contribution to distribution of THEMIS data will be carried out through the THEMIS webpage on NORSTAR-WEB.

We will display real time data products as well as housekeeping information vital to keeping downtime to a minimum.

All summary data, summary images, merged thumbnails, as well as tools for accessing the relational database will be publicly accessible (CDF files on our server FTP tree mirrored at UCB).

The “top 60’’ full time and space resolution image data base will be freely accessible to all THEMIS team members.

The complete full time and space resolution image data base will be publicly accessible via temporary passwords that will be granted in response to specific data requests.


THEMIS CANADA WEB

http://www.phys.ucalgary.ca/NORSTAR/themis/themis_main.html


THEMIS CANADA WEB


• Real-time Merged Webpage 2004• Archive structure 2004• Summary database 2005• Relational database 2006

• Eric Donovan• Trond Trondsen• Mikko Syrjäsuo• Brian Jackel

Canadian Personnel Involved in ASI Data Management

Development Milestones for Data Management

themis/gbo engineering peer review 1 ucb, oct. 17, 2003 themis preliminary design review november...

Documents