welcome! day 1. facility overview entering and exiting – rear entrance is closest to the...

62
Welcome ! DAY 1

Upload: esmond-owens

Post on 25-Dec-2015

219 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

Welcome!

DAY 1

Page 2: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

Facility Overview

• Entering and Exiting– Rear entrance is closest to the auditorium– Perimeter doors are not secure– Do not exit through the auditorium rear

emergency doors• Restrooms

– Located near the 2nd floor front entrance, left of the double doors

• In Case of Emergency– Please exist through the rear doors of the

auditorium and proceed down the rear stairwell

Page 3: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

Facility Overview

• Security– Be sure to sign in at the beginning of each day– Entrance into a Raytheon work area will require a Raytheon escort

• Parking– No visitor parking registration is needed– Please park in unmarked spots to avoid being towed

Page 4: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

Workshop Overview

• Food & Drink– Food and Drink are allowed in the auditorium.

• Breaks & Lunches– Periodic breaks will be provided during the workshop– Lunch will be brought in for those who pre-registered

• Wireless Access– Access to the RaytheonVAG wireless network requires a user name and

password• Pre-registered attendees will have an account provided

• Teleconferencing– The ECHO teleconference # (877.973.2179 Passcode 770291) will be used– A WebEx live session will also be available. Details provided separately.

• Discussions– Questions should be asked as the presentations proceed.– Some discussions may be tabled for the designated Q&A periods

Page 5: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

Agenda Overview

• Day One– 9:00am ~ 4:30pm– Focus entirely on Reverb discussion topics including:

• Reverb Showcase• Reverb Functional Overview• Reverb Automation• Reverb Technical Topics• WIST2REVERB Transition• Reverb Future Changes

• Day Two– 9:00am ~ 12:00pm– Focus shifted to ECHO engineering topics including:

• Upcoming ECHO Changes• Upcoming Operational Activities

Page 6: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

ECHO Organization

Tim Ortiz (Program Manager)

Lisa Pourkhomami

(Dev Lead)

Bob Hartranft (DBA Lead)

Marcus White* (SA Lead)

Ayanna Dennis* (OPS Lead)

Art Cohen (Task 3 Lead)

(Release Manager)

Dan Pilone (Tech Lead)

Matt Cechini (Sys Engineer)

Page 7: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

ECHO TEAM INTRODUCTIONS

Page 8: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

Reverb MVP Award

• Honorable Mentions– Kelly Lemig – 42 NCRs– Jon Pals – 17 NCRs– Dawn Siemonsma – 15 NCRs

• Sample Bug Report

PETER GIBBONSMVP

Page 9: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

OPERATIONS STATUS

Page 10: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

ECHO Partner Status

• Current Holdings – Collections 3,227– Granules 94 million – Browse 35 million (internal) / 22 million (external)

• Data Partners– Operational: 13

• ASF, GHRC, GSFC, LAADS, LARC (ECS), LARC (ANGe), LPDAAC, NSIDC (ECS), NSIDC (V0), PODAAC, ORNL, SEDAC, USGS_EROS

– Test: 1 • CDDIS

• Client Partners– Operational 5

• WIST, ESA, MTMGW, GMU, ECHO-ESIP– In evaluation or test 6

• MIRADOR (OpenSearch), YOTC (OpenSearch), Reverb, SCS3, Mercury, CWIC

– Development/Design 3• AVAPC, J-Earth, PO.DAAC

Page 11: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

ECHO Client Usage (1 of 2)

02/06 - 02/12

02/13 - 02/19

02/20 - 02/26

02/27 - 03/05

03/06 - 03/12

03/13 - 03/19

03/20 - 03/26

03/27 - 04/02

04/03 - 04/09

04/10 - 04/16

04/17 - 04/23

04/24 - 04/30

05/01 - 05/07

WIST

7786 7141 9103 6882 8172 9846 9047 9025 10704 11462 10253 8693 10263

Reverb (Ops)

NaN NaN NaN 37 137 8 43 559 397 401 273 163 190

1000

3000

5000

7000

9000

11000

13000

WIST & Reverb Granule Queries

Page 12: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

ECHO Client Usage (2 of 2)

02/06 -

02/12

02/13 -

02/19

02/20 -

02/26

02/27 -

03/05

03/06 -

03/12

03/13 -

03/19

03/20 -

03/26

03/27 -

04/02

04/03 -

04/09

04/10 -

04/16

04/17 -

04/23

04/24 -

04/30

Reverb (Ops)

NaN NaN NaN 37 137 8 43 559 397 401 273 163

ING (ESA)

82 193 184 312 333 9 6 83 256 194 179 253

GMU

247 162 80 64 31 111 57 81 236 68 297 72

MTMGW

0 0 0 0 0 0 0 0 0 0 0 0

SNOWI

0 1 0 2 0 1 3 0 0 0 2 2

Mercury

17 96 178 199 185 152 361 26 17 170 34 56

SCS3

0 0 0 0 0 0 0 0 0 0 0 0

AVAPC

0 0 0 0 0 0 0 0 0 0 0 0

Mi-rador/Giovanni

2 4 4 3 0 2 2 2 0 0 0 0

ESIP (OPS)

53 58 67 70 55 51 83 287 118 307 65 21

ESIP (TBD)

2 15 0 0 3 0 3 718 0 0 11 0

Reverb (TBD)

235 183 146 79 127 151 176 186 105 65 305 146

Other

28 64 29 8 118 43 33 0 10 23 56 9

250

750

1250

1750

2250

Non-WIST Granule Queries

Page 13: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

Query Performance

02/06 -

02/12

02/13 -

02/19

02/20 -

02/26

02/27 -

03/05

03/06 -

03/12

03/13 -

03/19

03/20 -

03/26

03/27 -

04/02

04/03 -

04/09

04/10 -

04/16

04/17 -

04/23

04/24 -

04/30

05/01 -

05/07

Avg Exec Time

20.08 15.19 14.02 14.18 12.03 15.27 13 12.05 14.85 17.45 13.18 11.21 9.77

Exec Time Std. Dev.

67.42 51.26 24.04 40.69 29.52 59.81 28.33 26.88 37.67 86.39 38.78 22.78 21.36

Avg Exec Time

20.08 15.19 14.02 14.18 12.03 15.27 13 12.05 14.85 17.45 13.18 11.21 9.77

Exec Time Std. Dev.

67.42 51.26 24.04 40.69 29.52 59.81 28.33 26.88 37.67 86.39 38.78 22.78 21.36

5

15

25

35

45

55

65

75

85

95

Average Query Performance

Se

co

nd

s

Page 14: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

Order Metrics (1 of 2)

*All orders submitted by WIST.

11/21 - 11/27

11/28 - 12/04

12/05 - 12/11

12/12 - 12/18

12/19 - 12/25

12/26 - 01/01

01/02 - 01/08

01/09 - 01/15

01/16 - 01/22

01/23 - 01/29

01/30 - 02/05

02/06 - 02/12

ASF 0 0 0 0 0 0 0 0 0 0 0 0

GHRC 0 1 3 1 0 3 1 4 1 3 8 0

LAADS 131 143 108 98 87 52 76 89 105 85 64 68

LARC 7 15 7 3 3 0 6 6 16 23 3 21

LARC_ASDC

3 3 2 1 1 2 7 7 5 1 2 1

LP-DAAC_ECS

1083 978 1008 1049 766 881 987 1140 1221 1199 952 1062

NSIDC_ECS

121 79 116 102 84 52 67 109 88 142 100 108

ORNL_DAAC

0 0 1 0 1 0 2 0 0 1 0 1

USGS_EROS

23 22 22 20 21 5 19 17 16 23 41 32

100

300

500

700

900

1100

1300

1500

02/13 - 02/19

02/20 - 02/26

02/27 - 03/05

03/06 - 03/12

03/13 - 03/19

03/20 - 03/26

03/27 - 04/02

04/03 - 04/09

04/10 - 04/16

04/17 - 04/23

04/24 - 04/30

05/01 - 05/07

ASF 0 0 0 0 1 0 0 0 0 0 0 1

GHRC 5 2 1 1 2 7 6 4 0 2 1 4

LAADS 69 154 129 65 119 95 78 94 162 118 145 141

LARC 2 13 24 16 30 32 9 9 22 15 6 3

LARC_ASDC

4 2 1 8 3 9 7 7 15 4 0 2

LP-DAAC_ECS

1412 1538 1277 1441 1395 1466 1587 1378 1516 1480 1386 1369

NSIDC_ECS

100 142 198 179 135 150 118 158 196 204 124 110

ORNL_DAAC

2 0 1 2 0 2 3 0 0 1 1 0

USGS_EROS

26 29 17 20 15 23 38 24 22 24 14 36

250

750

1250

1750

2250

Axis Title

Page 15: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

Order Metrics (2 of 2)

03/13 - 03/19

03/20 - 03/26

03/27 - 04/02

04/03 - 04/09

04/10 - 04/16

04/17 - 04/23

04/24 - 04/30

WIST

1687

1765

1766

1606

1900

1774

1651

Reverb

Other

Bulk Download

100

300

500

WIST vs. Reverb Orders & Downloads#

Ord

ers o

r Dow

nloa

ds

Page 16: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

Ingest Activity

11/21 - 11/27

11/28 - 12/04

12/05 - 12/11

12/12 - 12/18

12/19 - 12/25

12/26 - 01/01

01/02 - 01/08

01/09 - 01/15

01/16 - 01/22

01/23 - 01/29

01/30 - 02/05

02/06 - 02/12

ASF 383861 198694 199294 192384 287619 20994 1 0 0 199996 381512 1276

GHRC 52 175 671 118 52 49 42 726 141 51 1504 875

GSFC-S4PA

26881 35976 71696 69849 32631 31867 31305 98684 46337 67253 46558 62601

LAADS 29277 35180 34679 91887 36069 35303 87184 203080 50195 35753 103884 45877

LARC 21536 42295 49781 37892 24161 23760 33611 72055 22095 21200 53963 43753

LARC_ASDC

2252 3550 76240 4515 715 0 9166 3591 8169 9951 3982 294837

LP-DAAC-ECS

110566 928287 466030 115325 80945 137081 91971 347116 197785 460501 251811 508880

NSIDCV0

14 0 3 3 12 2 1 16 0 1 3 257

NSIDC-ECS

30965 64639 43950 200147 306378 55381 193388 348489 41209 28017 71090 63224

ORNL-DAAC

0 0 0 0 0 0 0 0 0 0 0 0

PO-DAAC

0 0 8 0 0 0 0 0 0 0 0 0

SEDAC 0 0 0 0 0 0 0 0 0 0 0 0

USGS_EROS

114207 119129 393095 140877 212707 115865 302574 308168 252095 124458 117277 91726

100,000

300,000

500,000

700,000

900,000

1,100,000

1,300,000

1,500,000

- 02/0602/12

- 02/1302/19

- 02/2002/26

- 02/2703/05

- 03/0603/12

- 03/1303/19

- 03/2003/26

- 03/2704/02

- 04/0304/09

- 04/1004/16

- 04/1704/23

- 04/2404/30

- 05/0105/07

ASF 1276 2339 11931 5322 6339 11717 10582 26632 3291 11018 14132 60990 44271

GHRC 875 6968 13627 67 906 250 59 54 53004 406 75 9353 29

-GSFCS4PA

62601 73670 51778 102600 95946 93940 40457 61683 57305 43214 33340 47003 267260

LAADS 45877 30155 34044 24923 35948 34836 30258 30046 28677 49265 32793 31022 34005

LARC 43753 21497 20261 34128 22030 21715 21870 89459 54096 22382 23653 21124 60419

_LARCASDC

294837 316793 19327 158743 210497 316514 95561 10769 10858 5439 7809 7124 3702

LP--DAACECS

508880 184229 200690 157411 105205 215700 166051 140288 178571 233698 436679 376592 972054

NSIDCV0

257 10 5 3 6 3 3 3 0 9 13 4 1

-NSIDCECS

63224 230860 784232 69718 26451 80883 1051600 878064 220676 76799 33967 33041 120397

-ORNLDAAC

0 0 0 0 0 0 0 0 0 0 0 0 0

PO-DAAC

0 41 0 0 0 0 0 0 0 4829 2 265851 0

SEDAC 0 0 0 0 0 0 0 0 0 0 0 0 0

_USGSEROS

91726 257020 76647 69199 73342 233905 83074 60878 131441 242253 122929 150048 216102

100,000

300,000

500,000

700,000

900,000

1,100,000

1,300,000

1,500,000

1,700,000

1,900,000

Rejections 25%. <

Page 17: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

ECHO Availability

Feb-09

Mar-09

Apr-09

May-09

Jun-09

Jul-09

Sep-09

Oct-09

Nov-09

Dec-09

Jan-10

Feb-10

Mar-10

Apr-10

May-10

Jun-10

Jul-10

Aug-10

Sep-10

Oct-10

Nov-10

Dec-10

Jan-11

% Available

0.997

0.993

0.985

1 0.999

1 0.9938

0.9969

0.9902

0.9998

0.9457

0.991

0.993

1 1 1 1 0.9996

1 0.9996

1 1 1

Downtime

15 16.25

8 7 1 8.75

2 4 11 4 12 7.75

16.5

6 4 4 3.5 1 0 0.25

3.66

0 0

94.5%

95.5%

96.5%

97.5%

98.5%

99.5%

1

3

5

7

9

11

13

15

17

% A

vaila

ble

Du

rin

g M

on

th

Ho

urs

*ECHO HA solution deployed in March 2009** % Availability does not include PM (Up to 4 hours / week) outages

*** Downtime (Hours) _does_ include PM outages

Apr-10 May-10 Jun-10 Jul-10 Aug-10 Sep-10 Oct-10 Nov-10 Dec-10 Jan-11 Feb-11 Mar-11 Apr-11 May-11

% Available

1 1 1 1 0.9996 1 0.9996 1 1 1 1 1 1 1

Downtime

6 4 4 3.5 1 0 0.25 3.66 0 0 4.5 0 0 0

99.52%

99.58%

99.63%

99.68%

99.73%

99.78%

99.83%

99.88%

99.93%

99.98%

0.5

1.5

2.5

3.5

4.5

5.5

6.5

% A

vaila

ble

Durin

g M

onth

Hour

s

Page 18: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

PROCESS OVERVIEW

Page 19: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

ONE GOAL

Page 20: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

BUILD THE RIGHT SOFTWARE

Page 21: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

Original Approach

Testbed• Alpha Release every 2

weeks• Open to the public• Early feedback• 20% Dev Time Reserved

for feature request and prioritization

Partner Test (Beta)• Early beta – approx Feb

2011• Open to the public with

WIST announcement• Solicit public input on

Reverb prioritization

Operational• May 2011• Already have a base of users

from beta testing• Smooth (ideally non-existent)

transition from beta testing• Allow for continued

evolution of Reverb

Page 22: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

Development Lessons Learned

• Deployment overhead still too high to sustain 2 week alpha pushes– Nuances of new technologies contributed to costly build

process• Feedback focused more on features not-yet

implemented vs. testable functionality• Needed preview release in Partner Test

sooner than later to test end-to-end ordering outside of Ops

• 20% rework was sometimes difficult to plan for, but was very useful to address feedback concerns

• “Top 5” requests were helpful, but under-utilized

Page 23: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

Modified Approach

• Monthly alpha release pushes to Testbed• Point releases as needed to meet major

milestones or to address significant bugs• Delayed beta testing until more

functionality was implemented• Plan in 20% rework to each development

sprint for bug fixes & enhancements per feedback

• Continue to request “Top 5”, but start nailing down required bug fixes for major milestones early

Page 24: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

BETA RELEASE CHANGED THE DYNAMIC

Page 25: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

NCR Metrics

July Aug Sept Oct Nov Dec Jan Feb Mar Apr May0

5

10

15

20

25

30

35

40

45

Externally Submitted NCRs

Initial Reverb Testbed deployment

Beta release prep-telecon

Beta-release

Page 26: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

REVERB IS THE PLATFORM FOR FUTURE ECHO CLIENT INNOVATION

Page 27: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

Moving Reverb Forward

• Core Reverb functionality will become part of monthly sustaining activities

• Reverb will become Operational on May 16• Development will continue with monthly

Alpha pushes to Testbed• Reverb Beta will continue to exist and serve

as a prototype space for T2R4 and potential client technology efforts

• Operational Reverb will be updated as part of the normal Operational deployments

Specific functionality will be discussed later today

Page 28: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

REVERB SHOWCASE

Page 29: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

Dataset Discovery

• First class dataset discovery• Fast keyword filtering of datasets• Ability to add entire datasets to

cart to support dataset download and ordering

• Ability to applyservices directly todatasets

• Temporal and spatialfiltering of datasetswithout doing agranule search

Page 30: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

Improved Form Rendering

• Fully styled form rendering• Support for native controls

including spatial selectionareas on maps withmultiple projects

• Inline error and helpinformation

• Smooth form expansionand collapsing to showor hide input areas

• Same rendering engine usedfor Orders and Service invocations

Page 31: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

Bulk Download

• Support for bulk download of large number of items

• Supports multiple download options• Text file of URLs to

support wget and curl

• FTP batch download script

Page 32: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

Services

• Added dynamic servicediscovery and invocation

• Services can be associated using tags

• Leverages familiar ECHO Forms for service UI presentation to the user

• Can be extended to supportwide variety of APIs (e.g.: GLASSubsetter, ESI)

• User input can be as simple as selecting an area of interest and desired dataset.

Page 33: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

Maintainability

• Reverb is based on modern web standards– Ruby on Rails3, HTML(5), CSS, JavaScript

• Fully automated valids, ACLs, and keyword generation

• Follows well established ECHO Development best practices

• Extensive suite of automated tests

Page 34: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

Minimized Ops/DAAC Interaction

• Minimized Ops/DAAC Coordination– Reverb reduces the number of items on which ECHO data partners need to

coordinate with the ECHO Operations team.– Reduced coordination simplifies Reverb maintenance.– Data partners can modify Reverb interactions through modifying metadata.

Page 35: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

Reverb-Enabled Metadata Cleanup

• Resolved Metadata Inconsistencies & Errors – Missing Collection Temporal Metadata– Missing Collection Spatial Metadata– Incorrectly defined “MODIS Tile” 2D Coordinate System– Invalid NSIDC Descending Crossing Longitude– Archive Center Cleanup

• Identified Metadata Issues– Inconsistent Processing Level Usage– Invalid LARC_ASDC Granule Temporal Values– Conflicting “ASTER” Instrument & Sensor– Invalid OnlineResourceURL MimeTypes– OnlineResource vs OnlineAccessUrl– Non-specific browse file extensions

Page 36: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

REVERB AUTOMATION

Page 37: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

WIST Valids

• WIST– Valids configured to run once/hour for guest users.

• Metadata or guest user access changes lags according to valids frequency.• Valids runs as a stand alone process, not integrated with WIST.

– Valids processing runs on-demand when a user logs in.• There are no lagging issues having to do with metadata modifications.

– Information Gathered for Dynamic Presentation• Collections available to guest users• Science Keywords• Additional Attributes

– ECHO Operations Configured Information• Data Quality Summaries & Assignments• Radio Button Mappings• 2D Coordinate Systems• Additional Attribute Grouping

Page 38: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

Reverb Valids

• Reverb– Valids processing configured to run once/hour for guest users.

• Metadata or guest user access changes will lag in Reverb interface.• The valids process is integrated with Reverb and runs as a core part of the app.

– Valids processing runs on-demand when a user logs in. (No Change)• Valids are refreshed every hour for the registered user.

– Information Gathered for Dynamic Presentation• Search Terms• Platforms & Instruments• Campaigns• Science Keywords• Processing Levels• 2D Coordinate Systems• Calendar Events• Provider Holdings (Granule Counts)• Services (Including Dataset Tags)

Page 39: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

Calendar Events

• WIST– Calendar events managed by providers in WIST Interface.– Username/Password not synchronized with ECHO system.– Alerts/Info displayed in scrolling banner & on separate calendar page.

• Reverb– Calendar events managed by providers in PUMP & made available to all ECHO

client partners through SOAP & REST API, or end users via RSS. – All provider and system calendar events loaded from the ECHO system.

• NCR 11010933 tracking issue re: Reverb displaying non-active events– ALERT events displayed in “Availability” section & INFO events displayed in

“Notices” section.– HTML formatting available for improved readability.

• Data Partner Responsibilities– Management of ECHO calendar events belongs to Data Partners.– Continue to update WIST & Reverb to reflect accurate alerts & info events.– Remove non-active events when the end-date has passed.

Page 40: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

Data Quality Summaries

• WIST– Configured by ECHO Ops team in cooperation w/ Data Partners.– Displayed when user adds a collection or granule to their cart.– If a registered user has accepted the DQS and the DQS changes, they will not

be presented with the new DQS.• Reverb

– Data quality summaries managed by providers in PUMP & made available to all ECHO client partners through SOAP & REST API.

– Displayed when a user searches for granules within a dataset.– Modified DQS are displayed to registered and guest users.– HTML formatting available for improved readability.

• Data Partner Responsibilities– Management of ECHO data quality summaries belongs to Data Partners.– Update Reverb & coordinate w/ ECHO Ops to accurately configure DQSs.

Page 41: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

REVERB TECHNICAL OVERVIEW

Page 42: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

Implementation Notes

• Implemented using an Agile Process• Implemented using Ruby on Rails, HTML,

CSS, JavaScript• Mostly built on top of new ECHO REST API

– Remainder will be moved to Multiformat REST API late summer

• Implementation time and team– ~10 months– ~6 developers

Page 43: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

Maintainability

WIST Reverb + REST0

50,000

100,000

150,000

200,000

250,000

300,000

Approx. Lines of Code

Page 44: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

Maintainability

@javascriptFeature: Spatial search for datasets In order to narrow my dataset results by spatial bounds as a Reverb user I should be able to visually select boundaries for my dataset searches

Scenario: Type in a valid polygon Given I am on the home page When I select "Polygon" from "spatial_type" within ".spatial-field" And I wait for datasets to load When I fill in "spatial" with "-9.102, 40.430, 22.594, 22.852, -1.406, 1.055" within ".spatial-field" And I wait for datasets to load Then I should find the dataset with id "Dataset with normal cartesian bounding rectangle" And I should find the dataset with id "Dataset with normal cartesian polygon" And I should not find the dataset with id "Dataset with cartesian point”

• Nearly all testing is fully automated• Unit Tests using Test::Unit• Integration Tests using Cucumber,

Capybara, and Celerity

Page 45: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

ECHO DBECHO DB

Deployment Model

ECHO Kernel(SOAP API)

ECHO Kernel(SOAP API)

REST API REST API

Reverb Reverb

ECHO DB

Reverb is deployed to

multiple serversUsers are transparently

balanced across instances

Reverb distributes its search and order load

across all ECHO kernels

Reverb takes advantage of ECHO’s ability to distribute

across DB nodes

Like ECHO, Reverb can be updated

without downtime.

Page 46: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

Supported Browsers

• Officially supported– Firefox– IE7 and IE8– Safari on OS X

• Unofficially tested– Firefox 4.x– Chrome 11– Safari 5.x

Page 47: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

Supported Browse Image Types

• Reverb will automaticallydisplay browser friendly types (JPG, PNG, etc.)

• Reverb can detect HDFbrowse and automatically extract embedded JPGs

• Multiple browse images are support and fetched asynchronously for performance

Page 48: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

Supported Spatial Projections

• Searching– Google Maps Mercator– North/South Polar Stereographic

• Subsetting Projections– North/South EASE-Grid (EPSG:3408, EPSG:3409)– Hughes / NSIDC North/South Polar Stereographic

(EPSG:3411, EPSG:3412)• Spatial Extent Visualization (results)

– OpenLayers– Plate Carree (equirectangular)– North/South Polar Stereographic

Page 49: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

Spatial extent drawing

• Reverb can render multiple granule spatial extents

• Will provide swath and polar rendering before release

Page 50: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

WIST 2 REVERB TRANSITION

Page 51: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

WIST To Reverb Migration

• EDG to WIST Recap– Accounts migrated from EDG instances to ECHO requiring user actions.– DAAC USO involvement to notify users encouraging self-migration.– Self-Migration tool developed and made available by ECHO team.– Password reset required during migration

• WIST to Reverb Preparation & Execution– No account migration activities required.– Users may self migrate to Reverb on their own.– WIST & Reverb usage will continue to be monitored.

• Discussion– How should we advertise the Operational Reverb on WIST?– How can we encourage users to self-migrate?– What criteria should be considered for starting a forced migration?– How is the final migration enforced?

Page 52: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

REVERB FUTURE CHANGES

Page 53: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

MULTI-FORMAT INGEST REST API INTEGRATION

Page 54: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

MultiFormat Reverb Integration

ECHO DBECHO DB

ECHO Kernel(SOAP API)

ECHO Kernel(SOAP API)

REST API REST API

Reverb Reverb

ECHO DB

V2 REST API V2 REST APIECHO DBECHO DBElastic Search IndexECHO DBECHO DBElastic Search Index

Page 55: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

Reverb Enhancements

• Multiformat REST will immediately provide Reverb with– Better and more complete Keyword Searching– Full and accurate hit counts– Ability to search metadata in a native ECHO 10 or

ISO19115 format– Retrieve metadata in ECHO10, Atom, or ISO19115– More advanced facets (valids) support

• Multiformat REST sets the stage for advanced Reverb feature such as– Able to display format specific information such as

production history and citations– Relevancy sorting

Page 56: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

BROWSE VISUALIZATION ENHANCEMENTS

Page 57: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

Temporal Browse Visualization

Dataset 1

Dataset 2

Dataset 3

(Non-artist’s rendering…)

5/21/20116/7/2011

Page 58: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

Browse “cover-flow”(Non-artist’s rendering…)

Page 59: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

SSW/ESI Integration

• SSW Integration– Targeting interaction with services exposing SSW API– Initially integration work with LPDAAC & GES DISC– Additional service integration to follow initial integration effort– Form development will require manual intervention & configuration– Development not currently scheduled in an ECHO sprint

• EOSDIS Service Interface (ESI) Integration– Participating in bi-weekly ESI technical meeting– Integration work coordinated with ECS DAACs– Investigating Automated Dataset Configuration -< ECHO Form Translation– Development to be scheduled in late-summer 2011

Page 60: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

Client Technology Sharing

• Survey Inputs– Existing EOSDIS clients surveyed & discussions held w/ some DAACs regarding

technologies & workflows that could be incorporated into Reverb.– Specific requests received from LPDAAC regarding client modifications.

• Current Items in Discussion– Import Shapefile defined boundary for spatial searching– Ops Concept Development - Tile layout view in granule results (GloVis-esque)– Ops Concept Development - Drill-Down selection (Mosaic Pivot Viewer)– Location Search (Google Maps Point)– Location Search w/ Pre-Compiled Shape Files (e.g. Country, State, County)– User Preferences (e.g favorite queries, option selections, etc)– Export Results to KML– Map-Based tile selection for spatial searching

• Other Suggestions?

Page 61: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

Notable NCRs

• Reverb Enhancements– Spatial Entry Enhancements

• Advanced Text Entry• Zoom to selection• Lat/Lon Cursor Tracking

– Show temporal information in granule results row– Order Option Enhancements (e.g. Editing, Default, & Multiple Products)– Filter & search w/ multiple temporal ranges– Filter & search w/ multiple tile ranges– Display granule spatial extents on 3D globe

Page 62: Welcome! DAY 1. Facility Overview Entering and Exiting – Rear entrance is closest to the auditorium – Perimeter doors are not secure – Do not exit through

Advanced Concepts

• Discovery– Display total granules found– Fluid granule list expansion – Display search area and/or granule spatial extents on a 3D globe– Additional projections during spatial selection

• Ordering & Downloading– Group granules by dataset during order workflow– Group by dataset & search constraints in cart– Bulk Order Processing– Advanced URL Downloading

• Online Resource URLs• OPeNDAP vs Direct Access• Metadata URLs (Format Specific)

– Additional projections during spatial subsetting