NodeManagerandServicesWorkingTeam:ProgressUpdateandFuture

RoadmapSashaAmes,Co-Lead(LLNL)

TobiasWeigel,Co-Lead,KatharinaBerger(DKRZ),MikeBerkley(UVic/CCCma),AlessandraNuzzo,Maria

Mirto,PaulaNassisi,(CMCC),LucaC.(JPL)

ThisworkwasperformedundertheauspicesoftheU.S.DepartmentofEnergybyLawrenceLivermoreNationalLaboratoryunderContractDE-AC52-07NA27344

LLNL-PRES-742742

OverviewofNodeManagerandUserNotification

• NodeManager:§ Componenttohandleinternodecommunicationofconfigurationinfo§ Usesatwo-tierdesign:1sttierP2P;2nd tierclients§ Maintainthenode-componentregistry:registration.xml

DataNode(TrackingService)

FeedbackService

(2)DatasetUpdates

(1)UserSubscribesorDownloads

UpdateInfo(3)

(4)Notification(email)

• UserNotification:goaltoprovideupdatestodatachangesinthefederation

1

23

5 4

SuperNodes

Member Nodes

7

Standby Nodes

6

NodeManagerAccomplishments2017

• NodeManager1.0integratedintoesg-node(installer)§ Deployedtoproductioninv2.5.9§ Severalupgradedsitesregistered§ Recaptureofupgradedsitesinprogress

• CredentialsshareAPI- requiressignedpubliccertforverificationofsignedrequest§ testedbetweenLLNLandGFDL

• Teamreformulationandkickoffdiscussions

NodeManagerReleaseReportesg.lasg.ac.cn CoreyHaim v2.5.17-master-releaseaims3.llnl.gov CoreyHaim v2.5.17-master-release

esgf-node.jpl.nasa.gov Helheim v2.5.13-master-release

esgf-node.llnl.gov CoreyHaim v2.5.17-master-releaseesgf1.dkrz.de Helheim v2.5.13-master-release

esgf-data.jpl.nasa.gov Vanaheim v2.5.14-master-releaseesgf-node.cmcc.it Service Error(500)

esgf-data2.ceda.ac.uk TIMEOUTesg-dn1.ru.ac.th TIMEOUT

esgfcog.cccma.ec.gc.ca Alfheim v2.5.16-master-releaseesgf.nccs.nasa.gov Samhain v2.5.17-master-releaseesgf-data.dkrz.de Helheim v2.5.13-master-releaseesgf.anl.gov Midgard v2.5.9-master-releaseesgf2.dkrz.de Helheim v2.5.13-master-release

Allothernodes2.5notinstalled…

UserNotificationDevelopment2017

• Feedbackserviceprototype§ collectsandcollatesindividualuserdigests§ Basedonmessagesfromtrackingserver

• Trackingserviceissubscriptionbased§ PeriodicprojectquerysnapshotstoSOLR§ Takesdeltavsprevioussnapshot

oDatasetscategoriesforupdates:new,retracted,updated(version)

Roadmapfor2018

• NodeManager§ Streamlineconfig deployment§ Authenticatedcommunications– usedsigningprotocollikethecredentialsshareAPI§ Future:replacewiththirdpartycommunicationprotocollibrary

• Usernotification§ Completesubscriptionservice§ Testingphases§ Deploytoproduction

• Beyond:considerdownloadtracking§ willuseridentitybecapturedsomehowforunrestrictedCMIP6data?§ Clientside:alternativestoemailnotifications,

o browserplug-into“Notificationcenters”o smartphonenotifications(SMSorother)?

Foodforthought…

• Bigquestion– doweneedanodemanager– whatisitsusefulpurpose?Doesanyonereallyusetheregistry?Itsis”kindofnicetohave”butthatmaynotjustifytheeffort

• Nodemapcouldbeuseful,butotherservicesexistformonitoring.TheseareoverarchingarchitecturalquestionsforESGF

• OTOH– best,mostaccuratepictureofstateoffederationviaregistryandnodemap

• Howelsecouldweusethenodemanager?Otherconfigurationtobedistributed?

• Notifications– helpfulordistracting?Ifthelatterthenworththeeffort?