estec, 25 january 2007l. vibert, j.l. puget science ground segment management sgs1: iot and dpc...

ESTEC, 25 January 2007 L. Vibert, J.L. Puget

Science Ground Segment Management

SGS1: IOT and DPC status

L. Vibert J.L. Puget

Planck SGS Implementation Review

January 2nd-4th October 2006 @ ESTEC

L. Vibert, J.L. Puget

Preamble

Many things to learn for the new SGS manager– New field– Long history– Not written

Trying to drive a project – in a public & research organization– With industrial constraints– With moving deadlines

Trying to «stick to field reality» :– Quality management being lighten– Risk management is very sensitive

Presentation is build by L. Vibert & JL Puget talk is given by JL Puget


Outline

1. HFI overall SGS management– Organization– Management– Quality– Risks

2. IOT Status– Operations infrastructure– IOT organization– Operations tasks– Tools for operations– Daily timeline– Operations knowledge web site– Procedures

3. SGS1 DPC Status– L1 software– Interfaces– Evolutions– Calibration data


Instrument project mgrG. Guyot

AIV-AITT. Maciaszek

Project assistantD. Lelièvre

Calibration scientistF. Pajot

IOT ManagerL. Vibert

System group(team leaders)

System engineerG. Guyot

AIT/AIV group(team leaders)

Calibration groupP. Lami

Project controllerB. Cougrand

OperatorsX & X

Project & Quality AssuranceL. Meslier & S. Maloreau

HFI Instrument organization (up to end of PV phase)

OBSW maintenanceC. Mercier & R. Pons

Instrument expertsM. Charra & «offline experts»

Scientific groupJL Puget

F.-X. DésertM.-A. Miville-Deschene

G. LagacheC. Leroy

N. PouthieuC. Rosset

M. TristramJ. PlascinskyF. Couchot

J. Haissinski

SW&HW infrastructureG. Poulleau & group

Dilution coolerP. Camus

REUR. Pons

DPU OBSSB. Mansoux

4K coolerT. Bradshaw & N. Wright

ThermicsJJ. Fourmond

MechanicsC. Dumesnil

DCEC. Vescovi

Cold opticsY. Longval

Inst. Ground segmentC. Mercier

AIV-AIT deputyM. Charra

REUR. Pons

DPU OBSWW. Marty

Thermics / 4K coolerJJ. Fourmond

MechanicsC. Dumesnil

Electronics / control & cmdV. Hervier

Inst. Ground segmentC. Mercier

Commanding & proceduresV. Hervier & …

Instrument scientist & deputyJ.-M. Lamarre & M. Piat

ExpertiseP. Eng (former AIT/AIV mgr)

IOT scientistF. Pajot

Pneumatic cryogenyM. Charra

Operation tools maintenanceC. Mercier


DPC managerF. R. Bouchet

Operations toolsdevelopment & deployment

C. Mercier

SGS common toolsJ.-M. Delouis

IMO validationF.-X. Désert

Pipeline developmentA. Moneti

Infrastructures &tools integration

D. Vibert

L1 development & supportE. Montes & F. Bérenger

IMO & transfert functionRTA & MIBsK. Dassas

HOC infrastructureG. Pouleau & group

L4 developmentJ. Rachen

DMC developmentJ.-M. Delouis & H. Danzas

FL developmentM. Bremer

IMO & transfer functions tools & tests

X

IDIS support tools(LLink+Mantis+CVS)

K. Phipps

CMTS. Du

ProC developmentW. Hovest

Web toolsA. Khemsi

User support H. Danzas

Pre-processingJ. Macias Perez &

C Renault

Pointing reconstructionK. Benabed

Map makingO. Perdereau & group

Component separationM. Hobson & V. Stolyarov

Legacy catalogueD. Harrison

Systematics detectionJ.-P. Bernard & C. Leroy

Detector noise &characterisation

S. Prunet & J.-M. Colley

Focal plane geometryA. Jaffe & P. Dineen

Photometric calibrationG. Lagache

C(I) estimationG. Efstathiou & E. Hivon

Simulations coordination & production

C. Rosset & M. Reineke

ERCSCW. Reach & group

L2 hardwareS. Rouberol

Release processS. Du

IDIS interfaceD. Vibert

Pipelineintegration & tests

X

QLA & Trend AnalysisM.-A. Miville Deschenes

& group

SGS1 external interfacesC. Mercier

AIT/AIV managementM. Léoncini

Developers supportJ.-M. Colley

SGS project managerL. Vibert

HFI SGS organization

Ground Segment Project managersM. Asdown (CPAC) & D. Clements (LPAC) & J. Sternberg (IDIS)

& T. Ensslin (MPA) & K. Bennett (RSSD) & W. Reach (USPDC) & C. Mercier (IAS) & A. Moneti (IAP)

DPC Scientific Coordination GroupM Asdown & FX Désert & K Ganga

Project assistantD. Lelièvre

Deputy Mgr /Quality & Risk Mgt

S.M.


We need to improve management efficiency

Items under configuration– List and content have to be updated

• items under the project configuration control limited to ICDs, test plans involving other SGS elements (MOC, LFI, PSO)

• Development and tests of items involving only HFI should stay within HFI configuration control

– Critical s/w which have been extensively tested and used should go to a light reporting (for ex RTA, QLA, TA/SP), “nice to have” improvements are out of SGS1

Already working with modified constraints– merge documents to make their update easier and thus the

documentation more effective to use for the internal HFI management Planck project organization

– Activate a steering group at management level (MOC,PSO,LFI,HFI SGS)

– Improve definition of responsibilities of different groups like ICWG/PGSSG, multiplication of meetings and questions, too many people, mixing of the internal instrument operations with legitimate organisation of interfaces

Quality process and risk management reassessment– Goal: define what’s helpful, avoid useless overheads


QA: Documentation status

HFI SGS Work Organization Plan PL-HFI-IAS-PL-WOP New

HFI DM & FM-1 Pipeline Objectives PL-HFI-IAP-DPC05.105 updated

HFI DM Pipeline Development Plan PL-HFI-IAP-PL-104 updated

HFI FM Pipeline Design PL-HFI-IAP-DD-10 new

HFI FM pipeline scientific design PL-HFI-APC-DD-101 updated

HFI SGS1 Software Verification and Validation Plan PL-HFI-IAS-SVVP-101 new

HFI DM pipeline validation and test plan PL-HFI-IAP-SV-103 new

HFI DPC Product Assurance Plan PL-HFI-IAS-SV-001 updated

HFI SGS Risk Management Plan PL-HFI-IAS-PL-RMP000 updated

HFI Operations Plan PL-HFI-IAS-PL-101 updated

HFI DPC Hardware Design & Implementation Plan PL-HFI-IAS-SD-HSADD updated

HFI IDIS Acceptance Test Plan PL-HFI-IAP-PL-106 new

HFI IMO Overview PL-HFI-IAS-PL-IMO new

HFI Level 1 SSD PL-HFI-IAS-SSD-101 updated

HFI RTA URD UR-PHZYA-100014-LAL updated

HFI Instrument User Manual UM-PH921-300334-IAS Updated

HFI TCP & TMP list LI-PH921-500630-IAS Updated

HFI L1 User Manual PL-HFI-IAS-UM-1452 new

HFI IW @ MOC URD PL-HFI-IAP-UR-103 updated

HFI IW @ HOC URD PL-HFI-IAP-UR-102 updated

new or updated for the Review


Risks status

Reminder :– Risks was managed through an open list on www.planck.fr as a

way to indentify risks– Risks assessment was mainly technical– No escalation of them really happened– The previous ones are mostly outdated

Risks have been reassessed in Dec 06 by the management following the way it was done on the instrument

Most were technical and closed, L1 schedule risk was worked on, checked to be on time

Main HFI-SGS project risk raised : IDIS/ ProC component delivery


ProC risk and mitigation plan

(status at 15th of January 2007)

At the project level, the risk is seen as :– ProC has difficulties running in HFI environment– Critical features might not be delivered in time to test the FM

pipeline before the GS Readiness Review (beginning 08)

Mitigation– Weekly technical MPA-HFI telecon (no IDIS, LFI is invited)

• Detail requirements of the ProC functions to be implemented

• define the validation, integration acceptance procedure

• Direct discussions of bugs & features requests between engineers

– In March 07 and at the May IDIS management meeting: key point for assessment of confidence of the required ProC delivery in time

– In parallel define temporary alternative plan.


Planning difficulties in the last year

Planning is supposed to be a driving tool but :

Manpower has been constrained by « emergencies » and delays in the instrument schedule:

– support to Instruments integration, tests, problems with acquisition chain (all solved today)

– Support to users (calibration phase, data to broadcast, analyse and maintain) (finished)

– Support to instrument team for system tests (still on going)

A number of small items are emerging as the project is progressing :– Evolution of IDIS/DMC– Modification of Instrument Model– Tackling the data exchange internaly (IAS, IAP, USPDC, Cambridge) and

externally with LFI– …

Main milestones drifting with launch date:– Lack of availability of interfaces– GS readiness review drifting

HFI milestones well identified, detailed planning not yet rebuilt


Outline1. HFI overall SGS management

– organization– management– quality– Risks




Operations infrastructure

Hardware– Operation room and furnitures in place– PCs are installed, servers being installed before end

June 07– lines between MOC and IAS are on slow progress but

no hurry Software

– See L1 and interface s/w further – See MAMD’s talk for RTA,QLA, TA


IOT organization (operated 7 days a week)

IOT Management Group

IOT ManagerL. Vibert

3 OperatorsTBD

Scientific groupJL Puget

M.-A. Miville-DescheneG. Lagache

C. LeroyN. PouthieuC. Rosset

M. TristramJ. PlascinskyF. Couchot

J. Haissinski

SW&HW infrastructureG. Poulleau & group

Commanding & proceduresV. Hervier & …

Instrument scientist & deputyJ.-M. Lamarre & M. Piat

Operation tools maintenanceC. Mercier

IOT scientistF. Pajot

IMO ScientistF.X Désert

cryo & mecanics expertM. Charra

Electronics expertTBD

« Offline » experts

Instrument Operations Engineering Team Instrument Operations Science Team Operation Software mainteance IAS Data Operation Centre

From HFI Organization, PL-HFI-IAS-PL-ORG

commanding engineer & deputy

instrumentengineer

One engineer per major subsystem available on call

10 scientists (2 on duty each day) Participation

of instrument builder institutes (CESR,

LPSC, Caltech/CITA)

Operators shared with other instrument operations at

IDOC (Orsay)


Operation tasks are defined 1/2Task IOT task DPC task

Task sheet 1: Receive, process and store NRT data Daily

Task sheet 2: Retrieve, process and store consolidated and auxiliary data Daily

Task sheet 3: Generate data to be transmitted to LFI Daily

Task sheet 4: Real Time Analysis (RTA) Daily

Task sheet 5: Quick Look Analysis (QLA) and Trend analysis (TA) Daily

Task sheet 6: Analyse data with trend analysis and sky predictor tools Daily

Task sheet 7: Daily Meeting Daily

Task sheet 8: Instrument commanding Irregular

Task sheet 9: Instrument on-board software maintenance Irregular

Task sheet 10: IOT reporting Daily (for DQR)

Weekly (for WHR)

Task sheet 11: IOT – DPC L2 meeting Weekly Weekly

Task sheet 12: Survey planning & re-planning Irregular Irregular

Task sheet 13: Retrieve data from HOC Daily

Task sheet 14: Retrieve LFI data Daily

Task sheet 15: Demodulation Daily

Task sheet 16: Glitch flagging Daily & Irregular

Task sheet 17: Time constant deconvolution Daily

Task sheet 18: Flag sources Daily

Task sheet 19: Cross-talk characterization and removal Daily & Irregular

Task sheet 20: Temperature de-correlation Daily & Irregular

Task sheet 21: Stray light Weekly


Operation tasks are defined 2/2Task IOT DPC

Task sheet 22: Focal plane reconstruction Irregular

Task sheet 23: Beam reconstruction Irregular

Task sheet 24: Manage Instrument Model Monthly & Irregular

Task sheet 25: Characterization of detector noise Daily & Irregular

Task sheet 26: Dipole calibration Weekly & Irregular

Task sheet 27: Calibration on galactic profiles Monthly & Irregular

Task sheet 28: Calibration from Solar System objects Irregular

Task sheet 29: Calibration from bright galactic & extra-galactic sources Irregular

Task sheet 30: Inter-calibration Weekly & Irregular

Task sheet 31: DPC reporting Weekly & Monthly

Task sheet 32: Transfer data to USPDC Daily

Task sheet 33: Creation of ERCSource Catalogue Irregular

Task sheet 34: Detector map making Daily Irregular

Task sheet 35: Frequency map making Monthly & Irregular

Task sheet 36: Distribute data within DPC Irregular

Task sheet 37: Component map making Irregular

Task sheet 38: Power spectrum estimation Irregular

Task sheet 39: Cross calibration Irregular

Task sheet 40: Final photometric calibration Irregular

Task sheet 41: Compact sources final catalogue Irregular

Task sheet 42: Final data preparation Irregular


Tools for operations

MOC

PSO

HFI

LFIIW@HOC (IAS)

DPC L2/L3 (IAP)

Daily Quality Report

Weekly Health Report

•Timelines•Maps•Calibration data

IW@MOC

NRTConsolid.& auxillary

HFI DMC

HFI-DMC synchronization

NRTDDSFTS

NRT telemetry

Real Time Assessment (SCOS)

Quick Look AnalysisTrend Analysis

FITS

FITS

•Timelines•Maps•Calibration data

Consolidated telemetry & Auxilliary data

Monthly Report (Core Team)

See MAMD’s talk


Daily operations timelineDepending on time of DTCP, and time taken by transmissions, the daily report on data taken on day D will come late day D+1 or morning of day D+2.

To be iterated in ICWG (operation plans will then be updated)


New web site dedicated to Operations

Instrument description HFI User manual Commanding Telemetry Data dictionnary Procedures …


Procedures status

367 differents TeleCommands

For the HFI and HFI/sat tests, we’ve written:– 72 elementary procedures (1 to 15 TCs)– 18 types of configuration files– numerous macro-procedures for E2E tests, ISTs, cryo tests @CSL

For the operations with MOC we have to rewrite them (mainly because of incompatible SCOS versions between Alcatel and MOC) !– Already done : SVT0 on AVM (=1st FOP : from HFI power on to

bolometers setup and observation & optimisation modes)– To be done : FOPs, CPV procedures, contingencies– To be done : specific procedure to be able to update the data

compression factors during one DTCP (because of very tight TM rate)

This rewriting of procedures is a severe risk for the whole GS


Outline

1. HFI overall SGS management– organization– management– quality– Risks




L1 interfaces : reminder (from ESA)


«Uplink» workflow

OK with IR objectives

Not fully compliant with review objectives but schedule defined, no problem seen

Not compliant with review objectives: either interface or design not yet defined or difficulties seen


«Downlink» workflow


L1 software versions Version V1 was developed for HFI calibration (CQM, FM Sc.

Characterization and then calibration) – Fully tested total of the order of 4 months of operation; used to degug all

problems with DPU interface– interfaced with DMC V1 (PIOLIB) – Includes the acquisition of data from calibration equipment (Saturne tank,

calibration set up)– Could be used if needed for flight

Version V2 developed for flight – Remove all calibration related modules, rewrite modules which were source of

instabilities – Includes two modes

• a “batch mode” ingest in the DMC the consolidated data received everyday (large chunk of data)

• A “near real time mode” ingest data in the DMC by smaller chunk of data for near real time access to the data (calibration, ground system tests, CPV phase)

– HFI L1 want to ingest all HK-TM from LFI, Sorption cooler, Spacecraft to be able to follow directly critical parameters (all thermometers, on/off flags for elements of the SC and PL, …)

• HFI has done that on specific HK during CSL-FM1 tests (all Sorption cooler HK, Temperatures on the LFI mock up which allowed us to determine the transfer function of temperature fluctuations through the whole Planck cryo chain

• this is not flight critical,• L1 team will work on that after the final testing of the critical elements and delivery to

MOC (end June 07) and the CSL FM2 tests end of 2007 to be available for these tests– see next slides for implementation verification validation status


L1 modules status 1/2 HFI_CircularBuffer

– done and tested Nov06 HFI_MIBlib

– done and tested Nov06– Problems on document delivered by SEA for 4K cooler MIBS one week ago (many mistakes) correction

process has been tested ! HFI_PUSlib2

– done and tested Nov06 HFICOlMib

– done and tested Nov06 HL1_storeRaw

– done and tested Nov06 HL1_ScosClient

– done and tested Nov06– Adding a new function (echo TC) being done

HL1_orbit– Format of data received in files from MOC defined– Requirements on format in DMC to be done– Planned for 1st quarter 07– Easy, no risk involved

HL1-Attitude(reconstructed)– Format of data received in files from MOC defined– Read files tested– Functional tests with L2 to be done 1st quarter 07 with level S (should include check consistency of

definitions of reference frames)– Critical item should be tested ASAP


L1 modules status 2/2 HL1_time correlation

– Format of data received in files from MOC not fully defined

– Read file being written

– Tested not done (no test file available)

– Simple no risk involved HL1_APPL (Augmented Pointing list)

– Received in form of files from PSO– DMC formats defined– used directly by TA sky predictor, interfaces OK

HL2_transfertFunctions– done and tested Nov06

HL1_retrieve_Live_data_from_SCOS– Package used during operations to extract TM/TC in Near Real Time from a SCOS acting as a broadcasting

server– Tested done

HL1_CompareDMC– Test package

HL1_PacketFeeder– Tool for testing L1 by injecting PUS Pacquets– Developed, used at IAS


L1 integration tests

Live data from SCOS (Near Real time mode) Tm unpack and QLA client (Batch mode) Packet server and clients (Near real time mode) Tm Unpack QLA server and QLA client For all

– tested during calibration and system tests (CSL, AVM, Alcatel on going)

– done only partially on V2

– Flight Critical, ICD tests planned 1st quarter 07

– Delivery to MOC June 07 after system test on non flight hardware ready for SOVT1

Acceptance tests on the flight hardware at HOC – The flight operation hardware has been ordered and is mostly delivered

being installed at IAS

– Acceptance tests planned for September–October 07 (4 months before before GS Readiness Review)


L1 and related modules verification and validation schedule

L1 with DMC V2 will be finished before October 07 (in time for CSL FM2

L1 with V1 DMC tested

Interface tests

SOVT1


SGS other Interfaces 1/2 HPMCS-DDS consolidated TM (MOC-DPC)

– Telemetry reading OK– Test with DDS waiting for availability of DDS

TC history (MOC-DPC)– Interface not yet finally defined– Software to be written

Out Of Limits info– Interface to be clarified– Software to be written

HPMCS SGS NRT– S/W done – Use SCOS EGSE3.1 to simulate MOC– Need final test with MOC SCOS

Inst. OBSW updates, Instrument memory images– Interface well defined– Used in system tests

Eng. And Cal observations and scheduling constraints (IOT-PSO)– Probably very limited – To be defined after discussion at ICWG


SGS other Interfaces 1/2

Timeline exchange, Maps and Power Spectra exchange (HFI-LFI-PSO)– File (FITS ) exchange in specific repository– Automatic FTP retrieve (HPFTS)

Calibration information– Not defined yet– Cross calibration limited – Discussed in core team, formal interface might not be necessary– No risk involved

Sorption cooler System and 4K Cooler data exchange– Time lines in FITS files– Exchanges HPFTS

SC/instrument alignment matrix (SIAM) (HFI-LFI-PSO)– Generated by HFI L2– File form, format defined– Exchange HPFTS

Task parameter file (DPC-MOC)– Defined by SCOS, already in use


Next SGS1 implementation steps

Already tackled :

Integration of HFI-DMC V2 Use non-HFI telemetries Definition workflow of data, SGS system view

– Which data ? Which rate ?– Between institutes, between instruments

Work on Instrument procedures (FOP, Contingencies) IMO evolution (see FXD’s talk) Data archive and maintenance philosophy for next years

(including calibration and test data)


Overall Summary

SGS1 status is in line with the Review objectives Some system aspects of operations needs to be

consolidated Manpower:

– team was understaffed especially during period of delayed calibration and system integration (still on going)

– During this period management was also sub-critical– 3 additional s/w engineer since SGS DR– CITA team extends its contribution to operation tools and

operations (after completing QLA)

Instrument related activities of the SGS1 team start to decrease

Completion of SGS1 development will be ready in time for SOVT1 and finished for CSL FM2

estec, 25 january 2007l. vibert, j.l. puget science ground segment management sgs1: iot and dpc...

Documents