1 the mice online systems linda r. coney chep – may 2012

1

The MICE Online The MICE Online SystemsSystems

Linda R. Coney Linda R. Coney

CHEP – May 2012CHEP – May 2012

2L. Coney – CHEP2012

OutlineOutline Intro – MICE Intro – MICE

Muon Ionization Cooling ExperimentMuon Ionization Cooling Experiment

Controls & MonitoringControls & Monitoring

DAQDAQ

Online Monitoring & ReconstructionOnline Monitoring & Reconstruction

ConclusionsConclusions


MICE: MICE: Muon Ionization Cooling Muon Ionization Cooling

ExperimentExperiment

MICE Goals:MICE Goals: Design, build, commission, and operate a realistic Design, build, commission, and operate a realistic

section of cooling channelsection of cooling channel Measure its performance in a variety of modes of Measure its performance in a variety of modes of

operation and beam conditionsoperation and beam conditions

……results will be used to optimize results will be used to optimize Neutrino Factory and Muon Collider designs.Neutrino Factory and Muon Collider designs.

Spectrometer Solenoid & Tracker

Absorber

RFCC Module


MICE: DesignMICE: Design MICE is designed to produce a 10% cooling MICE is designed to produce a 10% cooling

effect on the muon beameffect on the muon beam

Use particle detectors to measure the cooling Use particle detectors to measure the cooling effect to 1%effect to 1%

Measurements will be done with muon beams Measurements will be done with muon beams having momentum of 140 MeV/c – 240 MeV/chaving momentum of 140 MeV/c – 240 MeV/c

Method:Method: Create beam of muonsCreate beam of muons Identify muons and reject backgroundIdentify muons and reject background Measure single particle parameters x, pMeasure single particle parameters x, pxx, y, p, y, pyy, p, pzz Cool muons in absorberCool muons in absorber Restore longitudinal momentum component with RF Restore longitudinal momentum component with RF

cavitiescavities Identify outgoing particles to reject electrons from Identify outgoing particles to reject electrons from

muon decaymuon decay


MICE: Beam LineMICE: Beam Line Produce from p interactions with a titanium

target Transport (Q123) and select momentum (D1) Collect (DS) and select momentum (D2) Transport to MICE and match to cooling

channel

Maximize purity (reduce contamination) Maximize transmission Define optics for the MICE program

LM


Online Group OverviewOnline Group Overview The MICE Online Group creates, maintains, and The MICE Online Group creates, maintains, and

ensures proper use of all tools (hardware, ensures proper use of all tools (hardware, software, documentation) within the MLCR software, documentation) within the MLCR (MICE Local Control Room) that allow the (MICE Local Control Room) that allow the experiment to efficiently record high quality experiment to efficiently record high quality data.data.

We are responsible for:We are responsible for: Controls & Monitoring (C&M)Controls & Monitoring (C&M) Data Acquisition (DAQ)Data Acquisition (DAQ) Online Monitoring and ReconstructionOnline Monitoring and Reconstruction Data Transfer, Networking, and Computing Data Transfer, Networking, and Computing

InfrastructureInfrastructure

We also interface closely with systems related to We also interface closely with systems related to the Online sector including MICE Operations, the Online sector including MICE Operations, Offline Software, and Computing.Offline Software, and Computing.


Online Group MembersOnline Group Members Linda Coney (UCR)Linda Coney (UCR) – head of Online Group– head of Online Group David Colling (Imperial)David Colling (Imperial) – head of Software & – head of Software &

ComputingComputing Yordan Karadzhov (U. Geneve) Yordan Karadzhov (U. Geneve) – head of DAQ – head of DAQ Pierrick Hanlet (IIT)Pierrick Hanlet (IIT) – head of C&M – head of C&M Chris Rogers (RAL) Chris Rogers (RAL) – head of Software – head of Software Brian Martlew (Daresbury Lab) Brian Martlew (Daresbury Lab) – C&M – C&M Paul Hodgson (Sheffield U) Paul Hodgson (Sheffield U) – C&M (target) – C&M (target) Matt Robinson (Sheffield U)Matt Robinson (Sheffield U) – System Admin; C&M – System Admin; C&M

(target, tracker)(target, tracker) Mike Courthold (RAL)Mike Courthold (RAL) – Networking – Networking Henry Nebrensky (Brunel) Henry Nebrensky (Brunel) – GRID, data transfer – GRID, data transfer Janusz Martynikk (Imperial)Janusz Martynikk (Imperial) – data transfer – data transfer Craig Macwaters (RAL) Craig Macwaters (RAL) – MLCR Network, – MLCR Network,

hardware, computinghardware, computing Antony Wilson (RAL)Antony Wilson (RAL) – Config DB, PPD contact – Config DB, PPD contact Paul Kyberd (Brunel)Paul Kyberd (Brunel) – GRID – GRID





DAQDAQ




MICE: Controls & MICE: Controls & MonitoringMonitoring

ControlsControls User interface to equipment – both beamline and User interface to equipment – both beamline and

detectorsdetectors Mandates proper sequencingMandates proper sequencing

MonitoringMonitoring Protects equipment (early notification of problems) Protects equipment (early notification of problems)

& data quality& data quality Required for proper sequencing in ControlsRequired for proper sequencing in Controls

Use EPICS (Experimental Physics & Industrial Control Systems) interface Framework for C&M Open source, multiple platforms, stable Existing support for many devicesExisting support for many devices


C&M: EPICSC&M: EPICS

Start with hardware and LANStart with hardware and LAN Use existing drivers or develop new onesUse existing drivers or develop new ones Build Input/Output Controllers (IOCs) which define Build Input/Output Controllers (IOCs) which define

Process Variables Process Variables Make PVs available on LAN for users (clients) or Make PVs available on LAN for users (clients) or

other IOCsother IOCs Clients: control or monitoring panels, Alarm Clients: control or monitoring panels, Alarm

Handlers, ArchiversHandlers, Archivers


C&M: StatusC&M: Status Completed: All beamline and PID Completed: All beamline and PID

equipmentequipment TargetTarget Beamline magnetsBeamline magnets BeamStop, Proton Absorber BeamStop, Proton Absorber Particle ID detectors, Hall Particle ID detectors, Hall

environmentenvironment Alarm Handler, ArchiverAlarm Handler, Archiver External gateway for remote External gateway for remote

accessaccess


Cooling Channel:Cooling Channel:Spectrometer Solenoids & Spectrometer Solenoids &

Focus CoilFocus Coil At Wang, NMR (CA)At Wang, NMR (CA) At TESLA (UK)At TESLA (UK)


SS Standalone System SS Standalone System OperationalOperational

SS: Quench protection (FNAL), power supply SS: Quench protection (FNAL), power supply (LBNL), C&M hardware (Daresbury)(LBNL), C&M hardware (Daresbury)

FC standalone C&M readyFC standalone C&M ready


C&M: Current & Future C&M: Current & Future FocusFocus

Config DB: Config DB: Ensure data taking parameters of all equipment carefully recorded/restored to/from the CDB Control all systematic errorsControl all systematic errors

Run ControlRun Control Target DAQ, Experiment DAQ, beamline Target DAQ, Experiment DAQ, beamline

controls, MICE state machines, PID controls, MICE state machines, PID All integrated into single Run Control processAll integrated into single Run Control process

Future: RFCC (RF cavities and coupling Future: RFCC (RF cavities and coupling coils), further development of infrastructure coils), further development of infrastructure monitoring (vacuum, compressed air, power, monitoring (vacuum, compressed air, power, chilled water, etc)chilled water, etc)

Spectrometer Solenoid & Tracker

Absorber RFCC Module


C&M: Run ControlC&M: Run Control

Target MonitoringTarget Monitoring Beam Center Distance, ISIS current, Beam Beam Center Distance, ISIS current, Beam

Loss due to MICE Target, Beam PositionLoss due to MICE Target, Beam Position


C&M: Run ControlC&M: Run Control DAQ MonitoringDAQ Monitoring

Run numberRun number DAQ statusDAQ status Trigger typeTrigger type Spill Gate widthSpill Gate width Particle triggersParticle triggers Target infoTarget info

All information All information sent to ConfigDBsent to ConfigDB

Continue with Continue with State MachinesState Machines





DAQDAQ




MICE TimingMICE Timing

MICE target dips into ISIS beam during last MICE target dips into ISIS beam during last 3 ms of the cycle3 ms of the cycle

MS signal used to time in target with correct MS signal used to time in target with correct pulsepulse

MICE RF will be timed with last 1 ms of ISIS MICE RF will be timed with last 1 ms of ISIS cyclecycle

RF Pulse1 ms

20 ms

Isis Beam Radius

MS

RF Trigger

Target Position

SPILL !


DAQ & Trigger DAQ & Trigger RequirementsRequirements

Long-term stabilityLong-term stability Maintainable Maintainable Non-expert use Non-expert use documentation documentation

Specifications:Specifications: 100s particles/1 ms spill at 1 Hz100s particles/1 ms spill at 1 Hz Level 0 trigger only – all events read outLevel 0 trigger only – all events read out Readout at end of spill – buffer in FEEReadout at end of spill – buffer in FEE Dead time not > 1 burst after that which Dead time not > 1 burst after that which

generated particle eventgenerated particle event Calibration runs possible between spillsCalibration runs possible between spills Event size <60 MB (normally ~2 MB; will Event size <60 MB (normally ~2 MB; will

be ~5 MB with EMR & trackers)be ~5 MB with EMR & trackers)


DAQ Software DAQ Software FrameworkFramework

Using DATEUsing DATE ALICE DAQ software frameworkALICE DAQ software framework Provided MICE with Provided MICE with

EventBuilder toolEventBuilder tool Subevents collected by Subevents collected by

different processors are different processors are synchronized and assembled synchronized and assembled before storagebefore storage

Version 6.40 Version 6.40 update to v7.34 update to v7.34 next monthnext month

LDC – Local Data ConcentratorLDC – Local Data Concentrator PC connected to the VME cratePC connected to the VME crate Contains set of EquipmentContains set of Equipment

GDC – Global Data CollectorGDC – Global Data Collector Event builderEvent builder

Equipment – module in DAQ Equipment – module in DAQ cratecrate

DATE Event = DAQ EventDATE Event = DAQ Event Multiple Particle Events (100s)Multiple Particle Events (100s)


DAQ RequirementsDAQ Requirements Flexible:Flexible:

Performs initialization of FEE unitsPerforms initialization of FEE units Read data from FEE through VME busRead data from FEE through VME bus Select necessary equipment without Select necessary equipment without

modify codemodify code Run independently of target, MICE RF, Run independently of target, MICE RF,

and individual detectorsand individual detectors

Interface with Controls & MonitoringInterface with Controls & Monitoring Interface with Online Monitoring and Interface with Online Monitoring and

ReconstructionReconstruction


DAQ Hardware OverviewDAQ Hardware Overview


DAQ StatusDAQ Status TOF, CKOV, KL completedTOF, CKOV, KL completed Unpacking code finished for all current and future Unpacking code finished for all current and future

detectorsdetectors

Prototype EMR detector and electronics Prototype EMR detector and electronics successfully integratedsuccessfully integrated

Simultaneous readout of two scintillating fiber Simultaneous readout of two scintillating fiber trackers with cosmic ray data completedtrackers with cosmic ray data completed

Successful integration of prototype single station Successful integration of prototype single station tracker into MLCR DAQtracker into MLCR DAQ

Timing of tracker alive window and vetos completedTiming of tracker alive window and vetos completed

Communication linking DAQ, C&M and Config DB Communication linking DAQ, C&M and Config DB donedone Allows DAQ monitoring and archiving of DAQ parametersAllows DAQ monitoring and archiving of DAQ parameters





DAQDAQ




Online MonitoringOnline Monitoring Interface is based on DATE monitoring facilityInterface is based on DATE monitoring facility

Runs over data on socketRuns over data on socket Online monitoring process produces histograms and Online monitoring process produces histograms and

makes them available on demandmakes them available on demand Online Monitoring GUI is just a ROOT macro Online Monitoring GUI is just a ROOT macro

allowing the user to request histogramsallowing the user to request histograms

Run unpacker on DATE dataRun unpacker on DATE data Fill plots for each type of board – no reconstructionFill plots for each type of board – no reconstruction Fill histograms in real time while taking dataFill histograms in real time while taking data Use to debug operations & provides data quality Use to debug operations & provides data quality

checkcheck

Three types of boards Three types of boards three types of plots three types of plots FADCs, Scalar, TDCsFADCs, Scalar, TDCs


Online MonitoringOnline Monitoring

Typical online plots during data-Typical online plots during data-takingtaking

User selects what to viewUser selects what to view Displayed for each runDisplayed for each run

TOF hit profiles

TDCscalars

fADC

trigger

Par

t. T

rig

ger

Trg

Req

.G

VA

1

GV

A3

CKOVA/B

Clo

ck 1

MH

zT

OF

0

For cumulative, average and last spill


Online ReconstructionOnline Reconstruction Unpacker runs over data from DATE on Unpacker runs over data from DATE on

socketsocket Converts the raw data into information with Converts the raw data into information with

physical meaningphysical meaning Real-time physics and detector functionality Real-time physics and detector functionality

First look at analysis quantitiesFirst look at analysis quantities

Available nowAvailable now TOF, CKOV, KL, Sci-Fi Tracker detector readoutTOF, CKOV, KL, Sci-Fi Tracker detector readout Time-of-flight distributionsTime-of-flight distributions Beam dynamicsBeam dynamics

Future:Future: EMR detectorEMR detector Additional online analysis Additional online analysis


TOF0

TOF1

Hit Distribution in X

Online ReconstructionOnline Reconstruction

TOF detectorsTOF detectors Shape of beam, particle triggersShape of beam, particle triggers CKOV detectorsCKOV detectors Time-of-flight distributionTime-of-flight distribution PIDPID

TOF0

TOF1

Hit Distribution in Y

Reconstructed Time of Flight

e+

+

+


OtherOther Data transferData transfer

Move data out of MLCR at end of each day and Move data out of MLCR at end of each day and automatically transfer to RAL PPD and GRID for later automatically transfer to RAL PPD and GRID for later analysisanalysis

Saves associated Online Monitoring and Saves associated Online Monitoring and Reconstruction plots with dataReconstruction plots with data

InfrastructureInfrastructure Change in OS in progress, moving from CentOS to SL – Change in OS in progress, moving from CentOS to SL –

using SLv5.7using SLv5.7 Replacement of unreliable DAQ crates completedReplacement of unreliable DAQ crates completed Upgrade/replacement of critical machines in progressUpgrade/replacement of critical machines in progress Improving equipment protections in case of power Improving equipment protections in case of power

outagesoutages

Documentation – all has recently been reviewed, Documentation – all has recently been reviewed, updated and postedupdated and posted


Online FutureOnline Future Prepare complete C&M for arrival of cooling Prepare complete C&M for arrival of cooling

channel elements in 2013 channel elements in 2013 Spectrometer solenoids, full sci-fi trackers(2), AFC Spectrometer solenoids, full sci-fi trackers(2), AFC

(absorber focus coil) in beam(absorber focus coil) in beam

Move to latest version of DATEMove to latest version of DATE Finish integration of tracker DAQ into MLCR Finish integration of tracker DAQ into MLCR

DAQ DAQ Add production versions of EMR equipment to Add production versions of EMR equipment to

DAQ & take dataDAQ & take data Complete timing with ISIS RF and prepare for Complete timing with ISIS RF and prepare for

running with MICE RFrunning with MICE RF

Continue improvement/addition of Online Continue improvement/addition of Online ReconstructionReconstruction

Add online accelerator physics analysis tools Add online accelerator physics analysis tools for beam in cooling channelfor beam in cooling channel


ConclusionsConclusions MICE Online Systems are in place MICE Online Systems are in place

and performing welland performing well

Improvements to DAQ, C&M, and Improvements to DAQ, C&M, and Online Reconstruction continue to Online Reconstruction continue to develop as new requirements arisedevelop as new requirements arise

Progressing on schedule toward Progressing on schedule toward arrival of Cooling Channel elements arrival of Cooling Channel elements and subsequent data-taking and subsequent data-taking campaign in 2013campaign in 2013


MICE: International MICE: International InvolvementInvolvement

Institutions worldwide are contributing to the Institutions worldwide are contributing to the demonstration of muon ionization cooling at MICEdemonstration of muon ionization cooling at MICE


Online StructureOnline Structure


MICE DAQ TerminologyMICE DAQ Terminology Isis Cycle: Isis Cycle:

The injection and acceleration cycle of ISIS. It is 20 ms long The injection and acceleration cycle of ISIS. It is 20 ms long (50 Hz).(50 Hz).

Machine Start (MS): Machine Start (MS): This is the pulse used for the ISIS synchronizationThis is the pulse used for the ISIS synchronization

Spill Gate: Spill Gate: Time window during which the MICE Target is crossing the Time window during which the MICE Target is crossing the

ISIS beam. Driven by the cycle of the MICE target.ISIS beam. Driven by the cycle of the MICE target. Burst: Burst:

The ~100 ns time window during which muons are in the MICE The ~100 ns time window during which muons are in the MICE detectors. Is the time it takes for a proton bunch in ISIS to detectors. Is the time it takes for a proton bunch in ISIS to cross through the MICE target.cross through the MICE target.

DAQ-Trigger: DAQ-Trigger: Signal triggering the readout of the FE-electronics modules of Signal triggering the readout of the FE-electronics modules of

the MICE detectors. One DAQ-Trigger = one DAQ-Eventthe MICE detectors. One DAQ-Trigger = one DAQ-Event Particle-Trigger: Particle-Trigger:

Signal generated when the desired Trigger Condition is met. Signal generated when the desired Trigger Condition is met. Distributed to the sub-detectors Front End Electronics and Distributed to the sub-detectors Front End Electronics and

initiates the digitization of the data.initiates the digitization of the data.


DAQ TriggerDAQ Trigger

Timing of DAQ with Timing of DAQ with ISIS, Spill Gate, ISIS, Spill Gate, readoutreadout

MLCR hardwareMLCR hardware

DAQ Trigger distribution

Scalars and particle trigger NIM Logic

TOF discriminators & trigger CAMAC Logic

Interfacew/Target &Spill Gate

KL

ShapersGVA Discri,KL cosmics trg

TOF & CKOV


TOF FEETOF FEE Sensor: PMT (Hamamatsu R4998)Sensor: PMT (Hamamatsu R4998)

Signal transmission: Single ended, Signal transmission: Single ended, 50 Ohm50 Ohm, , coax cable (RG213)coax cable (RG213)

Number of ChannelsNumber of Channels 40 (TOF0) + 28 (TOF1) + 40 (TOF2) = 108 ch 40 (TOF0) + 28 (TOF1) + 40 (TOF2) = 108 ch

Main ConstraintMain Constraint Time ResolutionTime Resolution -> Time-walk correction-> Time-walk correction

TDC TDC CAEN V1290, 32 chCAEN V1290, 32 ch Large Event BufferLarge Event Buffer ECL inputECL input

DiscriminatorDiscriminator Lecroy 4415Lecroy 4415 16 Channels16 Channels ECL outputECL output Twisted Pair Input (Twisted Pair Input (110 Ohm110 Ohm))

Need Signal splitting Need Signal splitting for charge measurementfor charge measurement


KL FEEKL FEE Sensor: PMT (Sensor: PMT (Hamamatsu R1355Hamamatsu R1355))

Signal transmission: Signal transmission: Differential, 120 OhmDifferential, 120 Ohm, , Twisted pair cableTwisted pair cable

Number of ChannelsNumber of Channels 42 ch 42 ch

Main ConstraintMain Constraint Charge measurementCharge measurement Time ~ 1 nsTime ~ 1 ns

Flash ADC (WFD)Flash ADC (WFD) CAEN V1724CAEN V1724 100 MS/s, 14 bits100 MS/s, 14 bits Best commercial dealBest commercial deal Single Ended, 50 OhmSingle Ended, 50 Ohm

InputInput


CKOV FEECKOV FEE Sensor: PMT (8”)Sensor: PMT (8”)

Signal transmission: Single ended, 50 Signal transmission: Single ended, 50 Ohm, coax cable (RG58)Ohm, coax cable (RG58)

Number of ChannelsNumber of Channels 4 + 4 = 8 ch 4 + 4 = 8 ch

Main ConstrainMain Constrain Rate (no segmentation)Rate (no segmentation) Small chargeSmall charge

Flash ADC (WFD)Flash ADC (WFD) CAEN V1731CAEN V1731 500 MS/s, 8 bits500 MS/s, 8 bits Single Ended, 50 OhmSingle Ended, 50 Ohm

InputInput No Shaper !No Shaper !


Tracker FEETracker FEE

4 VLSB Boards in VME Crate

= Data Buffer

MICE HALL

1 Cryo-Cooler

= ½ Tracker

4 AFE2-t

Boards

Fibers from VLPCs

Digital Signal

MIL1553(Control)

Read out PC

In Control Room

Optical Fiber

Custom Made Digital Data BufferCustom Made Digital Data Buffer VLSB = VME LVDS CERDES BufferVLSB = VME LVDS CERDES Buffer MICE defined Data formatMICE defined Data format Measure Both discriminated time and Zero Measure Both discriminated time and Zero

suppressed Chargesuppressed Charge 4096 + 4096 = 8198 channels4096 + 4096 = 8198 channels


DAQ EquipmentDAQ Equipment Readout code available and tested forReadout code available and tested for

TDC V1290A (TOF)TDC V1290A (TOF) FADC V1724 (TOF and KL)FADC V1724 (TOF and KL) FADC V1731 (CKOV and EMR)FADC V1731 (CKOV and EMR) Scaler V830Scaler V830 Trigger Receiver I/O V977Trigger Receiver I/O V977 NI I/O PCi 6254 (Target)NI I/O PCi 6254 (Target) VLSB (Tracker)VLSB (Tracker) Prototype custom EMR Front End BoardPrototype custom EMR Front End Board Trailer (special equipment handling the Trailer (special equipment handling the

release of the busy)release of the busy)

1 the mice online systems linda r. coney chep – may 2012

Documents

mice online systemslinda

mice operations

cooling effect

muon decaymice

muon beams

muon collider designs

mlcr mice local control

online sector