detector variaon studies - indico-fnal (indico) · repeat nominal cpv analysis using full mc...
TRANSCRIPT
DetectorVaria+onStudies
ElizabethWorcester(BNL)Calibra+onTaskForceMee+ngOctober16,2018
Introduc+on• Goalistostudyimpactofvaria+onsindetectorperformance/
specifica+onsonCPVanalysis• Listofvaria+onschosenbasedonimportanceandeaseof
simula+on:– Deadchannels– Dri-fieldmagnitude– DriTfieldnon-uniformi+es– Noise
• Methodistore-runsimula+onchangingsomeparameterandrepeatnominalCPVanalysisusingfullMCsimula+on,nominalenergyreconstruc+onandCVNeventselec+on– Energyreconstruc+onnotre-tuned,crudeenergyscalingisapplied
(morelater)– CVNisnotre-trained– CVNselec+oncutisre-op+mized– Secondordereffects(eg:impactonsystema+cs)notconsidered
Thistalk
Simula+onplanned/inprogressTodo
2
Warning
• Donotover-interpret!Thesestudiescangiveasenseofwhatspecifica+onsareimportantfortheCPVanalysis,but,withoutfullyrepea+ngtheanalysisincludingreconstruc+ontuningandnetworktrainingandwithoutincludingtheimpactonourabilitytocalibrateandconstrainsystema+cs,theydonottellanythinglikeafullstory!
3
AnalysisDetails• FullLArSoTMonteCarlosimula+on
– GENIEeventgenerator– GEANT4par+clepropaga+on– Detectorreadoutsimula+onincluding“realis+c”waveformsandwhitenoise
• Automatedsignalprocessingandhitfinding• Automatedenergyreconstruc+on
– Muonmomentumfromrange(contained)ormul+pleCoulombsca^ering(exi+ng)
– Electronandhadronenergyfromcalorimetry• Eventselec+onusingconvolu+onalvisualnetwork(CVN)• MCtruthusedtoproduceefficiencyhistogramsandtrue-recosmearing
matricesthatareusedasinputtoGLoBESanalysis• GLoBESanalysisiden+caltoCDR(withtheefficiencyandsmearingcoming
frompreviousstep)performedtoobtainCPVsensi+vity– Includesnormaliza+onsystema+cschosentorepresentresidualuncertain+es
aTerNDconstraintsandsample-samplecancella+onsapplied
4
ExampleEfficiency
5
ExampleSmearing
6
AnalysisInputDetails• Badchannelstudy:
– MCC10.1– Remove5%or25%ofallchannels(Backhouse)
• Atrandom• Groupedbychip(groupsof16)• Groupedbyboard(groupsof128)• Forgroupings,~followprotoDUNEmappingscheme
• DriTfieldstudy:– May2018CVNupdate(improvedefficiencyrela+vetoMCC10.1)– ReducethedriTfieldinsim/recofclfiles– Generatenewfieldresponsehistogramsgivenreducedfield(Garfield,
thanksYichen!)
– Comparetonominalsehngs:
7
ExampleEventDisplays:BadChannels
8
5%random
25%random
EnergyCorrec+onDetails• Runonlynominalenergy
reconstruc+on,whichiscalorimetricforEMshowers– Expecttobemissing~5%or25%of
energyforrandombadchannels– Scalingreconstructedenergyby
1.05or1.25approximatelycorrectsbacktonominalreconstructedenergyasexpected
• Forstudieswhereexpecta+onislessobvious(ie:alltheothers)IjustscaletoforceaGaussianfittothepeaktomatchnominal
• Note:scalingperformedatplotlevelonly,doesnotimpacteventselec+on
9
Exampleforrandomlydistributedbadchannels:
EnergyResolu+onCrosscheck• Checkfrac+onal
energyresidualsforeachcase
• Seebiasasexpectedinuncorrectedresiduals
• Nominalresolu+onsimilartothatreportedbyN.Grant
• Seesomeincreaseinresolu+onfor25%missingchannelscase
10Nominal 5%Random 25%Random
EffectofDriTFieldonEreco• EffectssimulatedinMC:
– Largerdiffusion(driTingforlonger)– Largerlossduetoa^achment(driTingfor
longer)• Ofcoursethisdependsonpurity–we
simulate3mselectronlife+me– Largerlossduetorecombina+on(Birks’
Law)• Usingh^ps://lar.bnl.gov/proper+es/)
fordE/dx=4MeV/cm,3.6mdriTdistance,nominal(3ms)electronlife+me:– At500V/cm:Ra=0.48,Rc=0.63– At250V/cm:Ra=0.33,Rc=0.51
• Calorimetricenergyreconstruc+onusesaverageRc=0.63– Expecttoreconstructaround25%less
energyatlowerfield• Life+mecorrec+onishandledcorrectly• ImpactofdiffusiononErecoshouldbe
small?11
PIDCutTuning• Method:
– SetnumuPIDcutat0.5(notuning)– RequirenumuPID<0.5andnuePID>xfornueeventtobeselected(and
inversefornumuevents)– ScanthroughnuePIDcutvaluesinstepsof0.05– EvaluateCPVsensi+vityatδCP=-π/2– Defineop+mumcutvalueastheonebeforesensi+vitystartstodecrease(so
mightmiss2ndop+mumvalueifsensi+vityisnotmonotonicaboveandbelowop+mum)
• Resul+ngop+mizednuePIDcut(CVN)– Nominal:0.7– 5%badchannels:0.65– 25%badchannels:0.6
• Withmorebadchannels,prefercutwithslightlyhigheracceptancesuchthatsignalefficienciesaremoresimilarthanwithun-tunedcuts– Balancedbyincreasingbackgroundwithloosercuts
12
SummaryofCorrec+ons/Op+miza+on
Sample EnergyScaleFactor Op:mizedνeCut
MCC10.1Nominal 1.0 0.7
5%Bad–Random 1.05 0.65
5%Bad–ByChip 1.03 0.65
5%Bad–ByBoard 1.02 0.6
25%Bad–Random 1.25 0.6
25%Bad–ByChip 1.21 0.55
25%Bad–ByBoard 1.13 0.45
13
Sample EnergyScaleFactor Op:mizedνeCut
May2018Nominal 1.0 0.85
250V/cm 1.264 0.8
Efficiency:RandomBadChannels
14
Efficiency:5%BadChannels
15
Efficiency:25%BadChannels
16
Efficiency:DriTField
17
Sensi+vity:RandomBadChannels
18
Sensi+vity:BadChannelGroups
195%BadChannels 25%BadChannels
Sensi+vity:DriTField
20
ConclusionfromExis+ngStudies• CPVanalysispre^yinsensi+vetobadchannels,par+cularlywhengrouped
randomly– Seemsreasonable:byeye,differen+a+onbetweentracksandshowersisquite
easyevenwithmanymissinghits• Largergroupsofbadchannels(eg:boards)causemoretroublethan
randombadchannels– Againseemsreasonable:whenmissingawholeboard,significantpor+onsof
showerscouldbemissing– Energycorrec+onmethodalsolessrobustinthiscase–overcorrec+ng
showersthatdon’thappentohavebadboardsandundercorrec+ngthoseforwhichalargefrac+onofhitsaremissing
– Somelossofsensi+vitycouldberegainedbydetailedenergycorrec+onsand/orretrainingCVN
• 250V/cmdriTfieldproduceslargedegrada+oninsensi+vityrela+vetofull500V/cm– Wouldnetworkretrainingrecoversomeofthiseffect?
21
GoingForward• Iclaimbadchannelstudiesarecomplete:conclusionisCPVanalysis
reasonablyrobusttoanyrealis+csetofbadchannelsevenunderworstcasescenarioofnoretrainingordetailedenergycorrec+ons
• Retrainingnetworknotfeasibleformanyvaria+ons–ifveryimportantwecouldpickafewtostudymorecarefully(250V/cm?)– Firststepwouldbetolookatsomeeventdisplays–doweseemajorvisual
differencesbetweenshowersinthedifferentsamplessuchthatwesuspectretrainingwillhelp?
• Fieldnon-uniformitystudies– ImplementinMCusingspacechargeeffectsimula+onmachinery(justdummy
up“spacecharge”maps)– Inprogress–Boismakingtheini+alfielddistor+onmapsforus
• Noisestudies– Studyseverallevelsofincreasedwhitenoiseandadata-drivennoise
simula+on– ToolsexistwithinMC,butworknotyetac+velyunderwaytogenerate/analyze
thesesamples
22