CBSN Brewer Software Status

by: Tom Grajnar and Stephn Seko

December 2002

Summary of Previous PresentationsSummary of Previous Presentations

Why New CBSN Brewer Software? Philosophy Behind New Software User Interface—General Appearance User Interface—Components User Interface—Ozone MeasurementsUser Interface—Ozone Measurements Stages of Software Development Monitoring Development Status Software Developer Software Status

This PresentationThis Presentation

(TG) Update stages of software development(TG) Update stages of software development

(SS) Current status of software(SS) Current status of software

(SS) Upgrades and changes incorporated(SS) Upgrades and changes incorporated

(TG) Proposed upgrades and prioritization(TG) Proposed upgrades and prioritization

Stage I: ConversionStage I: Conversion

Conversion of GW Basic Brewer Conversion of GW Basic Brewer software to a MKII Brewer with old software to a MKII Brewer with old electronics on a simple schedule.electronics on a simple schedule.

Stage II: Control all BrewersStage II: Control all Brewers

Conversion Upgraded with ability to Conversion Upgraded with ability to run MKII, III, IV and V with old run MKII, III, IV and V with old electronics (either RCA or IOS micro electronics (either RCA or IOS micro board) or new K&Z electronicsboard) or new K&Z electronics

Stage III: User-Transparent UpgradesStage III: User-Transparent Upgrades

Improve B-file data content, data Improve B-file data content, data dissemination capabilities, measurement dissemination capabilities, measurement quality and instrument operation without quality and instrument operation without fundamental changes to data formatsfundamental changes to data formats

Hopefully maximize global Brewer user Hopefully maximize global Brewer user implementation since most existing data implementation since most existing data analysis and processing software should analysis and processing software should still function or require only minor still function or require only minor upgradesupgrades

Stage IV: User non-Transparent UpgradesStage IV: User non-Transparent Upgrades

Improvements which will affect the Improvements which will affect the fundamental operation, calibration, fundamental operation, calibration, or file formatsor file formats

Likely render most existing Brewer Likely render most existing Brewer data analysis, calibration and data analysis, calibration and presentation software inoperative presentation software inoperative and thus in need of upgrade or re-and thus in need of upgrade or re-writewrite

Stage V: Ongoing SupportStage V: Ongoing Support

Continue to address software Continue to address software problems, concerns and potential problems, concerns and potential upgrades as suggested by members upgrades as suggested by members of the global Brewer user communityof the global Brewer user community

Steps for Stages II through IVSteps for Stages II through IV1.1. Discussion and prioritization of upgradesDiscussion and prioritization of upgrades2.2. Implementation of upgradesImplementation of upgrades3.3. Brewer Software release internal CBSN onlyBrewer Software release internal CBSN only4.4. Extensive Internal MSC beta-testing with several MSC Extensive Internal MSC beta-testing with several MSC

rooftop Brewers (on two computers) plus on secondary rooftop Brewers (on two computers) plus on secondary Brewer at the 5 stations that have 2 BrewersBrewer at the 5 stations that have 2 Brewers

5.5. Document each bug and its fix and increment the Document each bug and its fix and increment the software version numbersoftware version number

6.6. Brewer Software release to Brewer community with Brewer Software release to Brewer community with request for potential upgradesrequest for potential upgrades

7.7. Progress to next stage when all known Stage # related Progress to next stage when all known Stage # related bugs have been resolvedbugs have been resolved

8.8. Inform Brewer community of final release of Stage # Inform Brewer community of final release of Stage # softwaresoftware

9.9. Consider deployment throughout CBSN after Consider deployment throughout CBSN after commencement of one year’s operation on 5 network commencement of one year’s operation on 5 network secondary Brewerssecondary Brewers

Currently Supported RoutinesCurrently Supported Routines AP - A/D monitor printoutAP - A/D monitor printout AS - Move tracker to sunAS - Move tracker to sun AZ - Azimuth zeroingAZ - Azimuth zeroing B0 - Lamps offB0 - Lamps off B1 - Mercury lamp onB1 - Mercury lamp on B2 - Standard lamp onB2 - Standard lamp on DS - Direct sun obsDS - Direct sun obs DT - Deadtime testDT - Deadtime test ED - End-of-day sequenceED - End-of-day sequence FM - Focused moon obsFM - Focused moon obs FR - Micrometer resetFR - Micrometer reset FW - Reset for filter wheel #3FW - Reset for filter wheel #3 FZ - Focused sun obsFZ - Focused sun obs HG - Mercury lamp calibrationHG - Mercury lamp calibration HP - Micrometer #2 alignmentHP - Micrometer #2 alignment N2 - Switch to NO2 modeN2 - Switch to NO2 mode O3 - Switch to O3 modeO3 - Switch to O3 mode PD - Activate writing to D filePD - Activate writing to D file PF - Deactivate writing to D filePF - Deactivate writing to D file PO - Instrument constants PO - Instrument constants

printoutprintout PZ - Point zenith prism to zenithPZ - Point zenith prism to zenith

RE - Instrument resetRE - Instrument reset RS - Run/stop testRS - Run/stop test SC - Sun scanSC - Sun scan SI - Solar sightingSI - Solar sighting SIM - Lunar sightingSIM - Lunar sighting SL - Standard lamp testSL - Standard lamp test SR - Step per revolution testSR - Step per revolution test UA - Timed UV scanUA - Timed UV scan UF - Fast UV scanUF - Fast UV scan UM - Umkehr measurementUM - Umkehr measurement UV - Standard UV scanUV - Standard UV scan UX - Extended UV scanUX - Extended UV scan W0 - 1 min waitW0 - 1 min wait W1 - 5 min waitW1 - 5 min wait W2 - 10 min waitW2 - 10 min wait W3 - 20 min waitW3 - 20 min wait W4 - 30 min waitW4 - 30 min wait ZB - Zenith blue obsZB - Zenith blue obs ZC - Zenith cloud obsZC - Zenith cloud obs ZE - Zero zenith motorZE - Zero zenith motor ZP - Zenith perpendicular obsZP - Zenith perpendicular obs ZS - Zenith sky obsZS - Zenith sky obs

Additional Supported RoutinesAdditional Supported Routines

SUM - Creates S fileSUM - Creates S file FMSUM - Summary printout for FM FMSUM - Summary printout for FM FZSUM - Summary printout for FZFZSUM - Summary printout for FZ HGSUM - Summary printout for HGHGSUM - Summary printout for HG OZSUM - Summary printout for ozone obsOZSUM - Summary printout for ozone obs SLSUM - Summary printout for SLSLSUM - Summary printout for SL UVSUM - Summary printout for UV scansUVSUM - Summary printout for UV scans ZSSUM - Summary printout for ZSZSSUM - Summary printout for ZS

To Be Supported (Stage II)To Be Supported (Stage II) CHECKAZ - checks the azimuth to CHECKAZ - checks the azimuth to

see if properly referencedsee if properly referenced CI - Lamp scanning routineCI - Lamp scanning routine CO - Add comment to B fileCO - Add comment to B file CY - Set slit mask cycles ??CY - Set slit mask cycles ?? CZ - Customizable scanCZ - Customizable scan DSP - Dispersion testDSP - Dispersion test DSP1 - Dispersion testDSP1 - Dispersion test ET - Focus Brewer mirrorET - Focus Brewer mirror FV - Optimal Sighting FV - Optimal Sighting

DeterminationDetermination GI - Global irradianceGI - Global irradiance GL - Ozone on Zenith Sky RoutineGL - Ozone on Zenith Sky Routine GS - Grating synchronizationGS - Grating synchronization

G1, G5 – Updated GS routinesG1, G5 – Updated GS routines HV - High voltage testHV - High voltage test HVSET - Sets the high voltageHVSET - Sets the high voltage J3 - Performs all three global J3 - Performs all three global

irradiance, sun and zenith jump irradiance, sun and zenith jump scan measurementsscan measurements

JDirDif - direct sun with usual ds JDirDif - direct sun with usual ds optics vs direct sun on diffuseroptics vs direct sun on diffuser

JL - Standard lamp jump scanJL - Standard lamp jump scan MD - Modem RoutineMD - Modem Routine

QL - Lamp Quick ScanQL - Lamp Quick Scan QS - Lamp quick scanQS - Lamp quick scan SH - Motor timing testSH - Motor timing test SS - Extended UV Direct Sun ScanSS - Extended UV Direct Sun Scan S0 - Modified ss.rtn for red Brewers--S0 - Modified ss.rtn for red Brewers--

looks at direct sun (40 cycles)looks at direct sun (40 cycles) SV - Modified ss.rtn for red Brewers--SV - Modified ss.rtn for red Brewers--

looks at direct sun (1 cycle)looks at direct sun (1 cycle) SZ - Modified ss.rtn for red Brewers--SZ - Modified ss.rtn for red Brewers--

looks at zenithlooks at zenith TESTFW2 - ND filter attenuationTESTFW2 - ND filter attenuation TR - Tracker onTR - Tracker on TF - Tracker offTF - Tracker off TU - Test UVB port alignmentTU - Test UVB port alignment UB - Summary and recalc for DUVUB - Summary and recalc for DUV UL - External Lamp scanUL - External Lamp scan UX - Extended external lamp scanUX - Extended external lamp scan XQ - Extended external Lamp XQ - Extended external Lamp

Scanning RoutineScanning Routine GLSUM - summary list of global GLSUM - summary list of global

radiation O3 observationsradiation O3 observations NOSUM - Summary printout for NO2NOSUM - Summary printout for NO2 RL - Read Brewer LogRL - Read Brewer Log TE - Check temperatureTE - Check temperature

GUI-Related RoutinesGUI-Related RoutinesCurrently Supported through GUICurrently Supported through GUI

CF - Editing ICF fileCF - Editing ICF file IC - Editing Op_State fileIC - Editing Op_State file LL - Enters locationLL - Enters location

To be supported through GUITo be supported through GUI

AU - Setup auto sequence of commands (AUC)AU - Setup auto sequence of commands (AUC) DA - Change dateDA - Change date LF - Edit location fileLF - Edit location file NO - Change instrument numberNO - Change instrument number REP - Display average filesREP - Display average files SA - Solar/lunar angle printoutSA - Solar/lunar angle printout SE - Schedule editorSE - Schedule editor ST - Brewer statusST - Brewer status TI - Change timeTI - Change time TT - Teletype modeTT - Teletype mode

Miscellaneous RoutinesMiscellaneous RoutinesData Analysis Routines--Leave these Data Analysis Routines--Leave these out?out?

PB - Play backPB - Play back TCSUM - Change summary files using new TCSUM - Change summary files using new

temperature coefficientstemperature coefficients

Redundant Routines—Plan to leave outRedundant Routines—Plan to leave out

AB_SK - Abort scheduleAB_SK - Abort schedule CS - Setup command sequence ??CS - Setup command sequence ?? DA_LO - Get date and locationDA_LO - Get date and location DD - Print data directoryDD - Print data directory DDS - Display data directoryDDS - Display data directory DDP - Print program directoryDDP - Print program directory DI - Turn on data recording DI - Turn on data recording EX - Exit to DOSEX - Exit to DOS FF - Form-feed commandFF - Form-feed command INIT - InitializeINIT - Initialize

LD - Long data formatLD - Long data format ND - Format diskND - Format disk NR - Turn off data recordingNR - Turn off data recording PN - Print to printerPN - Print to printer SHELL - Shell to DOSSHELL - Shell to DOS SD - Short data formatSD - Short data format SK - Run schedule non-SK - Run schedule non-

continuouscontinuous SLEEP - End operationsSLEEP - End operations TD - Shell to DOS to update TD - Shell to DOS to update

clockclock

Stage I: Upgrades and ChangesStage I: Upgrades and Changes Windows operating system time and date used--Td Windows operating system time and date used--Td

routine eliminatedroutine eliminated Support more than two COM portsSupport more than two COM ports RS and DT have detailed entries in the B-fileRS and DT have detailed entries in the B-file Re performs a reset for all motorsRe performs a reset for all motors Fr routine performs reset on micrometers onlyFr routine performs reset on micrometers only Fw command performs reset for filter wheels #1-3Fw command performs reset for filter wheels #1-3 Sr moves the tracker 14000 of 14670 steps/rev then Sr moves the tracker 14000 of 14670 steps/rev then

moves in smaller increments to find flagmoves in smaller increments to find flag Output to printer no longer supportedOutput to printer no longer supported Improved Si and Sim response to push buttons--motor Improved Si and Sim response to push buttons--motor

positions sent only if changedpositions sent only if changed Uploads Julian’s code that:Uploads Julian’s code that:

• allows simultaneous movement of both micrometers allows simultaneous movement of both micrometers for all measurementsfor all measurements

• speeds up zeroing of zenith, azimuth and micrometer speeds up zeroing of zenith, azimuth and micrometer motors by eliminating continual checking of LED status motors by eliminating continual checking of LED status bitbit

Software Status SummarySoftware Status Summary

Stage I completedStage I completed 3 Brewers running on one computer 3 Brewers running on one computer

(2 under new software)(2 under new software) Stage II about half doneStage II about half done

• 50 routines completed 50 routines completed • 50 more routines to be written50 more routines to be written• new electronics support to be addednew electronics support to be added

Anticipated Stage II completion—May Anticipated Stage II completion—May 20032003

Stage II: Proposed Upgrades and ChangesStage II: Proposed Upgrades and Changes

Include support for use of Brewer clockInclude support for use of Brewer clock Include Brewer software version at beginning of every B-file using Include Brewer software version at beginning of every B-file using

format “Brewer software version: A-B-C-D” where A is the format “Brewer software version: A-B-C-D” where A is the programming environment, B is the software development stage programming environment, B is the software development stage #, C is the release number, and D is the compilation number#, C is the release number, and D is the compilation number

DSP routine to include lamp and wavelength configuration option DSP routine to include lamp and wavelength configuration option used by CBSN and automatically log both initial and final hg tests, used by CBSN and automatically log both initial and final hg tests, lamp used, wavelength, slit and FW2 position to D-file. If lamp used, wavelength, slit and FW2 position to D-file. If calculated step is beyond range of micrometer then note this in D-calculated step is beyond range of micrometer then note this in D-file and proceed to next slit.file and proceed to next slit.

Modify dsp routine to select correct ND filter based on an intensity Modify dsp routine to select correct ND filter based on an intensity test to optimize signal to noise and prevent PMT saturation.test to optimize signal to noise and prevent PMT saturation.

SH routine modified to not require initial pd and to provide default SH routine modified to not require initial pd and to provide default values for the test. Record results into B-file alsovalues for the test. Record results into B-file also

Provide default values for HV test and log results into B-fileProvide default values for HV test and log results into B-file Harmonize dssum.rtn with md.rtn so they use same acceptance Harmonize dssum.rtn with md.rtn so they use same acceptance

criteria and log acceptance criteria in dssum d-file headercriteria and log acceptance criteria in dssum d-file header Low disk space warning (20 MB).Low disk space warning (20 MB). Upload change in shutter timing constant if changed in cfUpload change in shutter timing constant if changed in cf

Stage III: Minor Upgrades and ChangesStage III: Minor Upgrades and Changes Implement hg 296.7 line for hg calibrations but also support 302.2 lineImplement hg 296.7 line for hg calibrations but also support 302.2 line Make the Hp routine a part of the Hg routineMake the Hp routine a part of the Hg routine Display error messages when schedule abortedDisplay error messages when schedule aborted Error log file to record date, time and information for all error messagesError log file to record date, time and information for all error messages Elimination of NO2 offset constantElimination of NO2 offset constant Check if previous day’s B-file complete on software startup—if not then create S-file and Check if previous day’s B-file complete on software startup—if not then create S-file and

update avg files update avg files Option to specify to exit to menu immediately or exit after the current measurement Option to specify to exit to menu immediately or exit after the current measurement

when home key pressedwhen home key pressed Modify md routine to create bulletins that include ds zs fm gi um red and from uv o3 Modify md routine to create bulletins that include ds zs fm gi um red and from uv o3

values and create daily summaries for all of these measurementsvalues and create daily summaries for all of these measurements Routine to scan sl and hg lamp to determine the optimum zenith offset valueRoutine to scan sl and hg lamp to determine the optimum zenith offset value Modify ap routine to measure humidityModify ap routine to measure humidity Automate sr check and update of constant if it is within 5 steps of previous value or Automate sr check and update of constant if it is within 5 steps of previous value or

repeat again to confirm results consistent. If not consistent after 3 tries then log error repeat again to confirm results consistent. If not consistent after 3 tries then log error messagemessage

Log all relevant values to avg filesLog all relevant values to avg files Upgrade the tu test to perform ze both before and after the tu and to log this Upgrade the tu test to perform ze both before and after the tu and to log this

information to the B-file. Also expand the number of steps scanned to 40information to the B-file. Also expand the number of steps scanned to 40 Check box option to ftp B UV etc. files to various data centres along with option to send Check box option to ftp B UV etc. files to various data centres along with option to send

real-time ozone and UV bulletinsAz, Ze and Fw end of day values on screenreal-time ozone and UV bulletinsAz, Ze and Fw end of day values on screen Low disk space warningLow disk space warning Log all “waiting for za…” messages to d-fileLog all “waiting for za…” messages to d-file Add suncscan output to B-fileAdd suncscan output to B-file Add NO2 heading under UV on UI with ds and zs subheadingsAdd NO2 heading under UV on UI with ds and zs subheadings Possible to perform dsp using only lines in the visible (say from a Neon bulb) for a MKIV Possible to perform dsp using only lines in the visible (say from a Neon bulb) for a MKIV

and MKV and the correlation to the UV dispersion is 100%-set up default config in dspand MKV and the correlation to the UV dispersion is 100%-set up default config in dsp

Stage III: Major Upgrades and ChangesStage III: Major Upgrades and Changes Allow user FTP bulletins to user-specified site(s) in real-time--prompt the Allow user FTP bulletins to user-specified site(s) in real-time--prompt the

user for this information the first time that the program is runuser for this information the first time that the program is run Allow user to select file types (B, D, UV, etc. or ALL) to automatically Allow user to select file types (B, D, UV, etc. or ALL) to automatically

send to one or more FTP—sites at end of day (available defaults should send to one or more FTP—sites at end of day (available defaults should include WOUDC and other regional data centres)--prompt the user for include WOUDC and other regional data centres)--prompt the user for this information the first time that the program is runthis information the first time that the program is run

Apply grating slope and intercept information to all measurements and Apply grating slope and intercept information to all measurements and consider changing this function to something other than a linear one in consider changing this function to something other than a linear one in order to better model the actual relationshiporder to better model the actual relationship

Add target step value to B-file hg test outputAdd target step value to B-file hg test output Incorporate real-time ozone determination from GI UV UM Red scansIncorporate real-time ozone determination from GI UV UM Red scans Incorporate stray-light reduction algorithm from McLindenIncorporate stray-light reduction algorithm from McLinden Option to send email to a specified user list on user-selectable conditionsOption to send email to a specified user list on user-selectable conditions

—ex. Temperature or humidity, sighting values, drive discrepancy values —ex. Temperature or humidity, sighting values, drive discrepancy values beyond acceptable limits etc.beyond acceptable limits etc.

Incorporate Julian’s fv (sighting check) routine and update of sighting Incorporate Julian’s fv (sighting check) routine and update of sighting correction values.correction values.

Also incorporate data from all calibrations into B-file (ex., dsp, ul, xl, ql, Also incorporate data from all calibrations into B-file (ex., dsp, ul, xl, ql, ci, cz, sh, hv, tu, etc.)ci, cz, sh, hv, tu, etc.)

Implement appropriate Rayleigh Scattering Coefficients (re: Annex I – Implement appropriate Rayleigh Scattering Coefficients (re: Annex I – Recommendations from the 5Recommendations from the 5thth Brewer Workshop, Halkidiki, Greece, Brewer Workshop, Halkidiki, Greece, 1998)1998)

Stage IV: Upgrades and ChangesStage IV: Upgrades and Changes Hg routine could be made to run automatically without needing to Hg routine could be made to run automatically without needing to

be entered in schedules based on a 2 or 3 degree change in be entered in schedules based on a 2 or 3 degree change in temperature—must be user selectabletemperature—must be user selectable

XL should have overlap at filter changeXL should have overlap at filter change Fix the dark count file format error in the UV UX Ul Xl filesFix the dark count file format error in the UV UX Ul Xl files Place results of all routines, tests and calibrations into B-file and Place results of all routines, tests and calibrations into B-file and

consider eliminating all other output filesconsider eliminating all other output files Julian’s new dispersion routine which uses a polynomial fitJulian’s new dispersion routine which uses a polynomial fit Examine Julian’s modified 3.74d Brewer software run on 119 for Examine Julian’s modified 3.74d Brewer software run on 119 for

potential upgradespotential upgrades Examine Julian’s MatLab Brewer software for potential upgradesExamine Julian’s MatLab Brewer software for potential upgrades The program could be made to run more than one Brewer at the The program could be made to run more than one Brewer at the

same timesame time A code generator or a sort of high level scripting language that will A code generator or a sort of high level scripting language that will

allow users to create and customize routines without having to allow users to create and customize routines without having to change the program itself. A better solution to the above would be change the program itself. A better solution to the above would be to make the measurement and test routines available as an editable to make the measurement and test routines available as an editable VB file that can be compiled into a resource dll to be utilized by the VB file that can be compiled into a resource dll to be utilized by the main program which will only be available as the compiled program main program which will only be available as the compiled program and, therefore, not changeable by the users. The modules that they and, therefore, not changeable by the users. The modules that they can edit or create will use only the appropriate resources of the can edit or create will use only the appropriate resources of the main program which should be accessed programmatically in a way main program which should be accessed programmatically in a way that is simple and concise?that is simple and concise?

Stage IV: More Upgrades and ChangesStage IV: More Upgrades and Changes Dispersion coeffs affected by temp of ozone layer and ozone Dispersion coeffs affected by temp of ozone layer and ozone

amount-- would be good if the algorithm would take these two amount-- would be good if the algorithm would take these two factors into accountfactors into account

Laser scan information can be used to determine the shape of the Laser scan information can be used to determine the shape of the slits which can then be used to determine a correction for stray slits which can then be used to determine a correction for stray lightlight

Implement separate set of Rayleigh scattering coefficients for NO2Implement separate set of Rayleigh scattering coefficients for NO2 ND coefficients for each Brewer which reflect its own specific ND coefficients for each Brewer which reflect its own specific

filters--would need 5 different etcs for O3 and 5 for SO2 to correct filters--would need 5 different etcs for O3 and 5 for SO2 to correct for different transmission function of each ND filterfor different transmission function of each ND filter

Record neutral density values for all filter positions and all slits Record neutral density values for all filter positions and all slits (6x5=30, or 6x6=36 if slit0 is included) into the icf files(6x5=30, or 6x6=36 if slit0 is included) into the icf files

Consider placing Consider placing ALLALL Brewer information into B-file, formatted B- Brewer information into B-file, formatted B-file output to D-file and average files, no other files requiredfile output to D-file and average files, no other files required

Do several slul measurements througout the day at various Do several slul measurements througout the day at various temperatures and then do a fit to counts as a function of temperatures and then do a fit to counts as a function of temperature for each ul wavelength in order to determine temperature for each ul wavelength in order to determine temperature coefficients over the entire uv range so can compare temperature coefficients over the entire uv range so can compare uv measurements over the entire rangeuv measurements over the entire range

Information Dissemination ProposalInformation Dissemination Proposal

New Brewer software (.exe+source) and original presentation + New Brewer software (.exe+source) and original presentation + this one (.ppt+.txt) available to:this one (.ppt+.txt) available to:

• MSC-ARQXMSC-ARQX on Arqx_NT: Arqx_home1\common\grajnar\Brewer on Arqx_NT: Arqx_home1\common\grajnar\Brewer

softwaresoftware

• International Brewer user communityInternational Brewer user community Notify all via email of software availabiltyNotify all via email of software availabilty Request comments and recommendationsRequest comments and recommendations Provide information for download on FTP siteProvide information for download on FTP site

Development of “Brewer User’s” support websiteDevelopment of “Brewer User’s” support website