18:08:26 - Module 77 is connected to channel 1 of DTC slot 19
18:08:29 - Starting task "Powering modules..."
18:08:29 - Executing command '/opt/cta/bin/cta_ctrl --slot 19 --channel 1 --power_on' on Digital Trigger Crate at 10.10.4.57
18:08:31 - Finished task "Powering modules..."
18:08:32 - Module 78 is connected to channel 8 of DTC slot 19
18:08:35 - Starting task "Powering modules..."
18:08:35 - Executing command '/opt/cta/bin/cta_ctrl --slot 19 --channel 8 --power_on' on Digital Trigger Crate at 10.10.4.57
18:08:37 - Finished task "Powering modules..."
18:08:41 - Scanning interface enp2s0 for non configured modules...
18:08:41 - Found 1 MAC address(es)
18:08:43 - Scanning interface enp2s0 for non configured modules...
18:08:43 - Found 2 MAC address(es)
18:08:48 - Starting task "Configure modules"
18:08:48 - Configuring modules with configuration /data/config/2020/20200924/config_tower_2modules_FEBv6_pingpong_Ibof_Dacl.NMC.xml
18:08:48 - Switching off high voltages in configuration
18:08:52 - Successfully configured 2 module(s)
18:08:52 - All front-end boards are programmed with firmware F61D2009
18:08:52 - All backplanes are programmed with firmware 15
18:08:53 - NMC is in state NmcState.Configured and knows of 2 drawer(s)
18:08:53 - Found 0 PPS errors.
18:08:53 - Finished task "Configure modules"
18:09:01 - Starting task "Switch HVPA voltage state"
18:09:01 - Setting HVPA current limit to 12489.75 uA
18:09:01 - Setting HVPA ramp speed to 25 V/s
18:09:01 - High voltage locked channels will be checked every 30 s
18:09:01 - Switching HVPA to state Nominal
18:09:08 - Setting HVPA current limits...
18:09:10 - Finished task "Switch HVPA voltage state"
18:09:21 - Calling method FSM.gotoReady in object FSM
18:09:26 - Calling method FSM.gotoObserving in object FSM
18:09:32 - Checking for high voltage locked pixels...
18:09:59 - Starting task "Check high voltages"
18:09:59 - Found 2 drawer(s) in Nominal state, 0 in Low state and 0 in Wait state
18:09:59 - Actual voltage is between 954.65 V and 1171.81 V.
18:09:59 - Low voltages range between 300.00 V and 300.00 V. 
18:10:00 - Reference voltages range between 954.64 V and 1172.13 V. 
18:10:00 - Maximum difference between expected and actual voltages is 0.81 V
18:10:01 - Maximum of current limits is 5411.92 uA
18:10:01 - Checking status of HVPA module in 2 drawer(s)...
18:10:01 - Checking status of HVPA channels in 2 drawer(s)...
18:10:01 - HV is stabilized in all channels.
18:10:01 - Checking reference and low voltages against /data/config/2020/20200924/config_tower_2modules_FEBv6_pingpong_Ibof_Dacl.NMC.xml
18:10:01 - Done
18:10:02 - Checking for high voltage locked pixels...
18:10:02 - Finished task "Check high voltages"
18:10:03 - Starting task "Set L0 trigger thresholds"
18:10:03 - Setting L0 thresholds to 15.0 p.e. using /data/luts/l0_threshold_slope_and_offset_feb_20200708.h5
18:10:04 - Setting L0 thresholds to 15.0 p.e. per pixel using L0 slopes and offsets in /data/luts/l0_threshold_slope_and_offset_feb_20200708.h5
18:10:04 - Thresholds saved in configuration file /data/config/2020/20200924/config_2020-09-24_18-10-04.NMC.xml
18:10:04 - Finished task "Set L0 trigger thresholds"
18:10:07 - Starting NMC
18:10:07 - Clearing PPS error counters
18:10:10 - Configuring calibration box...
18:10:10 - Configuring calibration box with leds=0x1fff voltage=11.00 frequency=5000.0/1 central_current=0.0 duration=0 width=1 lemo_out=True fiber1_out=True fiber2_out=True lemo_in=True enabled=True
18:10:14 - Resetting TIB...
18:10:16 - Updating L0 scaler widget...
18:10:18 - Updating L1 scaler widget...
18:10:29 - Starting NMC
18:10:29 - Clearing PPS error counters
18:10:32 - Checking for high voltage locked pixels...
18:10:50 - Checking UCTS clock...
18:10:50 - UCTS clock is late by 5 seconds!
18:10:50 - Configuring UCTS
18:10:50 - Configuring TIB...
18:10:50 - Setting TIB forced mode to False
18:10:51 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v
18:10:51 - Status: TibState.RunStopped
18:10:51 - Alarms: AlarmVector.NoAlarm
18:10:51 - Connection status: False TXclient_alive: False
18:10:51 - Disabling PPS
18:10:53 - Status: TibState.PpsStopped
18:10:53 - Alarms: AlarmVector.NoAlarm
18:10:53 - Connection status: False TXclient_alive: False
18:10:53 - Entering set_external_delay
18:10:53 - Setting ExternalDelayLocal to 0.000 ns
18:10:53 - Writing 0.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v
18:10:53 - Entering set_external_delay
18:10:53 - Setting ExternalDelayCalibration to 65.000 ns
18:10:53 - Writing 65.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v
18:10:53 - Entering set_external_delay
18:10:53 - Setting ExternalDelaySphe to 150.000 ns
18:10:53 - Writing 150.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v
18:10:53 - Setting TIB trigger mode to 0x51 = TriggerMask.SlowControl|Software|Mono
18:10:53 - Writing 81 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v
18:10:53 - Writing 1 to Camera.TIB.InputsEnable.InputMask.InputMask_v
18:10:53 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v
18:10:53 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v
18:10:53 - Writing False to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v
18:10:53 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v
18:10:53 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v
18:10:53 - Status: TibState.PpsStopped
18:10:53 - Alarms: AlarmVector.NoAlarm
18:10:53 - Connection status: False TXclient_alive: False
18:10:53 - Writing False to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v
18:10:53 - Writing 2000 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v
18:10:53 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
18:10:53 - Writing False to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v
18:10:53 - Writing 2000 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v
18:10:53 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v
18:10:53 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
18:10:53 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v
18:10:53 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v
18:10:53 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
18:10:55 - Connecting TIB to camera server at 10.10.4.12:222
18:10:55 - Starting TIB...
18:10:55 - Status: TibState.PpsStopped
18:10:55 - Alarms: AlarmVector.NoAlarm
18:10:55 - Connection status: False TXclient_alive: True
18:10:55 - Resetting run
18:10:55 - Wait for UCTS external trigger before enabling trigger...
18:10:55 - Status: TibState.Standby
18:10:55 - Alarms: AlarmVector.NoAlarm
18:10:55 - Connection status: False TXclient_alive: True
18:10:55 - Status: TibState.Standby
18:10:55 - Alarms: AlarmVector.NoAlarm
18:10:55 - Connection status: False TXclient_alive: True
18:10:56 - Status: TibState.CoutingPps
18:10:56 - Alarms: AlarmVector.NoAlarm
18:10:56 - Connection status: True TXclient_alive: True
18:11:00 - Starting TIB triggers...
18:11:00 - Enabling trigger
18:11:00 - Status: TibState.Running
18:11:00 - Alarms: AlarmVector.NoAlarm
18:11:00 - Connection status: True TXclient_alive: True
18:11:01 - Status: TibState.Running ConnectionStatus: True TXclient_alive: True
18:11:01 - Alarms: AlarmVector.NoAlarm
18:11:01 - Temperature: 41.25
18:11:01 - Local camera rate: 7296.0 Hz
18:11:01 - Stereo trigger rate: 0.0 Hz
18:11:01 - SPE trigger rate: 0.0 Hz
18:11:01 - Calibration trigger rate: 7476.0 Hz
18:11:01 - Software trigger rate: 0.0 Hz
18:11:01 - Pedestal trigger rate: 0.0 Hz
18:11:01 - Collected trigger rate: 4189.0 Hz
18:11:01 - Busy rate: 6.0 Hz
18:11:01 - Camera trigger rate: 4183.0 Hz
18:11:02 - Checking for high voltage locked pixels...
18:11:02 - Status: TibState.Running ConnectionStatus: True TXclient_alive: True
18:11:02 - Alarms: AlarmVector.NoAlarm
18:11:02 - Temperature: 41.25
18:11:02 - Local camera rate: 7296.0 Hz
18:11:02 - Stereo trigger rate: 0.0 Hz
18:11:02 - SPE trigger rate: 0.0 Hz
18:11:02 - Calibration trigger rate: 7476.0 Hz
18:11:02 - Software trigger rate: 0.0 Hz
18:11:02 - Pedestal trigger rate: 0.0 Hz
18:11:02 - Collected trigger rate: 4189.0 Hz
18:11:02 - Busy rate: 6.0 Hz
18:11:02 - Camera trigger rate: 4183.0 Hz
18:11:03 - Status: TibState.Running ConnectionStatus: True TXclient_alive: True
18:11:03 - Alarms: AlarmVector.NoAlarm
18:11:03 - Temperature: 41.25
18:11:03 - Local camera rate: 7296.0 Hz
18:11:03 - Stereo trigger rate: 0.0 Hz
18:11:03 - SPE trigger rate: 0.0 Hz
18:11:03 - Calibration trigger rate: 7476.0 Hz
18:11:03 - Software trigger rate: 0.0 Hz
18:11:03 - Pedestal trigger rate: 0.0 Hz
18:11:03 - Collected trigger rate: 4189.0 Hz
18:11:03 - Busy rate: 6.0 Hz
18:11:03 - Camera trigger rate: 4183.0 Hz
18:11:04 - Status: TibState.Running ConnectionStatus: True TXclient_alive: True
18:11:04 - Alarms: AlarmVector.NoAlarm
18:11:04 - Temperature: 41.25
18:11:04 - Local camera rate: 7296.0 Hz
18:11:04 - Stereo trigger rate: 0.0 Hz
18:11:04 - SPE trigger rate: 0.0 Hz
18:11:04 - Calibration trigger rate: 7476.0 Hz
18:11:04 - Software trigger rate: 0.0 Hz
18:11:04 - Pedestal trigger rate: 0.0 Hz
18:11:04 - Collected trigger rate: 4189.0 Hz
18:11:04 - Busy rate: 6.0 Hz
18:11:04 - Camera trigger rate: 4183.0 Hz
18:11:05 - Status: TibState.Running ConnectionStatus: True TXclient_alive: True
18:11:05 - Alarms: AlarmVector.ReadError
18:11:05 - Temperature: 41.25
18:11:05 - Local camera rate: 7296.0 Hz
18:11:05 - Stereo trigger rate: 0.0 Hz
18:11:05 - SPE trigger rate: 0.0 Hz
18:11:06 - Calibration trigger rate: 7476.0 Hz
18:11:06 - Software trigger rate: 0.0 Hz
18:11:06 - Pedestal trigger rate: 0.0 Hz
18:11:06 - Collected trigger rate: 4189.0 Hz
18:11:06 - Busy rate: 6.0 Hz
18:11:06 - Camera trigger rate: 4183.0 Hz
18:11:07 - Status: TibState.Running ConnectionStatus: True TXclient_alive: True
18:11:07 - Alarms: AlarmVector.ReadError
18:11:07 - Temperature: 41.25
18:11:07 - Local camera rate: 7296.0 Hz
18:11:07 - Stereo trigger rate: 0.0 Hz
18:11:07 - SPE trigger rate: 0.0 Hz
18:11:07 - Calibration trigger rate: 7476.0 Hz
18:11:07 - Software trigger rate: 0.0 Hz
18:11:07 - Pedestal trigger rate: 0.0 Hz
18:11:07 - Collected trigger rate: 4189.0 Hz
18:11:07 - Busy rate: 6.0 Hz
18:11:07 - Camera trigger rate: 4183.0 Hz
18:11:08 - Status: TibState.Running ConnectionStatus: True TXclient_alive: True
18:11:08 - Alarms: AlarmVector.ReadError
18:11:08 - Temperature: 41.25
18:11:08 - Local camera rate: 7169.0 Hz
18:11:08 - Stereo trigger rate: 0.0 Hz
18:11:08 - SPE trigger rate: 0.0 Hz
18:11:08 - Calibration trigger rate: 7335.0 Hz
18:11:08 - Software trigger rate: 0.0 Hz
18:11:08 - Pedestal trigger rate: 0.0 Hz
18:11:08 - Collected trigger rate: 7169.0 Hz
18:11:08 - Busy rate: 7169.0 Hz
18:11:08 - Camera trigger rate: 0.0 Hz
18:11:10 - Status: TibState.Running ConnectionStatus: True TXclient_alive: True
18:11:10 - Alarms: AlarmVector.ReadError
18:11:10 - Temperature: 41.19
18:11:10 - Local camera rate: 7169.0 Hz
18:11:10 - Stereo trigger rate: 0.0 Hz
18:11:10 - SPE trigger rate: 0.0 Hz
18:11:10 - Calibration trigger rate: 7335.0 Hz
18:11:10 - Software trigger rate: 0.0 Hz
18:11:10 - Pedestal trigger rate: 0.0 Hz
18:11:10 - Collected trigger rate: 7169.0 Hz
18:11:10 - Busy rate: 7169.0 Hz
18:11:10 - Camera trigger rate: 0.0 Hz
18:11:11 - Status: TibState.Running ConnectionStatus: True TXclient_alive: True
18:11:11 - Alarms: AlarmVector.ReadError
18:11:11 - Temperature: 41.25
18:11:11 - Local camera rate: 7169.0 Hz
18:11:11 - Stereo trigger rate: 0.0 Hz
18:11:11 - SPE trigger rate: 0.0 Hz
18:11:11 - Calibration trigger rate: 7335.0 Hz
18:11:11 - Software trigger rate: 0.0 Hz
18:11:11 - Pedestal trigger rate: 0.0 Hz
18:11:11 - Collected trigger rate: 7169.0 Hz
18:11:11 - Busy rate: 7169.0 Hz
18:11:11 - Camera trigger rate: 0.0 Hz
18:11:32 - Checking for high voltage locked pixels...
18:11:50 - Stopping TIB...
18:11:50 - Status: TibState.Running
18:11:50 - Alarms: AlarmVector.ReadError
18:11:50 - Connection status: True TXclient_alive: True
18:11:50 - Disabling trigger
18:11:50 - Disabling PPS
18:11:51 - Status: TibState.PpsStopped
18:11:51 - Alarms: AlarmVector.ReadError
18:11:51 - Connection status: True TXclient_alive: True
18:11:51 - Closing TIB connection to camera server
18:11:52 - Status: TibState.PpsStopped
18:11:52 - Alarms: AlarmVector.ReadError
18:11:53 - Connection status: False TXclient_alive: False
18:11:53 - Run duration: 0:00:54
18:11:53 - Local camera triggers: 388587
18:11:53 - Slow control triggers: 0
18:11:53 - Single photo-electron triggers: 0
18:11:53 - Calibration triggers: 398015
18:11:53 - Software triggers from UCTS: 0
18:11:53 - Pedestal triggers: 0
18:11:53 - Collected input triggers: 362962
18:11:53 - Busy triggers: 321963
18:11:53 - Camera event triggers sent to clusters: 40999
18:11:58 - Calling method FSM.gotoReady in object FSM
18:12:02 - Checking for high voltage locked pixels...