16:30:47 - Starting task "Configure modules"
16:30:47 - Setting L0 thresholds to 3.0 p.e. per pixel using L0 slopes and offsets in /data/luts/l0_threshold_slope_and_offset_feb_20200708.h5
16:30:48 - Configuring modules with configuration /data/config/2020/20200903/config_2020-09-03_16-30-47.NMC.xml
16:30:48 - Switching off high voltages in configuration
16:30:51 - Successfully configured 52 module(s)
16:30:52 - All front-end boards are programmed with firmware F55D2001
16:30:54 - All backplanes are programmed with firmware 15
16:31:02 - NMC is in state NmcState.Configured and knows of 52 drawer(s)
16:31:03 - Found 0 PPS errors.
16:31:04 - Finished task "Configure modules"
16:31:07 - Starting task "Switch HVPA voltage state"
16:31:07 - Setting HVPA current limit to 12489.75 uA
16:31:27 - Setting HVPA ramp speed to 500 V/s
16:31:29 - Switching HVPA to state Low
16:31:38 - Setting HVPA current limits...
16:31:40 - High voltage locked channels will be checked every 30 s
16:32:06 - Finished task "Switch HVPA voltage state"
16:32:09 - Updating voltage widget...
16:32:13 - Checking for high voltage locked pixels...
16:32:14 - Module 81 has 1 pixel(s) locked (HVPA status of 0x3f)!
16:32:14 - Module 101 has 1 pixel(s) locked (HVPA status of 0x7e)!
16:32:14 - Module 117 has 1 pixel(s) locked (HVPA status of 0x7b)!
16:32:15 - Module 163 has 1 pixel(s) locked (HVPA status of 0x77)!
16:32:15 - Module 164 has 1 pixel(s) locked (HVPA status of 0x77)!
16:32:15 - Unlocking 5 channel(s)...
16:32:16 - Resetting HVPA channel 6 of drawer 81...
16:32:16 - Resetting HVPA channel 0 of drawer 101...
16:32:16 - Resetting HVPA channel 2 of drawer 117...
16:32:16 - Resetting HVPA channel 3 of drawer 163...
16:32:17 - Resetting HVPA channel 3 of drawer 164...
16:32:36 - Updating voltage widget...
16:32:40 - Checking for high voltage locked pixels...
16:32:46 - Starting task "Switch HVPA voltage state"
16:32:46 - Setting HVPA current limit to 12489.75 uA
16:33:04 - Checking UCTS clock...
16:33:04 - UCTS clock is late by 161077 seconds!
16:33:04 - Configuring UCTS
16:33:04 - Configuring TIB...
16:33:04 - Setting TIB forced mode to False
16:33:04 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v
16:33:04 - Status: TibState.CoutingPps
16:33:04 - Alarms: AlarmVector.NoAlarm
16:33:04 - Connection status: False TXclient_alive: True
16:33:04 - Disabling PPS
16:33:04 - Error configuring TIB: Failed to call DisablePPS: Bad statuses are present
16:33:06 - Setting HVPA ramp speed to 25 V/s
16:33:09 - Switching HVPA to state Nominal
16:33:10 - Checking for high voltage locked pixels...
16:33:12 - Resetting TIB...
16:33:18 - Checking UCTS clock...
16:33:18 - UCTS clock is late by 161077 seconds!
16:33:18 - Configuring UCTS
16:33:18 - Configuring TIB...
16:33:18 - Setting TIB forced mode to False
16:33:18 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v
16:33:18 - Status: TibState.RunStopped
16:33:18 - Alarms: AlarmVector.NoAlarm
16:33:18 - Connection status: False TXclient_alive: False
16:33:18 - Disabling PPS
16:33:20 - Status: TibState.PpsStopped
16:33:20 - Alarms: AlarmVector.NoAlarm
16:33:20 - Connection status: False TXclient_alive: False
16:33:20 - Entering set_external_delay
16:33:20 - Setting ExternalDelayLocal to 0.000 ns
16:33:20 - Writing 0.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v
16:33:21 - Entering set_external_delay
16:33:21 - Setting ExternalDelayCalibration to 65.000 ns
16:33:21 - Writing 65.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v
16:33:21 - Entering set_external_delay
16:33:21 - Setting ExternalDelaySphe to 150.000 ns
16:33:21 - Writing 150.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v
16:33:21 - Setting TIB trigger mode to 0x71 = TriggerMask.SlowControl|Pedestal|Software|Mono
16:33:21 - Writing 113 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v
16:33:21 - Writing 1 to Camera.TIB.InputsEnable.InputMask.InputMask_v
16:33:21 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v
16:33:21 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v
16:33:21 - Writing False to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v
16:33:21 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v
16:33:21 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v
16:33:21 - Status: TibState.PpsStopped
16:33:21 - Alarms: AlarmVector.NoAlarm
16:33:21 - Connection status: False TXclient_alive: False
16:33:21 - Writing False to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v
16:33:21 - Writing 100 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v
16:33:21 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
16:33:21 - Writing True to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v
16:33:21 - Writing 100 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v
16:33:21 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v
16:33:21 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
16:33:21 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v
16:33:21 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v
16:33:21 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
16:33:18 - Setting HVPA current limits...
16:33:28 - Status: TibState.PpsStopped ConnectionStatus: False TXclient_alive: False
16:33:28 - Alarms: AlarmVector.NoAlarm
16:33:28 - Temperature: 38.56
16:33:28 - Local camera rate: 0.0 Hz
16:33:28 - Stereo trigger rate: 0.0 Hz
16:33:28 - SPE trigger rate: 0.0 Hz
16:33:28 - Calibration trigger rate: 0.0 Hz
16:33:28 - Software trigger rate: 0.0 Hz
16:33:28 - Pedestal trigger rate: 104.0 Hz
16:33:28 - Collected trigger rate: 0.0 Hz
16:33:28 - Busy rate: 0.0 Hz
16:33:28 - Camera trigger rate: 0.0 Hz
16:33:40 - Checking for high voltage locked pixels...
16:33:45 - Finished task "Switch HVPA voltage state"
16:33:50 - Starting task "Check high voltages"
16:33:51 - Found 52 drawer(s) in Nominal state, 0 in Low state and 0 in Wait state
16:34:01 - Actual voltage is between 943.67 V and 1172.42 V.
16:34:02 - Low voltages range between 300.00 V and 300.00 V. 
16:34:10 - Checking for high voltage locked pixels...
16:34:16 - Reference voltages range between 943.91 V and 1172.13 V. 
16:34:27 - Maximum difference between expected and actual voltages is 0.82 V
16:34:34 - Maximum of current limits is 5647.07 uA
16:34:34 - Checking status of HVPA module in 52 drawer(s)...
16:34:35 - Checking status of HVPA channels in 52 drawer(s)...
16:34:39 - HV is stabilized in all channels.
16:34:39 - Checking reference and low voltages against /data/config/2020/20200723/config_tower_52modules_newHV2_newL0delays.NMC.xml
16:34:40 - Checking for high voltage locked pixels...
16:34:47 - Done
16:34:47 - Finished task "Check high voltages"
16:35:10 - Checking for high voltage locked pixels...
16:35:27 - Updating voltage widget...
16:35:32 - Starting NMC
16:35:32 - Clearing PPS error counters
16:35:40 - Checking for high voltage locked pixels...
16:35:48 - Calling method FSM.gotoObserving in object FSM
16:36:10 - Checking for high voltage locked pixels...
16:36:12 - Connecting TIB to camera server at 10.10.4.12:222
16:36:12 - Starting TIB...
16:36:12 - Status: TibState.PpsStopped
16:36:12 - Alarms: AlarmVector.NoAlarm
16:36:12 - Connection status: False TXclient_alive: True
16:36:12 - Resetting run
16:36:12 - Wait for UCTS external trigger before enabling trigger...
16:36:12 - Status: TibState.Standby
16:36:12 - Alarms: AlarmVector.NoAlarm
16:36:12 - Connection status: False TXclient_alive: True
16:36:12 - Status: TibState.Standby
16:36:12 - Alarms: AlarmVector.NoAlarm
16:36:12 - Connection status: False TXclient_alive: True
16:36:13 - Status: TibState.Armed
16:36:13 - Alarms: AlarmVector.NoAlarm
16:36:13 - Connection status: True TXclient_alive: True
16:36:37 - Starting TIB triggers...
16:36:37 - Enabling trigger
16:36:37 - Status: TibState.Running
16:36:37 - Alarms: AlarmVector.NoAlarm
16:36:37 - Connection status: True TXclient_alive: True
16:36:40 - Checking for high voltage locked pixels...
16:36:57 - Status: TibState.Running ConnectionStatus: True TXclient_alive: True
16:36:57 - Alarms: AlarmVector.ReadError
16:36:57 - Temperature: 38.44
16:36:57 - Local camera rate: 0.0 Hz
16:36:57 - Stereo trigger rate: 0.0 Hz
16:36:57 - SPE trigger rate: 0.0 Hz
16:36:57 - Calibration trigger rate: 0.0 Hz
16:36:57 - Software trigger rate: 0.0 Hz
16:36:57 - Pedestal trigger rate: 94.0 Hz
16:36:57 - Collected trigger rate: 94.0 Hz
16:36:57 - Busy rate: 0.0 Hz
16:36:57 - Camera trigger rate: 94.0 Hz
16:37:03 - Status: TibState.Running ConnectionStatus: True TXclient_alive: True
16:37:03 - Alarms: AlarmVector.ReadError
16:37:03 - Temperature: 38.38
16:37:03 - Local camera rate: 1.0 Hz
16:37:03 - Stereo trigger rate: 0.0 Hz
16:37:03 - SPE trigger rate: 0.0 Hz
16:37:03 - Calibration trigger rate: 0.0 Hz
16:37:03 - Software trigger rate: 0.0 Hz
16:37:03 - Pedestal trigger rate: 108.0 Hz
16:37:03 - Collected trigger rate: 109.0 Hz
16:37:03 - Busy rate: 0.0 Hz
16:37:04 - Camera trigger rate: 109.0 Hz
16:37:10 - Checking for high voltage locked pixels...
16:37:40 - Checking for high voltage locked pixels...
16:38:10 - Checking for high voltage locked pixels...
16:38:40 - Checking for high voltage locked pixels...
16:39:10 - Checking for high voltage locked pixels...
16:39:40 - Checking for high voltage locked pixels...
16:39:54 - Stopping TIB...
16:39:54 - Status: TibState.Running
16:39:54 - Alarms: AlarmVector.ReadError
16:39:54 - Connection status: True TXclient_alive: True
16:39:54 - Disabling trigger
16:39:55 - Disabling PPS
16:39:56 - Status: TibState.PpsStopped
16:39:56 - Alarms: AlarmVector.ReadError
16:39:56 - Connection status: True TXclient_alive: True
16:39:56 - Closing TIB connection to camera server
16:39:56 - Status: TibState.PpsStopped
16:39:56 - Alarms: AlarmVector.ReadError
16:39:56 - Connection status: False TXclient_alive: False
16:39:56 - Run duration: 0:03:41
16:39:56 - Local camera triggers: 330
16:39:56 - Slow control triggers: 0
16:39:56 - Single photo-electron triggers: 0
16:39:56 - Calibration triggers: 0
16:39:56 - Software triggers from UCTS: 0
16:39:56 - Pedestal triggers: 22338
16:39:56 - Collected input triggers: 20243
16:39:56 - Busy triggers: 1
16:39:56 - Camera event triggers sent to clusters: 20242