14:31:11 - Setting HVPA current limits...
14:31:12 - Finished task "Switch HVPA voltage state"
14:31:14 - Chiller is running with a set temperature of 12.00 degrees and has an actual bath temperature of 18.30 degrees
14:31:37 - Checking for high voltage locked pixels...
14:32:07 - Checking for high voltage locked pixels...
14:32:37 - Checking for high voltage locked pixels...
14:33:06 - Starting task "Check high voltages"
14:33:06 - Found 0 drawer(s) in Nominal state, 1 in Low state and 0 in Wait state
14:33:06 - Actual voltage is between 299.51 V and 300.12 V.
14:33:06 - Low voltages range between 300.00 V and 300.00 V. 
14:33:07 - Checking for high voltage locked pixels...
14:33:07 - Reference voltages range between 972.40 V and 1132.81 V. 
14:33:07 - Maximum difference between expected and actual voltages is 0.49 V
14:33:07 - Maximum of current limits is 5269.48 uA
14:33:07 - Checking status of HVPA module in 1 drawer(s)...
14:33:07 - Checking status of HVPA channels in 1 drawer(s)...
14:33:07 - HV is stabilized in all channels.
14:33:07 - Finished task "Check high voltages"
14:33:12 - Starting NMC
14:33:12 - Clearing PPS error counters
14:33:17 - Updating voltage widget...
14:33:23 - Starting task "Switch HVPA voltage state"
14:33:23 - Setting HVPA current limit to 12489.75 uA
14:33:23 - Setting HVPA ramp speed to 25 V/s
14:33:23 - Switching HVPA to state Nominal
14:33:30 - Setting HVPA current limits...
14:33:31 - Finished task "Switch HVPA voltage state"
14:33:37 - Checking for high voltage locked pixels...
14:33:43 - Configuring calibration box...
14:33:43 - Configuring calibration box with leds=0x358 voltage=15.00 frequency=300.0/30 central_current=0.0 duration=0 width=1 lemo_out=True fiber1_out=True fiber2_out=True lemo_in=True enabled=True
14:33:55 - Starting task "Check high voltages"
14:33:55 - Found 1 drawer(s) in Nominal state, 0 in Low state and 0 in Wait state
14:33:55 - Actual voltage is between 972.34 V and 1127.28 V.
14:33:55 - Low voltages range between 300.00 V and 300.00 V. 
14:33:55 - Reference voltages range between 972.40 V and 1132.81 V. 
14:33:56 - Maximum difference between expected and actual voltages is 3.70 V
14:33:56 - Maximum of current limits is 5269.48 uA
14:33:56 - Checking status of HVPA module in 1 drawer(s)...
14:33:56 - Checking status of HVPA channels in 1 drawer(s)...
14:33:56 - HV is locked in 0 channel(s), was in rise default in 0 channel(s) and was still in progress in 1 channel(s)
14:33:56 - Checking reference and low voltages against /data/config/2020/20200806/config_tower_module131.NMC.xml
14:33:56 - Done
14:33:56 - Finished task "Check high voltages"
14:34:01 - Updating voltage widget...
14:34:07 - Checking for high voltage locked pixels...
14:34:37 - Checking for high voltage locked pixels...
14:35:07 - Checking for high voltage locked pixels...
14:35:37 - Checking for high voltage locked pixels...
14:36:06 - Starting task "Check high voltages"
14:36:06 - Found 1 drawer(s) in Nominal state, 0 in Low state and 0 in Wait state
14:36:07 - Actual voltage is between 971.73 V and 1133.38 V.
14:36:07 - Checking for high voltage locked pixels...
14:36:07 - Low voltages range between 300.00 V and 300.00 V. 
14:36:07 - Reference voltages range between 972.40 V and 1132.81 V. 
14:36:07 - Maximum difference between expected and actual voltages is 0.46 V
14:36:07 - Maximum of current limits is 5269.48 uA
14:36:07 - Checking status of HVPA module in 1 drawer(s)...
14:36:07 - Checking status of HVPA channels in 1 drawer(s)...
14:36:08 - HV is stabilized in all channels.
14:36:08 - Checking reference and low voltages against /data/config/2020/20200806/config_tower_module131.NMC.xml
14:36:08 - Done
14:36:08 - Finished task "Check high voltages"
14:36:11 - Calling method FSM.gotoReady in object FSM
14:36:20 - Starting task "Set L0 trigger thresholds"
14:36:20 - Setting L0 thresholds to 15.0 p.e. using /data/luts/l0_threshold_slope_and_offset_feb_20200708.h5
14:36:20 - Note: NumExpr detected 64 cores but "NUMEXPR_MAX_THREADS" not set, so enforcing safe limit of 8.
14:36:20 - NumExpr defaulting to 8 threads.
14:36:21 - Setting L0 thresholds to 15.0 p.e. per pixel using L0 slopes and offsets in /data/luts/l0_threshold_slope_and_offset_feb_20200708.h5
14:36:21 - Thresholds saved in configuration file /data/config/2020/20200806/config_2020-08-06_14-36-21.NMC.xml
14:36:21 - Finished task "Set L0 trigger thresholds"
14:36:32 - Updating L0 scaler widget...
14:36:35 - Updating L1 scaler widget...
14:36:37 - Checking for high voltage locked pixels...
14:36:45 - Status: TibState.Running ConnectionStatus: False TXclient_alive: True
14:36:45 - Alarms: AlarmVector.BufferFull|AlmostFull
14:36:45 - Temperature: 40.50
14:36:45 - Local camera rate: 0.0 Hz
14:36:45 - Stereo trigger rate: 0.0 Hz
14:36:45 - SPE trigger rate: 0.0 Hz
14:36:45 - Calibration trigger rate: 5464.0 Hz
14:36:45 - Software trigger rate: 0.0 Hz
14:36:45 - Pedestal trigger rate: 999.0 Hz
14:36:45 - Collected trigger rate: 999.0 Hz
14:36:45 - Busy rate: 0.0 Hz
14:36:45 - Camera trigger rate: 999.0 Hz
14:36:58 - Checking UCTS clock...
14:36:59 - UCTS clock is late by 5 seconds!
14:36:59 - Configuring UCTS
14:36:59 - Configuring TIB...
14:36:59 - Setting TIB forced mode to False
14:36:59 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v
14:36:59 - Status: TibState.Running
14:36:59 - Alarms: AlarmVector.BufferFull|AlmostFull
14:36:59 - Connection status: False TXclient_alive: True
14:36:59 - Disabling PPS
14:36:59 - Error configuring TIB: Failed to call DisablePPS: Bad statuses are present
14:37:07 - Checking for high voltage locked pixels...
14:37:07 - Stopping TIB...
14:37:07 - Status: TibState.Running
14:37:07 - Alarms: AlarmVector.BufferFull|AlmostFull
14:37:07 - Connection status: False TXclient_alive: True
14:37:07 - Disabling trigger
14:37:07 - Disabling PPS
14:37:08 - Status: TibState.PpsStopped
14:37:08 - Alarms: AlarmVector.BufferFull|AlmostFull
14:37:08 - Connection status: False TXclient_alive: True
14:37:08 - Closing TIB connection to camera server
14:37:11 - Resetting TIB...
14:37:16 - Status: TibState.RunStopped
14:37:16 - Alarms: AlarmVector.NoAlarm
14:37:16 - Connection status: False TXclient_alive: False
14:37:17 - External delays: Local=3825.000 ns, Calibration=3825.000 ns, Sphe=3825.000 ns
14:37:17 - Trigger mask: 0x51 = TriggerMask.SlowControl|Software|Mono
14:37:17 - Input mask: 0x7
14:37:17 - Disable BUSY: False
14:37:17 - Extra BUSY Delay: 0.0
14:37:17 - Temperature: 40.50
14:37:25 - Checking UCTS clock...
14:37:25 - UCTS clock is late by 5 seconds!
14:37:25 - Configuring UCTS
14:37:26 - Configuring TIB...
14:37:26 - Setting TIB forced mode to False
14:37:26 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v
14:37:26 - Status: TibState.RunStopped
14:37:26 - Alarms: AlarmVector.NoAlarm
14:37:26 - Connection status: False TXclient_alive: False
14:37:26 - Disabling PPS
14:37:28 - Status: TibState.PpsStopped
14:37:28 - Alarms: AlarmVector.NoAlarm
14:37:28 - Connection status: False TXclient_alive: False
14:37:28 - Entering set_external_delay
14:37:28 - Setting ExternalDelayLocal to 0.000 ns
14:37:28 - Writing 0.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v
14:37:29 - Entering set_external_delay
14:37:29 - Setting ExternalDelayCalibration to 65.000 ns
14:37:29 - Writing 65.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v
14:37:29 - Entering set_external_delay
14:37:29 - Setting ExternalDelaySphe to 150.000 ns
14:37:29 - Writing 150.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v
14:37:29 - Setting TIB trigger mode to 0x71 = TriggerMask.SlowControl|Pedestal|Software|Mono
14:37:29 - Writing 113 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v
14:37:29 - Writing 1 to Camera.TIB.InputsEnable.InputMask.InputMask_v
14:37:29 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v
14:37:29 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v
14:37:29 - Writing False to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v
14:37:29 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v
14:37:29 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v
14:37:29 - Status: TibState.PpsStopped
14:37:29 - Alarms: AlarmVector.NoAlarm
14:37:29 - Connection status: False TXclient_alive: False
14:37:29 - Writing False to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v
14:37:29 - Writing 5000 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v
14:37:29 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
14:37:29 - Writing True to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v
14:37:29 - Writing 5000 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v
14:37:29 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v
14:37:29 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
14:37:29 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v
14:37:29 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v
14:37:29 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
14:37:35 - Stopping NMC
14:37:36 - Found 0 PPS errors.
14:37:37 - Checking for high voltage locked pixels...
14:37:37 - Starting NMC
14:37:37 - Clearing PPS error counters
14:37:52 - Calling method FSM.gotoObserving in object FSM
14:38:07 - Checking for high voltage locked pixels...
14:38:24 - Connecting TIB to camera server at 10.10.4.12:222
14:38:24 - Starting TIB...
14:38:24 - Status: TibState.PpsStopped
14:38:24 - Alarms: AlarmVector.NoAlarm
14:38:24 - Connection status: False TXclient_alive: True
14:38:24 - Resetting run
14:38:24 - Wait for UCTS external trigger before enabling trigger...
14:38:24 - Status: TibState.Standby
14:38:24 - Alarms: AlarmVector.NoAlarm
14:38:24 - Connection status: False TXclient_alive: True
14:38:24 - Status: TibState.Standby
14:38:24 - Alarms: AlarmVector.NoAlarm
14:38:24 - Connection status: False TXclient_alive: True
14:38:25 - Status: TibState.Armed
14:38:25 - Alarms: AlarmVector.NoAlarm
14:38:25 - Connection status: True TXclient_alive: True
14:38:36 - Starting TIB triggers...
14:38:36 - Enabling trigger
14:38:36 - Status: TibState.Running
14:38:36 - Alarms: AlarmVector.NoAlarm
14:38:36 - Connection status: True TXclient_alive: True
14:38:37 - Checking for high voltage locked pixels...
14:38:42 - Status: TibState.Running ConnectionStatus: True TXclient_alive: True
14:38:42 - Alarms: AlarmVector.NoAlarm
14:38:42 - Temperature: 40.50
14:38:42 - Local camera rate: 0.0 Hz
14:38:42 - Stereo trigger rate: 0.0 Hz
14:38:42 - SPE trigger rate: 0.0 Hz
14:38:42 - Calibration trigger rate: 5457.0 Hz
14:38:42 - Software trigger rate: 0.0 Hz
14:38:42 - Pedestal trigger rate: 6499.0 Hz
14:38:42 - Collected trigger rate: 6499.0 Hz
14:38:42 - Busy rate: 205.0 Hz
14:38:42 - Camera trigger rate: 6294.0 Hz
14:39:07 - Checking for high voltage locked pixels...
14:39:16 - Stopping TIB...
14:39:16 - Status: TibState.Running
14:39:16 - Alarms: AlarmVector.ReadError
14:39:16 - Connection status: True TXclient_alive: True
14:39:16 - Disabling trigger
14:39:16 - Disabling PPS
14:39:17 - Status: TibState.PpsStopped
14:39:17 - Alarms: AlarmVector.ReadError
14:39:17 - Connection status: True TXclient_alive: True
14:39:17 - Closing TIB connection to camera server
14:39:20 - Status: TibState.PpsStopped
14:39:20 - Alarms: AlarmVector.ReadError
14:39:20 - Connection status: False TXclient_alive: False
14:39:20 - Run duration: 0:00:51
14:39:20 - Local camera triggers: 0
14:39:20 - Slow control triggers: 0
14:39:20 - Single photo-electron triggers: 0
14:39:20 - Calibration triggers: 278239
14:39:20 - Software triggers from UCTS: 0
14:39:20 - Pedestal triggers: 327769
14:39:20 - Collected input triggers: 258300
14:39:20 - Busy triggers: 8737
14:39:20 - Camera event triggers sent to clusters: 249563
14:39:28 - Calling method FSM.gotoReady in object FSM
14:39:37 - Checking for high voltage locked pixels...