13:35:49 - High voltage locked channels will be checked every 30 s
13:35:53 - Stopping NMC
13:35:54 - Found 0 PPS errors.
13:35:55 - Starting NMC
13:35:55 - Clearing PPS error counters
13:36:02 - Setting HVPA ramp speed to 25 V/s
13:36:04 - Switching HVPA to state Nominal
13:36:11 - Calling method FSM.gotoReady in object FSM
13:36:13 - Setting HVPA current limits...
13:36:19 - Checking for high voltage locked pixels...
13:36:20 - Module 81 has 1 pixel(s) locked (HVPA status of 0x3f)!
13:36:21 - Unlocking 1 channel(s)...
13:36:21 - Resetting HVPA channel 6 of drawer 81...
13:36:36 - Finished task "Switch HVPA voltage state"
13:36:49 - Checking for high voltage locked pixels...
13:36:50 - Module 146 has 1 pixel(s) locked (HVPA status of 0x7d)!
13:36:51 - Module 163 has 1 pixel(s) locked (HVPA status of 0x77)!
13:36:51 - Unlocking 2 channel(s)...
13:36:51 - Resetting HVPA channel 1 of drawer 146...
13:36:51 - Resetting HVPA channel 3 of drawer 163...
13:36:55 - Initializing Keithley 2000 Multimeter.
13:36:57 - Current: -8.450 pA
13:36:57 - NSB: 0.009 ph/cm**2/sr/ns ~ 10.719 MHz
13:37:19 - Checking for high voltage locked pixels...
13:37:25 - Starting task "Check high voltages"
13:37:25 - Found 53 drawer(s) in Nominal state, 0 in Low state and 0 in Wait state
13:37:34 - Actual voltage is between 945.50 V and 1166.93 V.
13:37:34 - Low voltages range between 300.00 V and 300.00 V. 
13:37:43 - Reference voltages range between 945.26 V and 1167.15 V. 
13:37:49 - Checking for high voltage locked pixels...
13:37:52 - Maximum difference between expected and actual voltages is 0.72 V
13:37:57 - Maximum of current limits is 5647.07 uA
13:37:57 - Checking status of HVPA module in 53 drawer(s)...
13:37:57 - Checking status of HVPA channels in 53 drawer(s)...
13:38:01 - HV is stabilized in all channels.
13:38:02 - Checking reference and low voltages against /local/home/cta_test_bench/config/2020/20200701/config_tower_53modules_nf18.NMC.xml
13:38:07 - Done
13:38:07 - Finished task "Check high voltages"
13:38:19 - Checking for high voltage locked pixels...
13:38:49 - Checking for high voltage locked pixels...
13:39:19 - Checking for high voltage locked pixels...
13:39:49 - Checking for high voltage locked pixels...
13:40:19 - Checking for high voltage locked pixels...
13:40:49 - Checking for high voltage locked pixels...
13:41:19 - Checking for high voltage locked pixels...
13:41:49 - Checking for high voltage locked pixels...
13:42:19 - Checking for high voltage locked pixels...
13:42:49 - Checking for high voltage locked pixels...
13:43:19 - Checking for high voltage locked pixels...
13:43:49 - Checking for high voltage locked pixels...
13:44:19 - Checking for high voltage locked pixels...
13:44:49 - Checking for high voltage locked pixels...
13:45:19 - Checking for high voltage locked pixels...
13:45:49 - Checking for high voltage locked pixels...
13:46:19 - Checking for high voltage locked pixels...
13:46:49 - Checking for high voltage locked pixels...
13:47:19 - Checking for high voltage locked pixels...
13:47:49 - Checking for high voltage locked pixels...
13:48:19 - Checking for high voltage locked pixels...
13:48:49 - Checking for high voltage locked pixels...
13:49:19 - Checking for high voltage locked pixels...
13:49:49 - Checking for high voltage locked pixels...
13:50:05 - Calling method FSM.gotoObserving in object FSM
13:50:19 - Checking for high voltage locked pixels...
13:50:26 - Checking status of calibration box...
13:50:27 - Failed to call GetStatus: Bad statuses are present
13:50:31 - Checking status of calibration box...
13:50:31 - No server with URI='NectarCAM:CalibrationBox' has been discovered. The client could not discover a single server.
13:50:39 - Checking status of calibration box...
13:50:39 - No server with URI='NectarCAM:CalibrationBox' has been discovered. The client could not discover a single server.
13:50:49 - Checking for high voltage locked pixels...
13:51:18 - Checking status of calibration box...
13:51:19 - Calibration box is configured with 13 leds at a frequency of 10000.0 Hz and a voltage of 10.00 V
13:51:20 - Checking for high voltage locked pixels...
13:51:26 - Checking status of calibration box...
13:51:27 - Calibration box is configured with 1 leds at a frequency of 1000.0 Hz and a voltage of 8.99 V
13:51:47 - Checking UCTS clock...
13:51:47 - UCTS clock is late by 5 seconds!
13:51:47 - Configuring UCTS
13:51:47 - Configuring TIB...
13:51:47 - Setting TIB forced mode to False
13:51:47 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v
13:51:47 - Status: TibState.RunStopped
13:51:47 - Alarms: AlarmVector.NoAlarm
13:51:47 - Connection status: False TXclient_alive: False
13:51:47 - Disabling PPS
13:51:49 - Status: TibState.PpsStopped
13:51:49 - Alarms: AlarmVector.NoAlarm
13:51:49 - Connection status: False TXclient_alive: False
13:51:49 - Entering set_external_delay
13:51:49 - Setting ExternalDelayLocal to 0.000 ns
13:51:49 - Writing 0.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v
13:51:49 - Entering set_external_delay
13:51:49 - Setting ExternalDelayCalibration to 65.000 ns
13:51:49 - Writing 65.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v
13:51:49 - Entering set_external_delay
13:51:49 - Setting ExternalDelaySphe to 150.000 ns
13:51:49 - Writing 150.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v
13:51:49 - Setting TIB trigger mode to 0x70 = TriggerMask.SlowControl|Pedestal|Software
13:51:49 - Writing 112 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v
13:51:50 - Writing 1 to Camera.TIB.InputsEnable.InputMask.InputMask_v
13:51:50 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v
13:51:50 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v
13:51:50 - Writing False to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v
13:51:50 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v
13:51:50 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v
13:51:50 - Status: TibState.PpsStopped
13:51:50 - Alarms: AlarmVector.NoAlarm
13:51:50 - Connection status: False TXclient_alive: False
13:51:50 - Writing True to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v
13:51:50 - Writing 1000 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v
13:51:50 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
13:51:50 - Writing False to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v
13:51:50 - Writing 1000 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v
13:51:50 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v
13:51:50 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
13:51:50 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v
13:51:50 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v
13:51:50 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
13:51:50 - Checking for high voltage locked pixels...
13:51:51 - Connecting TIB to camera server at 10.10.4.12:222
13:51:51 - Starting TIB...
13:51:51 - Status: TibState.PpsStopped
13:51:51 - Alarms: AlarmVector.NoAlarm
13:51:51 - Connection status: False TXclient_alive: False
13:51:51 - Resetting run
13:51:51 - Wait for UCTS external trigger before enabling trigger...
13:51:52 - Status: TibState.Standby
13:51:52 - Alarms: AlarmVector.NoAlarm
13:51:52 - Connection status: False TXclient_alive: False
13:51:52 - Status: TibState.Standby
13:51:52 - Alarms: AlarmVector.NoAlarm
13:51:52 - Connection status: False TXclient_alive: True
13:51:53 - Status: TibState.Armed
13:51:53 - Alarms: AlarmVector.NoAlarm
13:51:53 - Connection status: True TXclient_alive: True
13:52:02 - Starting TIB triggers...
13:52:02 - Enabling trigger
13:52:02 - Status: TibState.Running
13:52:02 - Alarms: AlarmVector.NoAlarm
13:52:02 - Connection status: True TXclient_alive: True
13:52:04 - Status: TibState.Running ConnectionStatus: True TXclient_alive: True
13:52:04 - Alarms: AlarmVector.ReadError
13:52:04 - Temperature: 36.88
13:52:04 - Local camera rate: 0.0 Hz
13:52:04 - Stereo trigger rate: 0.0 Hz
13:52:04 - SPE trigger rate: 0.0 Hz
13:52:05 - Calibration trigger rate: 0.0 Hz
13:52:05 - Software trigger rate: 0.0 Hz
13:52:05 - Pedestal trigger rate: 999.0 Hz
13:52:05 - Collected trigger rate: 999.0 Hz
13:52:05 - Busy rate: 0.0 Hz
13:52:05 - Camera trigger rate: 999.0 Hz
13:52:12 - Stopping TIB...
13:52:12 - Status: TibState.Running
13:52:12 - Alarms: AlarmVector.ReadError
13:52:12 - Connection status: True TXclient_alive: True
13:52:12 - Disabling trigger
13:52:12 - Disabling PPS
13:52:13 - Status: TibState.PpsStopped
13:52:13 - Alarms: AlarmVector.ReadError
13:52:13 - Connection status: True TXclient_alive: True
13:52:13 - Closing TIB connection to camera server
13:52:15 - Status: TibState.PpsStopped
13:52:15 - Alarms: AlarmVector.ReadError
13:52:15 - Connection status: False TXclient_alive: False
13:52:15 - Run duration: 0:00:20
13:52:15 - Local camera triggers: 0
13:52:15 - Slow control triggers: 0
13:52:15 - Single photo-electron triggers: 0
13:52:15 - Calibration triggers: 0
13:52:15 - Software triggers from UCTS: 0
13:52:15 - Pedestal triggers: 19527
13:52:15 - Collected input triggers: 10295
13:52:15 - Busy triggers: 0
13:52:15 - Camera event triggers sent to clusters: 10295
13:52:19 - Calling method FSM.gotoReady in object FSM
13:52:19 - Checking for high voltage locked pixels...
13:52:22 - Stopping NMC
13:52:22 - ("NmcError: Failed to call 'Stop': status Bad statuses are present, code 0x80020000", 2147614720)
13:52:29 - NMC is in state NmcState.Ready and knows of 0 drawer(s)
13:52:29 - Found 0 PPS errors.
13:52:44 - Starting task "Configure modules"
13:52:44 - Configuring modules with configuration /local/home/cta_test_bench/config/2020/20200701/config_tower_53modules_nf18.NMC.xml
13:52:44 - Switching off high voltages in configuration
13:52:47 - Successfully configured 53 module(s)
13:52:48 - All front-end boards are programmed with firmware F55D2001
13:52:49 - All backplanes are programmed with firmware 15
13:52:49 - Checking for high voltage locked pixels...
13:52:54 - NMC is in state NmcState.Configured and knows of 53 drawer(s)
13:52:55 - Found 0 PPS errors.
13:52:55 - Finished task "Configure modules"
13:53:19 - Checking for high voltage locked pixels...
13:53:49 - Checking for high voltage locked pixels...