15:09:09 - Starting task "Check high voltages" 15:09:10 - Found 0 drawer(s) in Nominal state, 0 in Low state and 53 in Wait state 15:09:18 - Actual voltage is between 72.59 V and 85.40 V. 15:09:19 - Low voltages range between 300.00 V and 300.00 V. 15:09:28 - Reference voltages range between 945.26 V and 1167.15 V. 15:09:33 - Maximum difference between expected and actual voltages is 82.96 V 15:09:37 - Maximum of current limits is 5647.07 uA 15:09:37 - Checking status of HVPA module in 53 drawer(s)... 15:09:38 - Checking status of HVPA channels in 53 drawer(s)... 15:09:42 - HV is locked in 0 channel(s), was in rise default in 0 channel(s) and was still in progress in 371 channel(s) 15:09:42 - Finished task "Check high voltages" 15:09:55 - Resetting NMC 15:10:02 - Starting task "Powering modules..." 15:10:02 - Executing command '/opt/cta/bin/cta_ctrl --all --power_off' on Digital Trigger Crate at 10.10.4.57 15:10:04 - Finished task "Powering modules..." 15:10:10 - ECC is in state EccState.Ready with status EccStatus.NoError 15:10:10 - Average temperature: 22.3 deg C 15:10:10 - Air temperature (T1-T6 and T9-T10): 22.3, 1255.0, -838.0, 1254.0, 1254.0, 1254.0, 1254.0, 1253.0 deg C 15:10:10 - Air differential pressure: 0.0 Pa 15:10:10 - Water temperature (T11-T12): 1253.0, 1254.0 deg C 15:10:10 - Back doors are closed. 15:10:10 - Shutter is in state PartiallyOpen (error 0) 15:10:10 - Light sensors: [2.29, 2.79, 3.19, 3.5] V 15:10:10 - Humidity: 0.0 %. Water pressure: [0.0, 0.0] bar. 15:10:10 - Fan speeds: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0] rpm 15:10:10 - 24 V power supply no. 1 is enabled with a current of 0.270 A. 15:11:13 - Starting task "Powering modules..." 15:11:13 - Executing command '/opt/cta/bin/cta_ctrl --slot 1 --all --power_on' on Digital Trigger Crate at 10.10.4.57 15:11:19 - Executing command '/opt/cta/bin/cta_ctrl --slot 5 --all --power_on' on Digital Trigger Crate at 10.10.4.57 15:11:24 - Executing command '/opt/cta/bin/cta_ctrl --slot 6 --all --power_on' on Digital Trigger Crate at 10.10.4.57 15:11:30 - Executing command '/opt/cta/bin/cta_ctrl --slot 9 --all --power_on' on Digital Trigger Crate at 10.10.4.57 15:11:36 - Executing command '/opt/cta/bin/cta_ctrl --slot 13 --all --power_on' on Digital Trigger Crate at 10.10.4.57 15:11:42 - Executing command '/opt/cta/bin/cta_ctrl --slot 14 --all --power_on' on Digital Trigger Crate at 10.10.4.57 15:11:47 - Executing command '/opt/cta/bin/cta_ctrl --slot 15 --all --power_on' on Digital Trigger Crate at 10.10.4.57 15:11:53 - Executing command '/opt/cta/bin/cta_ctrl --slot 19 --all --power_on' on Digital Trigger Crate at 10.10.4.57 15:11:59 - Finished task "Powering modules..." 15:12:07 - Scanning interface p4p1 for non configured modules... 15:12:08 - Found 61 MAC address(es) 15:12:16 - Starting task "Switch HVPA voltage state" 15:12:16 - NMC does not know any module! 15:12:16 - Finished task "Switch HVPA voltage state" 15:12:38 - Starting task "Configure modules" 15:12:38 - Configuring modules with configuration /local/home/cta_test_bench/config/2020/20200610/config_tower_53modules.NMC.xml 15:12:38 - Switching off high voltages in configuration 15:12:42 - Successfully configured 53 module(s) 15:12:43 - All front-end boards are programmed with firmware F55D2001 15:12:44 - All backplanes are programmed with firmware 15 15:12:49 - NMC is in state NmcState.Configured and knows of 53 drawer(s) 15:12:50 - Found 0 PPS errors. 15:12:50 - Finished task "Configure modules" 15:12:52 - Starting task "Switch HVPA voltage state" 15:12:52 - Setting HVPA current limit to 12489.75 uA 15:13:10 - Setting HVPA ramp speed to 25 V/s 15:13:12 - Switching HVPA to state Nominal 15:13:21 - Setting HVPA current limits... 15:13:43 - Finished task "Switch HVPA voltage state" 15:14:20 - High voltage locked channels will be checked every 30 s 15:14:23 - Starting task "Check high voltages" 15:14:23 - Found 53 drawer(s) in Nominal state, 0 in Low state and 0 in Wait state 15:14:32 - Actual voltage is between 945.50 V and 1167.54 V. 15:14:32 - Low voltages range between 300.00 V and 300.00 V. 15:14:41 - Reference voltages range between 945.26 V and 1167.15 V. 15:14:50 - Maximum difference between expected and actual voltages is 0.94 V 15:14:50 - Checking for high voltage locked pixels... 15:14:55 - Maximum of current limits is 5647.07 uA 15:14:55 - Checking status of HVPA module in 53 drawer(s)... 15:14:55 - Checking status of HVPA channels in 53 drawer(s)... 15:14:59 - HV is stabilized in all channels. 15:14:59 - Checking reference and low voltages against /local/home/cta_test_bench/config/2020/20200610/config_tower_53modules.NMC.xml 15:15:05 - Done 15:15:05 - Finished task "Check high voltages" 15:15:21 - Checking for high voltage locked pixels... 15:15:51 - Checking for high voltage locked pixels... 15:15:54 - Starting task "Set L0 trigger thresholds" 15:15:54 - Setting L0 thresholds to 15.0 p.e. using /local/home/cta_test_bench/data/2019/20191203/l0_threshold_slope_and_offset_feb.h5 15:16:14 - Setting L0 thresholds to 15.0 p.e. per pixel using L0 slopes and offsets in /local/home/cta_test_bench/data/2019/20191203/l0_threshold_slope_and_offset_feb.h5 15:16:15 - Thresholds saved in configuration file /local/home/cta_test_bench/config/2020/20200625/config_2020-06-25_15-16-14.NMC.xml 15:16:15 - Finished task "Set L0 trigger thresholds" 15:16:21 - Checking for high voltage locked pixels... 15:16:30 - Starting NMC 15:16:30 - Clearing PPS error counters 15:16:34 - Calling method FSM.gotoObserving in object FSM 15:16:47 - Configuring calibration box... 15:16:47 - Configuring calibration box with leds=0x40 voltage=9.00 frequency=999.0/3 central_current=0.0 duration=0 width=1 lemo_out=False fiber1_out=False fiber2_out=False lemo_in=False enabled=False 15:16:49 - Starting flashes... 15:16:50 - Checking for high voltage locked pixels... 15:16:56 - Checking UCTS clock... 15:16:57 - UCTS and control PC clocks differ by 2.009219 seconds 15:16:57 - Configuring UCTS 15:16:57 - Configuring TIB... 15:16:57 - Setting TIB forced mode to False 15:16:57 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v 15:16:57 - Status: TibState.PpsStopped 15:16:57 - Alarms: AlarmVector.ReadError 15:16:57 - Connection status: False TXclient_alive: False 15:16:57 - Entering set_external_delay 15:16:57 - Setting ExternalDelayLocal to 0.000 ns 15:16:57 - Writing 0.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v 15:16:58 - Entering set_external_delay 15:16:58 - Setting ExternalDelayCalibration to 65.000 ns 15:16:58 - Writing 65.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v 15:16:58 - Entering set_external_delay 15:16:58 - Setting ExternalDelaySphe to 150.000 ns 15:16:58 - Writing 150.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v 15:16:58 - Setting TIB trigger mode to 0x71 = TriggerMask.SlowControl|Pedestal|Software|Mono 15:16:58 - Writing 113 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v 15:16:58 - Writing 1 to Camera.TIB.InputsEnable.InputMask.InputMask_v 15:16:58 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v 15:16:58 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v 15:16:58 - Writing False to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v 15:16:58 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v 15:16:58 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v 15:16:58 - Status: TibState.PpsStopped 15:16:58 - Alarms: AlarmVector.ReadError 15:16:58 - Connection status: False TXclient_alive: False 15:16:58 - Writing True to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v 15:16:58 - Writing 100 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v 15:16:58 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 15:16:58 - Writing False to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v 15:16:58 - Writing 100 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v 15:16:58 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v 15:16:58 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 15:16:58 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v 15:16:58 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v 15:16:58 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 15:17:01 - Connecting TIB to camera server at 10.10.4.12:222 15:17:01 - Starting TIB... 15:17:02 - Status: TibState.PpsStopped 15:17:02 - Alarms: AlarmVector.ReadError 15:17:02 - Connection status: False TXclient_alive: False 15:17:02 - Resetting run 15:17:02 - Wait for UCTS external trigger before enabling trigger... 15:17:02 - Status: TibState.Standby 15:17:02 - Alarms: AlarmVector.NoAlarm 15:17:02 - Connection status: False TXclient_alive: True 15:17:02 - Status: TibState.Standby 15:17:02 - Alarms: AlarmVector.NoAlarm 15:17:02 - Connection status: False TXclient_alive: True 15:17:03 - Status: TibState.Armed 15:17:03 - Alarms: AlarmVector.NoAlarm 15:17:03 - Connection status: True TXclient_alive: True 15:17:09 - Starting TIB triggers... 15:17:09 - Enabling trigger 15:17:09 - Status: TibState.Running 15:17:09 - Alarms: AlarmVector.NoAlarm 15:17:09 - Connection status: True TXclient_alive: True 15:17:10 - Status: TibState.Running ConnectionStatus: True TXclient_alive: True 15:17:10 - Alarms: AlarmVector.ReadError 15:17:10 - Temperature: 36.88 15:17:10 - Local camera rate: 333.0 Hz 15:17:10 - Stereo trigger rate: 0.0 Hz 15:17:10 - SPE trigger rate: 0.0 Hz 15:17:10 - Calibration trigger rate: 0.0 Hz 15:17:10 - Software trigger rate: 0.0 Hz 15:17:10 - Pedestal trigger rate: 100.0 Hz 15:17:10 - Collected trigger rate: 237.0 Hz 15:17:10 - Busy rate: 1.0 Hz 15:17:10 - Camera trigger rate: 236.0 Hz 15:17:21 - Checking for high voltage locked pixels... 15:17:22 - Status: TibState.Running ConnectionStatus: True TXclient_alive: True 15:17:22 - Alarms: AlarmVector.ReadError 15:17:22 - Temperature: 36.88 15:17:22 - Local camera rate: 334.0 Hz 15:17:22 - Stereo trigger rate: 0.0 Hz 15:17:22 - SPE trigger rate: 0.0 Hz 15:17:22 - Calibration trigger rate: 0.0 Hz 15:17:22 - Software trigger rate: 0.0 Hz 15:17:22 - Pedestal trigger rate: 100.0 Hz 15:17:22 - Collected trigger rate: 434.0 Hz 15:17:22 - Busy rate: 1.0 Hz 15:17:22 - Camera trigger rate: 433.0 Hz 15:17:31 - Stopping TIB... 15:17:31 - Status: TibState.Running 15:17:31 - Alarms: AlarmVector.ReadError 15:17:31 - Connection status: True TXclient_alive: True 15:17:31 - Disabling trigger 15:17:31 - Disabling PPS 15:17:32 - Status: TibState.PpsStopped 15:17:32 - Alarms: AlarmVector.ReadError 15:17:32 - Connection status: True TXclient_alive: True 15:17:32 - Closing TIB connection to camera server 15:17:35 - Status: TibState.PpsStopped 15:17:35 - Alarms: AlarmVector.ReadError 15:17:35 - Connection status: False TXclient_alive: False 15:17:35 - Run duration: 0:00:29 15:17:35 - Local camera triggers: 9468 15:17:35 - Slow control triggers: 0 15:17:35 - Single photo-electron triggers: 0 15:17:35 - Calibration triggers: 0 15:17:35 - Software triggers from UCTS: 0 15:17:35 - Pedestal triggers: 2841 15:17:35 - Collected input triggers: 9899 15:17:35 - Busy triggers: 12 15:17:35 - Camera event triggers sent to clusters: 9887 15:17:39 - Calling method FSM.gotoReady in object FSM 15:17:51 - Checking for high voltage locked pixels... 15:18:20 - Checking for high voltage locked pixels...