15:53:48 - Starting task "Powering modules..." 15:53:48 - Executing command '/opt/cta/bin/cta_ctrl --slot 1 --all --power_on' on Digital Trigger Crate at 10.10.4.57 15:53:54 - Executing command '/opt/cta/bin/cta_ctrl --slot 5 --all --power_on' on Digital Trigger Crate at 10.10.4.57 15:54:00 - Executing command '/opt/cta/bin/cta_ctrl --slot 6 --all --power_on' on Digital Trigger Crate at 10.10.4.57 15:54:05 - Executing command '/opt/cta/bin/cta_ctrl --slot 9 --all --power_on' on Digital Trigger Crate at 10.10.4.57 15:54:11 - Executing command '/opt/cta/bin/cta_ctrl --slot 13 --all --power_on' on Digital Trigger Crate at 10.10.4.57 15:54:17 - Executing command '/opt/cta/bin/cta_ctrl --slot 14 --all --power_on' on Digital Trigger Crate at 10.10.4.57 15:54:23 - Executing command '/opt/cta/bin/cta_ctrl --slot 15 --all --power_on' on Digital Trigger Crate at 10.10.4.57 15:54:28 - Executing command '/opt/cta/bin/cta_ctrl --slot 19 --all --power_on' on Digital Trigger Crate at 10.10.4.57 15:54:34 - Finished task "Powering modules..." 15:55:51 - ECC is in state EccState.Ready with status EccStatus.NoError 15:55:51 - Average temperature: 17.5 deg C 15:55:51 - Air temperature (T1-T6 and T9-T10): 17.5, -838.0, 1254.0, 1254.0, 1254.0, -838.0, 1254.0, 1253.0 deg C 15:55:51 - Air differential pressure: 101.0 Pa 15:55:51 - Water temperature (T11-T12): -838.0, -838.0 deg C 15:55:51 - Back doors are open. 15:55:51 - Shutter is in state PartiallyOpen (error 0) 15:55:51 - Light sensors: [1.8, 2.08, 2.37, 2.61] V 15:55:51 - Humidity: 17.2 %. Water pressure: [4.54, 6.0] bar. 15:55:51 - Fan speeds: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0] rpm 15:55:51 - 24 V power supply no. 1 is enabled with a current of 55.800 A. 15:55:53 - Scanning interface p4p1 for non configured modules... 15:55:53 - Found 60 MAC address(es) 15:55:58 - Starting task "Configure modules" 15:56:01 - Setting L0 thresholds to 1.0 p.e. per pixel using L0 slopes and offsets in /local/home/cta_test_bench/data/2019/20191203/l0_threshold_slope_and_offset_feb.h5 15:56:12 - Configuring modules with configuration /local/home/cta_test_bench/config/2020/20200130/config_2020-01-30_15-55-58.NMC.xml 15:56:12 - Switching off high voltages in configuration 15:56:16 - Successfully configured 53 module(s) 15:56:17 - All front-end boards are programmed with firmware F55D2001 15:56:18 - All backplanes are programmed with firmware 15 15:56:23 - NMC is in state NmcState.Configured and knows of 53 drawer(s) 15:56:24 - Found 0 PPS errors. 15:56:24 - Finished task "Configure modules" 15:56:29 - Starting task "Switch HVPA voltage state" 15:56:29 - Setting HVPA current limit to 12489.75 uA 15:56:42 - High voltage locked channels will be checked every 30 s 15:56:47 - Setting HVPA ramp speed to 25 V/s 15:56:49 - Switching HVPA to state Nominal 15:56:55 - Calling method FSM.gotoObserving in object FSM 15:56:58 - Setting HVPA current limits... 15:57:11 - Checking for high voltage locked pixels... 15:57:12 - Module 81 has 1 pixel(s) locked (HVPA status of 0x3f)! 15:57:12 - Module 130 has 1 pixel(s) locked (HVPA status of 0x3f)! 15:57:13 - Unlocking 2 channel(s)... 15:57:13 - Resetting HVPA channel 6 of drawer 81... 15:57:13 - Resetting HVPA channel 6 of drawer 130... 15:57:21 - Finished task "Switch HVPA voltage state" 15:57:41 - Checking for high voltage locked pixels... 15:58:11 - Checking for high voltage locked pixels... 15:58:28 - Starting task "Check high voltages" 15:58:29 - Found 53 drawer(s) in Nominal state, 0 in Low state and 0 in Wait state 15:58:37 - Actual voltage is between 945.50 V and 1167.54 V. 15:58:37 - Low voltages range between 300.00 V and 300.00 V. 15:58:41 - Checking for high voltage locked pixels... 15:58:47 - Reference voltages range between 945.26 V and 1167.15 V. 15:58:55 - Maximum difference between expected and actual voltages is 1.07 V 15:59:00 - Maximum of current limits is 5647.07 uA 15:59:00 - Checking status of HVPA module in 53 drawer(s)... 15:59:01 - Checking status of HVPA channels in 53 drawer(s)... 15:59:05 - HV is locked in 0 channel(s), was in rise default in 0 channel(s) and was still in progress in 1 channel(s) 15:59:05 - Checking reference and low voltages against /local/home/cta_test_bench/config/2020/20200128/config_tower_53modules_nd.NMC.xml 15:59:10 - Done 15:59:10 - Finished task "Check high voltages" 15:59:11 - Checking for high voltage locked pixels... 15:59:41 - Checking for high voltage locked pixels... 16:00:11 - Checking for high voltage locked pixels... 16:00:41 - Checking for high voltage locked pixels... 16:01:11 - Checking for high voltage locked pixels... 16:01:41 - Checking for high voltage locked pixels... 16:02:11 - Checking for high voltage locked pixels... 16:02:41 - Checking for high voltage locked pixels... 16:03:11 - Checking for high voltage locked pixels... 16:03:41 - Checking for high voltage locked pixels... 16:04:11 - Checking for high voltage locked pixels... 16:04:41 - Checking for high voltage locked pixels... 16:05:11 - Checking for high voltage locked pixels... 16:05:41 - Checking for high voltage locked pixels... 16:06:11 - Checking for high voltage locked pixels... 16:06:41 - Checking for high voltage locked pixels... 16:07:11 - Checking for high voltage locked pixels... 16:07:41 - Checking for high voltage locked pixels... 16:08:11 - Checking for high voltage locked pixels... 16:08:41 - Checking for high voltage locked pixels... 16:09:11 - Checking for high voltage locked pixels... 16:09:41 - Checking for high voltage locked pixels... 16:10:11 - Checking for high voltage locked pixels... 16:10:41 - Checking for high voltage locked pixels... 16:11:11 - Checking for high voltage locked pixels... 16:11:41 - Checking for high voltage locked pixels... 16:12:11 - Checking for high voltage locked pixels... 16:12:41 - Checking for high voltage locked pixels... 16:13:11 - Checking for high voltage locked pixels... 16:13:41 - Checking for high voltage locked pixels... 16:14:11 - Checking for high voltage locked pixels... 16:14:41 - Checking for high voltage locked pixels... 16:15:11 - Checking for high voltage locked pixels... 16:15:41 - Checking for high voltage locked pixels... 16:16:11 - Checking for high voltage locked pixels... 16:16:41 - Checking for high voltage locked pixels... 16:17:11 - Checking for high voltage locked pixels... 16:17:41 - Checking for high voltage locked pixels... 16:18:11 - Checking for high voltage locked pixels... 16:18:41 - Checking for high voltage locked pixels... 16:19:11 - Checking for high voltage locked pixels... 16:19:41 - Checking for high voltage locked pixels... 16:20:11 - Checking for high voltage locked pixels... 16:20:41 - Checking for high voltage locked pixels... 16:21:11 - Checking for high voltage locked pixels... 16:21:41 - Checking for high voltage locked pixels... 16:22:11 - Checking for high voltage locked pixels... 16:22:41 - Checking for high voltage locked pixels... 16:23:11 - Checking for high voltage locked pixels... 16:23:41 - Checking for high voltage locked pixels... 16:24:11 - Checking for high voltage locked pixels... 16:24:41 - Checking for high voltage locked pixels... 16:25:11 - Checking for high voltage locked pixels... 16:25:41 - Checking for high voltage locked pixels... 16:26:11 - Configuring UCTS 16:26:11 - Configuring TIB... 16:26:11 - Setting TIB forced mode to False 16:26:11 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v 16:26:11 - Status: TibState.RunStopped 16:26:11 - Alarms: AlarmVector.NoAlarm 16:26:11 - Connection status: False 16:26:11 - Disabling PPS 16:26:13 - Status: TibState.PpsStopped 16:26:13 - Alarms: AlarmVector.NoAlarm 16:26:13 - Connection status: False 16:26:13 - Entering set_external_delay 16:26:13 - Setting ExternalDelayLocal to 0.000 ns 16:26:13 - Writing 0.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v 16:26:13 - Entering set_external_delay 16:26:13 - Setting ExternalDelayCalibration to 98.000 ns 16:26:13 - Writing 98.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v 16:26:13 - Entering set_external_delay 16:26:13 - Setting ExternalDelaySphe to 150.000 ns 16:26:13 - Writing 150.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v 16:26:13 - Setting TIB trigger mode to 0x71 = TriggerMask.SlowControl|Pedestal|Software|Mono 16:26:13 - Writing 113 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v 16:26:13 - Writing 0 to Camera.TIB.InputsEnable.InputMask.InputMask_v 16:26:14 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v 16:26:14 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v 16:26:14 - Writing False to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v 16:26:14 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v 16:26:14 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v 16:26:14 - Status: TibState.PpsStopped 16:26:14 - Alarms: AlarmVector.NoAlarm 16:26:14 - Connection status: False 16:26:14 - Writing True to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v 16:26:14 - Writing 1 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v 16:26:14 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 16:26:14 - Writing False to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v 16:26:14 - Writing 1 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v 16:26:14 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v 16:26:14 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 16:26:14 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v 16:26:14 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v 16:26:14 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 16:26:14 - Checking for high voltage locked pixels... 16:26:22 - Starting NMC 16:26:22 - Clearing PPS error counters 16:26:28 - Connecting TIB to camera server at 10.10.4.12:222 16:26:28 - Starting TIB... 16:26:28 - Status: TibState.PpsStopped 16:26:28 - Alarms: AlarmVector.NoAlarm 16:26:28 - Connection status: False 16:26:28 - Resetting run 16:26:28 - Wait for UCTS external trigger before enabling trigger... 16:26:28 - Status: TibState.Standby 16:26:28 - Alarms: AlarmVector.NoAlarm 16:26:28 - Connection status: False 16:26:28 - Status: TibState.Standby 16:26:28 - Alarms: AlarmVector.NoAlarm 16:26:28 - Connection status: False 16:26:29 - Status: TibState.Armed 16:26:29 - Alarms: AlarmVector.NoAlarm 16:26:29 - Connection status: True 16:26:34 - Starting TIB triggers... 16:26:34 - Enabling trigger 16:26:34 - Status: TibState.Running 16:26:34 - Alarms: AlarmVector.NoAlarm 16:26:34 - Connection status: True 16:26:41 - Checking for high voltage locked pixels... 16:27:11 - Checking for high voltage locked pixels... 16:27:41 - Checking for high voltage locked pixels... 16:28:11 - Checking for high voltage locked pixels... 16:28:41 - Checking for high voltage locked pixels... 16:29:11 - Checking for high voltage locked pixels... 16:29:41 - Checking for high voltage locked pixels... 16:30:11 - Checking for high voltage locked pixels... 16:30:41 - Checking for high voltage locked pixels... 16:31:11 - Checking for high voltage locked pixels... 16:31:41 - Checking for high voltage locked pixels... 16:32:11 - Checking for high voltage locked pixels... 16:32:41 - Checking for high voltage locked pixels... 16:33:11 - Checking for high voltage locked pixels... 16:33:41 - Checking for high voltage locked pixels... 16:34:11 - Checking for high voltage locked pixels... 16:34:41 - Checking for high voltage locked pixels... 16:35:11 - Checking for high voltage locked pixels... 16:35:41 - Checking for high voltage locked pixels... 16:36:11 - Checking for high voltage locked pixels... 16:36:41 - Checking for high voltage locked pixels... 16:37:11 - Checking for high voltage locked pixels... 16:37:41 - Checking for high voltage locked pixels... 16:38:11 - Checking for high voltage locked pixels... 16:38:41 - Checking for high voltage locked pixels... 16:39:11 - Checking for high voltage locked pixels... 16:39:41 - Checking for high voltage locked pixels... 16:40:11 - Checking for high voltage locked pixels... 16:40:41 - Checking for high voltage locked pixels... 16:41:11 - Checking for high voltage locked pixels... 16:41:41 - Checking for high voltage locked pixels... 16:42:11 - Checking for high voltage locked pixels... 16:42:41 - Checking for high voltage locked pixels... 16:43:11 - Checking for high voltage locked pixels... 16:43:41 - Checking for high voltage locked pixels... 16:44:11 - Checking for high voltage locked pixels... 16:44:28 - Stopping TIB... 16:44:28 - Status: TibState.Running 16:44:28 - Alarms: AlarmVector.ReadError 16:44:28 - Connection status: True 16:44:28 - Disabling trigger 16:44:28 - Disabling PPS 16:44:29 - Status: TibState.PpsStopped 16:44:29 - Alarms: AlarmVector.ReadError 16:44:29 - Connection status: True 16:44:29 - Closing TIB connection to camera server 16:44:32 - Calling method FSM.gotoReady in object FSM 16:44:37 - Status: TibState.PpsStopped 16:44:37 - Alarms: AlarmVector.ReadError 16:44:37 - Connection status: False 16:44:37 - Run duration: 0:17:59 16:44:37 - Local camera triggers: 0 16:44:37 - Slow control triggers: 0 16:44:37 - Single photo-electron triggers: 0 16:44:37 - Calibration triggers: 0 16:44:37 - Software triggers from UCTS: 0 16:44:37 - Pedestal triggers: 1079 16:44:37 - Collected input triggers: 5899 16:44:37 - Busy triggers: 16 16:44:37 - Camera event triggers sent to clusters: 5883