08:32:22 - Executing command '/opt/cta/bin/cta_ctrl --slot 5 --all --power_on' on Digital Trigger Crate at 10.10.4.57
08:32:28 - Executing command '/opt/cta/bin/cta_ctrl --slot 6 --all --power_on' on Digital Trigger Crate at 10.10.4.57
08:32:33 - Executing command '/opt/cta/bin/cta_ctrl --slot 9 --all --power_on' on Digital Trigger Crate at 10.10.4.57
08:32:39 - Executing command '/opt/cta/bin/cta_ctrl --slot 13 --all --power_on' on Digital Trigger Crate at 10.10.4.57
08:32:45 - Executing command '/opt/cta/bin/cta_ctrl --slot 14 --all --power_on' on Digital Trigger Crate at 10.10.4.57
08:32:51 - Executing command '/opt/cta/bin/cta_ctrl --slot 15 --all --power_on' on Digital Trigger Crate at 10.10.4.57
08:32:57 - Executing command '/opt/cta/bin/cta_ctrl --slot 19 --all --power_on' on Digital Trigger Crate at 10.10.4.57
08:33:02 - Finished task "Powering modules..."
08:33:52 - ECC is in state EccState.Ready with status EccStatus.NoError
08:33:52 - Average temperature: 20.1 deg C
08:33:52 - Air temperature (T1-T6 and T9-T10): 20.1, 1255.0, -838.0, 1254.0, 1254.0, -838.0, -838.0, -838.0 deg C
08:33:52 - Air differential pressure: 100.0 Pa
08:33:52 - Water temperature (T11-T12): -838.0, 1254.0 deg C
08:33:52 - Back doors are open.
08:33:52 - Shutter is in state PartiallyOpen (error 0)
08:33:52 - Light sensors: [1.77, 2.05, 2.34, 2.58] V
08:33:52 - Humidity: 17.3 %. Water pressure: [4.52, 5.88] bar.
08:33:52 - Fan speeds: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0] rpm
08:33:52 - 24 V power supply no. 1 is enabled with a current of 50.900 A.
08:33:55 - Scanning interface p4p1 for non configured modules...
08:33:59 - Found 30 MAC address(es)
08:34:01 - Scanning interface p4p1 for non configured modules...
08:34:02 - Found 27 MAC address(es)
08:34:02 - Scanning interface p4p1 for non configured modules...
08:34:03 - Found 61 MAC address(es)
08:34:07 - ECC is in state EccState.Ready with status EccStatus.NoError
08:34:07 - Average temperature: 20.1 deg C
08:34:07 - Air temperature (T1-T6 and T9-T10): 20.1, 1255.0, 1254.0, 1254.0, -838.0, 1254.0, -838.0, 1253.0 deg C
08:34:07 - Air differential pressure: 104.0 Pa
08:34:07 - Water temperature (T11-T12): 1253.0, 1254.0 deg C
08:34:07 - Back doors are open.
08:34:07 - Shutter is in state PartiallyOpen (error 0)
08:34:07 - Light sensors: [1.78, 2.06, 2.34, 2.58] V
08:34:07 - Humidity: 17.4 %. Water pressure: [4.6, 5.94] bar.
08:34:07 - Fan speeds: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0] rpm
08:34:07 - 24 V power supply no. 1 is enabled with a current of 55.800 A.
08:34:12 - Starting task "Configure modules"
08:34:12 - Configuring modules with configuration /local/home/cta_test_bench/config/2019/20191210/config_tower_53modules_masks_delays_pattern_l1av2.NMC.xml
08:34:12 - Switching off high voltages in configuration
08:34:17 - Successfully configured 53 module(s)
08:34:23 - NMC is in state NmcState.Configured and knows of 53 drawer(s)
08:34:24 - Found 0 PPS errors.
08:34:24 - Finished task "Configure modules"
08:34:28 - Starting task "Power off channels not corresponding to a configured module"
08:34:28 - Powering off all but 53 DTC channel(s)
08:34:31 - Executing command '/opt/cta/bin/cta_ctrl --slot 1 --channel 4 --power_off' on Digital Trigger Crate at 10.10.4.57
08:34:33 - Executing command '/opt/cta/bin/cta_ctrl --slot 1 --channel 11 --power_off' on Digital Trigger Crate at 10.10.4.57
08:34:35 - Executing command '/opt/cta/bin/cta_ctrl --slot 5 --channel 3 --power_off' on Digital Trigger Crate at 10.10.4.57
08:34:36 - Executing command '/opt/cta/bin/cta_ctrl --slot 5 --channel 9 --power_off' on Digital Trigger Crate at 10.10.4.57
08:34:38 - Executing command '/opt/cta/bin/cta_ctrl --slot 6 --channel 1 --power_off' on Digital Trigger Crate at 10.10.4.57
08:34:40 - Executing command '/opt/cta/bin/cta_ctrl --slot 6 --channel 2 --power_off' on Digital Trigger Crate at 10.10.4.57
08:34:42 - Executing command '/opt/cta/bin/cta_ctrl --slot 6 --channel 4 --power_off' on Digital Trigger Crate at 10.10.4.57
08:34:43 - Executing command '/opt/cta/bin/cta_ctrl --slot 6 --channel 6 --power_off' on Digital Trigger Crate at 10.10.4.57
08:34:45 - Executing command '/opt/cta/bin/cta_ctrl --slot 6 --channel 7 --power_off' on Digital Trigger Crate at 10.10.4.57
08:34:47 - Executing command '/opt/cta/bin/cta_ctrl --slot 6 --channel 8 --power_off' on Digital Trigger Crate at 10.10.4.57
08:34:49 - Executing command '/opt/cta/bin/cta_ctrl --slot 6 --channel 9 --power_off' on Digital Trigger Crate at 10.10.4.57
08:34:50 - Executing command '/opt/cta/bin/cta_ctrl --slot 6 --channel 10 --power_off' on Digital Trigger Crate at 10.10.4.57
08:34:52 - Executing command '/opt/cta/bin/cta_ctrl --slot 6 --channel 11 --power_off' on Digital Trigger Crate at 10.10.4.57
08:34:54 - Executing command '/opt/cta/bin/cta_ctrl --slot 6 --channel 12 --power_off' on Digital Trigger Crate at 10.10.4.57
08:34:55 - Executing command '/opt/cta/bin/cta_ctrl --slot 6 --channel 13 --power_off' on Digital Trigger Crate at 10.10.4.57
08:34:57 - Executing command '/opt/cta/bin/cta_ctrl --slot 6 --channel 14 --power_off' on Digital Trigger Crate at 10.10.4.57
08:34:59 - Executing command '/opt/cta/bin/cta_ctrl --slot 6 --channel 15 --power_off' on Digital Trigger Crate at 10.10.4.57
08:35:01 - Executing command '/opt/cta/bin/cta_ctrl --slot 9 --channel 1 --power_off' on Digital Trigger Crate at 10.10.4.57
08:35:03 - Executing command '/opt/cta/bin/cta_ctrl --slot 9 --channel 2 --power_off' on Digital Trigger Crate at 10.10.4.57
08:35:04 - Executing command '/opt/cta/bin/cta_ctrl --slot 9 --channel 3 --power_off' on Digital Trigger Crate at 10.10.4.57
08:35:06 - Executing command '/opt/cta/bin/cta_ctrl --slot 9 --channel 4 --power_off' on Digital Trigger Crate at 10.10.4.57
08:35:08 - Executing command '/opt/cta/bin/cta_ctrl --slot 9 --channel 5 --power_off' on Digital Trigger Crate at 10.10.4.57
08:35:10 - Executing command '/opt/cta/bin/cta_ctrl --slot 9 --channel 6 --power_off' on Digital Trigger Crate at 10.10.4.57
08:35:11 - Executing command '/opt/cta/bin/cta_ctrl --slot 9 --channel 7 --power_off' on Digital Trigger Crate at 10.10.4.57
08:35:13 - Executing command '/opt/cta/bin/cta_ctrl --slot 9 --channel 8 --power_off' on Digital Trigger Crate at 10.10.4.57
08:35:15 - Executing command '/opt/cta/bin/cta_ctrl --slot 9 --channel 9 --power_off' on Digital Trigger Crate at 10.10.4.57
08:35:16 - Executing command '/opt/cta/bin/cta_ctrl --slot 9 --channel 10 --power_off' on Digital Trigger Crate at 10.10.4.57
08:35:18 - Executing command '/opt/cta/bin/cta_ctrl --slot 9 --channel 11 --power_off' on Digital Trigger Crate at 10.10.4.57
08:35:20 - Executing command '/opt/cta/bin/cta_ctrl --slot 9 --channel 12 --power_off' on Digital Trigger Crate at 10.10.4.57
08:35:22 - Executing command '/opt/cta/bin/cta_ctrl --slot 9 --channel 13 --power_off' on Digital Trigger Crate at 10.10.4.57
08:35:23 - Executing command '/opt/cta/bin/cta_ctrl --slot 9 --channel 14 --power_off' on Digital Trigger Crate at 10.10.4.57
08:35:25 - Executing command '/opt/cta/bin/cta_ctrl --slot 9 --channel 15 --power_off' on Digital Trigger Crate at 10.10.4.57
08:35:27 - Executing command '/opt/cta/bin/cta_ctrl --slot 13 --channel 1 --power_off' on Digital Trigger Crate at 10.10.4.57
08:35:29 - Executing command '/opt/cta/bin/cta_ctrl --slot 13 --channel 2 --power_off' on Digital Trigger Crate at 10.10.4.57
08:35:31 - Executing command '/opt/cta/bin/cta_ctrl --slot 13 --channel 6 --power_off' on Digital Trigger Crate at 10.10.4.57
08:35:32 - Executing command '/opt/cta/bin/cta_ctrl --slot 13 --channel 13 --power_off' on Digital Trigger Crate at 10.10.4.57
08:35:34 - Executing command '/opt/cta/bin/cta_ctrl --slot 14 --channel 1 --power_off' on Digital Trigger Crate at 10.10.4.57
08:35:36 - Executing command '/opt/cta/bin/cta_ctrl --slot 14 --channel 2 --power_off' on Digital Trigger Crate at 10.10.4.57
08:35:38 - Executing command '/opt/cta/bin/cta_ctrl --slot 14 --channel 3 --power_off' on Digital Trigger Crate at 10.10.4.57
08:35:39 - Executing command '/opt/cta/bin/cta_ctrl --slot 14 --channel 5 --power_off' on Digital Trigger Crate at 10.10.4.57
08:35:41 - Executing command '/opt/cta/bin/cta_ctrl --slot 14 --channel 8 --power_off' on Digital Trigger Crate at 10.10.4.57
08:35:43 - Executing command '/opt/cta/bin/cta_ctrl --slot 14 --channel 9 --power_off' on Digital Trigger Crate at 10.10.4.57
08:35:44 - Executing command '/opt/cta/bin/cta_ctrl --slot 14 --channel 10 --power_off' on Digital Trigger Crate at 10.10.4.57
08:35:46 - Executing command '/opt/cta/bin/cta_ctrl --slot 14 --channel 11 --power_off' on Digital Trigger Crate at 10.10.4.57
08:35:48 - Executing command '/opt/cta/bin/cta_ctrl --slot 14 --channel 12 --power_off' on Digital Trigger Crate at 10.10.4.57
08:35:50 - Executing command '/opt/cta/bin/cta_ctrl --slot 14 --channel 13 --power_off' on Digital Trigger Crate at 10.10.4.57
08:35:51 - Executing command '/opt/cta/bin/cta_ctrl --slot 14 --channel 14 --power_off' on Digital Trigger Crate at 10.10.4.57
08:35:53 - Executing command '/opt/cta/bin/cta_ctrl --slot 14 --channel 15 --power_off' on Digital Trigger Crate at 10.10.4.57
08:35:55 - Executing command '/opt/cta/bin/cta_ctrl --slot 15 --channel 1 --power_off' on Digital Trigger Crate at 10.10.4.57
08:35:57 - Executing command '/opt/cta/bin/cta_ctrl --slot 15 --channel 2 --power_off' on Digital Trigger Crate at 10.10.4.57
08:35:58 - Executing command '/opt/cta/bin/cta_ctrl --slot 15 --channel 3 --power_off' on Digital Trigger Crate at 10.10.4.57
08:36:00 - Executing command '/opt/cta/bin/cta_ctrl --slot 15 --channel 4 --power_off' on Digital Trigger Crate at 10.10.4.57
08:36:02 - Executing command '/opt/cta/bin/cta_ctrl --slot 15 --channel 5 --power_off' on Digital Trigger Crate at 10.10.4.57
08:36:04 - Executing command '/opt/cta/bin/cta_ctrl --slot 15 --channel 6 --power_off' on Digital Trigger Crate at 10.10.4.57
08:36:05 - Executing command '/opt/cta/bin/cta_ctrl --slot 15 --channel 7 --power_off' on Digital Trigger Crate at 10.10.4.57
08:36:07 - Executing command '/opt/cta/bin/cta_ctrl --slot 15 --channel 8 --power_off' on Digital Trigger Crate at 10.10.4.57
08:36:09 - Executing command '/opt/cta/bin/cta_ctrl --slot 15 --channel 11 --power_off' on Digital Trigger Crate at 10.10.4.57
08:36:11 - Executing command '/opt/cta/bin/cta_ctrl --slot 15 --channel 12 --power_off' on Digital Trigger Crate at 10.10.4.57
08:36:12 - Executing command '/opt/cta/bin/cta_ctrl --slot 15 --channel 13 --power_off' on Digital Trigger Crate at 10.10.4.57
08:36:14 - Executing command '/opt/cta/bin/cta_ctrl --slot 15 --channel 14 --power_off' on Digital Trigger Crate at 10.10.4.57
08:36:16 - Executing command '/opt/cta/bin/cta_ctrl --slot 15 --channel 15 --power_off' on Digital Trigger Crate at 10.10.4.57
08:36:18 - Executing command '/opt/cta/bin/cta_ctrl --slot 19 --channel 3 --power_off' on Digital Trigger Crate at 10.10.4.57
08:36:19 - Executing command '/opt/cta/bin/cta_ctrl --slot 19 --channel 4 --power_off' on Digital Trigger Crate at 10.10.4.57
08:36:21 - Executing command '/opt/cta/bin/cta_ctrl --slot 19 --channel 5 --power_off' on Digital Trigger Crate at 10.10.4.57
08:36:23 - Executing command '/opt/cta/bin/cta_ctrl --slot 19 --channel 6 --power_off' on Digital Trigger Crate at 10.10.4.57
08:36:25 - Executing command '/opt/cta/bin/cta_ctrl --slot 19 --channel 11 --power_off' on Digital Trigger Crate at 10.10.4.57
08:36:26 - Executing command '/opt/cta/bin/cta_ctrl --slot 19 --channel 14 --power_off' on Digital Trigger Crate at 10.10.4.57
08:36:28 - Finished task "Power off channels not corresponding to a configured module"
09:08:28 - Starting task "Switch HVPA voltage state"
09:08:28 - Setting HVPA current limit to 12489.75 uA
09:08:36 - Checking status of calibration box...
09:08:37 - Calibration box is configured with 1 leds at a frequency of 1000.0 Hz and a voltage of 8.00 V
09:08:38 - Stopping flashes...
09:08:46 - Setting HVPA ramp speed to 25 V/s
09:08:48 - Switching HVPA to state Nominal
09:08:53 - High voltage locked channels will be checked every 30 s
09:08:57 - Setting HVPA current limits...
09:09:20 - Finished task "Switch HVPA voltage state"
09:09:23 - Checking for high voltage locked pixels...
09:09:23 - Module 81 has 1 pixel(s) locked (HVPA status of 0x3f)!
09:09:24 - Module 163 has 1 pixel(s) locked (HVPA status of 0x77)!
09:09:24 - Unlocking 2 channel(s)...
09:09:25 - Resetting HVPA channel 6 of drawer 81...
09:09:25 - Resetting HVPA channel 3 of drawer 163...
09:09:53 - Checking for high voltage locked pixels...
09:10:12 - Starting task "Check high voltages"
09:10:13 - Found 53 drawer(s) in Nominal state, 0 in Low state and 0 in Wait state
09:10:21 - Actual voltage is between 945.50 V and 1166.93 V.
09:10:22 - Low voltages range between 300.00 V and 300.00 V. 
09:10:23 - Checking for high voltage locked pixels...
09:10:26 - Calling method FSM.gotoObserving in object FSM
09:10:31 - Reference voltages range between 945.26 V and 1167.15 V. 
09:10:40 - Maximum difference between expected and actual voltages is 0.71 V
09:10:44 - Maximum of current limits is 5647.07 uA
09:10:44 - Checking status of HVPA module in 53 drawer(s)...
09:10:45 - Checking status of HVPA channels in 53 drawer(s)...
09:10:48 - Stopping NMC
09:10:49 - Found 0 PPS errors.
09:10:49 - HV is stabilized in all channels.
09:10:49 - Checking reference and low voltages against /local/home/cta_test_bench/config/2019/20191210/config_tower_53modules_masks_delays_pattern_l1av2.NMC.xml
09:10:53 - Checking for high voltage locked pixels...
09:10:54 - Done
09:10:54 - Finished task "Check high voltages"
09:10:55 - Starting NMC
09:10:55 - Clearing PPS error counters
09:11:06 - Configuring calibration box...
09:11:06 - Configuring calibration box with leds=0x40 voltage=8.00 frequency=1000.0/1 central_current=0.0 duration=0 width=1 lemo_out=True fiber1_out=True fiber2_out=True lemo_in=False enabled=False
09:11:08 - Starting flashes...
09:11:18 - Configuring UCTS
09:11:18 - Configuring TIB...
09:11:18 - Setting TIB forced mode to False
09:11:18 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v
09:11:18 - Status: TibState.RunStopped
09:11:18 - Alarms: AlarmVector.NoAlarm
09:11:18 - Connection status: False
09:11:18 - Disabling PPS
09:11:20 - Status: TibState.PpsStopped
09:11:20 - Alarms: AlarmVector.NoAlarm
09:11:20 - Connection status: False
09:11:20 - Entering set_external_delay
09:11:20 - Setting ExternalDelayLocal to 0.000 ns
09:11:20 - Writing 0.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v
09:11:21 - Entering set_external_delay
09:11:21 - Setting ExternalDelayCalibration to 98.000 ns
09:11:21 - Writing 98.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v
09:11:21 - Entering set_external_delay
09:11:21 - Setting ExternalDelaySphe to 150.000 ns
09:11:21 - Writing 150.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v
09:11:21 - Setting TIB trigger mode to 0x74 = TriggerMask.SlowControl|Pedestal|Software|Calibration
09:11:21 - Writing 116 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v
09:11:21 - Writing 0 to Camera.TIB.InputsEnable.InputMask.InputMask_v
09:11:21 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v
09:11:21 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v
09:11:21 - Writing False to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v
09:11:22 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v
09:11:22 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v
09:11:22 - Status: TibState.PpsStopped
09:11:22 - Alarms: AlarmVector.NoAlarm
09:11:22 - Connection status: False
09:11:22 - Writing True to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v
09:11:22 - Writing 1 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v
09:11:22 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
09:11:22 - Writing False to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v
09:11:22 - Writing 1 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v
09:11:22 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v
09:11:22 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
09:11:22 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v
09:11:22 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v
09:11:22 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
09:11:23 - Checking for high voltage locked pixels...
09:11:25 - Connecting TIB to camera server at 10.10.4.12:222
09:11:25 - Starting TIB...
09:11:25 - Status: TibState.PpsStopped
09:11:25 - Alarms: AlarmVector.NoAlarm
09:11:25 - Connection status: False
09:11:25 - Resetting run
09:11:25 - Wait for UCTS external trigger before enabling trigger...
09:11:25 - Status: TibState.Standby
09:11:25 - Alarms: AlarmVector.NoAlarm
09:11:25 - Connection status: False
09:11:25 - Status: TibState.Standby
09:11:25 - Alarms: AlarmVector.NoAlarm
09:11:25 - Connection status: False
09:11:26 - Status: TibState.Armed
09:11:26 - Alarms: AlarmVector.NoAlarm
09:11:26 - Connection status: True
09:11:28 - Starting TIB triggers...
09:11:28 - Enabling trigger
09:11:28 - Status: TibState.Running
09:11:28 - Alarms: AlarmVector.NoAlarm
09:11:28 - Connection status: True
09:11:43 - Stopping TIB...
09:11:43 - Status: TibState.Running
09:11:43 - Alarms: AlarmVector.ReadError
09:11:43 - Connection status: True
09:11:43 - Disabling trigger
09:11:43 - Disabling PPS
09:11:44 - Status: TibState.PpsStopped
09:11:44 - Alarms: AlarmVector.ReadError
09:11:44 - Connection status: True
09:11:44 - Closing TIB connection to camera server
09:11:47 - Status: TibState.PpsStopped
09:11:47 - Alarms: AlarmVector.ReadError
09:11:47 - Connection status: False
09:11:47 - Run duration: 0:00:18
09:11:47 - Local camera triggers: 0
09:11:47 - Slow control triggers: 0
09:11:47 - Single photo-electron triggers: 0
09:11:47 - Calibration triggers: 17520
09:11:47 - Software triggers from UCTS: 0
09:11:47 - Pedestal triggers: 17
09:11:47 - Collected input triggers: 14771
09:11:47 - Busy triggers: 0
09:11:48 - Camera event triggers sent to clusters: 14771
09:11:49 - Calling method FSM.gotoReady in object FSM
09:11:53 - Checking for high voltage locked pixels...
09:12:23 - Checking for high voltage locked pixels...