14:55:48 - Starting task "Set DTC trigger masks" 14:55:48 - Configuring DTC trigger masks for 53 configured module(s) 14:55:49 - Setting DTC slot 1 trigger mask to 0xf7ee 14:55:53 - Starting task "Check high voltages" 14:55:53 - Setting DTC slot 5 trigger mask to 0xfdb6 14:55:53 - Found 53 drawer(s) in Nominal state, 0 in Low state and 0 in Wait state 14:55:55 - Checking for high voltage locked pixels... 14:55:56 - Setting DTC slot 6 trigger mask to 0x0028 14:56:00 - Setting DTC slot 9 trigger mask to 0x0000 14:56:01 - Actual voltage is between 945.50 V and 1166.93 V. 14:56:02 - Low voltages range between 300.00 V and 300.00 V. 14:56:03 - Setting DTC slot 13 trigger mask to 0xdff8 14:56:07 - Setting DTC slot 14 trigger mask to 0x00d0 14:56:10 - Setting DTC slot 15 trigger mask to 0x0600 14:56:12 - Reference voltages range between 945.26 V and 1167.15 V. 14:56:14 - Setting DTC slot 19 trigger mask to 0xb786 14:56:17 - Finished task "Set DTC trigger masks" 14:56:20 - Maximum difference between expected and actual voltages is 0.85 V 14:56:25 - Maximum of current limits is 5647.07 uA 14:56:25 - Checking status of HVPA module in 53 drawer(s)... 14:56:25 - Checking for high voltage locked pixels... 14:56:26 - Checking status of HVPA channels in 53 drawer(s)... 14:56:30 - HV is locked in 0 channel(s), was in rise default in 0 channel(s) and was still in progress in 1 channel(s) 14:56:30 - Checking reference and low voltages against /local/home/cta_test_bench/config/2020/20200610/config_tower_53modules.NMC.xml 14:56:35 - Done 14:56:35 - Finished task "Check high voltages" 14:56:55 - Starting NMC 14:56:55 - Clearing PPS error counters 14:56:58 - Checking for high voltage locked pixels... 14:57:02 - Calling method FSM.gotoObserving in object FSM 14:57:06 - Configuring calibration box... 14:57:06 - Configuring calibration box with leds=0x40 voltage=9.00 frequency=999.0/3 central_current=0.0 duration=0 width=1 lemo_out=False fiber1_out=False fiber2_out=False lemo_in=False enabled=False 14:57:08 - Starting flashes... 14:57:25 - Checking for high voltage locked pixels... 14:57:37 - Checking UCTS clock... 14:57:37 - UCTS and control PC clocks differ by 2.405191 seconds 14:57:37 - Configuring UCTS 14:57:37 - Configuring TIB... 14:57:37 - Setting TIB forced mode to False 14:57:37 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v 14:57:37 - Status: TibState.Running 14:57:37 - Alarms: AlarmVector.ReadError|BufferFull 14:57:37 - Connection status: True TXclient_alive: True 14:57:37 - Disabling PPS 14:57:37 - Error configuring TIB: Failed to call DisablePPS: Bad statuses are present 14:57:48 - Status: TibState.Running 14:57:48 - Alarms: AlarmVector.ReadError|BufferFull 14:57:48 - Connection status: True TXclient_alive: True 14:57:48 - External delays: Local=0.000 ns, Calibration=65.000 ns, Sphe=150.000 ns 14:57:48 - Trigger mask: 0x71 = TriggerMask.SlowControl|Pedestal|Software|Mono 14:57:48 - Input mask: 0x1 14:57:48 - Disable BUSY: False 14:57:48 - Extra BUSY Delay: 0.0 14:57:48 - Temperature: 36.94 14:57:52 - Stopping TIB... 14:57:52 - Status: TibState.Running 14:57:52 - Alarms: AlarmVector.ReadError|BufferFull 14:57:52 - Connection status: True TXclient_alive: True 14:57:52 - Disabling trigger 14:57:52 - Disabling PPS 14:57:53 - Status: TibState.PpsStopped 14:57:53 - Alarms: AlarmVector.ReadError|BufferFull 14:57:53 - Connection status: True TXclient_alive: True 14:57:53 - Closing TIB connection to camera server 14:57:55 - Resetting TIB... 14:57:57 - Checking for high voltage locked pixels... 14:57:59 - Checking UCTS clock... 14:57:59 - UCTS and control PC clocks differ by 1.588620 seconds 14:57:59 - Configuring UCTS 14:57:59 - Configuring TIB... 14:57:59 - Setting TIB forced mode to False 14:57:59 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v 14:57:59 - Status: TibState.RunStopped 14:57:59 - Alarms: AlarmVector.NoAlarm 14:57:59 - Connection status: False TXclient_alive: False 14:57:59 - Disabling PPS 14:58:01 - Status: TibState.PpsStopped 14:58:01 - Alarms: AlarmVector.NoAlarm 14:58:01 - Connection status: False TXclient_alive: False 14:58:01 - Entering set_external_delay 14:58:01 - Setting ExternalDelayLocal to 0.000 ns 14:58:01 - Writing 0.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v 14:58:01 - Entering set_external_delay 14:58:01 - Setting ExternalDelayCalibration to 65.000 ns 14:58:01 - Writing 65.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v 14:58:02 - Entering set_external_delay 14:58:02 - Setting ExternalDelaySphe to 150.000 ns 14:58:02 - Writing 150.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v 14:58:02 - Setting TIB trigger mode to 0x71 = TriggerMask.SlowControl|Pedestal|Software|Mono 14:58:02 - Writing 113 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v 14:58:02 - Writing 1 to Camera.TIB.InputsEnable.InputMask.InputMask_v 14:58:02 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v 14:58:02 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v 14:58:02 - Writing False to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v 14:58:02 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v 14:58:02 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v 14:58:02 - Status: TibState.PpsStopped 14:58:02 - Alarms: AlarmVector.NoAlarm 14:58:02 - Connection status: False TXclient_alive: False 14:58:02 - Writing True to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v 14:58:02 - Writing 100 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v 14:58:02 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 14:58:02 - Writing False to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v 14:58:02 - Writing 100 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v 14:58:02 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v 14:58:02 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 14:58:02 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v 14:58:02 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v 14:58:02 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 14:58:06 - Connecting TIB to camera server at 10.10.4.12:222 14:58:06 - Starting TIB... 14:58:06 - Status: TibState.PpsStopped 14:58:06 - Alarms: AlarmVector.NoAlarm 14:58:06 - Connection status: False TXclient_alive: False 14:58:06 - Resetting run 14:58:06 - Wait for UCTS external trigger before enabling trigger... 14:58:06 - Status: TibState.Standby 14:58:06 - Alarms: AlarmVector.NoAlarm 14:58:06 - Connection status: False TXclient_alive: True 14:58:06 - Status: TibState.Standby 14:58:06 - Alarms: AlarmVector.NoAlarm 14:58:06 - Connection status: False TXclient_alive: True 14:58:07 - Status: TibState.Armed 14:58:07 - Alarms: AlarmVector.NoAlarm 14:58:07 - Connection status: True TXclient_alive: True 14:58:25 - Checking for high voltage locked pixels... 14:58:29 - Calling method FSM.gotoReady in object FSM 14:58:35 - Calling method FSM.gotoObserving in object FSM 14:58:38 - Stopping NMC 14:58:38 - Found 0 PPS errors. 14:58:41 - Starting NMC 14:58:41 - Clearing PPS error counters 14:58:55 - Checking for high voltage locked pixels... 14:59:05 - Resetting TIB... 14:59:08 - Checking UCTS clock... 14:59:08 - UCTS and control PC clocks differ by 1.781734 seconds 14:59:08 - Configuring UCTS 14:59:08 - Configuring TIB... 14:59:08 - Setting TIB forced mode to False 14:59:08 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v 14:59:09 - Status: TibState.RunStopped 14:59:09 - Alarms: AlarmVector.NoAlarm 14:59:09 - Connection status: False TXclient_alive: False 14:59:09 - Disabling PPS 14:59:11 - Status: TibState.PpsStopped 14:59:11 - Alarms: AlarmVector.NoAlarm 14:59:11 - Connection status: False TXclient_alive: False 14:59:11 - Entering set_external_delay 14:59:11 - Setting ExternalDelayLocal to 0.000 ns 14:59:11 - Writing 0.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v 14:59:11 - Entering set_external_delay 14:59:11 - Setting ExternalDelayCalibration to 65.000 ns 14:59:11 - Writing 65.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v 14:59:11 - Entering set_external_delay 14:59:11 - Setting ExternalDelaySphe to 150.000 ns 14:59:11 - Writing 150.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v 14:59:11 - Setting TIB trigger mode to 0x71 = TriggerMask.SlowControl|Pedestal|Software|Mono 14:59:11 - Writing 113 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v 14:59:11 - Writing 1 to Camera.TIB.InputsEnable.InputMask.InputMask_v 14:59:11 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v 14:59:11 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v 14:59:11 - Writing False to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v 14:59:11 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v 14:59:11 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v 14:59:11 - Status: TibState.PpsStopped 14:59:11 - Alarms: AlarmVector.NoAlarm 14:59:11 - Connection status: False TXclient_alive: False 14:59:11 - Writing True to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v 14:59:11 - Writing 100 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v 14:59:11 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 14:59:11 - Writing False to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v 14:59:11 - Writing 100 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v 14:59:11 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v 14:59:11 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 14:59:11 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v 14:59:11 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v 14:59:11 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 14:59:12 - Connecting TIB to camera server at 10.10.4.12:222 14:59:12 - Starting TIB... 14:59:12 - Status: TibState.PpsStopped 14:59:12 - Alarms: AlarmVector.NoAlarm 14:59:12 - Connection status: False TXclient_alive: False 14:59:12 - Resetting run 14:59:12 - Wait for UCTS external trigger before enabling trigger... 14:59:12 - Status: TibState.Standby 14:59:12 - Alarms: AlarmVector.NoAlarm 14:59:12 - Connection status: False TXclient_alive: True 14:59:12 - Status: TibState.Standby 14:59:12 - Alarms: AlarmVector.NoAlarm 14:59:12 - Connection status: False TXclient_alive: True 14:59:14 - Status: TibState.Armed 14:59:14 - Alarms: AlarmVector.NoAlarm 14:59:14 - Connection status: True TXclient_alive: True 14:59:19 - Starting TIB triggers... 14:59:19 - Enabling trigger 14:59:19 - Status: TibState.Running 14:59:19 - Alarms: AlarmVector.NoAlarm 14:59:19 - Connection status: True TXclient_alive: True 14:59:26 - Checking for high voltage locked pixels... 14:59:42 - Stopping TIB... 14:59:42 - Status: TibState.Running 14:59:42 - Alarms: AlarmVector.ReadError 14:59:42 - Connection status: True TXclient_alive: True 14:59:42 - Disabling trigger 14:59:42 - Disabling PPS 14:59:43 - Status: TibState.PpsStopped 14:59:43 - Alarms: AlarmVector.ReadError 14:59:43 - Connection status: True TXclient_alive: True 14:59:43 - Closing TIB connection to camera server 14:59:44 - Status: TibState.PpsStopped 14:59:44 - Alarms: AlarmVector.ReadError 14:59:44 - Connection status: False TXclient_alive: False 14:59:44 - Run duration: 0:00:29 14:59:44 - Local camera triggers: 9455 14:59:44 - Slow control triggers: 0 14:59:44 - Single photo-electron triggers: 0 14:59:44 - Calibration triggers: 0 14:59:44 - Software triggers from UCTS: 0 14:59:44 - Pedestal triggers: 2834 14:59:44 - Collected input triggers: 10250 14:59:44 - Busy triggers: 10 14:59:44 - Camera event triggers sent to clusters: 10240 14:59:55 - Checking for high voltage locked pixels... 14:59:59 - Calling method FSM.gotoReady in object FSM