11:31:00 - Stopping NMC 11:31:01 - Found 0 PPS errors. 11:31:02 - Starting NMC 11:31:02 - Clearing PPS error counters 11:31:05 - Starting task "Check high voltages" 11:31:06 - Found 53 drawer(s) in Nominal state, 0 in Low state and 0 in Wait state 11:31:08 - Calling method FSM.gotoObserving in object FSM 11:31:14 - Actual voltage is between 945.50 V and 1167.54 V. 11:31:15 - Low voltages range between 300.00 V and 300.00 V. 11:31:16 - Configuring UCTS 11:31:16 - Configuring TIB... 11:31:16 - Setting TIB forced mode to False 11:31:16 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v 11:31:16 - Status: TibState.PpsStopped 11:31:16 - Alarms: AlarmVector.ReadError 11:31:16 - Connection status: False TXclient_alive: False 11:31:16 - Entering set_external_delay 11:31:16 - Setting ExternalDelayLocal to 0.000 ns 11:31:16 - Writing 0.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v 11:31:16 - Entering set_external_delay 11:31:16 - Setting ExternalDelayCalibration to 65.000 ns 11:31:16 - Writing 65.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v 11:31:16 - Entering set_external_delay 11:31:16 - Setting ExternalDelaySphe to 150.000 ns 11:31:16 - Writing 150.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v 11:31:16 - Setting TIB trigger mode to 0x74 = TriggerMask.SlowControl|Pedestal|Software|Calibration 11:31:16 - Writing 116 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v 11:31:16 - Writing 1 to Camera.TIB.InputsEnable.InputMask.InputMask_v 11:31:16 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v 11:31:16 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v 11:31:16 - Writing False to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v 11:31:16 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v 11:31:16 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v 11:31:16 - Status: TibState.PpsStopped 11:31:16 - Alarms: AlarmVector.ReadError 11:31:16 - Connection status: False TXclient_alive: False 11:31:16 - Writing True to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v 11:31:16 - Writing 100 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v 11:31:16 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 11:31:16 - Writing False to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v 11:31:16 - Writing 100 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v 11:31:16 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v 11:31:16 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 11:31:16 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v 11:31:16 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v 11:31:16 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 11:31:20 - Connecting TIB to camera server at 10.10.4.12:222 11:31:20 - Starting TIB... 11:31:20 - Status: TibState.PpsStopped 11:31:20 - Alarms: AlarmVector.ReadError 11:31:20 - Connection status: False TXclient_alive: False 11:31:20 - Resetting run 11:31:20 - Wait for UCTS external trigger before enabling trigger... 11:31:20 - Status: TibState.Standby 11:31:20 - Alarms: AlarmVector.NoAlarm 11:31:20 - Connection status: False TXclient_alive: True 11:31:20 - Status: TibState.Standby 11:31:20 - Alarms: AlarmVector.NoAlarm 11:31:20 - Connection status: False TXclient_alive: True 11:31:21 - Status: TibState.Armed 11:31:21 - Alarms: AlarmVector.NoAlarm 11:31:21 - Connection status: True TXclient_alive: True 11:31:24 - Reference voltages range between 945.26 V and 1167.15 V. 11:31:24 - Checking for high voltage locked pixels... 11:31:28 - Configuring calibration box... 11:31:28 - Configuring calibration box with leds=0x40 voltage=13.00 frequency=1000.0/1 central_current=0.0 duration=120 width=1 lemo_out=True fiber1_out=True fiber2_out=False lemo_in=False enabled=False 11:31:33 - Maximum difference between expected and actual voltages is 0.72 V 11:31:34 - Starting TIB triggers... 11:31:34 - Enabling trigger 11:31:34 - Status: TibState.Running 11:31:34 - Alarms: AlarmVector.NoAlarm 11:31:35 - Connection status: True TXclient_alive: True 11:31:37 - Starting flashes... 11:31:37 - Maximum of current limits is 5647.07 uA 11:31:37 - Checking status of HVPA module in 53 drawer(s)... 11:31:38 - Checking status of HVPA channels in 53 drawer(s)... 11:31:42 - HV is stabilized in all channels. 11:31:42 - Checking reference and low voltages against /local/home/cta_test_bench/config/2020/20200610/config_tower_53modules.NMC.xml 11:31:47 - Done 11:31:48 - Finished task "Check high voltages" 11:31:53 - Stopping TIB... 11:31:53 - Status: TibState.Running 11:31:53 - Alarms: AlarmVector.ReadError 11:31:53 - Connection status: True TXclient_alive: True 11:31:53 - Disabling trigger 11:31:53 - Disabling PPS 11:31:54 - Status: TibState.PpsStopped 11:31:54 - Alarms: AlarmVector.ReadError 11:31:54 - Connection status: True TXclient_alive: True 11:31:54 - Closing TIB connection to camera server 11:31:55 - Checking for high voltage locked pixels... 11:31:56 - Status: TibState.PpsStopped 11:31:56 - Alarms: AlarmVector.ReadError 11:31:56 - Connection status: False TXclient_alive: False 11:31:56 - Run duration: 0:00:33 11:31:56 - Local camera triggers: 0 11:31:56 - Slow control triggers: 0 11:31:56 - Single photo-electron triggers: 0 11:31:56 - Calibration triggers: 11920 11:31:56 - Software triggers from UCTS: 0 11:31:56 - Pedestal triggers: 3216 11:31:56 - Collected input triggers: 13792 11:31:56 - Busy triggers: 47 11:31:56 - Camera event triggers sent to clusters: 13745 11:31:59 - Calling method FSM.gotoReady in object FSM 11:32:09 - Starting task "Switch HVPA voltage state" 11:32:09 - Setting HVPA current limit to 12489.75 uA 11:32:24 - Checking for high voltage locked pixels... 11:32:27 - Setting HVPA ramp speed to 500 V/s 11:32:29 - Switching HVPA to state Wait 11:32:33 - Stopped periodic check of locked high voltages 11:32:38 - Setting HVPA current limits... 11:33:01 - Finished task "Switch HVPA voltage state" 12:36:37 - Starting task "Switch HVPA voltage state" 12:36:37 - Setting HVPA current limit to 12489.75 uA 12:36:50 - Calling method FSM.gotoObserving in object FSM 12:36:55 - Setting HVPA ramp speed to 25 V/s 12:36:57 - Switching HVPA to state Nominal 12:37:01 - High voltage locked channels will be checked every 30 s 12:37:06 - Setting HVPA current limits... 12:37:29 - Finished task "Switch HVPA voltage state" 12:37:31 - Checking for high voltage locked pixels... 12:37:32 - Module 81 has 1 pixel(s) locked (HVPA status of 0x3f)! 12:37:32 - Module 146 has 1 pixel(s) locked (HVPA status of 0x7d)! 12:37:32 - Module 163 has 1 pixel(s) locked (HVPA status of 0x77)! 12:37:33 - Unlocking 3 channel(s)... 12:37:33 - Resetting HVPA channel 6 of drawer 81... 12:37:33 - Resetting HVPA channel 1 of drawer 146... 12:37:33 - Resetting HVPA channel 3 of drawer 163... 12:38:01 - Checking for high voltage locked pixels... 12:38:17 - Starting task "Check high voltages" 12:38:18 - Found 53 drawer(s) in Nominal state, 0 in Low state and 0 in Wait state 12:38:26 - Actual voltage is between 945.50 V and 1166.93 V. 12:38:26 - Low voltages range between 300.00 V and 300.00 V. 12:38:31 - Checking for high voltage locked pixels... 12:38:36 - Reference voltages range between 945.26 V and 1167.15 V. 12:38:44 - Maximum difference between expected and actual voltages is 0.69 V 12:38:45 - Stopping NMC 12:38:45 - Found 0 PPS errors. 12:38:46 - Starting NMC 12:38:46 - Clearing PPS error counters 12:38:49 - Maximum of current limits is 5647.07 uA 12:38:49 - Checking status of HVPA module in 53 drawer(s)... 12:38:50 - Checking status of HVPA channels in 53 drawer(s)... 12:38:52 - Configuring UCTS 12:38:52 - Configuring TIB... 12:38:52 - Setting TIB forced mode to False 12:38:52 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v 12:38:52 - Status: TibState.PpsStopped 12:38:52 - Alarms: AlarmVector.ReadError 12:38:52 - Connection status: False TXclient_alive: False 12:38:52 - Entering set_external_delay 12:38:52 - Setting ExternalDelayLocal to 0.000 ns 12:38:52 - Writing 0.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v 12:38:52 - Entering set_external_delay 12:38:52 - Setting ExternalDelayCalibration to 65.000 ns 12:38:52 - Writing 65.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v 12:38:52 - Entering set_external_delay 12:38:52 - Setting ExternalDelaySphe to 150.000 ns 12:38:52 - Writing 150.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v 12:38:52 - Setting TIB trigger mode to 0x74 = TriggerMask.SlowControl|Pedestal|Software|Calibration 12:38:52 - Writing 116 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v 12:38:52 - Writing 1 to Camera.TIB.InputsEnable.InputMask.InputMask_v 12:38:52 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v 12:38:52 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v 12:38:52 - Writing False to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v 12:38:52 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v 12:38:52 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v 12:38:52 - Status: TibState.PpsStopped 12:38:52 - Alarms: AlarmVector.ReadError 12:38:52 - Connection status: False TXclient_alive: False 12:38:52 - Writing True to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v 12:38:52 - Writing 100 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v 12:38:52 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 12:38:52 - Writing False to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v 12:38:52 - Writing 100 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v 12:38:52 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v 12:38:52 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 12:38:52 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v 12:38:52 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v 12:38:52 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 12:38:54 - Connecting TIB to camera server at 10.10.4.12:222 12:38:54 - Starting TIB... 12:38:54 - Status: TibState.PpsStopped 12:38:54 - Alarms: AlarmVector.ReadError 12:38:54 - Connection status: False TXclient_alive: False 12:38:54 - Resetting run 12:38:54 - Wait for UCTS external trigger before enabling trigger... 12:38:54 - Status: TibState.Standby 12:38:54 - Alarms: AlarmVector.NoAlarm 12:38:54 - Connection status: False TXclient_alive: True 12:38:54 - Status: TibState.Standby 12:38:54 - Alarms: AlarmVector.NoAlarm 12:38:54 - Connection status: False TXclient_alive: True 12:38:55 - Status: TibState.Armed 12:38:55 - Alarms: AlarmVector.NoAlarm 12:38:55 - Connection status: True TXclient_alive: True 12:38:54 - HV is stabilized in all channels. 12:38:54 - Checking reference and low voltages against /local/home/cta_test_bench/config/2020/20200610/config_tower_53modules.NMC.xml 12:38:58 - Configuring calibration box... 12:38:58 - Configuring calibration box with leds=0x40 voltage=13.00 frequency=1000.0/1 central_current=0.0 duration=120 width=1 lemo_out=True fiber1_out=True fiber2_out=False lemo_in=False enabled=False 12:38:59 - Done 12:38:59 - Finished task "Check high voltages" 12:39:01 - Checking for high voltage locked pixels... 12:39:12 - Starting TIB triggers... 12:39:12 - Enabling trigger 12:39:12 - Status: TibState.Running 12:39:12 - Alarms: AlarmVector.NoAlarm 12:39:12 - Connection status: True TXclient_alive: True 12:39:14 - Starting flashes... 12:39:29 - Stopping TIB... 12:39:29 - Status: TibState.Running 12:39:29 - Alarms: AlarmVector.ReadError 12:39:29 - Connection status: True TXclient_alive: True 12:39:29 - Disabling trigger 12:39:29 - Disabling PPS 12:39:30 - Status: TibState.PpsStopped 12:39:30 - Alarms: AlarmVector.ReadError 12:39:30 - Connection status: True TXclient_alive: True 12:39:30 - Closing TIB connection to camera server 12:39:31 - Checking for high voltage locked pixels... 12:39:33 - Status: TibState.PpsStopped 12:39:33 - Alarms: AlarmVector.ReadError 12:39:33 - Connection status: False TXclient_alive: False 12:39:33 - Run duration: 0:00:35 12:39:33 - Local camera triggers: 0 12:39:33 - Slow control triggers: 0 12:39:33 - Single photo-electron triggers: 0 12:39:33 - Calibration triggers: 11967 12:39:33 - Software triggers from UCTS: 0 12:39:33 - Pedestal triggers: 3421 12:39:33 - Collected input triggers: 13737 12:39:33 - Busy triggers: 0 12:39:33 - Camera event triggers sent to clusters: 13737 12:39:36 - Calling method FSM.gotoReady in object FSM