14:05:36 - Starting task "Switch HVPA voltage state" 14:05:37 - Setting HVPA current limit to 12489.75 uA 14:05:39 - High voltage locked channels will be checked every 30 s 14:05:55 - Setting HVPA ramp speed to 25 V/s 14:05:57 - Switching HVPA to state Nominal 14:06:06 - Setting HVPA current limits... 14:06:08 - Checking for high voltage locked pixels... 14:06:29 - Finished task "Switch HVPA voltage state" 14:06:38 - Checking for high voltage locked pixels... 14:06:39 - Module 81 has 1 pixel(s) locked (HVPA status of 0x3f)! 14:06:39 - Module 146 has 1 pixel(s) locked (HVPA status of 0x7d)! 14:06:40 - Module 163 has 1 pixel(s) locked (HVPA status of 0x77)! 14:06:40 - Unlocking 3 channel(s)... 14:06:40 - Resetting HVPA channel 6 of drawer 81... 14:06:40 - Resetting HVPA channel 1 of drawer 146... 14:06:40 - Resetting HVPA channel 3 of drawer 163... 14:07:08 - Checking for high voltage locked pixels... 14:07:38 - Checking for high voltage locked pixels... 14:07:43 - Starting task "Check high voltages" 14:07:43 - Found 53 drawer(s) in Nominal state, 0 in Low state and 0 in Wait state 14:07:51 - Actual voltage is between 945.50 V and 1167.54 V. 14:07:52 - Low voltages range between 300.00 V and 300.00 V. 14:08:01 - Reference voltages range between 945.26 V and 1167.15 V. 14:08:08 - Checking for high voltage locked pixels... 14:08:11 - Maximum difference between expected and actual voltages is 1.07 V 14:08:16 - Maximum of current limits is 5647.07 uA 14:08:16 - Checking status of HVPA module in 53 drawer(s)... 14:08:16 - Checking status of HVPA channels in 53 drawer(s)... 14:08:21 - HV is stabilized in all channels. 14:08:21 - Checking reference and low voltages against /local/home/cta_test_bench/config/2019/20191210/config_tower_53modules_masks_delays_pattern_l1av2.NMC.xml 14:08:26 - Done 14:08:26 - Finished task "Check high voltages" 14:08:38 - Checking for high voltage locked pixels... 14:09:08 - Checking for high voltage locked pixels... 14:09:38 - Checking for high voltage locked pixels... 14:10:08 - Checking for high voltage locked pixels... 14:10:21 - Starting NMC 14:10:21 - Clearing PPS error counters 14:10:38 - Checking for high voltage locked pixels... 14:11:08 - Checking for high voltage locked pixels... 14:11:29 - Configuring UCTS 14:11:30 - Error configuring UCTS: Failed to call Configure: Bad statuses are present 14:11:38 - Checking for high voltage locked pixels... 14:12:08 - Checking for high voltage locked pixels... 14:12:38 - Checking for high voltage locked pixels... 14:13:08 - Checking for high voltage locked pixels... 14:13:38 - Checking for high voltage locked pixels... 14:14:08 - Checking for high voltage locked pixels... 14:14:38 - Checking for high voltage locked pixels... 14:15:07 - Configuring UCTS 14:15:07 - Error configuring UCTS: Failed to call Configure: Bad statuses are present 14:15:08 - Checking for high voltage locked pixels... 14:15:38 - Checking for high voltage locked pixels... 14:16:08 - Checking for high voltage locked pixels... 14:16:38 - Checking for high voltage locked pixels... 14:17:08 - Checking for high voltage locked pixels... 14:17:38 - Checking for high voltage locked pixels... 14:18:08 - Checking for high voltage locked pixels... 14:18:38 - Checking for high voltage locked pixels... 14:19:08 - Checking for high voltage locked pixels... 14:19:38 - Checking for high voltage locked pixels... 14:20:08 - Checking for high voltage locked pixels... 14:20:38 - Checking for high voltage locked pixels... 14:21:08 - Checking for high voltage locked pixels... 14:21:38 - Checking for high voltage locked pixels... 14:22:08 - Checking for high voltage locked pixels... 14:22:38 - Checking for high voltage locked pixels... 14:23:08 - Checking for high voltage locked pixels... 14:23:38 - Checking for high voltage locked pixels... 14:24:08 - Checking for high voltage locked pixels... 14:24:38 - Checking for high voltage locked pixels... 14:25:08 - Checking for high voltage locked pixels... 14:25:38 - Checking for high voltage locked pixels... 14:26:08 - Checking for high voltage locked pixels... 14:26:38 - Checking for high voltage locked pixels... 14:27:08 - Checking for high voltage locked pixels... 14:27:38 - Checking for high voltage locked pixels... 14:28:08 - Checking for high voltage locked pixels... 14:28:38 - Checking for high voltage locked pixels... 14:29:08 - Checking for high voltage locked pixels... 14:29:38 - Checking for high voltage locked pixels... 14:30:08 - Checking for high voltage locked pixels... 14:30:38 - Checking for high voltage locked pixels... 14:31:08 - Checking for high voltage locked pixels... 14:31:38 - Checking for high voltage locked pixels... 14:32:08 - Checking for high voltage locked pixels... 14:32:38 - Checking for high voltage locked pixels... 14:33:08 - Checking for high voltage locked pixels... 14:33:38 - Checking for high voltage locked pixels... 14:34:08 - Checking for high voltage locked pixels... 14:34:38 - Checking for high voltage locked pixels... 14:35:08 - Checking for high voltage locked pixels... 14:35:38 - Checking for high voltage locked pixels... 14:36:08 - Checking for high voltage locked pixels... 14:36:11 - Configuring UCTS 14:36:12 - No server with URI='urn:sedipcc127.extra.cea.fr:NectarCAM:UCTS' has been discovered. The client could not discover a single server. 14:36:36 - Configuring UCTS 14:36:37 - Configuring TIB... 14:36:37 - Setting TIB forced mode to False 14:36:37 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v 14:36:37 - Status: TibState.RunStopped 14:36:37 - Alarms: AlarmVector.NoAlarm 14:36:37 - Connection status: False 14:36:37 - Disabling PPS 14:36:39 - Status: TibState.PpsStopped 14:36:39 - Alarms: AlarmVector.NoAlarm 14:36:39 - Connection status: False 14:36:39 - Entering set_external_delay 14:36:39 - Setting ExternalDelayLocal to 0.000 ns 14:36:39 - Writing 0.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v 14:36:40 - Entering set_external_delay 14:36:40 - Setting ExternalDelayCalibration to 98.000 ns 14:36:40 - Writing 98.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v 14:36:40 - Entering set_external_delay 14:36:40 - Setting ExternalDelaySphe to 150.000 ns 14:36:40 - Writing 150.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v 14:36:40 - Setting TIB trigger mode to 0x54 = TriggerMask.SlowControl|Software|Calibration 14:36:40 - Writing 84 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v 14:36:40 - Writing 0 to Camera.TIB.InputsEnable.InputMask.InputMask_v 14:36:40 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v 14:36:40 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v 14:36:40 - Writing False to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v 14:36:40 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v 14:36:40 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v 14:36:40 - Status: TibState.PpsStopped 14:36:40 - Alarms: AlarmVector.NoAlarm 14:36:40 - Connection status: False 14:36:40 - Writing False to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v 14:36:40 - Writing 100 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v 14:36:40 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 14:36:40 - Writing False to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v 14:36:40 - Writing 100 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v 14:36:40 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v 14:36:40 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 14:36:40 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v 14:36:40 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v 14:36:40 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 14:36:41 - Checking for high voltage locked pixels... 14:37:08 - Checking for high voltage locked pixels... 14:37:38 - Checking for high voltage locked pixels... 14:38:08 - Checking for high voltage locked pixels... 14:38:38 - Checking for high voltage locked pixels... 14:38:43 - Checking status of calibration box... 14:38:45 - Failed to call GetStatus: Bad statuses are present 14:39:08 - Checking for high voltage locked pixels... 14:39:35 - Starting task "Switch HVPA voltage state" 14:39:36 - Setting HVPA current limit to 12489.75 uA 14:39:36 - Stopped periodic check of locked high voltages 14:39:53 - Setting HVPA ramp speed to 500 V/s 14:39:55 - Switching HVPA to state Wait 14:40:04 - Setting HVPA current limits... 14:40:27 - Finished task "Switch HVPA voltage state" 14:42:10 - Starting task "Check high voltages" 14:42:10 - Found 0 drawer(s) in Nominal state, 0 in Low state and 53 in Wait state 14:42:18 - Actual voltage is between 140.91 V and 156.77 V. 14:42:19 - Low voltages range between 300.00 V and 300.00 V. 14:42:28 - Reference voltages range between 945.26 V and 1167.15 V. 14:42:33 - Maximum difference between expected and actual voltages is 150.06 V 14:42:38 - Maximum of current limits is 5647.07 uA 14:42:38 - Checking status of HVPA module in 53 drawer(s)... 14:42:38 - Checking status of HVPA channels in 53 drawer(s)... 14:42:42 - HV is locked in 0 channel(s), was in rise default in 0 channel(s) and was still in progress in 371 channel(s) 14:42:42 - Finished task "Check high voltages" 14:45:24 - Starting task "Switch HVPA voltage state" 14:45:24 - Setting HVPA current limit to 12489.75 uA 14:45:26 - High voltage locked channels will be checked every 30 s 14:45:41 - Setting HVPA ramp speed to 25 V/s 14:45:43 - Switching HVPA to state Nominal 14:45:52 - Setting HVPA current limits... 14:45:55 - Checking for high voltage locked pixels... 14:45:56 - Module 81 has 1 pixel(s) locked (HVPA status of 0x3f)! 14:45:57 - Unlocking 1 channel(s)... 14:45:57 - Resetting HVPA channel 6 of drawer 81... 14:46:15 - Finished task "Switch HVPA voltage state" 14:46:25 - Checking for high voltage locked pixels... 14:46:55 - Checking for high voltage locked pixels... 14:47:25 - Checking for high voltage locked pixels... 14:47:55 - Checking for high voltage locked pixels... 14:47:57 - Stopping NMC 14:47:58 - Found 0 PPS errors. 14:47:58 - Starting NMC 14:47:58 - Clearing PPS error counters 14:48:03 - Starting task "Check high voltages" 14:48:03 - Found 53 drawer(s) in Nominal state, 0 in Low state and 0 in Wait state 14:48:12 - Actual voltage is between 944.89 V and 1167.54 V. 14:48:12 - Low voltages range between 300.00 V and 300.00 V. 14:48:16 - Checking status of calibration box... 14:48:17 - Failed to call GetStatus: Bad statuses are present 14:48:21 - Reference voltages range between 945.26 V and 1167.15 V. 14:48:25 - Checking for high voltage locked pixels... 14:48:30 - Maximum difference between expected and actual voltages is 0.71 V 14:48:35 - Maximum of current limits is 5647.07 uA 14:48:35 - Checking status of HVPA module in 53 drawer(s)... 14:48:35 - Checking status of HVPA channels in 53 drawer(s)... 14:48:40 - HV is stabilized in all channels. 14:48:40 - Checking reference and low voltages against /local/home/cta_test_bench/config/2019/20191210/config_tower_53modules_masks_delays_pattern_l1av2.NMC.xml 14:48:45 - Done 14:48:45 - Finished task "Check high voltages" 14:48:55 - Checking for high voltage locked pixels... 14:49:05 - Checking status of calibration box... 14:49:06 - Calibration box is configured with 13 leds at a frequency of 10000.0 Hz and a voltage of 10.00 V 14:49:25 - Checking for high voltage locked pixels... 14:49:55 - Checking for high voltage locked pixels... 14:50:14 - Configuring calibration box... 14:50:14 - Configuring calibration box with leds=0x40 voltage=11.00 frequency=1000.0/1 central_current=0.0 duration=500 width=1 lemo_out=True fiber1_out=True fiber2_out=True lemo_in=False enabled=False 14:50:25 - Checking for high voltage locked pixels... 14:50:55 - Checking for high voltage locked pixels... 14:51:25 - Checking for high voltage locked pixels... 14:51:48 - Calling method FSM.gotoStandby in object FSM 14:51:51 - The GetEndpoints service failed: BadTimeout 14:51:55 - Checking for high voltage locked pixels... 14:52:03 - The GetEndpoints service failed: BadTimeout 14:52:25 - Checking for high voltage locked pixels... 14:52:55 - Checking for high voltage locked pixels... 14:53:25 - Checking for high voltage locked pixels... 14:53:55 - Checking for high voltage locked pixels... 14:54:25 - Checking for high voltage locked pixels... 14:54:55 - Checking for high voltage locked pixels... 14:55:25 - Checking for high voltage locked pixels... 14:55:55 - Checking for high voltage locked pixels... 14:56:25 - Checking for high voltage locked pixels... 14:56:55 - Checking for high voltage locked pixels... 14:57:25 - Checking for high voltage locked pixels... 14:57:55 - Checking for high voltage locked pixels... 14:58:25 - Checking for high voltage locked pixels... 14:58:55 - Checking for high voltage locked pixels... 14:59:25 - Checking for high voltage locked pixels... 14:59:55 - Checking for high voltage locked pixels... 15:00:25 - Checking for high voltage locked pixels... 15:00:55 - Checking for high voltage locked pixels... 15:01:25 - Checking for high voltage locked pixels... 15:01:55 - Checking for high voltage locked pixels... 15:02:25 - Checking for high voltage locked pixels... 15:02:55 - Checking for high voltage locked pixels... 15:03:25 - Checking for high voltage locked pixels... 15:03:55 - Checking for high voltage locked pixels... 15:04:25 - Checking for high voltage locked pixels... 15:04:55 - Checking for high voltage locked pixels... 15:05:25 - Checking for high voltage locked pixels... 15:05:55 - Checking for high voltage locked pixels... 15:06:25 - Checking for high voltage locked pixels... 15:06:55 - Checking for high voltage locked pixels... 15:07:25 - Checking for high voltage locked pixels... 15:07:55 - Checking for high voltage locked pixels... 15:08:25 - Checking for high voltage locked pixels... 15:08:55 - Checking for high voltage locked pixels... 15:09:25 - Checking for high voltage locked pixels... 15:09:55 - Checking for high voltage locked pixels... 15:10:25 - Checking for high voltage locked pixels... 15:10:55 - Checking for high voltage locked pixels... 15:11:25 - Checking for high voltage locked pixels... 15:11:55 - Checking for high voltage locked pixels... 15:12:25 - Checking for high voltage locked pixels... 15:12:55 - Checking for high voltage locked pixels... 15:13:25 - Checking for high voltage locked pixels... 15:13:55 - Checking for high voltage locked pixels... 15:14:25 - Checking for high voltage locked pixels... 15:14:55 - Checking for high voltage locked pixels... 15:15:25 - Checking for high voltage locked pixels... 15:15:55 - Checking for high voltage locked pixels... 15:16:25 - Checking for high voltage locked pixels... 15:16:55 - Checking for high voltage locked pixels... 15:17:01 - Calling method FSM.gotoStandby in object FSM 15:17:02 - Failed to call FSM.gotoStandby: Bad statuses are present 15:17:05 - Event builder is in state CameraServerState.Standby and has output 444 event(s) (444 complete). 15:17:07 - Calling method FSM.gotoReady in object FSM 15:17:18 - Calling method FSM.gotoObserving in object FSM 15:17:25 - Checking for high voltage locked pixels... 15:17:32 - Connecting TIB to camera server at 10.10.4.12:222 15:17:32 - Starting TIB... 15:17:32 - Status: TibState.PpsStopped 15:17:32 - Alarms: AlarmVector.NoAlarm 15:17:32 - Connection status: False 15:17:32 - Resetting run 15:17:32 - Wait for UCTS external trigger before enabling trigger... 15:17:32 - Status: TibState.Standby 15:17:32 - Alarms: AlarmVector.NoAlarm 15:17:32 - Connection status: False 15:17:32 - Status: TibState.Standby 15:17:32 - Alarms: AlarmVector.NoAlarm 15:17:32 - Connection status: False 15:17:33 - Status: TibState.Armed 15:17:33 - Alarms: AlarmVector.NoAlarm 15:17:33 - Connection status: True 15:17:39 - Starting TIB triggers... 15:17:39 - Enabling trigger 15:17:39 - Status: TibState.Running 15:17:39 - Alarms: AlarmVector.NoAlarm 15:17:39 - Connection status: True 15:17:43 - Configuring calibration box... 15:17:43 - Configuring calibration box with leds=0x40 voltage=11.00 frequency=1000.0/1 central_current=0.0 duration=500 width=1 lemo_out=True fiber1_out=True fiber2_out=True lemo_in=False enabled=False 15:17:55 - Checking for high voltage locked pixels... 15:18:25 - Checking for high voltage locked pixels... 15:18:55 - Checking for high voltage locked pixels... 15:19:25 - Checking for high voltage locked pixels... 15:19:55 - Checking for high voltage locked pixels... 15:20:25 - Checking for high voltage locked pixels... 15:20:27 - Starting flashes... 15:20:55 - Checking for high voltage locked pixels... 15:21:21 - Calling method FSM.gotoReady in object FSM 15:21:25 - Checking for high voltage locked pixels... 15:21:27 - Stopping TIB... 15:21:27 - Status: TibState.Running 15:21:27 - Alarms: AlarmVector.ReadError 15:21:27 - Connection status: True 15:21:27 - Disabling trigger 15:21:27 - Disabling PPS 15:21:28 - Status: TibState.PpsStopped 15:21:28 - Alarms: AlarmVector.ReadError 15:21:28 - Connection status: True 15:21:28 - Closing TIB connection to camera server 15:21:33 - Status: TibState.PpsStopped 15:21:33 - Alarms: AlarmVector.ReadError 15:21:33 - Connection status: False 15:21:34 - Run duration: 0:03:54 15:21:34 - Local camera triggers: 0 15:21:34 - Slow control triggers: 0 15:21:34 - Single photo-electron triggers: 0 15:21:34 - Calibration triggers: 49938 15:21:34 - Software triggers from UCTS: 0 15:21:34 - Pedestal triggers: 0 15:21:34 - Collected input triggers: 49938 15:21:34 - Busy triggers: 0 15:21:34 - Camera event triggers sent to clusters: 49938 15:21:55 - Checking for high voltage locked pixels... 15:22:25 - Checking for high voltage locked pixels... 15:22:55 - Checking for high voltage locked pixels... 15:23:25 - Checking for high voltage locked pixels... 15:23:55 - Checking for high voltage locked pixels... 15:24:25 - Checking for high voltage locked pixels... 15:24:55 - Checking for high voltage locked pixels...