09:27 - Starting task "Set L0 trigger thresholds" 09:27 - Setting L0 thresholds to 15.0 p.e. 09:27 - Setting L0 thresholds to 15.0 p.e. per pixel using L0 slopes and offsets in /local/home/cta_test_bench/data/2019/20190328/l0_threshold_slope_and_offset.h5 09:28 - Thresholds saved in configuration file /local/home/cta_test_bench/config/2019/20190403/config_2019-04-03_09-27-59.NMC.xml 09:28 - Finished task "Set L0 trigger thresholds" 10:44 - Starting task "Configure modules" 10:44 - Configuring modules with configuration /local/home/cta_test_bench/config/2019/20190401/config_61modules_cameraqm_l1a+l0delays_nd.NMC.xml 10:44 - Switching off high voltages in configuration 10:44 - Successfully configured 61 module(s) 10:44 - NMC is in state NmcState.Configured and knows of 61 drawer(s) 10:44 - Found 0 PPS errors. 10:44 - Finished task "Configure modules" 10:45 - Starting task "Check high voltages" 10:45 - Found 0 drawer(s) in Nominal state, 0 in Low state and 61 in Wait state 10:45 - Actual voltage is between 0.00 V and 6.10 V. 10:45 - Low voltages range between 100.00 V and 100.00 V. 10:45 - Reference voltages range between 945.26 V and 1167.15 V. 10:45 - Maximum difference between expected and actual voltages is 6.10 V 10:45 - Maximum of current limits is 5647.07 uA 10:45 - Checking status of HVPA module in 61 drawer(s)... 10:45 - Checking status of HVPA channels in 61 drawer(s)... 10:45 - HV is locked in 0 channel(s), was in rise default in 0 channel(s) and was still in progress in 427 channel(s) 10:45 - Checking reference and low voltages against /local/home/cta_test_bench/config/2019/20190401/config_61modules_cameraqm_l1a+l0delays_nd.NMC.xml 10:45 - Done 10:45 - Finished task "Check high voltages" 10:46 - Starting task "Switch HVPA voltage state" 10:46 - Setting HVPA current limit to 12489.75 uA 10:46 - Setting HVPA ramp speed to 500 V/s 10:46 - Switching HVPA to state Low 10:46 - Setting HVPA current limits... 10:47 - Finished task "Check high voltages" 10:48 - Starting task "Check high voltages" 10:48 - Found 0 drawer(s) in Nominal state, 61 in Low state and 0 in Wait state 10:49 - Actual voltage is between 6.10 V and 100.65 V. 10:49 - Low voltages range between 100.00 V and 100.00 V. 10:49 - Reference voltages range between 0.00 V and 1167.15 V. 10:49 - Maximum difference between expected and actual voltages is 95.12 V 10:49 - Maximum of current limits is 5647.07 uA 10:49 - Checking status of HVPA module in 61 drawer(s)... 10:49 - HVPA module in drawer 80 has a status of 0x3f! 10:49 - HVPA module in drawer 83 has a status of 0x77! 10:49 - HVPA module in drawer 111 has a status of 0x7d! 10:49 - HVPA module in drawer 113 has a status of 0x77! 10:49 - HVPA module in drawer 134 has a status of 0x7b! 10:49 - HVPA module in drawer 153 has a status of 0x7e! 10:49 - Checking status of HVPA channels in 61 drawer(s)... 10:49 - HVPA channel 0 of drawer 153 has status 0x8003! 10:49 - HVPA channel 1 of drawer 111 has status 0x8003! 10:49 - HVPA channel 2 of drawer 134 has status 0x8003! 10:49 - HVPA channel 3 of drawer 83 has status 0x8003! 10:49 - HVPA channel 3 of drawer 113 has status 0x8003! 10:49 - HVPA channel 6 of drawer 80 has status 0x8003! 10:49 - HV is locked in 6 channel(s), was in rise default in 0 channel(s) and was still in progress in 0 channel(s) 10:49 - Resetting 6 channel(s)... 10:49 - Resetting HVPA channel 0 of drawer 153... 10:49 - Resetting HVPA channel 1 of drawer 111... 10:49 - Resetting HVPA channel 2 of drawer 134... 10:49 - Resetting HVPA channel 3 of drawer 83... 10:49 - Resetting HVPA channel 3 of drawer 113... 10:49 - Resetting HVPA channel 6 of drawer 80... 10:49 - Checking reference and low voltages against /local/home/cta_test_bench/config/2019/20190401/config_61modules_cameraqm_l1a+l0delays_nd.NMC.xml 10:49 - Done 10:49 - Finished task "Check high voltages" 10:50 - Starting task "Check high voltages" 10:50 - Found 0 drawer(s) in Nominal state, 61 in Low state and 0 in Wait state 10:50 - Actual voltage is between 99.43 V and 100.65 V. 10:50 - Low voltages range between 100.00 V and 100.00 V. 10:51 - Reference voltages range between 945.26 V and 1167.15 V. 10:51 - Maximum difference between expected and actual voltages is 0.65 V 10:51 - Maximum of current limits is 5647.07 uA 10:51 - Checking status of HVPA module in 61 drawer(s)... 10:51 - Checking status of HVPA channels in 61 drawer(s)... 10:51 - HV is stabilized in all channels. 10:51 - Checking reference and low voltages against /local/home/cta_test_bench/config/2019/20190401/config_61modules_cameraqm_l1a+l0delays_nd.NMC.xml 10:51 - Done 10:51 - Finished task "Check high voltages" 10:55 - Starting task "Switch HVPA voltage state" 10:55 - Setting HVPA current limit to 12489.75 uA 10:55 - Setting HVPA ramp speed to 35 V/s 10:55 - Switching HVPA to state Nominal 10:55 - High voltage locked channels will be checked every 30 s 10:55 - Setting HVPA current limits... 10:56 - Finished task "Switch HVPA voltage state" 10:56 - Checking for high voltage locked pixels... 10:56 - Checking for high voltage locked pixels... 10:57 - Starting task "Check high voltages" 10:57 - Checking for high voltage locked pixels... 10:57 - Found 61 drawer(s) in Nominal state, 0 in Low state and 0 in Wait state 10:57 - Actual voltage is between 944.89 V and 1167.54 V. 10:57 - Low voltages range between 100.00 V and 100.00 V. 10:57 - Reference voltages range between 945.26 V and 1167.15 V. 10:57 - Checking for high voltage locked pixels... 10:57 - Maximum difference between expected and actual voltages is 0.69 V 10:57 - Maximum of current limits is 5647.07 uA 10:57 - Checking status of HVPA module in 61 drawer(s)... 10:57 - Checking status of HVPA channels in 61 drawer(s)... 10:57 - HV is locked in 0 channel(s), was in rise default in 0 channel(s) and was still in progress in 1 channel(s) 10:57 - Checking reference and low voltages against /local/home/cta_test_bench/config/2019/20190401/config_61modules_cameraqm_l1a+l0delays_nd.NMC.xml 10:58 - Done 10:58 - Finished task "Check high voltages" 10:58 - Checking for high voltage locked pixels... 10:58 - Checking for high voltage locked pixels... 10:59 - Checking for high voltage locked pixels... 10:59 - Starting NMC 10:59 - Clearing PPS error counters 10:59 - Checking for high voltage locked pixels... 11:00 - Configuring UCTS 11:00 - Configuring TIB... 11:00 - Setting TIB forced mode to False 11:00 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v 11:00 - Status: TibState.PpsStopped 11:00 - Alarms: AlarmVector.ReadError 11:00 - Connection status: False 11:00 - Entering set_external_delay 11:00 - Setting ExternalDelayLocal to 0.000 ns 11:00 - Writing 0.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v 11:00 - Entering set_external_delay 11:00 - Setting ExternalDelayCalibration to 55.000 ns 11:00 - Writing 55.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v 11:00 - Entering set_external_delay 11:00 - Setting ExternalDelaySphe to 0.000 ns 11:00 - Writing 0.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v 11:00 - Setting TIB trigger mode to 0x54 = TriggerMask.SlowControl|Software|Calibration 11:00 - Writing 84 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v 11:00 - Writing 0 to Camera.TIB.InputsEnable.InputMask.InputMask_v 11:00 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v 11:00 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v 11:00 - Writing False to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v 11:00 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v 11:00 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v 11:00 - Status: TibState.PpsStopped 11:00 - Alarms: AlarmVector.ReadError 11:00 - Connection status: False 11:00 - Writing False to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v 11:00 - Writing 100 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v 11:00 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 11:00 - Writing False to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v 11:00 - Writing 100 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v 11:00 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v 11:00 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 11:00 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v 11:00 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v 11:00 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 11:00 - Checking for high voltage locked pixels... 11:00 - Connecting TIB to camera server at 10.10.4.12:222 11:00 - Starting TIB... 11:00 - Status: TibState.PpsStopped 11:00 - Alarms: AlarmVector.ReadError 11:00 - Connection status: False 11:00 - Resetting run 11:00 - Wait for UCTS external trigger before enabling trigger... 11:00 - Status: TibState.Standby 11:00 - Alarms: AlarmVector.NoAlarm 11:00 - Connection status: False 11:00 - Status: TibState.Standby 11:00 - Alarms: AlarmVector.NoAlarm 11:00 - Connection status: False 11:00 - Status: TibState.Armed 11:00 - Alarms: AlarmVector.NoAlarm 11:00 - Connection status: True 11:00 - Starting TIB triggers... 11:00 - Enabling trigger 11:00 - Status: TibState.Running 11:00 - Alarms: AlarmVector.NoAlarm 11:00 - Connection status: True 11:00 - Checking for high voltage locked pixels... 11:01 - Configuring calibration box... 11:01 - Configuring calibration box with leds=0x1fff voltage=16.50 frequency=1000.0/1 central_current=0.0 duration=200 width=1 lemo_out=True fiber1_out=True fiber2_out=True lemo_in=False enabled=False 11:01 - Checking for high voltage locked pixels... 11:01 - Starting flashes... 11:01 - Checking for high voltage locked pixels... 11:02 - Checking for high voltage locked pixels... 11:02 - Stopping flashes... 11:02 - Stopping TIB... 11:02 - Status: TibState.Running 11:02 - Alarms: AlarmVector.ReadError 11:02 - Connection status: True 11:02 - Disabling trigger 11:02 - Disabling PPS 11:02 - Status: TibState.PpsStopped 11:02 - Alarms: AlarmVector.ReadError 11:02 - Connection status: True 11:02 - Closing TIB connection to camera server 11:02 - Status: TibState.PpsStopped 11:02 - Alarms: AlarmVector.ReadError 11:02 - Connection status: False 11:02 - Run duration: 0:02:19 11:02 - Local camera triggers: 0 11:02 - Slow control triggers: 0 11:02 - Single photo-electron triggers: 0 11:02 - Calibration triggers: 19935 11:02 - Software triggers from UCTS: 0 11:02 - Pedestal triggers: 0 11:02 - Collected input triggers: 19935 11:02 - Busy triggers: 0 11:02 - Camera event triggers sent to clusters: 19935 11:02 - Checking for high voltage locked pixels... 11:03 - Checking for high voltage locked pixels... 11:03 - Checking for high voltage locked pixels... 11:04 - Checking for high voltage locked pixels... 11:04 - Checking for high voltage locked pixels... 11:05 - Checking for high voltage locked pixels... 11:05 - Stopping NMC 11:05 - Found 0 PPS errors. 11:05 - Starting task "Check high voltages" 11:05 - Found 61 drawer(s) in Nominal state, 0 in Low state and 0 in Wait state 11:05 - Actual voltage is between 945.50 V and 1167.54 V. 11:05 - Low voltages range between 100.00 V and 100.00 V. 11:05 - Checking for high voltage locked pixels... 11:05 - Reference voltages range between 945.26 V and 1167.15 V. 11:05 - Maximum difference between expected and actual voltages is 0.69 V 11:06 - Maximum of current limits is 5647.07 uA 11:06 - Checking status of HVPA module in 61 drawer(s)... 11:06 - Checking status of HVPA channels in 61 drawer(s)... 11:06 - HV is stabilized in all channels. 11:06 - Checking reference and low voltages against /local/home/cta_test_bench/config/2019/20190401/config_61modules_cameraqm_l1a+l0delays_nd.NMC.xml 11:06 - Done 11:06 - Finished task "Check high voltages" 11:06 - Checking for high voltage locked pixels... 11:06 - Checking for high voltage locked pixels... 11:07 - Checking for high voltage locked pixels... 11:07 - Checking for high voltage locked pixels... 11:08 - Checking for high voltage locked pixels... 11:08 - Checking for high voltage locked pixels... 11:09 - Checking for high voltage locked pixels... 11:09 - Checking for high voltage locked pixels... 11:10 - Checking for high voltage locked pixels... 11:10 - Checking for high voltage locked pixels... 11:11 - Checking for high voltage locked pixels... 11:11 - Checking for high voltage locked pixels... 11:12 - Starting NMC 11:12 - Clearing PPS error counters 11:12 - Checking for high voltage locked pixels... 11:12 - Configuring UCTS 11:12 - Configuring TIB... 11:12 - Setting TIB forced mode to False 11:12 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v 11:12 - Status: TibState.PpsStopped 11:12 - Alarms: AlarmVector.ReadError 11:12 - Connection status: False 11:12 - Entering set_external_delay 11:12 - Setting ExternalDelayLocal to 0.000 ns 11:12 - Writing 0.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v 11:12 - Entering set_external_delay 11:12 - Setting ExternalDelayCalibration to 55.000 ns 11:12 - Writing 55.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v 11:12 - Entering set_external_delay 11:12 - Setting ExternalDelaySphe to 0.000 ns 11:12 - Writing 0.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v 11:12 - Setting TIB trigger mode to 0x54 = TriggerMask.SlowControl|Software|Calibration 11:12 - Writing 84 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v 11:12 - Writing 0 to Camera.TIB.InputsEnable.InputMask.InputMask_v 11:12 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v 11:12 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v 11:12 - Writing False to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v 11:12 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v 11:12 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v 11:12 - Status: TibState.PpsStopped 11:12 - Alarms: AlarmVector.ReadError 11:12 - Connection status: False 11:12 - Writing False to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v 11:12 - Writing 100 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v 11:12 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 11:12 - Writing False to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v 11:12 - Writing 100 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v 11:12 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v 11:12 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 11:12 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v 11:12 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v 11:12 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 11:12 - Connecting TIB to camera server at 10.10.4.12:222 11:12 - Starting TIB... 11:12 - Status: TibState.PpsStopped 11:12 - Alarms: AlarmVector.ReadError 11:12 - Connection status: False 11:12 - Resetting run 11:12 - Wait for UCTS external trigger before enabling trigger... 11:12 - Status: TibState.Standby 11:12 - Alarms: AlarmVector.NoAlarm 11:12 - Connection status: False 11:12 - Status: TibState.Standby 11:12 - Alarms: AlarmVector.NoAlarm 11:12 - Connection status: False 11:12 - Status: TibState.Armed 11:12 - Alarms: AlarmVector.NoAlarm 11:12 - Connection status: True 11:12 - Starting TIB triggers... 11:12 - Enabling trigger 11:12 - Status: TibState.Running 11:12 - Alarms: AlarmVector.NoAlarm 11:12 - Connection status: True 11:12 - Checking for high voltage locked pixels... 11:13 - Checking for high voltage locked pixels... 11:13 - Configuring calibration box... 11:13 - Configuring calibration box with leds=0x1fff voltage=16.50 frequency=1000.0/1 central_current=0.0 duration=200 width=1 lemo_out=True fiber1_out=True fiber2_out=True lemo_in=False enabled=False 11:13 - Starting flashes... 11:13 - Checking for high voltage locked pixels... 11:14 - Stopping flashes... 11:14 - Checking for high voltage locked pixels... 11:14 - Stopping TIB... 11:14 - Status: TibState.Running 11:14 - Alarms: AlarmVector.ReadError 11:14 - Connection status: True 11:14 - Disabling trigger 11:14 - Disabling PPS 11:14 - Status: TibState.PpsStopped 11:14 - Alarms: AlarmVector.ReadError 11:14 - Connection status: True 11:14 - Closing TIB connection to camera server 11:14 - Status: TibState.PpsStopped 11:14 - Alarms: AlarmVector.ReadError 11:14 - Connection status: False 11:14 - Run duration: 0:01:54 11:14 - Local camera triggers: 0 11:14 - Slow control triggers: 0 11:14 - Single photo-electron triggers: 0 11:14 - Calibration triggers: 19930 11:14 - Software triggers from UCTS: 0 11:14 - Pedestal triggers: 0 11:14 - Collected input triggers: 19930 11:14 - Busy triggers: 0 11:14 - Camera event triggers sent to clusters: 19930 11:14 - Checking for high voltage locked pixels... 11:15 - Stopping NMC 11:15 - Found 0 PPS errors. 11:15 - Starting task "Check high voltages" 11:15 - Found 61 drawer(s) in Nominal state, 0 in Low state and 0 in Wait state 11:15 - Checking for high voltage locked pixels... 11:15 - Actual voltage is between 945.50 V and 1167.54 V. 11:15 - Low voltages range between 100.00 V and 100.00 V. 11:15 - Reference voltages range between 945.26 V and 1167.15 V. 11:15 - Maximum difference between expected and actual voltages is 0.69 V 11:15 - Maximum of current limits is 5647.07 uA 11:15 - Checking status of HVPA module in 61 drawer(s)... 11:15 - Checking status of HVPA channels in 61 drawer(s)... 11:15 - Checking for high voltage locked pixels... 11:15 - HV is locked in 0 channel(s), was in rise default in 0 channel(s) and was still in progress in 1 channel(s) 11:15 - Checking reference and low voltages against /local/home/cta_test_bench/config/2019/20190401/config_61modules_cameraqm_l1a+l0delays_nd.NMC.xml 11:15 - Stopped periodic check of locked high voltages 11:15 - Done 11:15 - Finished task "Switch HVPA voltage state" 11:16 - Starting task "Check high voltages" 11:16 - Found 61 drawer(s) in Nominal state, 0 in Low state and 0 in Wait state 11:16 - Actual voltage is between 945.50 V and 1167.54 V. 11:16 - Low voltages range between 100.00 V and 100.00 V. 11:16 - Reference voltages range between 945.26 V and 1167.15 V. 11:17 - Maximum difference between expected and actual voltages is 0.72 V 11:17 - Maximum of current limits is 5647.07 uA 11:17 - Checking status of HVPA module in 61 drawer(s)... 11:17 - Checking status of HVPA channels in 61 drawer(s)... 11:17 - HV is stabilized in all channels. 11:17 - Checking reference and low voltages against /local/home/cta_test_bench/config/2019/20190401/config_61modules_cameraqm_l1a+l0delays_nd.NMC.xml 11:17 - Done 11:17 - Finished task "Check high voltages" 11:17 - Starting task "Switch HVPA voltage state" 11:17 - Setting HVPA current limit to 12489.75 uA 11:17 - Setting HVPA ramp speed to 500 V/s 11:18 - Switching HVPA to state Low 11:18 - Setting HVPA current limits... 11:18 - Finished task "Check high voltages" 11:19 - Starting task "Check high voltages" 11:19 - Found 0 drawer(s) in Nominal state, 61 in Low state and 0 in Wait state 11:19 - Actual voltage is between 161.04 V and 192.76 V. 11:19 - Low voltages range between 100.00 V and 100.00 V. 11:19 - Reference voltages range between 945.26 V and 1167.15 V. 11:19 - Maximum difference between expected and actual voltages is 81.17 V 11:19 - Maximum of current limits is 5647.07 uA 11:19 - Checking status of HVPA module in 61 drawer(s)... 11:19 - Checking status of HVPA channels in 61 drawer(s)... 11:20 - HV is locked in 0 channel(s), was in rise default in 0 channel(s) and was still in progress in 427 channel(s) 11:20 - Checking reference and low voltages against /local/home/cta_test_bench/config/2019/20190401/config_61modules_cameraqm_l1a+l0delays_nd.NMC.xml 11:20 - Done 11:20 - Finished task "Check high voltages" 11:20 - Starting task "Check high voltages" 11:20 - Found 0 drawer(s) in Nominal state, 61 in Low state and 0 in Wait state 11:20 - Actual voltage is between 128.71 V and 151.28 V. 11:20 - Low voltages range between 100.00 V and 100.00 V. 11:20 - Reference voltages range between 945.26 V and 1167.15 V. 11:20 - Maximum difference between expected and actual voltages is 43.96 V 11:21 - Maximum of current limits is 5647.07 uA 11:21 - Checking status of HVPA module in 61 drawer(s)... 11:21 - Checking status of HVPA channels in 61 drawer(s)... 11:21 - HV is locked in 0 channel(s), was in rise default in 0 channel(s) and was still in progress in 427 channel(s) 11:21 - Checking reference and low voltages against /local/home/cta_test_bench/config/2019/20190401/config_61modules_cameraqm_l1a+l0delays_nd.NMC.xml 11:21 - Done 11:21 - Finished task "Check high voltages" 11:21 - Starting task "Check high voltages" 11:22 - Found 0 drawer(s) in Nominal state, 61 in Low state and 0 in Wait state 11:22 - Actual voltage is between 100.65 V and 117.12 V. 11:22 - Low voltages range between 100.00 V and 100.00 V. 11:22 - Reference voltages range between 945.26 V and 1167.15 V. 11:22 - Maximum difference between expected and actual voltages is 11.63 V 11:22 - Maximum of current limits is 5647.07 uA 11:22 - Checking status of HVPA module in 61 drawer(s)... 11:22 - Checking status of HVPA channels in 61 drawer(s)... 11:22 - HV is locked in 0 channel(s), was in rise default in 0 channel(s) and was still in progress in 326 channel(s) 11:22 - Checking reference and low voltages against /local/home/cta_test_bench/config/2019/20190401/config_61modules_cameraqm_l1a+l0delays_nd.NMC.xml 11:22 - Done 11:22 - Finished task "Check high voltages" 11:57 - Starting task "Check high voltages" 11:57 - Found 0 drawer(s) in Nominal state, 61 in Low state and 0 in Wait state 11:57 - Actual voltage is between 0.00 V and 100.65 V. 11:57 - Low voltages range between 100.00 V and 100.00 V. 11:57 - Reference voltages range between 0.00 V and 1167.15 V. 11:57 - Maximum difference between expected and actual voltages is 100.00 V 11:57 - Maximum of current limits is 5647.07 uA 11:57 - Checking status of HVPA module in 61 drawer(s)... 11:57 - HVPA module in drawer 118 has a status of 0x77! 11:57 - Checking status of HVPA channels in 61 drawer(s)... 11:57 - HVPA channel 3 of drawer 118 has status 0x8003! 11:57 - HV is locked in 1 channel(s), was in rise default in 0 channel(s) and was still in progress in 0 channel(s) 11:57 - Resetting 1 channel(s)... 11:57 - Resetting HVPA channel 3 of drawer 118... 11:57 - Checking reference and low voltages against /local/home/cta_test_bench/config/2019/20190401/config_61modules_cameraqm_l1a+l0delays_nd.NMC.xml 11:57 - Done 11:57 - Finished task "Check high voltages" 11:58 - Starting task "Check high voltages" 11:58 - Found 0 drawer(s) in Nominal state, 61 in Low state and 0 in Wait state 11:58 - Actual voltage is between 99.43 V and 100.65 V. 11:58 - Low voltages range between 100.00 V and 100.00 V. 11:59 - Reference voltages range between 945.26 V and 1167.15 V. 11:59 - Maximum difference between expected and actual voltages is 0.65 V 11:59 - Maximum of current limits is 5647.07 uA 11:59 - Checking status of HVPA module in 61 drawer(s)... 11:59 - Checking status of HVPA channels in 61 drawer(s)... 11:59 - HV is stabilized in all channels. 11:59 - Checking reference and low voltages against /local/home/cta_test_bench/config/2019/20190401/config_61modules_cameraqm_l1a+l0delays_nd.NMC.xml 11:59 - Done 11:59 - Finished task "Check high voltages" 11:59 - Starting task "Switch HVPA voltage state" 11:59 - Setting HVPA current limit to 12489.75 uA 12:00 - Setting HVPA ramp speed to 35 V/s 12:00 - Switching HVPA to state Nominal 12:00 - Setting HVPA current limits... 12:00 - Finished task "Switch HVPA voltage state" 12:00 - Starting task "Check high voltages" 12:01 - Found 61 drawer(s) in Nominal state, 0 in Low state and 0 in Wait state 12:01 - Actual voltage is between 945.50 V and 1167.54 V. 12:01 - Low voltages range between 100.00 V and 100.00 V. 12:01 - Reference voltages range between 945.26 V and 1167.15 V. 12:01 - Maximum difference between expected and actual voltages is 0.71 V 12:01 - Maximum of current limits is 5647.07 uA 12:01 - Checking status of HVPA module in 61 drawer(s)... 12:01 - Checking status of HVPA channels in 61 drawer(s)... 12:01 - HV is locked in 0 channel(s), was in rise default in 0 channel(s) and was still in progress in 1 channel(s) 12:01 - Checking reference and low voltages against /local/home/cta_test_bench/config/2019/20190401/config_61modules_cameraqm_l1a+l0delays_nd.NMC.xml 12:01 - Done 12:01 - Finished task "Check high voltages" 12:01 - Starting NMC 12:01 - Clearing PPS error counters 12:02 - Configuring UCTS 12:02 - Configuring TIB... 12:02 - Setting TIB forced mode to False 12:02 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v 12:02 - Status: TibState.PpsStopped 12:02 - Alarms: AlarmVector.ReadError 12:02 - Connection status: False 12:02 - Entering set_external_delay 12:02 - Setting ExternalDelayLocal to 0.000 ns 12:02 - Writing 0.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v 12:02 - Entering set_external_delay 12:02 - Setting ExternalDelayCalibration to 55.000 ns 12:02 - Writing 55.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v 12:02 - Entering set_external_delay 12:02 - Setting ExternalDelaySphe to 0.000 ns 12:02 - Writing 0.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v 12:02 - Setting TIB trigger mode to 0x54 = TriggerMask.SlowControl|Software|Calibration 12:02 - Writing 84 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v 12:02 - Writing 0 to Camera.TIB.InputsEnable.InputMask.InputMask_v 12:02 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v 12:02 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v 12:02 - Writing False to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v 12:02 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v 12:02 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v 12:02 - Status: TibState.PpsStopped 12:02 - Alarms: AlarmVector.ReadError 12:02 - Connection status: False 12:02 - Writing False to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v 12:02 - Writing 100 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v 12:02 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 12:02 - Writing False to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v 12:02 - Writing 100 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v 12:02 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v 12:02 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 12:02 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v 12:02 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v 12:02 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 12:02 - Connecting TIB to camera server at 10.10.4.12:222 12:02 - Starting TIB... 12:02 - Status: TibState.PpsStopped 12:02 - Alarms: AlarmVector.ReadError 12:02 - Connection status: False 12:02 - Resetting run 12:02 - Wait for UCTS external trigger before enabling trigger... 12:02 - Status: TibState.Standby 12:02 - Alarms: AlarmVector.NoAlarm 12:02 - Connection status: False 12:02 - Status: TibState.Standby 12:02 - Alarms: AlarmVector.NoAlarm 12:02 - Connection status: False 12:02 - Status: TibState.Armed 12:02 - Alarms: AlarmVector.NoAlarm 12:02 - Connection status: True 12:03 - Starting TIB triggers... 12:03 - Enabling trigger 12:03 - Status: TibState.Running 12:03 - Alarms: AlarmVector.NoAlarm 12:03 - Connection status: True 12:04 - Configuring calibration box... 12:04 - Configuring calibration box with leds=0x1fff voltage=16.50 frequency=1000.0/1 central_current=0.0 duration=200 width=1 lemo_out=True fiber1_out=True fiber2_out=True lemo_in=False enabled=False 12:04 - Starting flashes... 12:07 - Stopping flashes... 12:07 - Stopping TIB... 12:07 - Status: TibState.Running 12:07 - Alarms: AlarmVector.ReadError 12:07 - Connection status: True 12:07 - Disabling trigger 12:07 - Disabling PPS 12:08 - Status: TibState.PpsStopped 12:08 - Alarms: AlarmVector.ReadError 12:08 - Connection status: True 12:08 - Closing TIB connection to camera server 12:08 - Status: TibState.PpsStopped 12:08 - Alarms: AlarmVector.ReadError 12:08 - Connection status: False 12:08 - Run duration: 0:05:15 12:08 - Local camera triggers: 0 12:08 - Slow control triggers: 0 12:08 - Single photo-electron triggers: 0 12:08 - Calibration triggers: 19950 12:08 - Software triggers from UCTS: 0 12:08 - Pedestal triggers: 0 12:08 - Collected input triggers: 19950 12:08 - Busy triggers: 0 12:08 - Camera event triggers sent to clusters: 19950 12:08 - Stopping NMC 12:08 - Found 0 PPS errors. 12:09 - Starting task "Switch HVPA voltage state" 12:09 - Setting HVPA current limit to 12489.75 uA 12:09 - Setting HVPA ramp speed to 35 V/s 12:09 - Switching HVPA to state Nominal 12:10 - Setting HVPA current limits... 12:10 - Finished task "Switch HVPA voltage state" 12:10 - Starting task "Check high voltages" 12:10 - Found 61 drawer(s) in Nominal state, 0 in Low state and 0 in Wait state 12:11 - Actual voltage is between 944.89 V and 1166.93 V. 12:11 - Low voltages range between 100.00 V and 100.00 V. 12:11 - Reference voltages range between 945.26 V and 1167.15 V. 12:11 - Maximum difference between expected and actual voltages is 0.72 V 12:11 - Maximum of current limits is 5647.07 uA 12:11 - Checking status of HVPA module in 61 drawer(s)... 12:11 - Checking status of HVPA channels in 61 drawer(s)... 12:11 - HV is stabilized in all channels. 12:11 - Checking reference and low voltages against /local/home/cta_test_bench/config/2019/20190401/config_61modules_cameraqm_l1a+l0delays_nd.NMC.xml 12:11 - Done 12:11 - Finished task "Check high voltages" 12:13 - Starting task "Switch HVPA voltage state" 12:13 - Setting HVPA current limit to 12489.75 uA 12:13 - Setting HVPA ramp speed to 500 V/s 12:13 - Switching HVPA to state Low 12:13 - Setting HVPA current limits... 12:14 - Finished task "Switch HVPA voltage state" 12:14 - Starting task "Check high voltages" 12:14 - Found 0 drawer(s) in Nominal state, 61 in Low state and 0 in Wait state 12:15 - Actual voltage is between 157.38 V and 187.88 V. 12:15 - Low voltages range between 100.00 V and 100.00 V. 12:15 - Reference voltages range between 945.26 V and 1167.15 V. 12:15 - Maximum difference between expected and actual voltages is 76.90 V 12:15 - Maximum of current limits is 5647.07 uA 12:15 - Checking status of HVPA module in 61 drawer(s)... 12:15 - Checking status of HVPA channels in 61 drawer(s)... 12:15 - HV is locked in 0 channel(s), was in rise default in 0 channel(s) and was still in progress in 427 channel(s) 12:15 - Checking reference and low voltages against /local/home/cta_test_bench/config/2019/20190401/config_61modules_cameraqm_l1a+l0delays_nd.NMC.xml 12:15 - Done 12:15 - Finished task "Check high voltages" 12:15 - Starting task "Check high voltages" 12:15 - Found 0 drawer(s) in Nominal state, 61 in Low state and 0 in Wait state 12:16 - Actual voltage is between 130.54 V and 153.72 V. 12:16 - Low voltages range between 100.00 V and 100.00 V. 12:16 - Reference voltages range between 945.26 V and 1167.15 V. 12:16 - Maximum difference between expected and actual voltages is 45.79 V 12:16 - Maximum of current limits is 5647.07 uA 12:16 - Checking status of HVPA module in 61 drawer(s)... 12:16 - Checking status of HVPA channels in 61 drawer(s)... 12:16 - HV is locked in 0 channel(s), was in rise default in 0 channel(s) and was still in progress in 427 channel(s) 12:16 - Checking reference and low voltages against /local/home/cta_test_bench/config/2019/20190401/config_61modules_cameraqm_l1a+l0delays_nd.NMC.xml 12:16 - Done 12:16 - Finished task "Check high voltages" 12:19 - Starting task "Check high voltages" 12:19 - Found 0 drawer(s) in Nominal state, 61 in Low state and 0 in Wait state 12:19 - Actual voltage is between 82.35 V and 100.65 V. 12:19 - Low voltages range between 100.00 V and 100.00 V. 12:19 - Reference voltages range between 0.00 V and 1167.15 V. 12:19 - Maximum difference between expected and actual voltages is 22.53 V 12:19 - Maximum of current limits is 5647.07 uA 12:19 - Checking status of HVPA module in 61 drawer(s)... 12:19 - HVPA module in drawer 118 has a status of 0x77! 12:19 - Checking status of HVPA channels in 61 drawer(s)... 12:19 - HVPA channel 3 of drawer 118 has status 0x8003! 12:19 - HV is locked in 1 channel(s), was in rise default in 0 channel(s) and was still in progress in 0 channel(s) 12:19 - Resetting 1 channel(s)... 12:19 - Resetting HVPA channel 3 of drawer 118... 12:19 - Checking reference and low voltages against /local/home/cta_test_bench/config/2019/20190401/config_61modules_cameraqm_l1a+l0delays_nd.NMC.xml 12:19 - Done 12:19 - Finished task "Check high voltages" 12:21 - Starting task "Check high voltages" 12:21 - Found 0 drawer(s) in Nominal state, 61 in Low state and 0 in Wait state 12:21 - Actual voltage is between 99.43 V and 100.65 V. 12:21 - Low voltages range between 100.00 V and 100.00 V. 12:21 - Reference voltages range between 945.26 V and 1167.15 V. 12:22 - Maximum difference between expected and actual voltages is 0.65 V 12:22 - Maximum of current limits is 5647.07 uA 12:22 - Checking status of HVPA module in 61 drawer(s)... 12:22 - Checking status of HVPA channels in 61 drawer(s)... 12:22 - HV is stabilized in all channels. 12:22 - Checking reference and low voltages against /local/home/cta_test_bench/config/2019/20190401/config_61modules_cameraqm_l1a+l0delays_nd.NMC.xml 12:22 - Done 12:22 - Finished task "Check high voltages"