22:50 - ECC is in state EccState.Ready with status EccStatus.NoError 22:50 - Average temperature: 18.8 deg C 22:50 - Air temperature (T1-T6 and T9-T10): 20.1, 17.5, 18.9, 18.5, 19.1, 20.5, 20.0, 19.8 deg C 22:50 - Air differential pressure: 0.9 Pa 22:50 - Water temperature (T11-T12): 20.1, 20.0 deg C 22:50 - Back doors are closed. 22:50 - Shutter is in state PartiallyOpen (error 0) 22:50 - Light sensors: [0.01, 0.01, 0.0, 5.83] V 22:50 - Humidity: 65.6 %. Water pressure: [7.08, 8.78] bar. 22:50 - Fan speeds: [0.0, 0.0, 2280.0, 2280.0, 0.0, 0.0] rpm 22:50 - 24 V power supply no. 1 is enabled with a current of 2.480 A. 22:50 - Starting task "Powering modules..." 22:50 - Executing command '/opt/cta/bin/cta_ctrl --slot 1 --all --power_on' on Digital Trigger Crate at 10.10.4.57 22:51 - Executing command '/opt/cta/bin/cta_ctrl --slot 5 --all --power_on' on Digital Trigger Crate at 10.10.4.57 22:51 - Executing command '/opt/cta/bin/cta_ctrl --slot 9 --all --power_on' on Digital Trigger Crate at 10.10.4.57 22:51 - Executing command '/opt/cta/bin/cta_ctrl --slot 15 --all --power_on' on Digital Trigger Crate at 10.10.4.57 22:51 - Executing command '/opt/cta/bin/cta_ctrl --slot 19 --all --power_on' on Digital Trigger Crate at 10.10.4.57 22:51 - Finished task "Powering modules..." 22:51 - ECC is in state EccState.Ready with status EccStatus.NoError 22:51 - Average temperature: 18.8 deg C 22:51 - Air temperature (T1-T6 and T9-T10): 20.1, 17.6, 18.9, 18.5, 19.1, 20.5, 20.0, 19.8 deg C 22:51 - Air differential pressure: 1.0 Pa 22:51 - Water temperature (T11-T12): 20.1, 20.1 deg C 22:51 - Back doors are closed. 22:51 - Shutter is in state PartiallyOpen (error 0) 22:51 - Light sensors: [0.01, 0.01, 0.0, 5.83] V 22:51 - Humidity: 65.7 %. Water pressure: [7.08, 8.78] bar. 22:51 - Fan speeds: [0.0, 0.0, 2400.0, 2400.0, 0.0, 0.0] rpm 22:51 - 24 V power supply no. 1 is enabled with a current of 58.700 A. 22:51 - Scanning interface p4p1 for non configured modules... 22:51 - Found 61 MAC address(es) 22:51 - Starting task "Configure modules" 22:51 - Configuring modules with configuration /local/home/cta_test_bench/config/2019/20190519/config_61modules_cameraqm_moduleSwap3.NMC.xml 22:51 - Switching off high voltages in configuration 22:51 - Successfully configured 61 module(s) 22:52 - NMC is in state NmcState.Configured and knows of 61 drawer(s) 22:52 - Found 0 PPS errors. 22:52 - Finished task "Configure modules" 22:54 - Resetting TIB... 22:54 - Failed to call Reset: Bad statuses are present 22:54 - Starting task "Switch HVPA voltage state" 22:54 - Setting HVPA current limit to 12489.75 uA 22:54 - Setting HVPA ramp speed to 500 V/s 22:54 - Switching HVPA to state Low 22:54 - Setting HVPA current limits... 22:55 - Finished task "Switch HVPA voltage state" 22:55 - Starting task "Check high voltages" 22:55 - Found 0 drawer(s) in Nominal state, 61 in Low state and 0 in Wait state 22:55 - Actual voltage is between 21.35 V and 281.82 V. 22:55 - Low voltages range between 100.00 V and 100.00 V. 22:55 - Reference voltages range between 0.00 V and 1167.15 V. 22:55 - Maximum difference between expected and actual voltages is 87.19 V 22:56 - Maximum of current limits is 5647.07 uA 22:56 - Checking status of HVPA module in 61 drawer(s)... 22:56 - HVPA module in drawer 80 has a status of 0x3f! 22:56 - HVPA module in drawer 83 has a status of 0x77! 22:56 - HVPA module in drawer 94 has a status of 0x7b! 22:56 - HVPA module in drawer 99 has a status of 0x3f! 22:56 - HVPA module in drawer 111 has a status of 0x7d! 22:56 - HVPA module in drawer 113 has a status of 0x77! 22:56 - HVPA module in drawer 128 has a status of 0x3f! 22:56 - HVPA module in drawer 134 has a status of 0x7b! 22:56 - HVPA module in drawer 153 has a status of 0x7e! 22:56 - Checking status of HVPA channels in 61 drawer(s)... 22:56 - HVPA channel 0 of drawer 153 has status 0x8003! 22:56 - HVPA channel 1 of drawer 111 has status 0x8003! 22:56 - HVPA channel 2 of drawer 94 has status 0x8003! 22:56 - HVPA channel 2 of drawer 134 has status 0x8003! 22:56 - HVPA channel 3 of drawer 83 has status 0x8003! 22:56 - HVPA channel 3 of drawer 113 has status 0x8003! 22:56 - HVPA channel 6 of drawer 80 has status 0x8003! 22:56 - HVPA channel 6 of drawer 99 has status 0x8003! 22:56 - HVPA channel 6 of drawer 128 has status 0x8003! 22:56 - HV is locked in 9 channel(s), was in rise default in 0 channel(s) and was still in progress in 1 channel(s) 22:56 - Resetting 9 channel(s)... 22:56 - Resetting HVPA channel 0 of drawer 153... 22:56 - Resetting HVPA channel 1 of drawer 111... 22:56 - Resetting HVPA channel 2 of drawer 94... 22:56 - Resetting HVPA channel 2 of drawer 134... 22:56 - Resetting HVPA channel 3 of drawer 83... 22:56 - Resetting HVPA channel 3 of drawer 113... 22:56 - Resetting HVPA channel 6 of drawer 80... 22:56 - Resetting HVPA channel 6 of drawer 99... 22:56 - Resetting HVPA channel 6 of drawer 128... 22:56 - Checking reference and low voltages against /local/home/cta_test_bench/config/2019/20190519/config_61modules_cameraqm_moduleSwap3.NMC.xml 22:56 - Done 22:56 - Finished task "Check high voltages" 22:56 - Starting task "Check high voltages" 22:56 - Found 0 drawer(s) in Nominal state, 61 in Low state and 0 in Wait state 22:56 - Actual voltage is between 99.43 V and 100.65 V. 22:56 - Low voltages range between 100.00 V and 100.00 V. 22:56 - Reference voltages range between 945.26 V and 1167.15 V. 22:57 - Maximum difference between expected and actual voltages is 0.65 V 22:57 - Maximum of current limits is 5647.07 uA 22:57 - Checking status of HVPA module in 61 drawer(s)... 22:57 - Checking status of HVPA channels in 61 drawer(s)... 22:57 - HV is stabilized in all channels. 22:57 - Checking reference and low voltages against /local/home/cta_test_bench/config/2019/20190519/config_61modules_cameraqm_moduleSwap3.NMC.xml 22:57 - Done 22:57 - Finished task "Check high voltages" 22:57 - Starting task "Switch HVPA voltage state" 22:57 - Setting HVPA current limit to 12489.75 uA 22:57 - Setting HVPA ramp speed to 35 V/s 22:57 - Switching HVPA to state Nominal 22:58 - Setting HVPA current limits... 22:58 - ECC is in state EccState.Ready with status EccStatus.NoError 22:58 - Average temperature: 19.0 deg C 22:58 - Air temperature (T1-T6 and T9-T10): 20.4, 17.7, 19.0, 18.9, 19.6, 21.0, 20.1, 20.0 deg C 22:58 - Air differential pressure: 0.8 Pa 22:58 - Water temperature (T11-T12): 20.3, 20.2 deg C 22:58 - Back doors are closed. 22:58 - Shutter is in state PartiallyOpen (error 0) 22:58 - Light sensors: [0.01, 0.01, 0.0, 5.87] V 22:58 - Humidity: 64.7 %. Water pressure: [2.9, 4.52] bar. 22:58 - Fan speeds: [0.0, 0.0, 2400.0, 2400.0, 0.0, 0.0] rpm 22:58 - 24 V power supply no. 1 is enabled with a current of 58.300 A. 22:58 - Finished task "Switch HVPA voltage state" 22:58 - Starting task "Check high voltages" 22:58 - Found 61 drawer(s) in Nominal state, 0 in Low state and 0 in Wait state 22:58 - High voltage locked channels will be checked every 30 s 22:58 - Actual voltage is between 945.50 V and 1167.54 V. 22:58 - Low voltages range between 100.00 V and 100.00 V. 22:58 - Reference voltages range between 945.26 V and 1167.15 V. 22:59 - Maximum difference between expected and actual voltages is 0.70 V 22:59 - Checking for high voltage locked pixels... 22:59 - Maximum of current limits is 5647.07 uA 22:59 - Checking status of HVPA module in 61 drawer(s)... 22:59 - Checking status of HVPA channels in 61 drawer(s)... 22:59 - Starting NMC 22:59 - Clearing PPS error counters 22:59 - HV is stabilized in all channels. 22:59 - Checking reference and low voltages against /local/home/cta_test_bench/config/2019/20190519/config_61modules_cameraqm_moduleSwap3.NMC.xml 22:59 - Done 22:59 - Finished task "Check high voltages" 22:59 - Checking for high voltage locked pixels... 22:59 - Configuring UCTS 22:59 - Configuring TIB... 22:59 - Setting TIB forced mode to False 22:59 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v 22:59 - Status: TibState.RunStopped 22:59 - Alarms: AlarmVector.NoAlarm 22:59 - Connection status: False 22:59 - Disabling PPS 22:59 - Status: TibState.PpsStopped 22:59 - Alarms: AlarmVector.NoAlarm 22:59 - Connection status: False 22:59 - Entering set_external_delay 22:59 - Setting ExternalDelayLocal to 0.000 ns 22:59 - Writing 0.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v 22:59 - Entering set_external_delay 22:59 - Setting ExternalDelayCalibration to 78.000 ns 22:59 - Writing 78.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v 22:59 - Entering set_external_delay 22:59 - Setting ExternalDelaySphe to 150.000 ns 22:59 - Writing 150.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v 22:59 - Setting TIB trigger mode to 0x70 = TriggerMask.SlowControl|Pedestal|Software 22:59 - Writing 112 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v 22:59 - Writing 0 to Camera.TIB.InputsEnable.InputMask.InputMask_v 22:59 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v 22:59 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v 22:59 - Writing False to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v 22:59 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v 22:59 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v 22:59 - Status: TibState.PpsStopped 22:59 - Alarms: AlarmVector.NoAlarm 22:59 - Connection status: False 22:59 - Writing True to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v 22:59 - Writing 1000 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v 22:59 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 22:59 - Writing False to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v 22:59 - Writing 1000 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v 22:59 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v 22:59 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 22:59 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v 22:59 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v 22:59 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 23:00 - Checking for high voltage locked pixels... 23:00 - Connecting TIB to camera server at 10.10.4.12:222 23:00 - Starting TIB... 23:00 - Status: TibState.PpsStopped 23:00 - Alarms: AlarmVector.NoAlarm 23:00 - Connection status: False 23:00 - Resetting run 23:00 - Wait for UCTS external trigger before enabling trigger... 23:00 - Status: TibState.Standby 23:00 - Alarms: AlarmVector.NoAlarm 23:00 - Connection status: False 23:00 - Status: TibState.Standby 23:00 - Alarms: AlarmVector.NoAlarm 23:00 - Connection status: False 23:00 - Status: TibState.Armed 23:00 - Alarms: AlarmVector.NoAlarm 23:00 - Connection status: True 23:00 - Checking for high voltage locked pixels... 23:00 - Starting TIB triggers... 23:00 - Enabling trigger 23:00 - Status: TibState.Running 23:00 - Alarms: AlarmVector.NoAlarm 23:00 - Connection status: True 23:00 - Status: TibState.Running ConnectionStatus: True 23:00 - Alarms: AlarmVector.ReadError 23:00 - Temperature: 36.25 23:00 - Local camera rate: 0.0 Hz 23:00 - Stereo trigger rate: 0.0 Hz 23:00 - SPE trigger rate: 0.0 Hz 23:00 - Calibration trigger rate: 0.0 Hz 23:00 - Software trigger rate: 0.0 Hz 23:00 - Pedestal trigger rate: 1000.0 Hz 23:00 - Collected trigger rate: 1000.0 Hz 23:00 - Busy rate: 0.0 Hz 23:00 - Camera trigger rate: 1000.0 Hz 23:01 - Checking for high voltage locked pixels... 23:01 - Stopping TIB... 23:01 - Status: TibState.Running 23:01 - Alarms: AlarmVector.ReadError 23:01 - Connection status: True 23:01 - Disabling trigger 23:01 - Disabling PPS 23:01 - Status: TibState.PpsStopped 23:01 - Alarms: AlarmVector.ReadError 23:01 - Connection status: True 23:01 - Closing TIB connection to camera server 23:01 - Status: TibState.PpsStopped 23:01 - Alarms: AlarmVector.ReadError 23:01 - Connection status: False 23:01 - Run duration: 0:00:39 23:01 - Local camera triggers: 0 23:01 - Slow control triggers: 0 23:01 - Single photo-electron triggers: 0 23:01 - Calibration triggers: 0 23:01 - Software triggers from UCTS: 0 23:01 - Pedestal triggers: 38772 23:01 - Collected input triggers: 29970 23:01 - Busy triggers: 0 23:01 - Camera event triggers sent to clusters: 29970