10:33 - Configuring calibration box...
10:33 - Configuring calibration box with leds=0x1fff voltage=16.00 frequency=1000.0/1 central_current=0.0 duration=0 width=1 lemo_out=True fiber1_out=True fiber2_out=True lemo_in=True enabled=True
10:33 - Starting flashes...
10:33 - Configuring calibration box...
10:33 - Configuring calibration box with leds=0x1fff voltage=16.00 frequency=1000.0/1 central_current=0.0 duration=0 width=1 lemo_out=True fiber1_out=True fiber2_out=True lemo_in=True enabled=True
10:33 - ECC is in state EccState.Ready with status EccStatus.NoError
10:33 - Average temperature: 28.9 deg C
10:33 - Air temperature (T1-T6 and T9-T10): 30.0, 28.1, 29.0, 28.7, 28.7, 28.9, 29.1, 29.3 deg C
10:33 - Air differential pressure: 1.6 Pa
10:33 - Water temperature (T11-T12): 29.5, 29.5 deg C
10:33 - Back doors are open.
10:33 - Shutter is in state Open (error 0)
10:33 - Light sensors: [0.01, 0.01, 0.01, 6.91] V
10:33 - Humidity: 35.3 %. Water pressure: [0.1, 0.1] bar.
10:33 - Fan speeds: [0.0, 0.0, 2400.0, 2280.0, 0.0, 0.0] rpm
10:33 - 24 V power supply no. 1 is enabled with a current of 2.190 A.
10:33 - Starting task "Powering modules..."
10:33 - Executing command '/opt/cta/bin/cta_ctrl --slot 1 --all --power_on' on Digital Trigger Crate at 10.10.4.57
10:33 - Executing command '/opt/cta/bin/cta_ctrl --slot 5 --all --power_on' on Digital Trigger Crate at 10.10.4.57
10:33 - Executing command '/opt/cta/bin/cta_ctrl --slot 9 --all --power_on' on Digital Trigger Crate at 10.10.4.57
10:33 - Executing command '/opt/cta/bin/cta_ctrl --slot 15 --all --power_on' on Digital Trigger Crate at 10.10.4.57
10:34 - Executing command '/opt/cta/bin/cta_ctrl --slot 19 --all --power_on' on Digital Trigger Crate at 10.10.4.57
10:34 - Finished task "Powering modules..."
10:34 - ECC is in state EccState.Ready with status EccStatus.NoError
10:34 - Average temperature: 29.0 deg C
10:34 - Air temperature (T1-T6 and T9-T10): 30.0, 28.1, 29.0, 28.7, 28.7, 28.9, 29.1, 29.3 deg C
10:34 - Air differential pressure: 1.6 Pa
10:34 - Water temperature (T11-T12): 29.5, 29.5 deg C
10:34 - Back doors are open.
10:34 - Shutter is in state Open (error 0)
10:34 - Light sensors: [0.01, 0.01, 0.01, 6.91] V
10:34 - Humidity: 35.2 %. Water pressure: [0.1, 0.1] bar.
10:34 - Fan speeds: [0.0, 0.0, 2520.0, 2400.0, 0.0, 0.0] rpm
10:34 - 24 V power supply no. 1 is enabled with a current of 58.800 A.
10:34 - Scanning interface p4p1 for non configured modules...
10:34 - Found 17 MAC address(es)
10:34 - Scanning interface p4p1 for non configured modules...
10:34 - Found 61 MAC address(es)
10:34 - Starting task "Configure modules"
10:34 - Configuring modules with configuration /local/home/cta_test_bench/config/2019/20190620/config_2019-06-20_00-31-56.NMC.xml
10:34 - Switching off high voltages in configuration
10:34 - Successfully configured 61 module(s)
10:34 - NMC is in state NmcState.Configured and knows of 61 drawer(s)
10:35 - Found 0 PPS errors.
10:35 - Finished task "Configure modules"
10:35 - Starting task "Switch HVPA voltage state"
10:35 - Setting HVPA current limit to 12489.75 uA
10:35 - Setting HVPA ramp speed to 25 V/s
10:35 - Switching HVPA to state Nominal
10:35 - Setting HVPA current limits...
10:36 - Finished task "Switch HVPA voltage state"
10:36 - Starting task "Set L0 trigger thresholds"
10:36 - Setting L0 thresholds to 10.0 p.e.
10:36 - High voltage locked channels will be checked every 30 s
10:37 - Setting L0 thresholds to 10.0 p.e. per pixel using L0 slopes and offsets in /local/home/cta_test_bench/data/2019/20190328/l0_threshold_slope_and_offset.h5
10:37 - Thresholds saved in configuration file /local/home/cta_test_bench/config/2019/20190717/config_2019-07-17_10-37-11.NMC.xml
10:37 - Finished task "Set L0 trigger thresholds"
10:37 - Starting task "Check high voltages"
10:37 - Found 61 drawer(s) in Nominal state, 0 in Low state and 0 in Wait state
10:37 - Checking for high voltage locked pixels...
10:37 - Module 66 has 1 pixel(s) locked (HVPA status of 0x7e)!
10:37 - Module 83 has 1 pixel(s) locked (HVPA status of 0x77)!
10:37 - Module 94 has 1 pixel(s) locked (HVPA status of 0x7b)!
10:37 - Module 111 has 1 pixel(s) locked (HVPA status of 0x7d)!
10:37 - Module 128 has 1 pixel(s) locked (HVPA status of 0x3f)!
10:37 - Unlocking 5 channel(s)...
10:37 - Resetting HVPA channel 0 of drawer 66...
10:37 - Resetting HVPA channel 3 of drawer 83...
10:37 - Resetting HVPA channel 2 of drawer 94...
10:37 - Resetting HVPA channel 1 of drawer 111...
10:37 - Resetting HVPA channel 6 of drawer 128...
10:37 - Actual voltage is between 9.15 V and 1167.54 V.
10:37 - Low voltages range between 100.00 V and 100.00 V. 
10:37 - Reference voltages range between 945.26 V and 1167.15 V. 
10:37 - Maximum difference between expected and actual voltages is 449.08 V
10:37 - Checking for high voltage locked pixels...
10:38 - Maximum of current limits is 5647.07 uA
10:38 - Checking status of HVPA module in 61 drawer(s)...
10:38 - Checking status of HVPA channels in 61 drawer(s)...
10:38 - HV is locked in 0 channel(s), was in rise default in 0 channel(s) and was still in progress in 2 channel(s)
10:38 - Checking reference and low voltages against /local/home/cta_test_bench/config/2019/20190620/config_2019-06-20_00-31-56.NMC.xml
10:38 - Done
10:38 - Finished task "Check high voltages"
10:38 - Starting task "Check high voltages"
10:38 - Found 61 drawer(s) in Nominal state, 0 in Low state and 0 in Wait state
10:38 - Checking for high voltage locked pixels...
10:38 - Actual voltage is between 945.50 V and 1167.54 V.
10:38 - Low voltages range between 100.00 V and 100.00 V. 
10:38 - Reference voltages range between 945.26 V and 1167.15 V. 
10:38 - Maximum difference between expected and actual voltages is 7.57 V
10:38 - Maximum of current limits is 5647.07 uA
10:38 - Checking status of HVPA module in 61 drawer(s)...
10:38 - Checking status of HVPA channels in 61 drawer(s)...
10:38 - Checking for high voltage locked pixels...
10:39 - HV is stabilized in all channels.
10:39 - Checking reference and low voltages against /local/home/cta_test_bench/config/2019/20190620/config_2019-06-20_00-31-56.NMC.xml
10:39 - Done
10:39 - Finished task "Check high voltages"
10:39 - Starting NMC
10:39 - Clearing PPS error counters
10:39 - Configuring UCTS
10:39 - Configuring TIB...
10:39 - Setting TIB forced mode to False
10:39 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v
10:39 - Status: TibState.PpsStopped
10:39 - Alarms: AlarmVector.ReadError
10:39 - Connection status: False
10:39 - Entering set_external_delay
10:39 - Setting ExternalDelayLocal to 0.000 ns
10:39 - Writing 0.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v
10:39 - Entering set_external_delay
10:39 - Setting ExternalDelayCalibration to 78.000 ns
10:39 - Writing 78.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v
10:39 - Entering set_external_delay
10:39 - Setting ExternalDelaySphe to 150.000 ns
10:39 - Writing 150.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v
10:39 - Setting TIB trigger mode to 0x51 = TriggerMask.SlowControl|Software|Mono
10:39 - Writing 81 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v
10:39 - Writing 0 to Camera.TIB.InputsEnable.InputMask.InputMask_v
10:39 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v
10:39 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v
10:39 - Writing False to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v
10:39 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v
10:39 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v
10:39 - Status: TibState.PpsStopped
10:39 - Alarms: AlarmVector.ReadError
10:39 - Connection status: False
10:39 - Writing False to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v
10:39 - Writing 5000 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v
10:39 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
10:39 - Writing False to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v
10:39 - Writing 5000 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v
10:39 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v
10:39 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
10:39 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v
10:39 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v
10:39 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
10:39 - Checking for high voltage locked pixels...
10:39 - Connecting TIB to camera server at 10.10.4.12:222
10:39 - Starting TIB...
10:39 - Status: TibState.PpsStopped
10:39 - Alarms: AlarmVector.ReadError
10:39 - Connection status: False
10:39 - Resetting run
10:39 - Wait for UCTS external trigger before enabling trigger...
10:39 - Status: TibState.Standby
10:39 - Alarms: AlarmVector.NoAlarm
10:39 - Connection status: False
10:39 - Status: TibState.Standby
10:39 - Alarms: AlarmVector.NoAlarm
10:39 - Connection status: False
10:39 - Status: TibState.Armed
10:39 - Alarms: AlarmVector.NoAlarm
10:39 - Connection status: True
10:39 - Starting TIB triggers...
10:39 - Enabling trigger
10:39 - Status: TibState.Running
10:39 - Alarms: AlarmVector.NoAlarm
10:39 - Connection status: True
10:39 - Status: TibState.Running ConnectionStatus: True
10:39 - Alarms: AlarmVector.ReadError
10:39 - Temperature: 44.69
10:39 - Local camera rate: 0.0 Hz
10:39 - Stereo trigger rate: 0.0 Hz
10:39 - SPE trigger rate: 0.0 Hz
10:39 - Calibration trigger rate: 2002.0 Hz
10:39 - Software trigger rate: 0.0 Hz
10:39 - Pedestal trigger rate: 0.0 Hz
10:39 - Collected trigger rate: 1965.0 Hz
10:39 - Busy rate: 21.0 Hz
10:39 - Camera trigger rate: 1944.0 Hz
10:39 - Status: TibState.Running ConnectionStatus: True
10:39 - Alarms: AlarmVector.ReadError
10:39 - Temperature: 44.69
10:39 - Local camera rate: 0.0 Hz
10:39 - Stereo trigger rate: 0.0 Hz
10:39 - SPE trigger rate: 0.0 Hz
10:39 - Calibration trigger rate: 2013.0 Hz
10:39 - Software trigger rate: 0.0 Hz
10:39 - Pedestal trigger rate: 0.0 Hz
10:39 - Collected trigger rate: 1949.0 Hz
10:39 - Busy rate: 21.0 Hz
10:39 - Camera trigger rate: 1928.0 Hz
10:39 - Checking for high voltage locked pixels...
10:40 - Stopping TIB...
10:40 - Status: TibState.Running
10:40 - Alarms: AlarmVector.ReadError
10:40 - Connection status: True
10:40 - Disabling trigger
10:40 - Disabling PPS
10:40 - Status: TibState.PpsStopped
10:40 - Alarms: AlarmVector.ReadError
10:40 - Connection status: True
10:40 - Closing TIB connection to camera server
10:40 - Checking for high voltage locked pixels...
10:40 - Starting task "Set DTC trigger masks"
10:40 - Confuguring DTC trigger masks for 61 configured module(s)
10:40 - Setting DTC slot 1 trigger mask to 0x1fbe
10:40 - Setting DTC slot 5 trigger mask to 0xfffe
10:40 - Setting DTC slot 9 trigger mask to 0x03fe
10:40 - Setting DTC slot 15 trigger mask to 0xfffe
10:40 - Setting DTC slot 19 trigger mask to 0x1fbe
10:40 - Checking for high voltage locked pixels...
10:41 - Finished task "Set DTC trigger masks"
10:41 - Checking for high voltage locked pixels...
10:41 - Configuring calibration box...
10:41 - Configuring calibration box with leds=0x1fff voltage=16.00 frequency=1000.0/1 central_current=0.0 duration=0 width=1 lemo_out=False fiber1_out=False fiber2_out=False lemo_in=True enabled=True
10:41 - Stopping NMC
10:41 - Found 0 PPS errors.
10:41 - Starting NMC
10:41 - Clearing PPS error counters
10:41 - Checking for high voltage locked pixels...
10:42 - Checking for high voltage locked pixels...
10:42 - Checking for high voltage locked pixels...
10:43 - Checking for high voltage locked pixels...
10:43 - Checking for high voltage locked pixels...
10:44 - Configuring UCTS
10:44 - Configuring TIB...
10:44 - Setting TIB forced mode to False
10:44 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v
10:44 - Status: TibState.PpsStopped
10:44 - Alarms: AlarmVector.ReadError
10:44 - Connection status: False
10:44 - Entering set_external_delay
10:44 - Setting ExternalDelayLocal to 0.000 ns
10:44 - Writing 0.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v
10:44 - Entering set_external_delay
10:44 - Setting ExternalDelayCalibration to 78.000 ns
10:44 - Writing 78.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v
10:44 - Entering set_external_delay
10:44 - Setting ExternalDelaySphe to 150.000 ns
10:44 - Writing 150.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v
10:44 - Setting TIB trigger mode to 0x51 = TriggerMask.SlowControl|Software|Mono
10:44 - Writing 81 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v
10:44 - Writing 0 to Camera.TIB.InputsEnable.InputMask.InputMask_v
10:44 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v
10:44 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v
10:44 - Writing False to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v
10:44 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v
10:44 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v
10:44 - Status: TibState.PpsStopped
10:44 - Alarms: AlarmVector.ReadError
10:44 - Connection status: False
10:44 - Writing False to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v
10:44 - Writing 5000 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v
10:44 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
10:44 - Writing False to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v
10:44 - Writing 5000 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v
10:44 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v
10:44 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
10:44 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v
10:44 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v
10:44 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
10:44 - Connecting TIB to camera server at 10.10.4.12:222
10:44 - Starting TIB...
10:44 - Status: TibState.PpsStopped
10:44 - Alarms: AlarmVector.ReadError
10:44 - Connection status: False
10:44 - Resetting run
10:44 - Wait for UCTS external trigger before enabling trigger...
10:44 - Status: TibState.Standby
10:44 - Alarms: AlarmVector.NoAlarm
10:44 - Connection status: False
10:44 - Status: TibState.Standby
10:44 - Alarms: AlarmVector.NoAlarm
10:44 - Connection status: False
10:44 - Status: TibState.Armed
10:44 - Alarms: AlarmVector.NoAlarm
10:44 - Connection status: True
10:44 - Starting TIB triggers...
10:44 - Enabling trigger
10:44 - Status: TibState.Running
10:44 - Alarms: AlarmVector.NoAlarm
10:44 - Connection status: True
10:44 - Status: TibState.Running ConnectionStatus: True
10:44 - Alarms: AlarmVector.ReadError
10:44 - Temperature: 44.88
10:44 - Local camera rate: 0.0 Hz
10:44 - Stereo trigger rate: 0.0 Hz
10:44 - SPE trigger rate: 0.0 Hz
10:44 - Calibration trigger rate: 0.0 Hz
10:44 - Software trigger rate: 0.0 Hz
10:44 - Pedestal trigger rate: 0.0 Hz
10:44 - Collected trigger rate: 1921.0 Hz
10:44 - Busy rate: 16.0 Hz
10:44 - Camera trigger rate: 1905.0 Hz
10:44 - Status: TibState.Running ConnectionStatus: True
10:44 - Alarms: AlarmVector.ReadError
10:44 - Temperature: 44.94
10:44 - Local camera rate: 0.0 Hz
10:44 - Stereo trigger rate: 0.0 Hz
10:44 - SPE trigger rate: 0.0 Hz
10:44 - Calibration trigger rate: 0.0 Hz
10:44 - Software trigger rate: 0.0 Hz
10:44 - Pedestal trigger rate: 0.0 Hz
10:44 - Collected trigger rate: 2054.0 Hz
10:44 - Busy rate: 26.0 Hz
10:44 - Camera trigger rate: 2028.0 Hz
10:44 - Checking for high voltage locked pixels...
10:44 - Status: TibState.Running ConnectionStatus: True
10:44 - Alarms: AlarmVector.ReadError
10:44 - Temperature: 44.88
10:44 - Local camera rate: 0.0 Hz
10:44 - Stereo trigger rate: 0.0 Hz
10:44 - SPE trigger rate: 0.0 Hz
10:44 - Calibration trigger rate: 0.0 Hz
10:44 - Software trigger rate: 0.0 Hz
10:44 - Pedestal trigger rate: 0.0 Hz
10:44 - Collected trigger rate: 1973.0 Hz
10:44 - Busy rate: 21.0 Hz
10:44 - Camera trigger rate: 1952.0 Hz
10:44 - Status: TibState.Running ConnectionStatus: True
10:44 - Alarms: AlarmVector.ReadError
10:44 - Temperature: 44.88
10:44 - Local camera rate: 0.0 Hz
10:44 - Stereo trigger rate: 0.0 Hz
10:44 - SPE trigger rate: 0.0 Hz
10:44 - Calibration trigger rate: 0.0 Hz
10:44 - Software trigger rate: 0.0 Hz
10:44 - Pedestal trigger rate: 0.0 Hz
10:44 - Collected trigger rate: 2076.0 Hz
10:44 - Busy rate: 20.0 Hz
10:44 - Camera trigger rate: 2056.0 Hz
10:44 - Checking for high voltage locked pixels...
10:45 - Stopping TIB...
10:45 - Status: TibState.Running
10:45 - Alarms: AlarmVector.ReadError
10:45 - Connection status: True
10:45 - Disabling trigger
10:45 - Disabling PPS
10:45 - Status: TibState.PpsStopped
10:45 - Alarms: AlarmVector.ReadError
10:45 - Connection status: True
10:45 - Closing TIB connection to camera server
10:45 - Status: TibState.PpsStopped
10:45 - Alarms: AlarmVector.ReadError
10:45 - Connection status: False
10:45 - Run duration: 0:00:53
10:45 - Local camera triggers: 0
10:45 - Slow control triggers: 0
10:45 - Single photo-electron triggers: 0
10:45 - Calibration triggers: 0
10:45 - Software triggers from UCTS: 0
10:45 - Pedestal triggers: 0
10:45 - Collected input triggers: 103377
10:45 - Busy triggers: 1261
10:45 - Camera event triggers sent to clusters: 102116
10:45 - Checking for high voltage locked pixels...