17:01 - Resetting NMC
17:01 - Starting task "Configure modules"
17:01 - Setting L0 thresholds to 30.0 p.e. per pixel using L0 slopes and offsets in /local/home/cta_test_bench/data/2019/20190328/l0_threshold_slope_and_offset.h5
17:01 - Configuring modules with configuration /local/home/cta_test_bench/config/2019/20190801/config_2019-08-01_17-01-43.NMC.xml
17:01 - Switching off high voltages in configuration
17:01 - Successfully configured 61 module(s)
17:01 - NMC is in state NmcState.Configured and knows of 61 drawer(s)
17:01 - Found PPS errors: 255 in drawer 128, 255 in drawer 129, 255 in drawer 130, 255 in drawer 131, 255 in drawer 132, 255 in drawer 133, 255 in drawer 134, 255 in drawer 135, 255 in drawer 136
17:01 - Finished task "Configure modules"
17:02 - Starting task "Switch HVPA voltage state"
17:02 - Setting HVPA current limit to 12489.75 uA
17:02 - Setting HVPA ramp speed to 25 V/s
17:02 - Switching HVPA to state Nominal
17:02 - Setting HVPA current limits...
17:03 - Finished task "Switch HVPA voltage state"
17:03 - High voltage locked channels will be checked every 30 s
17:03 - Starting task "Check high voltages"
17:03 - Found 61 drawer(s) in Nominal state, 0 in Low state and 0 in Wait state
17:03 - Actual voltage is between 21.35 V and 1166.93 V.
17:03 - Low voltages range between 100.00 V and 100.00 V. 
17:03 - Reference voltages range between 0.00 V and 1167.15 V. 
17:03 - Checking for high voltage locked pixels...
17:03 - Module 83 has 1 pixel(s) locked (HVPA status of 0x77)!
17:03 - Module 111 has 1 pixel(s) locked (HVPA status of 0x7d)!
17:03 - Unlocking 2 channel(s)...
17:03 - Resetting HVPA channel 3 of drawer 83...
17:03 - Resetting HVPA channel 1 of drawer 111...
17:03 - Maximum difference between expected and actual voltages is 12.20 V
17:03 - Maximum of current limits is 12489.75 uA
17:03 - Checking status of HVPA module in 61 drawer(s)...
17:03 - Checking status of HVPA channels in 61 drawer(s)...
17:03 - HV is locked in 0 channel(s), was in rise default in 0 channel(s) and was still in progress in 2 channel(s)
17:03 - Checking reference and low voltages against /local/home/cta_test_bench/config/2019/20190801/config_61modules_1of7.NMC.xml
17:04 - Done
17:04 - Finished task "Check high voltages"
17:04 - Starting task "Check high voltages"
17:04 - Checking for high voltage locked pixels...
17:04 - Found 61 drawer(s) in Nominal state, 0 in Low state and 0 in Wait state
17:04 - Actual voltage is between 945.50 V and 1167.54 V.
17:04 - Low voltages range between 100.00 V and 100.00 V. 
17:04 - Reference voltages range between 945.26 V and 1167.15 V. 
17:04 - Checking for high voltage locked pixels...
17:04 - Maximum difference between expected and actual voltages is 0.72 V
17:04 - Maximum of current limits is 5647.07 uA
17:04 - Checking status of HVPA module in 61 drawer(s)...
17:04 - Checking status of HVPA channels in 61 drawer(s)...
17:04 - HV is stabilized in all channels.
17:04 - Checking reference and low voltages against /local/home/cta_test_bench/config/2019/20190801/config_61modules_1of7.NMC.xml
17:04 - Starting NMC
17:04 - Clearing PPS error counters
17:04 - Done
17:04 - Finished task "Check high voltages"
17:05 - Checking for high voltage locked pixels...
17:05 - Configuring UCTS
17:05 - Configuring TIB...
17:05 - Setting TIB forced mode to False
17:05 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v
17:05 - Status: TibState.PpsStopped
17:05 - Alarms: AlarmVector.ReadError
17:05 - Connection status: False
17:05 - Entering set_external_delay
17:05 - Setting ExternalDelayLocal to 0.000 ns
17:05 - Writing 0.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v
17:05 - Entering set_external_delay
17:05 - Setting ExternalDelayCalibration to 50.000 ns
17:05 - Writing 50.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v
17:05 - Entering set_external_delay
17:05 - Setting ExternalDelaySphe to 150.000 ns
17:05 - Writing 150.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v
17:05 - Setting TIB trigger mode to 0x51 = TriggerMask.SlowControl|Software|Mono
17:05 - Writing 81 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v
17:05 - Writing 0 to Camera.TIB.InputsEnable.InputMask.InputMask_v
17:05 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v
17:05 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v
17:05 - Writing False to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v
17:05 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v
17:05 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v
17:05 - Status: TibState.PpsStopped
17:05 - Alarms: AlarmVector.ReadError
17:05 - Connection status: False
17:05 - Writing False to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v
17:05 - Writing 100 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v
17:05 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
17:05 - Writing False to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v
17:05 - Writing 100 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v
17:05 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v
17:05 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
17:05 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v
17:05 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v
17:05 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
17:05 - Connecting TIB to camera server at 10.10.4.12:222
17:05 - Starting TIB...
17:05 - Status: TibState.PpsStopped
17:05 - Alarms: AlarmVector.ReadError
17:05 - Connection status: False
17:05 - Resetting run
17:05 - Wait for UCTS external trigger before enabling trigger...
17:05 - Status: TibState.Standby
17:05 - Alarms: AlarmVector.NoAlarm
17:05 - Connection status: False
17:05 - Status: TibState.Standby
17:05 - Alarms: AlarmVector.NoAlarm
17:05 - Connection status: False
17:05 - Status: TibState.Armed
17:05 - Alarms: AlarmVector.NoAlarm
17:05 - Connection status: True
17:05 - Starting TIB triggers...
17:05 - Enabling trigger
17:05 - Status: TibState.Undefined
17:05 - Alarms: AlarmVector.Undefined
17:05 - Connection status: True
17:05 - Status: TibState.Undefined
17:05 - Alarms: AlarmVector.Undefined
17:05 - Connection status: True
17:05 - External delays: Local=0.000 ns, Calibration=50.000 ns, Sphe=150.000 ns
17:05 - Trigger mask: 0x51 = TriggerMask.SlowControl|Software|Mono
17:05 - Input mask: 0x0
17:05 - Disable BUSY: False
17:05 - Extra BUSY Delay: 0.0
17:05 - Temperature: 40.06
17:05 - Checking for high voltage locked pixels...
17:06 - Checking for high voltage locked pixels...
17:06 - Status: TibState.Undefined
17:06 - Alarms: AlarmVector.Undefined
17:06 - Connection status: True
17:06 - External delays: Local=0.000 ns, Calibration=50.000 ns, Sphe=150.000 ns
17:06 - Trigger mask: 0x51 = TriggerMask.SlowControl|Software|Mono
17:06 - Input mask: 0x0
17:06 - Disable BUSY: False
17:06 - Extra BUSY Delay: 0.0
17:06 - Temperature: 40.06
17:06 - Resetting TIB...
17:06 - Failed to call Reset: Bad statuses are present
17:06 - Configuring UCTS
17:06 - Configuring TIB...
17:06 - Setting TIB forced mode to False
17:06 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v
17:06 - Status: TibState.RunStopped
17:06 - Alarms: AlarmVector.NoAlarm
17:06 - Connection status: False
17:06 - Disabling PPS
17:06 - Status: TibState.PpsStopped
17:06 - Alarms: AlarmVector.NoAlarm
17:06 - Connection status: False
17:06 - Entering set_external_delay
17:06 - Setting ExternalDelayLocal to 0.000 ns
17:06 - Writing 0.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v
17:06 - Entering set_external_delay
17:06 - Setting ExternalDelayCalibration to 50.000 ns
17:06 - Writing 50.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v
17:06 - Entering set_external_delay
17:06 - Setting ExternalDelaySphe to 150.000 ns
17:06 - Writing 150.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v
17:06 - Setting TIB trigger mode to 0x51 = TriggerMask.SlowControl|Software|Mono
17:06 - Writing 81 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v
17:06 - Writing 0 to Camera.TIB.InputsEnable.InputMask.InputMask_v
17:06 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v
17:06 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v
17:06 - Writing False to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v
17:06 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v
17:06 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v
17:06 - Status: TibState.PpsStopped
17:06 - Alarms: AlarmVector.NoAlarm
17:06 - Connection status: False
17:06 - Writing False to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v
17:06 - Writing 100 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v
17:06 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
17:06 - Writing False to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v
17:06 - Writing 100 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v
17:06 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v
17:06 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
17:06 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v
17:06 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v
17:06 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
17:06 - Checking for high voltage locked pixels...
17:06 - Starting task "Check high voltages"
17:06 - Found 61 drawer(s) in Nominal state, 0 in Low state and 0 in Wait state
17:06 - Actual voltage is between 945.50 V and 1166.93 V.
17:06 - Low voltages range between 100.00 V and 100.00 V. 
17:07 - Reference voltages range between 945.26 V and 1167.15 V. 
17:07 - Checking for high voltage locked pixels...
17:07 - Maximum difference between expected and actual voltages is 1.00 V
17:07 - Maximum of current limits is 5647.07 uA
17:07 - Checking status of HVPA module in 61 drawer(s)...
17:07 - Checking status of HVPA channels in 61 drawer(s)...
17:07 - HV is stabilized in all channels.
17:07 - Checking reference and low voltages against /local/home/cta_test_bench/config/2019/20190801/config_61modules_1of7.NMC.xml
17:07 - Connecting TIB to camera server at 10.10.4.12:222
17:07 - Starting TIB...
17:07 - Status: TibState.PpsStopped
17:07 - Alarms: AlarmVector.NoAlarm
17:07 - Connection status: False
17:07 - Resetting run
17:07 - Wait for UCTS external trigger before enabling trigger...
17:07 - Status: TibState.Standby
17:07 - Alarms: AlarmVector.NoAlarm
17:07 - Connection status: False
17:07 - Status: TibState.Standby
17:07 - Alarms: AlarmVector.NoAlarm
17:07 - Connection status: False
17:07 - Status: TibState.Armed
17:07 - Alarms: AlarmVector.NoAlarm
17:07 - Connection status: True
17:07 - Done
17:07 - Finished task "Check high voltages"
17:07 - Starting TIB triggers...
17:07 - Enabling trigger
17:07 - Status: TibState.Running
17:07 - Alarms: AlarmVector.NoAlarm
17:07 - Connection status: True
17:07 - Checking for high voltage locked pixels...
17:07 - Status: TibState.Running ConnectionStatus: True
17:07 - Alarms: AlarmVector.ReadError
17:07 - Temperature: 40.12
17:07 - Local camera rate: 0.0 Hz
17:07 - Stereo trigger rate: 0.0 Hz
17:07 - SPE trigger rate: 0.0 Hz
17:07 - Calibration trigger rate: 0.0 Hz
17:07 - Software trigger rate: 0.0 Hz
17:07 - Pedestal trigger rate: 0.0 Hz
17:07 - Collected trigger rate: 139.0 Hz
17:07 - Busy rate: 0.0 Hz
17:07 - Camera trigger rate: 139.0 Hz
17:07 - Status: TibState.Running ConnectionStatus: True
17:07 - Alarms: AlarmVector.ReadError
17:07 - Temperature: 40.19
17:07 - Local camera rate: 0.0 Hz
17:07 - Stereo trigger rate: 0.0 Hz
17:07 - SPE trigger rate: 0.0 Hz
17:07 - Calibration trigger rate: 0.0 Hz
17:07 - Software trigger rate: 0.0 Hz
17:07 - Pedestal trigger rate: 0.0 Hz
17:07 - Collected trigger rate: 157.0 Hz
17:07 - Busy rate: 0.0 Hz
17:07 - Camera trigger rate: 157.0 Hz
17:07 - Status: TibState.Running ConnectionStatus: True
17:07 - Alarms: AlarmVector.ReadError
17:07 - Temperature: 40.12
17:07 - Local camera rate: 0.0 Hz
17:07 - Stereo trigger rate: 0.0 Hz
17:07 - SPE trigger rate: 0.0 Hz
17:07 - Calibration trigger rate: 0.0 Hz
17:07 - Software trigger rate: 0.0 Hz
17:07 - Pedestal trigger rate: 0.0 Hz
17:07 - Collected trigger rate: 157.0 Hz
17:07 - Busy rate: 0.0 Hz
17:07 - Camera trigger rate: 157.0 Hz
17:07 - Status: TibState.Running ConnectionStatus: True
17:07 - Alarms: AlarmVector.ReadError
17:07 - Temperature: 40.12
17:07 - Local camera rate: 0.0 Hz
17:07 - Stereo trigger rate: 0.0 Hz
17:07 - SPE trigger rate: 0.0 Hz
17:07 - Calibration trigger rate: 0.0 Hz
17:07 - Software trigger rate: 0.0 Hz
17:07 - Pedestal trigger rate: 0.0 Hz
17:07 - Collected trigger rate: 157.0 Hz
17:07 - Busy rate: 0.0 Hz
17:07 - Camera trigger rate: 157.0 Hz
17:07 - Status: TibState.Running ConnectionStatus: True
17:07 - Alarms: AlarmVector.ReadError
17:07 - Temperature: 40.12
17:07 - Local camera rate: 0.0 Hz
17:07 - Stereo trigger rate: 0.0 Hz
17:07 - SPE trigger rate: 0.0 Hz
17:07 - Calibration trigger rate: 0.0 Hz
17:07 - Software trigger rate: 0.0 Hz
17:07 - Pedestal trigger rate: 0.0 Hz
17:07 - Collected trigger rate: 157.0 Hz
17:07 - Busy rate: 0.0 Hz
17:07 - Camera trigger rate: 157.0 Hz
17:08 - Checking for high voltage locked pixels...
17:08 - Checking for high voltage locked pixels...
17:09 - Checking for high voltage locked pixels...
17:09 - Status: TibState.Running ConnectionStatus: True
17:09 - Alarms: AlarmVector.ReadError
17:09 - Temperature: 40.25
17:09 - Local camera rate: 0.0 Hz
17:09 - Stereo trigger rate: 0.0 Hz
17:09 - SPE trigger rate: 0.0 Hz
17:09 - Calibration trigger rate: 0.0 Hz
17:09 - Software trigger rate: 0.0 Hz
17:09 - Pedestal trigger rate: 0.0 Hz
17:09 - Collected trigger rate: 136.0 Hz
17:09 - Busy rate: 0.0 Hz
17:09 - Camera trigger rate: 136.0 Hz
17:09 - Checking for high voltage locked pixels...
17:09 - Stopping TIB...
17:09 - Status: TibState.Running
17:09 - Alarms: AlarmVector.ReadError
17:09 - Connection status: True
17:09 - Disabling trigger
17:09 - Disabling PPS
17:09 - Status: TibState.PpsStopped
17:09 - Alarms: AlarmVector.ReadError
17:09 - Connection status: True
17:09 - Closing TIB connection to camera server
17:09 - Status: TibState.PpsStopped
17:09 - Alarms: AlarmVector.ReadError
17:09 - Connection status: False
17:09 - Run duration: 0:02:22
17:09 - Local camera triggers: 0
17:09 - Slow control triggers: 0
17:09 - Single photo-electron triggers: 0
17:09 - Calibration triggers: 0
17:09 - Software triggers from UCTS: 0
17:09 - Pedestal triggers: 0
17:09 - Collected input triggers: 20489
17:09 - Busy triggers: 22
17:09 - Camera event triggers sent to clusters: 20467