11:05:45 - Setting HVPA current limits...
11:05:46 - Finished task "Switch HVPA voltage state"
11:05:49 - Updating voltage widget...
11:05:53 - Starting task "Switch HVPA voltage state"
11:05:53 - Setting HVPA current limit to 12489.75 uA
11:05:53 - Setting HVPA ramp speed to 25 V/s
11:05:53 - Switching HVPA to state Nominal
11:05:55 - High voltage locked channels will be checked every 30 s
11:06:00 - Setting HVPA current limits...
11:06:01 - Finished task "Switch HVPA voltage state"
11:06:03 - Updating voltage widget...
11:06:09 - Updating voltage widget...
11:06:11 - Updating voltage widget...
11:06:12 - Updating voltage widget...
11:06:13 - Updating voltage widget...
11:06:14 - Updating voltage widget...
11:06:15 - Updating voltage widget...
11:06:16 - Updating voltage widget...
11:06:25 - Checking for high voltage locked pixels...
11:06:26 - Updating voltage widget...
11:06:29 - Starting task "Check high voltages"
11:06:29 - Found 1 drawer(s) in Nominal state, 0 in Low state and 0 in Wait state
11:06:29 - Actual voltage is between 989.42 V and 1063.23 V.
11:06:29 - Low voltages range between 300.00 V and 300.00 V. 
11:06:29 - Reference voltages range between 989.87 V and 1063.17 V. 
11:06:30 - Maximum difference between expected and actual voltages is 0.45 V
11:06:30 - Maximum of current limits is 4384.98 uA
11:06:30 - Checking status of HVPA module in 1 drawer(s)...
11:06:30 - Checking status of HVPA channels in 1 drawer(s)...
11:06:30 - HV is stabilized in all channels.
11:06:30 - Checking reference and low voltages against /data/config/2021/20210222/config_tower_1module_FEBv6_pingpong_DelayBusy0.NMC.xml
11:06:30 - Done
11:06:30 - Finished task "Check high voltages"
11:06:35 - Stopping NMC
11:06:35 - Found 0 PPS errors.
11:06:37 - Starting NMC
11:06:37 - Clearing PPS error counters
11:06:48 - Checking UCTS clock...
11:06:49 - UCTS clock is late by 36 seconds!
11:06:49 - Configuring UCTS
11:06:49 - Configuring TIB...
11:06:49 - Setting TIB forced mode to False
11:06:49 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v
11:06:49 - Status: TibState.RunStopped
11:06:49 - Alarms: AlarmVector.BufferFull
11:06:49 - Connection status: False TXclient_alive: False
11:06:49 - Disabling PPS
11:06:51 - Status: TibState.PpsStopped
11:06:51 - Alarms: AlarmVector.BufferFull
11:06:51 - Connection status: False TXclient_alive: False
11:06:51 - Entering set_external_delay
11:06:51 - Setting ExternalDelayLocal to 0.000 ns
11:06:51 - Writing 0.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v
11:06:51 - Entering set_external_delay
11:06:51 - Setting ExternalDelayCalibration to 65.000 ns
11:06:51 - Writing 65.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v
11:06:51 - Entering set_external_delay
11:06:51 - Setting ExternalDelaySphe to 150.000 ns
11:06:51 - Writing 150.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v
11:06:51 - Setting TIB trigger mode to 0x54 = TriggerMask.SlowControl|Software|Calibration
11:06:51 - Writing 84 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v
11:06:51 - Writing 1 to Camera.TIB.InputsEnable.InputMask.InputMask_v
11:06:51 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v
11:06:51 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v
11:06:51 - Writing False to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v
11:06:51 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v
11:06:51 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v
11:06:51 - Status: TibState.PpsStopped
11:06:51 - Alarms: AlarmVector.BufferFull
11:06:51 - Connection status: False TXclient_alive: False
11:06:51 - Writing False to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v
11:06:51 - Writing 100 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v
11:06:51 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
11:06:51 - Writing False to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v
11:06:52 - Writing 100 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v
11:06:52 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v
11:06:52 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
11:06:52 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v
11:06:52 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v
11:06:52 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
11:06:53 - Connecting TIB to camera server at 10.10.4.12:222
11:06:53 - Starting TIB...
11:06:53 - Status: TibState.PpsStopped
11:06:53 - Alarms: AlarmVector.BufferFull
11:06:53 - Connection status: False TXclient_alive: False
11:06:53 - Resetting run
11:06:53 - Wait for UCTS external trigger before enabling trigger...
11:06:53 - Status: TibState.Standby
11:06:53 - Alarms: AlarmVector.NoAlarm
11:06:53 - Connection status: False TXclient_alive: True
11:06:53 - Status: TibState.Standby
11:06:53 - Alarms: AlarmVector.NoAlarm
11:06:53 - Connection status: False TXclient_alive: True
11:06:54 - Status: TibState.Armed
11:06:54 - Alarms: AlarmVector.NoAlarm
11:06:54 - Connection status: False TXclient_alive: True
11:06:55 - Starting TIB triggers...
11:06:55 - Enabling trigger
11:06:55 - Status: TibState.Running
11:06:55 - Alarms: AlarmVector.NoAlarm
11:06:55 - Connection status: False TXclient_alive: True
11:06:56 - Checking for high voltage locked pixels...
11:06:59 - Checking status of calibration box...
11:07:00 - Calibration box is configured with 13 leds at a frequency of 200.0 Hz and a voltage of 16.50 V
11:07:25 - Checking for high voltage locked pixels...
11:07:55 - Checking for high voltage locked pixels...
11:08:25 - Checking for high voltage locked pixels...
11:08:37 - Configuring calibration box...
11:08:37 - Configuring calibration box with leds=0x40 voltage=9.50 frequency=1000.0/1 central_current=0.0 duration=0 width=1 lemo_out=True fiber1_out=True fiber2_out=True lemo_in=False enabled=False
11:08:40 - Starting flashes...
11:08:47 - Status: TibState.Running ConnectionStatus: False TXclient_alive: True
11:08:47 - Alarms: AlarmVector.BufferFull|AlmostFull
11:08:47 - Temperature: 34.69
11:08:47 - Local camera rate: 0.0 Hz
11:08:47 - Stereo trigger rate: 0.0 Hz
11:08:47 - SPE trigger rate: 0.0 Hz
11:08:47 - Calibration trigger rate: 1000.0 Hz
11:08:47 - Software trigger rate: 0.0 Hz
11:08:47 - Pedestal trigger rate: 0.0 Hz
11:08:47 - Collected trigger rate: 1000.0 Hz
11:08:47 - Busy rate: 0.0 Hz
11:08:47 - Camera trigger rate: 1000.0 Hz
11:08:50 - Stopping TIB...
11:08:50 - Status: TibState.Running
11:08:50 - Alarms: AlarmVector.BufferFull|AlmostFull
11:08:50 - Connection status: False TXclient_alive: True
11:08:50 - Disabling trigger
11:08:50 - Disabling PPS
11:08:51 - Status: TibState.PpsStopped
11:08:51 - Alarms: AlarmVector.BufferFull|AlmostFull
11:08:51 - Connection status: False TXclient_alive: True
11:08:51 - Closing TIB connection to camera server
11:08:55 - Checking for high voltage locked pixels...
11:08:56 - Stopping NMC
11:08:56 - Found 0 PPS errors.
11:09:02 - Updating FEB temperature widget...
11:09:05 - Updating voltage widget...
11:09:08 - Starting NMC
11:09:08 - Clearing PPS error counters
11:09:25 - Checking for high voltage locked pixels...
11:09:36 - Calling method FSM.gotoReady in object FSM
11:09:52 - Calling method FSM.gotoObserving in object FSM
11:09:55 - Checking for high voltage locked pixels...
11:10:11 - Configuring calibration box...
11:10:11 - Configuring calibration box with leds=0x40 voltage=9.50 frequency=1000.0/1 central_current=0.0 duration=0 width=1 lemo_out=True fiber1_out=True fiber2_out=True lemo_in=False enabled=False
11:10:12 - Starting flashes...
11:10:15 - Checking UCTS clock...
11:10:15 - UCTS clock is late by 35 seconds!
11:10:15 - Configuring UCTS
11:10:15 - Configuring TIB...
11:10:15 - Setting TIB forced mode to False
11:10:15 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v
11:10:15 - Status: TibState.PpsStopped
11:10:15 - Alarms: AlarmVector.BufferFull|AlmostFull
11:10:15 - Connection status: False TXclient_alive: False
11:10:15 - Entering set_external_delay
11:10:15 - Setting ExternalDelayLocal to 0.000 ns
11:10:15 - Writing 0.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v
11:10:16 - Entering set_external_delay
11:10:16 - Setting ExternalDelayCalibration to 65.000 ns
11:10:16 - Writing 65.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v
11:10:16 - Entering set_external_delay
11:10:16 - Setting ExternalDelaySphe to 150.000 ns
11:10:16 - Writing 150.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v
11:10:16 - Setting TIB trigger mode to 0x54 = TriggerMask.SlowControl|Software|Calibration
11:10:16 - Writing 84 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v
11:10:16 - Writing 1 to Camera.TIB.InputsEnable.InputMask.InputMask_v
11:10:16 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v
11:10:16 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v
11:10:16 - Writing False to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v
11:10:16 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v
11:10:16 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v
11:10:16 - Status: TibState.PpsStopped
11:10:16 - Alarms: AlarmVector.BufferFull|AlmostFull
11:10:16 - Connection status: False TXclient_alive: False
11:10:16 - Writing False to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v
11:10:16 - Writing 100 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v
11:10:17 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
11:10:17 - Writing False to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v
11:10:17 - Writing 100 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v
11:10:17 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v
11:10:17 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
11:10:17 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v
11:10:17 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v
11:10:17 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
11:10:18 - Connecting TIB to camera server at 10.10.4.12:222
11:10:18 - Starting TIB...
11:10:18 - Status: TibState.PpsStopped
11:10:18 - Alarms: AlarmVector.BufferFull|AlmostFull
11:10:19 - Connection status: False TXclient_alive: True
11:10:19 - Resetting run
11:10:19 - Wait for UCTS external trigger before enabling trigger...
11:10:19 - Status: TibState.Standby
11:10:19 - Alarms: AlarmVector.NoAlarm
11:10:19 - Connection status: False TXclient_alive: True
11:10:19 - Status: TibState.Standby
11:10:19 - Alarms: AlarmVector.NoAlarm
11:10:19 - Connection status: False TXclient_alive: True
11:10:20 - Status: TibState.Armed
11:10:20 - Alarms: AlarmVector.NoAlarm
11:10:20 - Connection status: True TXclient_alive: True
11:10:21 - Starting TIB triggers...
11:10:21 - Enabling trigger
11:10:21 - Failed to call EnableTrigger: Bad statuses are present
11:10:25 - Checking for high voltage locked pixels...
11:10:32 - Status: TibState.CoutingPps
11:10:32 - Alarms: AlarmVector.NoAlarm
11:10:32 - Connection status: True TXclient_alive: True
11:10:32 - External delays: Local=0.000 ns, Calibration=65.000 ns, Sphe=150.000 ns
11:10:32 - Trigger mask: 0x54 = TriggerMask.SlowControl|Software|Calibration
11:10:32 - Input mask: 0x1
11:10:32 - Disable BUSY: False
11:10:32 - Extra BUSY Delay: 0.0
11:10:32 - Temperature: 34.75
11:10:35 - Resetting TIB...
11:10:38 - Could not invoke the MethodCall service: BadTimeout
11:10:45 - Status: TibState.RunStopped
11:10:45 - Alarms: AlarmVector.NoAlarm
11:10:45 - Connection status: False TXclient_alive: False
11:10:45 - External delays: Local=3825.000 ns, Calibration=3825.000 ns, Sphe=3825.000 ns
11:10:45 - Trigger mask: 0x51 = TriggerMask.SlowControl|Software|Mono
11:10:45 - Input mask: 0x7
11:10:45 - Disable BUSY: False
11:10:45 - Extra BUSY Delay: 0.0
11:10:45 - Temperature: 34.75
11:10:50 - Status: TibState.RunStopped
11:10:50 - Alarms: AlarmVector.NoAlarm
11:10:50 - Connection status: False TXclient_alive: False
11:10:50 - External delays: Local=3825.000 ns, Calibration=3825.000 ns, Sphe=3825.000 ns
11:10:50 - Trigger mask: 0x51 = TriggerMask.SlowControl|Software|Mono
11:10:50 - Input mask: 0x7
11:10:50 - Disable BUSY: False
11:10:50 - Extra BUSY Delay: 0.0
11:10:50 - Temperature: 34.75
11:10:53 - Checking UCTS clock...
11:10:53 - UCTS clock is late by 35 seconds!
11:10:53 - Configuring UCTS
11:10:53 - Configuring TIB...
11:10:53 - Setting TIB forced mode to False
11:10:53 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v
11:10:53 - Status: TibState.RunStopped
11:10:53 - Alarms: AlarmVector.NoAlarm
11:10:53 - Connection status: False TXclient_alive: False
11:10:53 - Disabling PPS
11:10:55 - Status: TibState.PpsStopped
11:10:55 - Alarms: AlarmVector.NoAlarm
11:10:55 - Connection status: False TXclient_alive: False
11:10:55 - Entering set_external_delay
11:10:55 - Setting ExternalDelayLocal to 0.000 ns
11:10:55 - Writing 0.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v
11:10:55 - Entering set_external_delay
11:10:55 - Setting ExternalDelayCalibration to 65.000 ns
11:10:55 - Writing 65.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v
11:10:56 - Entering set_external_delay
11:10:56 - Setting ExternalDelaySphe to 150.000 ns
11:10:56 - Writing 150.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v
11:10:56 - Setting TIB trigger mode to 0x54 = TriggerMask.SlowControl|Software|Calibration
11:10:56 - Writing 84 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v
11:10:56 - Writing 1 to Camera.TIB.InputsEnable.InputMask.InputMask_v
11:10:56 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v
11:10:56 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v
11:10:56 - Writing False to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v
11:10:56 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v
11:10:56 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v
11:10:56 - Status: TibState.PpsStopped
11:10:56 - Alarms: AlarmVector.NoAlarm
11:10:56 - Connection status: False TXclient_alive: False
11:10:56 - Writing False to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v
11:10:56 - Writing 100 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v
11:10:56 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
11:10:56 - Writing False to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v
11:10:56 - Writing 100 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v
11:10:56 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v
11:10:56 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
11:10:56 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v
11:10:56 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v
11:10:56 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
11:10:56 - Checking for high voltage locked pixels...
11:10:58 - Connecting TIB to camera server at 10.10.4.12:222
11:10:58 - Starting TIB...
11:10:58 - Status: TibState.PpsStopped
11:10:58 - Alarms: AlarmVector.NoAlarm
11:10:58 - Connection status: False TXclient_alive: True
11:10:58 - Resetting run
11:10:58 - Wait for UCTS external trigger before enabling trigger...
11:10:58 - Status: TibState.Standby
11:10:58 - Alarms: AlarmVector.NoAlarm
11:10:58 - Connection status: False TXclient_alive: True
11:10:58 - Status: TibState.Standby
11:10:58 - Alarms: AlarmVector.NoAlarm
11:10:59 - Connection status: False TXclient_alive: True
11:11:00 - Status: TibState.Armed
11:11:00 - Alarms: AlarmVector.NoAlarm
11:11:00 - Connection status: True TXclient_alive: True
11:11:04 - Starting TIB triggers...
11:11:04 - Enabling trigger
11:11:04 - Status: TibState.Running
11:11:04 - Alarms: AlarmVector.ReadError
11:11:04 - Connection status: True TXclient_alive: True
11:11:25 - Checking for high voltage locked pixels...
11:11:55 - Checking for high voltage locked pixels...
11:11:56 - Stopping TIB...
11:11:56 - Status: TibState.Running
11:11:56 - Alarms: AlarmVector.ReadError
11:11:56 - Connection status: True TXclient_alive: True
11:11:56 - Disabling trigger
11:11:56 - Disabling PPS
11:11:57 - Status: TibState.PpsStopped
11:11:57 - Alarms: AlarmVector.ReadError
11:11:57 - Connection status: True TXclient_alive: True
11:11:57 - Closing TIB connection to camera server
11:11:58 - Status: TibState.PpsStopped
11:11:58 - Alarms: AlarmVector.ReadError
11:11:58 - Connection status: False TXclient_alive: False
11:11:58 - Run duration: 0:00:57
11:11:58 - Local camera triggers: 0
11:11:58 - Slow control triggers: 0
11:11:58 - Single photo-electron triggers: 0
11:11:58 - Calibration triggers: 56270
11:11:58 - Software triggers from UCTS: 0
11:11:58 - Pedestal triggers: 0
11:11:58 - Collected input triggers: 51678
11:11:58 - Busy triggers: 0
11:11:58 - Camera event triggers sent to clusters: 51678
11:12:01 - Calling method FSM.gotoReady in object FSM
11:12:03 - Stopping NMC
11:12:03 - Found 0 PPS errors.