16:26:04 - Starting task "Configure modules"
16:26:04 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/utils/branches/v5.5.1-40061 
16:26:04 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/libNectarCam/branches/v5.5.1-40061 
16:26:04 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/libQNectarCam/branches/v5.5.1-40061 
16:26:04 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/qNectarcamModuleController/branches/v5.5.1-40061
16:26:04 - Configuring modules with configuration /data/config/2021/20210325/config_tower_2FEBv5+2FEBv6.NMC.xml
16:26:04 - Switching off high voltages in configuration
16:26:08 - Successfully configured 4 module(s)
16:26:08 - Found 2 different versions of FEB firmware: ['61210216' 'F55D2001']
16:26:08 - All backplanes are programmed with firmware 15
16:26:09 - NMC is in state NmcState.Configured and knows of 4 drawer(s)
16:26:09 - Found 0 PPS errors.
16:26:10 - Finished task "Configure modules"
16:26:13 - Starting task "Switch HVPA voltage state"
16:26:13 - Setting HVPA current limit to 12489.75 uA
16:26:14 - Setting HVPA ramp speed to 25 V/s
16:26:14 - Switching HVPA to state Nominal
16:26:17 - Checking for high voltage locked pixels...
16:26:21 - Setting HVPA current limits...
16:26:23 - Finished task "Switch HVPA voltage state"
16:26:28 - Starting task "Check high voltages"
16:26:28 - Found 4 drawer(s) in Nominal state, 0 in Low state and 0 in Wait state
16:26:29 - Actual voltage is between 952.82 V and 1117.52 V.
16:26:29 - Low voltages range between 300.00 V and 300.00 V. 
16:26:30 - Reference voltages range between 952.50 V and 1117.51 V. 
16:26:31 - Maximum difference between expected and actual voltages is 1.09 V
16:26:31 - Maximum of current limits is 4840.96 uA
16:26:31 - Checking status of HVPA module in 4 drawer(s)...
16:26:31 - Checking status of HVPA channels in 4 drawer(s)...
16:26:32 - HV is stabilized in all channels.
16:26:32 - Checking reference and low voltages against /data/config/2021/20210325/config_tower_2FEBv5+2FEBv6.NMC.xml
16:26:33 - Done
16:26:33 - Finished task "Check high voltages"
16:26:34 - Starting NMC
16:26:34 - Clearing PPS error counters
16:26:37 - Calling method FSM.gotoObserving in object FSM
16:26:47 - Checking for high voltage locked pixels...
16:27:17 - Checking for high voltage locked pixels...
16:27:47 - Checking for high voltage locked pixels...
16:28:10 - Calling method FSM.gotoReady in object FSM
16:28:17 - Checking for high voltage locked pixels...
16:28:41 - Calling method FSM.gotoObserving in object FSM
16:28:47 - Checking for high voltage locked pixels...
16:29:09 - Stopping NMC
16:29:10 - Found 0 PPS errors.
16:29:11 - Starting NMC
16:29:11 - Clearing PPS error counters
16:29:17 - Checking for high voltage locked pixels...
16:29:20 - Configuring calibration box...
16:29:20 - Configuring calibration box with leds=0x358 voltage=10.49 frequency=300.0/30 central_current=0.0 duration=0 width=1 lemo_out=True fiber1_out=True fiber2_out=True lemo_in=False enabled=False
16:29:33 - Checking UCTS clock...
16:29:33 - UCTS clock is late by 12 seconds!
16:29:33 - Configuring UCTS
16:29:33 - Configuring TIB...
16:29:33 - Setting TIB forced mode to False
16:29:33 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v
16:29:33 - Status: TibState.PpsStopped
16:29:33 - Alarms: AlarmVector.NoAlarm
16:29:33 - Connection status: False TXclient_alive: False
16:29:33 - Entering set_external_delay
16:29:33 - Setting ExternalDelayLocal to 27.000 ns
16:29:33 - Writing 27.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v
16:29:34 - Entering set_external_delay
16:29:34 - Setting ExternalDelayCalibration to 58.000 ns
16:29:34 - Writing 58.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v
16:29:34 - Entering set_external_delay
16:29:34 - Setting ExternalDelaySphe to 150.000 ns
16:29:34 - Writing 150.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v
16:29:34 - Setting TIB trigger mode to 0x70 = TriggerMask.SlowControl|Pedestal|Software
16:29:34 - Writing 112 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v
16:29:34 - Writing 1 to Camera.TIB.InputsEnable.InputMask.InputMask_v
16:29:34 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v
16:29:34 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v
16:29:34 - Writing False to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v
16:29:34 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v
16:29:35 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v
16:29:35 - Status: TibState.PpsStopped
16:29:35 - Alarms: AlarmVector.NoAlarm
16:29:35 - Connection status: False TXclient_alive: False
16:29:35 - Writing True to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v
16:29:35 - Writing 5000 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v
16:29:35 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
16:29:35 - Writing False to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v
16:29:35 - Writing 5000 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v
16:29:35 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v
16:29:35 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
16:29:35 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v
16:29:35 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v
16:29:35 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
16:29:36 - Connecting TIB to camera server at 10.10.4.12:222
16:29:36 - Starting TIB...
16:29:36 - Status: TibState.PpsStopped
16:29:36 - Alarms: AlarmVector.NoAlarm
16:29:36 - Connection status: False TXclient_alive: True
16:29:36 - Resetting run
16:29:36 - Wait for UCTS external trigger before enabling trigger...
16:29:36 - Status: TibState.Standby
16:29:36 - Alarms: AlarmVector.NoAlarm
16:29:36 - Connection status: False TXclient_alive: True
16:29:36 - Status: TibState.Standby
16:29:36 - Alarms: AlarmVector.NoAlarm
16:29:36 - Connection status: False TXclient_alive: True
16:29:37 - Status: TibState.CoutingPps
16:29:37 - Alarms: AlarmVector.NoAlarm
16:29:37 - Connection status: False TXclient_alive: True
16:29:39 - Starting TIB triggers...
16:29:39 - Enabling trigger
16:29:39 - Status: TibState.Running
16:29:39 - Alarms: AlarmVector.NoAlarm
16:29:39 - Connection status: False TXclient_alive: True
16:29:40 - Status: TibState.Running ConnectionStatus: False TXclient_alive: True
16:29:40 - Alarms: AlarmVector.BufferFull|AlmostFull
16:29:40 - Temperature: 34.12
16:29:40 - Local camera rate: 0.0 Hz
16:29:40 - Stereo trigger rate: 0.0 Hz
16:29:40 - SPE trigger rate: 0.0 Hz
16:29:40 - Calibration trigger rate: 0.0 Hz
16:29:40 - Software trigger rate: 0.0 Hz
16:29:40 - Pedestal trigger rate: 4990.0 Hz
16:29:40 - Collected trigger rate: 2644.0 Hz
16:29:40 - Busy rate: 0.0 Hz
16:29:40 - Camera trigger rate: 2644.0 Hz
16:29:41 - Status: TibState.Running ConnectionStatus: False TXclient_alive: True
16:29:41 - Alarms: AlarmVector.BufferFull|AlmostFull
16:29:41 - Temperature: 34.12
16:29:41 - Local camera rate: 0.0 Hz
16:29:41 - Stereo trigger rate: 0.0 Hz
16:29:41 - SPE trigger rate: 3.0 Hz
16:29:41 - Calibration trigger rate: 1.0 Hz
16:29:42 - Software trigger rate: 0.0 Hz
16:29:42 - Pedestal trigger rate: 4990.0 Hz
16:29:42 - Collected trigger rate: 4990.0 Hz
16:29:42 - Busy rate: 0.0 Hz
16:29:42 - Camera trigger rate: 4990.0 Hz
16:29:43 - Status: TibState.Running ConnectionStatus: False TXclient_alive: True
16:29:43 - Alarms: AlarmVector.BufferFull|AlmostFull
16:29:43 - Temperature: 34.12
16:29:43 - Local camera rate: 0.0 Hz
16:29:43 - Stereo trigger rate: 0.0 Hz
16:29:43 - SPE trigger rate: 3.0 Hz
16:29:43 - Calibration trigger rate: 1.0 Hz
16:29:43 - Software trigger rate: 0.0 Hz
16:29:43 - Pedestal trigger rate: 4990.0 Hz
16:29:43 - Collected trigger rate: 4990.0 Hz
16:29:43 - Busy rate: 0.0 Hz
16:29:43 - Camera trigger rate: 4990.0 Hz
16:29:47 - Checking for high voltage locked pixels...
16:30:00 - Stopping TIB...
16:30:00 - Status: TibState.Running
16:30:00 - Alarms: AlarmVector.BufferFull|AlmostFull
16:30:00 - Connection status: False TXclient_alive: True
16:30:00 - Disabling trigger
16:30:00 - Disabling PPS
16:30:01 - Status: TibState.PpsStopped
16:30:01 - Alarms: AlarmVector.BufferFull|AlmostFull
16:30:01 - Connection status: False TXclient_alive: True
16:30:01 - Closing TIB connection to camera server
16:30:03 - Calling method FSM.gotoReady in object FSM
16:30:06 - Stopping NMC
16:30:06 - Found 0 PPS errors.
16:30:11 - Starting NMC
16:30:11 - Clearing PPS error counters
16:30:14 - Calling method FSM.gotoObserving in object FSM
16:30:17 - Checking for high voltage locked pixels...
16:30:29 - Checking UCTS clock...
16:30:29 - UCTS clock is late by 12 seconds!
16:30:29 - Configuring UCTS
16:30:29 - Configuring TIB...
16:30:29 - Setting TIB forced mode to False
16:30:29 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v
16:30:29 - Status: TibState.PpsStopped
16:30:29 - Alarms: AlarmVector.BufferFull|AlmostFull
16:30:29 - Connection status: False TXclient_alive: False
16:30:29 - Entering set_external_delay
16:30:29 - Setting ExternalDelayLocal to 27.000 ns
16:30:29 - Writing 27.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v
16:30:30 - Entering set_external_delay
16:30:30 - Setting ExternalDelayCalibration to 58.000 ns
16:30:30 - Writing 58.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v
16:30:30 - Entering set_external_delay
16:30:30 - Setting ExternalDelaySphe to 150.000 ns
16:30:30 - Writing 150.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v
16:30:30 - Setting TIB trigger mode to 0x70 = TriggerMask.SlowControl|Pedestal|Software
16:30:30 - Writing 112 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v
16:30:30 - Writing 1 to Camera.TIB.InputsEnable.InputMask.InputMask_v
16:30:30 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v
16:30:30 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v
16:30:30 - Writing False to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v
16:30:30 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v
16:30:30 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v
16:30:30 - Status: TibState.PpsStopped
16:30:30 - Alarms: AlarmVector.BufferFull|AlmostFull
16:30:30 - Connection status: False TXclient_alive: False
16:30:30 - Writing True to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v
16:30:30 - Writing 5000 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v
16:30:30 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
16:30:30 - Writing False to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v
16:30:30 - Writing 5000 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v
16:30:30 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v
16:30:30 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
16:30:30 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v
16:30:30 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v
16:30:30 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
16:30:31 - Connecting TIB to camera server at 10.10.4.12:222
16:30:31 - Starting TIB...
16:30:31 - Status: TibState.PpsStopped
16:30:31 - Alarms: AlarmVector.BufferFull|AlmostFull
16:30:31 - Connection status: False TXclient_alive: True
16:30:31 - Resetting run
16:30:31 - Wait for UCTS external trigger before enabling trigger...
16:30:31 - Status: TibState.Standby
16:30:31 - Alarms: AlarmVector.NoAlarm
16:30:31 - Connection status: False TXclient_alive: True
16:30:31 - Status: TibState.Standby
16:30:31 - Alarms: AlarmVector.NoAlarm
16:30:31 - Connection status: False TXclient_alive: True
16:30:32 - Status: TibState.Armed
16:30:32 - Alarms: AlarmVector.NoAlarm
16:30:32 - Connection status: False TXclient_alive: True
16:30:34 - Starting TIB triggers...
16:30:34 - Enabling trigger
16:30:34 - Status: TibState.Running
16:30:34 - Alarms: AlarmVector.NoAlarm
16:30:34 - Connection status: False TXclient_alive: True
16:30:35 - Status: TibState.Running ConnectionStatus: False TXclient_alive: True
16:30:35 - Alarms: AlarmVector.BufferFull|AlmostFull
16:30:35 - Temperature: 34.12
16:30:35 - Local camera rate: 0.0 Hz
16:30:35 - Stereo trigger rate: 0.0 Hz
16:30:35 - SPE trigger rate: 2.0 Hz
16:30:35 - Calibration trigger rate: 1.0 Hz
16:30:35 - Software trigger rate: 0.0 Hz
16:30:35 - Pedestal trigger rate: 4990.0 Hz
16:30:35 - Collected trigger rate: 4990.0 Hz
16:30:35 - Busy rate: 0.0 Hz
16:30:35 - Camera trigger rate: 4990.0 Hz
16:30:37 - Status: TibState.Running ConnectionStatus: False TXclient_alive: True
16:30:37 - Alarms: AlarmVector.BufferFull|AlmostFull
16:30:37 - Temperature: 34.12
16:30:37 - Local camera rate: 0.0 Hz
16:30:37 - Stereo trigger rate: 0.0 Hz
16:30:37 - SPE trigger rate: 2.0 Hz
16:30:37 - Calibration trigger rate: 1.0 Hz
16:30:37 - Software trigger rate: 0.0 Hz
16:30:37 - Pedestal trigger rate: 4990.0 Hz
16:30:37 - Collected trigger rate: 4990.0 Hz
16:30:37 - Busy rate: 0.0 Hz
16:30:37 - Camera trigger rate: 4990.0 Hz
16:30:47 - Checking for high voltage locked pixels...
16:31:14 - Stopping TIB...
16:31:14 - Status: TibState.Running
16:31:14 - Alarms: AlarmVector.BufferFull|AlmostFull
16:31:14 - Connection status: False TXclient_alive: True
16:31:14 - Disabling trigger
16:31:14 - Disabling PPS
16:31:15 - Status: TibState.PpsStopped
16:31:15 - Alarms: AlarmVector.BufferFull|AlmostFull
16:31:15 - Connection status: False TXclient_alive: True
16:31:15 - Closing TIB connection to camera server
16:31:17 - Checking for high voltage locked pixels...
16:31:36 - Status: TibState.PpsStopped
16:31:36 - Alarms: AlarmVector.BufferFull|AlmostFull
16:31:36 - Connection status: False TXclient_alive: False
16:31:36 - Run duration: 0:00:41
16:31:36 - Local camera triggers: 0
16:31:36 - Slow control triggers: 0
16:31:36 - Single photo-electron triggers: 33
16:31:36 - Calibration triggers: 26
16:31:36 - Software triggers from UCTS: 0
16:31:36 - Pedestal triggers: 202516
16:31:36 - Collected input triggers: 199858
16:31:36 - Busy triggers: 0
16:31:36 - Camera event triggers sent to clusters: 199858
16:31:39 - Calling method FSM.gotoReady in object FSM