08:51:46 - Scanning interface enp2s0 for non configured modules... 08:51:47 - Found 2 MAC address(es) 08:51:52 - Starting task "Configure modules" 08:51:52 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/utils/branches/v5.5.1-40061 08:51:52 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/libNectarCam/branches/v5.5.1-40061 08:51:52 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/libQNectarCam/branches/v5.5.1-40061 08:51:52 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/qNectarcamModuleController/branches/v5.5.1-40061 08:51:52 - Configuring modules with configuration /data/config/2021/20210315/config_tower_2modules_FEBv6_pingpong_DelayBusy0_newDACL_newHV2.NMC.xml 08:51:52 - Switching off high voltages in configuration 08:51:56 - Successfully configured 2 module(s) 08:51:56 - All front-end boards are programmed with firmware 61210216 08:51:56 - All backplanes are programmed with firmware 15 08:51:57 - NMC is in state NmcState.Configured and knows of 2 drawer(s) 08:51:57 - Found 0 PPS errors. 08:51:57 - Finished task "Configure modules" 08:51:59 - Updating FEB temperature widget... 09:28:53 - Updating FEB temperature widget... 09:33:38 - Checking status of calibration box... 09:33:39 - Calibration box is configured with 0 leds at a frequency of 1000.0 Hz and a voltage of 8.00 V 09:33:47 - Starting task "Switch HVPA voltage state" 09:33:47 - Setting HVPA current limit to 12489.75 uA 09:33:48 - Setting HVPA ramp speed to 25 V/s 09:33:48 - Switching HVPA to state Nominal 09:33:48 - High voltage locked channels will be checked every 30 s 09:33:55 - Setting HVPA current limits... 09:33:56 - Finished task "Switch HVPA voltage state" 09:34:14 - Checking UCTS clock... 09:34:15 - UCTS clock is late by 6 seconds! 09:34:15 - Configuring UCTS 09:34:15 - Configuring TIB... 09:34:15 - Setting TIB forced mode to False 09:34:15 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v 09:34:15 - Status: TibState.RunStopped 09:34:15 - Alarms: AlarmVector.NoAlarm 09:34:15 - Connection status: False TXclient_alive: False 09:34:15 - Disabling PPS 09:34:17 - Status: TibState.PpsStopped 09:34:17 - Alarms: AlarmVector.NoAlarm 09:34:17 - Connection status: False TXclient_alive: False 09:34:17 - Entering set_external_delay 09:34:17 - Setting ExternalDelayLocal to 0.000 ns 09:34:17 - Writing 0.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v 09:34:17 - Entering set_external_delay 09:34:17 - Setting ExternalDelayCalibration to 65.000 ns 09:34:17 - Writing 65.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v 09:34:17 - Entering set_external_delay 09:34:17 - Setting ExternalDelaySphe to 150.000 ns 09:34:17 - Writing 150.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v 09:34:17 - Setting TIB trigger mode to 0x74 = TriggerMask.SlowControl|Pedestal|Software|Calibration 09:34:17 - Writing 116 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v 09:34:17 - Writing 1 to Camera.TIB.InputsEnable.InputMask.InputMask_v 09:34:17 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v 09:34:17 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v 09:34:17 - Writing False to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v 09:34:18 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v 09:34:18 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v 09:34:18 - Status: TibState.PpsStopped 09:34:18 - Alarms: AlarmVector.NoAlarm 09:34:18 - Connection status: False TXclient_alive: False 09:34:18 - Writing True to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v 09:34:18 - Writing 100 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v 09:34:18 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 09:34:18 - Writing False to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v 09:34:18 - Writing 100 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v 09:34:18 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v 09:34:18 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 09:34:18 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v 09:34:18 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v 09:34:18 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 09:34:18 - Checking for high voltage locked pixels... 09:34:21 - Starting NMC 09:34:21 - Clearing PPS error counters 09:34:24 - Connecting TIB to camera server at 10.10.4.12:222 09:34:24 - Starting TIB... 09:34:24 - Status: TibState.PpsStopped 09:34:24 - Alarms: AlarmVector.NoAlarm 09:34:24 - Connection status: False TXclient_alive: False 09:34:24 - Resetting run 09:34:24 - Wait for UCTS external trigger before enabling trigger... 09:34:24 - Status: TibState.Standby 09:34:24 - Alarms: AlarmVector.NoAlarm 09:34:24 - Connection status: False TXclient_alive: True 09:34:24 - Status: TibState.Standby 09:34:24 - Alarms: AlarmVector.NoAlarm 09:34:24 - Connection status: False TXclient_alive: True 09:34:25 - Status: TibState.Armed 09:34:25 - Alarms: AlarmVector.NoAlarm 09:34:25 - Connection status: False TXclient_alive: True 09:34:27 - Starting TIB triggers... 09:34:27 - Enabling trigger 09:34:27 - Status: TibState.Running 09:34:27 - Alarms: AlarmVector.NoAlarm 09:34:27 - Connection status: False TXclient_alive: True 09:34:28 - Status: TibState.Running ConnectionStatus: False TXclient_alive: True 09:34:28 - Alarms: AlarmVector.NoAlarm 09:34:28 - Temperature: 33.44 09:34:28 - Local camera rate: 0.0 Hz 09:34:28 - Stereo trigger rate: 0.0 Hz 09:34:28 - SPE trigger rate: 0.0 Hz 09:34:28 - Calibration trigger rate: 0.0 Hz 09:34:28 - Software trigger rate: 0.0 Hz 09:34:28 - Pedestal trigger rate: 100.0 Hz 09:34:28 - Collected trigger rate: 43.0 Hz 09:34:28 - Busy rate: 0.0 Hz 09:34:28 - Camera trigger rate: 43.0 Hz 09:34:31 - Status: TibState.Running ConnectionStatus: False TXclient_alive: True 09:34:31 - Alarms: AlarmVector.NoAlarm 09:34:31 - Temperature: 33.50 09:34:31 - Local camera rate: 0.0 Hz 09:34:31 - Stereo trigger rate: 0.0 Hz 09:34:31 - SPE trigger rate: 0.0 Hz 09:34:31 - Calibration trigger rate: 0.0 Hz 09:34:31 - Software trigger rate: 0.0 Hz 09:34:31 - Pedestal trigger rate: 100.0 Hz 09:34:31 - Collected trigger rate: 100.0 Hz 09:34:31 - Busy rate: 0.0 Hz 09:34:31 - Camera trigger rate: 100.0 Hz 09:34:33 - Stopping TIB... 09:34:33 - Status: TibState.Running 09:34:33 - Alarms: AlarmVector.NoAlarm 09:34:33 - Connection status: False TXclient_alive: True 09:34:33 - Disabling trigger 09:34:33 - Disabling PPS 09:34:35 - Status: TibState.PpsStopped 09:34:35 - Alarms: AlarmVector.NoAlarm 09:34:35 - Connection status: False TXclient_alive: True 09:34:35 - Closing TIB connection to camera server 09:34:36 - Resetting TIB... 09:34:40 - Stopping NMC 09:34:40 - Found 0 PPS errors. 09:34:42 - Starting NMC 09:34:42 - Clearing PPS error counters 09:34:48 - Checking for high voltage locked pixels... 09:35:18 - Checking for high voltage locked pixels... 09:35:48 - Checking for high voltage locked pixels... 09:36:18 - Checking for high voltage locked pixels... 09:36:48 - Checking for high voltage locked pixels... 09:37:18 - Checking for high voltage locked pixels... 09:37:48 - Checking for high voltage locked pixels... 09:38:18 - Checking for high voltage locked pixels... 09:38:25 - Starting task "Check high voltages" 09:38:25 - Found 2 drawer(s) in Nominal state, 0 in Low state and 0 in Wait state 09:38:26 - Actual voltage is between 984.54 V and 1117.52 V. 09:38:26 - Low voltages range between 300.00 V and 300.00 V. 09:38:26 - Reference voltages range between 984.98 V and 1117.51 V. 09:38:27 - Maximum difference between expected and actual voltages is 0.45 V 09:38:27 - Maximum of current limits is 4840.96 uA 09:38:27 - Checking status of HVPA module in 2 drawer(s)... 09:38:27 - Checking status of HVPA channels in 2 drawer(s)... 09:38:27 - HV is stabilized in all channels. 09:38:27 - Checking reference and low voltages against /data/config/2021/20210315/config_tower_2modules_FEBv6_pingpong_DelayBusy0_newDACL_newHV2.NMC.xml 09:38:28 - Done 09:38:28 - Finished task "Check high voltages" 09:38:38 - Calling method FSM.gotoObserving in object FSM 09:38:48 - Checking for high voltage locked pixels... 09:39:18 - Checking for high voltage locked pixels... 09:39:48 - Checking for high voltage locked pixels... 09:40:18 - Checking for high voltage locked pixels... 09:40:45 - Configuring calibration box... 09:40:45 - Configuring calibration box with leds=0x358 voltage=8.75 frequency=1000.0/1 central_current=0.0 duration=0 width=1 lemo_out=True fiber1_out=True fiber2_out=True lemo_in=True enabled=True 09:40:48 - Checking for high voltage locked pixels... 09:40:51 - Status: TibState.RunStopped ConnectionStatus: False TXclient_alive: False 09:40:51 - Alarms: AlarmVector.NoAlarm 09:40:51 - Temperature: 33.56 09:40:51 - Local camera rate: 0.0 Hz 09:40:51 - Stereo trigger rate: 0.0 Hz 09:40:51 - SPE trigger rate: 0.0 Hz 09:40:51 - Calibration trigger rate: 7221.0 Hz 09:40:51 - Software trigger rate: 0.0 Hz 09:40:51 - Pedestal trigger rate: 0.0 Hz 09:40:51 - Collected trigger rate: 0.0 Hz 09:40:51 - Busy rate: 0.0 Hz 09:40:51 - Camera trigger rate: 0.0 Hz 09:40:53 - Status: TibState.RunStopped ConnectionStatus: False TXclient_alive: False 09:40:53 - Alarms: AlarmVector.NoAlarm 09:40:53 - Temperature: 33.56 09:40:53 - Local camera rate: 0.0 Hz 09:40:53 - Stereo trigger rate: 0.0 Hz 09:40:53 - SPE trigger rate: 0.0 Hz 09:40:53 - Calibration trigger rate: 7223.0 Hz 09:40:53 - Software trigger rate: 0.0 Hz 09:40:53 - Pedestal trigger rate: 0.0 Hz 09:40:53 - Collected trigger rate: 0.0 Hz 09:40:53 - Busy rate: 0.0 Hz 09:40:53 - Camera trigger rate: 0.0 Hz 09:41:18 - Checking for high voltage locked pixels... 09:41:40 - Checking UCTS clock... 09:41:40 - UCTS clock is late by 5 seconds! 09:41:40 - Configuring UCTS 09:41:40 - Configuring TIB... 09:41:40 - Setting TIB forced mode to False 09:41:40 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v 09:41:40 - Status: TibState.RunStopped 09:41:40 - Alarms: AlarmVector.NoAlarm 09:41:40 - Connection status: False TXclient_alive: False 09:41:40 - Disabling PPS 09:41:43 - Status: TibState.PpsStopped 09:41:43 - Alarms: AlarmVector.NoAlarm 09:41:43 - Connection status: False TXclient_alive: False 09:41:43 - Entering set_external_delay 09:41:43 - Setting ExternalDelayLocal to 0.000 ns 09:41:43 - Writing 0.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v 09:41:43 - Entering set_external_delay 09:41:43 - Setting ExternalDelayCalibration to 65.000 ns 09:41:43 - Writing 65.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v 09:41:43 - Entering set_external_delay 09:41:43 - Setting ExternalDelaySphe to 150.000 ns 09:41:43 - Writing 150.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v 09:41:43 - Setting TIB trigger mode to 0x74 = TriggerMask.SlowControl|Pedestal|Software|Calibration 09:41:43 - Writing 116 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v 09:41:43 - Writing 1 to Camera.TIB.InputsEnable.InputMask.InputMask_v 09:41:43 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v 09:41:43 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v 09:41:43 - Writing False to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v 09:41:43 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v 09:41:43 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v 09:41:43 - Status: TibState.PpsStopped 09:41:43 - Alarms: AlarmVector.NoAlarm 09:41:43 - Connection status: False TXclient_alive: False 09:41:43 - Writing True to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v 09:41:43 - Writing 100 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v 09:41:43 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 09:41:43 - Writing False to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v 09:41:43 - Writing 100 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v 09:41:43 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v 09:41:43 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 09:41:43 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v 09:41:43 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v 09:41:43 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 09:41:45 - Connecting TIB to camera server at 10.10.4.12:222 09:41:45 - Starting TIB... 09:41:45 - Status: TibState.PpsStopped 09:41:45 - Alarms: AlarmVector.NoAlarm 09:41:45 - Connection status: False TXclient_alive: True 09:41:45 - Resetting run 09:41:45 - Wait for UCTS external trigger before enabling trigger... 09:41:45 - Status: TibState.Standby 09:41:45 - Alarms: AlarmVector.NoAlarm 09:41:45 - Connection status: False TXclient_alive: True 09:41:45 - Status: TibState.Standby 09:41:45 - Alarms: AlarmVector.NoAlarm 09:41:45 - Connection status: False TXclient_alive: True 09:41:46 - Status: TibState.Armed 09:41:46 - Alarms: AlarmVector.NoAlarm 09:41:46 - Connection status: False TXclient_alive: True 09:41:48 - Checking for high voltage locked pixels... 09:41:50 - Starting TIB triggers... 09:41:50 - Enabling trigger 09:41:50 - Status: TibState.Running 09:41:50 - Alarms: AlarmVector.NoAlarm 09:41:50 - Connection status: True TXclient_alive: True 09:41:53 - Status: TibState.Running ConnectionStatus: True TXclient_alive: True 09:41:53 - Alarms: AlarmVector.NoAlarm 09:41:53 - Temperature: 33.56 09:41:53 - Local camera rate: 0.0 Hz 09:41:53 - Stereo trigger rate: 0.0 Hz 09:41:53 - SPE trigger rate: 0.0 Hz 09:41:53 - Calibration trigger rate: 7250.0 Hz 09:41:53 - Software trigger rate: 0.0 Hz 09:41:53 - Pedestal trigger rate: 100.0 Hz 09:41:53 - Collected trigger rate: 7312.0 Hz 09:41:53 - Busy rate: 11.0 Hz 09:41:53 - Camera trigger rate: 7301.0 Hz 09:42:06 - Stopping TIB... 09:42:06 - Status: TibState.Running 09:42:06 - Alarms: AlarmVector.NoAlarm 09:42:06 - Connection status: True TXclient_alive: True 09:42:06 - Disabling trigger 09:42:07 - Disabling PPS 09:42:08 - Status: TibState.PpsStopped 09:42:08 - Alarms: AlarmVector.NoAlarm 09:42:08 - Connection status: True TXclient_alive: True 09:42:08 - Closing TIB connection to camera server 09:42:09 - Status: TibState.PpsStopped 09:42:09 - Alarms: AlarmVector.NoAlarm 09:42:09 - Connection status: False TXclient_alive: False 09:42:09 - Run duration: 0:00:20 09:42:09 - Local camera triggers: 0 09:42:09 - Slow control triggers: 0 09:42:09 - Single photo-electron triggers: 0 09:42:09 - Calibration triggers: 144485 09:42:09 - Software triggers from UCTS: 0 09:42:09 - Pedestal triggers: 1990 09:42:09 - Collected input triggers: 117054 09:42:09 - Busy triggers: 226 09:42:09 - Camera event triggers sent to clusters: 116828 09:42:15 - Calling method FSM.gotoReady in object FSM 09:42:17 - Stopping NMC 09:42:18 - Found 0 PPS errors. 09:42:18 - Checking for high voltage locked pixels...