15:11:54 - Starting task "Configure modules" 15:11:54 - Setting L0 thresholds to 15.0 p.e. per pixel using L0 slopes and offsets in /data/luts/l0_threshold_slope_and_offset_feb_20200708.h5 15:11:56 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/utils/branches/v5.5.1-40061 15:11:56 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/libNectarCam/branches/v5.5.1-40061 15:11:56 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/libQNectarCam/branches/v5.5.1-40061 15:11:56 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/qNectarcamModuleController/branches/v5.5.1-40061 15:11:56 - Configuring modules with configuration /data/config/2021/20210317/config_2021-03-17_15-11-54.NMC.xml 15:11:56 - Switching off high voltages in configuration 15:12:00 - Successfully configured 2 module(s) 15:12:00 - All front-end boards are programmed with firmware 61210216 15:12:00 - All backplanes are programmed with firmware 15 15:12:01 - NMC is in state NmcState.Configured and knows of 2 drawer(s) 15:12:01 - Found 0 PPS errors. 15:12:01 - Finished task "Configure modules" 15:12:03 - Starting task "Switch HVPA voltage state" 15:12:03 - Setting HVPA current limit to 12489.75 uA 15:12:03 - Setting HVPA ramp speed to 25 V/s 15:12:04 - Switching HVPA to state Nominal 15:12:08 - High voltage locked channels will be checked every 30 s 15:12:11 - Setting HVPA current limits... 15:12:12 - Finished task "Switch HVPA voltage state" 15:12:38 - Checking for high voltage locked pixels... 15:13:08 - Checking for high voltage locked pixels... 15:13:38 - Checking for high voltage locked pixels... 15:14:08 - Checking for high voltage locked pixels... 15:14:38 - Checking for high voltage locked pixels... 15:15:08 - Checking for high voltage locked pixels... 15:15:16 - Starting task "Switch HVPA voltage state" 15:15:16 - Setting HVPA current limit to 12489.75 uA 15:15:17 - Setting HVPA ramp speed to 500 V/s 15:15:17 - Switching HVPA to state Wait 15:15:24 - Setting HVPA current limits... 15:15:25 - Finished task "Switch HVPA voltage state" 15:15:27 - Calling method FSM.gotoObserving in object FSM 15:15:38 - Checking for high voltage locked pixels... 15:16:08 - Checking for high voltage locked pixels... 15:16:38 - Checking for high voltage locked pixels... 15:17:08 - Checking for high voltage locked pixels... 15:17:38 - Checking for high voltage locked pixels... 15:18:08 - Checking for high voltage locked pixels... 15:18:38 - Checking for high voltage locked pixels... 15:19:08 - Checking for high voltage locked pixels... 15:19:38 - Checking for high voltage locked pixels... 15:20:08 - Checking for high voltage locked pixels... 15:20:38 - Checking for high voltage locked pixels... 15:21:08 - Checking for high voltage locked pixels... 15:21:38 - Checking for high voltage locked pixels... 15:22:08 - Checking for high voltage locked pixels... 15:22:38 - Checking for high voltage locked pixels... 15:23:08 - Checking for high voltage locked pixels... 15:23:38 - Checking for high voltage locked pixels... 15:24:08 - Checking for high voltage locked pixels... 15:24:38 - Checking for high voltage locked pixels... 15:25:02 - Starting task "Switch HVPA voltage state" 15:25:03 - Setting HVPA current limit to 12489.75 uA 15:25:03 - Setting HVPA ramp speed to 25 V/s 15:25:03 - Switching HVPA to state Nominal 15:25:08 - Checking for high voltage locked pixels... 15:25:10 - Setting HVPA current limits... 15:25:12 - Finished task "Switch HVPA voltage state" 15:25:21 - Updating voltage widget... 15:25:24 - Updating voltage widget... 15:25:25 - Updating voltage widget... 15:25:27 - Updating voltage widget... 15:25:28 - Updating voltage widget... 15:25:29 - Updating voltage widget... 15:25:30 - Updating voltage widget... 15:25:32 - Updating voltage widget... 15:25:33 - Updating voltage widget... 15:25:34 - Updating voltage widget... 15:25:35 - Updating voltage widget... 15:25:36 - Updating voltage widget... 15:25:37 - Updating voltage widget... 15:25:38 - Checking for high voltage locked pixels... 15:25:39 - Updating voltage widget... 15:25:40 - Updating voltage widget... 15:25:41 - Updating voltage widget... 15:25:43 - Updating voltage widget... 15:25:45 - Updating voltage widget... 15:25:47 - Updating voltage widget... 15:25:49 - Starting task "Check high voltages" 15:25:49 - Found 2 drawer(s) in Nominal state, 0 in Low state and 0 in Wait state 15:25:49 - Actual voltage is between 984.54 V and 1117.52 V. 15:25:49 - Low voltages range between 300.00 V and 300.00 V. 15:25:50 - Reference voltages range between 984.98 V and 1117.51 V. 15:25:50 - Maximum difference between expected and actual voltages is 0.45 V 15:25:50 - Maximum of current limits is 4840.96 uA 15:25:50 - Checking status of HVPA module in 2 drawer(s)... 15:25:50 - Checking status of HVPA channels in 2 drawer(s)... 15:25:51 - HV is stabilized in all channels. 15:25:51 - Checking reference and low voltages against /data/config/2021/20210317/config_tower_2modules_FEBv6_pingpong_DelayBusy0_newDACL_newHV2.NMC.xml 15:25:51 - Done 15:25:51 - Finished task "Check high voltages" 15:25:55 - Starting NMC 15:25:55 - Clearing PPS error counters 15:26:01 - Starting task "Set DTC trigger masks" 15:26:01 - Configuring DTC trigger masks for 2 configured module(s) 15:26:01 - Setting DTC slot 1 trigger mask to 0x0000 15:26:01 - Setting DTC slot 5 trigger mask to 0x0000 15:26:02 - Setting DTC slot 6 trigger mask to 0x0000 15:26:02 - Setting DTC slot 9 trigger mask to 0x0000 15:26:02 - Setting DTC slot 13 trigger mask to 0x0000 15:26:02 - Setting DTC slot 14 trigger mask to 0x0000 15:26:02 - Setting DTC slot 15 trigger mask to 0x0000 15:26:02 - Setting DTC slot 19 trigger mask to 0x9000 15:26:02 - Finished task "Set DTC trigger masks" 15:26:08 - Checking for high voltage locked pixels... 15:26:09 - Configuring calibration box... 15:26:09 - Configuring calibration box with leds=0x358 voltage=10.50 frequency=300.0/30 central_current=0.0 duration=0 width=1 lemo_out=True fiber1_out=True fiber2_out=True lemo_in=True enabled=True 15:26:23 - Checking UCTS clock... 15:26:23 - UCTS clock is late by 6 seconds! 15:26:23 - Configuring UCTS 15:26:23 - Configuring TIB... 15:26:23 - Setting TIB forced mode to False 15:26:23 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v 15:26:23 - Status: TibState.PpsStopped 15:26:23 - Alarms: AlarmVector.ReadError 15:26:23 - Connection status: False TXclient_alive: False 15:26:23 - Entering set_external_delay 15:26:23 - Setting ExternalDelayLocal to 0.000 ns 15:26:23 - Writing 0.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v 15:26:24 - Entering set_external_delay 15:26:24 - Setting ExternalDelayCalibration to 65.000 ns 15:26:24 - Writing 65.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v 15:26:24 - Entering set_external_delay 15:26:24 - Setting ExternalDelaySphe to 150.000 ns 15:26:24 - Writing 150.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v 15:26:24 - Setting TIB trigger mode to 0x75 = TriggerMask.SlowControl|Pedestal|Software|Calibration|Mono 15:26:24 - Writing 117 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v 15:26:24 - Writing 1 to Camera.TIB.InputsEnable.InputMask.InputMask_v 15:26:24 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v 15:26:24 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v 15:26:24 - Writing False to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v 15:26:24 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v 15:26:24 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v 15:26:24 - Status: TibState.PpsStopped 15:26:24 - Alarms: AlarmVector.ReadError 15:26:24 - Connection status: False TXclient_alive: False 15:26:24 - Writing True to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v 15:26:24 - Writing 100 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v 15:26:24 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 15:26:24 - Writing False to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v 15:26:24 - Writing 100 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v 15:26:24 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v 15:26:24 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 15:26:24 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v 15:26:24 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v 15:26:24 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 15:26:27 - Connecting TIB to camera server at 10.10.4.12:222 15:26:27 - Starting TIB... 15:26:27 - Status: TibState.PpsStopped 15:26:27 - Alarms: AlarmVector.ReadError 15:26:27 - Connection status: False TXclient_alive: True 15:26:27 - Resetting run 15:26:27 - Wait for UCTS external trigger before enabling trigger... 15:26:27 - Status: TibState.Standby 15:26:27 - Alarms: AlarmVector.NoAlarm 15:26:28 - Connection status: False TXclient_alive: True 15:26:28 - Status: TibState.Standby 15:26:28 - Alarms: AlarmVector.NoAlarm 15:26:28 - Connection status: False TXclient_alive: True 15:26:29 - Status: TibState.Armed 15:26:29 - Alarms: AlarmVector.NoAlarm 15:26:29 - Connection status: False TXclient_alive: True 15:26:32 - Starting TIB triggers... 15:26:32 - Enabling trigger 15:26:32 - Status: TibState.Running 15:26:32 - Alarms: AlarmVector.NoAlarm 15:26:32 - Connection status: True TXclient_alive: True 15:26:35 - Status: TibState.Running ConnectionStatus: True TXclient_alive: True 15:26:35 - Alarms: AlarmVector.NoAlarm 15:26:35 - Temperature: 33.25 15:26:35 - Local camera rate: 7312.0 Hz 15:26:35 - Stereo trigger rate: 0.0 Hz 15:26:35 - SPE trigger rate: 0.0 Hz 15:26:35 - Calibration trigger rate: 7455.0 Hz 15:26:35 - Software trigger rate: 0.0 Hz 15:26:35 - Pedestal trigger rate: 100.0 Hz 15:26:35 - Collected trigger rate: 7515.0 Hz 15:26:35 - Busy rate: 13.0 Hz 15:26:35 - Camera trigger rate: 7502.0 Hz 15:26:38 - Checking for high voltage locked pixels... 15:26:42 - Status: TibState.Running ConnectionStatus: True TXclient_alive: True 15:26:42 - Alarms: AlarmVector.NoAlarm 15:26:42 - Temperature: 33.19 15:26:42 - Local camera rate: 7360.0 Hz 15:26:42 - Stereo trigger rate: 0.0 Hz 15:26:42 - SPE trigger rate: 0.0 Hz 15:26:42 - Calibration trigger rate: 7512.0 Hz 15:26:42 - Software trigger rate: 0.0 Hz 15:26:42 - Pedestal trigger rate: 100.0 Hz 15:26:42 - Collected trigger rate: 7570.0 Hz 15:26:42 - Busy rate: 12.0 Hz 15:26:42 - Camera trigger rate: 7558.0 Hz 15:26:57 - Stopping TIB... 15:26:57 - Status: TibState.Running 15:26:57 - Alarms: AlarmVector.NoAlarm 15:26:58 - Connection status: True TXclient_alive: True 15:26:58 - Disabling trigger 15:26:58 - Disabling PPS 15:26:59 - Status: TibState.PpsStopped 15:26:59 - Alarms: AlarmVector.NoAlarm 15:26:59 - Connection status: True TXclient_alive: True 15:26:59 - Closing TIB connection to camera server 15:27:00 - Status: TibState.PpsStopped 15:27:00 - Alarms: AlarmVector.NoAlarm 15:27:00 - Connection status: False TXclient_alive: False 15:27:00 - Run duration: 0:00:29 15:27:00 - Local camera triggers: 206823 15:27:00 - Slow control triggers: 0 15:27:00 - Single photo-electron triggers: 0 15:27:00 - Calibration triggers: 211393 15:27:00 - Software triggers from UCTS: 0 15:27:00 - Pedestal triggers: 2811 15:27:00 - Collected input triggers: 196630 15:27:00 - Busy triggers: 392 15:27:00 - Camera event triggers sent to clusters: 196238 15:27:08 - Checking for high voltage locked pixels... 15:27:38 - Checking for high voltage locked pixels... 15:28:08 - Checking for high voltage locked pixels... 15:28:38 - Checking for high voltage locked pixels... 15:29:08 - Checking for high voltage locked pixels... 15:29:38 - Checking for high voltage locked pixels... 15:30:08 - Checking for high voltage locked pixels... 15:30:15 - Calling method FSM.gotoReady in object FSM 15:30:18 - Stopping NMC 15:30:18 - Found 0 PPS errors. 15:30:29 - Starting task "Switch HVPA voltage state" 15:30:29 - Setting HVPA current limit to 12489.75 uA 15:30:30 - Setting HVPA ramp speed to 500 V/s 15:30:30 - Switching HVPA to state Wait