22:05:04 - Successfully configured 2 module(s)
22:05:05 - All front-end boards are programmed with firmware 61210216
22:05:05 - All backplanes are programmed with firmware 15
22:05:05 - NMC is in state NmcState.Configured and knows of 2 drawer(s)
22:05:05 - Found 0 PPS errors.
22:05:06 - Finished task "Configure modules"
22:05:13 - Checking for high voltage locked pixels...
22:05:43 - Checking for high voltage locked pixels...
22:06:13 - Checking for high voltage locked pixels...
22:06:40 - Starting task "Configure modules"
22:06:40 - Setting L0 thresholds to 5.0 p.e. per pixel using L0 slopes and offsets in /data/luts/l0_threshold_slope_and_offset_feb_20200708.h5
22:06:40 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/utils/branches/v5.5.1-40061 
22:06:40 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/libNectarCam/branches/v5.5.1-40061 
22:06:40 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/libQNectarCam/branches/v5.5.1-40061 
22:06:40 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/qNectarcamModuleController/branches/v5.5.1-40061
22:06:40 - Configuring modules with configuration /data/config/2021/20210317/config_2021-03-17_22-06-40.NMC.xml
22:06:40 - Switching off high voltages in configuration
22:06:43 - Successfully configured 2 module(s)
22:06:43 - Checking for high voltage locked pixels...
22:06:44 - All front-end boards are programmed with firmware 61210216
22:06:44 - All backplanes are programmed with firmware 15
22:06:44 - NMC is in state NmcState.Configured and knows of 2 drawer(s)
22:06:44 - Found 0 PPS errors.
22:06:45 - Finished task "Configure modules"
22:06:46 - Starting task "Switch HVPA voltage state"
22:06:46 - Setting HVPA current limit to 12489.75 uA
22:06:46 - Setting HVPA ramp speed to 25 V/s
22:06:47 - Switching HVPA to state Nominal
22:06:54 - Setting HVPA current limits...
22:06:55 - Finished task "Switch HVPA voltage state"
22:07:13 - Checking for high voltage locked pixels...
22:07:13 - Module 84 has 1 pixel(s) locked (HVPA status of 0x3f)!
22:07:13 - Module 85 has 1 pixel(s) locked (HVPA status of 0x3f)!
22:07:13 - Unlocking 2 channel(s)...
22:07:13 - Resetting HVPA channel 6 of drawer 84...
22:07:14 - Resetting HVPA channel 6 of drawer 85...
22:07:39 - Configuring calibration box...
22:07:39 - Configuring calibration box with leds=0x358 voltage=10.49 frequency=400.0/4 central_current=0.0 duration=0 width=1 lemo_out=True fiber1_out=True fiber2_out=True lemo_in=False enabled=False
22:07:43 - Checking for high voltage locked pixels...
22:07:43 - Module 84 has 1 pixel(s) locked (HVPA status of 0x3f)!
22:07:43 - Module 85 has 1 pixel(s) locked (HVPA status of 0x3f)!
22:07:43 - Unlocking 2 channel(s)...
22:07:43 - Resetting HVPA channel 6 of drawer 84...
22:07:44 - Resetting HVPA channel 6 of drawer 85...
22:07:47 - Starting flashes...
22:07:53 - Starting task "Check high voltages"
22:07:53 - Found 2 drawer(s) in Nominal state, 0 in Low state and 0 in Wait state
22:07:54 - Actual voltage is between 148.84 V and 1117.52 V.
22:07:54 - Low voltages range between 300.00 V and 300.00 V. 
22:07:54 - Reference voltages range between 0.00 V and 1117.51 V. 
22:07:55 - Maximum difference between expected and actual voltages is 148.84 V
22:07:55 - Maximum of current limits is 4840.96 uA
22:07:55 - Checking status of HVPA module in 2 drawer(s)...
22:07:55 - HVPA module in drawer 84 has a status of 0x3f!
22:07:55 - HVPA module in drawer 85 has a status of 0x3f!
22:07:55 - Checking status of HVPA channels in 2 drawer(s)...
22:07:55 - HVPA channel 6 of drawer 84 has status 0x8003!
22:07:55 - HVPA channel 6 of drawer 85 has status 0x8003!
22:07:55 - HV is locked in 2 channel(s), was in rise default in 0 channel(s) and was still in progress in 0 channel(s)
22:07:55 - Resetting 2 channel(s)...
22:07:55 - Resetting HVPA channel 6 of drawer 84...
22:07:56 - Resetting HVPA channel 6 of drawer 85...
22:08:06 - Stopping flashes...
22:08:07 - Checking reference and low voltages against /data/config/2021/20210317/config_tower_2modules_FEBv6_pingpong_DelayBusy0_newDACL_newHV2_nd706.NMC.xml
22:08:07 - Reference voltage of channel 6 in drawer #85: expected 1009.30, read 0.00
22:08:07 - Done
22:08:07 - Finished task "Check high voltages"
22:08:11 - Starting task "Check high voltages"
22:08:11 - Found 2 drawer(s) in Nominal state, 0 in Low state and 0 in Wait state
22:08:12 - Actual voltage is between 272.67 V and 1117.52 V.
22:08:12 - Low voltages range between 300.00 V and 300.00 V. 
22:08:13 - Reference voltages range between 0.00 V and 1117.51 V. 
22:08:13 - Maximum difference between expected and actual voltages is 343.27 V
22:08:13 - Checking for high voltage locked pixels...
22:08:13 - Module 85 has 1 pixel(s) locked (HVPA status of 0x3f)!
22:08:13 - Unlocking 1 channel(s)...
22:08:13 - Resetting HVPA channel 6 of drawer 85...
22:08:13 - Maximum of current limits is 12489.75 uA
22:08:13 - Checking status of HVPA module in 2 drawer(s)...
22:08:13 - Checking status of HVPA channels in 2 drawer(s)...
22:08:14 - HV is locked in 0 channel(s), was in rise default in 0 channel(s) and was still in progress in 2 channel(s)
22:08:14 - Checking reference and low voltages against /data/config/2021/20210317/config_tower_2modules_FEBv6_pingpong_DelayBusy0_newDACL_newHV2_nd706.NMC.xml
22:08:14 - Done
22:08:14 - Finished task "Check high voltages"
22:08:23 - Starting task "Check high voltages"
22:08:24 - Found 2 drawer(s) in Nominal state, 0 in Low state and 0 in Wait state
22:08:24 - Actual voltage is between 405.04 V and 1117.52 V.
22:08:24 - Low voltages range between 300.00 V and 300.00 V. 
22:08:25 - Reference voltages range between 984.98 V and 1117.51 V. 
22:08:25 - Maximum difference between expected and actual voltages is 555.46 V
22:08:25 - Maximum of current limits is 4840.96 uA
22:08:25 - Checking status of HVPA module in 2 drawer(s)...
22:08:25 - Checking status of HVPA channels in 2 drawer(s)...
22:08:26 - HV is locked in 0 channel(s), was in rise default in 0 channel(s) and was still in progress in 1 channel(s)
22:08:26 - Checking reference and low voltages against /data/config/2021/20210317/config_tower_2modules_FEBv6_pingpong_DelayBusy0_newDACL_newHV2_nd706.NMC.xml
22:08:26 - Done
22:08:26 - Finished task "Check high voltages"
22:08:35 - Starting task "Check high voltages"
22:08:35 - Found 2 drawer(s) in Nominal state, 0 in Low state and 0 in Wait state
22:08:35 - Actual voltage is between 855.22 V and 1117.52 V.
22:08:36 - Low voltages range between 300.00 V and 300.00 V. 
22:08:36 - Reference voltages range between 984.98 V and 1117.51 V. 
22:08:36 - Maximum difference between expected and actual voltages is 107.11 V
22:08:37 - Maximum of current limits is 4840.96 uA
22:08:37 - Checking status of HVPA module in 2 drawer(s)...
22:08:37 - Checking status of HVPA channels in 2 drawer(s)...
22:08:37 - HV is locked in 0 channel(s), was in rise default in 0 channel(s) and was still in progress in 1 channel(s)
22:08:37 - Checking reference and low voltages against /data/config/2021/20210317/config_tower_2modules_FEBv6_pingpong_DelayBusy0_newDACL_newHV2_nd706.NMC.xml
22:08:37 - Done
22:08:38 - Finished task "Check high voltages"
22:08:43 - Checking for high voltage locked pixels...
22:08:58 - Calling method FSM.gotoObserving in object FSM
22:09:03 - Calling method FSM.gotoReady in object FSM
22:09:06 - Calling method FSM.gotoObserving in object FSM
22:09:13 - Checking for high voltage locked pixels...
22:09:27 - Starting task "Check high voltages"
22:09:27 - Found 2 drawer(s) in Nominal state, 0 in Low state and 0 in Wait state
22:09:27 - Actual voltage is between 984.54 V and 1117.52 V.
22:09:27 - Low voltages range between 300.00 V and 300.00 V. 
22:09:28 - Reference voltages range between 984.98 V and 1117.51 V. 
22:09:28 - Maximum difference between expected and actual voltages is 0.60 V
22:09:28 - Maximum of current limits is 4840.96 uA
22:09:28 - Checking status of HVPA module in 2 drawer(s)...
22:09:29 - Checking status of HVPA channels in 2 drawer(s)...
22:09:29 - HV is locked in 0 channel(s), was in rise default in 0 channel(s) and was still in progress in 1 channel(s)
22:09:29 - Checking reference and low voltages against /data/config/2021/20210317/config_tower_2modules_FEBv6_pingpong_DelayBusy0_newDACL_newHV2_nd706.NMC.xml
22:09:29 - Done
22:09:29 - Finished task "Check high voltages"
22:09:33 - Starting NMC
22:09:33 - Clearing PPS error counters
22:09:37 - Starting flashes...
22:09:43 - Checking for high voltage locked pixels...
22:09:45 - Checking UCTS clock...
22:09:46 - UCTS clock is late by 6 seconds!
22:09:46 - Configuring UCTS
22:09:46 - Configuring TIB...
22:09:46 - Setting TIB forced mode to False
22:09:46 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v
22:09:46 - Status: TibState.PpsStopped
22:09:46 - Alarms: AlarmVector.NoAlarm
22:09:46 - Connection status: False TXclient_alive: False
22:09:46 - Entering set_external_delay
22:09:46 - Setting ExternalDelayLocal to 0.000 ns
22:09:46 - Writing 0.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v
22:09:46 - Entering set_external_delay
22:09:46 - Setting ExternalDelayCalibration to 43.000 ns
22:09:46 - Writing 43.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v
22:09:46 - Entering set_external_delay
22:09:46 - Setting ExternalDelaySphe to 150.000 ns
22:09:46 - Writing 150.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v
22:09:46 - Setting TIB trigger mode to 0x75 = TriggerMask.SlowControl|Pedestal|Software|Calibration|Mono
22:09:46 - Writing 117 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v
22:09:46 - Writing 1 to Camera.TIB.InputsEnable.InputMask.InputMask_v
22:09:46 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v
22:09:47 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v
22:09:47 - Writing False to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v
22:09:47 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v
22:09:47 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v
22:09:47 - Status: TibState.PpsStopped
22:09:47 - Alarms: AlarmVector.NoAlarm
22:09:47 - Connection status: False TXclient_alive: False
22:09:47 - Writing True to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v
22:09:47 - Writing 100 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v
22:09:47 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
22:09:47 - Writing False to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v
22:09:47 - Writing 100 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v
22:09:47 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v
22:09:47 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
22:09:47 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v
22:09:47 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v
22:09:47 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
22:09:50 - Connecting TIB to camera server at 10.10.4.12:222
22:09:50 - Starting TIB...
22:09:50 - Status: TibState.PpsStopped
22:09:50 - Alarms: AlarmVector.NoAlarm
22:09:50 - Connection status: False TXclient_alive: True
22:09:50 - Resetting run
22:09:50 - Wait for UCTS external trigger before enabling trigger...
22:09:50 - Status: TibState.Standby
22:09:50 - Alarms: AlarmVector.NoAlarm
22:09:50 - Connection status: False TXclient_alive: True
22:09:51 - Status: TibState.Standby
22:09:51 - Alarms: AlarmVector.NoAlarm
22:09:51 - Connection status: False TXclient_alive: True
22:09:52 - Status: TibState.Armed
22:09:52 - Alarms: AlarmVector.NoAlarm
22:09:52 - Connection status: True TXclient_alive: True
22:09:55 - Starting TIB triggers...
22:09:55 - Enabling trigger
22:09:55 - Status: TibState.Running
22:09:55 - Alarms: AlarmVector.ReadError
22:09:55 - Connection status: True TXclient_alive: True
22:10:00 - Status: TibState.Running ConnectionStatus: True TXclient_alive: True
22:10:00 - Alarms: AlarmVector.ReadError
22:10:00 - Temperature: 33.25
22:10:00 - Local camera rate: 100.0 Hz
22:10:00 - Stereo trigger rate: 0.0 Hz
22:10:00 - SPE trigger rate: 0.0 Hz
22:10:00 - Calibration trigger rate: 100.0 Hz
22:10:00 - Software trigger rate: 0.0 Hz
22:10:00 - Pedestal trigger rate: 100.0 Hz
22:10:00 - Collected trigger rate: 200.0 Hz
22:10:00 - Busy rate: 0.0 Hz
22:10:00 - Camera trigger rate: 200.0 Hz
22:10:04 - Status: TibState.Running ConnectionStatus: True TXclient_alive: True
22:10:04 - Alarms: AlarmVector.ReadError
22:10:04 - Temperature: 33.25
22:10:04 - Local camera rate: 100.0 Hz
22:10:04 - Stereo trigger rate: 0.0 Hz
22:10:04 - SPE trigger rate: 0.0 Hz
22:10:04 - Calibration trigger rate: 100.0 Hz
22:10:04 - Software trigger rate: 0.0 Hz
22:10:04 - Pedestal trigger rate: 100.0 Hz
22:10:04 - Collected trigger rate: 200.0 Hz
22:10:04 - Busy rate: 0.0 Hz
22:10:04 - Camera trigger rate: 200.0 Hz
22:10:13 - Checking for high voltage locked pixels...
22:10:43 - Checking for high voltage locked pixels...
22:11:13 - Checking for high voltage locked pixels...
22:11:43 - Checking for high voltage locked pixels...
22:12:13 - Checking for high voltage locked pixels...
22:12:43 - Checking for high voltage locked pixels...
22:13:13 - Checking for high voltage locked pixels...
22:13:43 - Checking for high voltage locked pixels...
22:14:07 - Stopping TIB...
22:14:07 - Status: TibState.Running
22:14:07 - Alarms: AlarmVector.ReadError
22:14:07 - Connection status: True TXclient_alive: True
22:14:07 - Disabling trigger
22:14:07 - Disabling PPS
22:14:08 - Status: TibState.PpsStopped
22:14:08 - Alarms: AlarmVector.ReadError
22:14:08 - Connection status: True TXclient_alive: True
22:14:08 - Closing TIB connection to camera server
22:14:09 - Status: TibState.PpsStopped
22:14:09 - Alarms: AlarmVector.ReadError
22:14:09 - Connection status: False TXclient_alive: False
22:14:09 - Run duration: 0:04:16
22:14:09 - Local camera triggers: 25559
22:14:09 - Slow control triggers: 0
22:14:09 - Single photo-electron triggers: 0
22:14:09 - Calibration triggers: 25554
22:14:09 - Software triggers from UCTS: 0
22:14:09 - Pedestal triggers: 25555
22:14:09 - Collected input triggers: 50497
22:14:09 - Busy triggers: 0
22:14:09 - Camera event triggers sent to clusters: 50497
22:14:13 - Checking for high voltage locked pixels...
22:14:13 - Calling method FSM.gotoReady in object FSM
22:14:17 - Stopping NMC
22:14:17 - Found 0 PPS errors.