10:31:48 - Checking for high voltage locked pixels...
10:32:15 - Starting task "Switch HVPA voltage state"
10:32:15 - Setting HVPA current limit to 12489.75 uA
10:32:16 - Setting HVPA ramp speed to 500 V/s
10:32:16 - Switching HVPA to state Wait
10:32:18 - Checking for high voltage locked pixels...
10:32:23 - Setting HVPA current limits...
10:32:24 - Finished task "Switch HVPA voltage state"
10:32:26 - Updating voltage widget...
10:32:48 - Checking for high voltage locked pixels...
10:33:14 - Updating voltage widget...
10:33:17 - Resetting NMC
10:33:18 - Checking for high voltage locked pixels...
10:33:20 - Starting task "Powering modules..."
10:33:20 - Executing command '/opt/cta/bin/cta_ctrl --slot 19 --channel 12 --power_off' on Digital Trigger Crate at 10.10.4.57
10:33:22 - Finished task "Powering modules..."
10:33:23 - Module 85 is connected to channel 15 of DTC slot 19
10:33:24 - Starting task "Powering modules..."
10:33:24 - Executing command '/opt/cta/bin/cta_ctrl --slot 19 --channel 15 --power_off' on Digital Trigger Crate at 10.10.4.57
10:33:26 - Finished task "Powering modules..."
10:33:28 - Module 84 is connected to channel 12 of DTC slot 19
10:33:31 - Starting task "Powering modules..."
10:33:31 - Executing command '/opt/cta/bin/cta_ctrl --slot 19 --channel 12 --power_on' on Digital Trigger Crate at 10.10.4.57
10:33:33 - Finished task "Powering modules..."
10:33:36 - Module 85 is connected to channel 15 of DTC slot 19
10:33:38 - Starting task "Powering modules..."
10:33:38 - Executing command '/opt/cta/bin/cta_ctrl --slot 19 --channel 15 --power_on' on Digital Trigger Crate at 10.10.4.57
10:33:39 - Finished task "Powering modules..."
10:33:45 - Scanning interface enp2s0 for non configured modules...
10:33:45 - Found 2 MAC address(es)
10:33:48 - Checking for high voltage locked pixels...
10:33:48 - Starting task "Configure modules"
10:33:48 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/utils/branches/v5.5.1-40061 
10:33:48 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/libNectarCam/branches/v5.5.1-40061 
10:33:48 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/libQNectarCam/branches/v5.5.1-40061 
10:33:48 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/qNectarcamModuleController/branches/v5.5.1-40061
10:33:48 - Configuring modules with configuration /data/config/2020/20201208/config_tower_2modules_FEBv6_pingpong_newDacl_DelayBusy8.NMC.xml
10:33:48 - Switching off high voltages in configuration
10:33:51 - Successfully configured 2 module(s)
10:33:52 - All front-end boards are programmed with firmware 61201208
10:33:52 - All backplanes are programmed with firmware 15
10:33:52 - NMC is in state NmcState.Configured and knows of 2 drawer(s)
10:33:53 - Found 0 PPS errors.
10:33:53 - Finished task "Configure modules"
10:33:54 - Starting task "Switch HVPA voltage state"
10:33:54 - Setting HVPA current limit to 12489.75 uA
10:33:55 - Setting HVPA ramp speed to 25 V/s
10:33:55 - Switching HVPA to state Nominal
10:34:02 - Setting HVPA current limits...
10:34:03 - Finished task "Switch HVPA voltage state"
10:34:07 - Calling method FSM.gotoReady in object FSM
10:34:13 - Calling method FSM.gotoObserving in object FSM
10:34:18 - Checking for high voltage locked pixels...
10:34:18 - Module 84 has 1 pixel(s) locked (HVPA status of 0x3f)!
10:34:18 - Module 85 has 1 pixel(s) locked (HVPA status of 0x3f)!
10:34:18 - Unlocking 2 channel(s)...
10:34:18 - Resetting HVPA channel 6 of drawer 84...
10:34:18 - Resetting HVPA channel 6 of drawer 85...
10:34:26 - Updating voltage widget...
10:34:34 - Stopping flashes...
10:34:42 - Starting task "Check high voltages"
10:34:42 - Found 2 drawer(s) in Nominal state, 0 in Low state and 0 in Wait state
10:34:42 - Actual voltage is between 138.47 V and 1077.26 V.
10:34:43 - Low voltages range between 300.00 V and 300.00 V. 
10:34:43 - Reference voltages range between 0.00 V and 1077.36 V. 
10:34:43 - Maximum difference between expected and actual voltages is 145.18 V
10:34:44 - Maximum of current limits is 4840.96 uA
10:34:44 - Checking status of HVPA module in 2 drawer(s)...
10:34:44 - HVPA module in drawer 84 has a status of 0x3f!
10:34:44 - HVPA module in drawer 85 has a status of 0x3f!
10:34:44 - Checking status of HVPA channels in 2 drawer(s)...
10:34:44 - HVPA channel 6 of drawer 84 has status 0x8003!
10:34:44 - HVPA channel 6 of drawer 85 has status 0x8003!
10:34:44 - HV is locked in 2 channel(s), was in rise default in 0 channel(s) and was still in progress in 0 channel(s)
10:34:44 - Resetting 2 channel(s)...
10:34:44 - Resetting HVPA channel 6 of drawer 84...
10:34:45 - Resetting HVPA channel 6 of drawer 85...
10:34:48 - Checking for high voltage locked pixels...
10:34:56 - Checking reference and low voltages against /data/config/2020/20201208/config_tower_2modules_FEBv6_pingpong_newDacl_DelayBusy8.NMC.xml
10:34:56 - Done
10:34:56 - Finished task "Check high voltages"
10:34:57 - Updating voltage widget...
10:35:00 - Updating voltage widget...
10:35:02 - Updating voltage widget...
10:35:03 - Updating voltage widget...
10:35:05 - Updating voltage widget...
10:35:06 - Updating voltage widget...
10:35:07 - Updating voltage widget...
10:35:08 - Updating voltage widget...
10:35:09 - Updating voltage widget...
10:35:10 - Updating voltage widget...
10:35:13 - Updating voltage widget...
10:35:15 - Updating voltage widget...
10:35:18 - Checking for high voltage locked pixels...
10:35:18 - Starting task "Check high voltages"
10:35:18 - Found 2 drawer(s) in Nominal state, 0 in Low state and 0 in Wait state
10:35:18 - Actual voltage is between 989.42 V and 1168.15 V.
10:35:19 - Low voltages range between 300.00 V and 300.00 V. 
10:35:19 - Reference voltages range between 989.87 V and 1168.35 V. 
10:35:19 - Maximum difference between expected and actual voltages is 0.52 V
10:35:20 - Maximum of current limits is 4840.96 uA
10:35:20 - Checking status of HVPA module in 2 drawer(s)...
10:35:20 - Checking status of HVPA channels in 2 drawer(s)...
10:35:20 - HV is stabilized in all channels.
10:35:20 - Checking reference and low voltages against /data/config/2020/20201208/config_tower_2modules_FEBv6_pingpong_newDacl_DelayBusy8.NMC.xml
10:35:20 - Done
10:35:21 - Finished task "Check high voltages"
10:35:23 - Starting NMC
10:35:23 - Clearing PPS error counters
10:35:27 - Configuring calibration box...
10:35:27 - Configuring calibration box with leds=0x40 voltage=15.00 frequency=1000.0/1 central_current=0.0 duration=0 width=1 lemo_out=True fiber1_out=True fiber2_out=True lemo_in=True enabled=True
10:35:38 - Checking UCTS clock...
10:35:38 - UCTS and control PC clocks differ by 3.8 seconds
10:35:38 - Configuring UCTS
10:35:39 - Configuring TIB...
10:35:39 - Setting TIB forced mode to False
10:35:39 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v
10:35:39 - Status: TibState.PpsStopped
10:35:39 - Alarms: AlarmVector.ReadError
10:35:39 - Connection status: False TXclient_alive: False
10:35:39 - Entering set_external_delay
10:35:39 - Setting ExternalDelayLocal to 0.000 ns
10:35:39 - Writing 0.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v
10:35:39 - Entering set_external_delay
10:35:39 - Setting ExternalDelayCalibration to 65.000 ns
10:35:39 - Writing 65.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v
10:35:39 - Entering set_external_delay
10:35:39 - Setting ExternalDelaySphe to 150.000 ns
10:35:39 - Writing 150.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v
10:35:39 - Setting TIB trigger mode to 0x74 = TriggerMask.SlowControl|Pedestal|Software|Calibration
10:35:39 - Writing 116 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v
10:35:39 - Writing 1 to Camera.TIB.InputsEnable.InputMask.InputMask_v
10:35:39 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v
10:35:39 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v
10:35:39 - Writing False to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v
10:35:39 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v
10:35:39 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v
10:35:39 - Status: TibState.PpsStopped
10:35:39 - Alarms: AlarmVector.ReadError
10:35:39 - Connection status: False TXclient_alive: False
10:35:39 - Writing True to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v
10:35:39 - Writing 100 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v
10:35:39 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
10:35:39 - Writing False to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v
10:35:39 - Writing 100 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v
10:35:39 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v
10:35:39 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
10:35:39 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v
10:35:39 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v
10:35:39 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
10:35:41 - Connecting TIB to camera server at 10.10.4.12:222
10:35:41 - Starting TIB...
10:35:41 - Status: TibState.PpsStopped
10:35:41 - Alarms: AlarmVector.ReadError
10:35:41 - Connection status: False TXclient_alive: True
10:35:41 - Resetting run
10:35:41 - Wait for UCTS external trigger before enabling trigger...
10:35:41 - Status: TibState.Standby
10:35:41 - Alarms: AlarmVector.NoAlarm
10:35:41 - Connection status: False TXclient_alive: True
10:35:41 - Status: TibState.Standby
10:35:41 - Alarms: AlarmVector.NoAlarm
10:35:42 - Connection status: False TXclient_alive: True
10:35:43 - Status: TibState.Armed
10:35:43 - Alarms: AlarmVector.NoAlarm
10:35:43 - Connection status: True TXclient_alive: True
10:35:45 - Starting TIB triggers...
10:35:45 - Enabling trigger
10:35:45 - Status: TibState.Running
10:35:45 - Alarms: AlarmVector.ReadError
10:35:45 - Connection status: True TXclient_alive: True
10:35:48 - Checking for high voltage locked pixels...
10:35:57 - Status: TibState.Running ConnectionStatus: True TXclient_alive: True
10:35:57 - Alarms: AlarmVector.ReadError
10:35:57 - Temperature: 35.25
10:35:57 - Local camera rate: 0.0 Hz
10:35:57 - Stereo trigger rate: 0.0 Hz
10:35:57 - SPE trigger rate: 0.0 Hz
10:35:57 - Calibration trigger rate: 8903.0 Hz
10:35:57 - Software trigger rate: 0.0 Hz
10:35:57 - Pedestal trigger rate: 100.0 Hz
10:35:57 - Collected trigger rate: 8928.0 Hz
10:35:57 - Busy rate: 8928.0 Hz
10:35:57 - Camera trigger rate: 0.0 Hz
10:36:04 - Stopping TIB...
10:36:04 - Status: TibState.Running
10:36:04 - Alarms: AlarmVector.ReadError
10:36:04 - Connection status: True TXclient_alive: True
10:36:04 - Disabling trigger
10:36:04 - Disabling PPS
10:36:05 - Status: TibState.PpsStopped
10:36:05 - Alarms: AlarmVector.ReadError
10:36:05 - Connection status: True TXclient_alive: True
10:36:05 - Closing TIB connection to camera server
10:36:07 - Status: TibState.PpsStopped
10:36:07 - Alarms: AlarmVector.ReadError
10:36:07 - Connection status: False TXclient_alive: False
10:36:07 - Run duration: 0:00:21
10:36:07 - Local camera triggers: 0
10:36:07 - Slow control triggers: 0
10:36:07 - Single photo-electron triggers: 0
10:36:07 - Calibration triggers: 186644
10:36:07 - Software triggers from UCTS: 0
10:36:07 - Pedestal triggers: 2094
10:36:07 - Collected input triggers: 165071
10:36:07 - Busy triggers: 165069
10:36:07 - Camera event triggers sent to clusters: 2
10:36:18 - Checking for high voltage locked pixels...