10:48:03 - Configuring calibration box...
10:48:03 - Configuring calibration box with leds=0x40 voltage=15.98 frequency=1000.0/1 central_current=0.0 duration=0 width=1 lemo_out=True fiber1_out=True fiber2_out=True lemo_in=False enabled=False
10:48:10 - Starting task "Configure modules"
10:48:10 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/utils/branches/v5.5.1-40061 
10:48:10 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/libNectarCam/branches/v5.5.1-40061 
10:48:10 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/libQNectarCam/branches/v5.5.1-40061 
10:48:10 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/qNectarcamModuleController/branches/v5.5.1-40061
10:48:10 - Configuring modules with configuration /data/config/2020/20201208/config_tower_3modules.NMC.xml
10:48:10 - Switching off high voltages in configuration
10:48:14 - Successfully configured 3 module(s)
10:48:14 - All front-end boards are programmed with firmware F55D2001
10:48:14 - All backplanes are programmed with firmware 15
10:48:15 - NMC is in state NmcState.Configured and knows of 3 drawer(s)
10:48:15 - Found 0 PPS errors.
10:48:15 - Finished task "Configure modules"
10:48:17 - Updating FEB temperature widget...
10:48:20 - Updating voltage widget...
10:50:39 - Starting task "Switch HVPA voltage state"
10:50:39 - Setting HVPA current limit to 12489.75 uA
10:50:40 - Setting HVPA ramp speed to 25 V/s
10:50:40 - Switching HVPA to state Nominal
10:50:41 - High voltage locked channels will be checked every 30 s
10:50:47 - Setting HVPA current limits...
10:50:49 - Finished task "Switch HVPA voltage state"
10:51:12 - Checking for high voltage locked pixels...
10:51:12 - Module 170 has 1 pixel(s) locked (HVPA status of 0x7e)!
10:51:12 - Unlocking 1 channel(s)...
10:51:12 - Resetting HVPA channel 0 of drawer 170...
10:51:42 - Checking for high voltage locked pixels...
10:52:12 - Checking for high voltage locked pixels...
10:52:32 - Calling method FSM.gotoReady in object FSM
10:52:39 - Calling method FSM.gotoObserving in object FSM
10:52:42 - Checking for high voltage locked pixels...
10:53:07 - Starting task "Check high voltages"
10:53:08 - Found 3 drawer(s) in Nominal state, 0 in Low state and 0 in Wait state
10:53:08 - Actual voltage is between 973.56 V and 1082.75 V.
10:53:08 - Low voltages range between 300.00 V and 300.00 V. 
10:53:09 - Reference voltages range between 973.67 V and 1082.65 V. 
10:53:10 - Maximum difference between expected and actual voltages is 0.46 V
10:53:10 - Maximum of current limits is 5262.16 uA
10:53:10 - Checking status of HVPA module in 3 drawer(s)...
10:53:10 - Checking status of HVPA channels in 3 drawer(s)...
10:53:11 - HV is stabilized in all channels.
10:53:11 - Checking reference and low voltages against /data/config/2020/20201208/config_tower_3modules.NMC.xml
10:53:11 - Done
10:53:11 - Finished task "Check high voltages"
10:53:12 - Checking for high voltage locked pixels...
10:53:26 - Starting task "Set L0 trigger thresholds"
10:53:26 - Setting L0 thresholds to 5.0 p.e. using /data/luts/l0_threshold_slope_and_offset_feb_20200708.h5
10:53:26 - Note: NumExpr detected 64 cores but "NUMEXPR_MAX_THREADS" not set, so enforcing safe limit of 8.
10:53:26 - NumExpr defaulting to 8 threads.
10:53:27 - Setting L0 thresholds to 5.0 p.e. per pixel using L0 slopes and offsets in /data/luts/l0_threshold_slope_and_offset_feb_20200708.h5
10:53:27 - Thresholds saved in configuration file /data/config/2020/20201208/config_2020-12-08_10-53-27.NMC.xml
10:53:27 - Finished task "Set L0 trigger thresholds"
10:53:35 - Updating voltage widget...
10:53:37 - Updating FEB temperature widget...
10:53:40 - Updating L0 scaler widget...
10:53:42 - Checking for high voltage locked pixels...
10:53:46 - Updating L1 scaler widget...
10:53:55 - Starting task "Check high voltages"
10:53:55 - Found 3 drawer(s) in Nominal state, 0 in Low state and 0 in Wait state
10:53:56 - Actual voltage is between 973.56 V and 1082.75 V.
10:53:56 - Low voltages range between 300.00 V and 300.00 V. 
10:53:56 - Reference voltages range between 973.67 V and 1082.65 V. 
10:53:57 - Maximum difference between expected and actual voltages is 0.67 V
10:53:57 - Maximum of current limits is 5262.16 uA
10:53:57 - Checking status of HVPA module in 3 drawer(s)...
10:53:58 - Checking status of HVPA channels in 3 drawer(s)...
10:53:58 - HV is stabilized in all channels.
10:53:58 - Checking reference and low voltages against /data/config/2020/20201208/config_tower_3modules.NMC.xml
10:53:58 - Done
10:53:59 - Finished task "Check high voltages"
10:54:05 - Starting flashes...
10:54:08 - Updating L0 scaler widget...
10:54:12 - Checking for high voltage locked pixels...
10:54:14 - Updating L1 scaler widget...
10:54:29 - Configuring calibration box...
10:54:29 - Configuring calibration box with leds=0x40 voltage=13.98 frequency=1000.0/1 central_current=0.0 duration=0 width=1 lemo_out=True fiber1_out=True fiber2_out=True lemo_in=False enabled=False
10:54:30 - Starting flashes...
10:54:32 - Updating L0 scaler widget...
10:54:35 - Updating L1 scaler widget...
10:54:42 - Checking for high voltage locked pixels...
10:55:12 - Checking for high voltage locked pixels...
10:55:41 - Starting NMC
10:55:41 - Clearing PPS error counters
10:55:42 - Checking for high voltage locked pixels...
10:55:57 - Checking UCTS clock...
10:55:57 - UCTS and control PC clocks differ by 3.6 seconds
10:55:57 - Configuring UCTS
10:55:57 - Configuring TIB...
10:55:57 - Setting TIB forced mode to False
10:55:57 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v
10:55:57 - Status: TibState.RunStopped
10:55:57 - Alarms: AlarmVector.BufferFull
10:55:57 - Connection status: False TXclient_alive: False
10:55:57 - Disabling PPS
10:55:59 - Status: TibState.PpsStopped
10:55:59 - Alarms: AlarmVector.BufferFull
10:55:59 - Connection status: False TXclient_alive: False
10:55:59 - Entering set_external_delay
10:55:59 - Setting ExternalDelayLocal to 0.000 ns
10:55:59 - Writing 0.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v
10:56:00 - Entering set_external_delay
10:56:00 - Setting ExternalDelayCalibration to 65.000 ns
10:56:00 - Writing 65.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v
10:56:00 - Entering set_external_delay
10:56:00 - Setting ExternalDelaySphe to 150.000 ns
10:56:00 - Writing 150.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v
10:56:00 - Setting TIB trigger mode to 0x75 = TriggerMask.SlowControl|Pedestal|Software|Calibration|Mono
10:56:00 - Writing 117 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v
10:56:00 - Writing 1 to Camera.TIB.InputsEnable.InputMask.InputMask_v
10:56:00 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v
10:56:00 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v
10:56:00 - Writing False to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v
10:56:00 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v
10:56:00 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v
10:56:00 - Status: TibState.PpsStopped
10:56:00 - Alarms: AlarmVector.BufferFull
10:56:00 - Connection status: False TXclient_alive: False
10:56:00 - Writing True to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v
10:56:00 - Writing 100 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v
10:56:00 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
10:56:00 - Writing False to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v
10:56:00 - Writing 100 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v
10:56:00 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v
10:56:00 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
10:56:00 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v
10:56:00 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v
10:56:00 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
10:56:03 - Connecting TIB to camera server at 10.10.4.12:222
10:56:03 - Starting TIB...
10:56:03 - Status: TibState.PpsStopped
10:56:03 - Alarms: AlarmVector.BufferFull
10:56:03 - Connection status: False TXclient_alive: False
10:56:03 - Resetting run
10:56:03 - Wait for UCTS external trigger before enabling trigger...
10:56:03 - Status: TibState.Standby
10:56:03 - Alarms: AlarmVector.NoAlarm
10:56:03 - Connection status: False TXclient_alive: True
10:56:03 - Status: TibState.Standby
10:56:03 - Alarms: AlarmVector.NoAlarm
10:56:03 - Connection status: False TXclient_alive: True
10:56:04 - Status: TibState.Armed
10:56:04 - Alarms: AlarmVector.NoAlarm
10:56:04 - Connection status: True TXclient_alive: True
10:56:06 - Starting TIB triggers...
10:56:06 - Enabling trigger
10:56:06 - Status: TibState.Running
10:56:06 - Alarms: AlarmVector.ReadError
10:56:06 - Connection status: True TXclient_alive: True
10:56:08 - Status: TibState.Running ConnectionStatus: True TXclient_alive: True
10:56:08 - Alarms: AlarmVector.ReadError
10:56:08 - Temperature: 36.44
10:56:08 - Local camera rate: 0.0 Hz
10:56:08 - Stereo trigger rate: 0.0 Hz
10:56:08 - SPE trigger rate: 0.0 Hz
10:56:08 - Calibration trigger rate: 1000.0 Hz
10:56:08 - Software trigger rate: 0.0 Hz
10:56:08 - Pedestal trigger rate: 100.0 Hz
10:56:08 - Collected trigger rate: 1100.0 Hz
10:56:08 - Busy rate: 0.0 Hz
10:56:08 - Camera trigger rate: 1100.0 Hz
10:56:12 - Checking for high voltage locked pixels...
10:56:18 - Starting task "Set DTC trigger masks"
10:56:19 - Configuring DTC trigger masks for 3 configured module(s)
10:56:19 - Setting DTC slot 1 trigger mask to 0x0000
10:56:22 - Setting DTC slot 5 trigger mask to 0x0000
10:56:26 - Setting DTC slot 6 trigger mask to 0x0000
10:56:29 - Setting DTC slot 9 trigger mask to 0x0000
10:56:33 - Setting DTC slot 13 trigger mask to 0xc800
10:56:37 - Setting DTC slot 14 trigger mask to 0x0000
10:56:40 - Setting DTC slot 15 trigger mask to 0x0000
10:56:42 - Checking for high voltage locked pixels...
10:56:44 - Setting DTC slot 19 trigger mask to 0x0000
10:56:47 - Finished task "Set DTC trigger masks"
10:56:53 - Status: TibState.Running ConnectionStatus: True TXclient_alive: True
10:56:53 - Alarms: AlarmVector.ReadError
10:56:53 - Temperature: 36.44
10:56:53 - Local camera rate: 1000.0 Hz
10:56:53 - Stereo trigger rate: 0.0 Hz
10:56:53 - SPE trigger rate: 0.0 Hz
10:56:53 - Calibration trigger rate: 1000.0 Hz
10:56:53 - Software trigger rate: 0.0 Hz
10:56:53 - Pedestal trigger rate: 100.0 Hz
10:56:53 - Collected trigger rate: 1100.0 Hz
10:56:53 - Busy rate: 0.0 Hz
10:56:53 - Camera trigger rate: 1100.0 Hz
10:57:07 - Status: TibState.Running ConnectionStatus: True TXclient_alive: True
10:57:07 - Alarms: AlarmVector.ReadError
10:57:07 - Temperature: 36.44
10:57:07 - Local camera rate: 1000.0 Hz
10:57:07 - Stereo trigger rate: 0.0 Hz
10:57:07 - SPE trigger rate: 0.0 Hz
10:57:07 - Calibration trigger rate: 1000.0 Hz
10:57:07 - Software trigger rate: 0.0 Hz
10:57:07 - Pedestal trigger rate: 100.0 Hz
10:57:07 - Collected trigger rate: 1100.0 Hz
10:57:07 - Busy rate: 0.0 Hz
10:57:07 - Camera trigger rate: 1100.0 Hz
10:57:12 - Checking for high voltage locked pixels...
10:57:12 - Status: TibState.Running ConnectionStatus: True TXclient_alive: True
10:57:12 - Alarms: AlarmVector.ReadError
10:57:12 - Temperature: 36.44
10:57:12 - Local camera rate: 1000.0 Hz
10:57:12 - Stereo trigger rate: 0.0 Hz
10:57:12 - SPE trigger rate: 0.0 Hz
10:57:12 - Calibration trigger rate: 1000.0 Hz
10:57:12 - Software trigger rate: 0.0 Hz
10:57:12 - Pedestal trigger rate: 100.0 Hz
10:57:12 - Collected trigger rate: 1100.0 Hz
10:57:12 - Busy rate: 0.0 Hz
10:57:12 - Camera trigger rate: 1100.0 Hz
10:57:42 - Checking for high voltage locked pixels...
10:58:12 - Checking for high voltage locked pixels...
10:58:42 - Checking for high voltage locked pixels...
10:59:12 - Checking for high voltage locked pixels...
10:59:13 - Stopping TIB...
10:59:13 - Status: TibState.Running
10:59:13 - Alarms: AlarmVector.ReadError
10:59:13 - Connection status: True TXclient_alive: True
10:59:13 - Disabling trigger
10:59:13 - Disabling PPS
10:59:14 - Status: TibState.PpsStopped
10:59:14 - Alarms: AlarmVector.ReadError
10:59:14 - Connection status: True TXclient_alive: True
10:59:14 - Closing TIB connection to camera server
10:59:16 - Status: TibState.PpsStopped
10:59:16 - Alarms: AlarmVector.ReadError
10:59:16 - Connection status: False TXclient_alive: False
10:59:16 - Run duration: 0:03:09
10:59:16 - Local camera triggers: 156566
10:59:16 - Slow control triggers: 0
10:59:16 - Single photo-electron triggers: 0
10:59:16 - Calibration triggers: 188969
10:59:16 - Software triggers from UCTS: 0
10:59:16 - Pedestal triggers: 18897
10:59:16 - Collected input triggers: 205260
10:59:16 - Busy triggers: 284
10:59:16 - Camera event triggers sent to clusters: 204976