11:33:25 - Starting task "Configure modules"
11:33:25 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/utils/branches/v5.6.0-41551 
11:33:25 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/libNectarCam/branches/v5.6.0-41551 
11:33:25 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/libQNectarCam/branches/v5.6.0-41551 
11:33:25 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/qNectarcamModuleController/branches/v5.6.0-41551
11:33:25 - Configuring modules with configuration /data/config/2021/20211011/config_cameraqm_265febs_newHV6.NMC.xml
11:33:25 - Switching off high voltages in configuration
11:33:36 - Successfully configured 265 module(s)
11:33:36 - Waiting for modules to be configured...
11:33:45 - All front-end boards are programmed with firmware F56D2002
11:33:59 - Found 2 different versions of DTBP firmware: [15 17]
11:34:58 - NMC is in state NmcState.Ready and knows of 265 drawer(s)
11:35:21 - All front-end boards have counted 0 event(s)
11:35:28 - Found 0 PPS errors.
11:35:29 - Finished task "Configure modules"
11:37:20 - Starting task "Switch HVPA voltage state"
11:37:20 - Setting HVPA current limit to 12489.75 uA
11:37:20 - Setting Hvpa.Hvpa0.CurrentTrip in all drawers
11:37:36 - Setting Hvpa.Hvpa1.CurrentTrip in all drawers
11:37:51 - Setting Hvpa.Hvpa2.CurrentTrip in all drawers
11:38:06 - Setting Hvpa.Hvpa3.CurrentTrip in all drawers
11:38:21 - Setting Hvpa.Hvpa4.CurrentTrip in all drawers
11:38:36 - Setting Hvpa.Hvpa5.CurrentTrip in all drawers
11:38:51 - Setting Hvpa.Hvpa6.CurrentTrip in all drawers
11:39:07 - Setting HVPA ramp speed to 25 V/s
11:39:24 - Switching HVPA to state Nominal
11:39:56 - Setting HVPA current limits...
11:41:55 - Finished task "Switch HVPA voltage state"
11:42:04 - Updating FEB temperature widget...
11:42:15 - High voltage locked channels will be checked every 60 s
11:42:21 - Calling method FSM.gotoObserving in object FSM
11:42:21 - Starting run 2682
11:42:26 - Checking UCTS clock...
11:42:27 - UCTS clock is late by 12 seconds!
11:42:27 - Configuring UCTS with (10.200.7.250, 10.200.4.100, 44:a8:42:44:32:c9)
11:42:27 - Configuring TIB...
11:42:27 - Setting TIB forced mode to False
11:42:27 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v
11:42:27 - Status: TibState.PpsStopped
11:42:27 - Alarms: AlarmVector.ReadError
11:42:27 - Connection status: False TXclient_alive: False
11:42:27 - Entering set_external_delay
11:42:27 - Setting ExternalDelayLocal to 27.000 ns
11:42:27 - Writing 27.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v
11:42:27 - Entering set_external_delay
11:42:27 - Setting ExternalDelayCalibration to 58.000 ns
11:42:27 - Writing 58.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v
11:42:27 - Entering set_external_delay
11:42:27 - Setting ExternalDelaySphe to 110.000 ns
11:42:27 - Writing 110.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v
11:42:27 - Setting TIB trigger mode to 0x54 = TriggerMask.SlowControl|Software|Calibration
11:42:27 - Writing 84 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v
11:42:27 - Writing 1 to Camera.TIB.InputsEnable.InputMask.InputMask_v
11:42:27 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v
11:42:27 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v
11:42:27 - Writing True to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v
11:42:27 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v
11:42:27 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v
11:42:27 - Status: TibState.PpsStopped
11:42:27 - Alarms: AlarmVector.ReadError
11:42:27 - Connection status: False TXclient_alive: False
11:42:27 - Writing False to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v
11:42:27 - Writing 100 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v
11:42:27 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
11:42:28 - Writing False to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v
11:42:28 - Writing 100 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v
11:42:28 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v
11:42:28 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
11:42:28 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v
11:42:28 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v
11:42:28 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
11:42:31 - Connecting TIB to camera server at 10.10.4.12:222
11:42:31 - Starting TIB...
11:42:31 - Status: TibState.PpsStopped
11:42:31 - Alarms: AlarmVector.ReadError
11:42:31 - Connection status: False TXclient_alive: True
11:42:31 - Resetting run
11:42:31 - Wait for UCTS external trigger before enabling trigger...
11:42:31 - Status: TibState.Standby
11:42:31 - Alarms: AlarmVector.NoAlarm
11:42:31 - Connection status: False TXclient_alive: True
11:42:31 - Status: TibState.Standby
11:42:31 - Alarms: AlarmVector.NoAlarm
11:42:31 - Connection status: False TXclient_alive: True
11:42:32 - Status: TibState.Armed
11:42:32 - Alarms: AlarmVector.NoAlarm
11:42:32 - Connection status: True TXclient_alive: True
11:42:39 - Starting NMC
11:42:39 - Clearing PPS error counters
11:43:01 - Resetting FEB counters...
11:43:08 - Starting all configured modules...
11:43:15 - Checking for high voltage locked pixels...
11:43:41 - HVPA channel 2 of drawer 86 has status 0x0007!
11:43:41 - HVPA channel 2 in module 86 is in rise default!
11:44:04 - HV is locked in 0 channel(s), was in rise default in 1 channel(s) and was still in progress in 1 channel(s)
11:44:15 - Checking for high voltage locked pixels...
11:44:40 - HVPA channel 2 of drawer 86 has status 0x0007!
11:44:40 - HVPA channel 2 in module 86 is in rise default!
11:45:04 - HV is locked in 0 channel(s), was in rise default in 1 channel(s) and was still in progress in 1 channel(s)
11:45:04 - Stopped periodic check of locked high voltages
11:45:04 - High voltage locked channels will be checked every 60 s
11:45:06 - Stopped periodic check of locked high voltages
11:45:16 - Starting TIB triggers...
11:45:16 - Enabling trigger
11:45:16 - Status: TibState.Running
11:45:16 - Alarms: AlarmVector.NoAlarm
11:45:16 - Connection status: True TXclient_alive: True
11:45:36 - Configuring calibration box...
11:45:36 - Configuring calibration box with leds=0x358 voltage=10.98 frequency=1000.0/1 central_current=0.0 duration=0 width=1 lemo_out=True fiber1_out=True fiber2_out=True lemo_in=False enabled=False
11:45:40 - Scanning voltages
11:45:40 - Starting task "Scan voltages"
11:45:40 - Setting LED mask to 0x0
11:45:40 - Configuring calibration box with leds=0x0 voltage=8.00 frequency=1000.0/1 central_current=0.0 duration=0 width=1 lemo_out=True fiber1_out=True fiber2_out=True lemo_in=False enabled=False
11:45:40 - Starting flashes...
11:45:46 - Stopping flashes...
11:45:47 - Setting LED mask to 0x358
11:45:59 - Setting voltage to 8.000000 V
11:46:00 - Starting flashes...
11:46:06 - Stopping flashes...
11:46:17 - Setting voltage to 8.250000 V
11:46:18 - Starting flashes...
11:46:24 - Stopping flashes...
11:46:35 - Setting voltage to 8.500000 V
11:46:36 - Starting flashes...
11:46:42 - Stopping flashes...
11:46:53 - Setting voltage to 8.750000 V
11:46:54 - Starting flashes...
11:47:00 - Stopping flashes...
11:47:12 - Setting voltage to 9.000000 V
11:47:13 - Starting flashes...
11:47:19 - Stopping flashes...
11:47:30 - Setting voltage to 9.250000 V
11:47:31 - Starting flashes...
11:47:37 - Stopping flashes...
11:47:48 - Setting voltage to 9.500000 V
11:47:49 - Starting flashes...
11:47:55 - Stopping flashes...
11:48:06 - Setting voltage to 9.750000 V
11:48:07 - Starting flashes...
11:48:13 - Stopping flashes...
11:48:24 - Setting voltage to 10.000000 V
11:48:26 - Starting flashes...
11:48:32 - Stopping flashes...
11:48:43 - Setting voltage to 10.250000 V
11:48:44 - Starting flashes...
11:48:50 - Stopping flashes...
11:49:01 - Setting voltage to 10.500000 V
11:49:02 - Starting flashes...
11:49:08 - Stopping flashes...
11:49:19 - Setting voltage to 10.750000 V
11:49:20 - Starting flashes...
11:49:26 - Stopping flashes...
11:49:37 - Setting voltage to 11.000000 V
11:49:39 - Starting flashes...
11:49:45 - Stopping flashes...
11:49:56 - Setting voltage to 11.250000 V
11:49:57 - Starting flashes...
11:50:03 - Stopping flashes...
11:50:14 - Setting voltage to 11.500000 V
11:50:15 - Starting flashes...
11:50:21 - Stopping flashes...
11:50:32 - Setting voltage to 11.750000 V
11:50:33 - Starting flashes...
11:50:39 - Stopping flashes...
11:50:50 - Setting voltage to 12.000000 V
11:50:52 - Starting flashes...
11:50:58 - Stopping flashes...
11:51:09 - Setting voltage to 12.250000 V
11:51:10 - Starting flashes...
11:51:16 - Stopping flashes...
11:51:27 - Setting voltage to 12.500000 V
11:51:28 - Starting flashes...
11:51:34 - Stopping flashes...
11:51:45 - Setting voltage to 12.750000 V
11:51:46 - Starting flashes...
11:51:52 - Stopping flashes...
11:52:03 - Setting voltage to 13.000000 V
11:52:05 - Starting flashes...
11:52:11 - Stopping flashes...
11:52:22 - Setting voltage to 13.250000 V
11:52:23 - Starting flashes...
11:52:29 - Stopping flashes...
11:52:40 - Setting voltage to 13.500000 V
11:52:41 - Starting flashes...
11:52:47 - Stopping flashes...
11:52:58 - Setting voltage to 13.750000 V
11:52:59 - Starting flashes...
11:53:05 - Stopping flashes...
11:53:16 - Setting voltage to 14.000000 V
11:53:18 - Starting flashes...
11:53:24 - Stopping flashes...
11:53:35 - Setting voltage to 14.250000 V
11:53:36 - Starting flashes...
11:53:42 - Stopping flashes...
11:53:53 - Setting voltage to 14.500000 V
11:53:54 - Starting flashes...
11:54:00 - Stopping flashes...
11:54:11 - Setting voltage to 14.750000 V
11:54:12 - Starting flashes...
11:54:18 - Stopping flashes...
11:54:29 - Setting voltage to 15.000000 V
11:54:31 - Starting flashes...
11:54:37 - Stopping flashes...
11:54:48 - Setting voltage to 15.250000 V
11:54:49 - Starting flashes...
11:54:55 - Stopping flashes...
11:55:06 - Setting voltage to 15.500000 V
11:55:07 - Starting flashes...
11:55:13 - Stopping flashes...
11:55:24 - Setting voltage to 15.750000 V
11:55:25 - Starting flashes...
11:55:31 - Stopping flashes...
11:55:42 - Setting voltage to 16.000000 V
11:55:44 - Starting flashes...
11:55:50 - Stopping flashes...
11:55:51 - Finished task "Scan voltages"
12:40:36 - Stopping TIB...
12:40:36 - Status: TibState.Running
12:40:36 - Alarms: AlarmVector.ReadError
12:40:36 - Connection status: True TXclient_alive: True
12:40:36 - Disabling trigger
12:40:36 - Disabling PPS
12:40:37 - Status: TibState.PpsStopped
12:40:37 - Alarms: AlarmVector.ReadError
12:40:37 - Connection status: True TXclient_alive: True
12:40:38 - Closing TIB connection to camera server
12:40:39 - Status: TibState.PpsStopped
12:40:39 - Alarms: AlarmVector.ReadError
12:40:39 - Connection status: False TXclient_alive: False
12:40:39 - Run duration: 0:58:04
12:40:39 - Local camera triggers: 0
12:40:39 - Slow control triggers: 0
12:40:39 - Single photo-electron triggers: 0
12:40:39 - Calibration triggers: 206175
12:40:39 - Software triggers from UCTS: 0
12:40:39 - Pedestal triggers: 0
12:40:39 - Collected input triggers: 206175
12:40:39 - Busy triggers: 0
12:40:39 - Camera event triggers sent to clusters: 206175
12:40:42 - Calling method FSM.gotoReady in object FSM
12:40:43 - Event builder is in state CameraServerState.Observing and has output 206175 event(s) during run #2683.
12:40:43 - Event builder is in transition to state CameraServerState.Ready
12:40:46 - Stopping NMC
12:40:46 - ("NmcError: Failed to call 'Stop': status Bad statuses are present, code 0x80020000", 2147614720)