09:19:08 - ECC is in state EccState.Ready and transition EccTransition.Idle
09:19:08 - PDB temperature: 29.9 deg C
09:19:08 - Status of UPS power: V=234.0 V, I=0.82 A, P=0.090 kW, Q=0.000 kVAR, S=0.200 kVA, cos=-0.40
09:19:08 - Status of 400 V: V1=232.0 V, V2=232.0 V, V3=233.0 V, I1=9.52 A, I2=11.50 A, I3=9.37 A, f=50.0 Hz, cos=-0.80
09:19:08 - Status of 400 V: P1=-0.700 kW, P2=2.460 kW, P3=-1.000 kW, Q1=-1.900 kVAR, Q2=-0.200 kVAR, Q3=1.670 kVAR, S1=-2.200 kVA, S2=2.650 kVA, S3=-2.100 kVA
09:19:08 - 2 relays enabled in PSB1. Total current of 71.5 A.
09:19:08 - 1 relays enabled in PSB2. Total current of 121.0 A.
09:19:09 - Status of PDB switches: StateBreaker=True, StateEmergencyStop=False, SwitchStatus_General400V=True, SwitchStatus_General230V=False, SwitchStatus_line400V=True, SwitchStatus_switch1=True, SwitchStatus_switch2=True, SwitchStatus_fanFront=True, SwitchStatus_fanRear=True, SwitchStatus_shutter=False
09:19:09 - Average air temperature: 25.3 deg C
09:19:09 - Air temperature (T1-T13): 25.3, 25.1, 26.6, 26.3, 24.8, 27.9, 24.8, 27.2, 25.3, 26.6, 24.2, 22.3, 21.8 deg C
09:19:09 - Air differential pressure: 2.5 Pa
09:19:09 - Back doors are closed.
09:19:09 - Light sensors: [0.0, 0.0] V
09:19:09 - Cooling valve is 100 %% open.Water flow: 29.5 l/min.Water pressure: [1.0, 1.5] bar
09:19:09 - Water temperature (T14-T16): 18.3, 15.9, 15.6 deg C
09:19:09 - Humidity: 48.7 %. 
09:19:09 - Fan speeds: [2400.0, 2400.0, 2400.0, 2460.0, 2400.0, 2460.0] rpm
09:19:12 - High voltage locked channels will be checked every 60 s
09:20:05 - Updating FEB temperature widget...
09:20:13 - Checking for high voltage locked pixels...
09:20:13 - Module 17 has 1 pixel(s) locked (HVPA status of 0x7b)!
09:20:27 - HVPA channel 2 of drawer 17 has status 0x8003!
09:20:27 - HVPA channel 2 in module 17 is locked!
09:20:40 - HV is locked in 1 channel(s), was in rise default in 0 channel(s) and was still in progress in 2 channel(s)
09:20:40 - Unlocking 1 channel(s)...
09:21:13 - Checking for high voltage locked pixels...
09:21:13 - Module 17 has 1 pixel(s) locked (HVPA status of 0x7b)!
09:21:27 - HVPA channel 2 of drawer 17 has status 0x8003!
09:21:27 - HVPA channel 2 in module 17 is locked!
09:21:40 - HV is locked in 1 channel(s), was in rise default in 0 channel(s) and was still in progress in 2 channel(s)
09:21:40 - Unlocking 1 channel(s)...
09:21:40 - ("NmcError: Failed to write 'NectarFrontEnd_017.Hvpa.Hvpa2.Disable': status Bad statuses are present, code 0xfffffffb, status NmcStatus.Mismatch", 4294967291)
09:21:41 - Stopped periodic check of locked high voltages
09:21:45 - Starting task "Switch HVPA voltage state"
09:21:45 - Setting HVPA current limit to 12489.75 uA
09:21:45 - Setting Hvpa.Hvpa0.CurrentTrip in all drawers
09:21:55 - Setting Hvpa.Hvpa1.CurrentTrip in all drawers
09:22:05 - Setting Hvpa.Hvpa2.CurrentTrip in all drawers
09:22:14 - Setting Hvpa.Hvpa3.CurrentTrip in all drawers
09:22:24 - Setting Hvpa.Hvpa4.CurrentTrip in all drawers
09:22:34 - Setting Hvpa.Hvpa5.CurrentTrip in all drawers
09:22:44 - Setting Hvpa.Hvpa6.CurrentTrip in all drawers
09:22:54 - Setting HVPA ramp speed to 500 V/s
09:23:05 - Switching HVPA to state Wait
09:23:24 - Setting HVPA current limits...
09:24:46 - Finished task "Switch HVPA voltage state"
09:33:47 - Resetting NMC
09:33:49 - Could not invoke the MethodCall service: BadDisconnect
09:33:57 - NMC is in state NmcState.Ready and knows of 0 drawer(s)
09:34:03 - Starting task "Powering modules..."
09:34:03 - Disabling power in all modules
09:34:04 - Finished task "Powering modules..."
10:06:52 - Starting task "Powering modules..."
10:06:52 - Enabling power in all modules
10:06:52 - Finished task "Powering modules..."
10:06:54 - Updating DTC module currents...
10:07:05 - Starting task "Configure modules"
10:07:06 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/utils/branches/v5.6.0-41551 
10:07:06 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/libNectarCam/branches/v5.6.0-41551 
10:07:06 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/libQNectarCam/branches/v5.6.0-41551 
10:07:06 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/qNectarcamModuleController/branches/v5.6.0-41551
10:07:06 - Configuring modules with configuration /data/config/2021/20210929/config_cameraqm_265febs_Hamamatsu_ND.NMC.xml
10:07:06 - Switching off high voltages in configuration
10:07:16 - Successfully configured 265 module(s)
10:07:16 - Waiting for modules to be configured...
10:07:22 - All front-end boards are programmed with firmware F56D2002
10:07:30 - Found 2 different versions of DTBP firmware: [15 17]
10:08:10 - NMC is in state NmcState.Ready and knows of 265 drawer(s)
10:08:25 - All front-end boards have counted 0 event(s)
10:08:30 - Found PPS errors: 148 in drawer 0, 150 in drawer 1, 148 in drawer 2, 150 in drawer 3, 148 in drawer 4, 150 in drawer 5, 148 in drawer 8, 146 in drawer 9, 146 in drawer 10, 146 in drawer 11, 148 in drawer 12, 146 in drawer 13, 146 in drawer 14, 146 in drawer 15, 148 in drawer 16, 148 in drawer 17, 150 in drawer 18, 148 in drawer 19, 148 in drawer 20, 150 in drawer 21, 150 in drawer 22, 150 in drawer 23, 148 in drawer 24, 146 in drawer 25, 146 in drawer 26, 146 in drawer 27, 146 in drawer 28, 146 in drawer 29, 148 in drawer 30, 148 in drawer 31, 150 in drawer 32, 148 in drawer 33, 150 in drawer 34, 148 in drawer 35, 150 in drawer 36, 150 in drawer 37, 150 in drawer 38, 150 in drawer 39, 150 in drawer 40, 149 in drawer 41, 151 in drawer 42, 149 in drawer 43, 149 in drawer 44, 149 in drawer 45, 151 in drawer 46, 149 in drawer 47, 149 in drawer 48, 149 in drawer 49, 149 in drawer 50, 149 in drawer 51, 149 in drawer 52, 151 in drawer 53, 150 in drawer 54, 152 in drawer 55, 152 in drawer 56, 150 in drawer 57, 150 in drawer 58, 150 in drawer 59, 150 in drawer 60, 152 in drawer 61, 152 in drawer 62, 152 in drawer 63, 150 in drawer 64, 152 in drawer 65, 150 in drawer 66, 150 in drawer 67, 150 in drawer 68, 152 in drawer 69, 152 in drawer 70, 152 in drawer 71, 150 in drawer 72, 148 in drawer 73, 148 in drawer 74, 146 in drawer 75, 148 in drawer 76, 150 in drawer 77, 150 in drawer 78, 152 in drawer 79, 152 in drawer 80, 152 in drawer 81, 152 in drawer 82, 150 in drawer 83, 152 in drawer 84, 150 in drawer 85, 150 in drawer 86, 150 in drawer 87, 152 in drawer 88, 150 in drawer 89, 150 in drawer 90, 150 in drawer 91, 150 in drawer 92, 150 in drawer 93, 150 in drawer 94, 147 in drawer 95, 149 in drawer 96, 149 in drawer 97, 147 in drawer 98, 147 in drawer 99, 149 in drawer 100, 147 in drawer 101, 147 in drawer 102, 147 in drawer 103, 147 in drawer 104, 147 in drawer 105, 151 in drawer 106, 151 in drawer 107, 151 in drawer 108, 154 in drawer 109, 154 in drawer 110, 152 in drawer 111, 152 in drawer 112, 154 in drawer 113, 152 in drawer 114, 154 in drawer 115, 152 in drawer 116, 152 in drawer 117, 152 in drawer 118, 152 in drawer 119, 154 in drawer 120, 152 in drawer 121, 154 in drawer 122, 152 in drawer 123, 151 in drawer 124, 153 in drawer 125, 151 in drawer 126, 151 in drawer 127, 151 in drawer 128, 153 in drawer 129, 151 in drawer 130, 151 in drawer 131, 151 in drawer 132, 151 in drawer 133, 151 in drawer 134, 152 in drawer 135, 152 in drawer 136, 152 in drawer 137, 154 in drawer 138, 152 in drawer 139, 152 in drawer 140, 152 in drawer 141, 152 in drawer 142, 152 in drawer 143, 154 in drawer 144, 152 in drawer 145, 152 in drawer 146, 154 in drawer 147, 152 in drawer 148, 152 in drawer 149, 153 in drawer 150, 155 in drawer 151, 153 in drawer 152, 155 in drawer 153, 153 in drawer 154, 154 in drawer 155, 154 in drawer 156, 154 in drawer 157, 152 in drawer 158, 153 in drawer 159, 153 in drawer 160, 155 in drawer 161, 155 in drawer 162, 154 in drawer 163, 154 in drawer 164, 156 in drawer 165, 154 in drawer 166, 154 in drawer 167, 154 in drawer 168, 156 in drawer 169, 154 in drawer 170, 154 in drawer 171, 154 in drawer 172, 154 in drawer 173, 156 in drawer 174, 154 in drawer 175, 153 in drawer 176, 153 in drawer 177, 152 in drawer 178, 152 in drawer 179, 152 in drawer 180, 152 in drawer 181, 154 in drawer 182, 152 in drawer 183, 152 in drawer 184, 152 in drawer 185, 152 in drawer 186, 152 in drawer 187, 152 in drawer 188, 154 in drawer 189, 154 in drawer 190, 152 in drawer 191, 154 in drawer 192, 154 in drawer 193, 153 in drawer 194, 153 in drawer 195, 153 in drawer 196, 155 in drawer 197, 153 in drawer 198, 153 in drawer 199, 153 in drawer 200, 155 in drawer 201, 155 in drawer 202, 153 in drawer 203, 156 in drawer 204, 154 in drawer 205, 156 in drawer 206, 155 in drawer 207, 157 in drawer 208, 155 in drawer 209, 157 in drawer 210, 155 in drawer 211, 155 in drawer 212, 155 in drawer 213, 155 in drawer 214, 157 in drawer 215, 157 in drawer 216, 155 in drawer 217, 156 in drawer 218, 156 in drawer 219, 156 in drawer 220, 156 in drawer 221, 156 in drawer 222, 158 in drawer 223, 158 in drawer 224, 158 in drawer 225, 156 in drawer 226, 156 in drawer 227, 156 in drawer 228, 156 in drawer 229, 158 in drawer 230, 156 in drawer 231, 158 in drawer 232, 158 in drawer 233, 156 in drawer 234, 156 in drawer 235, 158 in drawer 236, 158 in drawer 237, 156 in drawer 238, 156 in drawer 239, 156 in drawer 240, 156 in drawer 241, 156 in drawer 242, 156 in drawer 243, 156 in drawer 244, 156 in drawer 245, 156 in drawer 246, 156 in drawer 247, 158 in drawer 248, 156 in drawer 249, 156 in drawer 250, 158 in drawer 251, 156 in drawer 252, 156 in drawer 253, 158 in drawer 254, 156 in drawer 255, 156 in drawer 256, 156 in drawer 257, 158 in drawer 258, 159 in drawer 259, 159 in drawer 260, 157 in drawer 261, 157 in drawer 262, 159 in drawer 263, 157 in drawer 264
10:08:30 - Finished task "Configure modules"
10:24:52 - Checking status of calibration box...
10:24:53 - Calibration box is configured with 0 leds at a frequency of 1000.0 Hz and a voltage of 8.00 V
10:24:56 - Stopping flashes...
10:24:59 - Checking status of calibration box...
10:25:00 - Calibration box is configured with 0 leds at a frequency of 1000.0 Hz and a voltage of 8.00 V
10:25:16 - Starting task "Switch HVPA voltage state"
10:25:16 - Setting HVPA current limit to 12489.75 uA
10:25:16 - Setting Hvpa.Hvpa0.CurrentTrip in all drawers
10:25:26 - Setting Hvpa.Hvpa1.CurrentTrip in all drawers
10:25:36 - Setting Hvpa.Hvpa2.CurrentTrip in all drawers
10:25:46 - Setting Hvpa.Hvpa3.CurrentTrip in all drawers
10:25:56 - Setting Hvpa.Hvpa4.CurrentTrip in all drawers
10:26:05 - Setting Hvpa.Hvpa5.CurrentTrip in all drawers
10:26:15 - Setting Hvpa.Hvpa6.CurrentTrip in all drawers
10:26:25 - Setting HVPA ramp speed to 25 V/s
10:26:37 - Switching HVPA to state Low
10:26:55 - Setting HVPA current limits...
10:28:16 - Updating voltage widget...
10:28:17 - Finished task "Switch HVPA voltage state"
10:28:37 - High voltage locked channels will be checked every 60 s
10:29:37 - Checking for high voltage locked pixels...
10:29:37 - Module 17 has 1 pixel(s) locked (HVPA status of 0x7b)!
10:29:51 - HVPA channel 2 of drawer 17 has status 0x8003!
10:29:51 - HVPA channel 2 in module 17 is locked!
10:29:51 - HVPA channel 2 of drawer 86 has status 0x0007!
10:29:51 - HVPA channel 2 in module 86 is in rise default!
10:30:04 - HV is locked in 1 channel(s), was in rise default in 1 channel(s) and was still in progress in 2 channel(s)
10:30:04 - Unlocking 1 channel(s)...
10:30:26 - Stopped periodic check of locked high voltages
10:30:28 - Updating voltage widget...
10:30:56 - Starting task "Switch HVPA voltage state"
10:30:56 - Setting HVPA current limit to 12489.75 uA
10:30:56 - Setting Hvpa.Hvpa0.CurrentTrip in all drawers
10:31:06 - Setting Hvpa.Hvpa1.CurrentTrip in all drawers
10:31:16 - Setting Hvpa.Hvpa2.CurrentTrip in all drawers
10:31:25 - Setting Hvpa.Hvpa3.CurrentTrip in all drawers
10:31:35 - Setting Hvpa.Hvpa4.CurrentTrip in all drawers
10:31:45 - Setting Hvpa.Hvpa5.CurrentTrip in all drawers
10:31:55 - Setting Hvpa.Hvpa6.CurrentTrip in all drawers
10:32:05 - Setting HVPA ramp speed to 25 V/s
10:32:16 - Switching HVPA to state Nominal
10:32:35 - Setting HVPA current limits...
10:33:30 - Starting NMC
10:33:30 - Clearing PPS error counters
10:33:44 - Resetting FEB counters...
10:33:48 - Starting all configured modules...
10:33:56 - Finished task "Switch HVPA voltage state"
10:34:05 - Updating voltage widget...
10:34:26 - High voltage locked channels will be checked every 60 s
10:35:27 - Checking for high voltage locked pixels...
10:35:41 - HVPA channel 2 of drawer 86 has status 0x0007!
10:35:41 - HVPA channel 2 in module 86 is in rise default!
10:35:54 - HV is locked in 0 channel(s), was in rise default in 1 channel(s) and was still in progress in 1 channel(s)
10:36:27 - Checking for high voltage locked pixels...
10:36:41 - HVPA channel 2 of drawer 86 has status 0x0007!
10:36:41 - HVPA channel 2 in module 86 is in rise default!
10:36:54 - HV is locked in 0 channel(s), was in rise default in 1 channel(s) and was still in progress in 2 channel(s)
10:37:23 - Checking UCTS clock...
10:37:24 - UCTS and control PC clocks differ by 1.1 seconds
10:37:24 - Configuring UCTS with (10.200.7.250, 10.200.4.100, 44:a8:42:44:32:c9)
10:37:24 - Configuring TIB...
10:37:24 - Setting TIB forced mode to False
10:37:24 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v
10:37:24 - Status: TibState.RunStopped
10:37:24 - Alarms: AlarmVector.BufferFull
10:37:24 - Connection status: False TXclient_alive: False
10:37:24 - Disabling PPS
10:37:26 - Status: TibState.PpsStopped
10:37:26 - Alarms: AlarmVector.BufferFull
10:37:26 - Connection status: False TXclient_alive: False
10:37:26 - Entering set_external_delay
10:37:26 - Setting ExternalDelayLocal to 27.000 ns
10:37:26 - Writing 27.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v
10:37:26 - Entering set_external_delay
10:37:26 - Setting ExternalDelayCalibration to 58.000 ns
10:37:26 - Writing 58.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v
10:37:26 - Entering set_external_delay
10:37:26 - Setting ExternalDelaySphe to 110.000 ns
10:37:26 - Writing 110.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v
10:37:26 - Setting TIB trigger mode to 0x54 = TriggerMask.SlowControl|Software|Calibration
10:37:26 - Writing 84 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v
10:37:26 - Writing 1 to Camera.TIB.InputsEnable.InputMask.InputMask_v
10:37:27 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v
10:37:27 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v
10:37:27 - Writing True to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v
10:37:27 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v
10:37:27 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v
10:37:27 - Status: TibState.PpsStopped
10:37:27 - Alarms: AlarmVector.BufferFull
10:37:27 - Connection status: False TXclient_alive: False
10:37:27 - Writing False to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v
10:37:27 - Writing 100 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v
10:37:28 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
10:37:28 - Writing False to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v
10:37:28 - Writing 100 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v
10:37:28 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v
10:37:28 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
10:37:28 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v
10:37:28 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v
10:37:28 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
10:37:28 - Checking for high voltage locked pixels...
10:37:42 - HVPA channel 2 of drawer 86 has status 0x0007!
10:37:42 - HVPA channel 2 in module 86 is in rise default!
10:37:55 - HV is locked in 0 channel(s), was in rise default in 1 channel(s) and was still in progress in 2 channel(s)
10:37:55 - Connecting TIB to camera server at 10.10.4.12:222
10:37:55 - Starting TIB...
10:37:55 - Status: TibState.PpsStopped
10:37:55 - Alarms: AlarmVector.BufferFull
10:37:55 - Connection status: False TXclient_alive: False
10:37:55 - Resetting run
10:37:55 - Wait for UCTS external trigger before enabling trigger...
10:37:55 - Status: TibState.Standby
10:37:55 - Alarms: AlarmVector.NoAlarm
10:37:55 - Connection status: False TXclient_alive: True
10:37:55 - Status: TibState.Standby
10:37:55 - Alarms: AlarmVector.NoAlarm
10:37:55 - Connection status: False TXclient_alive: True
10:37:56 - Status: TibState.Armed
10:37:56 - Alarms: AlarmVector.NoAlarm
10:37:56 - Connection status: False TXclient_alive: True
10:37:59 - Stopped periodic check of locked high voltages
10:38:09 - Starting TIB triggers...
10:38:09 - Enabling trigger
10:38:09 - Status: TibState.Running
10:38:09 - Alarms: AlarmVector.NoAlarm
10:38:09 - Connection status: False TXclient_alive: True
10:38:17 - Status: TibState.Running ConnectionStatus: False TXclient_alive: True
10:38:17 - Alarms: AlarmVector.BufferFull|AlmostFull
10:38:17 - Temperature: 41.25
10:38:17 - Local camera rate: 0.0 Hz
10:38:17 - Stereo trigger rate: 0.0 Hz
10:38:17 - SPE trigger rate: 0.0 Hz
10:38:17 - Calibration trigger rate: 3932.0 Hz
10:38:17 - Software trigger rate: 0.0 Hz
10:38:17 - Pedestal trigger rate: 0.0 Hz
10:38:17 - Collected trigger rate: 3913.0 Hz
10:38:17 - Busy rate: 120.0 Hz
10:38:17 - Camera trigger rate: 3793.0 Hz
10:38:48 - Configuring calibration box...
10:38:48 - Configuring calibration box with leds=0x1fff voltage=16.50 frequency=1000.0/1 central_current=0.0 duration=500 width=1 lemo_out=True fiber1_out=True fiber2_out=True lemo_in=False enabled=False
10:38:51 - Starting flashes...
10:38:55 - Status: TibState.Running ConnectionStatus: False TXclient_alive: True
10:38:55 - Alarms: AlarmVector.BufferFull|AlmostFull
10:38:55 - Temperature: 41.31
10:38:55 - Local camera rate: 0.0 Hz
10:38:55 - Stereo trigger rate: 0.0 Hz
10:38:55 - SPE trigger rate: 0.0 Hz
10:38:55 - Calibration trigger rate: 999.0 Hz
10:38:55 - Software trigger rate: 0.0 Hz
10:38:55 - Pedestal trigger rate: 0.0 Hz
10:38:55 - Collected trigger rate: 999.0 Hz
10:38:55 - Busy rate: 0.0 Hz
10:38:55 - Camera trigger rate: 999.0 Hz
10:39:26 - Status: TibState.Running ConnectionStatus: False TXclient_alive: True
10:39:26 - Alarms: AlarmVector.BufferFull|AlmostFull
10:39:26 - Temperature: 41.38
10:39:26 - Local camera rate: 0.0 Hz
10:39:26 - Stereo trigger rate: 0.0 Hz
10:39:26 - SPE trigger rate: 0.0 Hz
10:39:26 - Calibration trigger rate: 1000.0 Hz
10:39:26 - Software trigger rate: 0.0 Hz
10:39:26 - Pedestal trigger rate: 0.0 Hz
10:39:27 - Collected trigger rate: 1000.0 Hz
10:39:27 - Busy rate: 0.0 Hz
10:39:27 - Camera trigger rate: 1000.0 Hz
10:39:28 - Status: TibState.Running ConnectionStatus: False TXclient_alive: True
10:39:28 - Alarms: AlarmVector.BufferFull|AlmostFull
10:39:28 - Temperature: 41.31
10:39:28 - Local camera rate: 0.0 Hz
10:39:28 - Stereo trigger rate: 0.0 Hz
10:39:28 - SPE trigger rate: 0.0 Hz
10:39:28 - Calibration trigger rate: 1000.0 Hz
10:39:28 - Software trigger rate: 0.0 Hz
10:39:28 - Pedestal trigger rate: 0.0 Hz
10:39:28 - Collected trigger rate: 1000.0 Hz
10:39:28 - Busy rate: 0.0 Hz
10:39:28 - Camera trigger rate: 1000.0 Hz
10:39:29 - Status: TibState.Running ConnectionStatus: False TXclient_alive: True
10:39:29 - Alarms: AlarmVector.BufferFull|AlmostFull
10:39:29 - Temperature: 41.31
10:39:29 - Local camera rate: 0.0 Hz
10:39:29 - Stereo trigger rate: 0.0 Hz
10:39:29 - SPE trigger rate: 0.0 Hz
10:39:29 - Calibration trigger rate: 1000.0 Hz
10:39:29 - Software trigger rate: 0.0 Hz
10:39:29 - Pedestal trigger rate: 0.0 Hz
10:39:29 - Collected trigger rate: 1000.0 Hz
10:39:29 - Busy rate: 0.0 Hz
10:39:29 - Camera trigger rate: 1000.0 Hz
10:39:31 - Status: TibState.Running ConnectionStatus: False TXclient_alive: True
10:39:31 - Alarms: AlarmVector.BufferFull|AlmostFull
10:39:31 - Temperature: 41.31
10:39:31 - Local camera rate: 0.0 Hz
10:39:31 - Stereo trigger rate: 0.0 Hz
10:39:31 - SPE trigger rate: 0.0 Hz
10:39:31 - Calibration trigger rate: 1000.0 Hz
10:39:31 - Software trigger rate: 0.0 Hz
10:39:31 - Pedestal trigger rate: 0.0 Hz
10:39:31 - Collected trigger rate: 1000.0 Hz
10:39:31 - Busy rate: 0.0 Hz
10:39:31 - Camera trigger rate: 1000.0 Hz
10:39:33 - Status: TibState.Running ConnectionStatus: False TXclient_alive: True
10:39:33 - Alarms: AlarmVector.BufferFull|AlmostFull
10:39:33 - Temperature: 41.38
10:39:33 - Local camera rate: 0.0 Hz
10:39:33 - Stereo trigger rate: 0.0 Hz
10:39:33 - SPE trigger rate: 0.0 Hz
10:39:33 - Calibration trigger rate: 1000.0 Hz
10:39:33 - Software trigger rate: 0.0 Hz
10:39:33 - Pedestal trigger rate: 0.0 Hz
10:39:33 - Collected trigger rate: 1000.0 Hz
10:39:33 - Busy rate: 0.0 Hz
10:39:33 - Camera trigger rate: 1000.0 Hz
10:39:37 - Status: TibState.Running ConnectionStatus: False TXclient_alive: True
10:39:37 - Alarms: AlarmVector.BufferFull|AlmostFull
10:39:37 - Temperature: 41.31
10:39:37 - Local camera rate: 0.0 Hz
10:39:37 - Stereo trigger rate: 0.0 Hz
10:39:37 - SPE trigger rate: 0.0 Hz
10:39:37 - Calibration trigger rate: 998.0 Hz
10:39:37 - Software trigger rate: 0.0 Hz
10:39:37 - Pedestal trigger rate: 0.0 Hz
10:39:37 - Collected trigger rate: 998.0 Hz
10:39:37 - Busy rate: 0.0 Hz
10:39:37 - Camera trigger rate: 998.0 Hz
10:39:38 - Status: TibState.Running ConnectionStatus: False TXclient_alive: True
10:39:38 - Alarms: AlarmVector.BufferFull|AlmostFull
10:39:38 - Temperature: 41.38
10:39:38 - Local camera rate: 0.0 Hz
10:39:38 - Stereo trigger rate: 0.0 Hz
10:39:38 - SPE trigger rate: 0.0 Hz
10:39:38 - Calibration trigger rate: 998.0 Hz
10:39:38 - Software trigger rate: 0.0 Hz
10:39:38 - Pedestal trigger rate: 0.0 Hz
10:39:38 - Collected trigger rate: 998.0 Hz
10:39:38 - Busy rate: 0.0 Hz
10:39:38 - Camera trigger rate: 998.0 Hz
10:39:40 - Status: TibState.Running ConnectionStatus: False TXclient_alive: True
10:39:40 - Alarms: AlarmVector.BufferFull|AlmostFull
10:39:40 - Temperature: 41.31
10:39:40 - Local camera rate: 0.0 Hz
10:39:40 - Stereo trigger rate: 0.0 Hz
10:39:40 - SPE trigger rate: 0.0 Hz
10:39:40 - Calibration trigger rate: 998.0 Hz
10:39:40 - Software trigger rate: 0.0 Hz
10:39:40 - Pedestal trigger rate: 0.0 Hz
10:39:40 - Collected trigger rate: 998.0 Hz
10:39:40 - Busy rate: 0.0 Hz
10:39:40 - Camera trigger rate: 998.0 Hz
10:39:41 - Status: TibState.Running ConnectionStatus: False TXclient_alive: True
10:39:41 - Alarms: AlarmVector.BufferFull|AlmostFull
10:39:41 - Temperature: 41.31
10:39:41 - Local camera rate: 0.0 Hz
10:39:41 - Stereo trigger rate: 0.0 Hz
10:39:41 - SPE trigger rate: 0.0 Hz
10:39:41 - Calibration trigger rate: 1000.0 Hz
10:39:41 - Software trigger rate: 0.0 Hz
10:39:41 - Pedestal trigger rate: 0.0 Hz
10:39:41 - Collected trigger rate: 1000.0 Hz
10:39:41 - Busy rate: 0.0 Hz
10:39:41 - Camera trigger rate: 1000.0 Hz
10:39:42 - Status: TibState.Running ConnectionStatus: False TXclient_alive: True
10:39:42 - Alarms: AlarmVector.BufferFull|AlmostFull
10:39:42 - Temperature: 41.38
10:39:42 - Local camera rate: 0.0 Hz
10:39:42 - Stereo trigger rate: 0.0 Hz
10:39:42 - SPE trigger rate: 0.0 Hz
10:39:42 - Calibration trigger rate: 1000.0 Hz
10:39:42 - Software trigger rate: 0.0 Hz
10:39:42 - Pedestal trigger rate: 0.0 Hz
10:39:42 - Collected trigger rate: 1000.0 Hz
10:39:42 - Busy rate: 0.0 Hz
10:39:42 - Camera trigger rate: 1000.0 Hz
10:39:43 - Status: TibState.Running ConnectionStatus: False TXclient_alive: True
10:39:43 - Alarms: AlarmVector.BufferFull|AlmostFull
10:39:43 - Temperature: 41.31
10:39:43 - Local camera rate: 0.0 Hz
10:39:43 - Stereo trigger rate: 0.0 Hz
10:39:43 - SPE trigger rate: 0.0 Hz
10:39:43 - Calibration trigger rate: 1000.0 Hz
10:39:43 - Software trigger rate: 0.0 Hz
10:39:43 - Pedestal trigger rate: 0.0 Hz
10:39:43 - Collected trigger rate: 1000.0 Hz
10:39:43 - Busy rate: 0.0 Hz
10:39:43 - Camera trigger rate: 1000.0 Hz
10:39:44 - Status: TibState.Running ConnectionStatus: False TXclient_alive: True
10:39:44 - Alarms: AlarmVector.BufferFull|AlmostFull
10:39:44 - Temperature: 41.38
10:39:44 - Local camera rate: 0.0 Hz
10:39:44 - Stereo trigger rate: 0.0 Hz
10:39:44 - SPE trigger rate: 0.0 Hz
10:39:44 - Calibration trigger rate: 1000.0 Hz
10:39:44 - Software trigger rate: 0.0 Hz
10:39:44 - Pedestal trigger rate: 0.0 Hz
10:39:44 - Collected trigger rate: 1000.0 Hz
10:39:44 - Busy rate: 0.0 Hz
10:39:44 - Camera trigger rate: 1000.0 Hz
10:39:45 - Status: TibState.Running ConnectionStatus: False TXclient_alive: True
10:39:45 - Alarms: AlarmVector.BufferFull|AlmostFull
10:39:45 - Temperature: 41.31
10:39:45 - Local camera rate: 0.0 Hz
10:39:45 - Stereo trigger rate: 0.0 Hz
10:39:45 - SPE trigger rate: 0.0 Hz
10:39:45 - Calibration trigger rate: 1000.0 Hz
10:39:45 - Software trigger rate: 0.0 Hz
10:39:45 - Pedestal trigger rate: 0.0 Hz
10:39:45 - Collected trigger rate: 1000.0 Hz
10:39:45 - Busy rate: 0.0 Hz
10:39:45 - Camera trigger rate: 1000.0 Hz
10:40:01 - Status: TibState.Running ConnectionStatus: False TXclient_alive: True
10:40:01 - Alarms: AlarmVector.BufferFull|AlmostFull
10:40:01 - Temperature: 41.38
10:40:01 - Local camera rate: 0.0 Hz
10:40:01 - Stereo trigger rate: 0.0 Hz
10:40:01 - SPE trigger rate: 0.0 Hz
10:40:01 - Calibration trigger rate: 0.0 Hz
10:40:01 - Software trigger rate: 0.0 Hz
10:40:01 - Pedestal trigger rate: 0.0 Hz
10:40:01 - Collected trigger rate: 0.0 Hz
10:40:01 - Busy rate: 0.0 Hz
10:40:01 - Camera trigger rate: 0.0 Hz
10:40:05 - Stopping TIB...
10:40:05 - Status: TibState.Running
10:40:05 - Alarms: AlarmVector.BufferFull|AlmostFull
10:40:05 - Connection status: False TXclient_alive: True
10:40:05 - Disabling trigger
10:40:05 - Disabling PPS
10:40:06 - Status: TibState.PpsStopped
10:40:06 - Alarms: AlarmVector.BufferFull|AlmostFull
10:40:06 - Connection status: False TXclient_alive: True
10:40:07 - Closing TIB connection to camera server
10:40:10 - Stopping NMC
10:40:15 - Found 0 PPS errors.
10:40:17 - Starting NMC
10:40:17 - Clearing PPS error counters
10:40:30 - Resetting FEB counters...
10:40:34 - Starting all configured modules...
10:40:41 - Calling method FSM.gotoReady in object FSM
10:40:56 - Calling method FSM.gotoObserving in object FSM
10:40:56 - Starting run -1
10:41:10 - Event builder is in state CameraServerState.Observing and has output 0 event(s) during run #2608.
10:41:17 - Configuring calibration box...
10:41:17 - Configuring calibration box with leds=0x1fff voltage=16.50 frequency=1000.0/1 central_current=0.0 duration=500 width=1 lemo_out=True fiber1_out=True fiber2_out=True lemo_in=False enabled=False
10:41:23 - Checking UCTS clock...
10:41:24 - UCTS and control PC clocks differ by 1.0 seconds
10:41:24 - Configuring UCTS with (10.200.7.250, 10.200.4.100, 44:a8:42:44:32:c9)
10:41:24 - Configuring TIB...
10:41:24 - Setting TIB forced mode to False
10:41:24 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v
10:41:24 - Status: TibState.PpsStopped
10:41:24 - Alarms: AlarmVector.BufferFull|AlmostFull
10:41:24 - Connection status: False TXclient_alive: False
10:41:24 - Entering set_external_delay
10:41:24 - Setting ExternalDelayLocal to 27.000 ns
10:41:24 - Writing 27.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v
10:41:24 - Entering set_external_delay
10:41:24 - Setting ExternalDelayCalibration to 58.000 ns
10:41:24 - Writing 58.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v
10:41:24 - Entering set_external_delay
10:41:24 - Setting ExternalDelaySphe to 110.000 ns
10:41:24 - Writing 110.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v
10:41:24 - Setting TIB trigger mode to 0x54 = TriggerMask.SlowControl|Software|Calibration
10:41:24 - Writing 84 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v
10:41:24 - Writing 1 to Camera.TIB.InputsEnable.InputMask.InputMask_v
10:41:24 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v
10:41:24 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v
10:41:24 - Writing True to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v
10:41:24 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v
10:41:24 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v
10:41:24 - Status: TibState.PpsStopped
10:41:24 - Alarms: AlarmVector.BufferFull|AlmostFull
10:41:24 - Connection status: False TXclient_alive: False
10:41:24 - Writing False to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v
10:41:24 - Writing 100 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v
10:41:24 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
10:41:24 - Writing False to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v
10:41:24 - Writing 100 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v
10:41:24 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v
10:41:24 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
10:41:24 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v
10:41:24 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v
10:41:24 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
10:41:26 - Connecting TIB to camera server at 10.10.4.12:222
10:41:26 - Starting TIB...
10:41:26 - Status: TibState.PpsStopped
10:41:26 - Alarms: AlarmVector.BufferFull|AlmostFull
10:41:26 - Connection status: False TXclient_alive: True
10:41:26 - Resetting run
10:41:26 - Wait for UCTS external trigger before enabling trigger...
10:41:26 - Status: TibState.Standby
10:41:26 - Alarms: AlarmVector.NoAlarm
10:41:26 - Connection status: False TXclient_alive: True
10:41:26 - Status: TibState.Standby
10:41:26 - Alarms: AlarmVector.NoAlarm
10:41:26 - Connection status: False TXclient_alive: True
10:41:27 - Status: TibState.Armed
10:41:27 - Alarms: AlarmVector.NoAlarm
10:41:27 - Connection status: True TXclient_alive: True
10:41:30 - Starting TIB triggers...
10:41:30 - Enabling trigger
10:41:30 - Status: TibState.Running
10:41:30 - Alarms: AlarmVector.NoAlarm
10:41:30 - Connection status: True TXclient_alive: True
10:41:36 - Starting flashes...
10:41:41 - Status: TibState.Running ConnectionStatus: True TXclient_alive: True
10:41:41 - Alarms: AlarmVector.ReadError
10:41:41 - Temperature: 41.44
10:41:41 - Local camera rate: 0.0 Hz
10:41:41 - Stereo trigger rate: 0.0 Hz
10:41:41 - SPE trigger rate: 0.0 Hz
10:41:41 - Calibration trigger rate: 1000.0 Hz
10:41:41 - Software trigger rate: 0.0 Hz
10:41:41 - Pedestal trigger rate: 0.0 Hz
10:41:41 - Collected trigger rate: 1000.0 Hz
10:41:41 - Busy rate: 0.0 Hz
10:41:41 - Camera trigger rate: 1000.0 Hz
10:42:35 - Stopping TIB...
10:42:35 - Status: TibState.Running
10:42:35 - Alarms: AlarmVector.ReadError
10:42:35 - Connection status: True TXclient_alive: True
10:42:35 - Disabling trigger
10:42:36 - Disabling PPS
10:42:37 - Status: TibState.PpsStopped
10:42:37 - Alarms: AlarmVector.ReadError
10:42:37 - Connection status: True TXclient_alive: True
10:42:38 - Closing TIB connection to camera server
10:42:39 - Status: TibState.PpsStopped
10:42:39 - Alarms: AlarmVector.ReadError
10:42:39 - Connection status: False TXclient_alive: False
10:42:39 - Run duration: 0:01:08
10:42:39 - Local camera triggers: 0
10:42:39 - Slow control triggers: 0
10:42:39 - Single photo-electron triggers: 0
10:42:39 - Calibration triggers: 49930
10:42:39 - Software triggers from UCTS: 0
10:42:40 - Pedestal triggers: 0
10:42:40 - Collected input triggers: 49930
10:42:40 - Busy triggers: 0
10:42:40 - Camera event triggers sent to clusters: 49930
10:42:43 - Calling method FSM.gotoReady in object FSM
10:42:48 - Stopping NMC
10:42:53 - Found 0 PPS errors.
10:43:00 - NMC is in state NmcState.Configured and knows of 265 drawer(s)
10:43:15 - All front-end boards have counted 49930 event(s)
10:43:20 - Found 0 PPS errors.
10:44:22 - Configuring calibration box...
10:44:22 - Configuring calibration box with leds=0x0 voltage=8.00 frequency=1000.0/1 central_current=0.0 duration=0 width=1 lemo_out=True fiber1_out=True fiber2_out=True lemo_in=True enabled=False
10:44:26 - Status: TibState.PpsStopped ConnectionStatus: False TXclient_alive: False
10:44:26 - Alarms: AlarmVector.ReadError
10:44:26 - Temperature: 41.62
10:44:26 - Local camera rate: 0.0 Hz
10:44:26 - Stereo trigger rate: 0.0 Hz
10:44:26 - SPE trigger rate: 0.0 Hz
10:44:26 - Calibration trigger rate: 0.0 Hz
10:44:26 - Software trigger rate: 0.0 Hz
10:44:26 - Pedestal trigger rate: 0.0 Hz
10:44:26 - Collected trigger rate: 0.0 Hz
10:44:26 - Busy rate: 0.0 Hz
10:44:26 - Camera trigger rate: 0.0 Hz
10:44:31 - Configuring calibration box...
10:44:31 - Configuring calibration box with leds=0x0 voltage=8.00 frequency=1000.0/1 central_current=0.0 duration=0 width=1 lemo_out=True fiber1_out=True fiber2_out=True lemo_in=True enabled=True
10:44:35 - Status: TibState.PpsStopped ConnectionStatus: False TXclient_alive: False
10:44:35 - Alarms: AlarmVector.ReadError
10:44:35 - Temperature: 41.62
10:44:35 - Local camera rate: 0.0 Hz
10:44:35 - Stereo trigger rate: 0.0 Hz
10:44:35 - SPE trigger rate: 0.0 Hz
10:44:35 - Calibration trigger rate: 3638.0 Hz
10:44:35 - Software trigger rate: 0.0 Hz
10:44:35 - Pedestal trigger rate: 0.0 Hz
10:44:35 - Collected trigger rate: 0.0 Hz
10:44:35 - Busy rate: 0.0 Hz
10:44:35 - Camera trigger rate: 0.0 Hz
10:44:36 - Status: TibState.PpsStopped ConnectionStatus: False TXclient_alive: False
10:44:36 - Alarms: AlarmVector.ReadError
10:44:36 - Temperature: 41.62
10:44:36 - Local camera rate: 0.0 Hz
10:44:36 - Stereo trigger rate: 0.0 Hz
10:44:36 - SPE trigger rate: 0.0 Hz
10:44:36 - Calibration trigger rate: 3661.0 Hz
10:44:36 - Software trigger rate: 0.0 Hz
10:44:36 - Pedestal trigger rate: 0.0 Hz
10:44:36 - Collected trigger rate: 0.0 Hz
10:44:37 - Busy rate: 0.0 Hz
10:44:37 - Camera trigger rate: 0.0 Hz
10:50:21 - Resetting NMC
10:50:23 - Could not invoke the MethodCall service: BadDisconnect
10:52:13 - NMC is in state NmcState.Ready and knows of 0 drawer(s)
10:52:15 - Starting task "Configure modules"
10:52:15 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/utils/branches/v5.6.0-41551 
10:52:15 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/libNectarCam/branches/v5.6.0-41551 
10:52:15 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/libQNectarCam/branches/v5.6.0-41551 
10:52:15 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/qNectarcamModuleController/branches/v5.6.0-41551
10:52:15 - Configuring modules with configuration /data/config/2021/20210929/config_cameraqm_265febs_Hamamatsu_ND.NMC.xml
10:52:15 - Switching off high voltages in configuration
10:52:16 - Setting DAQ address to IP=10.10.4.93, MAC=a4:bb:6d:b0:8c:ef
10:52:26 - Successfully configured 265 module(s)
10:52:26 - Waiting for modules to be configured...
10:52:33 - All front-end boards are programmed with firmware F56D2002
10:52:40 - Found 2 different versions of DTBP firmware: [15 17]
10:53:20 - NMC is in state NmcState.Ready and knows of 265 drawer(s)
10:53:35 - All front-end boards have counted 0 event(s)
10:53:40 - Found 0 PPS errors.
10:53:40 - Finished task "Configure modules"
10:54:32 - Updating voltage widget...
10:57:04 - Updating voltage widget...
10:57:57 - Checking UCTS clock...
10:57:57 - UCTS and control PC clocks differ by 0.9 seconds
10:57:57 - Configuring UCTS with (10.200.7.250, 10.200.4.100, 44:a8:42:44:32:c9)
10:57:58 - Configuring TIB...
10:57:58 - Setting TIB forced mode to False
10:57:58 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v
10:57:58 - Status: TibState.PpsStopped
10:57:58 - Alarms: AlarmVector.ReadError
10:57:58 - Connection status: False TXclient_alive: False
10:57:58 - Entering set_external_delay
10:57:58 - Setting ExternalDelayLocal to 27.000 ns
10:57:58 - Writing 27.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v
10:57:58 - Entering set_external_delay
10:57:58 - Setting ExternalDelayCalibration to 58.000 ns
10:57:58 - Writing 58.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v
10:57:58 - Entering set_external_delay
10:57:58 - Setting ExternalDelaySphe to 110.000 ns
10:57:58 - Writing 110.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v
10:57:58 - Setting TIB trigger mode to 0x70 = TriggerMask.SlowControl|Pedestal|Software
10:57:58 - Writing 112 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v
10:57:58 - Writing 1 to Camera.TIB.InputsEnable.InputMask.InputMask_v
10:57:58 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v
10:57:58 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v
10:57:58 - Writing True to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v
10:57:58 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v
10:57:58 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v
10:57:58 - Status: TibState.PpsStopped
10:57:58 - Alarms: AlarmVector.ReadError
10:57:58 - Connection status: False TXclient_alive: False
10:57:58 - Writing True to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v
10:57:58 - Writing 1000 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v
10:57:58 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
10:57:58 - Writing False to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v
10:57:58 - Writing 1000 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v
10:57:58 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v
10:57:58 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
10:57:58 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v
10:57:58 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v
10:57:58 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
10:58:02 - Connecting TIB to camera server at 10.10.4.12:222
10:58:02 - Starting TIB...
10:58:02 - Status: TibState.PpsStopped
10:58:02 - Alarms: AlarmVector.ReadError
10:58:02 - Connection status: False TXclient_alive: True
10:58:02 - Resetting run
10:58:02 - Wait for UCTS external trigger before enabling trigger...
10:58:02 - Status: TibState.Standby
10:58:02 - Alarms: AlarmVector.NoAlarm
10:58:02 - Connection status: False TXclient_alive: True
10:58:02 - Status: TibState.Standby
10:58:02 - Alarms: AlarmVector.NoAlarm
10:58:02 - Connection status: False TXclient_alive: True
10:58:03 - Status: TibState.Armed
10:58:03 - Alarms: AlarmVector.NoAlarm
10:58:04 - Connection status: False TXclient_alive: True
10:58:05 - Starting TIB triggers...
10:58:05 - Enabling trigger
10:58:05 - Status: TibState.Running
10:58:05 - Alarms: AlarmVector.NoAlarm
10:58:05 - Connection status: False TXclient_alive: True
10:58:08 - Status: TibState.Running ConnectionStatus: False TXclient_alive: True
10:58:08 - Alarms: AlarmVector.BufferFull|AlmostFull
10:58:08 - Temperature: 42.00
10:58:08 - Local camera rate: 0.0 Hz
10:58:08 - Stereo trigger rate: 0.0 Hz
10:58:08 - SPE trigger rate: 0.0 Hz
10:58:08 - Calibration trigger rate: 3541.0 Hz
10:58:08 - Software trigger rate: 0.0 Hz
10:58:08 - Pedestal trigger rate: 1000.0 Hz
10:58:08 - Collected trigger rate: 1000.0 Hz
10:58:08 - Busy rate: 0.0 Hz
10:58:08 - Camera trigger rate: 1000.0 Hz
11:04:05 - Resetting NMC
11:04:16 - Stopping TIB...
11:04:16 - Status: TibState.Running
11:04:16 - Alarms: AlarmVector.BufferFull|AlmostFull
11:04:16 - Connection status: False TXclient_alive: True
11:04:16 - Disabling trigger
11:04:16 - Disabling PPS
11:04:17 - Status: TibState.PpsStopped
11:04:17 - Alarms: AlarmVector.BufferFull|AlmostFull
11:04:17 - Connection status: False TXclient_alive: True
11:04:18 - Closing TIB connection to camera server
11:04:20 - Starting task "Configure modules"
11:04:20 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/utils/branches/v5.6.0-41551 
11:04:20 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/libNectarCam/branches/v5.6.0-41551 
11:04:20 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/libQNectarCam/branches/v5.6.0-41551 
11:04:20 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/qNectarcamModuleController/branches/v5.6.0-41551
11:04:20 - Configuring modules with configuration /data/config/2021/20210929/config_cameraqm_265febs_Hamamatsu_ND_DACL.NMC.xml
11:04:20 - Switching off high voltages in configuration
11:04:31 - Successfully configured 265 module(s)
11:04:31 - Waiting for modules to be configured...
11:04:37 - All front-end boards are programmed with firmware F56D2002
11:04:45 - Found 2 different versions of DTBP firmware: [15 17]
11:05:25 - NMC is in state NmcState.Ready and knows of 265 drawer(s)
11:05:39 - All front-end boards have counted 0 event(s)
11:05:44 - Found 0 PPS errors.
11:05:45 - Finished task "Configure modules"
11:09:19 - Starting task "Switch HVPA voltage state"
11:09:19 - Setting HVPA current limit to 12489.75 uA
11:09:19 - Setting Hvpa.Hvpa0.CurrentTrip in all drawers
11:09:29 - Setting Hvpa.Hvpa1.CurrentTrip in all drawers
11:09:39 - Setting Hvpa.Hvpa2.CurrentTrip in all drawers
11:09:48 - Setting Hvpa.Hvpa3.CurrentTrip in all drawers
11:09:58 - Setting Hvpa.Hvpa4.CurrentTrip in all drawers
11:10:08 - Setting Hvpa.Hvpa5.CurrentTrip in all drawers
11:10:18 - Setting Hvpa.Hvpa6.CurrentTrip in all drawers
11:10:28 - Setting HVPA ramp speed to 25 V/s
11:10:30 - Status: TibState.PpsStopped ConnectionStatus: False TXclient_alive: False
11:10:30 - Alarms: AlarmVector.BufferFull|AlmostFull
11:10:30 - Temperature: 42.44
11:10:30 - Local camera rate: 0.0 Hz
11:10:30 - Stereo trigger rate: 0.0 Hz
11:10:30 - SPE trigger rate: 0.0 Hz
11:10:30 - Calibration trigger rate: 3236.0 Hz
11:10:30 - Software trigger rate: 0.0 Hz
11:10:30 - Pedestal trigger rate: 1000.0 Hz
11:10:30 - Collected trigger rate: 0.0 Hz
11:10:30 - Busy rate: 0.0 Hz
11:10:30 - Camera trigger rate: 0.0 Hz
11:10:38 - Status: TibState.PpsStopped ConnectionStatus: False TXclient_alive: False
11:10:38 - Alarms: AlarmVector.BufferFull|AlmostFull
11:10:38 - Temperature: 42.44
11:10:38 - Local camera rate: 0.0 Hz
11:10:38 - Stereo trigger rate: 0.0 Hz
11:10:38 - SPE trigger rate: 0.0 Hz
11:10:38 - Calibration trigger rate: 3372.0 Hz
11:10:38 - Software trigger rate: 0.0 Hz
11:10:38 - Pedestal trigger rate: 999.0 Hz
11:10:38 - Collected trigger rate: 0.0 Hz
11:10:38 - Busy rate: 0.0 Hz
11:10:38 - Camera trigger rate: 0.0 Hz
11:10:39 - Switching HVPA to state Nominal
11:10:58 - Setting HVPA current limits...
11:12:20 - Finished task "Switch HVPA voltage state"
11:12:31 - Status: TibState.PpsStopped ConnectionStatus: False TXclient_alive: False
11:12:31 - Alarms: AlarmVector.BufferFull|AlmostFull
11:12:31 - Temperature: 42.50
11:12:31 - Local camera rate: 0.0 Hz
11:12:31 - Stereo trigger rate: 0.0 Hz
11:12:31 - SPE trigger rate: 0.0 Hz
11:12:31 - Calibration trigger rate: 4007.0 Hz
11:12:31 - Software trigger rate: 0.0 Hz
11:12:31 - Pedestal trigger rate: 999.0 Hz
11:12:31 - Collected trigger rate: 0.0 Hz
11:12:31 - Busy rate: 0.0 Hz
11:12:31 - Camera trigger rate: 0.0 Hz
11:12:32 - Status: TibState.PpsStopped ConnectionStatus: False TXclient_alive: False
11:12:32 - Alarms: AlarmVector.BufferFull|AlmostFull
11:12:32 - Temperature: 42.56
11:12:32 - Local camera rate: 0.0 Hz
11:12:32 - Stereo trigger rate: 0.0 Hz
11:12:32 - SPE trigger rate: 0.0 Hz
11:12:32 - Calibration trigger rate: 4007.0 Hz
11:12:32 - Software trigger rate: 0.0 Hz
11:12:32 - Pedestal trigger rate: 999.0 Hz
11:12:32 - Collected trigger rate: 0.0 Hz
11:12:32 - Busy rate: 0.0 Hz
11:12:32 - Camera trigger rate: 0.0 Hz
11:12:36 - Updating voltage widget...
11:13:02 - High voltage locked channels will be checked every 60 s
11:13:11 - Starting NMC
11:13:11 - Clearing PPS error counters
11:13:24 - Resetting FEB counters...
11:13:28 - Starting all configured modules...
11:14:02 - Calling method FSM.gotoObserving in object FSM
11:14:02 - Starting run 2609
11:14:02 - Checking for high voltage locked pixels...
11:14:16 - HVPA channel 2 of drawer 86 has status 0x0007!
11:14:16 - HVPA channel 2 in module 86 is in rise default!
11:14:29 - HV is locked in 0 channel(s), was in rise default in 1 channel(s) and was still in progress in 1 channel(s)
11:14:52 - Checking UCTS clock...
11:14:52 - UCTS and control PC clocks differ by 0.5 seconds
11:14:52 - Configuring UCTS with (10.200.7.250, 10.200.4.100, 44:a8:42:44:32:c9)
11:14:52 - Configuring TIB...
11:14:52 - Setting TIB forced mode to False
11:14:52 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v
11:14:52 - Status: TibState.PpsStopped
11:14:52 - Alarms: AlarmVector.BufferFull|AlmostFull
11:14:52 - Connection status: False TXclient_alive: False
11:14:52 - Entering set_external_delay
11:14:52 - Setting ExternalDelayLocal to 27.000 ns
11:14:52 - Writing 27.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v
11:14:52 - Entering set_external_delay
11:14:52 - Setting ExternalDelayCalibration to 58.000 ns
11:14:52 - Writing 58.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v
11:14:53 - Entering set_external_delay
11:14:53 - Setting ExternalDelaySphe to 110.000 ns
11:14:53 - Writing 110.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v
11:14:53 - Setting TIB trigger mode to 0x70 = TriggerMask.SlowControl|Pedestal|Software
11:14:53 - Writing 112 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v
11:14:53 - Writing 1 to Camera.TIB.InputsEnable.InputMask.InputMask_v
11:14:53 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v
11:14:53 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v
11:14:53 - Writing True to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v
11:14:53 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v
11:14:53 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v
11:14:53 - Status: TibState.PpsStopped
11:14:53 - Alarms: AlarmVector.BufferFull|AlmostFull
11:14:53 - Connection status: False TXclient_alive: False
11:14:53 - Writing True to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v
11:14:53 - Writing 1000 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v
11:14:53 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
11:14:53 - Writing False to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v
11:14:53 - Writing 1000 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v
11:14:53 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v
11:14:53 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
11:14:53 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v
11:14:53 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v
11:14:53 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
11:14:58 - Connecting TIB to camera server at 10.10.4.12:222
11:14:58 - Starting TIB...
11:14:58 - Status: TibState.PpsStopped
11:14:58 - Alarms: AlarmVector.BufferFull|AlmostFull
11:14:58 - Connection status: False TXclient_alive: True
11:14:58 - Resetting run
11:14:58 - Wait for UCTS external trigger before enabling trigger...
11:14:58 - Status: TibState.Standby
11:14:58 - Alarms: AlarmVector.NoAlarm
11:14:58 - Connection status: False TXclient_alive: True
11:14:58 - Status: TibState.Standby
11:14:58 - Alarms: AlarmVector.NoAlarm
11:14:58 - Connection status: False TXclient_alive: True
11:14:59 - Status: TibState.Armed
11:14:59 - Alarms: AlarmVector.NoAlarm
11:14:59 - Connection status: True TXclient_alive: True
11:15:01 - Starting TIB triggers...
11:15:01 - Enabling trigger
11:15:01 - Status: TibState.Running
11:15:01 - Alarms: AlarmVector.ReadError
11:15:01 - Connection status: True TXclient_alive: True
11:15:02 - Checking for high voltage locked pixels...
11:15:16 - HVPA channel 2 of drawer 86 has status 0x0007!
11:15:16 - HVPA channel 2 in module 86 is in rise default!
11:15:28 - HV is locked in 0 channel(s), was in rise default in 1 channel(s) and was still in progress in 3 channel(s)
11:15:50 - Stopping TIB...
11:15:50 - Status: TibState.Running
11:15:50 - Alarms: AlarmVector.ReadError
11:15:50 - Connection status: True TXclient_alive: True
11:15:50 - Disabling trigger
11:15:50 - Disabling PPS
11:15:51 - Status: TibState.PpsStopped
11:15:51 - Alarms: AlarmVector.ReadError
11:15:51 - Connection status: True TXclient_alive: True
11:15:52 - Closing TIB connection to camera server
11:15:55 - Status: TibState.PpsStopped
11:15:55 - Alarms: AlarmVector.ReadError
11:15:55 - Connection status: False TXclient_alive: False
11:15:55 - Run duration: 0:00:51
11:15:55 - Local camera triggers: 0
11:15:55 - Slow control triggers: 0
11:15:55 - Single photo-electron triggers: 0
11:15:55 - Calibration triggers: 203781
11:15:55 - Software triggers from UCTS: 0
11:15:55 - Pedestal triggers: 50342
11:15:55 - Collected input triggers: 48870
11:15:55 - Busy triggers: 0
11:15:55 - Camera event triggers sent to clusters: 48870
11:16:02 - Checking for high voltage locked pixels...
11:16:16 - HVPA channel 2 of drawer 86 has status 0x0007!
11:16:16 - HVPA channel 2 in module 86 is in rise default!
11:16:29 - HV is locked in 0 channel(s), was in rise default in 1 channel(s) and was still in progress in 2 channel(s)
11:16:29 - Calling method FSM.gotoReady in object FSM
11:16:39 - Stopped periodic check of locked high voltages
11:16:42 - Stopping NMC
11:16:47 - Found 0 PPS errors.
11:16:50 - NMC is in state NmcState.Configured and knows of 265 drawer(s)
11:17:05 - All front-end boards have counted 48870 event(s)
11:17:10 - Found 0 PPS errors.
11:17:12 - Event builder is in state CameraServerState.Ready and has output 48870 event(s) during run #2609.