08:56:48 - ECC is in state EccState.Safe and transition EccTransition.Idle 08:56:48 - Active alarms: ['Alarm_General_current'] 08:56:48 - PDB temperature: 32.5 deg C 08:56:48 - Status of UPS power: V=232.0 V, I=0.80 A, P=0.090 kW, Q=0.000 kVAR, S=0.190 kVA, cos=-0.40 08:56:48 - Status of 400 V: V1=233.0 V, V2=232.0 V, V3=232.0 V, I1=0.55 A, I2=1.51 A, I3=1.32 A, f=50.0 Hz, cos=0.58 08:56:48 - Status of 400 V: P1=0.080 kW, P2=0.320 kW, P3=-0.100 kW, Q1=0.080 kVAR, Q2=-0.000 kVAR, Q3=0.250 kVAR, S1=0.120 kVA, S2=0.340 kVA, S3=-0.300 kVA 08:56:48 - 0 relays enabled in PSB1. Total current of -0.2 A. 08:56:48 - 0 relays enabled in PSB2. Total current of -0.2 A. 08:56:48 - Status of PDB switches: StateBreaker=True, StateEmergencyStop=False, SwitchStatus_General400V=True, SwitchStatus_General230V=False, SwitchStatus_line400V=True, SwitchStatus_switch1=False, SwitchStatus_switch2=False, SwitchStatus_fanFront=True, SwitchStatus_fanRear=True, SwitchStatus_shutter=False 08:56:48 - Average air temperature: 27.0 deg C 08:56:48 - Air temperature (T1-T13): 27.0, 27.2, 29.9, 25.8, 24.5, 25.9, 24.2, 25.7, 27.0, 28.4, 25.0, 23.1, 22.7 deg C 08:56:48 - Air differential pressure: 0.2 Pa 08:56:48 - Back doors are closed. 08:56:48 - Light sensors: [0.0, 0.0] V 08:56:48 - Cooling valve is 100 %% open.Water flow: 29.4 l/min.Water pressure: [1.0, 1.5] bar 08:56:48 - Water temperature (T14-T16): 18.5, 15.8, 15.6 deg C 08:56:48 - Humidity: 41.0 %. 08:56:48 - Fan speeds: [900.0, 840.0, 840.0, 840.0, 840.0, 840.0, 1440.0, 1500.0, 1380.0, 1320.0, 1440.0, 1620.0, 1440.0, 1560.0, 0.0, 0.0] rpm 08:56:51 - Starting task "Prepare ECC" 08:56:51 - Preparing ECC... 08:56:51 - Setting ECC temperature range for Ready state to [16.000000, 36.000000] 08:56:51 - Setting ECC mode to EccTransition.Ready 08:56:52 - Received ECC state change notification: EccState.Safe 08:57:09 - Received ECC state change notification: EccState.Ready 08:57:10 - Setting power supply box SPE relay to False 08:57:11 - Setting power supply box MCB relay to False 08:57:11 - Finished task "Prepare ECC" 09:05:44 - Starting task "Powering modules..." 09:05:44 - Enabling power in all modules 09:05:45 - Finished task "Powering modules..." 09:05:47 - Updating DTC module currents... 09:05:56 - Starting task "Configure modules" 09:05:56 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/utils/branches/v5.6.0-41551 09:05:56 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/libNectarCam/branches/v5.6.0-41551 09:05:56 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/libQNectarCam/branches/v5.6.0-41551 09:05:56 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/qNectarcamModuleController/branches/v5.6.0-41551 09:05:56 - Configuring modules with configuration /data/config/2021/20211011/config_cameraqm_265febs_newHV4.NMC.xml 09:05:56 - Switching off high voltages in configuration 09:06:06 - Successfully configured 265 module(s) 09:06:06 - Waiting for modules to be configured... 09:06:13 - All front-end boards are programmed with firmware F56D2002 09:06:26 - Found 2 different versions of DTBP firmware: [15 17] 09:07:25 - NMC is in state NmcState.Ready and knows of 265 drawer(s) 09:07:48 - All front-end boards have counted 0 event(s) 09:07:56 - Found PPS errors: 213 in drawer 0, 213 in drawer 1, 213 in drawer 2, 213 in drawer 3, 213 in drawer 4, 214 in drawer 5, 214 in drawer 8, 214 in drawer 9, 214 in drawer 10, 214 in drawer 11, 214 in drawer 12, 214 in drawer 13, 214 in drawer 14, 214 in drawer 15, 214 in drawer 16, 214 in drawer 17, 214 in drawer 18, 214 in drawer 19, 214 in drawer 20, 214 in drawer 21, 214 in drawer 22, 214 in drawer 23, 214 in drawer 24, 214 in drawer 25, 214 in drawer 26, 214 in drawer 27, 214 in drawer 28, 214 in drawer 29, 214 in drawer 30, 214 in drawer 31, 215 in drawer 32, 215 in drawer 33, 215 in drawer 34, 215 in drawer 35, 215 in drawer 36, 215 in drawer 37, 215 in drawer 38, 215 in drawer 39, 216 in drawer 40, 216 in drawer 41, 216 in drawer 42, 216 in drawer 43, 216 in drawer 44, 216 in drawer 45, 216 in drawer 46, 216 in drawer 47, 216 in drawer 48, 216 in drawer 49, 216 in drawer 50, 216 in drawer 51, 216 in drawer 52, 216 in drawer 53, 216 in drawer 54, 216 in drawer 55, 216 in drawer 56, 216 in drawer 57, 216 in drawer 58, 216 in drawer 59, 216 in drawer 60, 216 in drawer 61, 216 in drawer 62, 216 in drawer 63, 216 in drawer 64, 216 in drawer 65, 217 in drawer 66, 217 in drawer 67, 217 in drawer 68, 217 in drawer 69, 217 in drawer 70, 217 in drawer 71, 217 in drawer 72, 217 in drawer 73, 217 in drawer 74, 218 in drawer 75, 218 in drawer 76, 218 in drawer 77, 218 in drawer 78, 218 in drawer 79, 218 in drawer 80, 218 in drawer 81, 218 in drawer 82, 218 in drawer 83, 218 in drawer 84, 218 in drawer 85, 218 in drawer 86, 218 in drawer 87, 218 in drawer 88, 218 in drawer 89, 218 in drawer 90, 218 in drawer 91, 218 in drawer 92, 218 in drawer 93, 218 in drawer 94, 218 in drawer 95, 218 in drawer 96, 218 in drawer 97, 218 in drawer 98, 218 in drawer 99, 218 in drawer 100, 219 in drawer 101, 219 in drawer 102, 219 in drawer 103, 219 in drawer 104, 219 in drawer 105, 219 in drawer 106, 219 in drawer 107, 219 in drawer 108, 219 in drawer 109, 220 in drawer 110, 220 in drawer 111, 220 in drawer 112, 220 in drawer 113, 220 in drawer 114, 220 in drawer 115, 220 in drawer 116, 220 in drawer 117, 220 in drawer 118, 220 in drawer 119, 220 in drawer 120, 220 in drawer 121, 220 in drawer 122, 220 in drawer 123, 220 in drawer 124, 220 in drawer 125, 220 in drawer 126, 220 in drawer 127, 220 in drawer 128, 220 in drawer 129, 220 in drawer 130, 220 in drawer 131, 220 in drawer 132, 220 in drawer 133, 220 in drawer 134, 220 in drawer 135, 221 in drawer 136, 221 in drawer 137, 221 in drawer 138, 221 in drawer 139, 221 in drawer 140, 221 in drawer 141, 221 in drawer 142, 221 in drawer 143, 222 in drawer 144, 222 in drawer 145, 222 in drawer 146, 222 in drawer 147, 222 in drawer 148, 222 in drawer 149, 222 in drawer 150, 222 in drawer 151, 222 in drawer 152, 222 in drawer 153, 222 in drawer 154, 222 in drawer 155, 222 in drawer 156, 222 in drawer 157, 222 in drawer 158, 222 in drawer 159, 222 in drawer 160, 222 in drawer 161, 222 in drawer 162, 222 in drawer 163, 222 in drawer 164, 222 in drawer 165, 222 in drawer 166, 222 in drawer 167, 222 in drawer 168, 222 in drawer 169, 223 in drawer 170, 223 in drawer 171, 223 in drawer 172, 223 in drawer 173, 223 in drawer 174, 223 in drawer 175, 223 in drawer 176, 223 in drawer 177, 223 in drawer 178, 224 in drawer 179, 224 in drawer 180, 224 in drawer 181, 224 in drawer 182, 224 in drawer 183, 224 in drawer 184, 224 in drawer 185, 224 in drawer 186, 224 in drawer 187, 224 in drawer 188, 224 in drawer 189, 224 in drawer 190, 224 in drawer 191, 224 in drawer 192, 224 in drawer 193, 224 in drawer 194, 224 in drawer 195, 224 in drawer 196, 224 in drawer 197, 224 in drawer 198, 224 in drawer 199, 224 in drawer 200, 224 in drawer 201, 224 in drawer 202, 224 in drawer 203, 224 in drawer 204, 225 in drawer 205, 225 in drawer 206, 225 in drawer 207, 225 in drawer 208, 225 in drawer 209, 225 in drawer 210, 225 in drawer 211, 225 in drawer 212, 225 in drawer 213, 226 in drawer 214, 226 in drawer 215, 226 in drawer 216, 226 in drawer 217, 226 in drawer 218, 226 in drawer 219, 226 in drawer 220, 226 in drawer 221, 226 in drawer 222, 226 in drawer 223, 226 in drawer 224, 226 in drawer 225, 226 in drawer 226, 226 in drawer 227, 226 in drawer 228, 226 in drawer 229, 226 in drawer 230, 226 in drawer 231, 226 in drawer 232, 226 in drawer 233, 226 in drawer 234, 226 in drawer 235, 226 in drawer 236, 226 in drawer 237, 226 in drawer 238, 226 in drawer 239, 227 in drawer 240, 227 in drawer 241, 227 in drawer 242, 227 in drawer 243, 227 in drawer 244, 227 in drawer 245, 227 in drawer 246, 227 in drawer 247, 228 in drawer 248, 228 in drawer 249, 228 in drawer 250, 228 in drawer 251, 228 in drawer 252, 228 in drawer 253, 228 in drawer 254, 228 in drawer 255, 228 in drawer 256, 228 in drawer 257, 228 in drawer 258, 228 in drawer 259, 228 in drawer 260, 228 in drawer 261, 228 in drawer 262, 228 in drawer 263, 228 in drawer 264 09:07:56 - Finished task "Configure modules" 09:18:06 - Starting task "Switch HVPA voltage state" 09:18:06 - Setting HVPA current limit to 12489.75 uA 09:18:06 - Setting Hvpa.Hvpa0.CurrentTrip in all drawers 09:18:21 - Setting Hvpa.Hvpa1.CurrentTrip in all drawers 09:18:36 - Setting Hvpa.Hvpa2.CurrentTrip in all drawers 09:18:52 - Setting Hvpa.Hvpa3.CurrentTrip in all drawers 09:19:07 - Setting Hvpa.Hvpa4.CurrentTrip in all drawers 09:19:22 - Setting Hvpa.Hvpa5.CurrentTrip in all drawers 09:19:37 - Setting Hvpa.Hvpa6.CurrentTrip in all drawers 09:19:52 - Setting HVPA ramp speed to 25 V/s 09:20:09 - Switching HVPA to state Nominal 09:20:41 - Setting HVPA current limits... 09:22:41 - Finished task "Switch HVPA voltage state" 09:27:46 - High voltage locked channels will be checked every 60 s 09:27:59 - Calling method FSM.gotoObserving in object FSM 09:27:59 - Starting run 2677 09:28:04 - Starting NMC 09:28:04 - Clearing PPS error counters 09:28:25 - Resetting FEB counters... 09:28:32 - Starting all configured modules... 09:28:46 - Checking for high voltage locked pixels... 09:29:11 - HVPA channel 2 of drawer 86 has status 0x0007! 09:29:11 - HVPA channel 2 in module 86 is in rise default! 09:29:34 - HVPA channel 6 in module 73 is still in progress 09:29:34 - HV is locked in 0 channel(s), was in rise default in 1 channel(s) and was still in progress in 2 channel(s) 09:29:46 - Checking for high voltage locked pixels... 09:30:11 - HVPA channel 2 of drawer 86 has status 0x0007! 09:30:11 - HVPA channel 2 in module 86 is in rise default! 09:30:28 - HVPA channel 5 in module 171 is still in progress 09:30:34 - HV is locked in 0 channel(s), was in rise default in 1 channel(s) and was still in progress in 2 channel(s) 09:30:46 - Checking for high voltage locked pixels... 09:31:11 - HVPA channel 2 of drawer 86 has status 0x0007! 09:31:11 - HVPA channel 2 in module 86 is in rise default! 09:31:34 - HVPA channel 6 of drawer 73 has status 0x8003! 09:31:34 - HVPA channel 6 in module 73 is locked! 09:31:34 - HV is locked in 1 channel(s), was in rise default in 1 channel(s) and was still in progress in 2 channel(s) 09:31:34 - Unlocking 1 channel(s)... 09:31:46 - Checking for high voltage locked pixels... 09:32:11 - HVPA channel 2 of drawer 86 has status 0x0007! 09:32:11 - HVPA channel 2 in module 86 is in rise default! 09:32:28 - HVPA channel 5 in module 171 is still in progress 09:32:34 - HVPA channel 6 in module 73 is still in progress 09:32:34 - HV is locked in 0 channel(s), was in rise default in 1 channel(s) and was still in progress in 3 channel(s) 09:32:46 - Checking for high voltage locked pixels... 09:33:11 - HVPA channel 2 of drawer 86 has status 0x0007! 09:33:11 - HVPA channel 2 in module 86 is in rise default! 09:33:28 - HVPA channel 5 in module 171 is still in progress 09:33:34 - HV is locked in 0 channel(s), was in rise default in 1 channel(s) and was still in progress in 2 channel(s) 09:33:46 - Checking for high voltage locked pixels... 09:34:11 - HVPA channel 2 of drawer 86 has status 0x0007! 09:34:11 - HVPA channel 2 in module 86 is in rise default! 09:34:28 - HVPA channel 5 in module 171 is still in progress 09:34:34 - HVPA channel 6 in module 73 is still in progress 09:34:34 - HVPA channel 6 in module 161 is still in progress 09:34:34 - HV is locked in 0 channel(s), was in rise default in 1 channel(s) and was still in progress in 4 channel(s) 09:34:46 - Checking for high voltage locked pixels... 09:35:11 - HVPA channel 2 of drawer 86 has status 0x0007! 09:35:11 - HVPA channel 2 in module 86 is in rise default! 09:35:34 - HV is locked in 0 channel(s), was in rise default in 1 channel(s) and was still in progress in 1 channel(s) 09:35:39 - Stopped periodic check of locked high voltages 09:35:44 - Checking UCTS clock... 09:35:45 - UCTS clock is late by 10 seconds! 09:35:45 - Configuring UCTS with (10.200.7.250, 10.200.4.100, 44:a8:42:44:32:c9) 09:35:45 - Configuring TIB... 09:35:45 - Setting TIB forced mode to False 09:35:45 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v 09:35:45 - Status: TibState.RunStopped 09:35:45 - Alarms: AlarmVector.BufferFull 09:35:45 - Connection status: False TXclient_alive: False 09:35:45 - Disabling PPS 09:35:47 - Status: TibState.PpsStopped 09:35:47 - Alarms: AlarmVector.BufferFull 09:35:47 - Connection status: False TXclient_alive: False 09:35:47 - Entering set_external_delay 09:35:47 - Setting ExternalDelayLocal to 27.000 ns 09:35:47 - Writing 27.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v 09:35:47 - Entering set_external_delay 09:35:47 - Setting ExternalDelayCalibration to 58.000 ns 09:35:47 - Writing 58.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v 09:35:47 - Entering set_external_delay 09:35:47 - Setting ExternalDelaySphe to 110.000 ns 09:35:47 - Writing 110.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v 09:35:47 - Setting TIB trigger mode to 0x54 = TriggerMask.SlowControl|Software|Calibration 09:35:47 - Writing 84 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v 09:35:47 - Writing 1 to Camera.TIB.InputsEnable.InputMask.InputMask_v 09:35:47 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v 09:35:47 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v 09:35:47 - Writing True to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v 09:35:47 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v 09:35:47 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v 09:35:47 - Status: TibState.PpsStopped 09:35:47 - Alarms: AlarmVector.BufferFull 09:35:47 - Connection status: False TXclient_alive: False 09:35:47 - Writing False to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v 09:35:47 - Writing 100 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v 09:35:48 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 09:35:48 - Writing False to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v 09:35:48 - Writing 100 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v 09:35:48 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v 09:35:48 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 09:35:48 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v 09:35:48 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v 09:35:48 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 09:35:49 - Connecting TIB to camera server at 10.10.4.12:222 09:35:49 - Starting TIB... 09:35:49 - Status: TibState.PpsStopped 09:35:49 - Alarms: AlarmVector.BufferFull 09:35:49 - Connection status: False TXclient_alive: False 09:35:49 - Resetting run 09:35:49 - Wait for UCTS external trigger before enabling trigger... 09:35:49 - Status: TibState.Standby 09:35:49 - Alarms: AlarmVector.NoAlarm 09:35:49 - Connection status: False TXclient_alive: True 09:35:49 - Status: TibState.Standby 09:35:49 - Alarms: AlarmVector.NoAlarm 09:35:49 - Connection status: False TXclient_alive: True 09:35:50 - Status: TibState.Armed 09:35:50 - Alarms: AlarmVector.NoAlarm 09:35:50 - Connection status: False TXclient_alive: True 09:35:51 - Starting TIB triggers... 09:35:51 - Enabling trigger 09:35:51 - Status: TibState.Running 09:35:51 - Alarms: AlarmVector.NoAlarm 09:35:51 - Connection status: True TXclient_alive: True 09:35:55 - Configuring calibration box... 09:35:55 - Configuring calibration box with leds=0x40 voltage=11.00 frequency=1000.0/1 central_current=0.0 duration=500 width=1 lemo_out=True fiber1_out=True fiber2_out=True lemo_in=False enabled=False 09:35:56 - Starting flashes... 09:37:02 - Stopping TIB... 09:37:02 - Status: TibState.Running 09:37:02 - Alarms: AlarmVector.ReadError 09:37:02 - Connection status: True TXclient_alive: True 09:37:02 - Disabling trigger 09:37:02 - Disabling PPS 09:37:03 - Status: TibState.PpsStopped 09:37:03 - Alarms: AlarmVector.ReadError 09:37:03 - Connection status: True TXclient_alive: True 09:37:04 - Closing TIB connection to camera server 09:37:05 - Status: TibState.PpsStopped 09:37:05 - Alarms: AlarmVector.ReadError 09:37:05 - Connection status: False TXclient_alive: False 09:37:05 - Run duration: 0:01:12 09:37:05 - Local camera triggers: 0 09:37:05 - Slow control triggers: 0 09:37:05 - Single photo-electron triggers: 0 09:37:05 - Calibration triggers: 49961 09:37:05 - Software triggers from UCTS: 0 09:37:05 - Pedestal triggers: 0 09:37:05 - Collected input triggers: 49961 09:37:05 - Busy triggers: 0 09:37:05 - Camera event triggers sent to clusters: 49961 09:37:07 - Calling method FSM.gotoReady in object FSM 09:37:13 - Stopping NMC 09:37:21 - Found 0 PPS errors.