11:36:44 - ECC is in state EccState.Safe and transition EccTransition.Idle 11:36:44 - Active alarms: ['Alarm_General_current'] 11:36:44 - PDB temperature: 27.1 deg C 11:36:44 - Status of UPS power: V=234.0 V, I=0.80 A, P=0.090 kW, Q=4294.000 kVAR, S=0.190 kVA, PF=4294.00 11:36:44 - Status of 400 V: V1=234.0 V, V2=233.0 V, V3=233.0 V, I1=0.61 A, I2=1.47 A, I3=1.31 A, f=50.0 Hz, cos=0.65 11:36:45 - Status of 400 V: P1=0.080 kW, P2=0.340 kW, P3=4294.000 kW, Q1=0.100 kVAR, Q2=4294.000 kVAR, Q3=0.250 kVAR, S1=0.150 kVA, S2=0.350 kVA, S3=4294.000 kVA 11:36:45 - 0 relays enabled in PSB1. Total current of 0.0 A. 11:36:45 - 0 relays enabled in PSB2. Total current of 0.0 A. 11:36:45 - Status of PDB switches: StateBreaker=True, StateEmergencyStop=False, SwitchStatus_General400V=True, SwitchStatus_General230V=False, SwitchStatus_line400V=True, SwitchStatus_switch1=False, SwitchStatus_switch2=False, SwitchStatus_fanFront=True, SwitchStatus_fanRear=True, SwitchStatus_shutter=False 11:36:45 - Average air temperature: 24.8 deg C 11:36:45 - Air temperature (T1-T13): 24.8, 24.7, 25.2, 26.5, 24.8, 25.6, 24.8, 25.1, 24.3, 26.3, 25.9, 23.8, 22.5 deg C 11:36:45 - Air differential pressure: 0.2 Pa 11:36:45 - Back doors are closed. 11:36:45 - Light sensors: [0.0, 0.0] V 11:36:45 - Cooling valve is 100 %% open.Water flow: 9.8 l/min.Water pressure: [0.5, 0.5] bar 11:36:45 - Water temperature (T14-T16): 15.4, 15.3, 14.8 deg C 11:36:45 - Humidity: 62.7 %. 11:36:45 - Fan speeds: [840.0, 840.0, 840.0, 900.0, 900.0, 900.0] rpm 11:36:48 - Starting task "Prepare ECC" 11:36:48 - Preparing ECC... 11:36:48 - Setting ECC temperature range for Ready state to [16.000000, 36.000000] 11:36:48 - Setting ECC mode to EccTransition.Ready 11:36:49 - Received ECC state change notification: EccState.Safe 11:37:06 - Received ECC state change notification: EccState.Ready 11:37:07 - Setting power supply box SPE relay to False 11:37:08 - Setting power supply box MCB relay to False 11:37:08 - Finished task "Prepare ECC" 11:38:06 - Starting task "Powering modules..." 11:38:06 - Enabling power in all modules 11:38:06 - Finished task "Powering modules..." 11:38:12 - Updating DTC module currents... 11:39:01 - Updating DTC module currents... 11:39:10 - Scanning interface enp2s0 for non configured modules... 11:40:07 - Found 0 MAC address(es) 11:40:21 - Updating DTC module currents... 11:40:32 - Scanning interface enp2s0 for non configured modules... 11:41:29 - Found 0 MAC address(es) 11:41:45 - Starting task "Configure modules" 11:41:45 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/utils/branches/v5.6.0-41551 11:41:45 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/libNectarCam/branches/v5.6.0-41551 11:41:45 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/libQNectarCam/branches/v5.6.0-41551 11:41:45 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/qNectarcamModuleController/branches/v5.6.0-41551 11:41:45 - Configuring modules with configuration /data/config/2021/20210907/config_cameraqm_265febs_newnewDACL_newHV6.NMC.xml 11:41:45 - Switching off high voltages in configuration 11:41:52 - ("NmcError: Failed to call 'Configure': status Bad statuses are present, code 0xfffffffe, status NmcStatus.Timeout", 4294967294) 11:41:52 - NMC is in state NmcState.Ready and knows of 0 drawer(s) 11:49:24 - Starting task "Configure modules" 11:49:24 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/utils/branches/v5.6.0-41551 11:49:24 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/libNectarCam/branches/v5.6.0-41551 11:49:24 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/libQNectarCam/branches/v5.6.0-41551 11:49:24 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/qNectarcamModuleController/branches/v5.6.0-41551 11:49:24 - Configuring modules with configuration /data/config/2021/20210907/config_cameraqm_265febs_newnewDACL_newHV6.NMC.xml 11:49:24 - Switching off high voltages in configuration 11:49:32 - Successfully configured 265 module(s) 11:49:32 - Waiting for modules to be configured... 11:49:38 - All front-end boards are programmed with firmware F56D2002 11:49:46 - Found 2 different versions of DTBP firmware: [15 17] 11:50:26 - NMC is in state NmcState.Ready and knows of 265 drawer(s) 11:50:40 - All front-end boards have counted 0 event(s) 11:50:45 - Found PPS errors: 142 in drawer 0, 144 in drawer 1, 142 in drawer 2, 144 in drawer 3, 142 in drawer 4, 144 in drawer 5, 144 in drawer 8, 144 in drawer 9, 142 in drawer 10, 142 in drawer 11, 144 in drawer 12, 144 in drawer 13, 144 in drawer 14, 143 in drawer 15, 143 in drawer 16, 145 in drawer 17, 145 in drawer 18, 143 in drawer 19, 143 in drawer 20, 145 in drawer 21, 145 in drawer 22, 145 in drawer 23, 145 in drawer 24, 145 in drawer 25, 145 in drawer 26, 145 in drawer 27, 143 in drawer 28, 146 in drawer 29, 146 in drawer 30, 146 in drawer 31, 144 in drawer 32, 144 in drawer 33, 146 in drawer 34, 144 in drawer 35, 144 in drawer 36, 144 in drawer 37, 146 in drawer 38, 144 in drawer 39, 146 in drawer 40, 146 in drawer 41, 146 in drawer 42, 144 in drawer 43, 146 in drawer 44, 144 in drawer 45, 146 in drawer 46, 144 in drawer 47, 144 in drawer 48, 144 in drawer 49, 144 in drawer 50, 144 in drawer 51, 146 in drawer 52, 146 in drawer 53, 144 in drawer 54, 146 in drawer 55, 146 in drawer 56, 146 in drawer 57, 146 in drawer 58, 144 in drawer 59, 144 in drawer 60, 144 in drawer 61, 146 in drawer 62, 146 in drawer 63, 146 in drawer 64, 144 in drawer 65, 144 in drawer 66, 146 in drawer 67, 146 in drawer 68, 144 in drawer 69, 147 in drawer 70, 147 in drawer 71, 145 in drawer 72, 147 in drawer 73, 145 in drawer 74, 147 in drawer 75, 145 in drawer 76, 145 in drawer 77, 147 in drawer 78, 145 in drawer 79, 147 in drawer 80, 147 in drawer 81, 145 in drawer 82, 146 in drawer 83, 146 in drawer 84, 148 in drawer 85, 146 in drawer 86, 148 in drawer 87, 148 in drawer 88, 146 in drawer 89, 146 in drawer 90, 148 in drawer 91, 148 in drawer 92, 148 in drawer 93, 148 in drawer 94, 146 in drawer 95, 146 in drawer 96, 148 in drawer 97, 146 in drawer 98, 146 in drawer 99, 148 in drawer 100, 148 in drawer 101, 148 in drawer 102, 148 in drawer 103, 146 in drawer 104, 146 in drawer 105, 146 in drawer 106, 148 in drawer 107, 148 in drawer 108, 146 in drawer 109, 146 in drawer 110, 146 in drawer 111, 146 in drawer 112, 146 in drawer 113, 148 in drawer 114, 148 in drawer 115, 148 in drawer 116, 148 in drawer 117, 146 in drawer 118, 148 in drawer 119, 148 in drawer 120, 148 in drawer 121, 148 in drawer 122, 148 in drawer 123, 146 in drawer 124, 149 in drawer 125, 147 in drawer 126, 147 in drawer 127, 147 in drawer 128, 147 in drawer 129, 149 in drawer 130, 149 in drawer 131, 147 in drawer 132, 149 in drawer 133, 149 in drawer 134, 147 in drawer 135, 147 in drawer 136, 147 in drawer 137, 150 in drawer 138, 148 in drawer 139, 150 in drawer 140, 150 in drawer 141, 150 in drawer 142, 148 in drawer 143, 148 in drawer 144, 150 in drawer 145, 148 in drawer 146, 150 in drawer 147, 150 in drawer 148, 150 in drawer 149, 148 in drawer 150, 148 in drawer 151, 150 in drawer 152, 148 in drawer 153, 148 in drawer 154, 148 in drawer 155, 148 in drawer 156, 148 in drawer 157, 148 in drawer 158, 150 in drawer 159, 148 in drawer 160, 148 in drawer 161, 148 in drawer 162, 150 in drawer 163, 150 in drawer 164, 150 in drawer 165, 148 in drawer 166, 150 in drawer 167, 148 in drawer 168, 150 in drawer 169, 148 in drawer 170, 148 in drawer 171, 150 in drawer 172, 148 in drawer 173, 150 in drawer 174, 148 in drawer 175, 148 in drawer 176, 148 in drawer 177, 148 in drawer 178, 150 in drawer 179, 151 in drawer 180, 149 in drawer 181, 149 in drawer 182, 151 in drawer 183, 149 in drawer 184, 149 in drawer 185, 149 in drawer 186, 151 in drawer 187, 149 in drawer 188, 149 in drawer 189, 149 in drawer 190, 149 in drawer 191, 149 in drawer 192, 149 in drawer 193, 150 in drawer 194, 152 in drawer 195, 150 in drawer 196, 152 in drawer 197, 152 in drawer 198, 152 in drawer 199, 152 in drawer 200, 150 in drawer 201, 152 in drawer 202, 150 in drawer 203, 152 in drawer 204, 150 in drawer 205, 152 in drawer 206, 152 in drawer 207, 152 in drawer 208, 152 in drawer 209, 150 in drawer 210, 152 in drawer 211, 152 in drawer 212, 152 in drawer 213, 150 in drawer 214, 152 in drawer 215, 150 in drawer 216, 150 in drawer 217, 152 in drawer 218, 150 in drawer 219, 150 in drawer 220, 150 in drawer 221, 152 in drawer 222, 150 in drawer 223, 150 in drawer 224, 152 in drawer 225, 150 in drawer 226, 150 in drawer 227, 152 in drawer 228, 152 in drawer 229, 150 in drawer 230, 150 in drawer 231, 150 in drawer 232, 150 in drawer 233, 152 in drawer 234, 150 in drawer 235, 153 in drawer 236, 153 in drawer 237, 153 in drawer 238, 151 in drawer 239, 151 in drawer 240, 151 in drawer 241, 151 in drawer 242, 151 in drawer 243, 151 in drawer 244, 151 in drawer 245, 151 in drawer 246, 151 in drawer 247, 151 in drawer 248, 152 in drawer 249, 154 in drawer 250, 154 in drawer 251, 152 in drawer 252, 152 in drawer 253, 152 in drawer 254, 152 in drawer 255, 152 in drawer 256, 152 in drawer 257, 154 in drawer 258, 152 in drawer 259, 152 in drawer 260, 152 in drawer 261, 152 in drawer 262, 152 in drawer 263, 154 in drawer 264 11:50:46 - Finished task "Configure modules" 12:48:01 - Updating FEB temperature widget... 12:49:35 - Starting task "Switch HVPA voltage state" 12:49:35 - Setting HVPA current limit to 12489.75 uA 12:49:35 - Setting Hvpa.Hvpa0.CurrentTrip in all drawers 12:49:45 - Setting Hvpa.Hvpa1.CurrentTrip in all drawers 12:49:55 - Setting Hvpa.Hvpa2.CurrentTrip in all drawers 12:50:05 - Setting Hvpa.Hvpa3.CurrentTrip in all drawers 12:50:15 - Setting Hvpa.Hvpa4.CurrentTrip in all drawers 12:50:24 - Setting Hvpa.Hvpa5.CurrentTrip in all drawers 12:50:34 - Setting Hvpa.Hvpa6.CurrentTrip in all drawers 12:50:44 - Setting HVPA ramp speed to 25 V/s 12:50:56 - Switching HVPA to state Nominal 12:51:14 - Setting HVPA current limits... 12:52:35 - Finished task "Switch HVPA voltage state" 12:53:12 - Updating voltage widget... 12:53:42 - High voltage locked channels will be checked every 60 s 12:53:46 - Checking status of calibration box... 12:53:47 - Calibration box is configured with 1 leds at a frequency of 5000.0 Hz and a voltage of 10.00 V 12:53:53 - Stopping flashes... 12:53:55 - Checking status of calibration box... 12:53:56 - Calibration box is configured with 1 leds at a frequency of 5000.0 Hz and a voltage of 10.00 V 12:54:01 - Checking status of calibration box... 12:54:04 - Could not invoke the MethodCall service: BadTimeout 12:54:22 - Starting NMC 12:54:22 - Clearing PPS error counters 12:54:36 - Resetting FEB counters... 12:54:39 - Starting all configured modules... 12:54:44 - Checking for high voltage locked pixels... 12:54:59 - HVPA channel 2 of drawer 231 has status 0x0007! 12:54:59 - HVPA channel 2 in module 231 is in rise default! 12:55:11 - HVPA channel 6 of drawer 91 has status 0x8003! 12:55:11 - HVPA channel 6 in module 91 is locked! 12:55:11 - HV is locked in 1 channel(s), was in rise default in 1 channel(s) and was still in progress in 0 channel(s) 12:55:11 - Unlocking 2 channel(s)... 12:55:42 - Checking for high voltage locked pixels... 12:55:56 - HVPA channel 2 of drawer 231 has status 0x0007! 12:55:56 - HVPA channel 2 in module 231 is in rise default! 12:56:09 - HV is locked in 0 channel(s), was in rise default in 1 channel(s) and was still in progress in 2 channel(s) 12:56:09 - Unlocking 1 channel(s)... 12:56:24 - Checking UCTS clock... 12:56:24 - UCTS clock is late by 696944 seconds! 12:56:24 - Configuring UCTS with (10.200.7.250, 10.200.4.100, 44:a8:42:44:32:c9) 12:56:25 - Configuring TIB... 12:56:25 - Setting TIB forced mode to False 12:56:25 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v 12:56:25 - Status: TibState.RunStopped 12:56:25 - Alarms: AlarmVector.BufferFull 12:56:25 - Connection status: False TXclient_alive: False 12:56:25 - Disabling PPS 12:56:27 - Status: TibState.PpsStopped 12:56:27 - Alarms: AlarmVector.BufferFull 12:56:27 - Connection status: False TXclient_alive: False 12:56:27 - Entering set_external_delay 12:56:27 - Setting ExternalDelayLocal to 27.000 ns 12:56:27 - Writing 27.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v 12:56:27 - Entering set_external_delay 12:56:27 - Setting ExternalDelayCalibration to 58.000 ns 12:56:27 - Writing 58.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v 12:56:27 - Entering set_external_delay 12:56:27 - Setting ExternalDelaySphe to 110.000 ns 12:56:27 - Writing 110.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v 12:56:27 - Setting TIB trigger mode to 0x68 = TriggerMask.SlowControl|Pedestal|SPhE 12:56:27 - Writing 104 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v 12:56:27 - Writing 1 to Camera.TIB.InputsEnable.InputMask.InputMask_v 12:56:27 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v 12:56:27 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v 12:56:27 - Writing True to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v 12:56:28 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v 12:56:28 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v 12:56:28 - Status: TibState.PpsStopped 12:56:28 - Alarms: AlarmVector.BufferFull 12:56:28 - Connection status: False TXclient_alive: False 12:56:28 - Writing True to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v 12:56:28 - Writing 100 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v 12:56:28 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 12:56:28 - Writing False to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v 12:56:28 - Writing 100 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v 12:56:28 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v 12:56:28 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 12:56:28 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v 12:56:28 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v 12:56:28 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 12:56:33 - Stopped periodic check of locked high voltages 12:56:35 - Connecting TIB to camera server at 10.10.4.12:222 12:56:35 - Starting TIB... 12:56:35 - Status: TibState.PpsStopped 12:56:36 - Alarms: AlarmVector.BufferFull 12:56:36 - Connection status: False TXclient_alive: False 12:56:36 - Resetting run 12:56:36 - Wait for UCTS external trigger before enabling trigger... 12:56:36 - Status: TibState.Standby 12:56:36 - Alarms: AlarmVector.NoAlarm 12:56:36 - Connection status: False TXclient_alive: True 12:56:36 - Status: TibState.Standby 12:56:36 - Alarms: AlarmVector.NoAlarm 12:56:36 - Connection status: False TXclient_alive: True 12:56:37 - Status: TibState.Armed 12:56:37 - Alarms: AlarmVector.NoAlarm 12:56:37 - Connection status: False TXclient_alive: True 12:56:38 - Starting TIB triggers... 12:56:38 - Enabling trigger 12:56:38 - Status: TibState.Running 12:56:38 - Alarms: AlarmVector.NoAlarm 12:56:38 - Connection status: False TXclient_alive: True 12:56:40 - Status: TibState.Running ConnectionStatus: False TXclient_alive: True 12:56:40 - Alarms: AlarmVector.NoAlarm 12:56:40 - Temperature: 41.56 12:56:40 - Local camera rate: 0.0 Hz 12:56:40 - Stereo trigger rate: 0.0 Hz 12:56:40 - SPE trigger rate: 0.0 Hz 12:56:40 - Calibration trigger rate: 8641.0 Hz 12:56:40 - Software trigger rate: 0.0 Hz 12:56:40 - Pedestal trigger rate: 100.0 Hz 12:56:40 - Collected trigger rate: 59.0 Hz 12:56:40 - Busy rate: 0.0 Hz 12:56:40 - Camera trigger rate: 59.0 Hz 12:56:41 - Status: TibState.Running ConnectionStatus: False TXclient_alive: True 12:56:41 - Alarms: AlarmVector.NoAlarm 12:56:41 - Temperature: 41.56 12:56:41 - Local camera rate: 0.0 Hz 12:56:41 - Stereo trigger rate: 0.0 Hz 12:56:41 - SPE trigger rate: 0.0 Hz 12:56:41 - Calibration trigger rate: 8641.0 Hz 12:56:41 - Software trigger rate: 0.0 Hz 12:56:41 - Pedestal trigger rate: 100.0 Hz 12:56:41 - Collected trigger rate: 59.0 Hz 12:56:41 - Busy rate: 0.0 Hz 12:56:41 - Camera trigger rate: 59.0 Hz 12:56:42 - Status: TibState.Running ConnectionStatus: False TXclient_alive: True 12:56:42 - Alarms: AlarmVector.NoAlarm 12:56:42 - Temperature: 41.62 12:56:42 - Local camera rate: 0.0 Hz 12:56:42 - Stereo trigger rate: 0.0 Hz 12:56:42 - SPE trigger rate: 0.0 Hz 12:56:42 - Calibration trigger rate: 8641.0 Hz 12:56:42 - Software trigger rate: 0.0 Hz 12:56:42 - Pedestal trigger rate: 100.0 Hz 12:56:42 - Collected trigger rate: 59.0 Hz 12:56:42 - Busy rate: 0.0 Hz 12:56:42 - Camera trigger rate: 59.0 Hz 12:56:44 - Status: TibState.Running ConnectionStatus: False TXclient_alive: True 12:56:44 - Alarms: AlarmVector.NoAlarm 12:56:44 - Temperature: 41.62 12:56:44 - Local camera rate: 0.0 Hz 12:56:44 - Stereo trigger rate: 0.0 Hz 12:56:44 - SPE trigger rate: 0.0 Hz 12:56:44 - Calibration trigger rate: 8641.0 Hz 12:56:44 - Software trigger rate: 0.0 Hz 12:56:44 - Pedestal trigger rate: 100.0 Hz 12:56:44 - Collected trigger rate: 59.0 Hz 12:56:44 - Busy rate: 0.0 Hz 12:56:44 - Camera trigger rate: 59.0 Hz 12:56:45 - Status: TibState.Running ConnectionStatus: False TXclient_alive: True 12:56:45 - Alarms: AlarmVector.NoAlarm 12:56:45 - Temperature: 41.62 12:56:45 - Local camera rate: 0.0 Hz 12:56:45 - Stereo trigger rate: 0.0 Hz 12:56:45 - SPE trigger rate: 5.0 Hz 12:56:45 - Calibration trigger rate: 8782.0 Hz 12:56:45 - Software trigger rate: 0.0 Hz 12:56:45 - Pedestal trigger rate: 100.0 Hz 12:56:45 - Collected trigger rate: 103.0 Hz 12:56:45 - Busy rate: 0.0 Hz 12:56:45 - Camera trigger rate: 103.0 Hz 12:56:52 - Stopping TIB... 12:56:52 - Status: TibState.Running 12:56:52 - Alarms: AlarmVector.NoAlarm 12:56:52 - Connection status: False TXclient_alive: True 12:56:52 - Disabling trigger 12:56:52 - Disabling PPS 12:56:53 - Status: TibState.PpsStopped 12:56:53 - Alarms: AlarmVector.NoAlarm 12:56:53 - Connection status: False TXclient_alive: True 12:56:54 - Closing TIB connection to camera server 12:57:09 - Stopping NMC 12:57:14 - Found 0 PPS errors. 12:58:00 - Starting NMC 12:58:00 - Clearing PPS error counters 12:58:13 - Resetting FEB counters... 12:58:17 - Starting all configured modules... 13:00:10 - Checking status of calibration box... 13:00:11 - Failed to call GetStatus: Bad statuses are present 13:00:14 - Reconnecting to calibration box... 13:00:14 - Reconnecting to calibration box 13:00:17 - Could not invoke the MethodCall service: BadTimeout 13:00:19 - Checking status of calibration box... 13:00:20 - Calibration box is configured with 0 leds at a frequency of 16000000.0 Hz and a voltage of 7.90 V 13:01:07 - Configuring calibration box... 13:01:07 - Configuring calibration box with leds=0x1fbf voltage=16.50 frequency=1000.0/1 central_current=0.0 duration=0 width=1 lemo_out=True fiber1_out=True fiber2_out=True lemo_in=False enabled=False 13:02:26 - Checking status of calibration box... 13:02:27 - Calibration box is configured with 12 leds at a frequency of 1000.0 Hz and a voltage of 16.50 V 13:03:08 - Starting flashes... 13:03:18 - Calling method FSM.gotoObserving in object FSM 13:03:18 - No server with URI='urn:UnifiedAutomation:UaServerCpp' has been discovered. The client could not discover a single server. 13:03:52 - Calling method FSM.gotoReady in object FSM 13:04:59 - Calling method FSM.gotoObserving in object FSM 13:04:59 - Starting run -1 13:05:27 - Checking UCTS clock... 13:05:27 - UCTS clock is late by 696944 seconds! 13:05:27 - Configuring UCTS with (10.200.7.250, 10.200.4.100, 44:a8:42:44:32:c9) 13:05:28 - Configuring TIB... 13:05:28 - Setting TIB forced mode to False 13:05:28 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v 13:05:28 - Status: TibState.PpsStopped 13:05:28 - Alarms: AlarmVector.NoAlarm 13:05:28 - Connection status: False TXclient_alive: False 13:05:28 - Entering set_external_delay 13:05:28 - Setting ExternalDelayLocal to 27.000 ns 13:05:28 - Writing 27.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v 13:05:28 - Entering set_external_delay 13:05:28 - Setting ExternalDelayCalibration to 58.000 ns 13:05:28 - Writing 58.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v 13:05:28 - Entering set_external_delay 13:05:28 - Setting ExternalDelaySphe to 110.000 ns 13:05:28 - Writing 110.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v 13:05:28 - Setting TIB trigger mode to 0x48 = TriggerMask.SlowControl|SPhE 13:05:28 - Writing 72 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v 13:05:28 - Writing 1 to Camera.TIB.InputsEnable.InputMask.InputMask_v 13:05:28 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v 13:05:28 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v 13:05:28 - Writing True to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v 13:05:28 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v 13:05:28 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v 13:05:28 - Status: TibState.PpsStopped 13:05:28 - Alarms: AlarmVector.NoAlarm 13:05:28 - Connection status: False TXclient_alive: False 13:05:28 - Writing False to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v 13:05:28 - Writing 100 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v 13:05:28 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 13:05:28 - Writing False to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v 13:05:29 - Writing 100 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v 13:05:29 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v 13:05:29 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 13:05:29 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v 13:05:29 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v 13:05:29 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 13:05:33 - Connecting TIB to camera server at 10.10.4.12:222 13:05:33 - Starting TIB... 13:05:33 - Status: TibState.PpsStopped 13:05:33 - Alarms: AlarmVector.NoAlarm 13:05:33 - Connection status: False TXclient_alive: True 13:05:33 - Resetting run 13:05:33 - Wait for UCTS external trigger before enabling trigger... 13:05:33 - Status: TibState.Standby 13:05:33 - Alarms: AlarmVector.NoAlarm 13:05:33 - Connection status: False TXclient_alive: True 13:05:33 - Status: TibState.Standby 13:05:33 - Alarms: AlarmVector.NoAlarm 13:05:33 - Connection status: False TXclient_alive: True 13:05:34 - Status: TibState.Armed 13:05:34 - Alarms: AlarmVector.NoAlarm 13:05:34 - Connection status: True TXclient_alive: True 13:05:37 - Starting TIB triggers... 13:05:37 - Enabling trigger 13:05:37 - Status: TibState.Running 13:05:37 - Alarms: AlarmVector.ReadError 13:05:37 - Connection status: True TXclient_alive: True 13:05:43 - Status: TibState.Running ConnectionStatus: True TXclient_alive: True 13:05:43 - Alarms: AlarmVector.ReadError 13:05:43 - Temperature: 41.88 13:05:43 - Local camera rate: 0.0 Hz 13:05:43 - Stereo trigger rate: 0.0 Hz 13:05:43 - SPE trigger rate: 1000.0 Hz 13:05:43 - Calibration trigger rate: 8617.0 Hz 13:05:43 - Software trigger rate: 0.0 Hz 13:05:43 - Pedestal trigger rate: 0.0 Hz 13:05:44 - Collected trigger rate: 1000.0 Hz 13:05:44 - Busy rate: 0.0 Hz 13:05:44 - Camera trigger rate: 1000.0 Hz 13:06:28 - Stopping TIB... 13:06:28 - Status: TibState.Running 13:06:28 - Alarms: AlarmVector.ReadError 13:06:28 - Connection status: True TXclient_alive: True 13:06:28 - Disabling trigger 13:06:28 - Disabling PPS 13:06:29 - Status: TibState.PpsStopped 13:06:29 - Alarms: AlarmVector.ReadError 13:06:29 - Connection status: True TXclient_alive: True 13:06:30 - Closing TIB connection to camera server 13:06:32 - Status: TibState.PpsStopped 13:06:32 - Alarms: AlarmVector.ReadError 13:06:32 - Connection status: False TXclient_alive: False 13:06:32 - Run duration: 0:00:54 13:06:32 - Local camera triggers: 0 13:06:32 - Slow control triggers: 0 13:06:32 - Single photo-electron triggers: 53551 13:06:32 - Calibration triggers: 466256 13:06:32 - Software triggers from UCTS: 0 13:06:32 - Pedestal triggers: 0 13:06:32 - Collected input triggers: 51188 13:06:32 - Busy triggers: 0 13:06:32 - Camera event triggers sent to clusters: 51188 13:06:37 - Calling method FSM.gotoReady in object FSM 13:06:40 - Event builder is in state CameraServerState.Observing and has output 51188 event(s) during run #2582. 13:06:40 - Event builder is in transition to state CameraServerState.Ready 13:07:11 - Stopping NMC 13:07:16 - Found 0 PPS errors. 13:07:34 - Updating voltage widget... 13:08:00 - High voltage locked channels will be checked every 60 s 13:08:18 - NMC is in state NmcState.Configured and knows of 265 drawer(s) 13:08:33 - All front-end boards have counted 51188 event(s) 13:08:38 - Found 0 PPS errors. 13:09:00 - Checking for high voltage locked pixels... 13:09:02 - Module 91 has 1 pixel(s) locked (HVPA status of 0x3f)! 13:09:14 - HVPA channel 2 of drawer 231 has status 0x0007! 13:09:14 - HVPA channel 2 in module 231 is in rise default! 13:09:27 - HVPA channel 6 of drawer 91 has status 0x8003! 13:09:27 - HVPA channel 6 in module 91 is locked! 13:09:27 - HV is locked in 1 channel(s), was in rise default in 1 channel(s) and was still in progress in 0 channel(s) 13:09:27 - Unlocking 2 channel(s)... 13:10:00 - Checking for high voltage locked pixels... 13:10:14 - HVPA channel 2 of drawer 231 has status 0x0007! 13:10:14 - HVPA channel 2 in module 231 is in rise default! 13:10:26 - HV is locked in 0 channel(s), was in rise default in 1 channel(s) and was still in progress in 0 channel(s) 13:10:26 - Unlocking 1 channel(s)... 13:10:58 - Stopped periodic check of locked high voltages