10:10:58 - ECC is in state EccState.Safe and transition EccTransition.Idle 10:10:58 - Active alarms: ['Alarm_General_current'] 10:10:58 - PDB temperature: 3.7 deg C 10:10:58 - Status of UPS power: 23.1 V, 0.8 A, P=0.1 W, Q=4013.0 VAR, S=0.2 VA, PF=3734.00 10:10:58 - Status of 400 V: V1=2336.0 V, V2=211.0 V, V3=111.0 V, I1=210.0 A, I2=116.0 A, I3=55.8 A, f=12.100000381469727 Hz 10:10:58 - Status of 400 V: P1=17.6 W, P2=22.6 W, P3=1717.0 W, Q1=14.2 VAR, Q2=2526.0 VAR, Q3=9.3 VAR, S1=1.8 VA, S2=4.9 VA, S3=5436.0 VA 10:10:58 - 0 relays enabled in PSB1. Total current of 0.0 A. 10:10:58 - 0 relays enabled in PSB2. Total current of -0.2 A. 10:10:58 - Status of PDB switches: StateBreaker=True, StateEmergencyStop=False, SwitchStatus_General400V=True, SwitchStatus_General230V=False, SwitchStatus_line400V=True, SwitchStatus_switch1=False, SwitchStatus_switch2=False, SwitchStatus_fanFront=True, SwitchStatus_fanRear=True, SwitchStatus_shutter=False 10:10:58 - Average air temperature: 25.5 deg C 10:10:58 - Air temperature (T1-T13): 25.5, 25.3, 26.3, 24.6, 23.2, 24.7, 22.8, 24.4, 25.2, 26.5, 23.6, 22.0, 21.3 deg C 10:10:58 - Air differential pressure: 0.2 Pa 10:10:58 - Back doors are closed. 10:10:58 - Light sensors: [0.0, 0.0] V 10:10:58 - Cooling valve is 100 %% open.Water flow: 29.5 l/min.Water pressure: [1.0, 1.5] bar 10:10:58 - Water temperature (T14-T16): 18.0, 15.8, 15.7 deg C 10:10:58 - Humidity: 49.7 %. 10:10:58 - Fan speeds: [900.0, 900.0, 840.0, 900.0, 900.0, 840.0] rpm 10:11:00 - Starting task "Prepare ECC" 10:11:00 - Preparing ECC... 10:11:00 - Setting ECC temperature range for Ready state to [16.000000, 36.000000] 10:11:00 - Setting ECC mode to EccTransition.Ready 10:11:01 - Received ECC state change notification: EccState.Safe 10:11:18 - Received ECC state change notification: EccState.Ready 10:11:19 - Setting power supply box SPE relay to False 10:11:20 - Setting power supply box MCB relay to False 10:11:20 - Failed to call SetPSB_relays: Bad statuses are present 10:11:20 - Finished task "Prepare ECC" 10:12:14 - Updating DTC module currents... 10:12:16 - Module 89 connected to channel 10 of slot 14 has a CTDB current of 30.1 mA 10:12:16 - Module 90 connected to channel 11 of slot 14 has a CTDB current of 2.7 mA 10:12:16 - Module 91 connected to channel 12 of slot 14 has a CTDB current of 7.8 mA 10:12:16 - Module 92 connected to channel 13 of slot 14 has a CTDB current of 7.3 mA 10:12:16 - Module 95 connected to channel 1 of slot 15 has a CTDB current of 26.9 mA 10:12:16 - Module 96 connected to channel 2 of slot 15 has a CTDB current of 1.9 mA 10:12:16 - Module 115 connected to channel 1 of slot 14 has a CTDB current of 35.9 mA 10:12:16 - Module 116 connected to channel 2 of slot 14 has a CTDB current of 19.6 mA 10:12:16 - Module 117 connected to channel 3 of slot 14 has a CTDB current of 2.4 mA 10:12:16 - Module 118 connected to channel 4 of slot 14 has a CTDB current of 16.5 mA 10:12:16 - Module 119 connected to channel 5 of slot 14 has a CTDB current of 3.9 mA 10:12:16 - Module 120 connected to channel 6 of slot 14 has a CTDB current of 34.4 mA 10:12:16 - Module 121 connected to channel 7 of slot 14 has a CTDB current of 7.3 mA 10:12:16 - Module 122 connected to channel 8 of slot 14 has a CTDB current of 1.0 mA 10:12:16 - Module 123 connected to channel 9 of slot 14 has a CTDB current of 1.5 mA 10:12:16 - Module 127 connected to channel 8 of slot 9 has a CTDB current of 15.0 mA 10:12:16 - Module 134 connected to channel 15 of slot 9 has a CTDB current of 1.5 mA 10:12:27 - Starting task "Powering modules..." 10:12:27 - Disabling power in CTDB slot 14 10:12:27 - Finished task "Powering modules..." 10:12:29 - Starting task "Powering modules..." 10:12:29 - Enabling power in CTDB slot 14 10:12:29 - Finished task "Powering modules..." 10:12:31 - Updating DTC module currents... 10:12:33 - Module 95 connected to channel 1 of slot 15 has a CTDB current of 27.2 mA 10:12:33 - Module 96 connected to channel 2 of slot 15 has a CTDB current of 1.9 mA 10:12:33 - Module 127 connected to channel 8 of slot 9 has a CTDB current of 15.5 mA 10:12:33 - Module 134 connected to channel 15 of slot 9 has a CTDB current of 1.5 mA 10:12:37 - Updating DTC module currents... 10:12:39 - Module 95 connected to channel 1 of slot 15 has a CTDB current of 26.9 mA 10:12:39 - Module 96 connected to channel 2 of slot 15 has a CTDB current of 1.9 mA 10:12:39 - Module 127 connected to channel 8 of slot 9 has a CTDB current of 14.1 mA 10:12:39 - Module 134 connected to channel 15 of slot 9 has a CTDB current of 1.5 mA 10:12:47 - Module 95 is connected to channel 1 of DTC slot 15 10:12:49 - Starting task "Powering modules..." 10:12:49 - Disabling power in channel 1 of CTDB slot 15 10:12:49 - Finished task "Powering modules..." 10:12:50 - Starting task "Powering modules..." 10:12:50 - Enabling power in channel 1 of CTDB slot 15 10:12:50 - Finished task "Powering modules..." 10:12:52 - Module 96 is connected to channel 2 of DTC slot 15 10:12:55 - Starting task "Powering modules..." 10:12:55 - Disabling power in channel 2 of CTDB slot 15 10:12:55 - Finished task "Powering modules..." 10:12:56 - Starting task "Powering modules..." 10:12:56 - Enabling power in channel 2 of CTDB slot 15 10:12:57 - Finished task "Powering modules..." 10:13:03 - Module 127 is connected to channel 8 of DTC slot 9 10:13:05 - Starting task "Powering modules..." 10:13:05 - Disabling power in channel 8 of CTDB slot 9 10:13:05 - Finished task "Powering modules..." 10:13:06 - Starting task "Powering modules..." 10:13:06 - Enabling power in channel 8 of CTDB slot 9 10:13:06 - Finished task "Powering modules..." 10:13:08 - Module 134 is connected to channel 15 of DTC slot 9 10:13:12 - Starting task "Powering modules..." 10:13:12 - Disabling power in channel 15 of CTDB slot 9 10:13:12 - Finished task "Powering modules..." 10:13:14 - Starting task "Powering modules..." 10:13:14 - Enabling power in channel 15 of CTDB slot 9 10:13:14 - Finished task "Powering modules..." 10:13:15 - Updating DTC module currents... 10:16:44 - Starting task "Configure modules" 10:16:44 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/utils/branches/v5.6.0-41551 10:16:44 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/libNectarCam/branches/v5.6.0-41551 10:16:44 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/libQNectarCam/branches/v5.6.0-41551 10:16:44 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/qNectarcamModuleController/branches/v5.6.0-41551 10:16:44 - Configuring modules with configuration /data/config/2021/20210906/config_cameraqm_265febs_newnewDACL_newHV2.NMC.xml 10:16:44 - Switching off high voltages in configuration 10:16:53 - Successfully configured 265 module(s) 10:16:53 - Waiting for modules to be configured... 10:16:59 - All front-end boards are programmed with firmware F56D2002 10:17:07 - Found 2 different versions of DTBP firmware: [15 17] 10:17:47 - NMC is in state NmcState.Ready and knows of 265 drawer(s) 10:18:01 - All front-end boards have counted 0 event(s) 10:18:06 - Found PPS errors: 145 in drawer 0, 143 in drawer 1, 144 in drawer 2, 144 in drawer 3, 146 in drawer 4, 144 in drawer 5, 144 in drawer 8, 146 in drawer 9, 146 in drawer 10, 144 in drawer 11, 146 in drawer 12, 144 in drawer 13, 146 in drawer 14, 146 in drawer 15, 146 in drawer 16, 146 in drawer 17, 146 in drawer 18, 146 in drawer 19, 146 in drawer 20, 146 in drawer 21, 144 in drawer 22, 146 in drawer 23, 144 in drawer 24, 144 in drawer 25, 146 in drawer 26, 146 in drawer 27, 146 in drawer 28, 144 in drawer 29, 146 in drawer 30, 144 in drawer 31, 146 in drawer 32, 146 in drawer 33, 146 in drawer 34, 146 in drawer 35, 146 in drawer 36, 146 in drawer 37, 144 in drawer 38, 146 in drawer 39, 146 in drawer 40, 146 in drawer 41, 144 in drawer 42, 144 in drawer 43, 147 in drawer 44, 145 in drawer 45, 145 in drawer 46, 145 in drawer 47, 147 in drawer 48, 145 in drawer 49, 147 in drawer 50, 145 in drawer 51, 147 in drawer 52, 145 in drawer 53, 147 in drawer 54, 145 in drawer 55, 145 in drawer 56, 147 in drawer 57, 148 in drawer 58, 148 in drawer 59, 146 in drawer 60, 146 in drawer 61, 146 in drawer 62, 146 in drawer 63, 148 in drawer 64, 148 in drawer 65, 148 in drawer 66, 148 in drawer 67, 148 in drawer 68, 146 in drawer 69, 148 in drawer 70, 148 in drawer 71, 148 in drawer 72, 146 in drawer 73, 146 in drawer 74, 146 in drawer 75, 148 in drawer 76, 148 in drawer 77, 148 in drawer 78, 146 in drawer 79, 148 in drawer 80, 146 in drawer 81, 148 in drawer 82, 148 in drawer 83, 148 in drawer 84, 146 in drawer 85, 146 in drawer 86, 148 in drawer 87, 148 in drawer 88, 146 in drawer 89, 148 in drawer 90, 146 in drawer 91, 146 in drawer 92, 146 in drawer 93, 148 in drawer 94, 148 in drawer 95, 148 in drawer 96, 146 in drawer 97, 146 in drawer 98, 149 in drawer 99, 149 in drawer 100, 147 in drawer 101, 149 in drawer 102, 149 in drawer 103, 147 in drawer 104, 147 in drawer 105, 147 in drawer 106, 149 in drawer 107, 149 in drawer 108, 149 in drawer 109, 149 in drawer 110, 149 in drawer 111, 147 in drawer 112, 150 in drawer 113, 150 in drawer 114, 150 in drawer 115, 150 in drawer 116, 148 in drawer 117, 150 in drawer 118, 148 in drawer 119, 150 in drawer 120, 150 in drawer 121, 148 in drawer 122, 150 in drawer 123, 148 in drawer 124, 150 in drawer 125, 150 in drawer 126, 148 in drawer 127, 150 in drawer 128, 150 in drawer 129, 148 in drawer 130, 150 in drawer 131, 148 in drawer 132, 150 in drawer 133, 150 in drawer 134, 150 in drawer 135, 148 in drawer 136, 148 in drawer 137, 148 in drawer 138, 148 in drawer 139, 148 in drawer 140, 148 in drawer 141, 148 in drawer 142, 150 in drawer 143, 150 in drawer 144, 148 in drawer 145, 148 in drawer 146, 148 in drawer 147, 148 in drawer 148, 148 in drawer 149, 150 in drawer 150, 148 in drawer 151, 150 in drawer 152, 150 in drawer 153, 149 in drawer 154, 149 in drawer 155, 149 in drawer 156, 151 in drawer 157, 149 in drawer 158, 151 in drawer 159, 151 in drawer 160, 149 in drawer 161, 151 in drawer 162, 149 in drawer 163, 151 in drawer 164, 151 in drawer 165, 151 in drawer 166, 149 in drawer 167, 152 in drawer 168, 150 in drawer 169, 152 in drawer 170, 150 in drawer 171, 150 in drawer 172, 150 in drawer 173, 152 in drawer 174, 150 in drawer 175, 150 in drawer 176, 150 in drawer 177, 150 in drawer 178, 152 in drawer 179, 150 in drawer 180, 150 in drawer 181, 152 in drawer 182, 150 in drawer 183, 150 in drawer 184, 152 in drawer 185, 150 in drawer 186, 150 in drawer 187, 150 in drawer 188, 150 in drawer 189, 152 in drawer 190, 152 in drawer 191, 150 in drawer 192, 150 in drawer 193, 150 in drawer 194, 150 in drawer 195, 152 in drawer 196, 152 in drawer 197, 150 in drawer 198, 150 in drawer 199, 152 in drawer 200, 150 in drawer 201, 152 in drawer 202, 150 in drawer 203, 150 in drawer 204, 152 in drawer 205, 150 in drawer 206, 152 in drawer 207, 152 in drawer 208, 150 in drawer 209, 153 in drawer 210, 153 in drawer 211, 153 in drawer 212, 151 in drawer 213, 151 in drawer 214, 153 in drawer 215, 151 in drawer 216, 153 in drawer 217, 153 in drawer 218, 151 in drawer 219, 153 in drawer 220, 151 in drawer 221, 151 in drawer 222, 152 in drawer 223, 152 in drawer 224, 152 in drawer 225, 154 in drawer 226, 152 in drawer 227, 152 in drawer 228, 152 in drawer 229, 152 in drawer 230, 152 in drawer 231, 152 in drawer 232, 154 in drawer 233, 152 in drawer 234, 152 in drawer 235, 154 in drawer 236, 154 in drawer 237, 152 in drawer 238, 154 in drawer 239, 154 in drawer 240, 152 in drawer 241, 152 in drawer 242, 152 in drawer 243, 152 in drawer 244, 152 in drawer 245, 152 in drawer 246, 152 in drawer 247, 152 in drawer 248, 152 in drawer 249, 152 in drawer 250, 154 in drawer 251, 152 in drawer 252, 152 in drawer 253, 152 in drawer 254, 152 in drawer 255, 152 in drawer 256, 152 in drawer 257, 152 in drawer 258, 152 in drawer 259, 152 in drawer 260, 152 in drawer 261, 154 in drawer 262, 152 in drawer 263, 153 in drawer 264 10:18:06 - Finished task "Configure modules" 10:18:13 - Updating FEB temperature widget... 10:18:25 - Starting NMC 10:18:25 - Clearing PPS error counters 10:18:39 - Resetting FEB counters... 10:18:42 - Starting all configured modules... 10:19:44 - Checking UCTS clock... 10:19:45 - UCTS and control PC clocks differ by 3.0 seconds 10:19:45 - Configuring UCTS with (10.200.7.250, 10.200.4.100, 44:a8:42:44:32:c9) 10:19:45 - Configuring TIB... 10:19:45 - Setting TIB forced mode to False 10:19:45 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v 10:19:45 - Status: TibState.RunStopped 10:19:45 - Alarms: AlarmVector.BufferFull 10:19:45 - Connection status: False TXclient_alive: False 10:19:45 - Disabling PPS 10:19:47 - Status: TibState.PpsStopped 10:19:47 - Alarms: AlarmVector.BufferFull 10:19:47 - Connection status: False TXclient_alive: False 10:19:47 - Entering set_external_delay 10:19:47 - Setting ExternalDelayLocal to 27.000 ns 10:19:47 - Writing 27.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v 10:19:47 - Entering set_external_delay 10:19:47 - Setting ExternalDelayCalibration to 58.000 ns 10:19:47 - Writing 58.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v 10:19:47 - Entering set_external_delay 10:19:47 - Setting ExternalDelaySphe to 150.000 ns 10:19:47 - Writing 150.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v 10:19:47 - Setting TIB trigger mode to 0x70 = TriggerMask.SlowControl|Pedestal|Software 10:19:47 - Writing 112 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v 10:19:47 - Writing 1 to Camera.TIB.InputsEnable.InputMask.InputMask_v 10:19:47 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v 10:19:47 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v 10:19:47 - Writing True to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v 10:19:47 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v 10:19:47 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v 10:19:47 - Status: TibState.PpsStopped 10:19:47 - Alarms: AlarmVector.BufferFull 10:19:47 - Connection status: False TXclient_alive: False 10:19:47 - Writing True to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v 10:19:47 - Writing 1000 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v 10:19:47 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 10:19:47 - Writing False to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v 10:19:47 - Writing 1000 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v 10:19:47 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v 10:19:47 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 10:19:48 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v 10:19:48 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v 10:19:48 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 10:19:49 - Connecting TIB to camera server at 10.10.4.12:222 10:19:49 - Starting TIB... 10:19:49 - Status: TibState.PpsStopped 10:19:49 - Alarms: AlarmVector.BufferFull 10:19:49 - Connection status: False TXclient_alive: False 10:19:49 - Resetting run 10:19:49 - Wait for UCTS external trigger before enabling trigger... 10:19:49 - Status: TibState.Standby 10:19:49 - Alarms: AlarmVector.NoAlarm 10:19:49 - Connection status: False TXclient_alive: False 10:19:49 - Status: TibState.Standby 10:19:49 - Alarms: AlarmVector.NoAlarm 10:19:49 - Connection status: False TXclient_alive: False 10:19:50 - Status: TibState.Armed 10:19:50 - Alarms: AlarmVector.NoAlarm 10:19:50 - Connection status: False TXclient_alive: True 10:19:51 - Starting TIB triggers... 10:19:51 - Enabling trigger 10:19:51 - Status: TibState.Running 10:19:51 - Alarms: AlarmVector.NoAlarm 10:19:51 - Connection status: False TXclient_alive: True 10:19:53 - Status: TibState.Running ConnectionStatus: False TXclient_alive: True 10:19:53 - Alarms: AlarmVector.NoAlarm 10:19:53 - Temperature: 35.50 10:19:53 - Local camera rate: 0.0 Hz 10:19:53 - Stereo trigger rate: 0.0 Hz 10:19:53 - SPE trigger rate: 0.0 Hz 10:19:53 - Calibration trigger rate: 0.0 Hz 10:19:53 - Software trigger rate: 0.0 Hz 10:19:53 - Pedestal trigger rate: 999.0 Hz 10:19:53 - Collected trigger rate: 999.0 Hz 10:19:53 - Busy rate: 0.0 Hz 10:19:53 - Camera trigger rate: 999.0 Hz 10:19:56 - Stopping TIB... 10:19:56 - Status: TibState.Running 10:19:56 - Alarms: AlarmVector.BufferFull|AlmostFull 10:19:56 - Connection status: False TXclient_alive: True 10:19:56 - Disabling trigger 10:19:57 - Disabling PPS 10:19:58 - Status: TibState.PpsStopped 10:19:58 - Alarms: AlarmVector.BufferFull|AlmostFull 10:19:58 - Connection status: False TXclient_alive: True 10:19:59 - Closing TIB connection to camera server 10:20:03 - Stopping NMC 10:20:08 - Found 0 PPS errors. 10:37:31 - Updating FEB temperature widget... 10:37:40 - Starting task "Switch HVPA voltage state" 10:37:41 - Setting HVPA current limit to 12489.75 uA 10:37:41 - Setting Hvpa.Hvpa0.CurrentTrip in all drawers 10:37:50 - Starting NMC 10:37:50 - Clearing PPS error counters 10:38:03 - Resetting FEB counters... 10:38:07 - Starting all configured modules... 10:37:50 - Setting Hvpa.Hvpa1.CurrentTrip in all drawers 10:39:06 - Calling method FSM.gotoObserving in object FSM 10:39:06 - Starting run 2575 10:40:12 - Starting task "Switch HVPA voltage state" 10:40:12 - Setting HVPA current limit to 12489.75 uA 10:40:12 - Setting Hvpa.Hvpa0.CurrentTrip in all drawers 10:40:22 - Setting Hvpa.Hvpa1.CurrentTrip in all drawers 10:40:32 - Setting Hvpa.Hvpa2.CurrentTrip in all drawers 10:40:41 - Setting Hvpa.Hvpa3.CurrentTrip in all drawers 10:40:51 - Setting Hvpa.Hvpa4.CurrentTrip in all drawers 10:41:01 - Setting Hvpa.Hvpa5.CurrentTrip in all drawers 10:41:11 - Setting Hvpa.Hvpa6.CurrentTrip in all drawers 10:41:21 - Setting HVPA ramp speed to 25 V/s 10:41:32 - Switching HVPA to state Nominal 10:41:51 - Setting HVPA current limits... 10:43:45 - Finished task "Switch HVPA voltage state" 10:43:50 - Updating voltage widget... 10:44:21 - High voltage locked channels will be checked every 30 s 10:44:51 - Checking for high voltage locked pixels... 10:44:53 - Module 117 has 1 pixel(s) locked (HVPA status of 0x5f)! 10:45:15 - HVPA channel 5 of drawer 117 has status 0x8003! 10:45:15 - HVPA channel 5 in module 117 is locked! 10:45:19 - HV is locked in 1 channel(s), was in rise default in 0 channel(s) and was still in progress in 1 channel(s) 10:45:19 - Unlocking 1 channel(s)... 10:45:21 - Checking for high voltage locked pixels... 10:45:45 - HVPA channel 5 of drawer 117 has status 0x0003! 10:45:48 - HV is locked in 0 channel(s), was in rise default in 0 channel(s) and was still in progress in 1 channel(s) 10:45:51 - Checking for high voltage locked pixels... 10:45:53 - Module 117 has 1 pixel(s) locked (HVPA status of 0x5f)! 10:46:15 - HVPA channel 5 of drawer 117 has status 0x8003! 10:46:15 - HVPA channel 5 in module 117 is locked! 10:46:18 - HV is locked in 1 channel(s), was in rise default in 0 channel(s) and was still in progress in 1 channel(s) 10:46:18 - Unlocking 1 channel(s)... 10:46:20 - Stopped periodic check of locked high voltages 10:46:31 - Updating voltage widget... 10:47:39 - Checking UCTS clock... 10:47:39 - UCTS and control PC clocks differ by 3.0 seconds 10:47:39 - Configuring UCTS with (10.200.7.250, 10.200.4.100, 44:a8:42:44:32:c9) 10:47:40 - Configuring TIB... 10:47:40 - Setting TIB forced mode to False 10:47:40 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v 10:47:40 - Status: TibState.PpsStopped 10:47:40 - Alarms: AlarmVector.BufferFull|AlmostFull 10:47:40 - Connection status: False TXclient_alive: False 10:47:40 - Entering set_external_delay 10:47:40 - Setting ExternalDelayLocal to 27.000 ns 10:47:40 - Writing 27.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v 10:47:40 - Entering set_external_delay 10:47:40 - Setting ExternalDelayCalibration to 58.000 ns 10:47:40 - Writing 58.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v 10:47:41 - Entering set_external_delay 10:47:41 - Setting ExternalDelaySphe to 150.000 ns 10:47:41 - Writing 150.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v 10:47:41 - Setting TIB trigger mode to 0x54 = TriggerMask.SlowControl|Software|Calibration 10:47:41 - Writing 84 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v 10:47:41 - Writing 1 to Camera.TIB.InputsEnable.InputMask.InputMask_v 10:47:41 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v 10:47:41 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v 10:47:41 - Writing True to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v 10:47:41 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v 10:47:41 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v 10:47:41 - Status: TibState.PpsStopped 10:47:41 - Alarms: AlarmVector.BufferFull|AlmostFull 10:47:41 - Connection status: False TXclient_alive: False 10:47:41 - Writing False to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v 10:47:41 - Writing 1000 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v 10:47:41 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 10:47:41 - Writing False to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v 10:47:41 - Writing 1000 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v 10:47:41 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v 10:47:41 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 10:47:41 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v 10:47:41 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v 10:47:41 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 10:47:45 - Connecting TIB to camera server at 10.10.4.12:222 10:47:45 - Starting TIB... 10:47:45 - Status: TibState.PpsStopped 10:47:45 - Alarms: AlarmVector.BufferFull|AlmostFull 10:47:45 - Connection status: False TXclient_alive: True 10:47:45 - Resetting run 10:47:45 - Wait for UCTS external trigger before enabling trigger... 10:47:45 - Status: TibState.Standby 10:47:45 - Alarms: AlarmVector.NoAlarm 10:47:45 - Connection status: False TXclient_alive: True 10:47:45 - Status: TibState.Standby 10:47:45 - Alarms: AlarmVector.NoAlarm 10:47:45 - Connection status: False TXclient_alive: True 10:47:46 - Status: TibState.Armed 10:47:46 - Alarms: AlarmVector.NoAlarm 10:47:46 - Connection status: True TXclient_alive: True 10:47:47 - Starting TIB triggers... 10:47:47 - Enabling trigger 10:47:47 - Status: TibState.Running 10:47:47 - Alarms: AlarmVector.NoAlarm 10:47:47 - Connection status: True TXclient_alive: True 10:47:49 - Status: TibState.Running ConnectionStatus: True TXclient_alive: True 10:47:49 - Alarms: AlarmVector.NoAlarm 10:47:49 - Temperature: 40.75 10:47:49 - Local camera rate: 0.0 Hz 10:47:49 - Stereo trigger rate: 0.0 Hz 10:47:49 - SPE trigger rate: 0.0 Hz 10:47:49 - Calibration trigger rate: 0.0 Hz 10:47:49 - Software trigger rate: 0.0 Hz 10:47:49 - Pedestal trigger rate: 0.0 Hz 10:47:49 - Collected trigger rate: 0.0 Hz 10:47:49 - Busy rate: 0.0 Hz 10:47:49 - Camera trigger rate: 0.0 Hz 10:47:52 - Configuring calibration box... 10:47:52 - Configuring calibration box with leds=0x40 voltage=11.00 frequency=1000.0/1 central_current=0.0 duration=500 width=1 lemo_out=True fiber1_out=True fiber2_out=False lemo_in=False enabled=False 10:47:55 - Starting flashes... 10:48:37 - High voltage locked channels will be checked every 30 s 10:48:51 - Stopping TIB... 10:48:51 - Status: TibState.Running 10:48:51 - Alarms: AlarmVector.ReadError 10:48:51 - Connection status: True TXclient_alive: True 10:48:51 - Disabling trigger 10:48:51 - Disabling PPS 10:48:52 - Status: TibState.PpsStopped 10:48:52 - Alarms: AlarmVector.ReadError 10:48:52 - Connection status: True TXclient_alive: True 10:48:53 - Closing TIB connection to camera server 10:48:54 - Status: TibState.PpsStopped 10:48:54 - Alarms: AlarmVector.ReadError 10:48:55 - Connection status: False TXclient_alive: False 10:48:55 - Run duration: 0:01:05 10:48:55 - Local camera triggers: 0 10:48:55 - Slow control triggers: 0 10:48:55 - Single photo-electron triggers: 0 10:48:55 - Calibration triggers: 49880 10:48:55 - Software triggers from UCTS: 0 10:48:55 - Pedestal triggers: 0 10:48:55 - Collected input triggers: 49880 10:48:55 - Busy triggers: 0 10:48:55 - Camera event triggers sent to clusters: 49880 10:48:57 - Calling method FSM.gotoReady in object FSM 10:49:01 - Stopping NMC 10:49:06 - Found 0 PPS errors. 10:49:07 - Checking for high voltage locked pixels... 10:49:09 - Module 117 has 1 pixel(s) locked (HVPA status of 0x5f)! 10:49:31 - HVPA channel 5 of drawer 117 has status 0x8003! 10:49:31 - HVPA channel 5 in module 117 is locked! 10:49:34 - HV is locked in 1 channel(s), was in rise default in 0 channel(s) and was still in progress in 1 channel(s) 10:49:34 - Unlocking 1 channel(s)... 10:49:37 - Checking for high voltage locked pixels... 10:49:58 - HVPA channel 4 of drawer 97 has status 0x0003! 10:49:58 - HVPA channel 4 of drawer 239 has status 0x0003! 10:50:01 - HVPA channel 5 of drawer 117 has status 0x0003! 10:50:04 - HVPA channel 6 of drawer 91 has status 0x0003! 10:50:04 - HV is locked in 0 channel(s), was in rise default in 0 channel(s) and was still in progress in 4 channel(s) 10:50:04 - Event builder is in state CameraServerState.Ready and has output 49880 event(s) during run #2575. 10:50:07 - Checking for high voltage locked pixels... 10:50:09 - Module 117 has 1 pixel(s) locked (HVPA status of 0x5f)! 10:50:31 - HVPA channel 5 of drawer 117 has status 0x8003! 10:50:31 - HVPA channel 5 in module 117 is locked! 10:50:34 - HV is locked in 1 channel(s), was in rise default in 0 channel(s) and was still in progress in 1 channel(s) 10:50:34 - Unlocking 1 channel(s)... 10:50:37 - Checking for high voltage locked pixels... 10:51:01 - HVPA channel 5 of drawer 117 has status 0x0003! 10:51:04 - HV is locked in 0 channel(s), was in rise default in 0 channel(s) and was still in progress in 1 channel(s) 10:51:04 - NMC is in state NmcState.Configured and knows of 265 drawer(s) 10:51:19 - All front-end boards have counted 49880 event(s) 10:51:24 - Found 0 PPS errors. 10:51:24 - Checking for high voltage locked pixels... 10:51:26 - Module 117 has 1 pixel(s) locked (HVPA status of 0x5f)! 10:51:48 - HVPA channel 5 of drawer 117 has status 0x8003! 10:51:48 - HVPA channel 5 in module 117 is locked! 10:51:48 - HVPA channel 5 of drawer 251 has status 0x0003! 10:51:51 - HVPA channel 6 of drawer 46 has status 0x0003! 10:51:51 - HV is locked in 1 channel(s), was in rise default in 0 channel(s) and was still in progress in 3 channel(s) 10:51:51 - Unlocking 1 channel(s)... 10:51:52 - Stopped periodic check of locked high voltages