11:18:29 - Starting NMC 11:18:29 - Clearing PPS error counters 11:18:43 - Resetting FEB counters... 11:18:49 - Starting all configured modules... 11:18:57 - High voltage locked channels will be checked every 60 s 11:19:01 - Calling method FSM.gotoObserving in object FSM 11:19:01 - Starting run 2610 11:19:19 - Configuring calibration box... 11:19:19 - Configuring calibration box with leds=0x0 voltage=8.00 frequency=1000.0/1 central_current=0.0 duration=0 width=1 lemo_out=True fiber1_out=True fiber2_out=True lemo_in=True enabled=True 11:19:29 - Checking UCTS clock... 11:19:29 - UCTS and control PC clocks differ by 0.6 seconds 11:19:29 - Configuring UCTS with (10.200.7.250, 10.200.4.100, 44:a8:42:44:32:c9) 11:19:29 - Configuring TIB... 11:19:29 - Setting TIB forced mode to False 11:19:29 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v 11:19:29 - Status: TibState.PpsStopped 11:19:29 - Alarms: AlarmVector.ReadError 11:19:29 - Connection status: False TXclient_alive: False 11:19:29 - Entering set_external_delay 11:19:29 - Setting ExternalDelayLocal to 27.000 ns 11:19:29 - Writing 27.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v 11:19:30 - Entering set_external_delay 11:19:30 - Setting ExternalDelayCalibration to 58.000 ns 11:19:30 - Writing 58.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v 11:19:30 - Entering set_external_delay 11:19:30 - Setting ExternalDelaySphe to 110.000 ns 11:19:30 - Writing 110.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v 11:19:30 - Setting TIB trigger mode to 0x54 = TriggerMask.SlowControl|Software|Calibration 11:19:30 - Writing 84 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v 11:19:30 - Writing 1 to Camera.TIB.InputsEnable.InputMask.InputMask_v 11:19:30 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v 11:19:30 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v 11:19:30 - Writing True to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v 11:19:30 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v 11:19:30 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v 11:19:30 - Status: TibState.PpsStopped 11:19:30 - Alarms: AlarmVector.ReadError 11:19:30 - Connection status: False TXclient_alive: False 11:19:30 - Writing False to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v 11:19:30 - Writing 1000 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v 11:19:30 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 11:19:30 - Writing False to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v 11:19:30 - Writing 1000 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v 11:19:30 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v 11:19:30 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 11:19:30 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v 11:19:30 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v 11:19:30 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 11:19:33 - Connecting TIB to camera server at 10.10.4.12:222 11:19:33 - Starting TIB... 11:19:33 - Status: TibState.PpsStopped 11:19:33 - Alarms: AlarmVector.ReadError 11:19:33 - Connection status: False TXclient_alive: True 11:19:33 - Resetting run 11:19:33 - Wait for UCTS external trigger before enabling trigger... 11:19:33 - Status: TibState.Standby 11:19:33 - Alarms: AlarmVector.NoAlarm 11:19:33 - Connection status: False TXclient_alive: True 11:19:33 - Status: TibState.Standby 11:19:33 - Alarms: AlarmVector.NoAlarm 11:19:33 - Connection status: False TXclient_alive: True 11:19:34 - Status: TibState.Armed 11:19:34 - Alarms: AlarmVector.NoAlarm 11:19:34 - Connection status: True TXclient_alive: True 11:19:37 - Starting TIB triggers... 11:19:37 - Enabling trigger 11:19:37 - Status: TibState.Running 11:19:37 - Alarms: AlarmVector.ReadError 11:19:37 - Connection status: True TXclient_alive: True 11:19:39 - Status: TibState.Running ConnectionStatus: True TXclient_alive: True 11:19:39 - Alarms: AlarmVector.ReadError 11:19:39 - Temperature: 42.75 11:19:39 - Local camera rate: 0.0 Hz 11:19:39 - Stereo trigger rate: 0.0 Hz 11:19:39 - SPE trigger rate: 0.0 Hz 11:19:39 - Calibration trigger rate: 4043.0 Hz 11:19:39 - Software trigger rate: 0.0 Hz 11:19:39 - Pedestal trigger rate: 0.0 Hz 11:19:39 - Collected trigger rate: 4010.0 Hz 11:19:39 - Busy rate: 139.0 Hz 11:19:39 - Camera trigger rate: 3871.0 Hz 11:19:57 - Checking for high voltage locked pixels... 11:20:11 - HVPA channel 2 of drawer 86 has status 0x0007! 11:20:11 - HVPA channel 2 in module 86 is in rise default! 11:20:24 - HV is locked in 0 channel(s), was in rise default in 1 channel(s) and was still in progress in 1 channel(s) 11:20:57 - Checking for high voltage locked pixels... 11:21:11 - HVPA channel 2 of drawer 86 has status 0x0007! 11:21:11 - HVPA channel 2 in module 86 is in rise default! 11:21:24 - HV is locked in 0 channel(s), was in rise default in 1 channel(s) and was still in progress in 1 channel(s) 11:21:24 - Stopped periodic check of locked high voltages 11:21:24 - High voltage locked channels will be checked every 60 s 11:21:25 - Stopped periodic check of locked high voltages 11:21:29 - Status: TibState.Running ConnectionStatus: True TXclient_alive: True 11:21:29 - Alarms: AlarmVector.ReadError 11:21:29 - Temperature: 42.81 11:21:29 - Local camera rate: 0.0 Hz 11:21:29 - Stereo trigger rate: 0.0 Hz 11:21:29 - SPE trigger rate: 0.0 Hz 11:21:29 - Calibration trigger rate: 3923.0 Hz 11:21:29 - Software trigger rate: 0.0 Hz 11:21:29 - Pedestal trigger rate: 0.0 Hz 11:21:29 - Collected trigger rate: 3900.0 Hz 11:21:29 - Busy rate: 119.0 Hz 11:21:29 - Camera trigger rate: 3781.0 Hz 11:22:16 - Stopping TIB... 11:22:16 - Status: TibState.Running 11:22:16 - Alarms: AlarmVector.ReadError 11:22:16 - Connection status: True TXclient_alive: True 11:22:16 - Disabling trigger 11:22:16 - Disabling PPS 11:22:17 - Status: TibState.PpsStopped 11:22:17 - Alarms: AlarmVector.ReadError 11:22:17 - Connection status: True TXclient_alive: True 11:22:18 - Closing TIB connection to camera server 11:22:20 - Status: TibState.PpsStopped 11:22:20 - Alarms: AlarmVector.ReadError 11:22:20 - Connection status: False TXclient_alive: False 11:22:20 - Run duration: 0:02:42 11:22:20 - Local camera triggers: 0 11:22:20 - Slow control triggers: 0 11:22:20 - Single photo-electron triggers: 0 11:22:20 - Calibration triggers: 644050 11:22:20 - Software triggers from UCTS: 0 11:22:20 - Pedestal triggers: 0 11:22:20 - Collected input triggers: 629640 11:22:20 - Busy triggers: 18604 11:22:20 - Camera event triggers sent to clusters: 611036 11:22:29 - Calling method FSM.gotoReady in object FSM 11:22:33 - Stopping NMC 11:22:39 - Found 0 PPS errors. 11:22:40 - NMC is in state NmcState.Configured and knows of 265 drawer(s) 11:22:55 - All front-end boards have counted 611036 event(s) 11:23:00 - Found 0 PPS errors. 11:23:55 - Event builder is in state CameraServerState.Ready and has output 611036 event(s) during run #2610. 11:34:01 - Starting task "Switch HVPA voltage state" 11:34:01 - Setting HVPA current limit to 12489.75 uA 11:34:01 - Setting Hvpa.Hvpa0.CurrentTrip in all drawers 11:34:11 - Setting Hvpa.Hvpa1.CurrentTrip in all drawers 11:34:21 - Setting Hvpa.Hvpa2.CurrentTrip in all drawers 11:34:31 - Setting Hvpa.Hvpa3.CurrentTrip in all drawers 11:34:41 - Setting Hvpa.Hvpa4.CurrentTrip in all drawers 11:34:51 - Setting Hvpa.Hvpa5.CurrentTrip in all drawers 11:35:00 - Setting Hvpa.Hvpa6.CurrentTrip in all drawers 11:35:10 - Setting HVPA ramp speed to 25 V/s 11:35:22 - Switching HVPA to state Low 11:35:40 - Setting HVPA current limits... 11:37:02 - Finished task "Switch HVPA voltage state" 12:27:55 - Starting task "Switch HVPA voltage state" 12:27:55 - Setting HVPA current limit to 12489.75 uA 12:27:55 - Setting Hvpa.Hvpa0.CurrentTrip in all drawers 12:28:05 - Setting Hvpa.Hvpa1.CurrentTrip in all drawers 12:28:15 - Setting Hvpa.Hvpa2.CurrentTrip in all drawers 12:28:24 - Setting Hvpa.Hvpa3.CurrentTrip in all drawers 12:28:34 - Setting Hvpa.Hvpa4.CurrentTrip in all drawers 12:28:44 - Setting Hvpa.Hvpa5.CurrentTrip in all drawers 12:28:54 - Setting Hvpa.Hvpa6.CurrentTrip in all drawers 12:29:04 - Setting HVPA ramp speed to 500 V/s 12:29:15 - Switching HVPA to state Wait 12:29:34 - Setting HVPA current limits... 12:30:55 - Finished task "Switch HVPA voltage state" 13:25:45 - Resetting NMC 13:25:51 - Starting task "Configure modules" 13:25:51 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/utils/branches/v5.6.0-41551 13:25:51 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/libNectarCam/branches/v5.6.0-41551 13:25:51 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/libQNectarCam/branches/v5.6.0-41551 13:25:51 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/qNectarcamModuleController/branches/v5.6.0-41551 13:25:51 - Configuring modules with configuration /data/config/2021/20210929/config_cameraqm_265febs_Hamamatsu_ND_DACL.NMC.xml 13:25:51 - Switching off high voltages in configuration 13:25:51 - Setting DAQ address to IP=10.10.4.93, MAC=a4:bb:6d:b0:8c:ef 13:26:02 - Successfully configured 265 module(s) 13:26:02 - Waiting for modules to be configured... 13:26:08 - All front-end boards are programmed with firmware F56D2002 13:26:16 - Found 2 different versions of DTBP firmware: [15 17] 13:26:56 - NMC is in state NmcState.Ready and knows of 265 drawer(s) 13:27:11 - All front-end boards have counted 0 event(s) 13:27:16 - Found 0 PPS errors. 13:27:16 - Finished task "Configure modules" 13:27:49 - Checking UCTS clock... 13:27:50 - UCTS and control PC clocks differ by 1.2 seconds 13:27:50 - Configuring UCTS with (10.200.7.250, 10.200.4.100, 44:a8:42:44:32:c9) 13:27:50 - Configuring TIB... 13:27:50 - Setting TIB forced mode to False 13:27:50 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v 13:27:50 - Status: TibState.PpsStopped 13:27:50 - Alarms: AlarmVector.ReadError 13:27:50 - Connection status: False TXclient_alive: False 13:27:50 - Entering set_external_delay 13:27:50 - Setting ExternalDelayLocal to 27.000 ns 13:27:50 - Writing 27.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v 13:27:50 - Entering set_external_delay 13:27:50 - Setting ExternalDelayCalibration to 58.000 ns 13:27:50 - Writing 58.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v 13:27:50 - Entering set_external_delay 13:27:50 - Setting ExternalDelaySphe to 110.000 ns 13:27:50 - Writing 110.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v 13:27:50 - Setting TIB trigger mode to 0x70 = TriggerMask.SlowControl|Pedestal|Software 13:27:50 - Writing 112 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v 13:27:50 - Writing 1 to Camera.TIB.InputsEnable.InputMask.InputMask_v 13:27:50 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v 13:27:50 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v 13:27:50 - Writing True to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v 13:27:50 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v 13:27:50 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v 13:27:51 - Status: TibState.PpsStopped 13:27:51 - Alarms: AlarmVector.ReadError 13:27:51 - Connection status: False TXclient_alive: False 13:27:51 - Writing True to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v 13:27:51 - Writing 1000 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v 13:27:51 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 13:27:51 - Writing False to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v 13:27:51 - Writing 1000 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v 13:27:51 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v 13:27:51 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 13:27:51 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v 13:27:51 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v 13:27:51 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 13:30:14 - Connecting TIB to camera server at 10.10.4.12:222 13:30:14 - Starting TIB... 13:30:14 - Status: TibState.PpsStopped 13:30:14 - Alarms: AlarmVector.ReadError 13:30:14 - Connection status: False TXclient_alive: True 13:30:14 - Resetting run 13:30:14 - Wait for UCTS external trigger before enabling trigger... 13:30:14 - Status: TibState.Standby 13:30:14 - Alarms: AlarmVector.NoAlarm 13:30:14 - Connection status: False TXclient_alive: True 13:30:14 - Status: TibState.Standby 13:30:14 - Alarms: AlarmVector.NoAlarm 13:30:14 - Connection status: False TXclient_alive: True 13:30:15 - Status: TibState.Armed 13:30:15 - Alarms: AlarmVector.NoAlarm 13:30:15 - Connection status: False TXclient_alive: True 13:30:16 - Starting TIB triggers... 13:30:16 - Enabling trigger 13:30:16 - Status: TibState.Running 13:30:16 - Alarms: AlarmVector.NoAlarm 13:30:16 - Connection status: False TXclient_alive: True 13:33:48 - Resetting NMC 13:34:02 - Starting task "Configure modules" 13:34:02 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/utils/branches/v5.6.0-41551 13:34:02 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/libNectarCam/branches/v5.6.0-41551 13:34:02 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/libQNectarCam/branches/v5.6.0-41551 13:34:02 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/qNectarcamModuleController/branches/v5.6.0-41551 13:34:02 - Configuring modules with configuration /data/config/2021/20210929/config_cameraqm_265febs_Hamamatsu_ND_DACL2.NMC.xml 13:34:02 - Switching off high voltages in configuration 13:34:08 - Stopping TIB... 13:34:08 - Status: TibState.Running 13:34:08 - Alarms: AlarmVector.BufferFull|AlmostFull 13:34:08 - Connection status: False TXclient_alive: True 13:34:08 - Disabling trigger 13:34:08 - Disabling PPS 13:34:09 - Status: TibState.PpsStopped 13:34:09 - Alarms: AlarmVector.BufferFull|AlmostFull 13:34:09 - Connection status: False TXclient_alive: True 13:34:10 - Closing TIB connection to camera server 13:34:12 - Successfully configured 265 module(s) 13:34:12 - Waiting for modules to be configured... 13:34:18 - All front-end boards are programmed with firmware F56D2002 13:34:26 - Found 2 different versions of DTBP firmware: [15 17] 13:35:06 - NMC is in state NmcState.Ready and knows of 265 drawer(s) 13:35:20 - All front-end boards have counted 0 event(s) 13:35:26 - Found PPS errors: 97 in drawer 0, 97 in drawer 1, 97 in drawer 2, 98 in drawer 3, 98 in drawer 4, 98 in drawer 5, 72 in drawer 6, 72 in drawer 7, 100 in drawer 8, 100 in drawer 9, 100 in drawer 10, 98 in drawer 11, 98 in drawer 12, 100 in drawer 13, 98 in drawer 14, 98 in drawer 15, 100 in drawer 16, 100 in drawer 17, 100 in drawer 18, 98 in drawer 19, 98 in drawer 20, 98 in drawer 21, 98 in drawer 22, 98 in drawer 23, 100 in drawer 24, 98 in drawer 25, 98 in drawer 26, 100 in drawer 27, 100 in drawer 28, 98 in drawer 29, 98 in drawer 30, 100 in drawer 31, 100 in drawer 32, 100 in drawer 33, 100 in drawer 34, 98 in drawer 35, 98 in drawer 36, 100 in drawer 37, 100 in drawer 38, 98 in drawer 39, 98 in drawer 40, 98 in drawer 41, 100 in drawer 42, 100 in drawer 43, 99 in drawer 44, 101 in drawer 45, 101 in drawer 46, 99 in drawer 47, 101 in drawer 48, 99 in drawer 49, 101 in drawer 50, 101 in drawer 51, 101 in drawer 52, 101 in drawer 53, 101 in drawer 54, 101 in drawer 55, 101 in drawer 56, 101 in drawer 57, 99 in drawer 58, 101 in drawer 59, 101 in drawer 60, 101 in drawer 61, 101 in drawer 62, 99 in drawer 63, 101 in drawer 64, 99 in drawer 65, 99 in drawer 66, 101 in drawer 67, 101 in drawer 68, 101 in drawer 69, 101 in drawer 70, 99 in drawer 71, 99 in drawer 72, 99 in drawer 73, 101 in drawer 74, 101 in drawer 75, 101 in drawer 76, 101 in drawer 77, 99 in drawer 78, 99 in drawer 79, 101 in drawer 80, 99 in drawer 81, 101 in drawer 82, 99 in drawer 83, 99 in drawer 84, 100 in drawer 85, 100 in drawer 86, 100 in drawer 87, 102 in drawer 88, 102 in drawer 89, 102 in drawer 90, 100 in drawer 91, 100 in drawer 92, 102 in drawer 93, 102 in drawer 94, 102 in drawer 95, 102 in drawer 96, 100 in drawer 97, 100 in drawer 98, 100 in drawer 99, 100 in drawer 100, 100 in drawer 101, 102 in drawer 102, 100 in drawer 103, 100 in drawer 104, 102 in drawer 105, 100 in drawer 106, 100 in drawer 107, 100 in drawer 108, 102 in drawer 109, 100 in drawer 110, 102 in drawer 111, 100 in drawer 112, 102 in drawer 113, 100 in drawer 114, 100 in drawer 115, 102 in drawer 116, 100 in drawer 117, 100 in drawer 118, 100 in drawer 119, 100 in drawer 120, 100 in drawer 121, 102 in drawer 122, 102 in drawer 123, 100 in drawer 124, 102 in drawer 125, 100 in drawer 126, 101 in drawer 127, 101 in drawer 128, 101 in drawer 129, 101 in drawer 130, 101 in drawer 131, 103 in drawer 132, 101 in drawer 133, 103 in drawer 134, 101 in drawer 135, 103 in drawer 136, 101 in drawer 137, 101 in drawer 138, 101 in drawer 139, 101 in drawer 140, 101 in drawer 141, 103 in drawer 142, 101 in drawer 143, 101 in drawer 144, 101 in drawer 145, 101 in drawer 146, 101 in drawer 147, 101 in drawer 148, 101 in drawer 149, 101 in drawer 150, 101 in drawer 151, 103 in drawer 152, 101 in drawer 153, 103 in drawer 154, 103 in drawer 155, 103 in drawer 156, 101 in drawer 157, 101 in drawer 158, 101 in drawer 159, 103 in drawer 160, 103 in drawer 161, 103 in drawer 162, 101 in drawer 163, 101 in drawer 164, 103 in drawer 165, 101 in drawer 166, 101 in drawer 167, 104 in drawer 168, 104 in drawer 169, 102 in drawer 170, 102 in drawer 171, 102 in drawer 172, 102 in drawer 173, 102 in drawer 174, 102 in drawer 175, 102 in drawer 176, 102 in drawer 177, 104 in drawer 178, 104 in drawer 179, 102 in drawer 180, 102 in drawer 181, 102 in drawer 182, 104 in drawer 183, 102 in drawer 184, 102 in drawer 185, 102 in drawer 186, 104 in drawer 187, 104 in drawer 188, 102 in drawer 189, 102 in drawer 190, 102 in drawer 191, 102 in drawer 192, 102 in drawer 193, 102 in drawer 194, 102 in drawer 195, 102 in drawer 196, 102 in drawer 197, 102 in drawer 198, 104 in drawer 199, 102 in drawer 200, 102 in drawer 201, 102 in drawer 202, 104 in drawer 203, 102 in drawer 204, 102 in drawer 205, 104 in drawer 206, 102 in drawer 207, 104 in drawer 208, 105 in drawer 209, 103 in drawer 210, 103 in drawer 211, 103 in drawer 212, 105 in drawer 213, 103 in drawer 214, 105 in drawer 215, 105 in drawer 216, 105 in drawer 217, 103 in drawer 218, 103 in drawer 219, 103 in drawer 220, 103 in drawer 221, 103 in drawer 222, 103 in drawer 223, 105 in drawer 224, 103 in drawer 225, 103 in drawer 226, 103 in drawer 227, 103 in drawer 228, 103 in drawer 229, 103 in drawer 230, 105 in drawer 231, 103 in drawer 232, 105 in drawer 233, 103 in drawer 234, 105 in drawer 235, 105 in drawer 236, 103 in drawer 237, 105 in drawer 238, 103 in drawer 239, 103 in drawer 240, 103 in drawer 241, 105 in drawer 242, 105 in drawer 243, 103 in drawer 244, 103 in drawer 245, 105 in drawer 246, 103 in drawer 247, 105 in drawer 248, 103 in drawer 249, 103 in drawer 250, 104 in drawer 251, 104 in drawer 252, 104 in drawer 253, 106 in drawer 254, 104 in drawer 255, 104 in drawer 256, 104 in drawer 257, 104 in drawer 258, 104 in drawer 259, 104 in drawer 260, 104 in drawer 261, 104 in drawer 262, 104 in drawer 263, 104 in drawer 264 13:35:26 - Finished task "Configure modules" 13:37:02 - Starting task "Switch HVPA voltage state" 13:37:02 - Setting HVPA current limit to 12489.75 uA 13:37:02 - Setting Hvpa.Hvpa0.CurrentTrip in all drawers 13:37:12 - Setting Hvpa.Hvpa1.CurrentTrip in all drawers 13:37:22 - Setting Hvpa.Hvpa2.CurrentTrip in all drawers 13:37:31 - Setting Hvpa.Hvpa3.CurrentTrip in all drawers 13:37:41 - Setting Hvpa.Hvpa4.CurrentTrip in all drawers 13:37:51 - Setting Hvpa.Hvpa5.CurrentTrip in all drawers 13:38:01 - Setting Hvpa.Hvpa6.CurrentTrip in all drawers 13:38:11 - Setting HVPA ramp speed to 25 V/s 13:38:22 - Switching HVPA to state Low 13:38:41 - Setting HVPA current limits... 13:40:03 - Finished task "Switch HVPA voltage state" 13:42:03 - Updating voltage widget... 13:42:30 - Starting task "Switch HVPA voltage state" 13:42:30 - Setting HVPA current limit to 12489.75 uA 13:42:30 - Setting Hvpa.Hvpa0.CurrentTrip in all drawers 13:42:40 - Setting Hvpa.Hvpa1.CurrentTrip in all drawers 13:42:50 - Setting Hvpa.Hvpa2.CurrentTrip in all drawers 13:43:00 - Setting Hvpa.Hvpa3.CurrentTrip in all drawers 13:43:10 - Setting Hvpa.Hvpa4.CurrentTrip in all drawers 13:43:19 - Setting Hvpa.Hvpa5.CurrentTrip in all drawers 13:43:29 - Setting Hvpa.Hvpa6.CurrentTrip in all drawers 13:43:39 - Setting HVPA ramp speed to 25 V/s 13:43:51 - Switching HVPA to state Nominal 13:44:09 - Setting HVPA current limits... 13:45:31 - Finished task "Switch HVPA voltage state" 13:46:03 - High voltage locked channels will be checked every 60 s 13:46:05 - Updating voltage widget... 13:46:26 - Starting NMC 13:46:26 - Clearing PPS error counters 13:46:40 - Resetting FEB counters... 13:46:43 - Starting all configured modules... 13:47:03 - Checking for high voltage locked pixels... 13:47:17 - HVPA channel 2 of drawer 86 has status 0x0007! 13:47:17 - HVPA channel 2 in module 86 is in rise default! 13:47:29 - HV is locked in 0 channel(s), was in rise default in 1 channel(s) and was still in progress in 2 channel(s) 13:47:47 - Stopped periodic check of locked high voltages 13:47:55 - Checking UCTS clock... 13:47:55 - UCTS and control PC clocks differ by 0.7 seconds 13:47:55 - Configuring UCTS with (10.200.7.250, 10.200.4.100, 44:a8:42:44:32:c9) 13:47:55 - Configuring TIB... 13:47:55 - Setting TIB forced mode to False 13:47:55 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v 13:47:55 - Status: TibState.PpsStopped 13:47:55 - Alarms: AlarmVector.BufferFull|AlmostFull 13:47:55 - Connection status: False TXclient_alive: False 13:47:56 - Entering set_external_delay 13:47:56 - Setting ExternalDelayLocal to 27.000 ns 13:47:56 - Writing 27.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v 13:47:57 - Entering set_external_delay 13:47:57 - Setting ExternalDelayCalibration to 58.000 ns 13:47:57 - Writing 58.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v 13:47:57 - Entering set_external_delay 13:47:57 - Setting ExternalDelaySphe to 110.000 ns 13:47:57 - Writing 110.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v 13:47:57 - Setting TIB trigger mode to 0x70 = TriggerMask.SlowControl|Pedestal|Software 13:47:57 - Writing 112 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v 13:47:57 - Writing 1 to Camera.TIB.InputsEnable.InputMask.InputMask_v 13:47:57 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v 13:47:57 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v 13:47:57 - Writing True to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v 13:47:57 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v 13:47:57 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v 13:47:57 - Status: TibState.PpsStopped 13:47:57 - Alarms: AlarmVector.BufferFull|AlmostFull 13:47:57 - Connection status: False TXclient_alive: False 13:47:57 - Writing True to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v 13:47:57 - Writing 1000 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v 13:47:57 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 13:47:57 - Writing False to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v 13:47:57 - Writing 1000 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v 13:47:57 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v 13:47:57 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 13:47:57 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v 13:47:57 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v 13:47:57 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 13:48:08 - Calling method FSM.gotoObserving in object FSM 13:48:08 - Starting run 2611 13:48:16 - Connecting TIB to camera server at 10.10.4.12:222 13:48:16 - Starting TIB... 13:48:16 - Status: TibState.PpsStopped 13:48:16 - Alarms: AlarmVector.BufferFull|AlmostFull 13:48:16 - Connection status: False TXclient_alive: True 13:48:16 - Resetting run 13:48:16 - Wait for UCTS external trigger before enabling trigger... 13:48:16 - Status: TibState.Standby 13:48:16 - Alarms: AlarmVector.NoAlarm 13:48:16 - Connection status: False TXclient_alive: True 13:48:16 - Status: TibState.Standby 13:48:16 - Alarms: AlarmVector.NoAlarm 13:48:16 - Connection status: False TXclient_alive: True 13:48:18 - Status: TibState.Armed 13:48:18 - Alarms: AlarmVector.NoAlarm 13:48:18 - Connection status: True TXclient_alive: True 13:48:21 - Starting TIB triggers... 13:48:21 - Enabling trigger 13:48:21 - Status: TibState.Running 13:48:21 - Alarms: AlarmVector.ReadError 13:48:21 - Connection status: True TXclient_alive: True 13:48:22 - Status: TibState.Running ConnectionStatus: True TXclient_alive: True 13:48:23 - Alarms: AlarmVector.ReadError 13:48:23 - Temperature: 44.62 13:48:23 - Local camera rate: 0.0 Hz 13:48:23 - Stereo trigger rate: 0.0 Hz 13:48:23 - SPE trigger rate: 0.0 Hz 13:48:23 - Calibration trigger rate: 4245.0 Hz 13:48:23 - Software trigger rate: 0.0 Hz 13:48:23 - Pedestal trigger rate: 999.0 Hz 13:48:23 - Collected trigger rate: 896.0 Hz 13:48:23 - Busy rate: 0.0 Hz 13:48:23 - Camera trigger rate: 896.0 Hz 13:48:24 - Status: TibState.Running ConnectionStatus: True TXclient_alive: True 13:48:24 - Alarms: AlarmVector.ReadError 13:48:24 - Temperature: 44.62 13:48:24 - Local camera rate: 0.0 Hz 13:48:24 - Stereo trigger rate: 0.0 Hz 13:48:24 - SPE trigger rate: 0.0 Hz 13:48:24 - Calibration trigger rate: 4253.0 Hz 13:48:24 - Software trigger rate: 0.0 Hz 13:48:24 - Pedestal trigger rate: 999.0 Hz 13:48:24 - Collected trigger rate: 999.0 Hz 13:48:24 - Busy rate: 0.0 Hz 13:48:24 - Camera trigger rate: 999.0 Hz 13:49:11 - Stopping TIB... 13:49:11 - Status: TibState.Running 13:49:11 - Alarms: AlarmVector.ReadError 13:49:12 - Connection status: True TXclient_alive: True 13:49:12 - Disabling trigger 13:49:12 - Disabling PPS 13:49:13 - Status: TibState.PpsStopped 13:49:13 - Alarms: AlarmVector.ReadError 13:49:13 - Connection status: True TXclient_alive: True 13:49:14 - Closing TIB connection to camera server 13:49:15 - Status: TibState.PpsStopped 13:49:15 - Alarms: AlarmVector.ReadError 13:49:15 - Connection status: False TXclient_alive: False 13:49:15 - Run duration: 0:00:54 13:49:15 - Local camera triggers: 0 13:49:15 - Slow control triggers: 0 13:49:15 - Single photo-electron triggers: 0 13:49:15 - Calibration triggers: 231100 13:49:15 - Software triggers from UCTS: 0 13:49:15 - Pedestal triggers: 53680 13:49:15 - Collected input triggers: 50467 13:49:15 - Busy triggers: 0 13:49:15 - Camera event triggers sent to clusters: 50467 13:49:19 - Calling method FSM.gotoReady in object FSM 13:49:23 - Event builder is in state CameraServerState.Observing and has output 50467 event(s) during run #2611. 13:49:23 - Event builder is in transition to state CameraServerState.Ready 13:49:28 - Stopping NMC 13:49:33 - Found 0 PPS errors.