14:18:49 - Starting task "Powering modules..." 14:18:49 - Executing command '/opt/cta/bin/cta_ctrl --slot 19 --channel 15 --power_off' on Digital Trigger Crate at 10.10.4.57 14:18:51 - Finished task "Powering modules..." 14:18:51 - Module 84 is connected to channel 12 of DTC slot 19 14:18:54 - Starting task "Powering modules..." 14:18:54 - Executing command '/opt/cta/bin/cta_ctrl --slot 19 --channel 12 --power_on' on Digital Trigger Crate at 10.10.4.57 14:18:55 - Finished task "Powering modules..." 14:19:01 - Starting task "Powering modules..." 14:19:01 - Executing command '/opt/cta/bin/cta_ctrl --slot 19 --channel 12 --power_off' on Digital Trigger Crate at 10.10.4.57 14:19:03 - Finished task "Powering modules..." 14:19:03 - Module 85 is connected to channel 15 of DTC slot 19 14:19:05 - Starting task "Powering modules..." 14:19:05 - Executing command '/opt/cta/bin/cta_ctrl --slot 19 --channel 15 --power_on' on Digital Trigger Crate at 10.10.4.57 14:19:07 - Finished task "Powering modules..." 14:19:08 - Module 84 is connected to channel 12 of DTC slot 19 14:19:09 - Starting task "Powering modules..." 14:19:09 - Executing command '/opt/cta/bin/cta_ctrl --slot 19 --channel 12 --power_on' on Digital Trigger Crate at 10.10.4.57 14:19:11 - Finished task "Powering modules..." 14:19:12 - Scanning interface enp2s0 for non configured modules... 14:19:13 - Found 1 MAC address(es) 14:19:14 - Scanning interface enp2s0 for non configured modules... 14:19:14 - Found 1 MAC address(es) 14:19:15 - Scanning interface enp2s0 for non configured modules... 14:19:15 - Found 1 MAC address(es) 14:19:16 - Scanning interface enp2s0 for non configured modules... 14:19:16 - Found 1 MAC address(es) 14:19:17 - Scanning interface enp2s0 for non configured modules... 14:19:18 - Found 2 MAC address(es) 14:19:18 - Scanning interface enp2s0 for non configured modules... 14:19:19 - Found 2 MAC address(es) 14:19:29 - Starting task "Configure modules" 14:19:29 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/utils/branches/v5.5.1-40061 14:19:29 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/libNectarCam/branches/v5.5.1-40061 14:19:29 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/libQNectarCam/branches/v5.5.1-40061 14:19:29 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/qNectarcamModuleController/branches/v5.5.1-40061 14:19:29 - Configuring modules with configuration /data/config/2020/20201208/config_tower_2modules_FEBv6_pingpong_newDacl_DelayBusy15.NMC.xml 14:19:29 - Switching off high voltages in configuration 14:19:33 - Successfully configured 2 module(s) 14:19:33 - All front-end boards are programmed with firmware 61201209 14:19:33 - All backplanes are programmed with firmware 15 14:19:34 - NMC is in state NmcState.Configured and knows of 2 drawer(s) 14:19:34 - Found 0 PPS errors. 14:19:34 - Finished task "Configure modules" 14:19:37 - Stopping flashes... 14:19:58 - Starting task "Switch HVPA voltage state" 14:19:58 - Setting HVPA current limit to 12489.75 uA 14:19:59 - Setting HVPA ramp speed to 25 V/s 14:19:59 - Switching HVPA to state Nominal 14:20:01 - High voltage locked channels will be checked every 30 s 14:20:06 - Setting HVPA current limits... 14:20:07 - Finished task "Switch HVPA voltage state" 14:20:09 - Calling method FSM.gotoObserving in object FSM 14:20:31 - Checking for high voltage locked pixels... 14:21:01 - Checking for high voltage locked pixels... 14:21:02 - Starting task "Check high voltages" 14:21:02 - Found 2 drawer(s) in Nominal state, 0 in Low state and 0 in Wait state 14:21:03 - Actual voltage is between 989.42 V and 1168.15 V. 14:21:03 - Low voltages range between 300.00 V and 300.00 V. 14:21:04 - Reference voltages range between 989.87 V and 1168.35 V. 14:21:04 - Maximum difference between expected and actual voltages is 0.60 V 14:21:04 - Maximum of current limits is 4840.96 uA 14:21:04 - Checking status of HVPA module in 2 drawer(s)... 14:21:04 - Checking status of HVPA channels in 2 drawer(s)... 14:21:05 - HV is stabilized in all channels. 14:21:05 - Checking reference and low voltages against /data/config/2020/20201208/config_tower_2modules_FEBv6_pingpong_newDacl_DelayBusy15.NMC.xml 14:21:05 - Done 14:21:05 - Finished task "Check high voltages" 14:21:31 - Checking for high voltage locked pixels... 14:22:01 - Checking for high voltage locked pixels... 14:22:25 - Starting task "Switch HVPA voltage state" 14:22:25 - Setting HVPA current limit to 12489.75 uA 14:22:25 - Setting HVPA ramp speed to 500 V/s 14:22:25 - Switching HVPA to state Low 14:22:31 - Checking for high voltage locked pixels... 14:22:32 - Setting HVPA current limits... 14:22:34 - Finished task "Switch HVPA voltage state" 14:23:01 - Checking for high voltage locked pixels... 14:23:05 - Updating voltage widget... 14:23:12 - Starting task "Switch HVPA voltage state" 14:23:12 - Setting HVPA current limit to 12489.75 uA 14:23:13 - Setting HVPA ramp speed to 500 V/s 14:23:13 - Switching HVPA to state Wait 14:23:20 - Setting HVPA current limits... 14:23:22 - Finished task "Switch HVPA voltage state" 14:23:31 - Checking for high voltage locked pixels... 14:23:35 - Updating voltage widget... 14:23:48 - Updating voltage widget... 14:23:50 - Updating voltage widget... 14:24:01 - Checking for high voltage locked pixels... 14:24:06 - Updating voltage widget... 14:24:16 - Updating voltage widget... 14:24:18 - Updating voltage widget... 14:24:19 - Updating voltage widget... 14:24:23 - Starting NMC 14:24:23 - Clearing PPS error counters 14:24:31 - Checking for high voltage locked pixels... 14:24:36 - Configuring calibration box... 14:24:36 - Configuring calibration box with leds=0x40 voltage=15.00 frequency=1000.0/1 central_current=0.0 duration=0 width=1 lemo_out=True fiber1_out=True fiber2_out=True lemo_in=True enabled=True 14:24:44 - Checking UCTS clock... 14:24:44 - UCTS and control PC clocks differ by 3.9 seconds 14:24:44 - Configuring UCTS 14:24:45 - Configuring TIB... 14:24:45 - Setting TIB forced mode to False 14:24:45 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v 14:24:45 - Status: TibState.PpsStopped 14:24:45 - Alarms: AlarmVector.NoAlarm 14:24:45 - Connection status: False TXclient_alive: False 14:24:45 - Entering set_external_delay 14:24:45 - Setting ExternalDelayLocal to 0.000 ns 14:24:45 - Writing 0.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v 14:24:45 - Entering set_external_delay 14:24:45 - Setting ExternalDelayCalibration to 65.000 ns 14:24:45 - Writing 65.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v 14:24:45 - Entering set_external_delay 14:24:45 - Setting ExternalDelaySphe to 150.000 ns 14:24:45 - Writing 150.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v 14:24:45 - Setting TIB trigger mode to 0x74 = TriggerMask.SlowControl|Pedestal|Software|Calibration 14:24:45 - Writing 116 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v 14:24:45 - Writing 1 to Camera.TIB.InputsEnable.InputMask.InputMask_v 14:24:45 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v 14:24:45 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v 14:24:45 - Writing False to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v 14:24:45 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v 14:24:45 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v 14:24:45 - Status: TibState.PpsStopped 14:24:45 - Alarms: AlarmVector.NoAlarm 14:24:45 - Connection status: False TXclient_alive: False 14:24:45 - Writing True to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v 14:24:45 - Writing 100 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v 14:24:45 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 14:24:45 - Writing False to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v 14:24:45 - Writing 100 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v 14:24:45 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v 14:24:45 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 14:24:45 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v 14:24:45 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v 14:24:45 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v 14:24:46 - Connecting TIB to camera server at 10.10.4.12:222 14:24:46 - Starting TIB... 14:24:46 - Status: TibState.PpsStopped 14:24:46 - Alarms: AlarmVector.NoAlarm 14:24:46 - Connection status: False TXclient_alive: True 14:24:46 - Resetting run 14:24:46 - Wait for UCTS external trigger before enabling trigger... 14:24:46 - Status: TibState.Standby 14:24:46 - Alarms: AlarmVector.NoAlarm 14:24:46 - Connection status: False TXclient_alive: True 14:24:46 - Status: TibState.Standby 14:24:46 - Alarms: AlarmVector.NoAlarm 14:24:46 - Connection status: False TXclient_alive: True 14:24:47 - Status: TibState.Armed 14:24:47 - Alarms: AlarmVector.NoAlarm 14:24:47 - Connection status: True TXclient_alive: True 14:24:49 - Starting TIB triggers... 14:24:49 - Enabling trigger 14:24:49 - Status: TibState.Running 14:24:49 - Alarms: AlarmVector.NoAlarm 14:24:49 - Connection status: True TXclient_alive: True 14:24:52 - Status: TibState.Running ConnectionStatus: True TXclient_alive: True 14:24:52 - Alarms: AlarmVector.NoAlarm 14:24:52 - Temperature: 37.12 14:24:52 - Local camera rate: 0.0 Hz 14:24:52 - Stereo trigger rate: 0.0 Hz 14:24:52 - SPE trigger rate: 0.0 Hz 14:24:52 - Calibration trigger rate: 8610.0 Hz 14:24:52 - Software trigger rate: 0.0 Hz 14:24:52 - Pedestal trigger rate: 100.0 Hz 14:24:52 - Collected trigger rate: 8645.0 Hz 14:24:52 - Busy rate: 104.0 Hz 14:24:52 - Camera trigger rate: 8541.0 Hz 14:25:01 - Checking for high voltage locked pixels... 14:25:12 - Status: TibState.Running ConnectionStatus: True TXclient_alive: True 14:25:12 - Alarms: AlarmVector.NoAlarm 14:25:12 - Temperature: 37.12 14:25:12 - Local camera rate: 0.0 Hz 14:25:12 - Stereo trigger rate: 0.0 Hz 14:25:12 - SPE trigger rate: 0.0 Hz 14:25:12 - Calibration trigger rate: 8580.0 Hz 14:25:12 - Software trigger rate: 0.0 Hz 14:25:12 - Pedestal trigger rate: 100.0 Hz 14:25:12 - Collected trigger rate: 8626.0 Hz 14:25:12 - Busy rate: 102.0 Hz 14:25:12 - Camera trigger rate: 8524.0 Hz 14:25:13 - Status: TibState.Running ConnectionStatus: True TXclient_alive: True 14:25:13 - Alarms: AlarmVector.NoAlarm 14:25:13 - Temperature: 37.06 14:25:13 - Local camera rate: 0.0 Hz 14:25:13 - Stereo trigger rate: 0.0 Hz 14:25:13 - SPE trigger rate: 0.0 Hz 14:25:13 - Calibration trigger rate: 8580.0 Hz 14:25:13 - Software trigger rate: 0.0 Hz 14:25:13 - Pedestal trigger rate: 100.0 Hz 14:25:13 - Collected trigger rate: 8626.0 Hz 14:25:13 - Busy rate: 102.0 Hz 14:25:13 - Camera trigger rate: 8524.0 Hz 14:25:15 - Status: TibState.Running ConnectionStatus: True TXclient_alive: True 14:25:15 - Alarms: AlarmVector.NoAlarm 14:25:15 - Temperature: 37.06 14:25:15 - Local camera rate: 0.0 Hz 14:25:15 - Stereo trigger rate: 0.0 Hz 14:25:15 - SPE trigger rate: 0.0 Hz 14:25:15 - Calibration trigger rate: 8580.0 Hz 14:25:15 - Software trigger rate: 0.0 Hz 14:25:15 - Pedestal trigger rate: 100.0 Hz 14:25:15 - Collected trigger rate: 8626.0 Hz 14:25:15 - Busy rate: 102.0 Hz 14:25:15 - Camera trigger rate: 8524.0 Hz 14:25:17 - Status: TibState.Running ConnectionStatus: True TXclient_alive: True 14:25:17 - Alarms: AlarmVector.NoAlarm 14:25:17 - Temperature: 37.12 14:25:17 - Local camera rate: 0.0 Hz 14:25:17 - Stereo trigger rate: 0.0 Hz 14:25:17 - SPE trigger rate: 0.0 Hz 14:25:17 - Calibration trigger rate: 8831.0 Hz 14:25:17 - Software trigger rate: 0.0 Hz 14:25:18 - Pedestal trigger rate: 100.0 Hz 14:25:18 - Collected trigger rate: 8864.0 Hz 14:25:18 - Busy rate: 108.0 Hz 14:25:18 - Camera trigger rate: 8756.0 Hz 14:25:24 - Status: TibState.Running ConnectionStatus: True TXclient_alive: True 14:25:24 - Alarms: AlarmVector.NoAlarm 14:25:24 - Temperature: 37.19 14:25:24 - Local camera rate: 0.0 Hz 14:25:24 - Stereo trigger rate: 0.0 Hz 14:25:24 - SPE trigger rate: 0.0 Hz 14:25:24 - Calibration trigger rate: 8513.0 Hz 14:25:24 - Software trigger rate: 0.0 Hz 14:25:24 - Pedestal trigger rate: 100.0 Hz 14:25:25 - Collected trigger rate: 8536.0 Hz 14:25:25 - Busy rate: 102.0 Hz 14:25:25 - Camera trigger rate: 8434.0 Hz 14:25:31 - Checking for high voltage locked pixels... 14:25:50 - Stopping TIB... 14:25:50 - Status: TibState.Running 14:25:50 - Alarms: AlarmVector.NoAlarm 14:25:50 - Connection status: True TXclient_alive: True 14:25:50 - Disabling trigger 14:25:50 - Disabling PPS 14:25:51 - Status: TibState.PpsStopped 14:25:51 - Alarms: AlarmVector.NoAlarm 14:25:51 - Connection status: True TXclient_alive: True 14:25:51 - Closing TIB connection to camera server 14:25:51 - Status: TibState.PpsStopped 14:25:51 - Alarms: AlarmVector.NoAlarm 14:25:52 - Connection status: False TXclient_alive: False 14:25:52 - Run duration: 0:01:02 14:25:52 - Local camera triggers: 0 14:25:52 - Slow control triggers: 0 14:25:52 - Single photo-electron triggers: 1 14:25:52 - Calibration triggers: 533494 14:25:52 - Software triggers from UCTS: 0 14:25:52 - Pedestal triggers: 6181 14:25:52 - Collected input triggers: 528635 14:25:52 - Busy triggers: 6081 14:25:52 - Camera event triggers sent to clusters: 522554