13:19:20 - Starting NMC
13:19:20 - Clearing PPS error counters
13:19:42 - Resetting FEB counters...
13:19:48 - Starting all configured modules...
13:25:55 - High voltage locked channels will be checked every 60 s
13:25:59 - Checking status of calibration box...
13:25:59 - No server with URI='NectarCAM:CalibrationBox' has been discovered. The client could not discover a single server.
13:26:05 - Reconnecting to calibration box...
13:26:05 - Reconnecting to calibration box
13:26:05 - No server with URI='NectarCAM:CalibrationBox' has been discovered. The client could not discover a single server.
13:26:38 - Reconnecting to calibration box...
13:26:38 - Reconnecting to calibration box
13:26:41 - Could not invoke the MethodCall service: BadTimeout
13:26:44 - Checking status of calibration box...
13:26:45 - Calibration box is configured with 0 leds at a frequency of 16000000.0 Hz and a voltage of 7.90 V
13:26:56 - Checking for high voltage locked pixels...
13:27:21 - HVPA channel 2 of drawer 86 has status 0x0007!
13:27:21 - HVPA channel 2 in module 86 is in rise default!
13:27:44 - HV is locked in 0 channel(s), was in rise default in 1 channel(s) and was still in progress in 1 channel(s)
13:27:56 - Checking for high voltage locked pixels...
13:28:21 - HVPA channel 2 of drawer 86 has status 0x0007!
13:28:21 - HVPA channel 2 in module 86 is in rise default!
13:28:44 - HV is locked in 0 channel(s), was in rise default in 1 channel(s) and was still in progress in 1 channel(s)
13:28:56 - Checking for high voltage locked pixels...
13:29:21 - HVPA channel 2 of drawer 86 has status 0x0007!
13:29:21 - HVPA channel 2 in module 86 is in rise default!
13:29:44 - HV is locked in 0 channel(s), was in rise default in 1 channel(s) and was still in progress in 1 channel(s)
13:29:56 - Checking for high voltage locked pixels...
13:30:09 - HVPA channel 0 in module 117 is still in progress
13:30:21 - HVPA channel 2 of drawer 86 has status 0x0007!
13:30:21 - HVPA channel 2 in module 86 is in rise default!
13:30:44 - HV is locked in 0 channel(s), was in rise default in 1 channel(s) and was still in progress in 2 channel(s)
13:30:56 - Checking for high voltage locked pixels...
13:31:21 - HVPA channel 2 of drawer 86 has status 0x0007!
13:31:21 - HVPA channel 2 in module 86 is in rise default!
13:31:38 - HVPA channel 5 in module 213 is still in progress
13:31:44 - HV is locked in 0 channel(s), was in rise default in 1 channel(s) and was still in progress in 2 channel(s)
13:31:56 - Checking for high voltage locked pixels...
13:32:09 - HVPA channel 0 in module 117 is still in progress
13:32:21 - HVPA channel 2 of drawer 86 has status 0x0007!
13:32:21 - HVPA channel 2 in module 86 is in rise default!
13:32:44 - HVPA channel 6 in module 73 is still in progress
13:32:44 - HV is locked in 0 channel(s), was in rise default in 1 channel(s) and was still in progress in 3 channel(s)
13:32:56 - Checking for high voltage locked pixels...
13:33:09 - HVPA channel 0 in module 117 is still in progress
13:33:21 - HVPA channel 2 of drawer 86 has status 0x0007!
13:33:21 - HVPA channel 2 in module 86 is in rise default!
13:33:44 - HV is locked in 0 channel(s), was in rise default in 1 channel(s) and was still in progress in 2 channel(s)
13:33:56 - Checking for high voltage locked pixels...
13:34:21 - HVPA channel 2 of drawer 86 has status 0x0007!
13:34:21 - HVPA channel 2 in module 86 is in rise default!
13:34:44 - HVPA channel 6 in module 73 is still in progress
13:34:44 - HV is locked in 0 channel(s), was in rise default in 1 channel(s) and was still in progress in 2 channel(s)
13:34:56 - Checking for high voltage locked pixels...
13:35:09 - HVPA channel 0 in module 117 is still in progress
13:35:21 - HVPA channel 2 of drawer 86 has status 0x0007!
13:35:21 - HVPA channel 2 in module 86 is in rise default!
13:35:44 - HV is locked in 0 channel(s), was in rise default in 1 channel(s) and was still in progress in 2 channel(s)
13:35:56 - Checking for high voltage locked pixels...
13:36:21 - HVPA channel 2 of drawer 86 has status 0x0007!
13:36:21 - HVPA channel 2 in module 86 is in rise default!
13:36:21 - HVPA channel 2 in module 207 is still in progress
13:36:44 - HV is locked in 0 channel(s), was in rise default in 1 channel(s) and was still in progress in 2 channel(s)
13:36:56 - Checking for high voltage locked pixels...
13:37:09 - HVPA channel 0 in module 117 is still in progress
13:37:21 - HVPA channel 2 in module 27 is still in progress
13:37:21 - HVPA channel 2 of drawer 86 has status 0x0007!
13:37:21 - HVPA channel 2 in module 86 is in rise default!
13:37:27 - HVPA channel 3 in module 122 is still in progress
13:37:44 - HVPA channel 6 in module 73 is still in progress
13:37:44 - HV is locked in 0 channel(s), was in rise default in 1 channel(s) and was still in progress in 5 channel(s)
13:37:56 - Checking for high voltage locked pixels...
13:38:21 - HVPA channel 2 of drawer 86 has status 0x0007!
13:38:21 - HVPA channel 2 in module 86 is in rise default!
13:38:44 - HV is locked in 0 channel(s), was in rise default in 1 channel(s) and was still in progress in 1 channel(s)
13:38:56 - Checking for high voltage locked pixels...
13:39:21 - HVPA channel 2 of drawer 86 has status 0x0007!
13:39:21 - HVPA channel 2 in module 86 is in rise default!
13:39:44 - HV is locked in 0 channel(s), was in rise default in 1 channel(s) and was still in progress in 1 channel(s)
13:39:56 - Checking for high voltage locked pixels...
13:40:21 - HVPA channel 2 of drawer 86 has status 0x0007!
13:40:21 - HVPA channel 2 in module 86 is in rise default!
13:40:38 - HVPA channel 5 in module 143 is still in progress
13:40:44 - HV is locked in 0 channel(s), was in rise default in 1 channel(s) and was still in progress in 2 channel(s)
13:40:56 - Checking for high voltage locked pixels...
13:41:21 - HVPA channel 2 of drawer 86 has status 0x0007!
13:41:21 - HVPA channel 2 in module 86 is in rise default!
13:41:44 - HV is locked in 0 channel(s), was in rise default in 1 channel(s) and was still in progress in 1 channel(s)
13:41:56 - Checking for high voltage locked pixels...
13:42:21 - HVPA channel 2 of drawer 86 has status 0x0007!
13:42:21 - HVPA channel 2 in module 86 is in rise default!
13:42:44 - HVPA channel 6 in module 73 is still in progress
13:42:44 - HV is locked in 0 channel(s), was in rise default in 1 channel(s) and was still in progress in 2 channel(s)
13:42:56 - Checking for high voltage locked pixels...
13:43:21 - HVPA channel 2 of drawer 86 has status 0x0007!
13:43:21 - HVPA channel 2 in module 86 is in rise default!
13:43:44 - HV is locked in 0 channel(s), was in rise default in 1 channel(s) and was still in progress in 1 channel(s)
13:43:56 - Checking for high voltage locked pixels...
13:44:21 - HVPA channel 2 of drawer 86 has status 0x0007!
13:44:21 - HVPA channel 2 in module 86 is in rise default!
13:44:44 - HV is locked in 0 channel(s), was in rise default in 1 channel(s) and was still in progress in 1 channel(s)
13:44:56 - Checking for high voltage locked pixels...
13:45:21 - HVPA channel 2 of drawer 86 has status 0x0007!
13:45:21 - HVPA channel 2 in module 86 is in rise default!
13:45:33 - HVPA channel 4 in module 57 is still in progress
13:45:44 - HV is locked in 0 channel(s), was in rise default in 1 channel(s) and was still in progress in 2 channel(s)
13:45:44 - Stopped periodic check of locked high voltages
13:47:11 - Checking UCTS clock...
13:47:11 - UCTS clock is late by 10 seconds!
13:47:11 - Configuring UCTS with (10.200.7.250, 10.200.4.100, 44:a8:42:44:32:c9)
13:47:11 - Configuring TIB...
13:47:11 - Setting TIB forced mode to False
13:47:11 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v
13:47:11 - Status: TibState.PpsStopped
13:47:11 - Alarms: AlarmVector.ReadError
13:47:11 - Connection status: False TXclient_alive: False
13:47:12 - Entering set_external_delay
13:47:12 - Setting ExternalDelayLocal to 27.000 ns
13:47:12 - Writing 27.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v
13:47:12 - Entering set_external_delay
13:47:12 - Setting ExternalDelayCalibration to 58.000 ns
13:47:12 - Writing 58.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v
13:47:12 - Entering set_external_delay
13:47:12 - Setting ExternalDelaySphe to 110.000 ns
13:47:12 - Writing 110.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v
13:47:12 - Setting TIB trigger mode to 0x48 = TriggerMask.SlowControl|SPhE
13:47:12 - Writing 72 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v
13:47:12 - Writing 1 to Camera.TIB.InputsEnable.InputMask.InputMask_v
13:47:12 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v
13:47:12 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v
13:47:12 - Writing True to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v
13:47:12 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v
13:47:12 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v
13:47:12 - Status: TibState.PpsStopped
13:47:12 - Alarms: AlarmVector.ReadError
13:47:12 - Connection status: False TXclient_alive: False
13:47:12 - Writing False to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v
13:47:12 - Writing 100 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v
13:47:12 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
13:47:12 - Writing False to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v
13:47:12 - Writing 100 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v
13:47:12 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v
13:47:12 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
13:47:12 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v
13:47:12 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v
13:47:12 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
13:50:59 - Configuring calibration box...
13:50:59 - Configuring calibration box with leds=0x318 voltage=11.50 frequency=400.0/2 central_current=0.0 duration=0 width=1 lemo_out=True fiber1_out=True fiber2_out=True lemo_in=False enabled=False
13:51:10 - Starting NMC
13:51:10 - Clearing PPS error counters
13:51:31 - Resetting FEB counters...
13:51:38 - Starting all configured modules...
14:04:35 - Calling method FSM.gotoObserving in object FSM
14:04:35 - Starting run 2679
14:05:22 - Checking UCTS clock...
14:05:23 - UCTS clock is late by 10 seconds!
14:05:23 - Configuring UCTS with (10.200.7.250, 10.200.4.100, 44:a8:42:44:32:c9)
14:05:23 - Configuring TIB...
14:05:23 - Setting TIB forced mode to False
14:05:23 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v
14:05:23 - Status: TibState.PpsStopped
14:05:23 - Alarms: AlarmVector.ReadError
14:05:23 - Connection status: False TXclient_alive: False
14:05:23 - Entering set_external_delay
14:05:23 - Setting ExternalDelayLocal to 27.000 ns
14:05:23 - Writing 27.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v
14:05:23 - Entering set_external_delay
14:05:23 - Setting ExternalDelayCalibration to 58.000 ns
14:05:23 - Writing 58.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v
14:05:23 - Entering set_external_delay
14:05:23 - Setting ExternalDelaySphe to 110.000 ns
14:05:24 - Writing 110.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v
14:05:24 - Setting TIB trigger mode to 0x40 = TriggerMask.SlowControl
14:05:24 - Writing 64 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v
14:05:24 - Writing 1 to Camera.TIB.InputsEnable.InputMask.InputMask_v
14:05:24 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v
14:05:24 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v
14:05:24 - Writing True to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v
14:05:24 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v
14:05:24 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v
14:05:24 - Status: TibState.PpsStopped
14:05:24 - Alarms: AlarmVector.ReadError
14:05:24 - Connection status: False TXclient_alive: False
14:05:24 - Writing False to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v
14:05:24 - Writing 100 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v
14:05:24 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
14:05:24 - Writing False to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v
14:05:24 - Writing 100 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v
14:05:24 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v
14:05:24 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
14:05:24 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v
14:05:24 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v
14:05:24 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
14:05:25 - Connecting TIB to camera server at 10.10.4.12:222
14:05:25 - Starting TIB...
14:05:25 - Status: TibState.PpsStopped
14:05:25 - Alarms: AlarmVector.ReadError
14:05:25 - Connection status: False TXclient_alive: True
14:05:25 - Resetting run
14:05:25 - Wait for UCTS external trigger before enabling trigger...
14:05:25 - Status: TibState.Standby
14:05:25 - Alarms: AlarmVector.NoAlarm
14:05:25 - Connection status: False TXclient_alive: True
14:05:25 - Status: TibState.Standby
14:05:25 - Alarms: AlarmVector.NoAlarm
14:05:25 - Connection status: False TXclient_alive: True
14:05:26 - Status: TibState.Armed
14:05:26 - Alarms: AlarmVector.NoAlarm
14:05:26 - Connection status: True TXclient_alive: True
14:06:09 - Starting TIB triggers...
14:06:09 - Enabling trigger
14:06:09 - Status: TibState.Running
14:06:09 - Alarms: AlarmVector.NoAlarm
14:06:09 - Connection status: True TXclient_alive: True
14:19:24 - Stopping TIB...
14:19:24 - Status: TibState.Running
14:19:24 - Alarms: AlarmVector.ReadError
14:19:24 - Connection status: True TXclient_alive: True
14:19:24 - Disabling trigger
14:19:24 - Disabling PPS
14:19:25 - Status: TibState.PpsStopped
14:19:25 - Alarms: AlarmVector.ReadError
14:19:25 - Connection status: True TXclient_alive: True
14:19:26 - Closing TIB connection to camera server
14:19:27 - Status: TibState.PpsStopped
14:19:27 - Alarms: AlarmVector.ReadError
14:19:27 - Connection status: False TXclient_alive: False
14:19:27 - Run duration: 0:13:58
14:19:27 - Local camera triggers: 0
14:19:27 - Slow control triggers: 40
14:19:27 - Single photo-electron triggers: 48731
14:19:27 - Calibration triggers: 0
14:19:27 - Software triggers from UCTS: 0
14:19:27 - Pedestal triggers: 0
14:19:27 - Collected input triggers: 40453
14:19:27 - Busy triggers: 0
14:19:27 - Camera event triggers sent to clusters: 40453
14:19:31 - Calling method FSM.gotoReady in object FSM
14:19:33 - Event builder is in state CameraServerState.Observing and has output 40453 event(s) during run #2680.
14:19:33 - Event builder is in transition to state CameraServerState.Ready
14:19:36 - Stopping NMC
14:19:44 - Found 0 PPS errors.