15:30:19 - Switching ECC back to Safe state...
15:30:19 - Powering off modules...
15:30:19 - Executing command '/opt/cta/bin/cta_ctrl --all --power_off' on Digital Trigger Crate at 10.10.4.57
15:30:21 - Setting ECC mode to EccTransition.Safe
15:31:58 - ECC is in state EccState.Safe with status EccStatus.NoError
15:31:58 - Average temperature: 22.3 deg C
15:31:58 - Air temperature (T1-T6 and T9-T10): 22.3, 1255.0, 1254.0, 1254.0, 1254.0, 1254.0, 1254.0, 1253.0 deg C
15:31:58 - Air differential pressure: 0.0 Pa
15:31:58 - Water temperature (T11-T12): 1253.0, 1254.0 deg C
15:31:58 - Back doors are closed.
15:31:58 - Shutter is in state PartiallyOpen (error 0)
15:31:58 - Light sensors: [2.29, 2.76, 3.16, 3.48] V
15:31:58 - Humidity: 0.0 %. Water pressure: [0.0, 0.0] bar.
15:31:58 - Fan speeds: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0] rpm
15:31:58 - 24 V power supply no. 1 is disabled with a current of 6.120 A.
15:32:02 - Starting task "Prepare ECC"
15:32:02 - Preparing ECC...
15:32:02 - Setting ECC temperature range for Ready state to [16.000000, 36.000000]
15:32:02 - Setting ECC mode to EccTransition.Ready
15:32:03 - Received ECC state change notification: EccState.Safe
15:32:08 - Received ECC state change notification: EccState.Ready
15:32:09 - Setting power supply box SPE relay to True
15:32:09 - Finished task "Prepare ECC"
15:32:38 - No server with URI='urn:raspberrypi:UnifiedAutomation:UaServerCpp' has been discovered. The client could not discover a single server.
15:32:42 - Starting task "Powering modules..."
15:32:42 - Executing command '/opt/cta/bin/cta_ctrl --slot 1 --all --power_on' on Digital Trigger Crate at 10.10.4.57
15:32:48 - Executing command '/opt/cta/bin/cta_ctrl --slot 5 --all --power_on' on Digital Trigger Crate at 10.10.4.57
15:32:54 - Executing command '/opt/cta/bin/cta_ctrl --slot 6 --all --power_on' on Digital Trigger Crate at 10.10.4.57
15:33:00 - Executing command '/opt/cta/bin/cta_ctrl --slot 9 --all --power_on' on Digital Trigger Crate at 10.10.4.57
15:33:05 - Executing command '/opt/cta/bin/cta_ctrl --slot 13 --all --power_on' on Digital Trigger Crate at 10.10.4.57
15:33:11 - Executing command '/opt/cta/bin/cta_ctrl --slot 14 --all --power_on' on Digital Trigger Crate at 10.10.4.57
15:33:17 - Executing command '/opt/cta/bin/cta_ctrl --slot 15 --all --power_on' on Digital Trigger Crate at 10.10.4.57
15:33:23 - Executing command '/opt/cta/bin/cta_ctrl --slot 19 --all --power_on' on Digital Trigger Crate at 10.10.4.57
15:33:28 - Finished task "Powering modules..."
15:33:31 - ECC is in state EccState.Ready with status EccStatus.NoError
15:33:31 - Average temperature: 22.3 deg C
15:33:31 - Air temperature (T1-T6 and T9-T10): 22.3, 1255.0, 1254.0, 1254.0, 1254.0, 1254.0, -838.0, -838.0 deg C
15:33:31 - Air differential pressure: 0.0 Pa
15:33:31 - Water temperature (T11-T12): 1253.0, 1254.0 deg C
15:33:31 - Back doors are closed.
15:33:31 - Shutter is in state PartiallyOpen (error 0)
15:33:31 - Light sensors: [2.34, 2.81, 3.21, 3.51] V
15:33:31 - Humidity: 0.0 %. Water pressure: [0.0, 0.0] bar.
15:33:31 - Fan speeds: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0] rpm
15:33:31 - 24 V power supply no. 1 is enabled with a current of 40.900 A.
15:33:32 - ECC is in state EccState.Ready with status EccStatus.NoError
15:33:32 - Average temperature: 22.3 deg C
15:33:32 - Air temperature (T1-T6 and T9-T10): 22.3, -838.0, 1254.0, -838.0, 1254.0, -838.0, 1254.0, 1253.0 deg C
15:33:32 - Air differential pressure: 0.0 Pa
15:33:32 - Water temperature (T11-T12): -838.0, 1254.0 deg C
15:33:32 - Back doors are closed.
15:33:32 - Shutter is in state PartiallyOpen (error 0)
15:33:32 - Light sensors: [2.34, 2.81, 3.21, 3.51] V
15:33:32 - Humidity: 0.0 %. Water pressure: [0.0, 0.0] bar.
15:33:32 - Fan speeds: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0] rpm
15:33:32 - 24 V power supply no. 1 is enabled with a current of 40.900 A.
15:33:34 - ECC is in state EccState.Ready with status EccStatus.NoError
15:33:34 - Average temperature: 22.3 deg C
15:33:34 - Air temperature (T1-T6 and T9-T10): 22.3, 1255.0, 1254.0, 1254.0, 1254.0, -838.0, 1254.0, -838.0 deg C
15:33:34 - Air differential pressure: 0.0 Pa
15:33:34 - Water temperature (T11-T12): 1253.0, -838.0 deg C
15:33:34 - Back doors are closed.
15:33:34 - Shutter is in state PartiallyOpen (error 0)
15:33:34 - Light sensors: [2.37, 2.82, 3.22, 3.53] V
15:33:34 - Humidity: 0.0 %. Water pressure: [0.0, 0.0] bar.
15:33:34 - Fan speeds: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0] rpm
15:33:34 - 24 V power supply no. 1 is enabled with a current of 40.900 A.
15:33:35 - ECC is in state EccState.Ready with status EccStatus.NoError
15:33:35 - Average temperature: 22.3 deg C
15:33:35 - Air temperature (T1-T6 and T9-T10): 22.3, -838.0, 1254.0, 1254.0, -838.0, -838.0, 1254.0, -838.0 deg C
15:33:35 - Air differential pressure: 0.0 Pa
15:33:35 - Water temperature (T11-T12): 1253.0, 1254.0 deg C
15:33:35 - Back doors are closed.
15:33:35 - Shutter is in state PartiallyOpen (error 0)
15:33:35 - Light sensors: [2.37, 2.82, 3.22, 3.53] V
15:33:35 - Humidity: 0.0 %. Water pressure: [0.0, 0.0] bar.
15:33:35 - Fan speeds: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0] rpm
15:33:35 - 24 V power supply no. 1 is enabled with a current of 40.900 A.
15:33:36 - ECC is in state EccState.Ready with status EccStatus.NoError
15:33:36 - Average temperature: 22.3 deg C
15:33:36 - Air temperature (T1-T6 and T9-T10): 22.3, -838.0, 1254.0, -838.0, 1254.0, 1254.0, -838.0, 1253.0 deg C
15:33:36 - Air differential pressure: 0.0 Pa
15:33:36 - Water temperature (T11-T12): 1253.0, -838.0 deg C
15:33:36 - Back doors are closed.
15:33:36 - Shutter is in state PartiallyOpen (error 0)
15:33:36 - Light sensors: [2.36, 2.82, 3.22, 3.53] V
15:33:36 - Humidity: 0.0 %. Water pressure: [0.0, 0.0] bar.
15:33:36 - Fan speeds: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0] rpm
15:33:36 - 24 V power supply no. 1 is enabled with a current of 40.900 A.
15:33:37 - ECC is in state EccState.Ready with status EccStatus.NoError
15:33:37 - Average temperature: 22.3 deg C
15:33:37 - Air temperature (T1-T6 and T9-T10): 22.3, -838.0, 1254.0, -838.0, 1254.0, 1254.0, -838.0, 1253.0 deg C
15:33:37 - Air differential pressure: 0.0 Pa
15:33:37 - Water temperature (T11-T12): 1253.0, -838.0 deg C
15:33:37 - Back doors are closed.
15:33:37 - Shutter is in state PartiallyOpen (error 0)
15:33:37 - Light sensors: [2.36, 2.82, 3.22, 3.53] V
15:33:37 - Humidity: 0.0 %. Water pressure: [0.0, 0.0] bar.
15:33:37 - Fan speeds: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0] rpm
15:33:37 - 24 V power supply no. 1 is enabled with a current of 40.900 A.
15:33:38 - ECC is in state EccState.Ready with status EccStatus.NoError
15:33:38 - Average temperature: 22.3 deg C
15:33:38 - Air temperature (T1-T6 and T9-T10): 22.3, 1255.0, 1254.0, -838.0, 1254.0, 1254.0, -838.0, -838.0 deg C
15:33:38 - Air differential pressure: 0.0 Pa
15:33:38 - Water temperature (T11-T12): 1253.0, 1254.0 deg C
15:33:38 - Back doors are closed.
15:33:38 - Shutter is in state PartiallyOpen (error 0)
15:33:38 - Light sensors: [2.36, 2.82, 3.22, 3.53] V
15:33:38 - Humidity: 0.0 %. Water pressure: [0.0, 0.0] bar.
15:33:38 - Fan speeds: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0] rpm
15:33:38 - 24 V power supply no. 1 is enabled with a current of 40.900 A.
15:33:39 - ECC is in state EccState.Ready with status EccStatus.NoError
15:33:39 - Average temperature: 22.3 deg C
15:33:39 - Air temperature (T1-T6 and T9-T10): 22.3, 1255.0, 1254.0, -838.0, 1254.0, 1254.0, -838.0, -838.0 deg C
15:33:39 - Air differential pressure: 0.0 Pa
15:33:39 - Water temperature (T11-T12): 1253.0, 1254.0 deg C
15:33:39 - Back doors are closed.
15:33:39 - Shutter is in state PartiallyOpen (error 0)
15:33:39 - Light sensors: [2.37, 2.83, 3.23, 3.53] V
15:33:39 - Humidity: 0.0 %. Water pressure: [0.0, 0.0] bar.
15:33:39 - Fan speeds: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0] rpm
15:33:39 - 24 V power supply no. 1 is enabled with a current of 40.900 A.
15:33:40 - ECC is in state EccState.Ready with status EccStatus.NoError
15:33:40 - Average temperature: 22.3 deg C
15:33:40 - Air temperature (T1-T6 and T9-T10): 22.3, -838.0, 1254.0, -838.0, 1254.0, 1254.0, 1254.0, -838.0 deg C
15:33:40 - Air differential pressure: 0.0 Pa
15:33:40 - Water temperature (T11-T12): 1253.0, 1254.0 deg C
15:33:40 - Back doors are closed.
15:33:40 - Shutter is in state PartiallyOpen (error 0)
15:33:40 - Light sensors: [2.37, 2.83, 3.23, 3.53] V
15:33:40 - Humidity: 0.0 %. Water pressure: [0.0, 0.0] bar.
15:33:40 - Fan speeds: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0] rpm
15:33:40 - 24 V power supply no. 1 is enabled with a current of 40.900 A.
15:33:42 - ECC is in state EccState.Ready with status EccStatus.NoError
15:33:42 - Average temperature: 22.3 deg C
15:33:42 - Air temperature (T1-T6 and T9-T10): 22.3, -838.0, -838.0, 1254.0, -838.0, 1254.0, -838.0, 1253.0 deg C
15:33:42 - Air differential pressure: 0.0 Pa
15:33:42 - Water temperature (T11-T12): 1253.0, 1254.0 deg C
15:33:42 - Back doors are closed.
15:33:42 - Shutter is in state PartiallyOpen (error 0)
15:33:42 - Light sensors: [2.36, 2.82, 3.22, 3.53] V
15:33:42 - Humidity: 0.0 %. Water pressure: [0.0, 0.0] bar.
15:33:42 - Fan speeds: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0] rpm
15:33:42 - 24 V power supply no. 1 is enabled with a current of 40.900 A.
15:33:43 - ECC is in state EccState.Ready with status EccStatus.NoError
15:33:43 - Average temperature: 22.3 deg C
15:33:43 - Air temperature (T1-T6 and T9-T10): 22.3, 1255.0, 1254.0, 1254.0, 1254.0, 1254.0, 1254.0, 1253.0 deg C
15:33:43 - Air differential pressure: 0.0 Pa
15:33:43 - Water temperature (T11-T12): 1253.0, 1254.0 deg C
15:33:43 - Back doors are closed.
15:33:43 - Shutter is in state PartiallyOpen (error 0)
15:33:43 - Light sensors: [2.35, 2.82, 3.22, 3.52] V
15:33:43 - Humidity: 0.0 %. Water pressure: [0.0, 0.0] bar.
15:33:43 - Fan speeds: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0] rpm
15:33:43 - 24 V power supply no. 1 is enabled with a current of 40.900 A.
15:33:44 - ECC is in state EccState.Ready with status EccStatus.NoError
15:33:44 - Average temperature: 22.3 deg C
15:33:44 - Air temperature (T1-T6 and T9-T10): 22.3, -838.0, -838.0, -838.0, 1254.0, 1254.0, -838.0, 1253.0 deg C
15:33:44 - Air differential pressure: 0.0 Pa
15:33:44 - Water temperature (T11-T12): 1253.0, 1254.0 deg C
15:33:44 - Back doors are closed.
15:33:44 - Shutter is in state PartiallyOpen (error 0)
15:33:44 - Light sensors: [2.35, 2.82, 3.22, 3.52] V
15:33:44 - Humidity: 0.0 %. Water pressure: [0.0, 0.0] bar.
15:33:44 - Fan speeds: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0] rpm
15:33:44 - 24 V power supply no. 1 is enabled with a current of 40.900 A.
15:33:47 - Scanning interface p4p1 for non configured modules...
15:33:54 - Found 0 MAC address(es)
15:33:59 - ECC is in state EccState.Ready with status EccStatus.NoError
15:33:59 - Average temperature: 22.3 deg C
15:33:59 - Air temperature (T1-T6 and T9-T10): 22.3, 1255.0, 1254.0, 1254.0, -838.0, 1254.0, -838.0, 1253.0 deg C
15:33:59 - Air differential pressure: 0.0 Pa
15:33:59 - Water temperature (T11-T12): 1253.0, 1254.0 deg C
15:33:59 - Back doors are closed.
15:33:59 - Shutter is in state PartiallyOpen (error 0)
15:33:59 - Light sensors: [2.37, 2.83, 3.23, 3.53] V
15:33:59 - Humidity: 0.0 %. Water pressure: [0.0, 0.0] bar.
15:33:59 - Fan speeds: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0] rpm
15:33:59 - 24 V power supply no. 1 is enabled with a current of 44.900 A.
15:34:01 - ECC is in state EccState.Ready with status EccStatus.NoError
15:34:01 - Average temperature: 22.3 deg C
15:34:01 - Air temperature (T1-T6 and T9-T10): 22.3, -838.0, 1254.0, 1254.0, 1254.0, -838.0, -838.0, -838.0 deg C
15:34:01 - Air differential pressure: 0.0 Pa
15:34:01 - Water temperature (T11-T12): 1253.0, 1254.0 deg C
15:34:01 - Back doors are closed.
15:34:01 - Shutter is in state PartiallyOpen (error 0)
15:34:01 - Light sensors: [2.35, 2.82, 3.22, 3.53] V
15:34:01 - Humidity: 0.0 %. Water pressure: [0.0, 0.0] bar.
15:34:01 - Fan speeds: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0] rpm
15:34:01 - 24 V power supply no. 1 is enabled with a current of 44.900 A.
15:34:02 - ECC is in state EccState.Ready with status EccStatus.NoError
15:34:02 - Average temperature: 22.3 deg C
15:34:02 - Air temperature (T1-T6 and T9-T10): 22.3, 1255.0, -838.0, 1254.0, 1254.0, 1254.0, -838.0, 1253.0 deg C
15:34:02 - Air differential pressure: 0.0 Pa
15:34:02 - Water temperature (T11-T12): 1253.0, 1254.0 deg C
15:34:02 - Back doors are closed.
15:34:02 - Shutter is in state PartiallyOpen (error 0)
15:34:02 - Light sensors: [2.37, 2.83, 3.23, 3.53] V
15:34:02 - Humidity: 0.0 %. Water pressure: [0.0, 0.0] bar.
15:34:02 - Fan speeds: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0] rpm
15:34:02 - 24 V power supply no. 1 is enabled with a current of 44.900 A.
15:34:03 - ECC is in state EccState.Ready with status EccStatus.NoError
15:34:03 - Average temperature: 22.3 deg C
15:34:03 - Air temperature (T1-T6 and T9-T10): 22.3, 1255.0, -838.0, 1254.0, 1254.0, 1254.0, -838.0, 1253.0 deg C
15:34:03 - Air differential pressure: 0.0 Pa
15:34:03 - Water temperature (T11-T12): 1253.0, 1254.0 deg C
15:34:03 - Back doors are closed.
15:34:03 - Shutter is in state PartiallyOpen (error 0)
15:34:03 - Light sensors: [2.36, 2.82, 3.22, 3.52] V
15:34:03 - Humidity: 0.0 %. Water pressure: [0.0, 0.0] bar.
15:34:03 - Fan speeds: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0] rpm
15:34:03 - 24 V power supply no. 1 is enabled with a current of 44.900 A.
15:34:04 - ECC is in state EccState.Ready with status EccStatus.NoError
15:34:04 - Average temperature: 22.3 deg C
15:34:04 - Air temperature (T1-T6 and T9-T10): 22.3, -838.0, 1254.0, -838.0, 1254.0, -838.0, 1254.0, 1253.0 deg C
15:34:04 - Air differential pressure: 0.0 Pa
15:34:04 - Water temperature (T11-T12): 1253.0, 1254.0 deg C
15:34:04 - Back doors are closed.
15:34:04 - Shutter is in state PartiallyOpen (error 0)
15:34:04 - Light sensors: [2.36, 2.82, 3.22, 3.52] V
15:34:04 - Humidity: 0.0 %. Water pressure: [0.0, 0.0] bar.
15:34:04 - Fan speeds: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0] rpm
15:34:04 - 24 V power supply no. 1 is enabled with a current of 44.900 A.
15:34:08 - Scanning interface p4p1 for non configured modules...
15:34:08 - Found 34 MAC address(es)
15:34:09 - Scanning interface p4p1 for non configured modules...
15:34:09 - Found 18 MAC address(es)
15:34:10 - Scanning interface p4p1 for non configured modules...
15:34:10 - Found 24 MAC address(es)
15:34:11 - Scanning interface p4p1 for non configured modules...
15:34:11 - Found 16 MAC address(es)
15:34:12 - Scanning interface p4p1 for non configured modules...
15:34:12 - Found 21 MAC address(es)
15:34:12 - Scanning interface p4p1 for non configured modules...
15:34:13 - Found 61 MAC address(es)
15:34:16 - ECC is in state EccState.Ready with status EccStatus.NoError
15:34:16 - Average temperature: 22.3 deg C
15:34:16 - Air temperature (T1-T6 and T9-T10): 22.3, 1255.0, 1254.0, -838.0, -838.0, 1254.0, -838.0, 1253.0 deg C
15:34:16 - Air differential pressure: 0.0 Pa
15:34:16 - Water temperature (T11-T12): -838.0, 1254.0 deg C
15:34:16 - Back doors are closed.
15:34:16 - Shutter is in state PartiallyOpen (error 0)
15:34:16 - Light sensors: [2.37, 2.84, 3.23, 3.54] V
15:34:16 - Humidity: 0.0 %. Water pressure: [0.0, 0.0] bar.
15:34:16 - Fan speeds: [0.0, 0.0, 0.0, 0.0, 0.0, 0.0] rpm
15:34:16 - 24 V power supply no. 1 is enabled with a current of 44.900 A.
15:34:21 - Starting task "Configure modules"
15:34:21 - Configuring modules with configuration /local/home/cta_test_bench/config/2020/20200610/config_tower_53modules.NMC.xml
15:34:21 - Switching off high voltages in configuration
15:34:25 - Successfully configured 53 module(s)
15:34:26 - All front-end boards are programmed with firmware F55D2001
15:34:28 - All backplanes are programmed with firmware 15
15:34:32 - Stopping flashes...
15:34:33 - NMC is in state NmcState.Configured and knows of 53 drawer(s)
15:34:33 - Found 0 PPS errors.
15:34:34 - Finished task "Configure modules"
15:34:40 - Starting task "Switch HVPA voltage state"
15:34:40 - Setting HVPA current limit to 12489.75 uA
15:34:46 - High voltage locked channels will be checked every 30 s
15:34:52 - Calling method FSM.gotoObserving in object FSM
15:34:58 - Setting HVPA ramp speed to 25 V/s
15:35:00 - Switching HVPA to state Nominal
15:35:09 - Setting HVPA current limits...
15:35:15 - Checking for high voltage locked pixels...
15:35:31 - Finished task "Switch HVPA voltage state"
15:35:34 - Starting task "Set L0 trigger thresholds"
15:35:34 - Setting L0 thresholds to 15.0 p.e. using /local/home/cta_test_bench/data/2019/20191203/l0_threshold_slope_and_offset_feb.h5
15:35:45 - Checking for high voltage locked pixels...
15:35:52 - Setting L0 thresholds to 15.0 p.e. per pixel using L0 slopes and offsets in /local/home/cta_test_bench/data/2019/20191203/l0_threshold_slope_and_offset_feb.h5
15:35:53 - Thresholds saved in configuration file /local/home/cta_test_bench/config/2020/20200625/config_2020-06-25_15-35-52.NMC.xml
15:35:53 - Finished task "Set L0 trigger thresholds"
15:36:04 - Starting task "Check high voltages"
15:36:05 - Found 53 drawer(s) in Nominal state, 0 in Low state and 0 in Wait state
15:36:08 - Starting NMC
15:36:08 - Clearing PPS error counters
15:36:13 - Actual voltage is between 945.50 V and 1167.54 V.
15:36:14 - Low voltages range between 300.00 V and 300.00 V. 
15:36:15 - Checking for high voltage locked pixels...
15:36:23 - Reference voltages range between 945.26 V and 1167.15 V. 
15:36:32 - Maximum difference between expected and actual voltages is 1.02 V
15:36:34 - Starting task "Power off channels not corresponding to a configured module"
15:36:34 - Powering off all but 53 DTC channel(s)
15:36:34 - Executing command '/opt/cta/bin/cta_ctrl --slot 1 --channel 4 --power_off' on Digital Trigger Crate at 10.10.4.57
15:36:36 - Executing command '/opt/cta/bin/cta_ctrl --slot 1 --channel 11 --power_off' on Digital Trigger Crate at 10.10.4.57
15:36:37 - Maximum of current limits is 5647.07 uA
15:36:37 - Checking status of HVPA module in 53 drawer(s)...
15:36:37 - Checking status of HVPA channels in 53 drawer(s)...
15:36:38 - Executing command '/opt/cta/bin/cta_ctrl --slot 5 --channel 3 --power_off' on Digital Trigger Crate at 10.10.4.57
15:36:39 - Executing command '/opt/cta/bin/cta_ctrl --slot 5 --channel 6 --power_off' on Digital Trigger Crate at 10.10.4.57
15:36:41 - Executing command '/opt/cta/bin/cta_ctrl --slot 5 --channel 9 --power_off' on Digital Trigger Crate at 10.10.4.57
15:36:41 - HV is stabilized in all channels.
15:36:41 - Checking reference and low voltages against /local/home/cta_test_bench/config/2020/20200610/config_tower_53modules.NMC.xml
15:36:43 - Executing command '/opt/cta/bin/cta_ctrl --slot 6 --channel 1 --power_off' on Digital Trigger Crate at 10.10.4.57
15:36:45 - Executing command '/opt/cta/bin/cta_ctrl --slot 6 --channel 2 --power_off' on Digital Trigger Crate at 10.10.4.57
15:36:45 - Checking for high voltage locked pixels...
15:36:46 - Executing command '/opt/cta/bin/cta_ctrl --slot 6 --channel 4 --power_off' on Digital Trigger Crate at 10.10.4.57
15:36:47 - Done
15:36:47 - Finished task "Check high voltages"
15:36:48 - Executing command '/opt/cta/bin/cta_ctrl --slot 6 --channel 6 --power_off' on Digital Trigger Crate at 10.10.4.57
15:36:50 - Executing command '/opt/cta/bin/cta_ctrl --slot 6 --channel 7 --power_off' on Digital Trigger Crate at 10.10.4.57
15:36:52 - Executing command '/opt/cta/bin/cta_ctrl --slot 6 --channel 8 --power_off' on Digital Trigger Crate at 10.10.4.57
15:36:53 - Executing command '/opt/cta/bin/cta_ctrl --slot 6 --channel 9 --power_off' on Digital Trigger Crate at 10.10.4.57
15:36:55 - Executing command '/opt/cta/bin/cta_ctrl --slot 6 --channel 10 --power_off' on Digital Trigger Crate at 10.10.4.57
15:36:57 - Executing command '/opt/cta/bin/cta_ctrl --slot 6 --channel 11 --power_off' on Digital Trigger Crate at 10.10.4.57
15:36:59 - Executing command '/opt/cta/bin/cta_ctrl --slot 6 --channel 12 --power_off' on Digital Trigger Crate at 10.10.4.57
15:37:00 - Executing command '/opt/cta/bin/cta_ctrl --slot 6 --channel 13 --power_off' on Digital Trigger Crate at 10.10.4.57
15:37:02 - Executing command '/opt/cta/bin/cta_ctrl --slot 6 --channel 14 --power_off' on Digital Trigger Crate at 10.10.4.57
15:37:04 - Configuring calibration box...
15:37:04 - Configuring calibration box with leds=0x40 voltage=9.00 frequency=999.0/3 central_current=0.0 duration=0 width=1 lemo_out=False fiber1_out=False fiber2_out=False lemo_in=False enabled=False
15:37:04 - Executing command '/opt/cta/bin/cta_ctrl --slot 6 --channel 15 --power_off' on Digital Trigger Crate at 10.10.4.57
15:37:06 - Executing command '/opt/cta/bin/cta_ctrl --slot 9 --channel 1 --power_off' on Digital Trigger Crate at 10.10.4.57
15:37:08 - Executing command '/opt/cta/bin/cta_ctrl --slot 9 --channel 2 --power_off' on Digital Trigger Crate at 10.10.4.57
15:37:09 - Executing command '/opt/cta/bin/cta_ctrl --slot 9 --channel 3 --power_off' on Digital Trigger Crate at 10.10.4.57
15:37:11 - Executing command '/opt/cta/bin/cta_ctrl --slot 9 --channel 4 --power_off' on Digital Trigger Crate at 10.10.4.57
15:37:13 - Executing command '/opt/cta/bin/cta_ctrl --slot 9 --channel 5 --power_off' on Digital Trigger Crate at 10.10.4.57
15:37:14 - Executing command '/opt/cta/bin/cta_ctrl --slot 9 --channel 6 --power_off' on Digital Trigger Crate at 10.10.4.57
15:37:15 - Checking for high voltage locked pixels...
15:37:16 - Executing command '/opt/cta/bin/cta_ctrl --slot 9 --channel 7 --power_off' on Digital Trigger Crate at 10.10.4.57
15:37:18 - Executing command '/opt/cta/bin/cta_ctrl --slot 9 --channel 8 --power_off' on Digital Trigger Crate at 10.10.4.57
15:37:20 - Executing command '/opt/cta/bin/cta_ctrl --slot 9 --channel 9 --power_off' on Digital Trigger Crate at 10.10.4.57
15:37:22 - Executing command '/opt/cta/bin/cta_ctrl --slot 9 --channel 10 --power_off' on Digital Trigger Crate at 10.10.4.57
15:37:23 - Executing command '/opt/cta/bin/cta_ctrl --slot 9 --channel 11 --power_off' on Digital Trigger Crate at 10.10.4.57
15:37:25 - Executing command '/opt/cta/bin/cta_ctrl --slot 9 --channel 12 --power_off' on Digital Trigger Crate at 10.10.4.57
15:37:27 - Executing command '/opt/cta/bin/cta_ctrl --slot 9 --channel 13 --power_off' on Digital Trigger Crate at 10.10.4.57
15:37:29 - Executing command '/opt/cta/bin/cta_ctrl --slot 9 --channel 14 --power_off' on Digital Trigger Crate at 10.10.4.57
15:37:30 - Executing command '/opt/cta/bin/cta_ctrl --slot 9 --channel 15 --power_off' on Digital Trigger Crate at 10.10.4.57
15:37:32 - Executing command '/opt/cta/bin/cta_ctrl --slot 13 --channel 1 --power_off' on Digital Trigger Crate at 10.10.4.57
15:37:33 - Starting flashes...
15:37:34 - Executing command '/opt/cta/bin/cta_ctrl --slot 13 --channel 2 --power_off' on Digital Trigger Crate at 10.10.4.57
15:37:35 - Executing command '/opt/cta/bin/cta_ctrl --slot 13 --channel 13 --power_off' on Digital Trigger Crate at 10.10.4.57
15:37:37 - Executing command '/opt/cta/bin/cta_ctrl --slot 14 --channel 1 --power_off' on Digital Trigger Crate at 10.10.4.57
15:37:39 - Executing command '/opt/cta/bin/cta_ctrl --slot 14 --channel 2 --power_off' on Digital Trigger Crate at 10.10.4.57
15:37:41 - Executing command '/opt/cta/bin/cta_ctrl --slot 14 --channel 3 --power_off' on Digital Trigger Crate at 10.10.4.57
15:37:42 - Executing command '/opt/cta/bin/cta_ctrl --slot 14 --channel 5 --power_off' on Digital Trigger Crate at 10.10.4.57
15:37:44 - Executing command '/opt/cta/bin/cta_ctrl --slot 14 --channel 8 --power_off' on Digital Trigger Crate at 10.10.4.57
15:37:45 - Checking for high voltage locked pixels...
15:37:46 - Executing command '/opt/cta/bin/cta_ctrl --slot 14 --channel 9 --power_off' on Digital Trigger Crate at 10.10.4.57
15:37:48 - Executing command '/opt/cta/bin/cta_ctrl --slot 14 --channel 10 --power_off' on Digital Trigger Crate at 10.10.4.57
15:37:49 - Executing command '/opt/cta/bin/cta_ctrl --slot 14 --channel 11 --power_off' on Digital Trigger Crate at 10.10.4.57
15:37:51 - Executing command '/opt/cta/bin/cta_ctrl --slot 14 --channel 12 --power_off' on Digital Trigger Crate at 10.10.4.57
15:37:53 - Executing command '/opt/cta/bin/cta_ctrl --slot 14 --channel 13 --power_off' on Digital Trigger Crate at 10.10.4.57
15:37:55 - Executing command '/opt/cta/bin/cta_ctrl --slot 14 --channel 14 --power_off' on Digital Trigger Crate at 10.10.4.57
15:37:56 - Executing command '/opt/cta/bin/cta_ctrl --slot 14 --channel 15 --power_off' on Digital Trigger Crate at 10.10.4.57
15:37:58 - Executing command '/opt/cta/bin/cta_ctrl --slot 15 --channel 1 --power_off' on Digital Trigger Crate at 10.10.4.57
15:38:00 - Executing command '/opt/cta/bin/cta_ctrl --slot 15 --channel 2 --power_off' on Digital Trigger Crate at 10.10.4.57
15:38:02 - Executing command '/opt/cta/bin/cta_ctrl --slot 15 --channel 3 --power_off' on Digital Trigger Crate at 10.10.4.57
15:38:04 - Executing command '/opt/cta/bin/cta_ctrl --slot 15 --channel 4 --power_off' on Digital Trigger Crate at 10.10.4.57
15:38:05 - Executing command '/opt/cta/bin/cta_ctrl --slot 15 --channel 5 --power_off' on Digital Trigger Crate at 10.10.4.57
15:38:07 - Executing command '/opt/cta/bin/cta_ctrl --slot 15 --channel 6 --power_off' on Digital Trigger Crate at 10.10.4.57
15:38:09 - Executing command '/opt/cta/bin/cta_ctrl --slot 15 --channel 7 --power_off' on Digital Trigger Crate at 10.10.4.57
15:38:11 - Executing command '/opt/cta/bin/cta_ctrl --slot 15 --channel 8 --power_off' on Digital Trigger Crate at 10.10.4.57
15:38:12 - Executing command '/opt/cta/bin/cta_ctrl --slot 15 --channel 11 --power_off' on Digital Trigger Crate at 10.10.4.57
15:38:14 - Executing command '/opt/cta/bin/cta_ctrl --slot 15 --channel 12 --power_off' on Digital Trigger Crate at 10.10.4.57
15:38:15 - Checking for high voltage locked pixels...
15:38:16 - Executing command '/opt/cta/bin/cta_ctrl --slot 15 --channel 13 --power_off' on Digital Trigger Crate at 10.10.4.57
15:38:18 - Executing command '/opt/cta/bin/cta_ctrl --slot 15 --channel 14 --power_off' on Digital Trigger Crate at 10.10.4.57
15:38:19 - Executing command '/opt/cta/bin/cta_ctrl --slot 15 --channel 15 --power_off' on Digital Trigger Crate at 10.10.4.57
15:38:21 - Executing command '/opt/cta/bin/cta_ctrl --slot 19 --channel 3 --power_off' on Digital Trigger Crate at 10.10.4.57
15:38:23 - Executing command '/opt/cta/bin/cta_ctrl --slot 19 --channel 4 --power_off' on Digital Trigger Crate at 10.10.4.57
15:38:25 - Executing command '/opt/cta/bin/cta_ctrl --slot 19 --channel 5 --power_off' on Digital Trigger Crate at 10.10.4.57
15:38:26 - Executing command '/opt/cta/bin/cta_ctrl --slot 19 --channel 6 --power_off' on Digital Trigger Crate at 10.10.4.57
15:38:28 - Executing command '/opt/cta/bin/cta_ctrl --slot 19 --channel 11 --power_off' on Digital Trigger Crate at 10.10.4.57
15:38:30 - Executing command '/opt/cta/bin/cta_ctrl --slot 19 --channel 14 --power_off' on Digital Trigger Crate at 10.10.4.57
15:38:32 - Finished task "Power off channels not corresponding to a configured module"
15:38:45 - Checking for high voltage locked pixels...
15:39:15 - Starting task "Set DTC trigger masks"
15:39:15 - Configuring DTC trigger masks for 53 configured module(s)
15:39:15 - Setting DTC slot 1 trigger mask to 0xf7ee
15:39:15 - Checking for high voltage locked pixels...
15:39:19 - Setting DTC slot 5 trigger mask to 0xfdb6
15:39:22 - Setting DTC slot 6 trigger mask to 0x0028
15:39:26 - Setting DTC slot 9 trigger mask to 0x0000
15:39:29 - Setting DTC slot 13 trigger mask to 0xdff8
15:39:33 - Setting DTC slot 14 trigger mask to 0x00d0
15:39:36 - Setting DTC slot 15 trigger mask to 0x0600
15:39:40 - Setting DTC slot 19 trigger mask to 0xb786
15:39:43 - Finished task "Set DTC trigger masks"
15:39:45 - Checking for high voltage locked pixels...
15:39:59 - Checking UCTS clock...
15:39:59 - UCTS and control PC clocks differ by 1.965468 seconds
15:39:59 - Configuring UCTS
15:40:00 - Configuring TIB...
15:40:00 - Setting TIB forced mode to False
15:40:00 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v
15:40:00 - Status: TibState.RunStopped
15:40:00 - Alarms: AlarmVector.NoAlarm
15:40:00 - Connection status: False TXclient_alive: False
15:40:00 - Disabling PPS
15:40:02 - Status: TibState.PpsStopped
15:40:02 - Alarms: AlarmVector.NoAlarm
15:40:02 - Connection status: False TXclient_alive: False
15:40:02 - Entering set_external_delay
15:40:02 - Setting ExternalDelayLocal to 0.000 ns
15:40:02 - Writing 0.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v
15:40:02 - Entering set_external_delay
15:40:02 - Setting ExternalDelayCalibration to 65.000 ns
15:40:02 - Writing 65.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v
15:40:02 - Entering set_external_delay
15:40:02 - Setting ExternalDelaySphe to 150.000 ns
15:40:02 - Writing 150.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v
15:40:02 - Setting TIB trigger mode to 0x71 = TriggerMask.SlowControl|Pedestal|Software|Mono
15:40:02 - Writing 113 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v
15:40:02 - Writing 1 to Camera.TIB.InputsEnable.InputMask.InputMask_v
15:40:02 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v
15:40:02 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v
15:40:02 - Writing False to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v
15:40:02 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v
15:40:02 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v
15:40:02 - Status: TibState.PpsStopped
15:40:02 - Alarms: AlarmVector.NoAlarm
15:40:02 - Connection status: False TXclient_alive: False
15:40:02 - Writing True to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v
15:40:02 - Writing 100 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v
15:40:02 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
15:40:02 - Writing False to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v
15:40:02 - Writing 100 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v
15:40:02 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v
15:40:02 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
15:40:02 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v
15:40:02 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v
15:40:02 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
15:40:08 - Connecting TIB to camera server at 10.10.4.12:222
15:40:08 - Starting TIB...
15:40:08 - Status: TibState.PpsStopped
15:40:08 - Alarms: AlarmVector.NoAlarm
15:40:08 - Connection status: False TXclient_alive: False
15:40:08 - Resetting run
15:40:08 - Wait for UCTS external trigger before enabling trigger...
15:40:08 - Status: TibState.Standby
15:40:08 - Alarms: AlarmVector.NoAlarm
15:40:08 - Connection status: False TXclient_alive: True
15:40:08 - Status: TibState.Standby
15:40:08 - Alarms: AlarmVector.NoAlarm
15:40:08 - Connection status: False TXclient_alive: True
15:40:09 - Status: TibState.Armed
15:40:09 - Alarms: AlarmVector.NoAlarm
15:40:09 - Connection status: True TXclient_alive: True
15:40:11 - Starting TIB triggers...
15:40:11 - Enabling trigger
15:40:11 - Status: TibState.Running
15:40:11 - Alarms: AlarmVector.NoAlarm
15:40:11 - Connection status: True TXclient_alive: True
15:40:16 - Status: TibState.Running ConnectionStatus: True TXclient_alive: True
15:40:16 - Alarms: AlarmVector.ReadError
15:40:16 - Temperature: 36.38
15:40:16 - Local camera rate: 333.0 Hz
15:40:16 - Stereo trigger rate: 0.0 Hz
15:40:16 - SPE trigger rate: 0.0 Hz
15:40:16 - Calibration trigger rate: 0.0 Hz
15:40:16 - Software trigger rate: 0.0 Hz
15:40:16 - Pedestal trigger rate: 100.0 Hz
15:40:16 - Collected trigger rate: 433.0 Hz
15:40:16 - Busy rate: 1.0 Hz
15:40:16 - Camera trigger rate: 432.0 Hz
15:40:16 - Checking for high voltage locked pixels...
15:40:34 - Stopping TIB...
15:40:34 - Status: TibState.Running
15:40:34 - Alarms: AlarmVector.ReadError
15:40:34 - Connection status: True TXclient_alive: True
15:40:35 - Disabling trigger
15:40:35 - Disabling PPS
15:40:36 - Status: TibState.PpsStopped
15:40:36 - Alarms: AlarmVector.ReadError
15:40:36 - Connection status: True TXclient_alive: True
15:40:36 - Closing TIB connection to camera server
15:40:37 - Status: TibState.PpsStopped
15:40:37 - Alarms: AlarmVector.ReadError
15:40:37 - Connection status: False TXclient_alive: False
15:40:37 - Run duration: 0:00:25
15:40:37 - Local camera triggers: 8181
15:40:37 - Slow control triggers: 0
15:40:37 - Single photo-electron triggers: 0
15:40:37 - Calibration triggers: 0
15:40:37 - Software triggers from UCTS: 0
15:40:37 - Pedestal triggers: 2455
15:40:37 - Collected input triggers: 10074
15:40:37 - Busy triggers: 12
15:40:37 - Camera event triggers sent to clusters: 10062
15:40:40 - Calling method FSM.gotoReady in object FSM
15:40:43 - Stopping NMC
15:40:43 - Found 0 PPS errors.
15:40:45 - Checking for high voltage locked pixels...