09:30:09 - Starting task "Check high voltages"
09:30:14 - Found 265 drawer(s) in Nominal state, 0 in Low state and 0 in Wait state
09:31:03 - Actual voltage is between 0.00 V and 1133.99 V.
09:31:08 - Low voltages range between 100.00 V and 100.00 V. 
09:32:15 - Reference voltages range between 918.00 V and 1134.00 V. 
09:33:09 - Maximum difference between expected and actual voltages is 1008.00 V
09:33:43 - Maximum of current limits is 6290.01 uA
09:33:43 - Checking status of HVPA module in 265 drawer(s)...
09:33:46 - HVPA module in drawer 9 has a status of 0x5f!
09:33:46 - HVPA module in drawer 91 has a status of 0x3f!
09:33:47 - Module 9 has 1 pixel(s) locked (HVPA status of 0x5f)!
09:33:48 - Module 91 has 1 pixel(s) locked (HVPA status of 0x3f)!
09:34:01 - HVPA channel 2 of drawer 231 has status 0x0007!
09:34:01 - HVPA channel 2 in module 231 is in rise default!
09:34:11 - HVPA channel 5 of drawer 9 has status 0x8003!
09:34:11 - HVPA channel 5 in module 9 is locked!
09:34:14 - HVPA channel 6 of drawer 91 has status 0x8003!
09:34:14 - HVPA channel 6 in module 91 is locked!
09:34:14 - HV is locked in 2 channel(s), was in rise default in 1 channel(s) and was still in progress in 1 channel(s)
09:34:14 - Unlocking 3 channel(s)...
09:34:17 - Checking reference and low voltages against /data/config/2021/20210917/config_cameraqm_265febs_newnewDACL_HamamatsuHV_newL1A_triggerMasks.NMC.xml
09:34:56 - Done
09:34:56 - Finished task "Check high voltages"
09:35:54 - Updating voltage widget...
09:36:25 - High voltage locked channels will be checked every 60 s
09:37:25 - Checking for high voltage locked pixels...
09:37:39 - HVPA channel 2 of drawer 231 has status 0x0007!
09:37:39 - HVPA channel 2 in module 231 is in rise default!
09:37:52 - HV is locked in 0 channel(s), was in rise default in 1 channel(s) and was still in progress in 1 channel(s)
09:37:52 - Unlocking 1 channel(s)...
09:38:12 - Stopped periodic check of locked high voltages
09:38:15 - Updating voltage widget...
09:38:26 - Could not update voltage widget: Could not invoke the Read service: BadTimeout
09:38:32 - Updating voltage widget...
09:43:39 - Starting task "Switch HVPA voltage state"
09:43:39 - Setting HVPA current limit to 12489.75 uA
09:43:39 - Setting Hvpa.Hvpa0.CurrentTrip in all drawers
09:43:49 - Setting Hvpa.Hvpa1.CurrentTrip in all drawers
09:43:58 - Setting Hvpa.Hvpa2.CurrentTrip in all drawers
09:44:08 - Setting Hvpa.Hvpa3.CurrentTrip in all drawers
09:44:18 - Setting Hvpa.Hvpa4.CurrentTrip in all drawers
09:44:28 - Setting Hvpa.Hvpa5.CurrentTrip in all drawers
09:44:38 - Setting Hvpa.Hvpa6.CurrentTrip in all drawers
09:44:48 - Setting HVPA ramp speed to 500 V/s
09:44:59 - Switching HVPA to state Wait
09:45:18 - Setting HVPA current limits...
09:46:39 - Finished task "Switch HVPA voltage state"
09:47:32 - Updating voltage widget...
09:48:21 - Resetting NMC
09:48:22 - Could not invoke the MethodCall service: BadDisconnect
09:48:25 - NMC is in state NmcState.Ready and knows of 0 drawer(s)
09:48:30 - Starting task "Powering modules..."
09:48:30 - Disabling power in all modules
09:48:30 - Finished task "Powering modules..."
09:48:33 - Updating DTC module currents...
09:48:35 - Module 0 connected to channel 8 of slot 21 has a CTDB current of 4.1 mA
09:48:35 - Module 1 connected to channel 9 of slot 21 has a CTDB current of 12.4 mA
09:48:35 - Module 2 connected to channel 10 of slot 21 has a CTDB current of 20.1 mA
09:48:35 - Module 3 connected to channel 11 of slot 21 has a CTDB current of 24.2 mA
09:48:35 - Module 4 connected to channel 12 of slot 21 has a CTDB current of 8.0 mA
09:48:35 - Module 5 connected to channel 13 of slot 21 has a CTDB current of 15.8 mA
09:48:35 - Module 6 connected to channel 14 of slot 21 has a CTDB current of 1.5 mA
09:48:35 - Module 7 connected to channel 15 of slot 21 has a CTDB current of 25.2 mA
09:48:35 - Module 8 connected to channel 7 of slot 20 has a CTDB current of 6.1 mA
09:48:35 - Module 9 connected to channel 8 of slot 20 has a CTDB current of 27.9 mA
09:48:35 - Module 10 connected to channel 9 of slot 20 has a CTDB current of 12.1 mA
09:48:35 - Module 11 connected to channel 10 of slot 20 has a CTDB current of 13.3 mA
09:48:35 - Module 12 connected to channel 11 of slot 20 has a CTDB current of 3.9 mA
09:48:35 - Module 13 connected to channel 12 of slot 20 has a CTDB current of 8.7 mA
09:48:35 - Module 14 connected to channel 13 of slot 20 has a CTDB current of 3.4 mA
09:48:35 - Module 15 connected to channel 14 of slot 20 has a CTDB current of 10.4 mA
09:48:35 - Module 16 connected to channel 15 of slot 20 has a CTDB current of 1.5 mA
09:48:35 - Module 17 connected to channel 1 of slot 21 has a CTDB current of 13.6 mA
09:48:35 - Module 18 connected to channel 2 of slot 21 has a CTDB current of 5.3 mA
09:48:35 - Module 19 connected to channel 10 of slot 19 has a CTDB current of 7.8 mA
09:48:35 - Module 20 connected to channel 11 of slot 19 has a CTDB current of 15.5 mA
09:48:35 - Module 21 connected to channel 12 of slot 19 has a CTDB current of 3.4 mA
09:48:35 - Module 22 connected to channel 13 of slot 19 has a CTDB current of 4.6 mA
09:48:35 - Module 23 connected to channel 14 of slot 19 has a CTDB current of 3.6 mA
09:48:35 - Module 24 connected to channel 15 of slot 19 has a CTDB current of 25.5 mA
09:48:35 - Module 25 connected to channel 1 of slot 20 has a CTDB current of 17.0 mA
09:48:35 - Module 26 connected to channel 2 of slot 20 has a CTDB current of 7.8 mA
09:48:35 - Module 27 connected to channel 3 of slot 20 has a CTDB current of 4.8 mA
09:48:35 - Module 28 connected to channel 4 of slot 20 has a CTDB current of 13.6 mA
09:48:35 - Module 29 connected to channel 5 of slot 20 has a CTDB current of 15.8 mA
09:48:35 - Module 30 connected to channel 6 of slot 20 has a CTDB current of 25.5 mA
09:48:35 - Module 31 connected to channel 12 of slot 18 has a CTDB current of 9.5 mA
09:48:35 - Module 32 connected to channel 13 of slot 18 has a CTDB current of 11.9 mA
09:48:35 - Module 33 connected to channel 14 of slot 18 has a CTDB current of 35.4 mA
09:48:35 - Module 34 connected to channel 15 of slot 18 has a CTDB current of 4.8 mA
09:48:35 - Module 35 connected to channel 1 of slot 19 has a CTDB current of 15.0 mA
09:48:35 - Module 36 connected to channel 2 of slot 19 has a CTDB current of 3.4 mA
09:48:35 - Module 37 connected to channel 3 of slot 19 has a CTDB current of 11.2 mA
09:48:35 - Module 38 connected to channel 4 of slot 19 has a CTDB current of 8.7 mA
09:48:35 - Module 39 connected to channel 5 of slot 19 has a CTDB current of 7.0 mA
09:48:35 - Module 40 connected to channel 6 of slot 19 has a CTDB current of 8.7 mA
09:48:35 - Module 41 connected to channel 7 of slot 19 has a CTDB current of 11.9 mA
09:48:35 - Module 42 connected to channel 8 of slot 19 has a CTDB current of 4.6 mA
09:48:35 - Module 43 connected to channel 9 of slot 19 has a CTDB current of 1.5 mA
09:48:35 - Module 44 connected to channel 13 of slot 17 has a CTDB current of 2.9 mA
09:48:35 - Module 45 connected to channel 14 of slot 17 has a CTDB current of 4.8 mA
09:48:35 - Module 46 connected to channel 15 of slot 17 has a CTDB current of 7.0 mA
09:48:35 - Module 47 connected to channel 1 of slot 18 has a CTDB current of 24.2 mA
09:48:35 - Module 48 connected to channel 2 of slot 18 has a CTDB current of 0.5 mA
09:48:35 - Module 49 connected to channel 3 of slot 18 has a CTDB current of 17.0 mA
09:48:35 - Module 50 connected to channel 4 of slot 18 has a CTDB current of 1.5 mA
09:48:35 - Module 51 connected to channel 5 of slot 18 has a CTDB current of 26.2 mA
09:48:35 - Module 52 connected to channel 6 of slot 18 has a CTDB current of 19.4 mA
09:48:35 - Module 53 connected to channel 7 of slot 18 has a CTDB current of 14.1 mA
09:48:35 - Module 54 connected to channel 8 of slot 18 has a CTDB current of 18.7 mA
09:48:35 - Module 55 connected to channel 9 of slot 18 has a CTDB current of 6.5 mA
09:48:35 - Module 56 connected to channel 10 of slot 18 has a CTDB current of 7.3 mA
09:48:35 - Module 57 connected to channel 11 of slot 18 has a CTDB current of 17.9 mA
09:48:35 - Module 58 connected to channel 13 of slot 16 has a CTDB current of 17.5 mA
09:48:35 - Module 59 connected to channel 14 of slot 16 has a CTDB current of 13.3 mA
09:48:35 - Module 60 connected to channel 15 of slot 16 has a CTDB current of 33.5 mA
09:48:35 - Module 61 connected to channel 1 of slot 17 has a CTDB current of 14.5 mA
09:48:35 - Module 62 connected to channel 2 of slot 17 has a CTDB current of 9.0 mA
09:48:35 - Module 63 connected to channel 3 of slot 17 has a CTDB current of 18.4 mA
09:48:35 - Module 64 connected to channel 4 of slot 17 has a CTDB current of 3.9 mA
09:48:35 - Module 65 connected to channel 5 of slot 17 has a CTDB current of 9.7 mA
09:48:35 - Module 66 connected to channel 6 of slot 17 has a CTDB current of 24.2 mA
09:48:35 - Module 67 connected to channel 7 of slot 17 has a CTDB current of 3.9 mA
09:48:35 - Module 68 connected to channel 8 of slot 17 has a CTDB current of 1.9 mA
09:48:35 - Module 69 connected to channel 9 of slot 17 has a CTDB current of 28.9 mA
09:48:35 - Module 70 connected to channel 10 of slot 17 has a CTDB current of 21.6 mA
09:48:35 - Module 71 connected to channel 11 of slot 17 has a CTDB current of 7.5 mA
09:48:35 - Module 72 connected to channel 12 of slot 17 has a CTDB current of 11.9 mA
09:48:35 - Module 73 connected to channel 12 of slot 15 has a CTDB current of 3.4 mA
09:48:35 - Module 74 connected to channel 13 of slot 15 has a CTDB current of 21.1 mA
09:48:35 - Module 75 connected to channel 14 of slot 15 has a CTDB current of 3.4 mA
09:48:35 - Module 76 connected to channel 15 of slot 15 has a CTDB current of 36.9 mA
09:48:35 - Module 77 connected to channel 1 of slot 16 has a CTDB current of 5.6 mA
09:48:35 - Module 78 connected to channel 2 of slot 16 has a CTDB current of 6.3 mA
09:48:35 - Module 79 connected to channel 3 of slot 16 has a CTDB current of 0.7 mA
09:48:35 - Module 80 connected to channel 4 of slot 16 has a CTDB current of 4.8 mA
09:48:35 - Module 81 connected to channel 5 of slot 16 has a CTDB current of 23.8 mA
09:48:35 - Module 82 connected to channel 6 of slot 16 has a CTDB current of 2.4 mA
09:48:35 - Module 83 connected to channel 7 of slot 16 has a CTDB current of 9.7 mA
09:48:35 - Module 84 connected to channel 8 of slot 16 has a CTDB current of 2.4 mA
09:48:35 - Module 85 connected to channel 9 of slot 16 has a CTDB current of 24.2 mA
09:48:35 - Module 86 connected to channel 10 of slot 16 has a CTDB current of 16.2 mA
09:48:35 - Module 87 connected to channel 11 of slot 16 has a CTDB current of 10.7 mA
09:48:35 - Module 88 connected to channel 12 of slot 16 has a CTDB current of 29.6 mA
09:48:35 - Module 89 connected to channel 10 of slot 14 has a CTDB current of 33.7 mA
09:48:35 - Module 90 connected to channel 11 of slot 14 has a CTDB current of 2.4 mA
09:48:35 - Module 91 connected to channel 12 of slot 14 has a CTDB current of 10.9 mA
09:48:35 - Module 92 connected to channel 13 of slot 14 has a CTDB current of 10.9 mA
09:48:35 - Module 93 connected to channel 14 of slot 14 has a CTDB current of 4.4 mA
09:48:35 - Module 94 connected to channel 15 of slot 14 has a CTDB current of 31.5 mA
09:48:35 - Module 95 connected to channel 1 of slot 15 has a CTDB current of 30.8 mA
09:48:35 - Module 96 connected to channel 2 of slot 15 has a CTDB current of 7.0 mA
09:48:35 - Module 97 connected to channel 3 of slot 15 has a CTDB current of 33.0 mA
09:48:35 - Module 98 connected to channel 4 of slot 15 has a CTDB current of 46.1 mA
09:48:35 - Module 99 connected to channel 5 of slot 15 has a CTDB current of 6.3 mA
09:48:35 - Module 100 connected to channel 6 of slot 15 has a CTDB current of 25.5 mA
09:48:35 - Module 101 connected to channel 7 of slot 15 has a CTDB current of 11.2 mA
09:48:35 - Module 102 connected to channel 8 of slot 15 has a CTDB current of 17.0 mA
09:48:35 - Module 103 connected to channel 9 of slot 15 has a CTDB current of 3.4 mA
09:48:35 - Module 104 connected to channel 10 of slot 15 has a CTDB current of 3.4 mA
09:48:35 - Module 105 connected to channel 11 of slot 15 has a CTDB current of 7.5 mA
09:48:35 - Module 106 connected to channel 7 of slot 13 has a CTDB current of 21.1 mA
09:48:35 - Module 107 connected to channel 8 of slot 13 has a CTDB current of 30.8 mA
09:48:35 - Module 108 connected to channel 9 of slot 13 has a CTDB current of 18.4 mA
09:48:35 - Module 109 connected to channel 10 of slot 13 has a CTDB current of 25.7 mA
09:48:35 - Module 110 connected to channel 11 of slot 13 has a CTDB current of 35.6 mA
09:48:35 - Module 111 connected to channel 12 of slot 13 has a CTDB current of 5.1 mA
09:48:35 - Module 112 connected to channel 13 of slot 13 has a CTDB current of 22.6 mA
09:48:35 - Module 113 connected to channel 14 of slot 13 has a CTDB current of 16.5 mA
09:48:35 - Module 114 connected to channel 15 of slot 13 has a CTDB current of 24.5 mA
09:48:35 - Module 115 connected to channel 1 of slot 14 has a CTDB current of 35.9 mA
09:48:35 - Module 116 connected to channel 2 of slot 14 has a CTDB current of 20.4 mA
09:48:35 - Module 117 connected to channel 3 of slot 14 has a CTDB current of 2.9 mA
09:48:35 - Module 118 connected to channel 4 of slot 14 has a CTDB current of 17.9 mA
09:48:35 - Module 119 connected to channel 5 of slot 14 has a CTDB current of 3.9 mA
09:48:35 - Module 120 connected to channel 6 of slot 14 has a CTDB current of 38.3 mA
09:48:35 - Module 121 connected to channel 7 of slot 14 has a CTDB current of 12.1 mA
09:48:35 - Module 122 connected to channel 8 of slot 14 has a CTDB current of 1.0 mA
09:48:35 - Module 123 connected to channel 9 of slot 14 has a CTDB current of 5.3 mA
09:48:35 - Module 124 connected to channel 5 of slot 9 has a CTDB current of 6.3 mA
09:48:35 - Module 125 connected to channel 6 of slot 9 has a CTDB current of 50.7 mA
09:48:35 - Module 126 connected to channel 7 of slot 9 has a CTDB current of 4.4 mA
09:48:35 - Module 127 connected to channel 8 of slot 9 has a CTDB current of 31.8 mA
09:48:35 - Module 128 connected to channel 9 of slot 9 has a CTDB current of 41.0 mA
09:48:35 - Module 129 connected to channel 10 of slot 9 has a CTDB current of 15.5 mA
09:48:35 - Module 130 connected to channel 11 of slot 9 has a CTDB current of 4.8 mA
09:48:35 - Module 131 connected to channel 12 of slot 9 has a CTDB current of 15.0 mA
09:48:35 - Module 132 connected to channel 13 of slot 9 has a CTDB current of 3.4 mA
09:48:35 - Module 133 connected to channel 14 of slot 9 has a CTDB current of 2.7 mA
09:48:35 - Module 134 connected to channel 15 of slot 9 has a CTDB current of 1.5 mA
09:48:35 - Module 135 connected to channel 1 of slot 13 has a CTDB current of 4.6 mA
09:48:35 - Module 136 connected to channel 2 of slot 13 has a CTDB current of 12.4 mA
09:48:35 - Module 137 connected to channel 3 of slot 13 has a CTDB current of 8.2 mA
09:48:35 - Module 138 connected to channel 4 of slot 13 has a CTDB current of 10.2 mA
09:48:35 - Module 139 connected to channel 5 of slot 13 has a CTDB current of 40.7 mA
09:48:35 - Module 140 connected to channel 6 of slot 13 has a CTDB current of 23.8 mA
09:48:35 - Module 141 connected to channel 2 of slot 8 has a CTDB current of 17.0 mA
09:48:35 - Module 142 connected to channel 3 of slot 8 has a CTDB current of 3.4 mA
09:48:35 - Module 143 connected to channel 4 of slot 8 has a CTDB current of 2.4 mA
09:48:35 - Module 144 connected to channel 5 of slot 8 has a CTDB current of 19.9 mA
09:48:35 - Module 145 connected to channel 6 of slot 8 has a CTDB current of 14.1 mA
09:48:35 - Module 146 connected to channel 7 of slot 8 has a CTDB current of 23.8 mA
09:48:35 - Module 147 connected to channel 8 of slot 8 has a CTDB current of 23.8 mA
09:48:35 - Module 148 connected to channel 9 of slot 8 has a CTDB current of 7.5 mA
09:48:35 - Module 149 connected to channel 10 of slot 8 has a CTDB current of 36.6 mA
09:48:35 - Module 150 connected to channel 11 of slot 8 has a CTDB current of 2.7 mA
09:48:35 - Module 151 connected to channel 12 of slot 8 has a CTDB current of 4.8 mA
09:48:35 - Module 152 connected to channel 13 of slot 8 has a CTDB current of 3.9 mA
09:48:35 - Module 153 connected to channel 14 of slot 8 has a CTDB current of 19.4 mA
09:48:35 - Module 154 connected to channel 15 of slot 8 has a CTDB current of 3.4 mA
09:48:35 - Module 155 connected to channel 1 of slot 9 has a CTDB current of 6.8 mA
09:48:35 - Module 156 connected to channel 2 of slot 9 has a CTDB current of 3.4 mA
09:48:35 - Module 157 connected to channel 3 of slot 9 has a CTDB current of 7.3 mA
09:48:35 - Module 158 connected to channel 4 of slot 9 has a CTDB current of 5.6 mA
09:48:35 - Module 159 connected to channel 15 of slot 6 has a CTDB current of 22.3 mA
09:48:35 - Module 160 connected to channel 1 of slot 7 has a CTDB current of 16.5 mA
09:48:35 - Module 161 connected to channel 2 of slot 7 has a CTDB current of 23.0 mA
09:48:35 - Module 162 connected to channel 3 of slot 7 has a CTDB current of 5.8 mA
09:48:35 - Module 163 connected to channel 4 of slot 7 has a CTDB current of 27.2 mA
09:48:35 - Module 164 connected to channel 5 of slot 7 has a CTDB current of 19.4 mA
09:48:35 - Module 165 connected to channel 6 of slot 7 has a CTDB current of 5.8 mA
09:48:35 - Module 166 connected to channel 7 of slot 7 has a CTDB current of 22.6 mA
09:48:35 - Module 167 connected to channel 8 of slot 7 has a CTDB current of 23.3 mA
09:48:35 - Module 168 connected to channel 9 of slot 7 has a CTDB current of 25.7 mA
09:48:35 - Module 169 connected to channel 10 of slot 7 has a CTDB current of 9.0 mA
09:48:35 - Module 170 connected to channel 11 of slot 7 has a CTDB current of 13.8 mA
09:48:35 - Module 171 connected to channel 12 of slot 7 has a CTDB current of 20.4 mA
09:48:35 - Module 172 connected to channel 13 of slot 7 has a CTDB current of 0.5 mA
09:48:35 - Module 173 connected to channel 14 of slot 7 has a CTDB current of 16.5 mA
09:48:35 - Module 174 connected to channel 15 of slot 7 has a CTDB current of 2.4 mA
09:48:35 - Module 175 connected to channel 1 of slot 8 has a CTDB current of 17.2 mA
09:48:35 - Module 176 connected to channel 14 of slot 5 has a CTDB current of 38.6 mA
09:48:35 - Module 177 connected to channel 15 of slot 5 has a CTDB current of 3.9 mA
09:48:35 - Module 178 connected to channel 1 of slot 6 has a CTDB current of 1.7 mA
09:48:35 - Module 179 connected to channel 2 of slot 6 has a CTDB current of 1.5 mA
09:48:35 - Module 180 connected to channel 3 of slot 6 has a CTDB current of 7.8 mA
09:48:35 - Module 181 connected to channel 4 of slot 6 has a CTDB current of 6.1 mA
09:48:35 - Module 182 connected to channel 5 of slot 6 has a CTDB current of 11.2 mA
09:48:35 - Module 183 connected to channel 6 of slot 6 has a CTDB current of 3.9 mA
09:48:35 - Module 184 connected to channel 7 of slot 6 has a CTDB current of 1.5 mA
09:48:35 - Module 185 connected to channel 8 of slot 6 has a CTDB current of 3.2 mA
09:48:35 - Module 186 connected to channel 9 of slot 6 has a CTDB current of 8.7 mA
09:48:35 - Module 187 connected to channel 10 of slot 6 has a CTDB current of 14.5 mA
09:48:35 - Module 188 connected to channel 11 of slot 6 has a CTDB current of 18.4 mA
09:48:35 - Module 189 connected to channel 12 of slot 6 has a CTDB current of 1.7 mA
09:48:35 - Module 190 connected to channel 13 of slot 6 has a CTDB current of 1.0 mA
09:48:35 - Module 191 connected to channel 14 of slot 6 has a CTDB current of 30.8 mA
09:48:35 - Module 192 connected to channel 14 of slot 4 has a CTDB current of 37.3 mA
09:48:35 - Module 193 connected to channel 15 of slot 4 has a CTDB current of 25.5 mA
09:48:35 - Module 194 connected to channel 1 of slot 5 has a CTDB current of 28.4 mA
09:48:35 - Module 195 connected to channel 2 of slot 5 has a CTDB current of 3.9 mA
09:48:35 - Module 196 connected to channel 3 of slot 5 has a CTDB current of 2.9 mA
09:48:35 - Module 197 connected to channel 4 of slot 5 has a CTDB current of 14.1 mA
09:48:35 - Module 198 connected to channel 5 of slot 5 has a CTDB current of 19.4 mA
09:48:35 - Module 199 connected to channel 6 of slot 5 has a CTDB current of 18.7 mA
09:48:35 - Module 200 connected to channel 7 of slot 5 has a CTDB current of 4.8 mA
09:48:35 - Module 201 connected to channel 8 of slot 5 has a CTDB current of 32.7 mA
09:48:35 - Module 202 connected to channel 9 of slot 5 has a CTDB current of 2.4 mA
09:48:35 - Module 203 connected to channel 10 of slot 5 has a CTDB current of 37.8 mA
09:48:35 - Module 204 connected to channel 11 of slot 5 has a CTDB current of 13.6 mA
09:48:35 - Module 205 connected to channel 12 of slot 5 has a CTDB current of 36.1 mA
09:48:35 - Module 206 connected to channel 13 of slot 5 has a CTDB current of 2.9 mA
09:48:35 - Module 207 connected to channel 15 of slot 3 has a CTDB current of 24.7 mA
09:48:35 - Module 208 connected to channel 1 of slot 4 has a CTDB current of 15.0 mA
09:48:35 - Module 209 connected to channel 2 of slot 4 has a CTDB current of 9.2 mA
09:48:35 - Module 210 connected to channel 3 of slot 4 has a CTDB current of 22.8 mA
09:48:35 - Module 211 connected to channel 4 of slot 4 has a CTDB current of 36.1 mA
09:48:35 - Module 212 connected to channel 5 of slot 4 has a CTDB current of 5.6 mA
09:48:35 - Module 213 connected to channel 6 of slot 4 has a CTDB current of 4.6 mA
09:48:35 - Module 214 connected to channel 7 of slot 4 has a CTDB current of 17.0 mA
09:48:35 - Module 215 connected to channel 8 of slot 4 has a CTDB current of 34.9 mA
09:48:35 - Module 216 connected to channel 9 of slot 4 has a CTDB current of 15.0 mA
09:48:35 - Module 217 connected to channel 10 of slot 4 has a CTDB current of 40.3 mA
09:48:35 - Module 218 connected to channel 11 of slot 4 has a CTDB current of 14.8 mA
09:48:35 - Module 219 connected to channel 12 of slot 4 has a CTDB current of 5.3 mA
09:48:35 - Module 220 connected to channel 13 of slot 4 has a CTDB current of 39.8 mA
09:48:35 - Module 221 connected to channel 2 of slot 3 has a CTDB current of 4.4 mA
09:48:35 - Module 222 connected to channel 3 of slot 3 has a CTDB current of 0.7 mA
09:48:35 - Module 223 connected to channel 4 of slot 3 has a CTDB current of 4.6 mA
09:48:35 - Module 224 connected to channel 5 of slot 3 has a CTDB current of 27.6 mA
09:48:35 - Module 225 connected to channel 6 of slot 3 has a CTDB current of 0.5 mA
09:48:35 - Module 226 connected to channel 7 of slot 3 has a CTDB current of 30.8 mA
09:48:35 - Module 227 connected to channel 8 of slot 3 has a CTDB current of 31.0 mA
09:48:35 - Module 228 connected to channel 9 of slot 3 has a CTDB current of 31.0 mA
09:48:35 - Module 229 connected to channel 10 of slot 3 has a CTDB current of 4.4 mA
09:48:35 - Module 230 connected to channel 11 of slot 3 has a CTDB current of 33.7 mA
09:48:35 - Module 231 connected to channel 12 of slot 3 has a CTDB current of 28.1 mA
09:48:35 - Module 232 connected to channel 13 of slot 3 has a CTDB current of 3.2 mA
09:48:35 - Module 233 connected to channel 14 of slot 3 has a CTDB current of 18.7 mA
09:48:35 - Module 234 connected to channel 5 of slot 2 has a CTDB current of 33.5 mA
09:48:35 - Module 235 connected to channel 6 of slot 2 has a CTDB current of 3.4 mA
09:48:35 - Module 236 connected to channel 7 of slot 2 has a CTDB current of 34.7 mA
09:48:35 - Module 237 connected to channel 8 of slot 2 has a CTDB current of 2.7 mA
09:48:35 - Module 238 connected to channel 9 of slot 2 has a CTDB current of 4.8 mA
09:48:35 - Module 239 connected to channel 10 of slot 2 has a CTDB current of 4.4 mA
09:48:35 - Module 240 connected to channel 11 of slot 2 has a CTDB current of 21.3 mA
09:48:35 - Module 241 connected to channel 12 of slot 2 has a CTDB current of 37.8 mA
09:48:35 - Module 242 connected to channel 13 of slot 2 has a CTDB current of 49.5 mA
09:48:35 - Module 243 connected to channel 14 of slot 2 has a CTDB current of 1.9 mA
09:48:35 - Module 244 connected to channel 15 of slot 2 has a CTDB current of 26.7 mA
09:48:35 - Module 245 connected to channel 1 of slot 3 has a CTDB current of 23.3 mA
09:48:35 - Module 246 connected to channel 9 of slot 1 has a CTDB current of 14.1 mA
09:48:35 - Module 247 connected to channel 10 of slot 1 has a CTDB current of 5.1 mA
09:48:35 - Module 248 connected to channel 11 of slot 1 has a CTDB current of 1.0 mA
09:48:35 - Module 249 connected to channel 12 of slot 1 has a CTDB current of 24.2 mA
09:48:35 - Module 250 connected to channel 13 of slot 1 has a CTDB current of 17.5 mA
09:48:35 - Module 251 connected to channel 14 of slot 1 has a CTDB current of 3.6 mA
09:48:35 - Module 252 connected to channel 15 of slot 1 has a CTDB current of 0.5 mA
09:48:35 - Module 253 connected to channel 1 of slot 2 has a CTDB current of 6.8 mA
09:48:35 - Module 254 connected to channel 2 of slot 2 has a CTDB current of 34.2 mA
09:48:35 - Module 255 connected to channel 3 of slot 2 has a CTDB current of 24.2 mA
09:48:35 - Module 256 connected to channel 4 of slot 2 has a CTDB current of 20.6 mA
09:48:35 - Module 257 connected to channel 1 of slot 1 has a CTDB current of 2.9 mA
09:48:35 - Module 258 connected to channel 2 of slot 1 has a CTDB current of 16.5 mA
09:48:35 - Module 259 connected to channel 3 of slot 1 has a CTDB current of 13.1 mA
09:48:35 - Module 260 connected to channel 4 of slot 1 has a CTDB current of 36.4 mA
09:48:35 - Module 261 connected to channel 5 of slot 1 has a CTDB current of 12.6 mA
09:48:35 - Module 262 connected to channel 6 of slot 1 has a CTDB current of 21.3 mA
09:48:35 - Module 263 connected to channel 7 of slot 1 has a CTDB current of 7.3 mA
09:48:35 - Module 264 connected to channel 8 of slot 1 has a CTDB current of 13.1 mA
09:48:40 - Starting task "Powering modules..."
09:48:40 - Enabling power in all modules
09:48:41 - Finished task "Powering modules..."
09:48:42 - Updating DTC module currents...
09:48:44 - Module 127 connected to channel 8 of slot 9 has a CTDB current of 15.0 mA
09:48:44 - Module 134 connected to channel 15 of slot 9 has a CTDB current of 1.7 mA
09:48:44 - Module 257 connected to channel 1 of slot 1 has a CTDB current of 2.4 mA
09:48:44 - Module 258 connected to channel 2 of slot 1 has a CTDB current of 9.7 mA
09:48:44 - Module 259 connected to channel 3 of slot 1 has a CTDB current of 5.3 mA
09:48:48 - Starting task "Restart modules in under/over current error"
09:48:50 - Module 127 connected to channel 8 of slot 9 has a CTDB current of 13.3 mA
09:48:50 - Module 134 connected to channel 15 of slot 9 has a CTDB current of 1.5 mA
09:48:50 - Module 257 connected to channel 1 of slot 1 has a CTDB current of 2.7 mA
09:48:50 - Module 258 connected to channel 2 of slot 1 has a CTDB current of 9.2 mA
09:48:50 - Module 259 connected to channel 3 of slot 1 has a CTDB current of 5.3 mA
09:48:50 - Restarting module 127
09:48:50 - Disabling power in channel 8 of CTDB slot 9
09:48:50 - Enabling power in channel 8 of CTDB slot 9
09:48:50 - Restarting module 134
09:48:50 - Disabling power in channel 15 of CTDB slot 9
09:48:50 - Enabling power in channel 15 of CTDB slot 9
09:48:50 - Restarting module 257
09:48:50 - Disabling power in channel 1 of CTDB slot 1
09:48:50 - Enabling power in channel 1 of CTDB slot 1
09:48:50 - Restarting module 258
09:48:50 - Disabling power in channel 2 of CTDB slot 1
09:48:51 - Enabling power in channel 2 of CTDB slot 1
09:48:51 - Restarting module 259
09:48:51 - Disabling power in channel 3 of CTDB slot 1
09:48:51 - Enabling power in channel 3 of CTDB slot 1
09:48:51 - Finished task "Restart modules in under/over current error"
09:48:53 - Updating DTC module currents...
09:48:55 - Module 134 connected to channel 15 of slot 9 has a CTDB current of 1.5 mA
09:48:59 - Starting task "Restart modules in under/over current error"
09:49:01 - Module 134 connected to channel 15 of slot 9 has a CTDB current of 1.5 mA
09:49:01 - Restarting module 134
09:49:01 - Disabling power in channel 15 of CTDB slot 9
09:49:01 - Enabling power in channel 15 of CTDB slot 9
09:49:01 - Finished task "Restart modules in under/over current error"
09:49:03 - Updating DTC module currents...
09:49:07 - Updating DTC module currents...
09:49:14 - Starting task "Configure modules"
09:49:14 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/utils/branches/v5.6.0-41551 
09:49:14 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/libNectarCam/branches/v5.6.0-41551 
09:49:14 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/libQNectarCam/branches/v5.6.0-41551 
09:49:14 - Version of NMC: svn+ssh://svn.in2p3.fr/cta/MST/NectarCAM/qNectarcamModuleController/branches/v5.6.0-41551
09:49:14 - Configuring modules with configuration /data/config/2021/20210917/config_cameraqm_265febs_newnewDACL_HamamatsuHV_newL1A_triggerMasks.NMC.xml
09:49:14 - Switching off high voltages in configuration
09:49:23 - Successfully configured 265 module(s)
09:49:24 - Waiting for modules to be configured...
09:49:30 - All front-end boards are programmed with firmware F56D2002
09:49:38 - Found 2 different versions of DTBP firmware: [15 17]
09:50:18 - NMC is in state NmcState.Ready and knows of 265 drawer(s)
09:50:33 - All front-end boards have counted 0 event(s)
09:50:38 - Found 0 PPS errors.
09:50:38 - Finished task "Configure modules"
09:50:50 - Starting task "Switch HVPA voltage state"
09:50:50 - Setting HVPA current limit to 12489.75 uA
09:50:50 - Setting Hvpa.Hvpa0.CurrentTrip in all drawers
09:51:00 - Setting Hvpa.Hvpa1.CurrentTrip in all drawers
09:51:10 - Setting Hvpa.Hvpa2.CurrentTrip in all drawers
09:51:19 - Setting Hvpa.Hvpa3.CurrentTrip in all drawers
09:51:29 - Setting Hvpa.Hvpa4.CurrentTrip in all drawers
09:51:39 - Setting Hvpa.Hvpa5.CurrentTrip in all drawers
09:51:49 - Setting Hvpa.Hvpa6.CurrentTrip in all drawers
09:51:59 - Setting HVPA ramp speed to 25 V/s
09:52:10 - Switching HVPA to state Low
09:52:29 - Setting HVPA current limits...
09:53:50 - Finished task "Switch HVPA voltage state"
09:56:09 - Updating voltage widget...
09:56:20 - Could not update voltage widget: Could not invoke the Read service: BadTimeout
09:56:23 - Updating voltage widget...
10:00:14 - Starting task "Switch HVPA voltage state"
10:00:14 - Setting HVPA current limit to 12489.75 uA
10:00:14 - Setting Hvpa.Hvpa0.CurrentTrip in all drawers
10:00:24 - Setting Hvpa.Hvpa1.CurrentTrip in all drawers
10:00:33 - Setting Hvpa.Hvpa2.CurrentTrip in all drawers
10:00:43 - Setting Hvpa.Hvpa3.CurrentTrip in all drawers
10:00:53 - Setting Hvpa.Hvpa4.CurrentTrip in all drawers
10:01:03 - Setting Hvpa.Hvpa5.CurrentTrip in all drawers
10:01:13 - Setting Hvpa.Hvpa6.CurrentTrip in all drawers
10:01:22 - Setting HVPA ramp speed to 25 V/s
10:01:34 - Switching HVPA to state Nominal
10:01:53 - Setting HVPA current limits...
10:03:14 - Finished task "Switch HVPA voltage state"
10:11:48 - Updating voltage widget...
10:13:11 - Starting NMC
10:13:11 - Clearing PPS error counters
10:13:25 - Resetting FEB counters...
10:13:28 - Starting all configured modules...
10:13:35 - High voltage locked channels will be checked every 60 s
10:13:37 - Calling method FSM.gotoObserving in object FSM
10:13:37 - Failed to call FSM.gotoObserving: Bad statuses are present
10:13:55 - Event builder is in state CameraServerState.Observing and has output 0 event(s) during run #2592.
10:13:58 - Calling method FSM.gotoReady in object FSM
10:14:06 - Event builder is in state CameraServerState.Observing and has output 0 event(s) during run #2592.
10:14:06 - Event builder is in transition to state CameraServerState.Ready
10:14:09 - Event builder is in state CameraServerState.Ready and has output 0 event(s) during run #2592.
10:14:12 - Event builder is in state CameraServerState.Ready and has output 0 event(s) during run #2592.
10:14:13 - Calling method FSM.gotoObserving in object FSM
10:14:13 - Starting run 2593
10:14:35 - Checking for high voltage locked pixels...
10:14:49 - HVPA channel 2 of drawer 197 has status 0x0007!
10:14:49 - HVPA channel 2 in module 197 is in rise default!
10:14:49 - HVPA channel 2 of drawer 231 has status 0x0007!
10:14:49 - HVPA channel 2 in module 231 is in rise default!
10:15:02 - HV is locked in 0 channel(s), was in rise default in 2 channel(s) and was still in progress in 0 channel(s)
10:15:02 - Unlocking 2 channel(s)...
10:15:23 - Checking UCTS clock...
10:15:23 - UCTS clock is late by 696948 seconds!
10:15:23 - Configuring UCTS with (10.200.7.250, 10.200.4.100, 44:a8:42:44:32:c9)
10:15:23 - Configuring TIB...
10:15:23 - Setting TIB forced mode to False
10:15:23 - Writing False to Camera.TIB.Forced.ForcedMode.ForcedMode_v
10:15:23 - Status: TibState.PpsStopped
10:15:23 - Alarms: AlarmVector.NoAlarm
10:15:23 - Connection status: False TXclient_alive: False
10:15:23 - Entering set_external_delay
10:15:23 - Setting ExternalDelayLocal to 27.000 ns
10:15:23 - Writing 27.0 to Camera.TIB.ExternalDelay.ExternalDelayLocal.ExternalDelayLocal_v
10:15:24 - Entering set_external_delay
10:15:24 - Setting ExternalDelayCalibration to 58.000 ns
10:15:24 - Writing 58.0 to Camera.TIB.ExternalDelay.ExternalDelayCalibration.ExternalDelayCalibration_v
10:15:24 - Entering set_external_delay
10:15:24 - Setting ExternalDelaySphe to 110.000 ns
10:15:24 - Writing 110.0 to Camera.TIB.ExternalDelay.ExternalDelaySphe.ExternalDelaySphe_v
10:15:24 - Setting TIB trigger mode to 0x54 = TriggerMask.SlowControl|Software|Calibration
10:15:24 - Writing 84 to Camera.TIB.TriggerMode.ModeMask.ModeMask_v
10:15:24 - Writing 1 to Camera.TIB.InputsEnable.InputMask.InputMask_v
10:15:24 - Writing False to Camera.TIB.BUSY.DisableBusy.DisableBusy_v
10:15:24 - Writing 0.0 to Camera.TIB.BUSY.ExtraDelayBusy.ExtraDelayBusy_v
10:15:24 - Writing True to Camera.TIB.Throttler.DisableThrottler.DisableThrottler_v
10:15:25 - Writing 255 to Camera.TIB.Throttler.MaxTriggers50us.MaxTriggers50us_v
10:15:25 - Writing 255 to Camera.TIB.Throttler.MaxTriggers1ms.MaxTriggers1ms_v
10:15:25 - Status: TibState.PpsStopped
10:15:25 - Alarms: AlarmVector.NoAlarm
10:15:25 - Connection status: False TXclient_alive: False
10:15:25 - Writing False to Camera.TIB.Pedestal.PeriodicPedestalEnable.PeriodicPedestalEnable_v
10:15:25 - Writing 100 to Camera.TIB.Pedestal.PeriodicPedestalFrequency.PeriodicPedestalFrequency_v
10:15:25 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
10:15:25 - Writing False to Camera.TIB.Pedestal.DigitalPedestalEnable.DigitalPedestalEnable_v
10:15:25 - Writing 100 to Camera.TIB.Pedestal.DigitalPedestal_config_Rate.DigitalPedestal_config_Rate_v
10:15:25 - Writing 375764 to Camera.TIB.Pedestal.DigitalPedestalSeed.DigitalPedestalSeed_v
10:15:25 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
10:15:25 - Writing False to Camera.TIB.Pedestal.AnalogPedestalEnable.AnalogPedestalEnable_v
10:15:25 - Writing 3000.0 to Camera.TIB.Pedestal.AnalogPedestalThreshold.AnalogPedestalThreshold_v
10:15:25 - Writing False to Camera.TIB.Pedestal.Fake_trig_enable.Fake_trig_enable_v
10:15:26 - Connecting TIB to camera server at 10.10.4.12:222
10:15:26 - Starting TIB...
10:15:26 - Status: TibState.PpsStopped
10:15:26 - Alarms: AlarmVector.NoAlarm
10:15:26 - Connection status: False TXclient_alive: True
10:15:26 - Resetting run
10:15:26 - Wait for UCTS external trigger before enabling trigger...
10:15:26 - Status: TibState.Standby
10:15:26 - Alarms: AlarmVector.NoAlarm
10:15:26 - Connection status: False TXclient_alive: True
10:15:26 - Status: TibState.Standby
10:15:26 - Alarms: AlarmVector.NoAlarm
10:15:26 - Connection status: False TXclient_alive: True
10:15:27 - Status: TibState.Armed
10:15:27 - Alarms: AlarmVector.NoAlarm
10:15:27 - Connection status: True TXclient_alive: True
10:15:28 - Starting TIB triggers...
10:15:28 - Enabling trigger
10:15:28 - Status: TibState.Running
10:15:28 - Alarms: AlarmVector.NoAlarm
10:15:28 - Connection status: True TXclient_alive: True
10:15:35 - Checking for high voltage locked pixels...
10:15:49 - HVPA channel 2 of drawer 197 has status 0x0007!
10:15:49 - HVPA channel 2 in module 197 is in rise default!
10:15:49 - HVPA channel 2 of drawer 231 has status 0x0007!
10:15:49 - HVPA channel 2 in module 231 is in rise default!
10:16:02 - HV is locked in 0 channel(s), was in rise default in 2 channel(s) and was still in progress in 2 channel(s)
10:16:02 - Unlocking 2 channel(s)...
10:16:35 - Checking for high voltage locked pixels...
10:16:49 - HVPA channel 2 of drawer 197 has status 0x0007!
10:16:49 - HVPA channel 2 in module 197 is in rise default!
10:16:49 - HVPA channel 2 of drawer 231 has status 0x0007!
10:16:49 - HVPA channel 2 in module 231 is in rise default!
10:17:02 - HV is locked in 0 channel(s), was in rise default in 2 channel(s) and was still in progress in 1 channel(s)
10:17:02 - Unlocking 2 channel(s)...
10:17:03 - Configuring calibration box...
10:17:03 - Configuring calibration box with leds=0x40 voltage=11.00 frequency=1000.0/1 central_current=0.0 duration=500 width=1 lemo_out=True fiber1_out=True fiber2_out=True lemo_in=False enabled=False
10:17:04 - Configuring calibration box...
10:17:04 - Configuring calibration box with leds=0x40 voltage=11.00 frequency=1000.0/1 central_current=0.0 duration=500 width=1 lemo_out=True fiber1_out=True fiber2_out=True lemo_in=False enabled=False
10:17:06 - Starting flashes...
10:17:10 - Stopped periodic check of locked high voltages
10:17:14 - Status: TibState.Running ConnectionStatus: True TXclient_alive: True
10:17:14 - Alarms: AlarmVector.ReadError
10:17:14 - Temperature: 41.31
10:17:14 - Local camera rate: 0.0 Hz
10:17:14 - Stereo trigger rate: 0.0 Hz
10:17:14 - SPE trigger rate: 0.0 Hz
10:17:14 - Calibration trigger rate: 1000.0 Hz
10:17:14 - Software trigger rate: 0.0 Hz
10:17:14 - Pedestal trigger rate: 0.0 Hz
10:17:14 - Collected trigger rate: 1000.0 Hz
10:17:14 - Busy rate: 0.0 Hz
10:17:14 - Camera trigger rate: 1000.0 Hz
10:18:04 - Stopping TIB...
10:18:04 - Status: TibState.Running
10:18:04 - Alarms: AlarmVector.ReadError
10:18:04 - Connection status: True TXclient_alive: True
10:18:04 - Disabling trigger
10:18:04 - Disabling PPS
10:18:05 - Status: TibState.PpsStopped
10:18:05 - Alarms: AlarmVector.ReadError
10:18:05 - Connection status: True TXclient_alive: True
10:18:06 - Closing TIB connection to camera server
10:18:07 - Status: TibState.PpsStopped
10:18:07 - Alarms: AlarmVector.ReadError
10:18:07 - Connection status: False TXclient_alive: False
10:18:07 - Run duration: 0:02:37
10:18:07 - Local camera triggers: 0
10:18:07 - Slow control triggers: 0
10:18:07 - Single photo-electron triggers: 0
10:18:07 - Calibration triggers: 49938
10:18:07 - Software triggers from UCTS: 0
10:18:07 - Pedestal triggers: 0
10:18:07 - Collected input triggers: 49938
10:18:07 - Busy triggers: 0
10:18:07 - Camera event triggers sent to clusters: 49938
10:18:12 - Calling method FSM.gotoReady in object FSM
10:18:14 - Event builder is in state CameraServerState.Observing and has output 49938 event(s) during run #2593.
10:18:14 - Event builder is in transition to state CameraServerState.Ready
10:18:19 - Stopping NMC
10:18:24 - Found 0 PPS errors.
10:18:25 - NMC is in state NmcState.Configured and knows of 265 drawer(s)
10:18:40 - All front-end boards have counted 49938 event(s)
10:18:45 - Found 0 PPS errors.