climateprediction.net home page
Task 22315383

Task 22315383

Name oifs_43r3_00gd_2019110100_123_993_12214027_0
Workunit 12214027
Created 24 Feb 2023, 13:33:26 UTC
Sent 24 Feb 2023, 19:24:13 UTC
Report deadline 25 Apr 2023, 19:24:13 UTC
Received 25 Feb 2023, 1:22:31 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1534737
Run time 4 hours 43 min 7 sec
CPU time 4 hours 30 min 46 sec
Validate state Invalid
Credit 3,628.80
Device peak FLOPS 5.73 GFLOPS
Application version OpenIFS 43r3 v1.21
x86_64-pc-linux-gnu
Peak working set size 4,391.18 MB
Peak swap size 4,974.27 MB
Peak disk usage 1,264.07 MB
Stderr
<core_client_version>7.20.2</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
dding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000132
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000132
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_0_r644475507_5.zip
Uploading the intermediate file: upload_file_5.zip
  20:31:30 STEP  145 H= 145:00 +CPU= 16.500
  20:31:48 STEP  146 H= 146:00 +CPU= 17.609
  20:32:16 STEP  147 H= 147:00 +CPU= 27.091
  20:32:34 STEP  148 H= 148:00 +CPU= 17.630
  20:32:51 STEP  149 H= 149:00 +CPU= 16.733
  20:33:18 STEP  150 H= 150:00 +CPU= 26.585
  20:33:36 STEP  151 H= 151:00 +CPU= 17.566
  20:33:53 STEP  152 H= 152:00 +CPU= 16.717
  20:34:26 STEP  153 H= 153:00 +CPU= 30.661
  20:34:45 STEP  154 H= 154:00 +CPU= 18.605
  20:35:03 STEP  155 H= 155:00 +CPU= 17.173
  20:35:37 STEP  156 H= 156:00 +CPU= 32.614
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000156
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000156
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000156
  20:35:55 STEP  157 H= 157:00 +CPU= 17.012
  20:36:12 STEP  158 H= 158:00 +CPU= 17.121
  20:36:38 STEP  159 H= 159:00 +CPU= 25.411
  20:36:54 STEP  160 H= 160:00 +CPU= 16.559
  20:37:11 STEP  161 H= 161:00 +CPU= 16.376
  20:37:37 STEP  162 H= 162:00 +CPU= 25.736
  20:37:53 STEP  163 H= 163:00 +CPU= 16.212
  20:38:10 STEP  164 H= 164:00 +CPU= 16.454
  20:38:35 STEP  165 H= 165:00 +CPU= 25.159
  20:38:52 STEP  166 H= 166:00 +CPU= 16.582
  20:39:09 STEP  167 H= 167:00 +CPU= 16.711
  20:39:39 STEP  168 H= 168:00 +CPU= 30.095
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000168
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000168
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000168
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000144
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000144
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000144
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000156
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000156
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000156
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_0_r644475507_6.zip
Uploading the intermediate file: upload_file_6.zip
  20:39:56 STEP  169 H= 169:00 +CPU= 16.390
  20:40:13 STEP  170 H= 170:00 +CPU= 16.869
  20:40:39 STEP  171 H= 171:00 +CPU= 25.338
  20:40:57 STEP  172 H= 172:00 +CPU= 18.194
  20:41:14 STEP  173 H= 173:00 +CPU= 16.666
  20:41:41 STEP  174 H= 174:00 +CPU= 26.084
  20:41:58 STEP  175 H= 175:00 +CPU= 16.969
  20:42:15 STEP  176 H= 176:00 +CPU= 17.175
  20:42:41 STEP  177 H= 177:00 +CPU= 25.732
  20:42:58 STEP  178 H= 178:00 +CPU= 16.670
  20:43:16 STEP  179 H= 179:00 +CPU= 16.946
  20:43:45 STEP  180 H= 180:00 +CPU= 28.664
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000180
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000180
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000180
  20:44:01 STEP  181 H= 181:00 +CPU= 16.366
  20:44:19 STEP  182 H= 182:00 +CPU= 17.486
  20:44:46 STEP  183 H= 183:00 +CPU= 26.025
  20:45:02 STEP  184 H= 184:00 +CPU= 16.627
  20:45:19 STEP  185 H= 185:00 +CPU= 16.539
  20:45:47 STEP  186 H= 186:00 +CPU= 27.590
  20:46:06 STEP  187 H= 187:00 +CPU= 17.886
  20:46:24 STEP  188 H= 188:00 +CPU= 17.269
  20:46:50 STEP  189 H= 189:00 +CPU= 26.248
  20:47:08 STEP  190 H= 190:00 +CPU= 17.133
  20:47:25 STEP  191 H= 191:00 +CPU= 16.737
  20:47:56 STEP  192 H= 192:00 +CPU= 30.898
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000192
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000192
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000192
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000168
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000168
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000168
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000180
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000180
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000180
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_0_r644475507_7.zip
Uploading the intermediate file: upload_file_7.zip
  20:48:13 STEP  193 H= 193:00 +CPU= 16.750
  20:48:30 STEP  194 H= 194:00 +CPU= 16.999
  20:48:57 STEP  195 H= 195:00 +CPU= 26.136
  20:49:14 STEP  196 H= 196:00 +CPU= 16.657
  20:49:30 STEP  197 H= 197:00 +CPU= 16.589
  20:49:58 STEP  198 H= 198:00 +CPU= 26.681
  20:50:15 STEP  199 H= 199:00 +CPU= 16.873
  20:50:32 STEP  200 H= 200:00 +CPU= 17.360
  20:50:59 STEP  201 H= 201:00 +CPU= 25.909
  20:51:15 STEP  202 H= 202:00 +CPU= 16.699
  20:51:32 STEP  203 H= 203:00 +CPU= 16.713
  20:52:01 STEP  204 H= 204:00 +CPU= 28.240
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000204
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000204
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000204
  20:52:18 STEP  205 H= 205:00 +CPU= 16.555
  20:52:35 STEP  206 H= 206:00 +CPU= 17.029
  20:53:05 STEP  207 H= 207:00 +CPU= 28.572
  20:53:25 STEP  208 H= 208:00 +CPU= 19.203
  20:53:44 STEP  209 H= 209:00 +CPU= 18.041
  20:54:11 STEP  210 H= 210:00 +CPU= 27.061
  20:54:29 STEP  211 H= 211:00 +CPU= 17.043
  20:54:47 STEP  212 H= 212:00 +CPU= 17.642
  20:55:14 STEP  213 H= 213:00 +CPU= 26.628
  20:55:32 STEP  214 H= 214:00 +CPU= 17.894
  20:55:50 STEP  215 H= 215:00 +CPU= 17.173
  20:56:21 STEP  216 H= 216:00 +CPU= 30.412
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000216
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000216
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000216
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000192
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000192
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000192
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000204
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000204
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000204
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_0_r644475507_8.zip
Uploading the intermediate file: upload_file_8.zip
  20:56:38 STEP  217 H= 217:00 +CPU= 17.220
  20:56:56 STEP  218 H= 218:00 +CPU= 17.600
  20:57:24 STEP  219 H= 219:00 +CPU= 26.753
  20:57:41 STEP  220 H= 220:00 +CPU= 16.846
  20:57:58 STEP  221 H= 221:00 +CPU= 16.929
  20:58:28 STEP  222 H= 222:00 +CPU= 28.576
  20:58:50 STEP  223 H= 223:00 +CPU= 20.689
  20:59:10 STEP  224 H= 224:00 +CPU= 19.069
  20:59:37 STEP  225 H= 225:00 +CPU= 27.165
  20:59:55 STEP  226 H= 226:00 +CPU= 17.324
  21:00:13 STEP  227 H= 227:00 +CPU= 17.062
  21:00:43 STEP  228 H= 228:00 +CPU= 29.580
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000228
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000228
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000228
  21:01:03 STEP  229 H= 229:00 +CPU= 19.052
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:01:36 STEP  230 H= 230:00 +CPU= 20.633
  21:02:05 STEP  231 H= 231:00 +CPU= 27.914
  21:02:23 STEP  232 H= 232:00 +CPU= 17.993
  21:02:40 STEP  233 H= 233:00 +CPU= 16.700
  21:03:11 STEP  234 H= 234:00 +CPU= 29.080
  21:03:30 STEP  235 H= 235:00 +CPU= 18.499
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:04:04 STEP  236 H= 236:00 +CPU= 21.527
  21:04:34 STEP  237 H= 237:00 +CPU= 28.628
  21:04:54 STEP  238 H= 238:00 +CPU= 18.760
  21:05:14 STEP  239 H= 239:00 +CPU= 19.311
  21:05:47 STEP  240 H= 240:00 +CPU= 32.148
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000240
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000240
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000240
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000216
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000216
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000216
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000228
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000228
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000228
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_0_r644475507_9.zip
Uploading the intermediate file: upload_file_9.zip
  21:06:04 STEP  241 H= 241:00 +CPU= 17.046
Uploading trickle at timestep: 864000
  21:06:22 STEP  242 H= 242:00 +CPU= 17.847
  21:06:52 STEP  243 H= 243:00 +CPU= 28.132
  21:07:10 STEP  244 H= 244:00 +CPU= 18.273
  21:07:30 STEP  245 H= 245:00 +CPU= 18.696
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:08:16 STEP  246 H= 246:00 +CPU= 32.589
  21:08:35 STEP  247 H= 247:00 +CPU= 18.337
  21:08:53 STEP  248 H= 248:00 +CPU= 17.955
  21:09:24 STEP  249 H= 249:00 +CPU= 29.281
  21:09:42 STEP  250 H= 250:00 +CPU= 17.612
  21:10:01 STEP  251 H= 251:00 +CPU= 18.222
  21:10:35 STEP  252 H= 252:00 +CPU= 32.289
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000252
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000252
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000252
  21:10:54 STEP  253 H= 253:00 +CPU= 18.471
  21:11:13 STEP  254 H= 254:00 +CPU= 18.105
  21:11:42 STEP  255 H= 255:00 +CPU= 28.028
  21:12:02 STEP  256 H= 256:00 +CPU= 19.100
  21:12:21 STEP  257 H= 257:00 +CPU= 18.474
  21:12:52 STEP  258 H= 258:00 +CPU= 29.837
  21:13:10 STEP  259 H= 259:00 +CPU= 17.671
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:13:54 STEP  260 H= 260:00 +CPU= 20.943
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:15:37 STEP  261 H= 261:00 +CPU= 34.099
  21:15:57 STEP  262 H= 262:00 +CPU= 19.306
  21:16:17 STEP  263 H= 263:00 +CPU= 19.240
  21:16:53 STEP  264 H= 264:00 +CPU= 34.027
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000264
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000264
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000264
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000240
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000240
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000240
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000252
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000252
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000252
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_0_r644475507_10.zip
Uploading the intermediate file: upload_file_10.zip
  21:17:12 STEP  265 H= 265:00 +CPU= 18.620
  21:17:32 STEP  266 H= 266:00 +CPU= 19.552
  21:18:03 STEP  267 H= 267:00 +CPU= 29.123
  21:18:23 STEP  268 H= 268:00 +CPU= 19.039
  21:18:42 STEP  269 H= 269:00 +CPU= 18.614
  21:19:13 STEP  270 H= 270:00 +CPU= 29.622
  21:19:32 STEP  271 H= 271:00 +CPU= 18.524
  21:19:52 STEP  272 H= 272:00 +CPU= 18.961
  21:20:22 STEP  273 H= 273:00 +CPU= 29.033
  21:20:42 STEP  274 H= 274:00 +CPU= 19.035
  21:21:01 STEP  275 H= 275:00 +CPU= 18.486
  21:21:34 STEP  276 H= 276:00 +CPU= 31.655
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000276
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000276
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000276
  21:21:53 STEP  277 H= 277:00 +CPU= 18.741
  21:22:13 STEP  278 H= 278:00 +CPU= 18.862
  21:22:44 STEP  279 H= 279:00 +CPU= 29.330
  21:23:03 STEP  280 H= 280:00 +CPU= 18.869
  21:23:23 STEP  281 H= 281:00 +CPU= 18.625
  21:23:53 STEP  282 H= 282:00 +CPU= 29.490
  21:24:13 STEP  283 H= 283:00 +CPU= 18.611
  21:24:34 STEP  284 H= 284:00 +CPU= 20.140
  21:25:06 STEP  285 H= 285:00 +CPU= 30.771
  21:25:26 STEP  286 H= 286:00 +CPU= 18.852
  21:25:46 STEP  287 H= 287:00 +CPU= 19.368
  21:26:22 STEP  288 H= 288:00 +CPU= 34.281
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000288
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000288
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000288
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000264
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000264
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000264
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000276
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000276
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000276
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_0_r644475507_11.zip
Uploading the intermediate file: upload_file_11.zip
  21:26:41 STEP  289 H= 289:00 +CPU= 18.750
  21:27:01 STEP  290 H= 290:00 +CPU= 19.054
  21:27:31 STEP  291 H= 291:00 +CPU= 29.119
  21:27:51 STEP  292 H= 292:00 +CPU= 19.179
  21:28:11 STEP  293 H= 293:00 +CPU= 18.650
  21:28:41 STEP  294 H= 294:00 +CPU= 29.469
  21:29:01 STEP  295 H= 295:00 +CPU= 18.777
  21:29:20 STEP  296 H= 296:00 +CPU= 18.580
  21:29:50 STEP  297 H= 297:00 +CPU= 28.800
  21:30:10 STEP  298 H= 298:00 +CPU= 19.400
  21:30:30 STEP  299 H= 299:00 +CPU= 18.601
  21:31:03 STEP  300 H= 300:00 +CPU= 31.937
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000300
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000300
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000300
  21:31:22 STEP  301 H= 301:00 +CPU= 18.584
  21:31:42 STEP  302 H= 302:00 +CPU= 18.997
  21:32:12 STEP  303 H= 303:00 +CPU= 28.948
  21:32:32 STEP  304 H= 304:00 +CPU= 19.090
  21:32:52 STEP  305 H= 305:00 +CPU= 18.860
  21:33:22 STEP  306 H= 306:00 +CPU= 29.353
  21:33:41 STEP  307 H= 307:00 +CPU= 18.274
  21:34:01 STEP  308 H= 308:00 +CPU= 19.115
  21:34:31 STEP  309 H= 309:00 +CPU= 28.816
  21:34:51 STEP  310 H= 310:00 +CPU= 19.240
  21:35:11 STEP  311 H= 311:00 +CPU= 19.287
  21:35:47 STEP  312 H= 312:00 +CPU= 34.334
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000312
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000312
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000312
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000288
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000288
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000288
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000300
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000300
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000300
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_0_r644475507_12.zip
Uploading the intermediate file: upload_file_12.zip
  21:36:06 STEP  313 H= 313:00 +CPU= 18.488
  21:36:27 STEP  314 H= 314:00 +CPU= 19.304
  21:36:57 STEP  315 H= 315:00 +CPU= 28.890
  21:37:17 STEP  316 H= 316:00 +CPU= 19.119
  21:37:37 STEP  317 H= 317:00 +CPU= 18.948
  21:38:07 STEP  318 H= 318:00 +CPU= 29.679
  21:38:27 STEP  319 H= 319:00 +CPU= 18.562
  21:38:47 STEP  320 H= 320:00 +CPU= 19.247
  21:39:17 STEP  321 H= 321:00 +CPU= 28.978
  21:39:37 STEP  322 H= 322:00 +CPU= 18.917
  21:39:57 STEP  323 H= 323:00 +CPU= 18.928
  21:40:30 STEP  324 H= 324:00 +CPU= 31.554
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000324
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000324
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000324
  21:40:49 STEP  325 H= 325:00 +CPU= 18.874
  21:41:09 STEP  326 H= 326:00 +CPU= 19.003
  21:41:39 STEP  327 H= 327:00 +CPU= 28.887
  21:41:59 STEP  328 H= 328:00 +CPU= 18.895
  21:42:18 STEP  329 H= 329:00 +CPU= 18.604
  21:42:49 STEP  330 H= 330:00 +CPU= 29.429
  21:43:08 STEP  331 H= 331:00 +CPU= 18.545
  21:43:29 STEP  332 H= 332:00 +CPU= 19.687
  21:43:59 STEP  333 H= 333:00 +CPU= 29.113
  21:44:19 STEP  334 H= 334:00 +CPU= 18.868
  21:44:39 STEP  335 H= 335:00 +CPU= 19.271
  21:45:15 STEP  336 H= 336:00 +CPU= 34.016
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000336
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000336
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000336
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000312
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000312
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000312
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000324
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000324
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000324
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_0_r644475507_13.zip
Uploading the intermediate file: upload_file_13.zip
  21:45:34 STEP  337 H= 337:00 +CPU= 18.539
  21:45:54 STEP  338 H= 338:00 +CPU= 19.093
  21:46:24 STEP  339 H= 339:00 +CPU= 29.011
  21:46:44 STEP  340 H= 340:00 +CPU= 19.165
  21:47:04 STEP  341 H= 341:00 +CPU= 18.795
  21:47:35 STEP  342 H= 342:00 +CPU= 29.657
  21:47:55 STEP  343 H= 343:00 +CPU= 18.863
  21:48:15 STEP  344 H= 344:00 +CPU= 19.124
  21:48:45 STEP  345 H= 345:00 +CPU= 29.016
  21:49:05 STEP  346 H= 346:00 +CPU= 19.136
  21:49:24 STEP  347 H= 347:00 +CPU= 18.595
  21:49:57 STEP  348 H= 348:00 +CPU= 31.722
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000348
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000348
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000348
  21:50:17 STEP  349 H= 349:00 +CPU= 18.604
  21:50:36 STEP  350 H= 350:00 +CPU= 18.914
  21:51:06 STEP  351 H= 351:00 +CPU= 28.790
  21:51:26 STEP  352 H= 352:00 +CPU= 19.008
  21:51:46 STEP  353 H= 353:00 +CPU= 18.574
  21:52:17 STEP  354 H= 354:00 +CPU= 29.740
  21:52:36 STEP  355 H= 355:00 +CPU= 18.485
  21:52:56 STEP  356 H= 356:00 +CPU= 19.113
  21:53:26 STEP  357 H= 357:00 +CPU= 28.801
  21:53:46 STEP  358 H= 358:00 +CPU= 18.979
  21:54:06 STEP  359 H= 359:00 +CPU= 19.205
  21:54:41 STEP  360 H= 360:00 +CPU= 33.891
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000360
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000360
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000360
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000336
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000336
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000336
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000348
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000348
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000348
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_0_r644475507_14.zip
Uploading the intermediate file: upload_file_14.zip
  21:55:01 STEP  361 H= 361:00 +CPU= 18.808
  21:55:20 STEP  362 H= 362:00 +CPU= 18.869
  21:55:50 STEP  363 H= 363:00 +CPU= 28.882
  21:56:12 STEP  364 H= 364:00 +CPU= 20.271
  21:56:32 STEP  365 H= 365:00 +CPU= 18.777
  21:57:03 STEP  366 H= 366:00 +CPU= 29.672
  21:57:22 STEP  367 H= 367:00 +CPU= 18.680
  21:57:42 STEP  368 H= 368:00 +CPU= 19.120
  21:58:13 STEP  369 H= 369:00 +CPU= 29.016
  21:58:32 STEP  370 H= 370:00 +CPU= 18.875
  21:58:52 STEP  371 H= 371:00 +CPU= 18.646
  21:59:24 STEP  372 H= 372:00 +CPU= 31.408
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000372
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000372
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000372
  21:59:44 STEP  373 H= 373:00 +CPU= 18.387
  22:00:04 STEP  374 H= 374:00 +CPU= 19.090
  22:00:35 STEP  375 H= 375:00 +CPU= 29.650
  22:00:56 STEP  376 H= 376:00 +CPU= 19.806
  22:01:16 STEP  377 H= 377:00 +CPU= 19.601
  22:01:49 STEP  378 H= 378:00 +CPU= 30.994
  22:02:10 STEP  379 H= 379:00 +CPU= 19.285
  22:02:30 STEP  380 H= 380:00 +CPU= 19.205
  22:03:00 STEP  381 H= 381:00 +CPU= 28.997
  22:03:20 STEP  382 H= 382:00 +CPU= 18.961
  22:03:40 STEP  383 H= 383:00 +CPU= 19.278
  22:04:16 STEP  384 H= 384:00 +CPU= 34.174
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000384
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000384
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000384
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000360
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000360
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000360
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000372
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000372
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000372
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_0_r644475507_15.zip
Uploading the intermediate file: upload_file_15.zip
  22:04:35 STEP  385 H= 385:00 +CPU= 18.589
  22:04:55 STEP  386 H= 386:00 +CPU= 19.425
  22:05:26 STEP  387 H= 387:00 +CPU= 28.978
  22:05:45 STEP  388 H= 388:00 +CPU= 18.794
  22:06:05 STEP  389 H= 389:00 +CPU= 18.765
  22:06:36 STEP  390 H= 390:00 +CPU= 30.190
  22:06:56 STEP  391 H= 391:00 +CPU= 18.654
  22:07:16 STEP  392 H= 392:00 +CPU= 19.286
  22:07:46 STEP  393 H= 393:00 +CPU= 29.165
  22:08:06 STEP  394 H= 394:00 +CPU= 19.031
  22:08:26 STEP  395 H= 395:00 +CPU= 18.664
  22:08:58 STEP  396 H= 396:00 +CPU= 31.407
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000396
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000396
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000396
  22:09:18 STEP  397 H= 397:00 +CPU= 18.603
  22:09:38 STEP  398 H= 398:00 +CPU= 18.980
  22:10:08 STEP  399 H= 399:00 +CPU= 29.465
  22:10:28 STEP  400 H= 400:00 +CPU= 19.025
  22:10:48 STEP  401 H= 401:00 +CPU= 18.769
  22:11:18 STEP  402 H= 402:00 +CPU= 29.356
  22:11:38 STEP  403 H= 403:00 +CPU= 18.415
  22:11:58 STEP  404 H= 404:00 +CPU= 19.391
  22:12:28 STEP  405 H= 405:00 +CPU= 28.828
  22:12:48 STEP  406 H= 406:00 +CPU= 19.078
  22:13:08 STEP  407 H= 407:00 +CPU= 18.996
  22:13:44 STEP  408 H= 408:00 +CPU= 34.519
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000408
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000408
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000408
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000384
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000384
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000384
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000396
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000396
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000396
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_0_r644475507_16.zip
Uploading the intermediate file: upload_file_16.zip
  22:14:04 STEP  409 H= 409:00 +CPU= 18.923
  22:14:24 STEP  410 H= 410:00 +CPU= 19.158
  22:14:54 STEP  411 H= 411:00 +CPU= 28.914
  22:15:14 STEP  412 H= 412:00 +CPU= 19.001
  22:15:33 STEP  413 H= 413:00 +CPU= 18.550
  22:16:04 STEP  414 H= 414:00 +CPU= 29.467
  22:16:23 STEP  415 H= 415:00 +CPU= 18.375
  22:16:43 STEP  416 H= 416:00 +CPU= 19.088
  22:17:13 STEP  417 H= 417:00 +CPU= 29.011
  22:17:33 STEP  418 H= 418:00 +CPU= 18.929
  22:17:52 STEP  419 H= 419:00 +CPU= 18.518
  22:18:25 STEP  420 H= 420:00 +CPU= 31.231
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000420
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000420
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000420
  22:18:44 STEP  421 H= 421:00 +CPU= 18.529
  22:19:04 STEP  422 H= 422:00 +CPU= 18.871
  22:19:34 STEP  423 H= 423:00 +CPU= 28.755
  22:19:54 STEP  424 H= 424:00 +CPU= 19.113
  22:20:13 STEP  425 H= 425:00 +CPU= 18.484
  22:20:46 STEP  426 H= 426:00 +CPU= 30.732
  22:21:09 STEP  427 H= 427:00 +CPU= 21.046
  22:21:29 STEP  428 H= 428:00 +CPU= 19.502
  22:22:00 STEP  429 H= 429:00 +CPU= 29.196
  22:22:20 STEP  430 H= 430:00 +CPU= 18.944
  22:22:40 STEP  431 H= 431:00 +CPU= 19.087
  22:23:15 STEP  432 H= 432:00 +CPU= 34.020
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000432
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000432
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000432
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000408
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000408
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000408
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000420
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000420
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000420
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_0_r644475507_17.zip
Uploading the intermediate file: upload_file_17.zip
  22:23:35 STEP  433 H= 433:00 +CPU= 18.707
  22:23:55 STEP  434 H= 434:00 +CPU= 19.161
  22:24:25 STEP  435 H= 435:00 +CPU= 28.648
  22:24:45 STEP  436 H= 436:00 +CPU= 19.018
  22:25:04 STEP  437 H= 437:00 +CPU= 18.380
  22:25:34 STEP  438 H= 438:00 +CPU= 29.485
  22:25:54 STEP  439 H= 439:00 +CPU= 18.296
  22:26:13 STEP  440 H= 440:00 +CPU= 19.043
  22:26:44 STEP  441 H= 441:00 +CPU= 28.935
  22:27:03 STEP  442 H= 442:00 +CPU= 18.965
  22:27:23 STEP  443 H= 443:00 +CPU= 18.461
  22:27:56 STEP  444 H= 444:00 +CPU= 31.603
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000444
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000444
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000444
  22:28:15 STEP  445 H= 445:00 +CPU= 18.616
  22:28:34 STEP  446 H= 446:00 +CPU= 18.711
  22:29:05 STEP  447 H= 447:00 +CPU= 29.071
  22:29:24 STEP  448 H= 448:00 +CPU= 18.911
  22:29:44 STEP  449 H= 449:00 +CPU= 18.550
  22:30:14 STEP  450 H= 450:00 +CPU= 29.189
  22:30:34 STEP  451 H= 451:00 +CPU= 18.566
  22:30:53 STEP  452 H= 452:00 +CPU= 18.675
  22:31:23 STEP  453 H= 453:00 +CPU= 28.881
  22:31:43 STEP  454 H= 454:00 +CPU= 18.883
  22:32:03 STEP  455 H= 455:00 +CPU= 18.861
  22:32:38 STEP  456 H= 456:00 +CPU= 33.943
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000456
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000456
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000456
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000432
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000432
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000432
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000444
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000444
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000444
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_0_r644475507_18.zip
Uploading the intermediate file: upload_file_18.zip
  22:32:57 STEP  457 H= 457:00 +CPU= 18.636
  22:33:17 STEP  458 H= 458:00 +CPU= 19.029
  22:33:48 STEP  459 H= 459:00 +CPU= 29.191
  22:34:07 STEP  460 H= 460:00 +CPU= 18.814
  22:34:26 STEP  461 H= 461:00 +CPU= 18.230
  22:34:57 STEP  462 H= 462:00 +CPU= 29.283
  22:35:17 STEP  463 H= 463:00 +CPU= 18.960
  22:35:37 STEP  464 H= 464:00 +CPU= 19.082
  22:36:06 STEP  465 H= 465:00 +CPU= 28.476
  22:36:26 STEP  466 H= 466:00 +CPU= 19.090
  22:36:45 STEP  467 H= 467:00 +CPU= 18.427
  22:37:18 STEP  468 H= 468:00 +CPU= 31.445
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000468
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000468
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000468
  22:37:38 STEP  469 H= 469:00 +CPU= 18.673
  22:37:57 STEP  470 H= 470:00 +CPU= 18.896
  22:38:28 STEP  471 H= 471:00 +CPU= 28.877
  22:38:47 STEP  472 H= 472:00 +CPU= 18.780
  22:39:07 STEP  473 H= 473:00 +CPU= 18.966
  22:39:38 STEP  474 H= 474:00 +CPU= 29.474
  22:39:57 STEP  475 H= 475:00 +CPU= 18.345
  22:40:17 STEP  476 H= 476:00 +CPU= 19.147
  22:40:49 STEP  477 H= 477:00 +CPU= 30.402
  22:41:10 STEP  478 H= 478:00 +CPU= 19.439
  22:41:30 STEP  479 H= 479:00 +CPU= 19.273
  22:42:06 STEP  480 H= 480:00 +CPU= 34.154
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000480
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000480
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000480
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000456
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000456
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000456
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000468
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000468
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000468
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_0_r644475507_19.zip
Uploading the intermediate file: upload_file_19.zip
  22:42:25 STEP  481 H= 481:00 +CPU= 18.457
Uploading trickle at timestep: 1728000
  22:42:45 STEP  482 H= 482:00 +CPU= 19.620
  22:43:16 STEP  483 H= 483:00 +CPU= 29.252
  22:43:36 STEP  484 H= 484:00 +CPU= 18.750
  22:43:55 STEP  485 H= 485:00 +CPU= 18.839
  22:44:26 STEP  486 H= 486:00 +CPU= 29.376
  22:44:45 STEP  487 H= 487:00 +CPU= 18.517
  22:45:05 STEP  488 H= 488:00 +CPU= 19.100
  22:45:35 STEP  489 H= 489:00 +CPU= 28.711
  22:45:55 STEP  490 H= 490:00 +CPU= 19.227
  22:46:14 STEP  491 H= 491:00 +CPU= 18.350
  22:46:47 STEP  492 H= 492:00 +CPU= 31.713
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000492
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000492
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000492
  22:47:07 STEP  493 H= 493:00 +CPU= 18.760
  22:47:27 STEP  494 H= 494:00 +CPU= 19.025
  22:47:57 STEP  495 H= 495:00 +CPU= 29.068
  22:48:17 STEP  496 H= 496:00 +CPU= 19.224
  22:48:36 STEP  497 H= 497:00 +CPU= 18.283
  22:49:07 STEP  498 H= 498:00 +CPU= 29.283
  22:49:26 STEP  499 H= 499:00 +CPU= 18.431
  22:49:46 STEP  500 H= 500:00 +CPU= 18.863
  22:50:16 STEP  501 H= 501:00 +CPU= 29.200
  22:50:36 STEP  502 H= 502:00 +CPU= 19.161
  22:50:56 STEP  503 H= 503:00 +CPU= 18.792
  22:51:31 STEP  504 H= 504:00 +CPU= 33.786
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000504
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000504
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000504
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000480
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000480
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000480
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000492
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000492
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000492
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_0_r644475507_20.zip
Uploading the intermediate file: upload_file_20.zip
  22:51:50 STEP  505 H= 505:00 +CPU= 18.241
  22:52:10 STEP  506 H= 506:00 +CPU= 18.872
  22:52:40 STEP  507 H= 507:00 +CPU= 29.083
  22:53:00 STEP  508 H= 508:00 +CPU= 18.724
  22:53:19 STEP  509 H= 509:00 +CPU= 18.408
  22:53:49 STEP  510 H= 510:00 +CPU= 29.288
  22:54:08 STEP  511 H= 511:00 +CPU= 18.369
  22:54:28 STEP  512 H= 512:00 +CPU= 18.917
  22:54:58 STEP  513 H= 513:00 +CPU= 28.971
  22:55:18 STEP  514 H= 514:00 +CPU= 18.964
  22:55:38 STEP  515 H= 515:00 +CPU= 18.648
  22:56:11 STEP  516 H= 516:00 +CPU= 31.579
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000516
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000516
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000516
  22:56:30 STEP  517 H= 517:00 +CPU= 18.398
  22:56:50 STEP  518 H= 518:00 +CPU= 19.193
  22:57:20 STEP  519 H= 519:00 +CPU= 28.932
  22:57:40 STEP  520 H= 520:00 +CPU= 19.153
  22:58:00 STEP  521 H= 521:00 +CPU= 19.009
  22:58:31 STEP  522 H= 522:00 +CPU= 29.587
  22:58:50 STEP  523 H= 523:00 +CPU= 18.412
  22:59:10 STEP  524 H= 524:00 +CPU= 19.161
  22:59:40 STEP  525 H= 525:00 +CPU= 28.941
  23:00:00 STEP  526 H= 526:00 +CPU= 18.821
  23:00:21 STEP  527 H= 527:00 +CPU= 20.034
  23:01:00 STEP  528 H= 528:00 +CPU= 36.753
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000528
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000528
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000528
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000504
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000504
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000504
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000516
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000516
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000516
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_0_r644475507_21.zip
Uploading the intermediate file: upload_file_21.zip
  23:01:20 STEP  529 H= 529:00 +CPU= 18.783
  23:01:40 STEP  530 H= 530:00 +CPU= 19.280
  23:02:10 STEP  531 H= 531:00 +CPU= 28.753
  23:02:30 STEP  532 H= 532:00 +CPU= 18.850
  23:02:49 STEP  533 H= 533:00 +CPU= 18.468
  23:03:19 STEP  534 H= 534:00 +CPU= 29.136
  23:03:38 STEP  535 H= 535:00 +CPU= 18.165
  23:03:58 STEP  536 H= 536:00 +CPU= 18.840
  23:04:28 STEP  537 H= 537:00 +CPU= 28.815
  23:04:47 STEP  538 H= 538:00 +CPU= 18.695
  23:05:07 STEP  539 H= 539:00 +CPU= 18.413
  23:05:39 STEP  540 H= 540:00 +CPU= 31.256
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000540
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000540
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000540
  23:05:58 STEP  541 H= 541:00 +CPU= 18.349
  23:06:18 STEP  542 H= 542:00 +CPU= 18.710
  23:06:48 STEP  543 H= 543:00 +CPU= 28.787
  23:07:08 STEP  544 H= 544:00 +CPU= 18.826
  23:07:27 STEP  545 H= 545:00 +CPU= 18.610
  23:07:57 STEP  546 H= 546:00 +CPU= 29.086
  23:08:16 STEP  547 H= 547:00 +CPU= 18.183
  23:08:36 STEP  548 H= 548:00 +CPU= 19.128
  23:09:06 STEP  549 H= 549:00 +CPU= 28.810
  23:09:26 STEP  550 H= 550:00 +CPU= 18.825
  23:09:46 STEP  551 H= 551:00 +CPU= 19.036
  23:10:21 STEP  552 H= 552:00 +CPU= 33.825
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000552
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000552
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000552
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000528
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000528
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000528
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000540
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000540
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000540
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_0_r644475507_22.zip
Uploading the intermediate file: upload_file_22.zip
  23:10:40 STEP  553 H= 553:00 +CPU= 18.270
  23:11:00 STEP  554 H= 554:00 +CPU= 18.835
  23:11:30 STEP  555 H= 555:00 +CPU= 28.821
  23:11:49 STEP  556 H= 556:00 +CPU= 18.757
  23:12:09 STEP  557 H= 557:00 +CPU= 18.699
  23:12:40 STEP  558 H= 558:00 +CPU= 29.418
  23:12:59 STEP  559 H= 559:00 +CPU= 18.330
  23:13:19 STEP  560 H= 560:00 +CPU= 19.166
  23:13:49 STEP  561 H= 561:00 +CPU= 29.066
  23:14:09 STEP  562 H= 562:00 +CPU= 18.828
  23:14:28 STEP  563 H= 563:00 +CPU= 18.432
  23:15:01 STEP  564 H= 564:00 +CPU= 31.279
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000564
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000564
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000564
  23:15:20 STEP  565 H= 565:00 +CPU= 18.161
  23:15:40 STEP  566 H= 566:00 +CPU= 19.257
  23:16:10 STEP  567 H= 567:00 +CPU= 28.894
  23:16:29 STEP  568 H= 568:00 +CPU= 18.596
  23:16:48 STEP  569 H= 569:00 +CPU= 18.296
  23:17:19 STEP  570 H= 570:00 +CPU= 29.153
  23:17:38 STEP  571 H= 571:00 +CPU= 18.328
  23:17:57 STEP  572 H= 572:00 +CPU= 18.779
  23:18:28 STEP  573 H= 573:00 +CPU= 28.870
  23:18:47 STEP  574 H= 574:00 +CPU= 18.706
  23:19:07 STEP  575 H= 575:00 +CPU= 18.830
  23:19:42 STEP  576 H= 576:00 +CPU= 34.074
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000576
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000576
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000576
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000552
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000552
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000552
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000564
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000564
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000564
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_0_r644475507_23.zip
Uploading the intermediate file: upload_file_23.zip
  23:20:01 STEP  577 H= 577:00 +CPU= 18.514
  23:20:22 STEP  578 H= 578:00 +CPU= 19.137
  23:20:52 STEP  579 H= 579:00 +CPU= 29.135
  23:21:12 STEP  580 H= 580:00 +CPU= 19.031
  23:21:31 STEP  581 H= 581:00 +CPU= 18.603
  23:22:02 STEP  582 H= 582:00 +CPU= 29.480
  23:22:21 STEP  583 H= 583:00 +CPU= 18.290
  23:22:41 STEP  584 H= 584:00 +CPU= 19.263
  23:23:14 STEP  585 H= 585:00 +CPU= 30.499
  23:23:34 STEP  586 H= 586:00 +CPU= 18.723
  23:23:53 STEP  587 H= 587:00 +CPU= 18.763
  23:24:26 STEP  588 H= 588:00 +CPU= 31.442
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000588
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000588
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000588
  23:24:45 STEP  589 H= 589:00 +CPU= 18.237
  23:25:05 STEP  590 H= 590:00 +CPU= 18.949
  23:25:35 STEP  591 H= 591:00 +CPU= 28.867
  23:25:54 STEP  592 H= 592:00 +CPU= 18.756
  23:26:14 STEP  593 H= 593:00 +CPU= 18.423
  23:26:44 STEP  594 H= 594:00 +CPU= 29.311
  23:27:03 STEP  595 H= 595:00 +CPU= 18.256
  23:27:23 STEP  596 H= 596:00 +CPU= 18.965
  23:27:53 STEP  597 H= 597:00 +CPU= 28.990
  23:28:13 STEP  598 H= 598:00 +CPU= 18.749
  23:28:33 STEP  599 H= 599:00 +CPU= 19.166
  23:29:08 STEP  600 H= 600:00 +CPU= 33.401
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000600
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000600
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000600
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000576
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000576
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000576
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000588
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000588
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000588
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_0_r644475507_24.zip
Uploading the intermediate file: upload_file_24.zip
  23:29:27 STEP  601 H= 601:00 +CPU= 18.200
  23:29:46 STEP  602 H= 602:00 +CPU= 18.886
  23:30:16 STEP  603 H= 603:00 +CPU= 28.810
  23:30:36 STEP  604 H= 604:00 +CPU= 18.694
  23:30:55 STEP  605 H= 605:00 +CPU= 18.549
  23:31:26 STEP  606 H= 606:00 +CPU= 29.578
  23:31:45 STEP  607 H= 607:00 +CPU= 18.249
  23:32:05 STEP  608 H= 608:00 +CPU= 18.959
  23:32:35 STEP  609 H= 609:00 +CPU= 28.736
  23:32:54 STEP  610 H= 610:00 +CPU= 19.002
  23:33:14 STEP  611 H= 611:00 +CPU= 18.354
  23:33:46 STEP  612 H= 612:00 +CPU= 31.182
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000612
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000612
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000612
  23:34:05 STEP  613 H= 613:00 +CPU= 18.333
  23:34:25 STEP  614 H= 614:00 +CPU= 18.689
  23:34:55 STEP  615 H= 615:00 +CPU= 29.073
  23:35:15 STEP  616 H= 616:00 +CPU= 18.899
  23:35:34 STEP  617 H= 617:00 +CPU= 18.507
  23:36:05 STEP  618 H= 618:00 +CPU= 29.485
  23:36:24 STEP  619 H= 619:00 +CPU= 18.240
  23:36:43 STEP  620 H= 620:00 +CPU= 18.766
  23:37:13 STEP  621 H= 621:00 +CPU= 28.673
  23:37:33 STEP  622 H= 622:00 +CPU= 18.845
  23:37:52 STEP  623 H= 623:00 +CPU= 18.684
  23:38:27 STEP  624 H= 624:00 +CPU= 33.574
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000624
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000624
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000624
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000600
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000600
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000600
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000612
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000612
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000612
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_0_r644475507_25.zip
Uploading the intermediate file: upload_file_25.zip
  23:38:46 STEP  625 H= 625:00 +CPU= 18.328
  23:39:06 STEP  626 H= 626:00 +CPU= 18.997
  23:39:36 STEP  627 H= 627:00 +CPU= 28.724
  23:39:56 STEP  628 H= 628:00 +CPU= 18.864
  23:40:15 STEP  629 H= 629:00 +CPU= 18.513
  23:40:46 STEP  630 H= 630:00 +CPU= 29.535
  23:41:05 STEP  631 H= 631:00 +CPU= 18.301
  23:41:25 STEP  632 H= 632:00 +CPU= 19.019
  23:41:55 STEP  633 H= 633:00 +CPU= 28.631
  23:42:15 STEP  634 H= 634:00 +CPU= 18.832
  23:42:34 STEP  635 H= 635:00 +CPU= 18.539
  23:43:06 STEP  636 H= 636:00 +CPU= 31.192
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000636
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000636
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000636
  23:43:25 STEP  637 H= 637:00 +CPU= 18.200
  23:43:45 STEP  638 H= 638:00 +CPU= 18.927
  23:44:15 STEP  639 H= 639:00 +CPU= 29.113
  23:44:35 STEP  640 H= 640:00 +CPU= 18.810
  23:44:54 STEP  641 H= 641:00 +CPU= 18.333
  23:45:25 STEP  642 H= 642:00 +CPU= 29.460
  23:45:44 STEP  643 H= 643:00 +CPU= 18.283
  23:46:04 STEP  644 H= 644:00 +CPU= 19.063
  23:46:34 STEP  645 H= 645:00 +CPU= 28.796
  23:46:53 STEP  646 H= 646:00 +CPU= 18.596
  23:47:13 STEP  647 H= 647:00 +CPU= 18.925
  23:47:48 STEP  648 H= 648:00 +CPU= 33.698
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000648
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000648
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000648
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000624
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000624
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000624
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000636
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000636
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000636
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_0_r644475507_26.zip
Uploading the intermediate file: upload_file_26.zip
  23:48:08 STEP  649 H= 649:00 +CPU= 18.653
  23:48:27 STEP  650 H= 650:00 +CPU= 19.024
  23:48:57 STEP  651 H= 651:00 +CPU= 28.734
  23:49:17 STEP  652 H= 652:00 +CPU= 18.743
  23:49:36 STEP  653 H= 653:00 +CPU= 18.351
  23:50:07 STEP  654 H= 654:00 +CPU= 29.507
  23:50:25 STEP  655 H= 655:00 +CPU= 18.116
  23:50:45 STEP  656 H= 656:00 +CPU= 18.872
  23:51:15 STEP  657 H= 657:00 +CPU= 28.871
  23:51:35 STEP  658 H= 658:00 +CPU= 18.688
  23:51:54 STEP  659 H= 659:00 +CPU= 18.808
  23:52:27 STEP  660 H= 660:00 +CPU= 31.292
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000660
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000660
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000660
  23:52:46 STEP  661 H= 661:00 +CPU= 18.076
  23:53:05 STEP  662 H= 662:00 +CPU= 18.828
  23:53:35 STEP  663 H= 663:00 +CPU= 28.355
  23:53:54 STEP  664 H= 664:00 +CPU= 18.672
  23:54:13 STEP  665 H= 665:00 +CPU= 18.436
  23:54:44 STEP  666 H= 666:00 +CPU= 29.194
  23:55:03 STEP  667 H= 667:00 +CPU= 18.396
  23:55:23 STEP  668 H= 668:00 +CPU= 18.945
  23:55:53 STEP  669 H= 669:00 +CPU= 29.008
  23:56:12 STEP  670 H= 670:00 +CPU= 18.531
  23:56:32 STEP  671 H= 671:00 +CPU= 18.778
  23:57:07 STEP  672 H= 672:00 +CPU= 33.567
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000672
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000672
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000672
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000648
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000648
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000648
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000660
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000660
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000660
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_0_r644475507_27.zip
Uploading the intermediate file: upload_file_27.zip
  23:57:26 STEP  673 H= 673:00 +CPU= 18.316
  23:57:46 STEP  674 H= 674:00 +CPU= 18.914
  23:58:16 STEP  675 H= 675:00 +CPU= 28.779
  23:58:36 STEP  676 H= 676:00 +CPU= 18.833
  23:58:55 STEP  677 H= 677:00 +CPU= 18.208
  23:59:25 STEP  678 H= 678:00 +CPU= 29.020
  23:59:44 STEP  679 H= 679:00 +CPU= 18.441
  00:00:04 STEP  680 H= 680:00 +CPU= 18.671
  00:00:37 STEP  681 H= 681:00 +CPU= 31.253
  00:00:58 STEP  682 H= 682:00 +CPU= 20.199
  00:01:17 STEP  683 H= 683:00 +CPU= 18.144
  00:01:52 STEP  684 H= 684:00 +CPU= 32.875
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000684
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000684
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000684
  00:02:11 STEP  685 H= 685:00 +CPU= 18.234
  00:02:31 STEP  686 H= 686:00 +CPU= 19.083
  00:03:01 STEP  687 H= 687:00 +CPU= 28.647
  00:03:20 STEP  688 H= 688:00 +CPU= 18.555
  00:03:40 STEP  689 H= 689:00 +CPU= 18.723
  00:04:10 STEP  690 H= 690:00 +CPU= 29.200
  00:04:29 STEP  691 H= 691:00 +CPU= 18.187
  00:04:49 STEP  692 H= 692:00 +CPU= 18.687
  00:05:19 STEP  693 H= 693:00 +CPU= 28.772
  00:05:38 STEP  694 H= 694:00 +CPU= 18.690
  00:05:58 STEP  695 H= 695:00 +CPU= 19.123
  00:06:31 STEP  696 H= 696:00 +CPU= 31.582
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000696
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000696
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000696
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000672
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000672
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000672
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000684
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000684
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000684
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_0_r644475507_28.zip
Uploading the intermediate file: upload_file_28.zip
  00:06:48 STEP  697 H= 697:00 +CPU= 17.188
  00:07:06 STEP  698 H= 698:00 +CPU= 17.230
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:07:44 STEP  699 H= 699:00 +CPU= 29.839
  00:08:02 STEP  700 H= 700:00 +CPU= 17.117
  00:08:19 STEP  701 H= 701:00 +CPU= 16.676
  00:08:47 STEP  702 H= 702:00 +CPU= 27.359
  00:09:05 STEP  703 H= 703:00 +CPU= 17.687
  00:09:24 STEP  704 H= 704:00 +CPU= 18.440
  00:09:51 STEP  705 H= 705:00 +CPU= 26.318
  00:10:08 STEP  706 H= 706:00 +CPU= 17.252
  00:10:26 STEP  707 H= 707:00 +CPU= 17.150
  00:11:00 STEP  708 H= 708:00 +CPU= 32.137
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000708
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000708
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000708
  00:11:20 STEP  709 H= 709:00 +CPU= 18.868
  00:11:40 STEP  710 H= 710:00 +CPU= 19.179
  00:12:10 STEP  711 H= 711:00 +CPU= 28.655
  00:12:29 STEP  712 H= 712:00 +CPU= 18.808
  00:12:48 STEP  713 H= 713:00 +CPU= 18.492
  00:13:19 STEP  714 H= 714:00 +CPU= 29.258
  00:13:38 STEP  715 H= 715:00 +CPU= 18.372
  00:13:58 STEP  716 H= 716:00 +CPU= 19.284
  00:14:28 STEP  717 H= 717:00 +CPU= 28.678
  00:14:47 STEP  718 H= 718:00 +CPU= 18.513
  00:15:07 STEP  719 H= 719:00 +CPU= 18.894
  00:15:42 STEP  720 H= 720:00 +CPU= 33.710
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000720
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000720
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000720
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000696
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000696
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000696
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMGGhnw4+000708
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMSHhnw4+000708
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214027/ICMUAhnw4+000708
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00gd_2019110100_123_993_12214027_0_r644475507_29.zip
Uploading the intermediate file: upload_file_29.zip
  00:16:02 STEP  721 H= 721:00 +CPU= 18.518
Uploading trickle at timestep: 2592000
  00:16:21 STEP  722 H= 722:00 +CPU= 18.894
  00:16:51 STEP  723 H= 723:00 +CPU= 28.649
  00:17:11 STEP  724 H= 724:00 +CPU= 19.090
  00:17:31 STEP  725 H= 725:00 +CPU= 18.812
  00:18:01 STEP  726 H= 726:00 +CPU= 29.287
  00:18:20 STEP  727 H= 727:00 +CPU= 18.309
  00:18:41 STEP  728 H= 728:00 +CPU= 19.383
  00:19:11 STEP  729 H= 729:00 +CPU= 28.748
  00:19:33 STEP  730 H= 730:00 +CPU= 20.882
  00:19:55 STEP  731 H= 731:00 +CPU= 20.178
  00:20:28 STEP  732 H= 732:00 +CPU= 31.299
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000732
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000732
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000732
..The child process has been killed with signal: 9
>>> Printing last 70 lines from file: NODE.001_01

         AVE   0.270457395278062E-05 0.000000000000000E+00 0.106688952997199E-02
 GPNORM SFL                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.200362762840619E-05 0.000000000000000E+00 0.927803631427650E-03
 GPNORM CRFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.574556235721582E-05 0.000000000000000E+00 0.338075459854383E-02
 GPNORM CSFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.165330133965954E-05 0.000000000000000E+00 0.262490933745958E-02
 GPNORM PFRC                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.134615438729762E+00 0.000000000000000E+00 0.100000000000000E+01
 NSTEP =   732 STEPO   A00000000
  MAXGPFV : MAX. VALUE =    1.17276193653273     
  MAXGPFV : MAX. VALUE =   0.752401619830861     
 NSTEP =   732 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGhnw4+000732 MODE=w
 IO-STREAM CLOSED - ICMGGhnw4+000732
 MPI-TASK:   1 -   1275365407 BYTES IN     27 RECORDS TRANSFERRED IN    0.0017 SECONDS750215.0 Mbytes/s, TOTAL TIME=    0.0316( 5.4%)
 NSTEP =   732 STEPO   0AA000000
  SPECTRAL NORMS: Pattern  1
 STEPO, YSPSDT_AR1     (  1,...), SP NORMS 2D: 5.378024345506E-01 1.695317523496E-01 7.270023245952E-02
 STEPO, YSPSDT_AR1     (SUM,...), SP NORMS 2D: 5.838818768158E-01
 STEPO, YGPSDT         (  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60 -3.32089134051879E-02 -2.31507573318636E+00  2.09841875253185E+00
 STEPO, YGPSDT[clipped](  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60 -2.89584771915677E-02 -1.00000000000000E+00  1.00000000000000E+00
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMSHhnw4+000732 MODE=a
 IO-STREAM CLOSED - ./ICMSHhnw4+000732
 MPI-TASK:   1 -   8019156404 BYTES IN    115 RECORDS TRANSFERRED IN    0.0055 SECONDS******** Mbytes/s, TOTAL TIME=    0.1451( 3.8%)
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAhnw4+000732 MODE=a
 IO-STREAM CLOSED - ./ICMUAhnw4+000732
 MPI-TASK:   1 -    956524053 BYTES IN     19 RECORDS TRANSFERRED IN    0.0012 SECONDS797103.4 Mbytes/s, TOTAL TIME=    0.0230( 5.2%)
 STEPO_FPOS WAS : B00000F00E
 NSTEP =   732 STEPO   0AAA00AAA
  SPECTRAL NORMS: Pattern  1
 STEPO, YSPSDT_AR1     (  1,...), SP NORMS 2D: 5.378024345506E-01 1.695317523496E-01 7.270023245952E-02
 STEPO, YSPSDT_AR1     (SUM,...), SP NORMS 2D: 5.838818768158E-01
 STEPO, YGPSDT         (  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60 -3.32089134051879E-02 -2.31507573318636E+00  2.09841875253185E+00
 STEPO, YGPSDT[clipped](  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60 -2.89584771915677E-02 -1.00000000000000E+00  1.00000000000000E+00
  STEPO: evolving YSPSDT_AR1(  1)
  MAXGPFV : MAX. VALUE =    1.14031798912911     
  MAXGPFV : MAX. VALUE =   0.753632912190634     
 NSTEP =   732 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGhnw4+000732 MODE=a
 IO-STREAM CLOSED - ICMGGhnw4+000732
 MPI-TASK:   1 -    318841354 BYTES IN      8 RECORDS TRANSFERRED IN    0.0003 SECONDS******** Mbytes/s, TOTAL TIME=    0.0070( 4.3%)
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20191201111500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20191201113000  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20191201114500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20191201120000  !!!!!!!!!!!! 
 00:20:28 STEP  732 H= 732:00 +CPU= 31.299
 NSTEP =   733 STEPO   0AAA00AAA
  SPECTRAL NORMS: Pattern  1
 STEPO, YSPSDT_AR1     (  1,...), SP NORMS 2D: 5.288113078851E-01 1.722343276822E-01 7.262072135153E-02
 STEPO, YSPSDT_AR1     (SUM,...), SP NORMS 2D: 5.758703765875E-01
 STEPO, YGPSDT         (  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60 -3.03878530520818E-02 -1.87184090037628E+00  2.09884177044494E+00
 STEPO, YGPSDT[clipped](  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60 -2.67491666835193E-02 -1.00000000000000E+00  1.00000000000000E+00
------------------------------------------------
CNT0 not found; string returned was: 'STEPO'
>>> Printing last 8 lines from file: ifs.stat

 00:19:11 0AAA00AAA STEPO      730    28.748   28.748   30.005    269:19    283:48 0.11513664227895E-04       2GB       0MB
 00:19:33 0AAA00AAA STEPO      731    20.882   20.882   22.633    269:40    284:10 0.11513664227895E-04       2GB       0MB
 00:19:55 A00000000 STEPO      732    20.368   20.368   21.935    270:01    284:32 0.11513664227895E-04       2GB       0MB
 00:19:55 0AA000000 STEPO      732     0.063    0.063    0.064    270:01    284:32 0.11513664227895E-04       2GB       0MB
 00:19:56 FULLPOS-B DYNFPOS    732     0.753    0.753    0.771    270:01    284:33 0.11513664227895E-04       2GB       0MB
 00:19:57 0AAA00AAA STEPO      732     1.159    1.159    1.262    270:03    284:35 0.11513664227895E-04       2GB       0MB
 00:20:28 0AAA00AAA STEPO      733    29.137   29.137   30.595    270:32    285:05 0.11513664227895E-04       2GB       0MB
------------------------------------------------
>>> Printing last 11 lines from file: rcf

 CSTEP   = "     720",
 CTIME   = "00300000      ",
 NSTEPLPP        =         201,         202,          49,      228226,      228227, 5*0,
 IPRGPNSRES      =           1,
 IPRGPEWRES      =           1,
 IPRTRWRES       =           1,
 IPRTRVRES       =           1,
 GMASS0  =   98322.8418653003     ,
 GMASSI  =   98322.6065728791     
 /
------------------------------------------------
>>> Printing last 17 lines from file: waminfo

PARAM=10U/10V,                                                          
REPRES=GG,                                                              
ANALYSIS PERIOD =       0                                               
FORECAST PERIOD =    8038800                                            
WIND TIME STEP IN SECONDS =    3600                                     
ANALYSIS FROM 20191101000000 TO 20191101000000                          
ASSIMILATION NO                                                         
NEW FORECAST NO                                                         
STATUS STORM1= UNFINISHED                                               
STATUS STORM2= UNFINISHED                                               
STATUS STORM3= UNFINISHED                                               
DATE FOR OUTPUT OF BOTH RESTART FILES = 00000000000000                  
LAST DATE FOR SPECTRA FILE OUTPUT = 20200303000000                      
BEGIN DATE FOR USING SURFACE CURRENT = 20191101000000                   
PARALLEL RESTART = YES                                                  
NUMBER OF MPI TASKS USED =          1                                   
------------------------------------------------
>>> Printing last 8 lines from file: /var/lib/boinc/slots/1/progress_file_12214027.xml

<running_values>
  <last_cpu_time>16245.530000</last_cpu_time>
  <upload_file_number>30</upload_file_number>
  <last_iter>733</last_iter>
  <last_upload>2592000</last_upload>
  <model_completed>0</model_completed>
</running_values>
------------------------------------------------
..Failed, model did not complete successfully

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:52:58 1534737 22315383 oifs_43r3_00gd_2019110100_123_993_12214027_0 2,592,000 15,961 0.0062
09 May 2023 16:52:54 1534737 22315383 oifs_43r3_00gd_2019110100_123_993_12214027_0 1,728,000 10,589 0.0061
09 May 2023 16:52:50 1534737 22315383 oifs_43r3_00gd_2019110100_123_993_12214027_0 864,000 5,141 0.0060


©2024 climateprediction.net