climateprediction.net home page
Task 22450006

Task 22450006

Name oifs_43r3_bl_a2hy_2016092300_20_1018_12291565_1
Workunit 12291565
Created 19 Jun 2024, 5:11:16 UTC
Sent 19 Jun 2024, 5:11:45 UTC
Report deadline 18 Aug 2024, 5:11:45 UTC
Received 22 Jun 2024, 21:36:24 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1522755
Run time 13 hours 56 min 58 sec
CPU time 13 hours 51 min 14 sec
Validate state Valid
Credit 2,635.55
Device peak FLOPS 7.59 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,025.72 MB
Peak swap size 5,981.07 MB
Peak disk usage 1,335.88 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<stderr_txt>
.480
  17:03:53 STEP 1276 H= 319:00 +CPU= 23.658
  17:04:19 STEP 1277 H= 319:15 +CPU= 25.536
  17:04:44 STEP 1278 H= 319:30 +CPU= 25.699
  17:05:09 STEP 1279 H= 319:45 +CPU= 24.027
  17:05:33 STEP 1280 H= 320:00 +CPU= 24.883
  17:05:59 STEP 1281 H= 320:15 +CPU= 25.262
  17:06:25 STEP 1282 H= 320:30 +CPU= 25.988
  17:06:51 STEP 1283 H= 320:45 +CPU= 25.559
  17:07:22 STEP 1284 H= 321:00 +CPU= 31.071
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001284
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001284
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001284
  17:07:47 STEP 1285 H= 321:15 +CPU= 24.987
  17:08:12 STEP 1286 H= 321:30 +CPU= 24.879
  17:08:35 STEP 1287 H= 321:45 +CPU= 23.089
  17:09:00 STEP 1288 H= 322:00 +CPU= 24.901
  17:09:23 STEP 1289 H= 322:15 +CPU= 22.982
  17:09:48 STEP 1290 H= 322:30 +CPU= 25.254
  17:10:13 STEP 1291 H= 322:45 +CPU= 24.432
  17:10:38 STEP 1292 H= 323:00 +CPU= 25.154
  17:11:02 STEP 1293 H= 323:15 +CPU= 24.283
  17:11:27 STEP 1294 H= 323:30 +CPU= 24.508
  17:11:51 STEP 1295 H= 323:45 +CPU= 24.305
  17:12:26 STEP 1296 H= 324:00 +CPU= 34.355
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001296
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001296
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001296
  17:12:52 STEP 1297 H= 324:15 +CPU= 26.230
  17:13:18 STEP 1298 H= 324:30 +CPU= 25.813
  17:13:43 STEP 1299 H= 324:45 +CPU= 24.882
  17:14:08 STEP 1300 H= 325:00 +CPU= 25.009
  17:14:33 STEP 1301 H= 325:15 +CPU= 25.113
  17:14:58 STEP 1302 H= 325:30 +CPU= 24.982
  17:15:23 STEP 1303 H= 325:45 +CPU= 25.209
  17:15:49 STEP 1304 H= 326:00 +CPU= 26.031
  17:16:14 STEP 1305 H= 326:15 +CPU= 24.310
  17:16:38 STEP 1306 H= 326:30 +CPU= 24.130
  17:17:05 STEP 1307 H= 326:45 +CPU= 26.744
  17:17:37 STEP 1308 H= 327:00 +CPU= 31.917
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001308
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001308
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001308
  17:18:02 STEP 1309 H= 327:15 +CPU= 25.094
  17:18:28 STEP 1310 H= 327:30 +CPU= 25.785
  17:18:54 STEP 1311 H= 327:45 +CPU= 25.774
  17:19:21 STEP 1312 H= 328:00 +CPU= 27.094
  17:19:45 STEP 1313 H= 328:15 +CPU= 24.607
  17:20:11 STEP 1314 H= 328:30 +CPU= 25.166
  17:20:34 STEP 1315 H= 328:45 +CPU= 23.364
  17:20:59 STEP 1316 H= 329:00 +CPU= 25.302
  17:21:24 STEP 1317 H= 329:15 +CPU= 24.488
  17:21:48 STEP 1318 H= 329:30 +CPU= 23.770
  17:22:15 STEP 1319 H= 329:45 +CPU= 27.063
  17:22:45 STEP 1320 H= 330:00 +CPU= 29.805
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001320
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001320
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001320
  17:23:12 STEP 1321 H= 330:15 +CPU= 27.371
  17:23:39 STEP 1322 H= 330:30 +CPU= 26.363
  17:24:03 STEP 1323 H= 330:45 +CPU= 24.360
  17:24:29 STEP 1324 H= 331:00 +CPU= 25.475
  17:24:53 STEP 1325 H= 331:15 +CPU= 23.960
  17:25:18 STEP 1326 H= 331:30 +CPU= 25.215
  17:25:42 STEP 1327 H= 331:45 +CPU= 24.218
  17:26:08 STEP 1328 H= 332:00 +CPU= 25.878
  17:26:34 STEP 1329 H= 332:15 +CPU= 25.809
  17:26:59 STEP 1330 H= 332:30 +CPU= 24.922
  17:27:25 STEP 1331 H= 332:45 +CPU= 26.439
  17:27:57 STEP 1332 H= 333:00 +CPU= 31.481
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001332
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001332
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001332
  17:28:22 STEP 1333 H= 333:15 +CPU= 24.582
  17:28:48 STEP 1334 H= 333:30 +CPU= 25.874
  17:29:14 STEP 1335 H= 333:45 +CPU= 26.609
  17:29:41 STEP 1336 H= 334:00 +CPU= 26.400
  17:30:08 STEP 1337 H= 334:15 +CPU= 26.756
  17:30:33 STEP 1338 H= 334:30 +CPU= 25.583
  17:30:58 STEP 1339 H= 334:45 +CPU= 24.437
  17:31:23 STEP 1340 H= 335:00 +CPU= 24.926
  17:31:47 STEP 1341 H= 335:15 +CPU= 24.078
  17:32:12 STEP 1342 H= 335:30 +CPU= 25.602
  17:32:38 STEP 1343 H= 335:45 +CPU= 25.267
  17:33:13 STEP 1344 H= 336:00 +CPU= 34.784
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001344
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001344
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001344
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001248
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001248
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001248
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001260
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001260
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001260
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001272
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001272
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001272
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001284
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001284
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001284
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001296
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001296
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001296
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001308
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001308
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001308
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001320
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001320
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001320
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001332
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001332
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001332
Zipping up the intermediate file: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_a2hy_2016092300_20_1018_12291565_1_r954197717_13.zip
Uploading the intermediate file: upload_file_13.zip
  17:33:39 STEP 1345 H= 336:15 +CPU= 26.372
  17:34:07 STEP 1346 H= 336:30 +CPU= 27.413
  17:34:31 STEP 1347 H= 336:45 +CPU= 24.306
  17:34:57 STEP 1348 H= 337:00 +CPU= 26.064
  17:35:21 STEP 1349 H= 337:15 +CPU= 24.058
  17:35:45 STEP 1350 H= 337:30 +CPU= 23.875
  17:36:08 STEP 1351 H= 337:45 +CPU= 22.676
  17:36:32 STEP 1352 H= 338:00 +CPU= 24.573
  17:36:57 STEP 1353 H= 338:15 +CPU= 24.098
  17:37:19 STEP 1354 H= 338:30 +CPU= 22.557
  17:37:41 STEP 1355 H= 338:45 +CPU= 21.889
  17:38:11 STEP 1356 H= 339:00 +CPU= 30.140
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001356
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001356
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001356
  17:38:37 STEP 1357 H= 339:15 +CPU= 25.240
  17:39:02 STEP 1358 H= 339:30 +CPU= 25.162
  17:39:28 STEP 1359 H= 339:45 +CPU= 25.857
  17:39:54 STEP 1360 H= 340:00 +CPU= 25.846
  17:40:19 STEP 1361 H= 340:15 +CPU= 25.221
  17:40:44 STEP 1362 H= 340:30 +CPU= 24.523
  17:41:07 STEP 1363 H= 340:45 +CPU= 23.604
  17:41:31 STEP 1364 H= 341:00 +CPU= 23.783
  17:41:56 STEP 1365 H= 341:15 +CPU= 25.201
  17:42:19 STEP 1366 H= 341:30 +CPU= 22.057
  17:42:42 STEP 1367 H= 341:45 +CPU= 23.205
  17:43:13 STEP 1368 H= 342:00 +CPU= 31.037
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001368
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001368
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001368
  17:43:37 STEP 1369 H= 342:15 +CPU= 24.355
  17:44:02 STEP 1370 H= 342:30 +CPU= 25.008
  17:44:27 STEP 1371 H= 342:45 +CPU= 24.684
  17:44:53 STEP 1372 H= 343:00 +CPU= 26.040
  17:45:20 STEP 1373 H= 343:15 +CPU= 26.377
  17:45:45 STEP 1374 H= 343:30 +CPU= 25.690
  17:46:11 STEP 1375 H= 343:45 +CPU= 25.459
  17:46:37 STEP 1376 H= 344:00 +CPU= 25.867
  17:47:02 STEP 1377 H= 344:15 +CPU= 24.833
  17:47:26 STEP 1378 H= 344:30 +CPU= 24.115
  17:47:50 STEP 1379 H= 344:45 +CPU= 23.874
  17:48:22 STEP 1380 H= 345:00 +CPU= 31.776
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001380
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001380
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001380
  17:48:46 STEP 1381 H= 345:15 +CPU= 24.112
  17:49:09 STEP 1382 H= 345:30 +CPU= 23.074
  17:49:32 STEP 1383 H= 345:45 +CPU= 22.817
  17:49:57 STEP 1384 H= 346:00 +CPU= 24.621
  17:50:19 STEP 1385 H= 346:15 +CPU= 22.218
  17:50:42 STEP 1386 H= 346:30 +CPU= 22.540
  17:51:05 STEP 1387 H= 346:45 +CPU= 23.666
  17:51:30 STEP 1388 H= 347:00 +CPU= 25.089
  17:51:56 STEP 1389 H= 347:15 +CPU= 25.341
  17:52:19 STEP 1390 H= 347:30 +CPU= 23.180
  17:52:43 STEP 1391 H= 347:45 +CPU= 23.807
  17:53:14 STEP 1392 H= 348:00 +CPU= 30.826
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001392
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001392
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001392
  17:53:38 STEP 1393 H= 348:15 +CPU= 23.994
  17:54:02 STEP 1394 H= 348:30 +CPU= 23.730
  17:54:24 STEP 1395 H= 348:45 +CPU= 22.620
  17:54:49 STEP 1396 H= 349:00 +CPU= 24.728
  17:55:15 STEP 1397 H= 349:15 +CPU= 25.813
  17:55:39 STEP 1398 H= 349:30 +CPU= 23.983
  17:56:03 STEP 1399 H= 349:45 +CPU= 23.688
  17:56:26 STEP 1400 H= 350:00 +CPU= 22.814
  17:56:50 STEP 1401 H= 350:15 +CPU= 23.832
  17:57:14 STEP 1402 H= 350:30 +CPU= 24.292
  17:57:38 STEP 1403 H= 350:45 +CPU= 24.359
  17:58:08 STEP 1404 H= 351:00 +CPU= 29.801
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001404
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001404
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001404
  17:58:33 STEP 1405 H= 351:15 +CPU= 25.133
  17:58:58 STEP 1406 H= 351:30 +CPU= 24.764
  17:59:24 STEP 1407 H= 351:45 +CPU= 25.456
  17:59:49 STEP 1408 H= 352:00 +CPU= 25.557
  18:00:15 STEP 1409 H= 352:15 +CPU= 25.677
  18:00:42 STEP 1410 H= 352:30 +CPU= 26.847
  18:01:07 STEP 1411 H= 352:45 +CPU= 25.173
  18:01:33 STEP 1412 H= 353:00 +CPU= 26.037
  18:01:57 STEP 1413 H= 353:15 +CPU= 24.022
  18:02:21 STEP 1414 H= 353:30 +CPU= 23.404
  18:02:45 STEP 1415 H= 353:45 +CPU= 24.143
  18:03:19 STEP 1416 H= 354:00 +CPU= 33.397
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001416
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001416
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001416
  18:03:44 STEP 1417 H= 354:15 +CPU= 25.046
  18:04:09 STEP 1418 H= 354:30 +CPU= 25.483
  18:04:34 STEP 1419 H= 354:45 +CPU= 24.385
  18:05:01 STEP 1420 H= 355:00 +CPU= 26.944
  18:05:26 STEP 1421 H= 355:15 +CPU= 25.652
  18:05:51 STEP 1422 H= 355:30 +CPU= 24.949
  18:06:17 STEP 1423 H= 355:45 +CPU= 25.130
  18:06:42 STEP 1424 H= 356:00 +CPU= 25.127
  18:07:09 STEP 1425 H= 356:15 +CPU= 27.169
  18:07:35 STEP 1426 H= 356:30 +CPU= 25.662
  18:07:58 STEP 1427 H= 356:45 +CPU= 23.290
  18:08:29 STEP 1428 H= 357:00 +CPU= 30.414
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001428
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001428
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001428
  18:08:54 STEP 1429 H= 357:15 +CPU= 25.177
  18:09:20 STEP 1430 H= 357:30 +CPU= 26.559
  18:09:44 STEP 1431 H= 357:45 +CPU= 23.900
  18:10:09 STEP 1432 H= 358:00 +CPU= 24.449
  18:10:34 STEP 1433 H= 358:15 +CPU= 25.089
  18:11:00 STEP 1434 H= 358:30 +CPU= 25.643
  18:11:23 STEP 1435 H= 358:45 +CPU= 23.534
  18:11:50 STEP 1436 H= 359:00 +CPU= 26.532
  18:12:14 STEP 1437 H= 359:15 +CPU= 24.493
  18:12:38 STEP 1438 H= 359:30 +CPU= 23.746
  18:13:02 STEP 1439 H= 359:45 +CPU= 23.414
  18:13:37 STEP 1440 H= 360:00 +CPU= 35.160
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001440
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001440
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001440
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001344
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001344
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001344
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001356
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001356
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001356
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001368
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001368
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001368
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001380
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001380
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001380
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001392
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001392
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001392
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001404
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001404
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001404
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001416
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001416
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001416
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001428
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001428
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001428
Zipping up the intermediate file: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_a2hy_2016092300_20_1018_12291565_1_r954197717_14.zip
Uploading the intermediate file: upload_file_14.zip
  18:14:02 STEP 1441 H= 360:15 +CPU= 25.209
  18:14:28 STEP 1442 H= 360:30 +CPU= 25.472
  18:14:54 STEP 1443 H= 360:45 +CPU= 25.733
  18:15:19 STEP 1444 H= 361:00 +CPU= 24.935
  18:15:43 STEP 1445 H= 361:15 +CPU= 24.614
  18:16:08 STEP 1446 H= 361:30 +CPU= 24.708
  18:16:34 STEP 1447 H= 361:45 +CPU= 25.619
  18:16:59 STEP 1448 H= 362:00 +CPU= 25.398
  18:17:23 STEP 1449 H= 362:15 +CPU= 23.639
  18:17:47 STEP 1450 H= 362:30 +CPU= 23.909
  18:18:10 STEP 1451 H= 362:45 +CPU= 23.119
  18:18:38 STEP 1452 H= 363:00 +CPU= 27.815
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001452
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001452
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001452
  18:19:01 STEP 1453 H= 363:15 +CPU= 23.292
  18:19:25 STEP 1454 H= 363:30 +CPU= 23.799
  18:19:50 STEP 1455 H= 363:45 +CPU= 24.650
  18:20:14 STEP 1456 H= 364:00 +CPU= 23.895
  18:20:37 STEP 1457 H= 364:15 +CPU= 22.783
  18:21:01 STEP 1458 H= 364:30 +CPU= 23.982
  18:21:24 STEP 1459 H= 364:45 +CPU= 23.011
  18:21:48 STEP 1460 H= 365:00 +CPU= 24.549
  18:22:13 STEP 1461 H= 365:15 +CPU= 24.276
  18:22:37 STEP 1462 H= 365:30 +CPU= 23.968
  18:23:01 STEP 1463 H= 365:45 +CPU= 24.809
  18:23:31 STEP 1464 H= 366:00 +CPU= 29.181
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001464
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001464
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001464
  18:23:54 STEP 1465 H= 366:15 +CPU= 23.034
  18:24:18 STEP 1466 H= 366:30 +CPU= 24.384
  18:24:43 STEP 1467 H= 366:45 +CPU= 25.086
  18:25:08 STEP 1468 H= 367:00 +CPU= 24.195
  18:25:30 STEP 1469 H= 367:15 +CPU= 21.816
  18:25:51 STEP 1470 H= 367:30 +CPU= 21.650
  18:26:15 STEP 1471 H= 367:45 +CPU= 24.200
  18:26:41 STEP 1472 H= 368:00 +CPU= 25.886
  18:27:07 STEP 1473 H= 368:15 +CPU= 25.814
  18:27:32 STEP 1474 H= 368:30 +CPU= 24.934
  18:27:58 STEP 1475 H= 368:45 +CPU= 25.697
  18:28:30 STEP 1476 H= 369:00 +CPU= 31.641
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001476
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001476
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001476
  18:28:56 STEP 1477 H= 369:15 +CPU= 26.389
  18:29:22 STEP 1478 H= 369:30 +CPU= 25.470
  18:29:46 STEP 1479 H= 369:45 +CPU= 23.650
  18:30:11 STEP 1480 H= 370:00 +CPU= 24.991
  18:30:34 STEP 1481 H= 370:15 +CPU= 23.160
  18:30:58 STEP 1482 H= 370:30 +CPU= 24.049
  18:31:23 STEP 1483 H= 370:45 +CPU= 25.492
  18:31:48 STEP 1484 H= 371:00 +CPU= 24.597
  18:32:12 STEP 1485 H= 371:15 +CPU= 23.543
  18:32:34 STEP 1486 H= 371:30 +CPU= 22.421
  18:32:58 STEP 1487 H= 371:45 +CPU= 24.138
  18:33:32 STEP 1488 H= 372:00 +CPU= 33.367
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001488
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001488
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001488
  18:33:56 STEP 1489 H= 372:15 +CPU= 23.987
  18:34:19 STEP 1490 H= 372:30 +CPU= 23.375
  18:34:44 STEP 1491 H= 372:45 +CPU= 24.923
  18:35:10 STEP 1492 H= 373:00 +CPU= 25.298
  18:35:35 STEP 1493 H= 373:15 +CPU= 25.349
  18:36:00 STEP 1494 H= 373:30 +CPU= 24.734
  18:36:25 STEP 1495 H= 373:45 +CPU= 24.889
  18:36:48 STEP 1496 H= 374:00 +CPU= 22.966
  18:37:12 STEP 1497 H= 374:15 +CPU= 24.282
  18:37:36 STEP 1498 H= 374:30 +CPU= 24.274
  18:38:00 STEP 1499 H= 374:45 +CPU= 23.616
  18:38:32 STEP 1500 H= 375:00 +CPU= 31.490
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001500
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001500
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001500
  18:38:57 STEP 1501 H= 375:15 +CPU= 25.233
  18:39:20 STEP 1502 H= 375:30 +CPU= 23.171
  18:39:44 STEP 1503 H= 375:45 +CPU= 23.389
  18:40:09 STEP 1504 H= 376:00 +CPU= 24.985
  18:40:34 STEP 1505 H= 376:15 +CPU= 25.610
  18:41:00 STEP 1506 H= 376:30 +CPU= 25.538
  18:41:26 STEP 1507 H= 376:45 +CPU= 26.158
  18:41:52 STEP 1508 H= 377:00 +CPU= 25.857
  18:42:17 STEP 1509 H= 377:15 +CPU= 25.072
  18:42:43 STEP 1510 H= 377:30 +CPU= 26.108
  18:43:09 STEP 1511 H= 377:45 +CPU= 25.124
  18:43:38 STEP 1512 H= 378:00 +CPU= 29.776
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001512
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001512
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001512
  18:44:04 STEP 1513 H= 378:15 +CPU= 25.855
  18:44:30 STEP 1514 H= 378:30 +CPU= 25.187
  18:44:53 STEP 1515 H= 378:45 +CPU= 23.429
  18:45:18 STEP 1516 H= 379:00 +CPU= 24.758
  18:45:43 STEP 1517 H= 379:15 +CPU= 25.203
  18:46:06 STEP 1518 H= 379:30 +CPU= 22.912
  18:46:30 STEP 1519 H= 379:45 +CPU= 23.666
  18:46:57 STEP 1520 H= 380:00 +CPU= 26.912
  18:47:23 STEP 1521 H= 380:15 +CPU= 26.062
  18:47:47 STEP 1522 H= 380:30 +CPU= 23.832
  18:48:13 STEP 1523 H= 380:45 +CPU= 26.563
  18:48:45 STEP 1524 H= 381:00 +CPU= 31.702
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001524
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001524
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001524
  18:49:11 STEP 1525 H= 381:15 +CPU= 25.270
  18:49:35 STEP 1526 H= 381:30 +CPU= 23.934
  18:50:01 STEP 1527 H= 381:45 +CPU= 26.425
  18:50:26 STEP 1528 H= 382:00 +CPU= 25.253
  18:50:49 STEP 1529 H= 382:15 +CPU= 22.987
  18:51:15 STEP 1530 H= 382:30 +CPU= 25.060
  18:51:37 STEP 1531 H= 382:45 +CPU= 21.903
  18:52:02 STEP 1532 H= 383:00 +CPU= 25.283
  18:52:24 STEP 1533 H= 383:15 +CPU= 22.519
  18:52:49 STEP 1534 H= 383:30 +CPU= 24.832
  18:53:14 STEP 1535 H= 383:45 +CPU= 24.742
  18:53:48 STEP 1536 H= 384:00 +CPU= 34.213
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001536
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001536
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001536
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001440
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001440
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001440
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001452
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001452
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001452
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001464
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001464
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001464
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001476
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001476
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001476
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001488
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001488
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001488
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001500
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001500
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001500
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001512
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001512
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001512
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001524
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001524
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001524
Zipping up the intermediate file: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_a2hy_2016092300_20_1018_12291565_1_r954197717_15.zip
Uploading the intermediate file: upload_file_15.zip
  18:54:13 STEP 1537 H= 384:15 +CPU= 24.873
  18:54:38 STEP 1538 H= 384:30 +CPU= 24.393
  18:55:04 STEP 1539 H= 384:45 +CPU= 26.057
  18:55:29 STEP 1540 H= 385:00 +CPU= 24.851
  18:55:53 STEP 1541 H= 385:15 +CPU= 23.651
  18:56:18 STEP 1542 H= 385:30 +CPU= 24.926
  18:56:44 STEP 1543 H= 385:45 +CPU= 26.197
  18:57:09 STEP 1544 H= 386:00 +CPU= 24.909
  18:57:32 STEP 1545 H= 386:15 +CPU= 23.199
  18:57:55 STEP 1546 H= 386:30 +CPU= 22.807
  18:58:18 STEP 1547 H= 386:45 +CPU= 23.268
  18:58:47 STEP 1548 H= 387:00 +CPU= 29.146
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001548
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001548
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001548
  18:59:12 STEP 1549 H= 387:15 +CPU= 24.511
  18:59:33 STEP 1550 H= 387:30 +CPU= 21.306
  18:59:56 STEP 1551 H= 387:45 +CPU= 22.877
  19:00:20 STEP 1552 H= 388:00 +CPU= 23.765
  19:00:43 STEP 1553 H= 388:15 +CPU= 22.619
  19:01:08 STEP 1554 H= 388:30 +CPU= 25.204
  19:01:31 STEP 1555 H= 388:45 +CPU= 23.268
  19:01:58 STEP 1556 H= 389:00 +CPU= 26.684
  19:02:22 STEP 1557 H= 389:15 +CPU= 23.544
  19:02:45 STEP 1558 H= 389:30 +CPU= 23.612
  19:03:08 STEP 1559 H= 389:45 +CPU= 22.570
  19:03:37 STEP 1560 H= 390:00 +CPU= 28.637
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001560
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001560
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001560
  19:04:00 STEP 1561 H= 390:15 +CPU= 22.781
  19:04:23 STEP 1562 H= 390:30 +CPU= 23.360
  19:04:47 STEP 1563 H= 390:45 +CPU= 23.519
  19:05:09 STEP 1564 H= 391:00 +CPU= 22.023
  19:05:34 STEP 1565 H= 391:15 +CPU= 25.193
  19:05:58 STEP 1566 H= 391:30 +CPU= 23.741
  19:06:21 STEP 1567 H= 391:45 +CPU= 23.349
  19:06:44 STEP 1568 H= 392:00 +CPU= 23.185
  19:07:06 STEP 1569 H= 392:15 +CPU= 21.631
  19:07:29 STEP 1570 H= 392:30 +CPU= 23.362
  19:07:55 STEP 1571 H= 392:45 +CPU= 25.530
  19:08:25 STEP 1572 H= 393:00 +CPU= 30.029
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001572
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001572
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001572
  19:08:50 STEP 1573 H= 393:15 +CPU= 25.117
  19:09:14 STEP 1574 H= 393:30 +CPU= 23.723
  19:09:39 STEP 1575 H= 393:45 +CPU= 24.534
  19:10:04 STEP 1576 H= 394:00 +CPU= 25.255
  19:10:30 STEP 1577 H= 394:15 +CPU= 25.542
  19:10:54 STEP 1578 H= 394:30 +CPU= 24.342
  19:11:21 STEP 1579 H= 394:45 +CPU= 26.627
  19:11:47 STEP 1580 H= 395:00 +CPU= 25.851
  19:12:12 STEP 1581 H= 395:15 +CPU= 25.693
  19:12:38 STEP 1582 H= 395:30 +CPU= 25.789
  19:13:04 STEP 1583 H= 395:45 +CPU= 25.544
  19:13:40 STEP 1584 H= 396:00 +CPU= 35.542
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001584
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001584
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001584
  19:14:05 STEP 1585 H= 396:15 +CPU= 25.362
  19:14:30 STEP 1586 H= 396:30 +CPU= 25.161
  19:14:55 STEP 1587 H= 396:45 +CPU= 24.395
  19:15:20 STEP 1588 H= 397:00 +CPU= 24.909
  19:15:45 STEP 1589 H= 397:15 +CPU= 25.038
  19:16:09 STEP 1590 H= 397:30 +CPU= 24.485
  19:16:31 STEP 1591 H= 397:45 +CPU= 21.961
  19:16:55 STEP 1592 H= 398:00 +CPU= 23.662
  19:17:19 STEP 1593 H= 398:15 +CPU= 23.622
  19:17:44 STEP 1594 H= 398:30 +CPU= 25.260
  19:18:08 STEP 1595 H= 398:45 +CPU= 24.272
  19:18:39 STEP 1596 H= 399:00 +CPU= 30.520
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001596
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001596
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001596
  19:19:03 STEP 1597 H= 399:15 +CPU= 23.687
  19:19:25 STEP 1598 H= 399:30 +CPU= 22.687
  19:19:49 STEP 1599 H= 399:45 +CPU= 23.887
  19:20:12 STEP 1600 H= 400:00 +CPU= 22.420
  19:20:35 STEP 1601 H= 400:15 +CPU= 22.926
  19:20:59 STEP 1602 H= 400:30 +CPU= 24.453
  19:21:22 STEP 1603 H= 400:45 +CPU= 22.523
  19:21:44 STEP 1604 H= 401:00 +CPU= 22.379
  19:22:06 STEP 1605 H= 401:15 +CPU= 22.107
  19:22:30 STEP 1606 H= 401:30 +CPU= 23.804
  19:22:51 STEP 1607 H= 401:45 +CPU= 20.864
  19:23:20 STEP 1608 H= 402:00 +CPU= 28.365
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001608
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001608
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001608
  19:23:42 STEP 1609 H= 402:15 +CPU= 22.379
  19:24:04 STEP 1610 H= 402:30 +CPU= 22.262
  19:24:27 STEP 1611 H= 402:45 +CPU= 22.895
  19:24:51 STEP 1612 H= 403:00 +CPU= 23.467
  19:25:16 STEP 1613 H= 403:15 +CPU= 25.107
  19:25:38 STEP 1614 H= 403:30 +CPU= 22.228
  19:26:03 STEP 1615 H= 403:45 +CPU= 24.677
  19:26:28 STEP 1616 H= 404:00 +CPU= 24.904
  19:26:52 STEP 1617 H= 404:15 +CPU= 23.559
  19:27:16 STEP 1618 H= 404:30 +CPU= 24.072
  19:27:39 STEP 1619 H= 404:45 +CPU= 23.355
  19:28:10 STEP 1620 H= 405:00 +CPU= 30.959
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001620
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001620
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001620
  19:28:34 STEP 1621 H= 405:15 +CPU= 23.512
  19:29:00 STEP 1622 H= 405:30 +CPU= 26.104
  19:29:22 STEP 1623 H= 405:45 +CPU= 22.246
  19:29:46 STEP 1624 H= 406:00 +CPU= 23.939
  19:30:11 STEP 1625 H= 406:15 +CPU= 24.644
  19:30:35 STEP 1626 H= 406:30 +CPU= 23.960
  19:31:00 STEP 1627 H= 406:45 +CPU= 24.544
  19:31:24 STEP 1628 H= 407:00 +CPU= 23.860
  19:31:48 STEP 1629 H= 407:15 +CPU= 23.962
  19:32:13 STEP 1630 H= 407:30 +CPU= 25.219
  19:32:39 STEP 1631 H= 407:45 +CPU= 25.677
  19:33:13 STEP 1632 H= 408:00 +CPU= 34.248
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001632
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001632
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001632
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001536
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001536
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001536
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001548
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001548
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001548
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001560
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001560
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001560
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001572
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001572
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001572
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001584
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001584
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001584
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001596
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001596
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001596
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001608
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001608
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001608
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001620
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001620
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001620
Zipping up the intermediate file: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_a2hy_2016092300_20_1018_12291565_1_r954197717_16.zip
Uploading the intermediate file: upload_file_16.zip
  19:33:39 STEP 1633 H= 408:15 +CPU= 25.542
  19:34:06 STEP 1634 H= 408:30 +CPU= 27.239
  19:34:32 STEP 1635 H= 408:45 +CPU= 25.532
  19:34:58 STEP 1636 H= 409:00 +CPU= 26.214
  19:35:22 STEP 1637 H= 409:15 +CPU= 24.136
  19:35:45 STEP 1638 H= 409:30 +CPU= 23.056
  19:36:11 STEP 1639 H= 409:45 +CPU= 25.872
  19:36:35 STEP 1640 H= 410:00 +CPU= 23.706
  19:37:00 STEP 1641 H= 410:15 +CPU= 25.348
  19:37:25 STEP 1642 H= 410:30 +CPU= 24.729
  19:37:49 STEP 1643 H= 410:45 +CPU= 23.589
  19:38:17 STEP 1644 H= 411:00 +CPU= 27.867
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001644
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001644
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001644
  19:38:40 STEP 1645 H= 411:15 +CPU= 23.439
  19:39:06 STEP 1646 H= 411:30 +CPU= 25.482
  19:39:30 STEP 1647 H= 411:45 +CPU= 23.744
  19:39:56 STEP 1648 H= 412:00 +CPU= 25.873
  19:40:19 STEP 1649 H= 412:15 +CPU= 23.896
  19:40:44 STEP 1650 H= 412:30 +CPU= 24.169
  19:41:07 STEP 1651 H= 412:45 +CPU= 22.789
  19:41:29 STEP 1652 H= 413:00 +CPU= 22.860
  19:41:54 STEP 1653 H= 413:15 +CPU= 24.505
  19:42:20 STEP 1654 H= 413:30 +CPU= 25.627
  19:42:45 STEP 1655 H= 413:45 +CPU= 24.829
  19:43:16 STEP 1656 H= 414:00 +CPU= 31.395
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001656
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001656
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001656
  19:43:42 STEP 1657 H= 414:15 +CPU= 25.770
  19:44:08 STEP 1658 H= 414:30 +CPU= 25.622
  19:44:33 STEP 1659 H= 414:45 +CPU= 25.200
  19:44:58 STEP 1660 H= 415:00 +CPU= 25.054
  19:45:23 STEP 1661 H= 415:15 +CPU= 24.970
  19:45:48 STEP 1662 H= 415:30 +CPU= 25.241
  19:46:14 STEP 1663 H= 415:45 +CPU= 25.220
  19:46:38 STEP 1664 H= 416:00 +CPU= 24.281
  19:47:02 STEP 1665 H= 416:15 +CPU= 23.902
  19:47:26 STEP 1666 H= 416:30 +CPU= 24.016
  19:47:51 STEP 1667 H= 416:45 +CPU= 25.046
  19:48:24 STEP 1668 H= 417:00 +CPU= 33.034
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001668
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001668
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001668
  19:48:49 STEP 1669 H= 417:15 +CPU= 24.168
  19:49:14 STEP 1670 H= 417:30 +CPU= 25.375
  19:49:41 STEP 1671 H= 417:45 +CPU= 26.730
  19:50:07 STEP 1672 H= 418:00 +CPU= 26.252
  19:50:33 STEP 1673 H= 418:15 +CPU= 25.527
  19:50:58 STEP 1674 H= 418:30 +CPU= 25.241
  19:51:24 STEP 1675 H= 418:45 +CPU= 25.558
  19:51:50 STEP 1676 H= 419:00 +CPU= 26.662
  19:52:16 STEP 1677 H= 419:15 +CPU= 25.559
  19:52:42 STEP 1678 H= 419:30 +CPU= 26.006
  19:53:07 STEP 1679 H= 419:45 +CPU= 24.714
  19:53:40 STEP 1680 H= 420:00 +CPU= 33.446
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001680
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001680
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001680
  19:54:05 STEP 1681 H= 420:15 +CPU= 24.659
  19:54:29 STEP 1682 H= 420:30 +CPU= 24.087
  19:54:53 STEP 1683 H= 420:45 +CPU= 23.729
  19:55:19 STEP 1684 H= 421:00 +CPU= 25.496
  19:55:45 STEP 1685 H= 421:15 +CPU= 25.911
  19:56:09 STEP 1686 H= 421:30 +CPU= 24.363
  19:56:33 STEP 1687 H= 421:45 +CPU= 24.120
  19:56:59 STEP 1688 H= 422:00 +CPU= 25.948
  19:57:23 STEP 1689 H= 422:15 +CPU= 24.052
  19:57:47 STEP 1690 H= 422:30 +CPU= 24.068
  19:58:12 STEP 1691 H= 422:45 +CPU= 24.370
  19:58:42 STEP 1692 H= 423:00 +CPU= 30.548
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001692
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001692
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001692
  19:59:04 STEP 1693 H= 423:15 +CPU= 21.379
  19:59:29 STEP 1694 H= 423:30 +CPU= 24.980
  19:59:54 STEP 1695 H= 423:45 +CPU= 24.716
  20:00:18 STEP 1696 H= 424:00 +CPU= 23.869
  20:00:40 STEP 1697 H= 424:15 +CPU= 22.245
  20:01:05 STEP 1698 H= 424:30 +CPU= 25.438
  20:01:30 STEP 1699 H= 424:45 +CPU= 24.891
  20:01:55 STEP 1700 H= 425:00 +CPU= 24.721
  20:02:20 STEP 1701 H= 425:15 +CPU= 24.467
  20:02:46 STEP 1702 H= 425:30 +CPU= 25.893
  20:03:07 STEP 1703 H= 425:45 +CPU= 21.412
  20:03:34 STEP 1704 H= 426:00 +CPU= 27.052
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001704
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001704
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001704
  20:03:56 STEP 1705 H= 426:15 +CPU= 21.937
  20:04:19 STEP 1706 H= 426:30 +CPU= 22.533
  20:04:44 STEP 1707 H= 426:45 +CPU= 25.015
  20:05:10 STEP 1708 H= 427:00 +CPU= 25.760
  20:05:33 STEP 1709 H= 427:15 +CPU= 23.259
  20:05:57 STEP 1710 H= 427:30 +CPU= 24.335
  20:06:21 STEP 1711 H= 427:45 +CPU= 23.848
  20:06:47 STEP 1712 H= 428:00 +CPU= 25.184
  20:07:10 STEP 1713 H= 428:15 +CPU= 23.683
  20:07:35 STEP 1714 H= 428:30 +CPU= 24.747
  20:07:58 STEP 1715 H= 428:45 +CPU= 23.003
  20:08:28 STEP 1716 H= 429:00 +CPU= 30.081
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001716
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001716
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001716
  20:08:51 STEP 1717 H= 429:15 +CPU= 22.786
  20:09:13 STEP 1718 H= 429:30 +CPU= 21.481
  20:09:37 STEP 1719 H= 429:45 +CPU= 23.918
  20:10:02 STEP 1720 H= 430:00 +CPU= 24.990
  20:10:28 STEP 1721 H= 430:15 +CPU= 26.592
  20:10:53 STEP 1722 H= 430:30 +CPU= 24.761
  20:11:18 STEP 1723 H= 430:45 +CPU= 24.609
  20:11:44 STEP 1724 H= 431:00 +CPU= 25.895
  20:12:09 STEP 1725 H= 431:15 +CPU= 24.909
  20:12:32 STEP 1726 H= 431:30 +CPU= 23.329
  20:12:56 STEP 1727 H= 431:45 +CPU= 24.215
  20:13:28 STEP 1728 H= 432:00 +CPU= 31.624
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001728
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001728
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001728
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001632
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001632
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001632
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001644
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001644
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001644
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001656
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001656
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001656
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001668
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001668
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001668
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001680
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001680
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001680
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001692
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001692
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001692
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001704
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001704
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001704
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001716
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001716
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001716
Zipping up the intermediate file: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_a2hy_2016092300_20_1018_12291565_1_r954197717_17.zip
Uploading the intermediate file: upload_file_17.zip
  20:13:53 STEP 1729 H= 432:15 +CPU= 24.961
  20:14:18 STEP 1730 H= 432:30 +CPU= 25.296
  20:14:45 STEP 1731 H= 432:45 +CPU= 26.172
  20:15:10 STEP 1732 H= 433:00 +CPU= 24.792
  20:15:35 STEP 1733 H= 433:15 +CPU= 25.091
  20:15:58 STEP 1734 H= 433:30 +CPU= 23.452
  20:16:22 STEP 1735 H= 433:45 +CPU= 23.930
  20:16:46 STEP 1736 H= 434:00 +CPU= 23.414
  20:17:08 STEP 1737 H= 434:15 +CPU= 22.441
  20:17:33 STEP 1738 H= 434:30 +CPU= 25.149
  20:17:56 STEP 1739 H= 434:45 +CPU= 22.706
  20:18:26 STEP 1740 H= 435:00 +CPU= 29.726
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001740
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001740
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001740
  20:18:50 STEP 1741 H= 435:15 +CPU= 23.882
  20:19:16 STEP 1742 H= 435:30 +CPU= 25.966
  20:19:40 STEP 1743 H= 435:45 +CPU= 24.034
  20:20:06 STEP 1744 H= 436:00 +CPU= 26.105
  20:20:30 STEP 1745 H= 436:15 +CPU= 23.252
  20:20:55 STEP 1746 H= 436:30 +CPU= 25.578
  20:21:20 STEP 1747 H= 436:45 +CPU= 24.407
  20:21:45 STEP 1748 H= 437:00 +CPU= 25.367
  20:22:09 STEP 1749 H= 437:15 +CPU= 23.812
  20:22:34 STEP 1750 H= 437:30 +CPU= 24.751
  20:22:59 STEP 1751 H= 437:45 +CPU= 24.930
  20:23:32 STEP 1752 H= 438:00 +CPU= 32.739
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001752
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001752
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001752
  20:23:56 STEP 1753 H= 438:15 +CPU= 23.989
  20:24:21 STEP 1754 H= 438:30 +CPU= 25.239
  20:24:46 STEP 1755 H= 438:45 +CPU= 24.525
  20:25:11 STEP 1756 H= 439:00 +CPU= 25.611
  20:25:36 STEP 1757 H= 439:15 +CPU= 24.726
  20:26:01 STEP 1758 H= 439:30 +CPU= 24.775
  20:26:26 STEP 1759 H= 439:45 +CPU= 24.766
  20:26:51 STEP 1760 H= 440:00 +CPU= 24.995
  20:27:16 STEP 1761 H= 440:15 +CPU= 25.643
  20:27:41 STEP 1762 H= 440:30 +CPU= 24.177
  20:28:04 STEP 1763 H= 440:45 +CPU= 23.626
  20:28:34 STEP 1764 H= 441:00 +CPU= 29.117
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001764
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001764
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001764
  20:28:58 STEP 1765 H= 441:15 +CPU= 24.221
  20:29:24 STEP 1766 H= 441:30 +CPU= 25.995
  20:29:49 STEP 1767 H= 441:45 +CPU= 24.697
  20:30:14 STEP 1768 H= 442:00 +CPU= 25.191
  20:30:37 STEP 1769 H= 442:15 +CPU= 23.358
  20:31:03 STEP 1770 H= 442:30 +CPU= 25.149
  20:31:28 STEP 1771 H= 442:45 +CPU= 24.942
  20:31:53 STEP 1772 H= 443:00 +CPU= 25.660
  20:32:18 STEP 1773 H= 443:15 +CPU= 24.338
  20:32:42 STEP 1774 H= 443:30 +CPU= 23.760
  20:33:05 STEP 1775 H= 443:45 +CPU= 23.431
  20:33:37 STEP 1776 H= 444:00 +CPU= 32.252
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001776
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001776
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001776
  20:34:00 STEP 1777 H= 444:15 +CPU= 22.506
  20:34:23 STEP 1778 H= 444:30 +CPU= 23.318
  20:34:47 STEP 1779 H= 444:45 +CPU= 23.781
  20:35:13 STEP 1780 H= 445:00 +CPU= 26.236
  20:35:36 STEP 1781 H= 445:15 +CPU= 22.987
  20:36:00 STEP 1782 H= 445:30 +CPU= 23.812
  20:36:24 STEP 1783 H= 445:45 +CPU= 24.108
  20:36:50 STEP 1784 H= 446:00 +CPU= 25.729
  20:37:16 STEP 1785 H= 446:15 +CPU= 25.582
  20:37:40 STEP 1786 H= 446:30 +CPU= 23.889
  20:38:04 STEP 1787 H= 446:45 +CPU= 24.412
  20:38:33 STEP 1788 H= 447:00 +CPU= 28.547
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001788
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001788
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001788
  20:38:56 STEP 1789 H= 447:15 +CPU= 23.243
  20:39:19 STEP 1790 H= 447:30 +CPU= 22.841
  20:39:41 STEP 1791 H= 447:45 +CPU= 21.738
  20:40:05 STEP 1792 H= 448:00 +CPU= 24.215
  20:40:29 STEP 1793 H= 448:15 +CPU= 23.958
  20:40:52 STEP 1794 H= 448:30 +CPU= 22.905
  20:41:14 STEP 1795 H= 448:45 +CPU= 21.585
  20:41:37 STEP 1796 H= 449:00 +CPU= 23.582
  20:42:00 STEP 1797 H= 449:15 +CPU= 22.567
  20:42:23 STEP 1798 H= 449:30 +CPU= 23.289
  20:42:48 STEP 1799 H= 449:45 +CPU= 24.113
  20:43:20 STEP 1800 H= 450:00 +CPU= 32.567
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001800
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001800
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001800
  20:43:46 STEP 1801 H= 450:15 +CPU= 25.277
  20:44:10 STEP 1802 H= 450:30 +CPU= 24.086
  20:44:34 STEP 1803 H= 450:45 +CPU= 24.573
  20:44:59 STEP 1804 H= 451:00 +CPU= 24.710
  20:45:25 STEP 1805 H= 451:15 +CPU= 25.341
  20:45:48 STEP 1806 H= 451:30 +CPU= 23.103
  20:46:11 STEP 1807 H= 451:45 +CPU= 23.321
  20:46:38 STEP 1808 H= 452:00 +CPU= 26.685
  20:47:02 STEP 1809 H= 452:15 +CPU= 24.388
  20:47:27 STEP 1810 H= 452:30 +CPU= 24.790
  20:47:52 STEP 1811 H= 452:45 +CPU= 25.120
  20:48:23 STEP 1812 H= 453:00 +CPU= 30.424
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001812
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001812
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001812
  20:48:46 STEP 1813 H= 453:15 +CPU= 22.531
  20:49:08 STEP 1814 H= 453:30 +CPU= 22.284
  20:49:31 STEP 1815 H= 453:45 +CPU= 22.601
  20:49:58 STEP 1816 H= 454:00 +CPU= 26.878
  20:50:23 STEP 1817 H= 454:15 +CPU= 25.211
  20:50:48 STEP 1818 H= 454:30 +CPU= 25.143
  20:51:14 STEP 1819 H= 454:45 +CPU= 25.486
  20:51:37 STEP 1820 H= 455:00 +CPU= 23.797
  20:52:04 STEP 1821 H= 455:15 +CPU= 26.315
  20:52:28 STEP 1822 H= 455:30 +CPU= 24.353
  20:52:53 STEP 1823 H= 455:45 +CPU= 24.521
  20:53:25 STEP 1824 H= 456:00 +CPU= 31.889
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001824
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001824
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001824
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001728
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001728
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001728
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001740
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001740
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001740
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001752
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001752
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001752
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001764
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001764
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001764
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001776
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001776
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001776
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001788
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001788
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001788
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001800
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001800
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001800
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001812
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001812
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001812
Zipping up the intermediate file: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_a2hy_2016092300_20_1018_12291565_1_r954197717_18.zip
Uploading the intermediate file: upload_file_18.zip
  20:53:50 STEP 1825 H= 456:15 +CPU= 25.581
  20:54:18 STEP 1826 H= 456:30 +CPU= 27.265
  20:54:42 STEP 1827 H= 456:45 +CPU= 24.323
  20:55:08 STEP 1828 H= 457:00 +CPU= 25.733
  20:55:33 STEP 1829 H= 457:15 +CPU= 24.845
  20:55:57 STEP 1830 H= 457:30 +CPU= 23.840
  20:56:23 STEP 1831 H= 457:45 +CPU= 26.077
  20:56:48 STEP 1832 H= 458:00 +CPU= 25.422
  20:57:13 STEP 1833 H= 458:15 +CPU= 24.104
  20:57:39 STEP 1834 H= 458:30 +CPU= 26.473
  20:58:03 STEP 1835 H= 458:45 +CPU= 23.789
  20:58:35 STEP 1836 H= 459:00 +CPU= 31.623
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001836
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001836
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001836
  20:59:00 STEP 1837 H= 459:15 +CPU= 25.788
  20:59:25 STEP 1838 H= 459:30 +CPU= 24.359
  20:59:49 STEP 1839 H= 459:45 +CPU= 24.365
  21:00:16 STEP 1840 H= 460:00 +CPU= 27.082
  21:00:41 STEP 1841 H= 460:15 +CPU= 24.519
  21:01:04 STEP 1842 H= 460:30 +CPU= 22.834
  21:01:28 STEP 1843 H= 460:45 +CPU= 23.629
  21:01:55 STEP 1844 H= 461:00 +CPU= 26.935
  21:02:19 STEP 1845 H= 461:15 +CPU= 24.766
  21:02:42 STEP 1846 H= 461:30 +CPU= 22.891
  21:03:06 STEP 1847 H= 461:45 +CPU= 23.866
  21:03:36 STEP 1848 H= 462:00 +CPU= 29.765
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001848
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001848
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001848
  21:04:02 STEP 1849 H= 462:15 +CPU= 25.547
  21:04:27 STEP 1850 H= 462:30 +CPU= 25.402
  21:04:50 STEP 1851 H= 462:45 +CPU= 22.985
  21:05:13 STEP 1852 H= 463:00 +CPU= 23.187
  21:05:36 STEP 1853 H= 463:15 +CPU= 22.296
  21:06:00 STEP 1854 H= 463:30 +CPU= 24.472
  21:06:25 STEP 1855 H= 463:45 +CPU= 24.185
  21:06:49 STEP 1856 H= 464:00 +CPU= 24.251
  21:07:12 STEP 1857 H= 464:15 +CPU= 23.201
  21:07:37 STEP 1858 H= 464:30 +CPU= 24.997
  21:08:01 STEP 1859 H= 464:45 +CPU= 23.263
  21:08:29 STEP 1860 H= 465:00 +CPU= 28.463
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001860
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001860
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001860
  21:08:51 STEP 1861 H= 465:15 +CPU= 21.959
  21:09:14 STEP 1862 H= 465:30 +CPU= 22.780
  21:09:37 STEP 1863 H= 465:45 +CPU= 22.533
  21:10:00 STEP 1864 H= 466:00 +CPU= 23.643
  21:10:26 STEP 1865 H= 466:15 +CPU= 26.056
  21:10:52 STEP 1866 H= 466:30 +CPU= 25.226
  21:11:16 STEP 1867 H= 466:45 +CPU= 24.342
  21:11:41 STEP 1868 H= 467:00 +CPU= 25.104
  21:12:08 STEP 1869 H= 467:15 +CPU= 26.761
  21:12:34 STEP 1870 H= 467:30 +CPU= 25.918
  21:13:00 STEP 1871 H= 467:45 +CPU= 25.436
  21:13:33 STEP 1872 H= 468:00 +CPU= 33.705
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001872
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001872
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001872
  21:13:59 STEP 1873 H= 468:15 +CPU= 25.529
  21:14:22 STEP 1874 H= 468:30 +CPU= 23.156
  21:14:46 STEP 1875 H= 468:45 +CPU= 23.860
  21:15:11 STEP 1876 H= 469:00 +CPU= 24.704
  21:15:37 STEP 1877 H= 469:15 +CPU= 25.747
  21:16:02 STEP 1878 H= 469:30 +CPU= 24.903
  21:16:27 STEP 1879 H= 469:45 +CPU= 24.999
  21:16:52 STEP 1880 H= 470:00 +CPU= 25.229
  21:17:16 STEP 1881 H= 470:15 +CPU= 24.374
  21:17:42 STEP 1882 H= 470:30 +CPU= 25.777
  21:18:08 STEP 1883 H= 470:45 +CPU= 25.536
  21:18:39 STEP 1884 H= 471:00 +CPU= 30.649
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001884
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001884
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001884
  21:19:02 STEP 1885 H= 471:15 +CPU= 23.502
  21:19:26 STEP 1886 H= 471:30 +CPU= 24.031
  21:19:50 STEP 1887 H= 471:45 +CPU= 24.128
  21:20:17 STEP 1888 H= 472:00 +CPU= 26.169
  21:20:42 STEP 1889 H= 472:15 +CPU= 25.073
  21:21:07 STEP 1890 H= 472:30 +CPU= 24.773
  21:21:31 STEP 1891 H= 472:45 +CPU= 24.364
  21:21:58 STEP 1892 H= 473:00 +CPU= 27.114
  21:22:23 STEP 1893 H= 473:15 +CPU= 24.421
  21:22:47 STEP 1894 H= 473:30 +CPU= 24.648
  21:23:13 STEP 1895 H= 473:45 +CPU= 25.309
  21:23:45 STEP 1896 H= 474:00 +CPU= 32.298
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001896
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001896
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001896
  21:24:10 STEP 1897 H= 474:15 +CPU= 24.931
  21:24:36 STEP 1898 H= 474:30 +CPU= 26.240
  21:25:01 STEP 1899 H= 474:45 +CPU= 24.555
  21:25:27 STEP 1900 H= 475:00 +CPU= 26.227
  21:25:53 STEP 1901 H= 475:15 +CPU= 25.453
  21:26:19 STEP 1902 H= 475:30 +CPU= 25.634
  21:26:42 STEP 1903 H= 475:45 +CPU= 23.372
  21:27:08 STEP 1904 H= 476:00 +CPU= 25.814
  21:27:34 STEP 1905 H= 476:15 +CPU= 26.429
  21:28:00 STEP 1906 H= 476:30 +CPU= 25.836
  21:28:27 STEP 1907 H= 476:45 +CPU= 26.209
  21:28:59 STEP 1908 H= 477:00 +CPU= 31.892
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001908
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001908
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001908
  21:29:24 STEP 1909 H= 477:15 +CPU= 25.889
  21:29:50 STEP 1910 H= 477:30 +CPU= 25.391
  21:30:16 STEP 1911 H= 477:45 +CPU= 26.173
  21:30:42 STEP 1912 H= 478:00 +CPU= 25.602
  21:31:07 STEP 1913 H= 478:15 +CPU= 24.909
  21:31:32 STEP 1914 H= 478:30 +CPU= 25.390
  21:31:59 STEP 1915 H= 478:45 +CPU= 26.223
  21:32:24 STEP 1916 H= 479:00 +CPU= 25.813
  21:32:51 STEP 1917 H= 479:15 +CPU= 26.502
  21:33:15 STEP 1918 H= 479:30 +CPU= 23.805
  21:33:39 STEP 1919 H= 479:45 +CPU= 24.383
  21:34:08 STEP 1920 H= 480:00 +CPU= 28.651
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I      0.1341195680E-20      I       0.9889293966E-06      I
ICloud fractionI      0.0000000000E+00      I       0.2832431810E-01      I
I  Relat. Hum. I      0.1156784657E+00      I       0.2286008973E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.3679190273E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1920 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001920 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001920
 MPI-TASK:   1 -    305492388 BYTES IN      7 RECORDS TRANSFERRED IN    0.0004 SECONDS763730.9 Mbytes/s, TOTAL TIME=    0.0126( 3.2%)
 21:34:08 STEP 1920 H= 480:00 +CPU= 28.651
 END CNT3
 NSTEP =  1920 CNT0   000000000  20.988  20.988  21.044   0.997               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ            0/           0 WRITTEN        57546/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1   1008    0        0            0    57546 ************    73.2     0.0    73.2     0.0   164.0
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 *********       0.0    100.00   -100.00
   1 CNT4     - FORWARD INTEGRATION                  1 *********       0.0    100.00   -100.00
   8 SCAN2M - GRID-POINT DYNAMICS                 2082    4215.5    4215.5      0.00      0.00
   9 SPCM     - SPECTRAL COMP.                    1920     745.1     745.1      0.00      0.00
  10 SCAN2M - PHYSICS                             1921  -99484.7       0.0    116.01   -116.01
  11 IOPACK   - OUTPUT P.P. RESULTS                161     652.2     652.2      0.00      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 83      52.2      52.2      0.00      0.00
  14 SUINIF                                          1    5038.2    5038.2      0.00      0.00
  17 GRIDFPOS IN CNT4                              161      29.5      29.5      0.00      0.00
  18 SUSPECG                                         1    2454.0    2454.0      0.00      0.00
  19 SUSPEC                                          1    2460.6    2460.6      0.00      0.00
  24 SUGRIDU                                         1    2112.4    2112.4      0.00      0.00
  25 SPECRT                                          1     199.6     199.6      0.00      0.00
  26 SUGRIDF                                         1     265.6     265.6      0.00      0.00
  27 RESTART FILES - WRITING                        40    2625.0    2625.0      0.00      0.00
  28 RESTART FILES - READING                         1       0.1       0.1      0.00      0.00
  29 SU4FPOS IN CNT4                               161       0.0       0.0      0.00      0.00
  30 DYNFPOS IN CNT4                               161    5477.4    5477.4      0.00      0.00
  31 POSDDH IN STEPO                                 9       0.7       0.7      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   1921    5518.2    5518.2      0.00      0.00
  39 SU0YOMB                                         1     370.7     370.7      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   1921      20.4      20.4      0.00      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             1920     351.7     351.7      0.00      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             1920      48.1      48.1      0.00      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 83       0.2       0.2      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     4165     340.9     340.9      0.00      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      4006     229.0     229.0      0.00      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       4006      80.9      80.9      0.00      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      4165     106.8     106.8      0.00      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      59.5      59.5      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           4165      46.3      46.3      0.00      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           4006      24.3      24.3      0.00      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           4165      69.8      69.8      0.00      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           4006      32.5      32.5      0.00      0.00
 400 GSTATS                                     223224       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                207696       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME  -164742.9 CPU TIME   49874.2 VECTOR TIME    49874.2


===-=== END   OF TIMING STATISTICS ===-===
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001920
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001920
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001920
Adding to the zip: /home/pdw/Mo/1/slots/0/NODE.001_01
Adding to the zip: /home/pdw/Mo/1/slots/0/ifs.stat
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001896
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001872
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001920
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001896
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001896
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001836
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001848
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001836
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001860
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001848
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001824
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001908
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001872
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001884
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001824
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001824
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001884
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001860
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001920
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001920
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001908
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001872
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001908
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001848
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMUAh7zg+001836
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMSHh7zg+001884
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12291565/ICMGGh7zg+001860
Zipping up the final file: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_a2hy_2016092300_20_1018_12291565_1_r954197717_19.zip
Uploading the final file: upload_file_19.zip
Uploading trickle at timestep: 1727100
21:37:37 (285909): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
22 Jun 2024 20:36:51 1522755 22450006 oifs_43r3_bl_a2hy_2016092300_20_1018_12291565_1 1,727,100 49,874 0.0289
22 Jun 2024 13:46:55 1522755 22450006 oifs_43r3_bl_a2hy_2016092300_20_1018_12291565_1 864,000 25,405 0.0294


©2024 climateprediction.net