climateprediction.net home page
Task 22442350

Task 22442350

Name oifs_43r3_bl_a0cq_2016092300_20_1018_12288785_0
Workunit 12288785
Created 12 Jun 2024, 20:38:21 UTC
Sent 13 Jun 2024, 10:00:54 UTC
Report deadline 12 Aug 2024, 10:00:54 UTC
Received 16 Jun 2024, 13:07:41 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1522755
Run time 13 hours 47 min 22 sec
CPU time 13 hours 41 min 24 sec
Validate state Valid
Credit 2,635.55
Device peak FLOPS 7.59 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,025.64 MB
Peak swap size 5,981.07 MB
Peak disk usage 1,347.97 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<stderr_txt>
8:30:40 STEP 1275 H= 318:45 +CPU= 25.854
  08:31:05 STEP 1276 H= 319:00 +CPU= 25.519
  08:31:31 STEP 1277 H= 319:15 +CPU= 25.298
  08:31:56 STEP 1278 H= 319:30 +CPU= 25.773
  08:32:22 STEP 1279 H= 319:45 +CPU= 25.434
  08:32:49 STEP 1280 H= 320:00 +CPU= 26.624
  08:33:12 STEP 1281 H= 320:15 +CPU= 23.016
  08:33:38 STEP 1282 H= 320:30 +CPU= 26.296
  08:34:03 STEP 1283 H= 320:45 +CPU= 24.711
  08:34:35 STEP 1284 H= 321:00 +CPU= 31.946
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001284
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001284
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001284
  08:35:00 STEP 1285 H= 321:15 +CPU= 25.147
  08:35:27 STEP 1286 H= 321:30 +CPU= 26.244
  08:35:50 STEP 1287 H= 321:45 +CPU= 23.782
  08:36:14 STEP 1288 H= 322:00 +CPU= 23.549
  08:36:40 STEP 1289 H= 322:15 +CPU= 26.267
  08:37:04 STEP 1290 H= 322:30 +CPU= 23.709
  08:37:28 STEP 1291 H= 322:45 +CPU= 24.094
  08:37:53 STEP 1292 H= 323:00 +CPU= 24.892
  08:38:18 STEP 1293 H= 323:15 +CPU= 24.758
  08:38:43 STEP 1294 H= 323:30 +CPU= 24.957
  08:39:08 STEP 1295 H= 323:45 +CPU= 25.342
  08:39:44 STEP 1296 H= 324:00 +CPU= 35.456
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001296
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001296
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001296
  08:40:10 STEP 1297 H= 324:15 +CPU= 26.369
  08:40:35 STEP 1298 H= 324:30 +CPU= 24.513
  08:40:59 STEP 1299 H= 324:45 +CPU= 23.652
  08:41:22 STEP 1300 H= 325:00 +CPU= 23.563
  08:41:49 STEP 1301 H= 325:15 +CPU= 26.448
  08:42:12 STEP 1302 H= 325:30 +CPU= 23.049
  08:42:36 STEP 1303 H= 325:45 +CPU= 23.596
  08:43:02 STEP 1304 H= 326:00 +CPU= 25.923
  08:43:28 STEP 1305 H= 326:15 +CPU= 25.767
  08:43:52 STEP 1306 H= 326:30 +CPU= 24.488
  08:44:18 STEP 1307 H= 326:45 +CPU= 25.721
  08:44:50 STEP 1308 H= 327:00 +CPU= 31.809
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001308
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001308
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001308
  08:45:15 STEP 1309 H= 327:15 +CPU= 24.844
  08:45:39 STEP 1310 H= 327:30 +CPU= 24.699
  08:46:03 STEP 1311 H= 327:45 +CPU= 23.131
  08:46:30 STEP 1312 H= 328:00 +CPU= 27.351
  08:46:56 STEP 1313 H= 328:15 +CPU= 25.370
  08:47:22 STEP 1314 H= 328:30 +CPU= 26.717
  08:47:47 STEP 1315 H= 328:45 +CPU= 24.562
  08:48:13 STEP 1316 H= 329:00 +CPU= 25.560
  08:48:37 STEP 1317 H= 329:15 +CPU= 23.943
  08:49:02 STEP 1318 H= 329:30 +CPU= 25.786
  08:49:25 STEP 1319 H= 329:45 +CPU= 22.731
  08:49:57 STEP 1320 H= 330:00 +CPU= 31.838
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001320
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001320
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001320
  08:50:23 STEP 1321 H= 330:15 +CPU= 26.138
  08:50:47 STEP 1322 H= 330:30 +CPU= 24.033
  08:51:11 STEP 1323 H= 330:45 +CPU= 23.928
  08:51:36 STEP 1324 H= 331:00 +CPU= 24.912
  08:52:01 STEP 1325 H= 331:15 +CPU= 24.171
  08:52:24 STEP 1326 H= 331:30 +CPU= 23.183
  08:52:49 STEP 1327 H= 331:45 +CPU= 25.375
  08:53:16 STEP 1328 H= 332:00 +CPU= 26.855
  08:53:41 STEP 1329 H= 332:15 +CPU= 25.013
  08:54:06 STEP 1330 H= 332:30 +CPU= 24.158
  08:54:30 STEP 1331 H= 332:45 +CPU= 24.260
  08:55:03 STEP 1332 H= 333:00 +CPU= 33.050
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001332
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001332
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001332
  08:55:28 STEP 1333 H= 333:15 +CPU= 24.947
  08:55:54 STEP 1334 H= 333:30 +CPU= 26.240
  08:56:18 STEP 1335 H= 333:45 +CPU= 23.085
  08:56:43 STEP 1336 H= 334:00 +CPU= 25.737
  08:57:09 STEP 1337 H= 334:15 +CPU= 25.278
  08:57:33 STEP 1338 H= 334:30 +CPU= 24.512
  08:57:59 STEP 1339 H= 334:45 +CPU= 25.501
  08:58:22 STEP 1340 H= 335:00 +CPU= 23.498
  08:58:47 STEP 1341 H= 335:15 +CPU= 24.314
  08:59:11 STEP 1342 H= 335:30 +CPU= 23.967
  08:59:36 STEP 1343 H= 335:45 +CPU= 24.729
  09:00:08 STEP 1344 H= 336:00 +CPU= 32.620
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001344
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001344
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001344
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001248
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001248
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001248
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001260
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001260
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001260
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001272
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001272
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001272
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001284
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001284
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001284
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001296
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001296
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001296
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001308
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001308
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001308
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001320
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001320
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001320
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001332
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001332
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001332
Zipping up the intermediate file: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_a0cq_2016092300_20_1018_12288785_0_r1436370426_13.zip
Uploading the intermediate file: upload_file_13.zip
  09:00:32 STEP 1345 H= 336:15 +CPU= 23.066
  09:00:54 STEP 1346 H= 336:30 +CPU= 22.201
  09:01:20 STEP 1347 H= 336:45 +CPU= 25.827
  09:01:45 STEP 1348 H= 337:00 +CPU= 25.072
  09:02:10 STEP 1349 H= 337:15 +CPU= 24.796
  09:02:34 STEP 1350 H= 337:30 +CPU= 23.716
  09:02:58 STEP 1351 H= 337:45 +CPU= 24.727
  09:03:24 STEP 1352 H= 338:00 +CPU= 26.024
  09:03:48 STEP 1353 H= 338:15 +CPU= 23.715
  09:04:12 STEP 1354 H= 338:30 +CPU= 23.998
  09:04:37 STEP 1355 H= 338:45 +CPU= 24.244
  09:05:07 STEP 1356 H= 339:00 +CPU= 30.403
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001356
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001356
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001356
  09:05:31 STEP 1357 H= 339:15 +CPU= 23.691
  09:05:55 STEP 1358 H= 339:30 +CPU= 24.007
  09:06:21 STEP 1359 H= 339:45 +CPU= 26.062
  09:06:46 STEP 1360 H= 340:00 +CPU= 25.367
  09:07:11 STEP 1361 H= 340:15 +CPU= 24.580
  09:07:35 STEP 1362 H= 340:30 +CPU= 24.209
  09:07:58 STEP 1363 H= 340:45 +CPU= 22.770
  09:08:22 STEP 1364 H= 341:00 +CPU= 23.725
  09:08:46 STEP 1365 H= 341:15 +CPU= 24.470
  09:09:09 STEP 1366 H= 341:30 +CPU= 22.665
  09:09:31 STEP 1367 H= 341:45 +CPU= 22.119
  09:09:58 STEP 1368 H= 342:00 +CPU= 27.060
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001368
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001368
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001368
  09:10:22 STEP 1369 H= 342:15 +CPU= 23.670
  09:10:48 STEP 1370 H= 342:30 +CPU= 25.469
  09:11:12 STEP 1371 H= 342:45 +CPU= 24.475
  09:11:36 STEP 1372 H= 343:00 +CPU= 23.670
  09:12:02 STEP 1373 H= 343:15 +CPU= 25.469
  09:12:28 STEP 1374 H= 343:30 +CPU= 26.437
  09:12:54 STEP 1375 H= 343:45 +CPU= 25.438
  09:13:21 STEP 1376 H= 344:00 +CPU= 27.111
  09:13:47 STEP 1377 H= 344:15 +CPU= 25.691
  09:14:11 STEP 1378 H= 344:30 +CPU= 24.614
  09:14:34 STEP 1379 H= 344:45 +CPU= 22.958
  09:15:05 STEP 1380 H= 345:00 +CPU= 30.804
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001380
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001380
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001380
  09:15:32 STEP 1381 H= 345:15 +CPU= 26.467
  09:15:57 STEP 1382 H= 345:30 +CPU= 25.316
  09:16:23 STEP 1383 H= 345:45 +CPU= 25.382
  09:16:48 STEP 1384 H= 346:00 +CPU= 25.783
  09:17:12 STEP 1385 H= 346:15 +CPU= 23.645
  09:17:35 STEP 1386 H= 346:30 +CPU= 22.654
  09:17:58 STEP 1387 H= 346:45 +CPU= 22.728
  09:18:21 STEP 1388 H= 347:00 +CPU= 23.511
  09:18:47 STEP 1389 H= 347:15 +CPU= 25.518
  09:19:13 STEP 1390 H= 347:30 +CPU= 25.899
  09:19:38 STEP 1391 H= 347:45 +CPU= 24.763
  09:20:08 STEP 1392 H= 348:00 +CPU= 30.035
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001392
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001392
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001392
  09:20:32 STEP 1393 H= 348:15 +CPU= 23.715
  09:20:57 STEP 1394 H= 348:30 +CPU= 25.158
  09:21:22 STEP 1395 H= 348:45 +CPU= 25.260
  09:21:48 STEP 1396 H= 349:00 +CPU= 25.906
  09:22:13 STEP 1397 H= 349:15 +CPU= 24.626
  09:22:38 STEP 1398 H= 349:30 +CPU= 24.768
  09:23:02 STEP 1399 H= 349:45 +CPU= 24.484
  09:23:27 STEP 1400 H= 350:00 +CPU= 24.698
  09:23:53 STEP 1401 H= 350:15 +CPU= 25.958
  09:24:21 STEP 1402 H= 350:30 +CPU= 27.676
  09:24:49 STEP 1403 H= 350:45 +CPU= 28.167
  09:25:21 STEP 1404 H= 351:00 +CPU= 32.283
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001404
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001404
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001404
  09:25:47 STEP 1405 H= 351:15 +CPU= 25.512
  09:26:13 STEP 1406 H= 351:30 +CPU= 25.877
  09:26:39 STEP 1407 H= 351:45 +CPU= 26.088
  09:27:07 STEP 1408 H= 352:00 +CPU= 27.210
  09:27:32 STEP 1409 H= 352:15 +CPU= 25.079
  09:27:57 STEP 1410 H= 352:30 +CPU= 24.821
  09:28:21 STEP 1411 H= 352:45 +CPU= 24.209
  09:28:47 STEP 1412 H= 353:00 +CPU= 26.292
  09:29:13 STEP 1413 H= 353:15 +CPU= 25.588
  09:29:38 STEP 1414 H= 353:30 +CPU= 25.402
  09:30:02 STEP 1415 H= 353:45 +CPU= 23.930
  09:30:36 STEP 1416 H= 354:00 +CPU= 33.145
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001416
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001416
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001416
  09:31:03 STEP 1417 H= 354:15 +CPU= 27.689
  09:31:31 STEP 1418 H= 354:30 +CPU= 27.059
  09:31:56 STEP 1419 H= 354:45 +CPU= 25.516
  09:32:22 STEP 1420 H= 355:00 +CPU= 25.768
  09:32:47 STEP 1421 H= 355:15 +CPU= 24.782
  09:33:09 STEP 1422 H= 355:30 +CPU= 22.028
  09:33:34 STEP 1423 H= 355:45 +CPU= 24.789
  09:34:01 STEP 1424 H= 356:00 +CPU= 26.596
  09:34:26 STEP 1425 H= 356:15 +CPU= 25.641
  09:34:50 STEP 1426 H= 356:30 +CPU= 23.512
  09:35:14 STEP 1427 H= 356:45 +CPU= 24.001
  09:35:46 STEP 1428 H= 357:00 +CPU= 32.222
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001428
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001428
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001428
  09:36:12 STEP 1429 H= 357:15 +CPU= 25.845
  09:36:37 STEP 1430 H= 357:30 +CPU= 25.105
  09:37:01 STEP 1431 H= 357:45 +CPU= 23.627
  09:37:26 STEP 1432 H= 358:00 +CPU= 24.844
  09:37:49 STEP 1433 H= 358:15 +CPU= 22.760
  09:38:13 STEP 1434 H= 358:30 +CPU= 23.997
  09:38:39 STEP 1435 H= 358:45 +CPU= 25.492
  09:39:04 STEP 1436 H= 359:00 +CPU= 25.442
  09:39:28 STEP 1437 H= 359:15 +CPU= 24.399
  09:39:53 STEP 1438 H= 359:30 +CPU= 24.291
  09:40:18 STEP 1439 H= 359:45 +CPU= 25.032
  09:40:51 STEP 1440 H= 360:00 +CPU= 33.341
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001440
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001440
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001440
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001344
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001344
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001344
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001356
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001356
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001356
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001368
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001368
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001368
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001380
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001380
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001380
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001392
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001392
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001392
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001404
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001404
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001404
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001416
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001416
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001416
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001428
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001428
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001428
Zipping up the intermediate file: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_a0cq_2016092300_20_1018_12288785_0_r1436370426_14.zip
Uploading the intermediate file: upload_file_14.zip
  09:41:16 STEP 1441 H= 360:15 +CPU= 24.863
  09:41:42 STEP 1442 H= 360:30 +CPU= 26.025
  09:42:08 STEP 1443 H= 360:45 +CPU= 25.913
  09:42:34 STEP 1444 H= 361:00 +CPU= 26.018
  09:42:59 STEP 1445 H= 361:15 +CPU= 24.282
  09:43:24 STEP 1446 H= 361:30 +CPU= 24.723
  09:43:48 STEP 1447 H= 361:45 +CPU= 24.226
  09:44:12 STEP 1448 H= 362:00 +CPU= 23.968
  09:44:35 STEP 1449 H= 362:15 +CPU= 22.716
  09:44:59 STEP 1450 H= 362:30 +CPU= 24.562
  09:45:24 STEP 1451 H= 362:45 +CPU= 24.332
  09:45:55 STEP 1452 H= 363:00 +CPU= 31.315
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001452
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001452
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001452
  09:46:20 STEP 1453 H= 363:15 +CPU= 24.864
  09:46:44 STEP 1454 H= 363:30 +CPU= 24.165
  09:47:09 STEP 1455 H= 363:45 +CPU= 25.023
  09:47:35 STEP 1456 H= 364:00 +CPU= 25.616
  09:47:59 STEP 1457 H= 364:15 +CPU= 23.748
  09:48:24 STEP 1458 H= 364:30 +CPU= 25.118
  09:48:49 STEP 1459 H= 364:45 +CPU= 24.780
  09:49:15 STEP 1460 H= 365:00 +CPU= 26.305
  09:49:39 STEP 1461 H= 365:15 +CPU= 23.827
  09:50:03 STEP 1462 H= 365:30 +CPU= 24.012
  09:50:28 STEP 1463 H= 365:45 +CPU= 24.614
  09:50:58 STEP 1464 H= 366:00 +CPU= 29.726
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001464
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001464
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001464
  09:51:22 STEP 1465 H= 366:15 +CPU= 24.209
  09:51:46 STEP 1466 H= 366:30 +CPU= 24.245
  09:52:13 STEP 1467 H= 366:45 +CPU= 26.325
  09:52:40 STEP 1468 H= 367:00 +CPU= 26.848
  09:53:05 STEP 1469 H= 367:15 +CPU= 25.510
  09:53:30 STEP 1470 H= 367:30 +CPU= 24.335
  09:53:55 STEP 1471 H= 367:45 +CPU= 25.070
  09:54:21 STEP 1472 H= 368:00 +CPU= 26.232
  09:54:47 STEP 1473 H= 368:15 +CPU= 25.957
  09:55:12 STEP 1474 H= 368:30 +CPU= 24.577
  09:55:36 STEP 1475 H= 368:45 +CPU= 24.493
  09:56:08 STEP 1476 H= 369:00 +CPU= 31.913
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001476
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001476
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001476
  09:56:32 STEP 1477 H= 369:15 +CPU= 23.856
  09:56:57 STEP 1478 H= 369:30 +CPU= 24.189
  09:57:21 STEP 1479 H= 369:45 +CPU= 24.516
  09:57:45 STEP 1480 H= 370:00 +CPU= 23.272
  09:58:10 STEP 1481 H= 370:15 +CPU= 25.269
  09:58:35 STEP 1482 H= 370:30 +CPU= 24.759
  09:59:01 STEP 1483 H= 370:45 +CPU= 26.323
  09:59:27 STEP 1484 H= 371:00 +CPU= 25.650
  09:59:53 STEP 1485 H= 371:15 +CPU= 25.935
  10:00:18 STEP 1486 H= 371:30 +CPU= 25.133
  10:00:42 STEP 1487 H= 371:45 +CPU= 24.033
  10:01:17 STEP 1488 H= 372:00 +CPU= 35.076
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001488
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001488
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001488
  10:01:43 STEP 1489 H= 372:15 +CPU= 25.135
  10:02:08 STEP 1490 H= 372:30 +CPU= 25.177
  10:02:33 STEP 1491 H= 372:45 +CPU= 25.159
  10:02:58 STEP 1492 H= 373:00 +CPU= 24.611
  10:03:24 STEP 1493 H= 373:15 +CPU= 25.799
  10:03:49 STEP 1494 H= 373:30 +CPU= 25.126
  10:04:13 STEP 1495 H= 373:45 +CPU= 24.454
  10:04:40 STEP 1496 H= 374:00 +CPU= 26.462
  10:05:06 STEP 1497 H= 374:15 +CPU= 25.918
  10:05:31 STEP 1498 H= 374:30 +CPU= 25.465
  10:05:56 STEP 1499 H= 374:45 +CPU= 24.428
  10:06:26 STEP 1500 H= 375:00 +CPU= 29.671
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001500
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001500
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001500
  10:06:50 STEP 1501 H= 375:15 +CPU= 24.477
  10:07:15 STEP 1502 H= 375:30 +CPU= 24.406
  10:07:38 STEP 1503 H= 375:45 +CPU= 23.496
  10:08:02 STEP 1504 H= 376:00 +CPU= 23.910
  10:08:28 STEP 1505 H= 376:15 +CPU= 26.049
  10:08:53 STEP 1506 H= 376:30 +CPU= 24.056
  10:09:17 STEP 1507 H= 376:45 +CPU= 24.234
  10:09:42 STEP 1508 H= 377:00 +CPU= 24.696
  10:10:08 STEP 1509 H= 377:15 +CPU= 25.999
  10:10:33 STEP 1510 H= 377:30 +CPU= 25.252
  10:11:00 STEP 1511 H= 377:45 +CPU= 26.687
  10:11:30 STEP 1512 H= 378:00 +CPU= 30.234
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001512
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001512
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001512
  10:11:53 STEP 1513 H= 378:15 +CPU= 23.338
  10:12:17 STEP 1514 H= 378:30 +CPU= 23.141
  10:12:42 STEP 1515 H= 378:45 +CPU= 25.414
  10:13:10 STEP 1516 H= 379:00 +CPU= 28.078
  10:13:35 STEP 1517 H= 379:15 +CPU= 25.134
  10:14:00 STEP 1518 H= 379:30 +CPU= 24.777
  10:14:25 STEP 1519 H= 379:45 +CPU= 24.701
  10:14:51 STEP 1520 H= 380:00 +CPU= 25.769
  10:15:16 STEP 1521 H= 380:15 +CPU= 24.636
  10:15:41 STEP 1522 H= 380:30 +CPU= 25.263
  10:16:07 STEP 1523 H= 380:45 +CPU= 26.167
  10:16:38 STEP 1524 H= 381:00 +CPU= 30.891
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001524
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001524
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001524
  10:17:04 STEP 1525 H= 381:15 +CPU= 25.816
  10:17:28 STEP 1526 H= 381:30 +CPU= 23.791
  10:17:54 STEP 1527 H= 381:45 +CPU= 25.619
  10:18:19 STEP 1528 H= 382:00 +CPU= 25.560
  10:18:45 STEP 1529 H= 382:15 +CPU= 25.935
  10:19:11 STEP 1530 H= 382:30 +CPU= 25.869
  10:19:36 STEP 1531 H= 382:45 +CPU= 24.663
  10:20:02 STEP 1532 H= 383:00 +CPU= 26.328
  10:20:27 STEP 1533 H= 383:15 +CPU= 25.002
  10:20:53 STEP 1534 H= 383:30 +CPU= 25.741
  10:21:19 STEP 1535 H= 383:45 +CPU= 25.181
  10:21:53 STEP 1536 H= 384:00 +CPU= 34.833
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001536
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001536
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001536
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001440
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001440
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001440
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001452
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001452
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001452
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001464
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001464
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001464
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001476
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001476
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001476
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001488
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001488
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001488
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001500
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001500
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001500
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001512
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001512
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001512
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001524
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001524
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001524
Zipping up the intermediate file: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_a0cq_2016092300_20_1018_12288785_0_r1436370426_15.zip
Uploading the intermediate file: upload_file_15.zip
  10:22:19 STEP 1537 H= 384:15 +CPU= 25.245
  10:22:43 STEP 1538 H= 384:30 +CPU= 24.565
  10:23:10 STEP 1539 H= 384:45 +CPU= 26.290
  10:23:36 STEP 1540 H= 385:00 +CPU= 26.105
  10:24:01 STEP 1541 H= 385:15 +CPU= 24.712
  10:24:25 STEP 1542 H= 385:30 +CPU= 24.278
  10:24:50 STEP 1543 H= 385:45 +CPU= 24.806
  10:25:15 STEP 1544 H= 386:00 +CPU= 25.007
  10:25:38 STEP 1545 H= 386:15 +CPU= 23.136
  10:26:02 STEP 1546 H= 386:30 +CPU= 23.673
  10:26:26 STEP 1547 H= 386:45 +CPU= 24.191
  10:26:56 STEP 1548 H= 387:00 +CPU= 29.462
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001548
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001548
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001548
  10:27:19 STEP 1549 H= 387:15 +CPU= 23.454
  10:27:44 STEP 1550 H= 387:30 +CPU= 24.971
  10:28:10 STEP 1551 H= 387:45 +CPU= 25.525
  10:28:35 STEP 1552 H= 388:00 +CPU= 24.664
  10:29:00 STEP 1553 H= 388:15 +CPU= 25.262
  10:29:24 STEP 1554 H= 388:30 +CPU= 24.056
  10:29:48 STEP 1555 H= 388:45 +CPU= 24.151
  10:30:14 STEP 1556 H= 389:00 +CPU= 25.339
  10:30:39 STEP 1557 H= 389:15 +CPU= 24.622
  10:31:04 STEP 1558 H= 389:30 +CPU= 25.426
  10:31:30 STEP 1559 H= 389:45 +CPU= 25.486
  10:32:01 STEP 1560 H= 390:00 +CPU= 31.122
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001560
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001560
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001560
  10:32:27 STEP 1561 H= 390:15 +CPU= 26.393
  10:32:55 STEP 1562 H= 390:30 +CPU= 28.111
  10:33:22 STEP 1563 H= 390:45 +CPU= 25.914
  10:33:45 STEP 1564 H= 391:00 +CPU= 23.186
  10:34:07 STEP 1565 H= 391:15 +CPU= 21.997
  10:34:29 STEP 1566 H= 391:30 +CPU= 22.147
  10:34:53 STEP 1567 H= 391:45 +CPU= 24.252
  10:35:18 STEP 1568 H= 392:00 +CPU= 24.998
  10:35:41 STEP 1569 H= 392:15 +CPU= 22.697
  10:36:03 STEP 1570 H= 392:30 +CPU= 22.125
  10:36:30 STEP 1571 H= 392:45 +CPU= 26.053
  10:37:02 STEP 1572 H= 393:00 +CPU= 31.892
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001572
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001572
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001572
  10:37:27 STEP 1573 H= 393:15 +CPU= 25.464
  10:37:51 STEP 1574 H= 393:30 +CPU= 23.795
  10:38:15 STEP 1575 H= 393:45 +CPU= 24.420
  10:38:41 STEP 1576 H= 394:00 +CPU= 25.872
  10:39:07 STEP 1577 H= 394:15 +CPU= 25.351
  10:39:32 STEP 1578 H= 394:30 +CPU= 25.394
  10:39:57 STEP 1579 H= 394:45 +CPU= 25.056
  10:40:24 STEP 1580 H= 395:00 +CPU= 26.506
  10:40:52 STEP 1581 H= 395:15 +CPU= 27.856
  10:41:18 STEP 1582 H= 395:30 +CPU= 25.604
  10:41:44 STEP 1583 H= 395:45 +CPU= 25.993
  10:42:18 STEP 1584 H= 396:00 +CPU= 33.719
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001584
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001584
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001584
  10:42:42 STEP 1585 H= 396:15 +CPU= 24.778
  10:43:07 STEP 1586 H= 396:30 +CPU= 24.058
  10:43:31 STEP 1587 H= 396:45 +CPU= 24.469
  10:43:57 STEP 1588 H= 397:00 +CPU= 26.048
  10:44:23 STEP 1589 H= 397:15 +CPU= 25.594
  10:44:48 STEP 1590 H= 397:30 +CPU= 24.640
  10:45:12 STEP 1591 H= 397:45 +CPU= 23.858
  10:45:38 STEP 1592 H= 398:00 +CPU= 26.410
  10:46:01 STEP 1593 H= 398:15 +CPU= 23.371
  10:46:25 STEP 1594 H= 398:30 +CPU= 23.291
  10:46:48 STEP 1595 H= 398:45 +CPU= 23.304
  10:47:18 STEP 1596 H= 399:00 +CPU= 30.112
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001596
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001596
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001596
  10:47:44 STEP 1597 H= 399:15 +CPU= 25.279
  10:48:07 STEP 1598 H= 399:30 +CPU= 23.331
  10:48:32 STEP 1599 H= 399:45 +CPU= 24.835
  10:48:55 STEP 1600 H= 400:00 +CPU= 23.368
  10:49:20 STEP 1601 H= 400:15 +CPU= 24.817
  10:49:45 STEP 1602 H= 400:30 +CPU= 24.505
  10:50:10 STEP 1603 H= 400:45 +CPU= 25.135
  10:50:36 STEP 1604 H= 401:00 +CPU= 26.033
  10:51:01 STEP 1605 H= 401:15 +CPU= 24.723
  10:51:25 STEP 1606 H= 401:30 +CPU= 23.831
  10:51:51 STEP 1607 H= 401:45 +CPU= 25.567
  10:52:22 STEP 1608 H= 402:00 +CPU= 31.419
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001608
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001608
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001608
  10:52:46 STEP 1609 H= 402:15 +CPU= 23.569
  10:53:09 STEP 1610 H= 402:30 +CPU= 22.959
  10:53:33 STEP 1611 H= 402:45 +CPU= 24.345
  10:53:59 STEP 1612 H= 403:00 +CPU= 26.190
  10:54:25 STEP 1613 H= 403:15 +CPU= 25.663
  10:54:50 STEP 1614 H= 403:30 +CPU= 24.368
  10:55:16 STEP 1615 H= 403:45 +CPU= 26.356
  10:55:40 STEP 1616 H= 404:00 +CPU= 24.319
  10:56:03 STEP 1617 H= 404:15 +CPU= 22.600
  10:56:27 STEP 1618 H= 404:30 +CPU= 24.232
  10:56:51 STEP 1619 H= 404:45 +CPU= 23.305
  10:57:22 STEP 1620 H= 405:00 +CPU= 31.251
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001620
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001620
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001620
  10:57:47 STEP 1621 H= 405:15 +CPU= 25.241
  10:58:11 STEP 1622 H= 405:30 +CPU= 23.501
  10:58:37 STEP 1623 H= 405:45 +CPU= 26.246
  10:59:05 STEP 1624 H= 406:00 +CPU= 27.605
  10:59:31 STEP 1625 H= 406:15 +CPU= 25.990
  10:59:56 STEP 1626 H= 406:30 +CPU= 25.214
  11:00:23 STEP 1627 H= 406:45 +CPU= 26.917
  11:00:50 STEP 1628 H= 407:00 +CPU= 26.562
  11:01:17 STEP 1629 H= 407:15 +CPU= 26.784
  11:01:42 STEP 1630 H= 407:30 +CPU= 25.013
  11:02:08 STEP 1631 H= 407:45 +CPU= 26.496
  11:02:43 STEP 1632 H= 408:00 +CPU= 34.409
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001632
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001632
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001632
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001536
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001536
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001536
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001548
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001548
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001548
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001560
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001560
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001560
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001572
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001572
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001572
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001584
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001584
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001584
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001596
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001596
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001596
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001608
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001608
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001608
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001620
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001620
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001620
Zipping up the intermediate file: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_a0cq_2016092300_20_1018_12288785_0_r1436370426_16.zip
Uploading the intermediate file: upload_file_16.zip
  11:03:11 STEP 1633 H= 408:15 +CPU= 27.542
  11:03:37 STEP 1634 H= 408:30 +CPU= 26.645
  11:04:04 STEP 1635 H= 408:45 +CPU= 26.284
  11:04:28 STEP 1636 H= 409:00 +CPU= 24.125
  11:04:56 STEP 1637 H= 409:15 +CPU= 27.550
  11:05:20 STEP 1638 H= 409:30 +CPU= 24.058
  11:05:44 STEP 1639 H= 409:45 +CPU= 24.476
  11:06:10 STEP 1640 H= 410:00 +CPU= 25.736
  11:06:35 STEP 1641 H= 410:15 +CPU= 24.957
  11:07:00 STEP 1642 H= 410:30 +CPU= 25.252
  11:07:26 STEP 1643 H= 410:45 +CPU= 25.461
  11:07:58 STEP 1644 H= 411:00 +CPU= 31.754
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001644
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001644
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001644
  11:08:23 STEP 1645 H= 411:15 +CPU= 25.319
  11:08:48 STEP 1646 H= 411:30 +CPU= 24.891
  11:09:12 STEP 1647 H= 411:45 +CPU= 24.173
  11:09:38 STEP 1648 H= 412:00 +CPU= 26.003
  11:10:03 STEP 1649 H= 412:15 +CPU= 24.471
  11:10:30 STEP 1650 H= 412:30 +CPU= 26.548
  11:10:54 STEP 1651 H= 412:45 +CPU= 24.551
  11:11:18 STEP 1652 H= 413:00 +CPU= 23.747
  11:11:43 STEP 1653 H= 413:15 +CPU= 25.089
  11:12:09 STEP 1654 H= 413:30 +CPU= 25.357
  11:12:34 STEP 1655 H= 413:45 +CPU= 25.663
  11:13:06 STEP 1656 H= 414:00 +CPU= 31.192
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001656
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001656
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001656
  11:13:31 STEP 1657 H= 414:15 +CPU= 25.613
  11:13:55 STEP 1658 H= 414:30 +CPU= 23.701
  11:14:20 STEP 1659 H= 414:45 +CPU= 24.802
  11:14:45 STEP 1660 H= 415:00 +CPU= 24.435
  11:15:08 STEP 1661 H= 415:15 +CPU= 23.669
  11:15:33 STEP 1662 H= 415:30 +CPU= 24.841
  11:15:57 STEP 1663 H= 415:45 +CPU= 24.256
  11:16:23 STEP 1664 H= 416:00 +CPU= 25.871
  11:16:48 STEP 1665 H= 416:15 +CPU= 24.795
  11:17:13 STEP 1666 H= 416:30 +CPU= 24.253
  11:17:36 STEP 1667 H= 416:45 +CPU= 23.064
  11:18:06 STEP 1668 H= 417:00 +CPU= 30.448
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001668
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001668
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001668
  11:18:32 STEP 1669 H= 417:15 +CPU= 25.199
  11:18:58 STEP 1670 H= 417:30 +CPU= 25.862
  11:19:20 STEP 1671 H= 417:45 +CPU= 22.400
  11:19:45 STEP 1672 H= 418:00 +CPU= 25.168
  11:20:10 STEP 1673 H= 418:15 +CPU= 24.919
  11:20:36 STEP 1674 H= 418:30 +CPU= 25.592
  11:21:03 STEP 1675 H= 418:45 +CPU= 26.612
  11:21:28 STEP 1676 H= 419:00 +CPU= 24.862
  11:21:53 STEP 1677 H= 419:15 +CPU= 25.175
  11:22:19 STEP 1678 H= 419:30 +CPU= 26.346
  11:22:44 STEP 1679 H= 419:45 +CPU= 24.682
  11:23:17 STEP 1680 H= 420:00 +CPU= 33.302
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001680
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001680
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001680
  11:23:44 STEP 1681 H= 420:15 +CPU= 26.216
  11:24:08 STEP 1682 H= 420:30 +CPU= 23.957
  11:24:32 STEP 1683 H= 420:45 +CPU= 24.498
  11:25:00 STEP 1684 H= 421:00 +CPU= 27.062
  11:25:25 STEP 1685 H= 421:15 +CPU= 25.901
  11:25:51 STEP 1686 H= 421:30 +CPU= 25.742
  11:26:16 STEP 1687 H= 421:45 +CPU= 24.399
  11:26:41 STEP 1688 H= 422:00 +CPU= 24.709
  11:27:04 STEP 1689 H= 422:15 +CPU= 23.697
  11:27:30 STEP 1690 H= 422:30 +CPU= 25.764
  11:27:55 STEP 1691 H= 422:45 +CPU= 24.590
  11:28:25 STEP 1692 H= 423:00 +CPU= 30.525
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001692
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001692
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001692
  11:28:50 STEP 1693 H= 423:15 +CPU= 24.622
  11:29:17 STEP 1694 H= 423:30 +CPU= 26.550
  11:29:42 STEP 1695 H= 423:45 +CPU= 24.924
  11:30:08 STEP 1696 H= 424:00 +CPU= 26.153
  11:30:35 STEP 1697 H= 424:15 +CPU= 26.591
  11:30:59 STEP 1698 H= 424:30 +CPU= 24.102
  11:31:22 STEP 1699 H= 424:45 +CPU= 23.017
  11:31:45 STEP 1700 H= 425:00 +CPU= 23.130
  11:32:10 STEP 1701 H= 425:15 +CPU= 25.003
  11:32:35 STEP 1702 H= 425:30 +CPU= 24.334
  11:32:58 STEP 1703 H= 425:45 +CPU= 23.276
  11:33:29 STEP 1704 H= 426:00 +CPU= 31.300
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001704
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001704
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001704
  11:33:55 STEP 1705 H= 426:15 +CPU= 25.223
  11:34:19 STEP 1706 H= 426:30 +CPU= 24.148
  11:34:44 STEP 1707 H= 426:45 +CPU= 25.163
  11:35:08 STEP 1708 H= 427:00 +CPU= 24.402
  11:35:34 STEP 1709 H= 427:15 +CPU= 25.155
  11:35:59 STEP 1710 H= 427:30 +CPU= 25.092
  11:36:23 STEP 1711 H= 427:45 +CPU= 23.768
  11:36:46 STEP 1712 H= 428:00 +CPU= 23.298
  11:37:10 STEP 1713 H= 428:15 +CPU= 23.712
  11:37:33 STEP 1714 H= 428:30 +CPU= 23.181
  11:37:58 STEP 1715 H= 428:45 +CPU= 24.904
  11:38:28 STEP 1716 H= 429:00 +CPU= 30.216
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001716
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001716
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001716
  11:38:54 STEP 1717 H= 429:15 +CPU= 25.264
  11:39:19 STEP 1718 H= 429:30 +CPU= 24.851
  11:39:42 STEP 1719 H= 429:45 +CPU= 23.036
  11:40:04 STEP 1720 H= 430:00 +CPU= 22.316
  11:40:29 STEP 1721 H= 430:15 +CPU= 25.285
  11:40:54 STEP 1722 H= 430:30 +CPU= 24.396
  11:41:20 STEP 1723 H= 430:45 +CPU= 26.044
  11:41:46 STEP 1724 H= 431:00 +CPU= 25.516
  11:42:12 STEP 1725 H= 431:15 +CPU= 26.600
  11:42:36 STEP 1726 H= 431:30 +CPU= 23.534
  11:42:58 STEP 1727 H= 431:45 +CPU= 21.717
  11:43:29 STEP 1728 H= 432:00 +CPU= 30.914
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001728
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001728
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001728
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001632
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001632
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001632
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001644
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001644
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001644
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001656
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001656
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001656
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001668
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001668
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001668
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001680
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001680
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001680
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001692
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001692
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001692
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001704
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001704
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001704
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001716
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001716
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001716
Zipping up the intermediate file: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_a0cq_2016092300_20_1018_12288785_0_r1436370426_17.zip
Uploading the intermediate file: upload_file_17.zip
  11:43:51 STEP 1729 H= 432:15 +CPU= 22.491
  11:44:15 STEP 1730 H= 432:30 +CPU= 24.006
  11:44:39 STEP 1731 H= 432:45 +CPU= 23.087
  11:45:05 STEP 1732 H= 433:00 +CPU= 26.204
  11:45:33 STEP 1733 H= 433:15 +CPU= 27.736
  11:45:58 STEP 1734 H= 433:30 +CPU= 25.521
  11:46:25 STEP 1735 H= 433:45 +CPU= 25.990
  11:46:50 STEP 1736 H= 434:00 +CPU= 25.211
  11:47:13 STEP 1737 H= 434:15 +CPU= 23.485
  11:47:38 STEP 1738 H= 434:30 +CPU= 24.361
  11:48:03 STEP 1739 H= 434:45 +CPU= 24.954
  11:48:35 STEP 1740 H= 435:00 +CPU= 32.182
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001740
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001740
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001740
  11:48:56 STEP 1741 H= 435:15 +CPU= 21.272
  11:49:19 STEP 1742 H= 435:30 +CPU= 22.349
  11:49:42 STEP 1743 H= 435:45 +CPU= 23.138
  11:50:07 STEP 1744 H= 436:00 +CPU= 25.256
  11:50:32 STEP 1745 H= 436:15 +CPU= 24.206
  11:50:55 STEP 1746 H= 436:30 +CPU= 22.922
  11:51:19 STEP 1747 H= 436:45 +CPU= 23.838
  11:51:42 STEP 1748 H= 437:00 +CPU= 23.871
  11:52:06 STEP 1749 H= 437:15 +CPU= 23.279
  11:52:28 STEP 1750 H= 437:30 +CPU= 21.777
  11:52:51 STEP 1751 H= 437:45 +CPU= 23.030
  11:53:20 STEP 1752 H= 438:00 +CPU= 29.391
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001752
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001752
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001752
  11:53:44 STEP 1753 H= 438:15 +CPU= 23.983
  11:54:11 STEP 1754 H= 438:30 +CPU= 26.795
  11:54:37 STEP 1755 H= 438:45 +CPU= 25.344
  11:55:03 STEP 1756 H= 439:00 +CPU= 26.530
  11:55:28 STEP 1757 H= 439:15 +CPU= 25.001
  11:55:53 STEP 1758 H= 439:30 +CPU= 24.300
  11:56:19 STEP 1759 H= 439:45 +CPU= 26.095
  11:56:44 STEP 1760 H= 440:00 +CPU= 25.463
  11:57:10 STEP 1761 H= 440:15 +CPU= 25.401
  11:57:36 STEP 1762 H= 440:30 +CPU= 25.835
  11:58:01 STEP 1763 H= 440:45 +CPU= 25.385
  11:58:33 STEP 1764 H= 441:00 +CPU= 31.456
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001764
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001764
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001764
  11:58:59 STEP 1765 H= 441:15 +CPU= 26.164
  11:59:24 STEP 1766 H= 441:30 +CPU= 25.265
  11:59:50 STEP 1767 H= 441:45 +CPU= 26.102
  12:00:16 STEP 1768 H= 442:00 +CPU= 25.383
  12:00:41 STEP 1769 H= 442:15 +CPU= 24.785
  12:01:05 STEP 1770 H= 442:30 +CPU= 24.420
  12:01:32 STEP 1771 H= 442:45 +CPU= 26.501
  12:01:58 STEP 1772 H= 443:00 +CPU= 25.856
  12:02:23 STEP 1773 H= 443:15 +CPU= 24.975
  12:02:48 STEP 1774 H= 443:30 +CPU= 25.194
  12:03:13 STEP 1775 H= 443:45 +CPU= 24.659
  12:03:48 STEP 1776 H= 444:00 +CPU= 35.448
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001776
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001776
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001776
  12:04:13 STEP 1777 H= 444:15 +CPU= 24.422
  12:04:38 STEP 1778 H= 444:30 +CPU= 24.698
  12:05:03 STEP 1779 H= 444:45 +CPU= 24.884
  12:05:27 STEP 1780 H= 445:00 +CPU= 24.660
  12:05:53 STEP 1781 H= 445:15 +CPU= 25.944
  12:06:18 STEP 1782 H= 445:30 +CPU= 24.876
  12:06:41 STEP 1783 H= 445:45 +CPU= 22.468
  12:07:04 STEP 1784 H= 446:00 +CPU= 23.126
  12:07:26 STEP 1785 H= 446:15 +CPU= 22.456
  12:07:51 STEP 1786 H= 446:30 +CPU= 24.234
  12:08:15 STEP 1787 H= 446:45 +CPU= 24.434
  12:08:46 STEP 1788 H= 447:00 +CPU= 31.050
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001788
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001788
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001788
  12:09:11 STEP 1789 H= 447:15 +CPU= 24.913
  12:09:37 STEP 1790 H= 447:30 +CPU= 25.724
  12:10:01 STEP 1791 H= 447:45 +CPU= 23.817
  12:10:29 STEP 1792 H= 448:00 +CPU= 28.240
  12:10:55 STEP 1793 H= 448:15 +CPU= 25.690
  12:11:21 STEP 1794 H= 448:30 +CPU= 25.345
  12:11:45 STEP 1795 H= 448:45 +CPU= 24.223
  12:12:10 STEP 1796 H= 449:00 +CPU= 25.389
  12:12:37 STEP 1797 H= 449:15 +CPU= 26.159
  12:13:01 STEP 1798 H= 449:30 +CPU= 24.724
  12:13:28 STEP 1799 H= 449:45 +CPU= 26.311
  12:13:59 STEP 1800 H= 450:00 +CPU= 30.784
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001800
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001800
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001800
  12:14:23 STEP 1801 H= 450:15 +CPU= 24.596
  12:14:47 STEP 1802 H= 450:30 +CPU= 24.213
  12:15:14 STEP 1803 H= 450:45 +CPU= 26.628
  12:15:42 STEP 1804 H= 451:00 +CPU= 27.262
  12:16:07 STEP 1805 H= 451:15 +CPU= 25.354
  12:16:32 STEP 1806 H= 451:30 +CPU= 24.743
  12:16:57 STEP 1807 H= 451:45 +CPU= 25.225
  12:17:22 STEP 1808 H= 452:00 +CPU= 24.499
  12:17:45 STEP 1809 H= 452:15 +CPU= 23.557
  12:18:10 STEP 1810 H= 452:30 +CPU= 24.650
  12:18:35 STEP 1811 H= 452:45 +CPU= 25.085
  12:19:05 STEP 1812 H= 453:00 +CPU= 29.538
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001812
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001812
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001812
  12:19:30 STEP 1813 H= 453:15 +CPU= 25.157
  12:19:56 STEP 1814 H= 453:30 +CPU= 25.467
  12:20:22 STEP 1815 H= 453:45 +CPU= 25.921
  12:20:48 STEP 1816 H= 454:00 +CPU= 26.207
  12:21:12 STEP 1817 H= 454:15 +CPU= 24.077
  12:21:38 STEP 1818 H= 454:30 +CPU= 25.737
  12:22:02 STEP 1819 H= 454:45 +CPU= 24.168
  12:22:28 STEP 1820 H= 455:00 +CPU= 25.778
  12:22:53 STEP 1821 H= 455:15 +CPU= 24.664
  12:23:16 STEP 1822 H= 455:30 +CPU= 23.685
  12:23:40 STEP 1823 H= 455:45 +CPU= 23.771
  12:24:12 STEP 1824 H= 456:00 +CPU= 32.146
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001824
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001824
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001824
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001728
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001728
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001728
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001740
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001740
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001740
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001752
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001752
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001752
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001764
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001764
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001764
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001776
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001776
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001776
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001788
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001788
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001788
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001800
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001800
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001800
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001812
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001812
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001812
Zipping up the intermediate file: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_a0cq_2016092300_20_1018_12288785_0_r1436370426_18.zip
Uploading the intermediate file: upload_file_18.zip
  12:24:38 STEP 1825 H= 456:15 +CPU= 25.254
  12:25:04 STEP 1826 H= 456:30 +CPU= 25.903
  12:25:29 STEP 1827 H= 456:45 +CPU= 24.914
  12:25:55 STEP 1828 H= 457:00 +CPU= 26.660
  12:26:20 STEP 1829 H= 457:15 +CPU= 24.450
  12:26:46 STEP 1830 H= 457:30 +CPU= 26.433
  12:27:10 STEP 1831 H= 457:45 +CPU= 23.929
  12:27:38 STEP 1832 H= 458:00 +CPU= 27.197
  12:28:03 STEP 1833 H= 458:15 +CPU= 25.101
  12:28:29 STEP 1834 H= 458:30 +CPU= 25.896
  12:28:55 STEP 1835 H= 458:45 +CPU= 25.539
  12:29:26 STEP 1836 H= 459:00 +CPU= 31.557
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001836
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001836
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001836
  12:29:53 STEP 1837 H= 459:15 +CPU= 26.436
  12:30:18 STEP 1838 H= 459:30 +CPU= 25.087
  12:30:42 STEP 1839 H= 459:45 +CPU= 23.651
  12:31:07 STEP 1840 H= 460:00 +CPU= 25.175
  12:31:31 STEP 1841 H= 460:15 +CPU= 24.312
  12:31:57 STEP 1842 H= 460:30 +CPU= 25.274
  12:32:21 STEP 1843 H= 460:45 +CPU= 24.399
  12:32:47 STEP 1844 H= 461:00 +CPU= 26.302
  12:33:12 STEP 1845 H= 461:15 +CPU= 24.783
  12:33:38 STEP 1846 H= 461:30 +CPU= 25.786
  12:34:03 STEP 1847 H= 461:45 +CPU= 25.152
  12:34:36 STEP 1848 H= 462:00 +CPU= 32.249
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001848
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001848
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001848
  12:35:01 STEP 1849 H= 462:15 +CPU= 25.408
  12:35:26 STEP 1850 H= 462:30 +CPU= 25.245
  12:35:51 STEP 1851 H= 462:45 +CPU= 24.954
  12:36:18 STEP 1852 H= 463:00 +CPU= 26.063
  12:36:42 STEP 1853 H= 463:15 +CPU= 24.647
  12:37:05 STEP 1854 H= 463:30 +CPU= 22.343
  12:37:29 STEP 1855 H= 463:45 +CPU= 23.741
  12:37:54 STEP 1856 H= 464:00 +CPU= 25.329
  12:38:18 STEP 1857 H= 464:15 +CPU= 23.630
  12:38:43 STEP 1858 H= 464:30 +CPU= 25.035
  12:39:09 STEP 1859 H= 464:45 +CPU= 25.874
  12:39:41 STEP 1860 H= 465:00 +CPU= 32.403
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001860
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001860
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001860
  12:40:07 STEP 1861 H= 465:15 +CPU= 26.091
  12:40:32 STEP 1862 H= 465:30 +CPU= 24.209
  12:40:56 STEP 1863 H= 465:45 +CPU= 24.129
  12:41:22 STEP 1864 H= 466:00 +CPU= 26.120
  12:41:48 STEP 1865 H= 466:15 +CPU= 25.805
  12:42:12 STEP 1866 H= 466:30 +CPU= 24.313
  12:42:36 STEP 1867 H= 466:45 +CPU= 24.022
  12:43:00 STEP 1868 H= 467:00 +CPU= 23.459
  12:43:24 STEP 1869 H= 467:15 +CPU= 24.459
  12:43:49 STEP 1870 H= 467:30 +CPU= 24.943
  12:44:13 STEP 1871 H= 467:45 +CPU= 23.320
  12:44:47 STEP 1872 H= 468:00 +CPU= 33.971
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001872
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001872
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001872
  12:45:12 STEP 1873 H= 468:15 +CPU= 25.323
  12:45:36 STEP 1874 H= 468:30 +CPU= 23.313
  12:46:00 STEP 1875 H= 468:45 +CPU= 24.269
  12:46:25 STEP 1876 H= 469:00 +CPU= 24.777
  12:46:51 STEP 1877 H= 469:15 +CPU= 26.092
  12:47:16 STEP 1878 H= 469:30 +CPU= 24.995
  12:47:42 STEP 1879 H= 469:45 +CPU= 26.044
  12:48:08 STEP 1880 H= 470:00 +CPU= 25.542
  12:48:32 STEP 1881 H= 470:15 +CPU= 24.081
  12:48:57 STEP 1882 H= 470:30 +CPU= 25.186
  12:49:22 STEP 1883 H= 470:45 +CPU= 25.090
  12:49:56 STEP 1884 H= 471:00 +CPU= 33.098
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001884
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001884
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001884
  12:50:22 STEP 1885 H= 471:15 +CPU= 26.091
  12:50:47 STEP 1886 H= 471:30 +CPU= 24.557
  12:51:12 STEP 1887 H= 471:45 +CPU= 25.087
  12:51:37 STEP 1888 H= 472:00 +CPU= 25.717
  12:52:04 STEP 1889 H= 472:15 +CPU= 26.210
  12:52:29 STEP 1890 H= 472:30 +CPU= 25.557
  12:52:58 STEP 1891 H= 472:45 +CPU= 28.179
  12:53:25 STEP 1892 H= 473:00 +CPU= 26.856
  12:53:49 STEP 1893 H= 473:15 +CPU= 24.441
  12:54:11 STEP 1894 H= 473:30 +CPU= 22.044
  12:54:34 STEP 1895 H= 473:45 +CPU= 22.605
  12:55:03 STEP 1896 H= 474:00 +CPU= 29.454
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001896
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001896
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001896
  12:55:29 STEP 1897 H= 474:15 +CPU= 25.173
  12:55:57 STEP 1898 H= 474:30 +CPU= 28.457
  12:56:24 STEP 1899 H= 474:45 +CPU= 26.195
  12:56:50 STEP 1900 H= 475:00 +CPU= 26.542
  12:57:16 STEP 1901 H= 475:15 +CPU= 26.173
  12:57:43 STEP 1902 H= 475:30 +CPU= 26.511
  12:58:08 STEP 1903 H= 475:45 +CPU= 25.306
  12:58:35 STEP 1904 H= 476:00 +CPU= 26.884
  12:59:01 STEP 1905 H= 476:15 +CPU= 25.116
  12:59:25 STEP 1906 H= 476:30 +CPU= 24.787
  12:59:49 STEP 1907 H= 476:45 +CPU= 23.818
  13:00:21 STEP 1908 H= 477:00 +CPU= 31.521
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001908
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001908
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001908
  13:00:45 STEP 1909 H= 477:15 +CPU= 23.796
  13:01:09 STEP 1910 H= 477:30 +CPU= 24.303
  13:01:36 STEP 1911 H= 477:45 +CPU= 27.193
  13:02:02 STEP 1912 H= 478:00 +CPU= 25.173
  13:02:26 STEP 1913 H= 478:15 +CPU= 24.451
  13:02:51 STEP 1914 H= 478:30 +CPU= 24.399
  13:03:17 STEP 1915 H= 478:45 +CPU= 26.294
  13:03:43 STEP 1916 H= 479:00 +CPU= 25.387
  13:04:07 STEP 1917 H= 479:15 +CPU= 24.543
  13:04:32 STEP 1918 H= 479:30 +CPU= 24.309
  13:04:56 STEP 1919 H= 479:45 +CPU= 24.798
  13:05:29 STEP 1920 H= 480:00 +CPU= 32.025
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I      0.1720293983E-20      I       0.5619900928E-07      I
ICloud fractionI      0.0000000000E+00      I       0.4823708013E-03      I
I  Relat. Hum. I      0.2844362538E+00      I       0.2988006343E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.5832135296E+01      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1920 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001920 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001920
 MPI-TASK:   1 -    301105572 BYTES IN      7 RECORDS TRANSFERRED IN    0.0004 SECONDS752763.9 Mbytes/s, TOTAL TIME=    0.0083( 4.8%)
 13:05:29 STEP 1920 H= 480:00 +CPU= 32.025
 END CNT3
 NSTEP =  1920 CNT0   000000000  23.501  23.501  23.570   0.997               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ            0/           0 WRITTEN        57546/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1   1008    0        0            0    57546 ************    72.9     0.0    72.9     0.0   158.8
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.99      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 2082    4253.9    4253.9     17.92      0.00
   9 SPCM     - SPECTRAL COMP.                    1920     751.6     751.6      2.92      0.00
  10 SCAN2M - PHYSICS                             1921   11989.4   11989.4     46.60      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                161     653.8     653.8      0.21      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 83      53.0      53.0      0.01      0.00
  14 SUINIF                                          1    5298.8    5298.8      0.01      0.00
  17 GRIDFPOS IN CNT4                              161      26.9      26.9      0.01      0.00
  18 SUSPECG                                         1    2689.8    2689.8      0.01      0.00
  19 SUSPEC                                          1    2696.6    2696.6      0.01      0.00
  24 SUGRIDU                                         1    2009.5    2009.5      0.00      0.00
  25 SPECRT                                          1     209.1     209.1      0.00      0.00
  26 SUGRIDF                                         1     383.6     383.6      0.00      0.00
  27 RESTART FILES - WRITING                        40    2631.6    2631.6      0.21      0.00
  28 RESTART FILES - READING                         1       0.0       0.0      0.00      0.00
  29 SU4FPOS IN CNT4                               161       0.0       0.0      0.00      0.00
  30 DYNFPOS IN CNT4                               161    5450.8    5450.8      1.78      0.00
  31 POSDDH IN STEPO                                 9       0.7       0.7      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   1921    5476.9    5476.9     21.29      0.00
  39 SU0YOMB                                         1     387.5     387.5      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   1921      20.8      20.8      0.08      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             1920     355.8     355.8      1.38      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             1920      49.1      49.1      0.19      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 83       0.2       0.2      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     4165     343.9     343.9      2.90      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      4006     227.9     227.9      1.85      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       4006      81.5      81.5      0.66      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      4165     105.4     105.4      0.89      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      70.9      70.9      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           4165      46.9      46.9      0.40      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           4006      24.6      24.6      0.20      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           4165      69.4      69.4      0.58      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           4006      32.6      32.6      0.26      0.00
 400 GSTATS                                     223224       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                207696       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    49428.7 CPU TIME   49284.6 VECTOR TIME    49284.6


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       35.0
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMGGh7zg+001920
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMSHh7zg+001920
Moving to projects directory: /home/pdw/Mo/1/slots/0/ICMUAh7zg+001920
Adding to the zip: /home/pdw/Mo/1/slots/0/NODE.001_01
Adding to the zip: /home/pdw/Mo/1/slots/0/ifs.stat
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001896
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001872
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001920
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001896
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001896
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001836
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001848
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001836
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001860
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001848
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001824
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001908
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001872
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001884
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001824
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001824
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001884
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001860
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001920
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001920
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001908
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001872
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001908
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001848
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMUAh7zg+001836
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMSHh7zg+001884
Adding to the zip: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_12288785/ICMGGh7zg+001860
Zipping up the final file: /home/pdw/Mo/1/projects/climateprediction.net/oifs_43r3_bl_a0cq_2016092300_20_1018_12288785_0_r1436370426_19.zip
Uploading the final file: upload_file_19.zip
Uploading trickle at timestep: 1727100
13:08:57 (183918): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
16 Jun 2024 12:07:31 1522755 22442350 oifs_43r3_bl_a0cq_2016092300_20_1018_12288785_0 1,727,100 49,284 0.0285
16 Jun 2024 05:25:41 1522755 22442350 oifs_43r3_bl_a0cq_2016092300_20_1018_12288785_0 864,000 24,718 0.0286


©2024 climateprediction.net