climateprediction.net home page
Task 22444064

Task 22444064

Name oifs_43r3_bl_a1nk_2016092300_20_1018_12290471_0
Workunit 12290471
Created 12 Jun 2024, 23:03:48 UTC
Sent 12 Jun 2024, 23:18:45 UTC
Report deadline 11 Aug 2024, 23:18:45 UTC
Received 16 Jun 2024, 1:04:13 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1535694
Run time 10 hours 21 min 11 sec
CPU time 10 hours 21 min 11 sec
Validate state Valid
Credit 2,635.55
Device peak FLOPS 9.73 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 4,919.19 MB
Peak swap size 5,981.07 MB
Peak disk usage 2,277.42 MB
Stderr
<core_client_version>8.0.2</core_client_version>
<![CDATA[
<stderr_txt>
/boinc-client/slots/3/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001404
  13:35:47 STEP 1405 H= 351:15 +CPU= 18.361
  13:36:04 STEP 1406 H= 351:30 +CPU= 17.708
  13:36:22 STEP 1407 H= 351:45 +CPU= 17.884
  13:36:41 STEP 1408 H= 352:00 +CPU= 19.004
  13:37:00 STEP 1409 H= 352:15 +CPU= 18.172
  13:37:18 STEP 1410 H= 352:30 +CPU= 18.659
  13:37:37 STEP 1411 H= 352:45 +CPU= 18.611
  13:37:56 STEP 1412 H= 353:00 +CPU= 18.885
  13:38:14 STEP 1413 H= 353:15 +CPU= 18.050
  13:38:32 STEP 1414 H= 353:30 +CPU= 17.539
  13:38:50 STEP 1415 H= 353:45 +CPU= 17.856
  13:39:12 STEP 1416 H= 354:00 +CPU= 22.198
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001416
  13:39:30 STEP 1417 H= 354:15 +CPU= 18.165
  13:39:48 STEP 1418 H= 354:30 +CPU= 18.024
  13:40:06 STEP 1419 H= 354:45 +CPU= 18.083
  13:40:23 STEP 1420 H= 355:00 +CPU= 16.697
  13:40:39 STEP 1421 H= 355:15 +CPU= 15.576
  13:40:54 STEP 1422 H= 355:30 +CPU= 15.605
  13:41:13 STEP 1423 H= 355:45 +CPU= 18.903
  13:41:36 STEP 1424 H= 356:00 +CPU= 22.170
  13:41:56 STEP 1425 H= 356:15 +CPU= 20.393
  13:42:13 STEP 1426 H= 356:30 +CPU= 16.476
  13:42:32 STEP 1427 H= 356:45 +CPU= 18.608
  13:42:54 STEP 1428 H= 357:00 +CPU= 22.681
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001428
  13:43:13 STEP 1429 H= 357:15 +CPU= 18.540
  13:43:32 STEP 1430 H= 357:30 +CPU= 18.453
  13:43:50 STEP 1431 H= 357:45 +CPU= 18.319
  13:44:09 STEP 1432 H= 358:00 +CPU= 18.674
  13:44:27 STEP 1433 H= 358:15 +CPU= 17.865
  13:44:45 STEP 1434 H= 358:30 +CPU= 18.020
  13:45:03 STEP 1435 H= 358:45 +CPU= 18.032
  13:45:21 STEP 1436 H= 359:00 +CPU= 18.008
  13:45:38 STEP 1437 H= 359:15 +CPU= 17.505
  13:45:57 STEP 1438 H= 359:30 +CPU= 18.200
  13:46:15 STEP 1439 H= 359:45 +CPU= 17.950
  13:46:42 STEP 1440 H= 360:00 +CPU= 26.818
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMUAh7zg+001428
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1nk_2016092300_20_1018_12290471_0_r1960818899_14.zip
Uploading the intermediate file: upload_file_14.zip
  13:46:57 STEP 1441 H= 360:15 +CPU= 15.075
  13:47:12 STEP 1442 H= 360:30 +CPU= 14.569
Uploading trickle at timestep: 1296000
  13:47:30 STEP 1443 H= 360:45 +CPU= 18.489
  13:47:53 STEP 1444 H= 361:00 +CPU= 22.263
  13:48:11 STEP 1445 H= 361:15 +CPU= 18.505
  13:48:29 STEP 1446 H= 361:30 +CPU= 17.956
  13:48:47 STEP 1447 H= 361:45 +CPU= 17.389
  13:49:05 STEP 1448 H= 362:00 +CPU= 18.320
  13:49:23 STEP 1449 H= 362:15 +CPU= 18.017
  13:49:41 STEP 1450 H= 362:30 +CPU= 17.626
  13:49:58 STEP 1451 H= 362:45 +CPU= 16.912
  13:50:19 STEP 1452 H= 363:00 +CPU= 21.236
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001452
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001452
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001452
  13:50:38 STEP 1453 H= 363:15 +CPU= 18.840
  13:50:56 STEP 1454 H= 363:30 +CPU= 18.246
  13:51:14 STEP 1455 H= 363:45 +CPU= 17.860
  13:51:33 STEP 1456 H= 364:00 +CPU= 18.353
  13:51:50 STEP 1457 H= 364:15 +CPU= 17.605
  13:52:08 STEP 1458 H= 364:30 +CPU= 17.486
  13:52:27 STEP 1459 H= 364:45 +CPU= 18.738
  13:52:46 STEP 1460 H= 365:00 +CPU= 18.848
  13:53:05 STEP 1461 H= 365:15 +CPU= 19.176
  13:53:23 STEP 1462 H= 365:30 +CPU= 18.317
  13:53:42 STEP 1463 H= 365:45 +CPU= 18.347
  13:54:04 STEP 1464 H= 366:00 +CPU= 22.699
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001464
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001464
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001464
  13:54:23 STEP 1465 H= 366:15 +CPU= 18.229
  13:54:41 STEP 1466 H= 366:30 +CPU= 18.448
  13:55:00 STEP 1467 H= 366:45 +CPU= 18.344
  13:55:18 STEP 1468 H= 367:00 +CPU= 18.122
  13:55:37 STEP 1469 H= 367:15 +CPU= 18.914
  13:55:55 STEP 1470 H= 367:30 +CPU= 18.639
  13:56:14 STEP 1471 H= 367:45 +CPU= 18.755
  13:56:33 STEP 1472 H= 368:00 +CPU= 18.970
  13:56:52 STEP 1473 H= 368:15 +CPU= 18.329
  13:57:10 STEP 1474 H= 368:30 +CPU= 18.221
  13:57:29 STEP 1475 H= 368:45 +CPU= 18.621
  13:57:51 STEP 1476 H= 369:00 +CPU= 22.548
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001476
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001476
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001476
  13:58:10 STEP 1477 H= 369:15 +CPU= 18.356
  13:58:28 STEP 1478 H= 369:30 +CPU= 18.741
  13:58:46 STEP 1479 H= 369:45 +CPU= 18.022
  13:59:05 STEP 1480 H= 370:00 +CPU= 18.908
  13:59:23 STEP 1481 H= 370:15 +CPU= 17.982
  13:59:42 STEP 1482 H= 370:30 +CPU= 18.307
  14:00:00 STEP 1483 H= 370:45 +CPU= 18.109
  14:00:19 STEP 1484 H= 371:00 +CPU= 19.273
  14:00:38 STEP 1485 H= 371:15 +CPU= 18.157
  14:00:56 STEP 1486 H= 371:30 +CPU= 18.696
  14:01:14 STEP 1487 H= 371:45 +CPU= 17.850
  14:01:39 STEP 1488 H= 372:00 +CPU= 24.789
  14:01:56 STEP 1489 H= 372:15 +CPU= 16.814
  14:02:13 STEP 1490 H= 372:30 +CPU= 16.713
  14:02:29 STEP 1491 H= 372:45 +CPU= 16.662
  14:02:47 STEP 1492 H= 373:00 +CPU= 17.524
  14:03:04 STEP 1493 H= 373:15 +CPU= 17.103
  14:03:21 STEP 1494 H= 373:30 +CPU= 17.042
  14:03:38 STEP 1495 H= 373:45 +CPU= 17.236
  14:03:56 STEP 1496 H= 374:00 +CPU= 17.953
  14:04:14 STEP 1497 H= 374:15 +CPU= 17.379
  14:04:31 STEP 1498 H= 374:30 +CPU= 17.170
  14:04:48 STEP 1499 H= 374:45 +CPU= 17.225
  14:05:09 STEP 1500 H= 375:00 +CPU= 21.474
  14:05:26 STEP 1501 H= 375:15 +CPU= 17.090
  14:05:44 STEP 1502 H= 375:30 +CPU= 17.122
  14:06:01 STEP 1503 H= 375:45 +CPU= 17.188
  14:06:18 STEP 1504 H= 376:00 +CPU= 17.609
  14:06:35 STEP 1505 H= 376:15 +CPU= 17.085
  14:06:53 STEP 1506 H= 376:30 +CPU= 17.041
  14:07:10 STEP 1507 H= 376:45 +CPU= 17.116
  14:07:27 STEP 1508 H= 377:00 +CPU= 17.571
  14:07:44 STEP 1509 H= 377:15 +CPU= 17.211
  14:08:02 STEP 1510 H= 377:30 +CPU= 17.332
  14:08:19 STEP 1511 H= 377:45 +CPU= 17.448
  14:08:41 STEP 1512 H= 378:00 +CPU= 21.579
  14:08:58 STEP 1513 H= 378:15 +CPU= 17.466
  14:09:16 STEP 1514 H= 378:30 +CPU= 17.408
  14:09:33 STEP 1515 H= 378:45 +CPU= 17.380
  14:09:51 STEP 1516 H= 379:00 +CPU= 17.894
  14:10:08 STEP 1517 H= 379:15 +CPU= 17.343
  14:10:26 STEP 1518 H= 379:30 +CPU= 17.264
  14:10:43 STEP 1519 H= 379:45 +CPU= 17.302
  14:11:00 STEP 1520 H= 380:00 +CPU= 17.403
  14:11:17 STEP 1521 H= 380:15 +CPU= 17.018
  14:11:35 STEP 1522 H= 380:30 +CPU= 17.262
  14:11:52 STEP 1523 H= 380:45 +CPU= 17.095
  14:12:13 STEP 1524 H= 381:00 +CPU= 21.529
  14:12:30 STEP 1525 H= 381:15 +CPU= 17.199
  14:12:48 STEP 1526 H= 381:30 +CPU= 17.238
  14:13:05 STEP 1527 H= 381:45 +CPU= 17.109
  14:13:22 STEP 1528 H= 382:00 +CPU= 17.670
  14:13:40 STEP 1529 H= 382:15 +CPU= 17.164
  14:13:57 STEP 1530 H= 382:30 +CPU= 17.378
  14:14:14 STEP 1531 H= 382:45 +CPU= 17.204
  14:14:32 STEP 1532 H= 383:00 +CPU= 17.680
  14:14:49 STEP 1533 H= 383:15 +CPU= 17.092
  14:15:06 STEP 1534 H= 383:30 +CPU= 17.069
  14:15:24 STEP 1535 H= 383:45 +CPU= 17.867
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001488
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001488
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001488
  14:15:50 STEP 1536 H= 384:00 +CPU= 25.575
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001536
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001536
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMGGh7zg+001452
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMSHh7zg+001452
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMUAh7zg+001452
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMGGh7zg+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMSHh7zg+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMUAh7zg+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMGGh7zg+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMSHh7zg+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMUAh7zg+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMGGh7zg+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMSHh7zg+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMUAh7zg+001488
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1nk_2016092300_20_1018_12290471_0_r1960818899_15.zip
Uploading the intermediate file: upload_file_15.zip
  14:16:07 STEP 1537 H= 384:15 +CPU= 17.620
  14:16:25 STEP 1538 H= 384:30 +CPU= 17.518
  14:16:45 STEP 1539 H= 384:45 +CPU= 19.671
  14:17:09 STEP 1540 H= 385:00 +CPU= 24.467
  14:17:31 STEP 1541 H= 385:15 +CPU= 21.578
  14:17:48 STEP 1542 H= 385:30 +CPU= 17.448
  14:18:06 STEP 1543 H= 385:45 +CPU= 17.435
  14:18:24 STEP 1544 H= 386:00 +CPU= 17.742
  14:18:41 STEP 1545 H= 386:15 +CPU= 17.438
  14:18:59 STEP 1546 H= 386:30 +CPU= 17.510
  14:19:17 STEP 1547 H= 386:45 +CPU= 17.886
  14:19:38 STEP 1548 H= 387:00 +CPU= 21.859
  14:19:56 STEP 1549 H= 387:15 +CPU= 17.479
  14:20:14 STEP 1550 H= 387:30 +CPU= 18.487
  14:20:34 STEP 1551 H= 387:45 +CPU= 19.317
  14:20:53 STEP 1552 H= 388:00 +CPU= 19.023
  14:21:12 STEP 1553 H= 388:15 +CPU= 18.689
  14:21:30 STEP 1554 H= 388:30 +CPU= 18.296
  14:21:49 STEP 1555 H= 388:45 +CPU= 18.782
  14:22:08 STEP 1556 H= 389:00 +CPU= 18.957
  14:22:26 STEP 1557 H= 389:15 +CPU= 18.427
  14:22:45 STEP 1558 H= 389:30 +CPU= 18.540
  14:23:04 STEP 1559 H= 389:45 +CPU= 18.952
  14:23:27 STEP 1560 H= 390:00 +CPU= 23.070
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001560
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001560
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001560
  14:23:45 STEP 1561 H= 390:15 +CPU= 18.328
  14:24:04 STEP 1562 H= 390:30 +CPU= 18.695
  14:24:23 STEP 1563 H= 390:45 +CPU= 18.838
  14:24:42 STEP 1564 H= 391:00 +CPU= 18.680
  14:25:00 STEP 1565 H= 391:15 +CPU= 18.018
  14:25:19 STEP 1566 H= 391:30 +CPU= 18.780
  14:25:38 STEP 1567 H= 391:45 +CPU= 19.384
  14:25:57 STEP 1568 H= 392:00 +CPU= 18.867
  14:26:16 STEP 1569 H= 392:15 +CPU= 18.615
  14:26:34 STEP 1570 H= 392:30 +CPU= 18.554
  14:26:53 STEP 1571 H= 392:45 +CPU= 18.370
  14:27:16 STEP 1572 H= 393:00 +CPU= 23.018
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001572
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001572
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001572
  14:27:35 STEP 1573 H= 393:15 +CPU= 19.266
  14:27:54 STEP 1574 H= 393:30 +CPU= 18.256
  14:28:13 STEP 1575 H= 393:45 +CPU= 19.261
  14:28:32 STEP 1576 H= 394:00 +CPU= 19.239
  14:28:52 STEP 1577 H= 394:15 +CPU= 19.399
  14:29:11 STEP 1578 H= 394:30 +CPU= 18.852
  14:29:29 STEP 1579 H= 394:45 +CPU= 18.855
  14:29:49 STEP 1580 H= 395:00 +CPU= 19.424
  14:30:07 STEP 1581 H= 395:15 +CPU= 18.232
  14:30:25 STEP 1582 H= 395:30 +CPU= 18.112
  14:30:44 STEP 1583 H= 395:45 +CPU= 18.377
  14:31:11 STEP 1584 H= 396:00 +CPU= 27.053
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001584
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001584
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001584
  14:31:30 STEP 1585 H= 396:15 +CPU= 18.289
  14:31:48 STEP 1586 H= 396:30 +CPU= 18.174
  14:32:07 STEP 1587 H= 396:45 +CPU= 18.813
  14:32:26 STEP 1588 H= 397:00 +CPU= 19.506
  14:32:45 STEP 1589 H= 397:15 +CPU= 18.838
  14:33:04 STEP 1590 H= 397:30 +CPU= 18.631
  14:33:22 STEP 1591 H= 397:45 +CPU= 18.292
  14:33:41 STEP 1592 H= 398:00 +CPU= 18.810
  14:33:59 STEP 1593 H= 398:15 +CPU= 18.348
  14:34:18 STEP 1594 H= 398:30 +CPU= 18.862
  14:34:37 STEP 1595 H= 398:45 +CPU= 18.525
  14:35:00 STEP 1596 H= 399:00 +CPU= 23.460
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001596
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001596
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001596
  14:35:19 STEP 1597 H= 399:15 +CPU= 18.339
  14:35:38 STEP 1598 H= 399:30 +CPU= 19.012
  14:35:57 STEP 1599 H= 399:45 +CPU= 18.768
  14:36:16 STEP 1600 H= 400:00 +CPU= 19.178
  14:36:35 STEP 1601 H= 400:15 +CPU= 18.608
  14:36:53 STEP 1602 H= 400:30 +CPU= 18.309
  14:37:12 STEP 1603 H= 400:45 +CPU= 18.681
  14:37:31 STEP 1604 H= 401:00 +CPU= 19.279
  14:37:50 STEP 1605 H= 401:15 +CPU= 18.731
  14:38:09 STEP 1606 H= 401:30 +CPU= 18.580
  14:38:27 STEP 1607 H= 401:45 +CPU= 18.532
  14:38:50 STEP 1608 H= 402:00 +CPU= 23.021
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001608
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001608
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001608
  14:39:09 STEP 1609 H= 402:15 +CPU= 18.538
  14:39:28 STEP 1610 H= 402:30 +CPU= 18.648
  14:39:46 STEP 1611 H= 402:45 +CPU= 18.645
  14:40:06 STEP 1612 H= 403:00 +CPU= 19.490
  14:40:26 STEP 1613 H= 403:15 +CPU= 19.949
  14:40:44 STEP 1614 H= 403:30 +CPU= 18.265
  14:41:02 STEP 1615 H= 403:45 +CPU= 18.228
  14:41:21 STEP 1616 H= 404:00 +CPU= 18.119
  14:41:39 STEP 1617 H= 404:15 +CPU= 18.688
  14:41:57 STEP 1618 H= 404:30 +CPU= 17.674
  14:42:15 STEP 1619 H= 404:45 +CPU= 18.209
  14:42:38 STEP 1620 H= 405:00 +CPU= 22.970
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001620
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001620
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001620
  14:42:56 STEP 1621 H= 405:15 +CPU= 17.947
  14:43:16 STEP 1622 H= 405:30 +CPU= 19.126
  14:43:34 STEP 1623 H= 405:45 +CPU= 18.785
  14:43:54 STEP 1624 H= 406:00 +CPU= 19.354
  14:44:12 STEP 1625 H= 406:15 +CPU= 18.378
  14:44:32 STEP 1626 H= 406:30 +CPU= 19.467
  14:44:51 STEP 1627 H= 406:45 +CPU= 19.042
  14:45:10 STEP 1628 H= 407:00 +CPU= 19.200
  14:45:29 STEP 1629 H= 407:15 +CPU= 18.605
  14:45:48 STEP 1630 H= 407:30 +CPU= 19.319
  14:46:07 STEP 1631 H= 407:45 +CPU= 19.210
  14:46:35 STEP 1632 H= 408:00 +CPU= 27.093
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001632
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001632
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMGGh7zg+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMSHh7zg+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMUAh7zg+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMGGh7zg+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMSHh7zg+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMUAh7zg+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMGGh7zg+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMSHh7zg+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMUAh7zg+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMGGh7zg+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMSHh7zg+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMUAh7zg+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMGGh7zg+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMSHh7zg+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMUAh7zg+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMGGh7zg+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMSHh7zg+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMUAh7zg+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMGGh7zg+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMSHh7zg+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMUAh7zg+001620
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1nk_2016092300_20_1018_12290471_0_r1960818899_16.zip
Uploading the intermediate file: upload_file_16.zip
  14:46:54 STEP 1633 H= 408:15 +CPU= 18.447
  14:47:13 STEP 1634 H= 408:30 +CPU= 18.860
  14:47:37 STEP 1635 H= 408:45 +CPU= 23.692
  14:47:58 STEP 1636 H= 409:00 +CPU= 21.020
  14:48:17 STEP 1637 H= 409:15 +CPU= 19.075
  14:48:36 STEP 1638 H= 409:30 +CPU= 18.835
  14:48:54 STEP 1639 H= 409:45 +CPU= 18.429
  14:49:16 STEP 1640 H= 410:00 +CPU= 21.758
  14:49:39 STEP 1641 H= 410:15 +CPU= 22.760
  14:50:00 STEP 1642 H= 410:30 +CPU= 20.913
  14:50:19 STEP 1643 H= 410:45 +CPU= 18.655
  14:50:42 STEP 1644 H= 411:00 +CPU= 22.972
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001644
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001644
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001644
  14:51:01 STEP 1645 H= 411:15 +CPU= 18.719
  14:51:19 STEP 1646 H= 411:30 +CPU= 18.198
  14:51:37 STEP 1647 H= 411:45 +CPU= 18.460
  14:51:57 STEP 1648 H= 412:00 +CPU= 19.639
  14:52:16 STEP 1649 H= 412:15 +CPU= 18.792
  14:52:34 STEP 1650 H= 412:30 +CPU= 18.205
  14:52:54 STEP 1651 H= 412:45 +CPU= 19.330
  14:53:13 STEP 1652 H= 413:00 +CPU= 19.381
  14:53:32 STEP 1653 H= 413:15 +CPU= 18.965
  14:53:51 STEP 1654 H= 413:30 +CPU= 18.934
  14:54:10 STEP 1655 H= 413:45 +CPU= 18.859
  14:54:33 STEP 1656 H= 414:00 +CPU= 23.146
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001656
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001656
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001656
  14:54:52 STEP 1657 H= 414:15 +CPU= 18.460
  14:55:11 STEP 1658 H= 414:30 +CPU= 18.710
  14:55:30 STEP 1659 H= 414:45 +CPU= 19.272
  14:55:50 STEP 1660 H= 415:00 +CPU= 19.600
  14:56:09 STEP 1661 H= 415:15 +CPU= 19.225
  14:56:29 STEP 1662 H= 415:30 +CPU= 19.704
  14:56:48 STEP 1663 H= 415:45 +CPU= 18.778
  14:57:07 STEP 1664 H= 416:00 +CPU= 19.443
  14:57:26 STEP 1665 H= 416:15 +CPU= 18.748
  14:57:45 STEP 1666 H= 416:30 +CPU= 19.041
  14:58:03 STEP 1667 H= 416:45 +CPU= 18.441
  14:58:27 STEP 1668 H= 417:00 +CPU= 22.959
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001668
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001668
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001668
  14:58:45 STEP 1669 H= 417:15 +CPU= 18.872
  14:59:04 STEP 1670 H= 417:30 +CPU= 18.205
  14:59:22 STEP 1671 H= 417:45 +CPU= 18.032
  14:59:41 STEP 1672 H= 418:00 +CPU= 19.366
  15:00:01 STEP 1673 H= 418:15 +CPU= 19.538
  15:00:20 STEP 1674 H= 418:30 +CPU= 18.756
  15:00:38 STEP 1675 H= 418:45 +CPU= 18.532
  15:00:58 STEP 1676 H= 419:00 +CPU= 19.406
  15:01:18 STEP 1677 H= 419:15 +CPU= 20.320
  15:01:36 STEP 1678 H= 419:30 +CPU= 18.130
  15:01:55 STEP 1679 H= 419:45 +CPU= 18.827
  15:02:23 STEP 1680 H= 420:00 +CPU= 26.985
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001680
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001680
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001680
  15:02:41 STEP 1681 H= 420:15 +CPU= 18.631
  15:03:00 STEP 1682 H= 420:30 +CPU= 18.723
  15:03:18 STEP 1683 H= 420:45 +CPU= 18.124
  15:03:37 STEP 1684 H= 421:00 +CPU= 18.635
  15:03:56 STEP 1685 H= 421:15 +CPU= 18.732
  15:04:15 STEP 1686 H= 421:30 +CPU= 18.839
  15:04:33 STEP 1687 H= 421:45 +CPU= 18.327
  15:04:51 STEP 1688 H= 422:00 +CPU= 18.272
  15:05:10 STEP 1689 H= 422:15 +CPU= 18.479
  15:05:28 STEP 1690 H= 422:30 +CPU= 18.449
  15:05:47 STEP 1691 H= 422:45 +CPU= 18.773
  15:06:10 STEP 1692 H= 423:00 +CPU= 22.594
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001692
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001692
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001692
  15:06:28 STEP 1693 H= 423:15 +CPU= 18.216
  15:06:46 STEP 1694 H= 423:30 +CPU= 18.169
  15:07:05 STEP 1695 H= 423:45 +CPU= 18.419
  15:07:24 STEP 1696 H= 424:00 +CPU= 18.933
  15:07:42 STEP 1697 H= 424:15 +CPU= 18.232
  15:08:00 STEP 1698 H= 424:30 +CPU= 18.222
  15:08:19 STEP 1699 H= 424:45 +CPU= 18.365
  15:08:37 STEP 1700 H= 425:00 +CPU= 18.566
  15:08:55 STEP 1701 H= 425:15 +CPU= 17.950
  15:09:14 STEP 1702 H= 425:30 +CPU= 18.269
  15:09:32 STEP 1703 H= 425:45 +CPU= 18.496
  15:09:56 STEP 1704 H= 426:00 +CPU= 23.274
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001704
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001704
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001704
  15:10:14 STEP 1705 H= 426:15 +CPU= 18.732
  15:10:33 STEP 1706 H= 426:30 +CPU= 18.124
  15:10:51 STEP 1707 H= 426:45 +CPU= 18.434
  15:11:10 STEP 1708 H= 427:00 +CPU= 18.743
  15:11:29 STEP 1709 H= 427:15 +CPU= 18.857
  15:11:48 STEP 1710 H= 427:30 +CPU= 18.796
  15:12:06 STEP 1711 H= 427:45 +CPU= 18.696
  15:12:25 STEP 1712 H= 428:00 +CPU= 18.787
  15:12:44 STEP 1713 H= 428:15 +CPU= 18.516
  15:13:02 STEP 1714 H= 428:30 +CPU= 18.053
  15:13:20 STEP 1715 H= 428:45 +CPU= 18.214
  15:13:44 STEP 1716 H= 429:00 +CPU= 23.609
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001716
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001716
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001716
  15:14:03 STEP 1717 H= 429:15 +CPU= 19.006
  15:14:21 STEP 1718 H= 429:30 +CPU= 17.916
  15:14:40 STEP 1719 H= 429:45 +CPU= 18.864
  15:14:59 STEP 1720 H= 430:00 +CPU= 19.268
  15:15:18 STEP 1721 H= 430:15 +CPU= 18.324
  15:15:36 STEP 1722 H= 430:30 +CPU= 17.970
  15:15:54 STEP 1723 H= 430:45 +CPU= 18.421
  15:16:13 STEP 1724 H= 431:00 +CPU= 18.839
  15:16:32 STEP 1725 H= 431:15 +CPU= 18.535
  15:16:50 STEP 1726 H= 431:30 +CPU= 18.475
  15:17:09 STEP 1727 H= 431:45 +CPU= 18.659
  15:17:36 STEP 1728 H= 432:00 +CPU= 26.726
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001728
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001728
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMGGh7zg+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMSHh7zg+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMUAh7zg+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMGGh7zg+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMSHh7zg+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMUAh7zg+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMGGh7zg+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMSHh7zg+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMUAh7zg+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMGGh7zg+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMSHh7zg+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMUAh7zg+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMGGh7zg+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMSHh7zg+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMUAh7zg+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMGGh7zg+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMSHh7zg+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMUAh7zg+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMGGh7zg+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMSHh7zg+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMUAh7zg+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMGGh7zg+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMSHh7zg+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMUAh7zg+001716
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1nk_2016092300_20_1018_12290471_0_r1960818899_17.zip
Uploading the intermediate file: upload_file_17.zip
  15:17:54 STEP 1729 H= 432:15 +CPU= 18.314
  15:18:13 STEP 1730 H= 432:30 +CPU= 18.853
  15:18:36 STEP 1731 H= 432:45 +CPU= 22.348
  15:18:54 STEP 1732 H= 433:00 +CPU= 18.476
  15:19:11 STEP 1733 H= 433:15 +CPU= 17.003
  15:19:28 STEP 1734 H= 433:30 +CPU= 17.003
  15:19:45 STEP 1735 H= 433:45 +CPU= 17.042
  15:20:03 STEP 1736 H= 434:00 +CPU= 17.391
  15:20:20 STEP 1737 H= 434:15 +CPU= 17.040
  15:20:37 STEP 1738 H= 434:30 +CPU= 17.042
  15:20:54 STEP 1739 H= 434:45 +CPU= 17.228
  15:21:15 STEP 1740 H= 435:00 +CPU= 21.537
  15:21:40 STEP 1741 H= 435:15 +CPU= 21.000
  15:21:58 STEP 1742 H= 435:30 +CPU= 17.488
  15:22:14 STEP 1743 H= 435:45 +CPU= 15.874
  15:22:29 STEP 1744 H= 436:00 +CPU= 15.151
  15:22:45 STEP 1745 H= 436:15 +CPU= 16.534
  15:23:04 STEP 1746 H= 436:30 +CPU= 18.453
  15:23:28 STEP 1747 H= 436:45 +CPU= 23.860
  15:23:47 STEP 1748 H= 437:00 +CPU= 19.291
  15:24:04 STEP 1749 H= 437:15 +CPU= 16.664
  15:24:21 STEP 1750 H= 437:30 +CPU= 17.105
  15:24:38 STEP 1751 H= 437:45 +CPU= 17.170
  15:24:59 STEP 1752 H= 438:00 +CPU= 20.737
  15:25:16 STEP 1753 H= 438:15 +CPU= 16.468
  15:25:33 STEP 1754 H= 438:30 +CPU= 16.966
  15:25:49 STEP 1755 H= 438:45 +CPU= 16.351
  15:26:06 STEP 1756 H= 439:00 +CPU= 17.204
  15:26:23 STEP 1757 H= 439:15 +CPU= 16.774
  15:26:40 STEP 1758 H= 439:30 +CPU= 16.540
  15:26:56 STEP 1759 H= 439:45 +CPU= 16.525
  15:27:13 STEP 1760 H= 440:00 +CPU= 16.731
  15:27:31 STEP 1761 H= 440:15 +CPU= 17.567
  15:27:49 STEP 1762 H= 440:30 +CPU= 17.811
  15:28:06 STEP 1763 H= 440:45 +CPU= 17.725
  15:28:28 STEP 1764 H= 441:00 +CPU= 22.031
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001764
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001764
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001764
  15:28:46 STEP 1765 H= 441:15 +CPU= 17.727
  15:29:04 STEP 1766 H= 441:30 +CPU= 17.491
  15:29:22 STEP 1767 H= 441:45 +CPU= 17.709
  15:29:40 STEP 1768 H= 442:00 +CPU= 17.947
  15:29:58 STEP 1769 H= 442:15 +CPU= 18.154
Suspend request received from the BOINC client, suspending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a1nk
(argv4) batchid: 1018
(argv5) wuid: 12290471
(argv6) fclen: 20
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/3
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.13
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/3/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/3/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_07c7638f08bd69bdb33aa59bd22813ae to: /var/lib/boinc-client/slots/3/oifs_43r3_bl_a1nk_2016092300_20_1018_12290471.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/3/oifs_43r3_bl_a1nk_2016092300_20_1018_12290471.zip
ic_ancil_file: ic_ancil_12290471
ifsdata_file: ifsdata_12290471
climate_data_file: clim_data_12290471
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc-client/slots/3/ic_ancil_12290471.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/3/ic_ancil_12290471.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_d48939f0951f8842d1ea3d2aeb2f51f7 to: /var/lib/boinc-client/slots/3/ifsdata/ifsdata_12290471.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/3/ifsdata/ifsdata_12290471.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/3/159l_2/clim_data_12290471.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/3/159l_2/clim_data_12290471.zip
Checking for progress XML file: /var/lib/boinc-client/slots/3/progress_file_12290471.xml
Opened progress file ok : /var/lib/boinc-client/slots/3/progress_file_12290471.xml
-- Model is restarting --
Adjusting last_iter, 1769, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/3/progress_file_12290471.xml
last_cpu_time: 33869
upload_file_number: 18
last_iter: 1729
last_upload: 1555200
model_completed: 0
total_length_of_simulation: 1728000
result_base_name: oifs_43r3_bl_a1nk_2016092300_20_1018_12290471_0_r1960818899
The child process has been launched with process id: 4415
Executing the command: /var/lib/boinc-client/slots/3/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:gp-VirtualBox:1:1:4415:4415] [20240616:090008:1718492408:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440
[EC_DRHOOK:gp-VirtualBox:1:1:4415:4415] [20240616:090008:1718492408:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:gp-VirtualBox:1:1:4415:4415] [20240616:090008:1718492408:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:gp-VirtualBox:1:1:4415:4415] [20240616:090008:1718492408:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:gp-VirtualBox:1:1:4415:4415] [20240616:090008:1718492408:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:gp-VirtualBox:1:1:4415:4415] [20240616:090008:1718492408:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:gp-VirtualBox:1:1:4415:4415] [20240616:090008:1718492408:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:gp-VirtualBox:1:1:4415:4415] [20240616:090008:1718492408:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:gp-VirtualBox:1:1:4415:4415] [20240616:090008:1718492408:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:gp-VirtualBox:1:1:4415:4415] [20240616:090008:1718492408:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:gp-VirtualBox:1:1:4415:4415] [20240616:090008:1718492408:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:gp-VirtualBox:1:1:4415:4415] [20240616:090008:1718492408:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:gp-VirtualBox:1:1:4415:4415] [20240616:090008:1718492408:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:gp-VirtualBox:1:1:4415:4415] [20240616:090008:1718492408:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:gp-VirtualBox:1:1:4415:4415] [20240616:090008:1718492408:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:gp-VirtualBox:1:1:4415:4415] [20240616:090008:1718492408:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:gp-VirtualBox:1:1:4415:4415] [20240616:090008:1718492408:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:gp-VirtualBox:1:1:4415:4415] [20240616:090008:1718492408:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:gp-VirtualBox:1:1:4415:4415] [20240616:090008:1718492408:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:gp-VirtualBox:1:1:4415:4415] [20240616:090008:1718492408:0.000] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:gp-VirtualBox:1:1:4415:4415] [20240616:090008:1718492408:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:gp-VirtualBox:1:1:4415:4415] [20240616:090008:1718492408:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:gp-VirtualBox:1:1:4415:4415] [20240616:090008:1718492408:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:gp-VirtualBox:1:1:4415:4415] [20240616:090008:1718492408:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:gp-VirtualBox:1:1:4415:4415] [20240616:090008:1718492408:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:gp-VirtualBox:1:1:4415:4415] [20240616:090008:1718492408:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:gp-VirtualBox:1:1:4415:4415] [20240616:090008:1718492408:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:gp-VirtualBox:1:1:4415:4415] [20240616:090008:1718492408:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:gp-VirtualBox:1:1:4415:4415] [20240616:090008:1718492408:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:gp-VirtualBox:1:1:4415:4415] [20240616:090008:1718492408:0.000] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  09:01:11 STEP 1728 H= 432:00 +CPU= 42.420
  09:01:29 STEP 1729 H= 432:15 +CPU= 18.331
  09:01:47 STEP 1730 H= 432:30 +CPU= 18.368
  09:02:06 STEP 1731 H= 432:45 +CPU= 18.310
  09:02:24 STEP 1732 H= 433:00 +CPU= 18.563
  09:02:43 STEP 1733 H= 433:15 +CPU= 18.517
  09:03:02 STEP 1734 H= 433:30 +CPU= 18.705
  09:03:19 STEP 1735 H= 433:45 +CPU= 17.601
  09:03:38 STEP 1736 H= 434:00 +CPU= 18.667
  09:03:57 STEP 1737 H= 434:15 +CPU= 18.360
  09:04:15 STEP 1738 H= 434:30 +CPU= 18.615
  09:04:35 STEP 1739 H= 434:45 +CPU= 19.449
  09:04:58 STEP 1740 H= 435:00 +CPU= 22.577
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001740
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001740
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001740
  09:05:15 STEP 1741 H= 435:15 +CPU= 17.416
  09:05:32 STEP 1742 H= 435:30 +CPU= 17.041
  09:05:50 STEP 1743 H= 435:45 +CPU= 17.420
  09:06:08 STEP 1744 H= 436:00 +CPU= 18.091
  09:06:25 STEP 1745 H= 436:15 +CPU= 16.974
  09:06:42 STEP 1746 H= 436:30 +CPU= 17.005
  09:06:59 STEP 1747 H= 436:45 +CPU= 16.894
  09:07:17 STEP 1748 H= 437:00 +CPU= 17.503
  09:07:34 STEP 1749 H= 437:15 +CPU= 17.539
  09:07:51 STEP 1750 H= 437:30 +CPU= 17.200
  09:08:08 STEP 1751 H= 437:45 +CPU= 16.964
  09:08:30 STEP 1752 H= 438:00 +CPU= 21.770
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001752
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001752
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001752
  09:08:47 STEP 1753 H= 438:15 +CPU= 17.205
  09:09:04 STEP 1754 H= 438:30 +CPU= 16.666
  09:09:21 STEP 1755 H= 438:45 +CPU= 17.247
  09:09:40 STEP 1756 H= 439:00 +CPU= 18.145
  09:09:56 STEP 1757 H= 439:15 +CPU= 16.577
  09:10:14 STEP 1758 H= 439:30 +CPU= 17.131
  09:10:30 STEP 1759 H= 439:45 +CPU= 16.761
  09:10:48 STEP 1760 H= 440:00 +CPU= 17.862
  09:11:05 STEP 1761 H= 440:15 +CPU= 16.963
  09:11:24 STEP 1762 H= 440:30 +CPU= 18.898
  09:11:41 STEP 1763 H= 440:45 +CPU= 16.764
  09:12:03 STEP 1764 H= 441:00 +CPU= 21.656
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001764
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001764
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001764
  09:12:19 STEP 1765 H= 441:15 +CPU= 16.488
  09:12:36 STEP 1766 H= 441:30 +CPU= 16.280
  09:12:52 STEP 1767 H= 441:45 +CPU= 16.220
  09:13:09 STEP 1768 H= 442:00 +CPU= 16.646
  09:13:25 STEP 1769 H= 442:15 +CPU= 16.549
  09:13:42 STEP 1770 H= 442:30 +CPU= 16.310
  09:13:58 STEP 1771 H= 442:45 +CPU= 16.205
  09:14:15 STEP 1772 H= 443:00 +CPU= 16.692
  09:14:31 STEP 1773 H= 443:15 +CPU= 16.503
  09:14:47 STEP 1774 H= 443:30 +CPU= 15.986
  09:15:04 STEP 1775 H= 443:45 +CPU= 16.439
  09:15:30 STEP 1776 H= 444:00 +CPU= 24.955
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001776
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001776
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001776
  09:15:46 STEP 1777 H= 444:15 +CPU= 16.479
  09:16:04 STEP 1778 H= 444:30 +CPU= 17.788
  09:16:22 STEP 1779 H= 444:45 +CPU= 17.672
  09:16:41 STEP 1780 H= 445:00 +CPU= 18.643
  09:16:59 STEP 1781 H= 445:15 +CPU= 18.636
  09:17:18 STEP 1782 H= 445:30 +CPU= 18.118
  09:17:37 STEP 1783 H= 445:45 +CPU= 18.973
  09:17:56 STEP 1784 H= 446:00 +CPU= 18.670
  09:18:15 STEP 1785 H= 446:15 +CPU= 19.220
  09:18:33 STEP 1786 H= 446:30 +CPU= 18.591
  09:18:51 STEP 1787 H= 446:45 +CPU= 17.650
  09:19:12 STEP 1788 H= 447:00 +CPU= 21.075
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001788
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001788
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001788
  09:19:29 STEP 1789 H= 447:15 +CPU= 17.072
  09:19:47 STEP 1790 H= 447:30 +CPU= 17.192
  09:20:04 STEP 1791 H= 447:45 +CPU= 17.264
  09:20:22 STEP 1792 H= 448:00 +CPU= 17.547
  09:20:39 STEP 1793 H= 448:15 +CPU= 17.707
  09:20:56 STEP 1794 H= 448:30 +CPU= 17.014
  09:21:13 STEP 1795 H= 448:45 +CPU= 16.803
  09:21:30 STEP 1796 H= 449:00 +CPU= 17.003
  09:21:47 STEP 1797 H= 449:15 +CPU= 16.834
  09:22:04 STEP 1798 H= 449:30 +CPU= 17.065
  09:22:22 STEP 1799 H= 449:45 +CPU= 17.325
  09:22:44 STEP 1800 H= 450:00 +CPU= 21.941
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001800
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001800
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001800
  09:23:01 STEP 1801 H= 450:15 +CPU= 16.793
  09:23:18 STEP 1802 H= 450:30 +CPU= 16.869
  09:23:32 STEP 1803 H= 450:45 +CPU= 14.762
  09:23:49 STEP 1804 H= 451:00 +CPU= 16.610
  09:24:06 STEP 1805 H= 451:15 +CPU= 17.034
  09:24:23 STEP 1806 H= 451:30 +CPU= 16.453
  09:24:39 STEP 1807 H= 451:45 +CPU= 16.059
  09:24:55 STEP 1808 H= 452:00 +CPU= 16.542
  09:25:12 STEP 1809 H= 452:15 +CPU= 16.096
  09:25:28 STEP 1810 H= 452:30 +CPU= 16.044
  09:25:44 STEP 1811 H= 452:45 +CPU= 16.060
  09:26:04 STEP 1812 H= 453:00 +CPU= 20.677
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001812
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001812
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001812
  09:26:21 STEP 1813 H= 453:15 +CPU= 15.965
  09:26:36 STEP 1814 H= 453:30 +CPU= 15.934
  09:26:52 STEP 1815 H= 453:45 +CPU= 15.745
  09:27:09 STEP 1816 H= 454:00 +CPU= 16.418
  09:27:26 STEP 1817 H= 454:15 +CPU= 16.813
  09:27:42 STEP 1818 H= 454:30 +CPU= 16.110
  09:27:58 STEP 1819 H= 454:45 +CPU= 16.623
  09:28:15 STEP 1820 H= 455:00 +CPU= 16.675
  09:28:32 STEP 1821 H= 455:15 +CPU= 16.489
  09:28:48 STEP 1822 H= 455:30 +CPU= 16.293
  09:29:04 STEP 1823 H= 455:45 +CPU= 15.607
  09:29:29 STEP 1824 H= 456:00 +CPU= 25.244
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001824
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001824
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMGGh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMSHh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMUAh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMGGh7zg+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMSHh7zg+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMUAh7zg+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMGGh7zg+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMSHh7zg+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMUAh7zg+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMGGh7zg+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMSHh7zg+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMUAh7zg+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMGGh7zg+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMSHh7zg+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMUAh7zg+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMGGh7zg+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMSHh7zg+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMUAh7zg+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMGGh7zg+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMSHh7zg+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMUAh7zg+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMGGh7zg+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMSHh7zg+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMUAh7zg+001812
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1nk_2016092300_20_1018_12290471_0_r1960818899_18.zip
Uploading the intermediate file: upload_file_18.zip
  09:29:46 STEP 1825 H= 456:15 +CPU= 16.373
  09:30:02 STEP 1826 H= 456:30 +CPU= 16.055
  09:30:21 STEP 1827 H= 456:45 +CPU= 18.973
  09:30:40 STEP 1828 H= 457:00 +CPU= 19.285
  09:30:59 STEP 1829 H= 457:15 +CPU= 18.584
  09:31:14 STEP 1830 H= 457:30 +CPU= 15.060
  09:31:28 STEP 1831 H= 457:45 +CPU= 13.750
  09:31:43 STEP 1832 H= 458:00 +CPU= 14.791
  09:31:57 STEP 1833 H= 458:15 +CPU= 14.911
  09:32:12 STEP 1834 H= 458:30 +CPU= 14.991
  09:32:27 STEP 1835 H= 458:45 +CPU= 15.030
  09:32:46 STEP 1836 H= 459:00 +CPU= 18.573
  09:33:01 STEP 1837 H= 459:15 +CPU= 15.027
  09:33:16 STEP 1838 H= 459:30 +CPU= 14.886
  09:33:31 STEP 1839 H= 459:45 +CPU= 14.798
  09:33:46 STEP 1840 H= 460:00 +CPU= 15.308
  09:34:01 STEP 1841 H= 460:15 +CPU= 14.881
  09:34:16 STEP 1842 H= 460:30 +CPU= 15.112
  09:34:31 STEP 1843 H= 460:45 +CPU= 15.245
  09:34:48 STEP 1844 H= 461:00 +CPU= 16.351
  09:35:03 STEP 1845 H= 461:15 +CPU= 15.497
  09:35:20 STEP 1846 H= 461:30 +CPU= 17.113
  09:35:38 STEP 1847 H= 461:45 +CPU= 17.809
  09:35:58 STEP 1848 H= 462:00 +CPU= 19.515
  09:36:13 STEP 1849 H= 462:15 +CPU= 15.412
  09:36:28 STEP 1850 H= 462:30 +CPU= 15.328
  09:36:44 STEP 1851 H= 462:45 +CPU= 15.504
  09:37:00 STEP 1852 H= 463:00 +CPU= 15.924
  09:37:15 STEP 1853 H= 463:15 +CPU= 15.605
  09:37:31 STEP 1854 H= 463:30 +CPU= 15.840
  09:37:47 STEP 1855 H= 463:45 +CPU= 15.837
  09:38:03 STEP 1856 H= 464:00 +CPU= 16.203
  09:38:19 STEP 1857 H= 464:15 +CPU= 15.791
  09:38:35 STEP 1858 H= 464:30 +CPU= 15.744
  09:38:51 STEP 1859 H= 464:45 +CPU= 15.836
  09:39:10 STEP 1860 H= 465:00 +CPU= 19.525
  09:39:26 STEP 1861 H= 465:15 +CPU= 15.486
  09:39:41 STEP 1862 H= 465:30 +CPU= 15.532
  09:39:57 STEP 1863 H= 465:45 +CPU= 15.486
  09:40:13 STEP 1864 H= 466:00 +CPU= 15.925
  09:40:28 STEP 1865 H= 466:15 +CPU= 15.663
  09:40:44 STEP 1866 H= 466:30 +CPU= 15.729
  09:41:00 STEP 1867 H= 466:45 +CPU= 15.720
  09:41:16 STEP 1868 H= 467:00 +CPU= 16.048
  09:41:32 STEP 1869 H= 467:15 +CPU= 15.831
  09:41:47 STEP 1870 H= 467:30 +CPU= 15.675
  09:42:03 STEP 1871 H= 467:45 +CPU= 15.301
  10:03:54 STEP 1872 H= 468:00 +CPU= 29.694
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001872
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001872
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001872
  10:04:12 STEP 1873 H= 468:15 +CPU= 17.284
  10:04:29 STEP 1874 H= 468:30 +CPU= 16.633
  10:04:44 STEP 1875 H= 468:45 +CPU= 15.656
  10:05:01 STEP 1876 H= 469:00 +CPU= 16.509
  10:05:22 STEP 1877 H= 469:15 +CPU= 21.269
  10:05:42 STEP 1878 H= 469:30 +CPU= 19.986
  10:05:59 STEP 1879 H= 469:45 +CPU= 16.799
  10:06:16 STEP 1880 H= 470:00 +CPU= 16.643
  10:06:34 STEP 1881 H= 470:15 +CPU= 17.582
  10:06:52 STEP 1882 H= 470:30 +CPU= 17.964
  10:07:09 STEP 1883 H= 470:45 +CPU= 17.304
  10:07:31 STEP 1884 H= 471:00 +CPU= 22.091
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001884
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001884
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001884
  10:07:50 STEP 1885 H= 471:15 +CPU= 18.244
  10:08:07 STEP 1886 H= 471:30 +CPU= 16.917
  10:08:24 STEP 1887 H= 471:45 +CPU= 17.199
  10:08:41 STEP 1888 H= 472:00 +CPU= 17.473
  10:08:59 STEP 1889 H= 472:15 +CPU= 17.312
  10:09:16 STEP 1890 H= 472:30 +CPU= 16.742
  10:09:33 STEP 1891 H= 472:45 +CPU= 17.106
  10:09:50 STEP 1892 H= 473:00 +CPU= 17.288
  10:10:08 STEP 1893 H= 473:15 +CPU= 17.991
  10:10:26 STEP 1894 H= 473:30 +CPU= 18.097
  10:10:45 STEP 1895 H= 473:45 +CPU= 18.879
  10:11:07 STEP 1896 H= 474:00 +CPU= 22.175
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001896
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001896
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001896
  10:11:25 STEP 1897 H= 474:15 +CPU= 17.281
  10:11:42 STEP 1898 H= 474:30 +CPU= 16.712
  10:11:59 STEP 1899 H= 474:45 +CPU= 17.334
  10:12:18 STEP 1900 H= 475:00 +CPU= 18.531
  10:12:35 STEP 1901 H= 475:15 +CPU= 17.311
  10:12:53 STEP 1902 H= 475:30 +CPU= 18.174
  10:13:10 STEP 1903 H= 475:45 +CPU= 16.933
  10:13:28 STEP 1904 H= 476:00 +CPU= 17.970
  10:13:46 STEP 1905 H= 476:15 +CPU= 17.268
  10:14:03 STEP 1906 H= 476:30 +CPU= 17.626
  10:14:21 STEP 1907 H= 476:45 +CPU= 17.219
  10:14:43 STEP 1908 H= 477:00 +CPU= 21.866
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001908
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001908
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001908
  10:15:01 STEP 1909 H= 477:15 +CPU= 18.553
  10:15:19 STEP 1910 H= 477:30 +CPU= 17.803
  10:15:37 STEP 1911 H= 477:45 +CPU= 17.633
  10:15:55 STEP 1912 H= 478:00 +CPU= 18.090
  10:16:12 STEP 1913 H= 478:15 +CPU= 17.212
  10:16:30 STEP 1914 H= 478:30 +CPU= 18.184
  10:16:48 STEP 1915 H= 478:45 +CPU= 17.291
  10:17:07 STEP 1916 H= 479:00 +CPU= 18.721
  10:17:25 STEP 1917 H= 479:15 +CPU= 18.212
  10:17:43 STEP 1918 H= 479:30 +CPU= 17.751
  10:18:01 STEP 1919 H= 479:45 +CPU= 18.168
  10:18:26 STEP 1920 H= 480:00 +CPU= 24.747
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  480.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.1653353185E-21      I       0.5766687732E-07      I
ICloud fractionI      0.0000000000E+00      I       0.2587534369E-01      I
I  Relat. Hum. I      0.3920873185E+00      I       0.4351444115E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.1431773042E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1920 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001920 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001920
 MPI-TASK:   1 -    296173236 BYTES IN      7 RECORDS TRANSFERRED IN    0.0006 SECONDS493622.1 Mbytes/s, TOTAL TIME=    0.0068( 8.8%)
 10:18:26 STEP 1920 H= 480:00 +CPU= 24.747
 END CNT3
 NSTEP =  1920 CNT0   000000000  17.284  17.284  17.388   0.994               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           46/  1069125708 WRITTEN         5720/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    103    0       46      1044068     5720 ************  1301.4    10.0  1291.5    14.6  1299.3
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 4697813.9 4697813.9    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 4677913.3 4677913.3     99.58      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                  209    3140.4    3140.4     13.97      0.00
   9 SPCM     - SPECTRAL COMP.                     192     402.4     402.4      1.64      0.00
  10 SCAN2M - PHYSICS                              193    7563.7    7563.7     31.07      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                 16     888.3     888.3      0.30      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                  9      20.2      20.2      0.00      0.00
  17 GRIDFPOS IN CNT4                               16      18.1      18.1      0.01      0.00
  27 RESTART FILES - WRITING                         4    3553.2    3553.2      0.30      0.00
  28 RESTART FILES - READING                         1   16658.5   16658.5      0.35      0.00
  29 SU4FPOS IN CNT4                                16       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                                16   83866.9   83866.9     28.56      0.00
  31 POSDDH IN STEPO                                 1       1.2       1.2      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                    193    4231.7    4231.7     17.39      0.00
  39 SU0YOMB                                         1    2768.5    2768.5      0.06      0.00
  51 SCAN2M   - SL COMM. PART 1                    193      15.7      15.7      0.06      0.00
  54 SPCM     - M TO S/S TO M TRANSP.              192      92.3      92.3      0.38      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.              192      43.8      43.8      0.18      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                  9       0.6       0.6      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM      420     276.5     276.5      2.47      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM       400     150.9     150.9      1.28      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM        400      63.5      63.5      0.54      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM       420      73.8      73.8      0.66      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1     111.6     111.6      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION            420      64.8      64.8      0.58      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION            400      30.0      30.0      0.26      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION            420      26.9      26.9      0.24      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION            400      14.8      14.8      0.13      0.00
 400 GSTATS                                      23311       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                 21635       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME     4697.8 CPU TIME    3402.7 VECTOR TIME     3402.7


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY      369.4
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001920
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001920
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001920
Adding to the zip: /var/lib/boinc-client/slots/3/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/3/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMUAh7zg+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMSHh7zg+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMSHh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMUAh7zg+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMUAh7zg+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMUAh7zg+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMGGh7zg+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMGGh7zg+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMUAh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMGGh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMSHh7zg+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMGGh7zg+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMUAh7zg+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMSHh7zg+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMGGh7zg+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMGGh7zg+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMSHh7zg+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290471/ICMSHh7zg+001908
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1nk_2016092300_20_1018_12290471_0_r1960818899_19.zip
Uploading the final file: upload_file_19.zip
Uploading trickle at timestep: 1727100
10:24:03 (4405): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
16 Jun 2024 01:05:52 1535694 22444064 oifs_43r3_bl_a1nk_2016092300_20_1018_12290471_0 1,727,100 37,271 0.0216
15 Jun 2024 03:48:40 1535694 22444064 oifs_43r3_bl_a1nk_2016092300_20_1018_12290471_0 1,296,000 27,703 0.0214


©2024 climateprediction.net