climateprediction.net home page
Task 22446110

Task 22446110

Name oifs_43r3_bl_a381_2016092300_20_1018_12292504_0
Workunit 12292504
Created 13 Jun 2024, 2:04:36 UTC
Sent 13 Jun 2024, 17:11:25 UTC
Report deadline 12 Aug 2024, 17:11:25 UTC
Received 17 Jun 2024, 17:08:20 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1469580
Run time 11 hours 14 min 31 sec
CPU time 11 hours 14 min 31 sec
Validate state Valid
Credit 2,635.55
Device peak FLOPS 5.26 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,007.54 MB
Peak swap size 5,981.07 MB
Peak disk usage 2,288.17 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<stderr_txt>
ding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+001440
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a381_2016092300_20_1018_12292504_0_r2114462758_14.zip
Uploading the intermediate file: upload_file_14.zip
  15:26:06 STEP 1442 H= 360:30 +CPU= 18.888
  15:26:25 STEP 1443 H= 360:45 +CPU= 18.671
  15:26:44 STEP 1444 H= 361:00 +CPU= 19.306
  15:27:03 STEP 1445 H= 361:15 +CPU= 18.910
  15:27:22 STEP 1446 H= 361:30 +CPU= 18.874
  15:27:41 STEP 1447 H= 361:45 +CPU= 19.084
  15:28:01 STEP 1448 H= 362:00 +CPU= 19.482
  15:28:20 STEP 1449 H= 362:15 +CPU= 19.633
  15:28:39 STEP 1450 H= 362:30 +CPU= 18.819
  15:28:58 STEP 1451 H= 362:45 +CPU= 18.832
  15:29:22 STEP 1452 H= 363:00 +CPU= 23.912
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001452
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001452
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001452
  15:29:41 STEP 1453 H= 363:15 +CPU= 19.109
  15:30:00 STEP 1454 H= 363:30 +CPU= 19.029
  15:30:20 STEP 1455 H= 363:45 +CPU= 19.609
  15:30:39 STEP 1456 H= 364:00 +CPU= 19.181
  15:30:58 STEP 1457 H= 364:15 +CPU= 18.980
  15:31:17 STEP 1458 H= 364:30 +CPU= 19.467
  15:31:36 STEP 1459 H= 364:45 +CPU= 18.686
  15:31:55 STEP 1460 H= 365:00 +CPU= 19.417
  15:32:14 STEP 1461 H= 365:15 +CPU= 18.926
  15:32:33 STEP 1462 H= 365:30 +CPU= 18.858
  15:32:52 STEP 1463 H= 365:45 +CPU= 18.883
  15:33:16 STEP 1464 H= 366:00 +CPU= 23.530
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001464
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001464
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001464
  15:33:34 STEP 1465 H= 366:15 +CPU= 18.131
  15:33:52 STEP 1466 H= 366:30 +CPU= 18.775
  15:34:11 STEP 1467 H= 366:45 +CPU= 18.832
  15:34:31 STEP 1468 H= 367:00 +CPU= 19.713
  15:34:50 STEP 1469 H= 367:15 +CPU= 18.663
  15:35:09 STEP 1470 H= 367:30 +CPU= 18.884
  15:35:26 STEP 1471 H= 367:45 +CPU= 17.734
  15:35:46 STEP 1472 H= 368:00 +CPU= 19.528
  15:36:05 STEP 1473 H= 368:15 +CPU= 18.975
  15:36:24 STEP 1474 H= 368:30 +CPU= 18.926
  15:36:43 STEP 1475 H= 368:45 +CPU= 18.966
  15:37:07 STEP 1476 H= 369:00 +CPU= 23.987
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001476
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001476
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001476
  15:37:25 STEP 1477 H= 369:15 +CPU= 18.449
  15:37:44 STEP 1478 H= 369:30 +CPU= 18.719
  15:38:03 STEP 1479 H= 369:45 +CPU= 18.781
  15:38:22 STEP 1480 H= 370:00 +CPU= 19.492
  15:38:41 STEP 1481 H= 370:15 +CPU= 18.723
  15:39:00 STEP 1482 H= 370:30 +CPU= 18.931
  15:39:19 STEP 1483 H= 370:45 +CPU= 19.121
  15:39:39 STEP 1484 H= 371:00 +CPU= 19.513
  15:39:58 STEP 1485 H= 371:15 +CPU= 18.999
  15:40:17 STEP 1486 H= 371:30 +CPU= 19.370
  15:40:36 STEP 1487 H= 371:45 +CPU= 19.360
  15:41:04 STEP 1488 H= 372:00 +CPU= 27.823
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001488
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001488
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001488
  15:41:24 STEP 1489 H= 372:15 +CPU= 19.011
  15:41:43 STEP 1490 H= 372:30 +CPU= 18.998
  15:42:03 STEP 1491 H= 372:45 +CPU= 19.172
  15:42:21 STEP 1492 H= 373:00 +CPU= 18.865
  15:42:40 STEP 1493 H= 373:15 +CPU= 18.543
  15:42:59 STEP 1494 H= 373:30 +CPU= 18.736
  15:43:18 STEP 1495 H= 373:45 +CPU= 19.364
  15:43:37 STEP 1496 H= 374:00 +CPU= 18.651
  15:43:56 STEP 1497 H= 374:15 +CPU= 19.032
  15:44:15 STEP 1498 H= 374:30 +CPU= 19.183
  15:44:34 STEP 1499 H= 374:45 +CPU= 18.822
  15:44:58 STEP 1500 H= 375:00 +CPU= 23.770
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001500
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001500
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001500
  15:45:17 STEP 1501 H= 375:15 +CPU= 19.512
  15:45:36 STEP 1502 H= 375:30 +CPU= 18.989
  15:45:55 STEP 1503 H= 375:45 +CPU= 18.981
  15:46:15 STEP 1504 H= 376:00 +CPU= 19.457
  15:46:33 STEP 1505 H= 376:15 +CPU= 18.810
  15:46:52 STEP 1506 H= 376:30 +CPU= 18.714
  15:47:11 STEP 1507 H= 376:45 +CPU= 19.056
  15:47:31 STEP 1508 H= 377:00 +CPU= 19.818
  15:47:50 STEP 1509 H= 377:15 +CPU= 18.658
  15:48:09 STEP 1510 H= 377:30 +CPU= 18.746
  15:48:28 STEP 1511 H= 377:45 +CPU= 19.424
  15:48:52 STEP 1512 H= 378:00 +CPU= 23.756
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001512
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001512
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001512
  15:49:10 STEP 1513 H= 378:15 +CPU= 18.526
  15:49:29 STEP 1514 H= 378:30 +CPU= 18.760
  15:49:48 STEP 1515 H= 378:45 +CPU= 18.883
  15:50:08 STEP 1516 H= 379:00 +CPU= 19.557
  15:50:27 STEP 1517 H= 379:15 +CPU= 19.123
  15:50:45 STEP 1518 H= 379:30 +CPU= 18.849
  15:51:04 STEP 1519 H= 379:45 +CPU= 18.911
  15:51:25 STEP 1520 H= 380:00 +CPU= 20.239
  15:51:43 STEP 1521 H= 380:15 +CPU= 18.593
  15:52:02 STEP 1522 H= 380:30 +CPU= 18.864
  15:52:21 STEP 1523 H= 380:45 +CPU= 19.010
  15:52:45 STEP 1524 H= 381:00 +CPU= 23.930
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001524
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001524
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001524
  15:53:04 STEP 1525 H= 381:15 +CPU= 18.827
  15:53:23 STEP 1526 H= 381:30 +CPU= 18.912
  15:53:42 STEP 1527 H= 381:45 +CPU= 18.847
  15:54:01 STEP 1528 H= 382:00 +CPU= 19.324
  15:54:19 STEP 1529 H= 382:15 +CPU= 17.767
  15:54:38 STEP 1530 H= 382:30 +CPU= 18.735
  15:54:56 STEP 1531 H= 382:45 +CPU= 18.864
  15:55:16 STEP 1532 H= 383:00 +CPU= 19.188
  15:55:34 STEP 1533 H= 383:15 +CPU= 18.583
  15:55:53 STEP 1534 H= 383:30 +CPU= 18.620
  15:56:12 STEP 1535 H= 383:45 +CPU= 18.969
  15:56:42 STEP 1536 H= 384:00 +CPU= 27.693
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001536
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001536
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001536
  15:57:01 STEP 1537 H= 384:15 +CPU= 19.225
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMGGh7zg+001452
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+001452
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+001452
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMGGh7zg+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMGGh7zg+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMGGh7zg+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMGGh7zg+001500
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+001500
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+001500
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMGGh7zg+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMGGh7zg+001524
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+001524
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+001524
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMGGh7zg+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+001536
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a381_2016092300_20_1018_12292504_0_r2114462758_15.zip
Uploading the intermediate file: upload_file_15.zip
  15:57:20 STEP 1538 H= 384:30 +CPU= 19.144
  15:57:39 STEP 1539 H= 384:45 +CPU= 18.937
  15:57:59 STEP 1540 H= 385:00 +CPU= 19.360
  15:58:18 STEP 1541 H= 385:15 +CPU= 19.149
  15:58:37 STEP 1542 H= 385:30 +CPU= 19.133
  15:58:56 STEP 1543 H= 385:45 +CPU= 18.939
  15:59:16 STEP 1544 H= 386:00 +CPU= 19.880
  15:59:35 STEP 1545 H= 386:15 +CPU= 19.065
  15:59:54 STEP 1546 H= 386:30 +CPU= 18.710
  16:00:13 STEP 1547 H= 386:45 +CPU= 18.908
  16:00:37 STEP 1548 H= 387:00 +CPU= 24.722
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001548
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001548
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001548
  16:00:57 STEP 1549 H= 387:15 +CPU= 19.200
  16:01:16 STEP 1550 H= 387:30 +CPU= 18.853
  16:01:34 STEP 1551 H= 387:45 +CPU= 18.899
  16:01:54 STEP 1552 H= 388:00 +CPU= 19.446
  16:02:13 STEP 1553 H= 388:15 +CPU= 18.999
  16:02:32 STEP 1554 H= 388:30 +CPU= 18.965
  16:02:51 STEP 1555 H= 388:45 +CPU= 19.087
  16:03:10 STEP 1556 H= 389:00 +CPU= 19.256
  16:03:28 STEP 1557 H= 389:15 +CPU= 18.134
  16:03:47 STEP 1558 H= 389:30 +CPU= 18.702
  16:04:06 STEP 1559 H= 389:45 +CPU= 18.929
  16:04:30 STEP 1560 H= 390:00 +CPU= 23.861
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001560
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001560
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001560
  16:04:49 STEP 1561 H= 390:15 +CPU= 18.917
  16:05:08 STEP 1562 H= 390:30 +CPU= 19.055
  16:05:27 STEP 1563 H= 390:45 +CPU= 18.928
  16:05:46 STEP 1564 H= 391:00 +CPU= 19.351
  16:06:05 STEP 1565 H= 391:15 +CPU= 18.775
  16:06:23 STEP 1566 H= 391:30 +CPU= 18.397
  16:06:42 STEP 1567 H= 391:45 +CPU= 18.903
  16:07:02 STEP 1568 H= 392:00 +CPU= 19.359
  16:07:20 STEP 1569 H= 392:15 +CPU= 18.673
  16:07:39 STEP 1570 H= 392:30 +CPU= 18.924
  16:07:58 STEP 1571 H= 392:45 +CPU= 18.776
  16:08:22 STEP 1572 H= 393:00 +CPU= 23.617
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001572
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001572
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001572
  16:08:40 STEP 1573 H= 393:15 +CPU= 18.818
  16:08:59 STEP 1574 H= 393:30 +CPU= 18.856
  16:09:18 STEP 1575 H= 393:45 +CPU= 18.798
  16:09:37 STEP 1576 H= 394:00 +CPU= 19.297
  16:09:56 STEP 1577 H= 394:15 +CPU= 18.753
  16:10:16 STEP 1578 H= 394:30 +CPU= 19.348
  16:10:35 STEP 1579 H= 394:45 +CPU= 19.274
  16:10:54 STEP 1580 H= 395:00 +CPU= 18.920
  16:11:12 STEP 1581 H= 395:15 +CPU= 17.855
  16:11:30 STEP 1582 H= 395:30 +CPU= 18.159
  16:11:49 STEP 1583 H= 395:45 +CPU= 19.193
  16:12:17 STEP 1584 H= 396:00 +CPU= 27.626
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001584
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001584
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001584
  16:12:36 STEP 1585 H= 396:15 +CPU= 18.858
  16:12:55 STEP 1586 H= 396:30 +CPU= 18.904
  16:13:14 STEP 1587 H= 396:45 +CPU= 18.970
  16:13:33 STEP 1588 H= 397:00 +CPU= 19.480
  16:13:52 STEP 1589 H= 397:15 +CPU= 18.786
  16:14:11 STEP 1590 H= 397:30 +CPU= 18.957
  16:14:30 STEP 1591 H= 397:45 +CPU= 18.884
  16:14:49 STEP 1592 H= 398:00 +CPU= 19.226
  16:15:08 STEP 1593 H= 398:15 +CPU= 18.936
  16:15:27 STEP 1594 H= 398:30 +CPU= 18.600
  16:15:46 STEP 1595 H= 398:45 +CPU= 19.062
  16:16:10 STEP 1596 H= 399:00 +CPU= 24.045
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001596
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001596
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001596
  16:16:29 STEP 1597 H= 399:15 +CPU= 19.067
  16:16:48 STEP 1598 H= 399:30 +CPU= 18.971
  16:17:07 STEP 1599 H= 399:45 +CPU= 19.179
  16:17:27 STEP 1600 H= 400:00 +CPU= 19.760
  16:17:46 STEP 1601 H= 400:15 +CPU= 18.889
  16:18:05 STEP 1602 H= 400:30 +CPU= 18.945
  16:18:25 STEP 1603 H= 400:45 +CPU= 19.650
  16:18:44 STEP 1604 H= 401:00 +CPU= 19.715
  16:19:03 STEP 1605 H= 401:15 +CPU= 18.812
  16:19:22 STEP 1606 H= 401:30 +CPU= 18.763
  16:19:41 STEP 1607 H= 401:45 +CPU= 18.860
  16:20:05 STEP 1608 H= 402:00 +CPU= 24.304
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001608
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001608
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001608
  16:20:25 STEP 1609 H= 402:15 +CPU= 19.456
  16:20:44 STEP 1610 H= 402:30 +CPU= 19.422
  16:21:03 STEP 1611 H= 402:45 +CPU= 19.155
  16:21:23 STEP 1612 H= 403:00 +CPU= 19.901
  16:21:42 STEP 1613 H= 403:15 +CPU= 18.999
  16:22:01 STEP 1614 H= 403:30 +CPU= 19.070
  16:22:20 STEP 1615 H= 403:45 +CPU= 19.171
  16:22:40 STEP 1616 H= 404:00 +CPU= 19.616
  16:22:59 STEP 1617 H= 404:15 +CPU= 18.838
  16:23:18 STEP 1618 H= 404:30 +CPU= 18.895
  16:23:37 STEP 1619 H= 404:45 +CPU= 19.138
  16:24:01 STEP 1620 H= 405:00 +CPU= 24.210
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001620
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001620
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001620
  16:24:21 STEP 1621 H= 405:15 +CPU= 19.414
  16:24:40 STEP 1622 H= 405:30 +CPU= 19.114
  16:24:59 STEP 1623 H= 405:45 +CPU= 19.073
  16:25:19 STEP 1624 H= 406:00 +CPU= 19.787
  16:25:38 STEP 1625 H= 406:15 +CPU= 19.088
  16:25:57 STEP 1626 H= 406:30 +CPU= 18.928
  16:26:16 STEP 1627 H= 406:45 +CPU= 18.896
  16:26:35 STEP 1628 H= 407:00 +CPU= 19.323
  16:26:54 STEP 1629 H= 407:15 +CPU= 18.656
  16:27:13 STEP 1630 H= 407:30 +CPU= 19.329
  16:27:32 STEP 1631 H= 407:45 +CPU= 19.267
  16:28:00 STEP 1632 H= 408:00 +CPU= 27.598
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001632
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001632
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001632
  16:28:19 STEP 1633 H= 408:15 +CPU= 19.331
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMGGh7zg+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMGGh7zg+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMGGh7zg+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMGGh7zg+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMGGh7zg+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMGGh7zg+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMGGh7zg+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMGGh7zg+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+001632
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a381_2016092300_20_1018_12292504_0_r2114462758_16.zip
Uploading the intermediate file: upload_file_16.zip
  16:28:38 STEP 1634 H= 408:30 +CPU= 18.818
  16:28:57 STEP 1635 H= 408:45 +CPU= 18.983
  16:29:16 STEP 1636 H= 409:00 +CPU= 19.037
  16:29:35 STEP 1637 H= 409:15 +CPU= 18.737
  16:29:54 STEP 1638 H= 409:30 +CPU= 18.700
  16:30:13 STEP 1639 H= 409:45 +CPU= 18.965
  16:30:32 STEP 1640 H= 410:00 +CPU= 19.530
  16:30:51 STEP 1641 H= 410:15 +CPU= 19.219
  16:31:11 STEP 1642 H= 410:30 +CPU= 19.084
  16:31:30 STEP 1643 H= 410:45 +CPU= 19.304
  16:31:54 STEP 1644 H= 411:00 +CPU= 23.955
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001644
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001644
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001644
  16:32:13 STEP 1645 H= 411:15 +CPU= 18.817
  16:32:31 STEP 1646 H= 411:30 +CPU= 18.510
  16:32:50 STEP 1647 H= 411:45 +CPU= 18.732
  16:33:09 STEP 1648 H= 412:00 +CPU= 19.210
  16:33:28 STEP 1649 H= 412:15 +CPU= 18.772
  16:33:47 STEP 1650 H= 412:30 +CPU= 18.773
  16:34:06 STEP 1651 H= 412:45 +CPU= 18.843
  16:34:25 STEP 1652 H= 413:00 +CPU= 19.351
  16:34:44 STEP 1653 H= 413:15 +CPU= 18.746
  16:35:02 STEP 1654 H= 413:30 +CPU= 18.710
  16:35:22 STEP 1655 H= 413:45 +CPU= 19.233
  16:35:45 STEP 1656 H= 414:00 +CPU= 23.707
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001656
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001656
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001656
  16:36:04 STEP 1657 H= 414:15 +CPU= 18.692
  16:36:23 STEP 1658 H= 414:30 +CPU= 18.827
  16:36:42 STEP 1659 H= 414:45 +CPU= 18.996
  16:37:01 STEP 1660 H= 415:00 +CPU= 19.316
  16:37:20 STEP 1661 H= 415:15 +CPU= 18.737
  16:37:39 STEP 1662 H= 415:30 +CPU= 18.723
  16:37:58 STEP 1663 H= 415:45 +CPU= 18.785
  16:38:17 STEP 1664 H= 416:00 +CPU= 19.425
  16:38:36 STEP 1665 H= 416:15 +CPU= 18.697
  16:38:54 STEP 1666 H= 416:30 +CPU= 18.684
  16:39:13 STEP 1667 H= 416:45 +CPU= 18.919
  16:39:37 STEP 1668 H= 417:00 +CPU= 23.700
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001668
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001668
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001668
  16:39:56 STEP 1669 H= 417:15 +CPU= 19.033
  16:40:15 STEP 1670 H= 417:30 +CPU= 18.839
  16:40:35 STEP 1671 H= 417:45 +CPU= 19.677
  16:40:55 STEP 1672 H= 418:00 +CPU= 19.980
  16:41:14 STEP 1673 H= 418:15 +CPU= 19.006
  16:41:32 STEP 1674 H= 418:30 +CPU= 18.800
  16:41:52 STEP 1675 H= 418:45 +CPU= 19.088
  16:42:11 STEP 1676 H= 419:00 +CPU= 19.333
  16:42:30 STEP 1677 H= 419:15 +CPU= 18.846
  16:42:49 STEP 1678 H= 419:30 +CPU= 19.042
  16:43:08 STEP 1679 H= 419:45 +CPU= 19.011
  16:43:46 STEP 1680 H= 420:00 +CPU= 27.717
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001680
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001680
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001680
  16:44:05 STEP 1681 H= 420:15 +CPU= 18.974
  16:44:24 STEP 1682 H= 420:30 +CPU= 18.855
  16:44:43 STEP 1683 H= 420:45 +CPU= 18.979
  16:45:03 STEP 1684 H= 421:00 +CPU= 19.546
  16:45:22 STEP 1685 H= 421:15 +CPU= 19.238
  16:45:41 STEP 1686 H= 421:30 +CPU= 18.982
  16:46:00 STEP 1687 H= 421:45 +CPU= 18.815
  16:46:20 STEP 1688 H= 422:00 +CPU= 19.868
  16:46:39 STEP 1689 H= 422:15 +CPU= 18.883
  16:46:57 STEP 1690 H= 422:30 +CPU= 18.781
  16:47:16 STEP 1691 H= 422:45 +CPU= 18.013
  16:47:39 STEP 1692 H= 423:00 +CPU= 23.746
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001692
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001692
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001692
  16:47:58 STEP 1693 H= 423:15 +CPU= 18.933
  16:48:17 STEP 1694 H= 423:30 +CPU= 19.067
  16:48:36 STEP 1695 H= 423:45 +CPU= 18.921
  16:48:56 STEP 1696 H= 424:00 +CPU= 19.399
  16:49:15 STEP 1697 H= 424:15 +CPU= 19.640
  16:49:35 STEP 1698 H= 424:30 +CPU= 19.149
  16:49:54 STEP 1699 H= 424:45 +CPU= 18.986
  16:50:14 STEP 1700 H= 425:00 +CPU= 20.100
  16:50:32 STEP 1701 H= 425:15 +CPU= 18.747
  16:50:51 STEP 1702 H= 425:30 +CPU= 19.039
  16:51:10 STEP 1703 H= 425:45 +CPU= 18.245
  16:51:34 STEP 1704 H= 426:00 +CPU= 24.013
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001704
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001704
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001704
  16:51:53 STEP 1705 H= 426:15 +CPU= 19.011
  16:52:12 STEP 1706 H= 426:30 +CPU= 19.201
  16:52:31 STEP 1707 H= 426:45 +CPU= 18.577
  16:52:50 STEP 1708 H= 427:00 +CPU= 19.647
  16:53:09 STEP 1709 H= 427:15 +CPU= 18.972
  16:53:29 STEP 1710 H= 427:30 +CPU= 19.352
  16:53:47 STEP 1711 H= 427:45 +CPU= 18.812
  16:54:07 STEP 1712 H= 428:00 +CPU= 19.425
  16:54:26 STEP 1713 H= 428:15 +CPU= 19.347
  16:54:45 STEP 1714 H= 428:30 +CPU= 19.065
  16:55:04 STEP 1715 H= 428:45 +CPU= 18.939
  16:55:28 STEP 1716 H= 429:00 +CPU= 23.994
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001716
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001716
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001716
  16:55:47 STEP 1717 H= 429:15 +CPU= 18.861
  16:56:06 STEP 1718 H= 429:30 +CPU= 19.082
  16:56:25 STEP 1719 H= 429:45 +CPU= 18.626
  16:56:44 STEP 1720 H= 430:00 +CPU= 19.558
  16:57:03 STEP 1721 H= 430:15 +CPU= 18.935
  16:57:22 STEP 1722 H= 430:30 +CPU= 18.961
  16:57:41 STEP 1723 H= 430:45 +CPU= 18.892
  16:58:01 STEP 1724 H= 431:00 +CPU= 19.537
  16:58:19 STEP 1725 H= 431:15 +CPU= 18.684
  16:58:38 STEP 1726 H= 431:30 +CPU= 18.571
  16:58:57 STEP 1727 H= 431:45 +CPU= 18.974
  16:59:28 STEP 1728 H= 432:00 +CPU= 27.615
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001728
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001728
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001728
  16:59:46 STEP 1729 H= 432:15 +CPU= 18.877
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMGGh7zg+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMGGh7zg+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMGGh7zg+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMGGh7zg+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMGGh7zg+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMGGh7zg+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMGGh7zg+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMGGh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+001728
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a381_2016092300_20_1018_12292504_0_r2114462758_17.zip
Uploading the intermediate file: upload_file_17.zip
  17:00:06 STEP 1730 H= 432:30 +CPU= 19.027
  17:00:24 STEP 1731 H= 432:45 +CPU= 18.692
  17:00:44 STEP 1732 H= 433:00 +CPU= 19.638
  17:01:03 STEP 1733 H= 433:15 +CPU= 19.162
  17:01:22 STEP 1734 H= 433:30 +CPU= 18.893
  17:01:41 STEP 1735 H= 433:45 +CPU= 18.623
  17:02:00 STEP 1736 H= 434:00 +CPU= 19.366
  17:02:19 STEP 1737 H= 434:15 +CPU= 18.808
  17:02:38 STEP 1738 H= 434:30 +CPU= 18.847
  17:02:56 STEP 1739 H= 434:45 +CPU= 18.810
  17:03:20 STEP 1740 H= 435:00 +CPU= 23.593
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001740
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001740
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001740
  17:03:39 STEP 1741 H= 435:15 +CPU= 19.056
  17:04:07 STEP 1742 H= 435:30 +CPU= 23.353
  17:04:32 STEP 1743 H= 435:45 +CPU= 22.544
  17:04:53 STEP 1744 H= 436:00 +CPU= 21.374
  17:05:14 STEP 1745 H= 436:15 +CPU= 20.764
  17:05:35 STEP 1746 H= 436:30 +CPU= 20.851
  17:05:56 STEP 1747 H= 436:45 +CPU= 20.977
  17:06:19 STEP 1748 H= 437:00 +CPU= 22.986
  17:06:43 STEP 1749 H= 437:15 +CPU= 23.640
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a381
(argv4) batchid: 1018
(argv5) wuid: 12292504
(argv6) fclen: 20
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/1
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.13
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/1/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/1/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_f22987aeb4cd9eac12a3deb833baa3ce to: /var/lib/boinc-client/slots/1/oifs_43r3_bl_a381_2016092300_20_1018_12292504.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/1/oifs_43r3_bl_a381_2016092300_20_1018_12292504.zip
ic_ancil_file: ic_ancil_12292504
ifsdata_file: ifsdata_12292504
climate_data_file: clim_data_12292504
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc-client/slots/1/ic_ancil_12292504.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/1/ic_ancil_12292504.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_062b6e2407f6c3a1287b9ae7fb1a9924 to: /var/lib/boinc-client/slots/1/ifsdata/ifsdata_12292504.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/1/ifsdata/ifsdata_12292504.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/1/159l_2/clim_data_12292504.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/1/159l_2/clim_data_12292504.zip
Checking for progress XML file: /var/lib/boinc-client/slots/1/progress_file_12292504.xml
Opened progress file ok : /var/lib/boinc-client/slots/1/progress_file_12292504.xml
-- Model is restarting --
Adjusting last_iter, 1749, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/1/progress_file_12292504.xml
last_cpu_time: 35983
upload_file_number: 18
last_iter: 1729
last_upload: 1556100
model_completed: 0
total_length_of_simulation: 1728000
result_base_name: oifs_43r3_bl_a381_2016092300_20_1018_12292504_0_r2114462758
The child process has been launched with process id: 10883
Executing the command: /var/lib/boinc-client/slots/1/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:server242:1:1:10883:10883] [20240617:170750:1718636870:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440
[EC_DRHOOK:server242:1:1:10883:10883] [20240617:170750:1718636870:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:server242:1:1:10883:10883] [20240617:170750:1718636870:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:server242:1:1:10883:10883] [20240617:170750:1718636870:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:server242:1:1:10883:10883] [20240617:170750:1718636870:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:server242:1:1:10883:10883] [20240617:170750:1718636870:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:server242:1:1:10883:10883] [20240617:170750:1718636870:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:server242:1:1:10883:10883] [20240617:170750:1718636870:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:server242:1:1:10883:10883] [20240617:170750:1718636870:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:server242:1:1:10883:10883] [20240617:170750:1718636870:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:server242:1:1:10883:10883] [20240617:170750:1718636870:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:server242:1:1:10883:10883] [20240617:170750:1718636870:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:server242:1:1:10883:10883] [20240617:170750:1718636870:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:server242:1:1:10883:10883] [20240617:170750:1718636870:0.001] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:server242:1:1:10883:10883] [20240617:170750:1718636870:0.001] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:server242:1:1:10883:10883] [20240617:170750:1718636870:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:server242:1:1:10883:10883] [20240617:170750:1718636870:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:server242:1:1:10883:10883] [20240617:170750:1718636870:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:server242:1:1:10883:10883] [20240617:170750:1718636870:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:server242:1:1:10883:10883] [20240617:170750:1718636870:0.001] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:server242:1:1:10883:10883] [20240617:170750:1718636870:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:server242:1:1:10883:10883] [20240617:170750:1718636870:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:server242:1:1:10883:10883] [20240617:170750:1718636870:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:server242:1:1:10883:10883] [20240617:170750:1718636870:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:server242:1:1:10883:10883] [20240617:170750:1718636870:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:server242:1:1:10883:10883] [20240617:170750:1718636870:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:server242:1:1:10883:10883] [20240617:170750:1718636870:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:server242:1:1:10883:10883] [20240617:170750:1718636870:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:server242:1:1:10883:10883] [20240617:170750:1718636870:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:server242:1:1:10883:10883] [20240617:170750:1718636870:0.001] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  17:08:30 STEP 1728 H= 432:00 +CPU= 23.757
  17:08:53 STEP 1729 H= 432:15 +CPU= 22.573
  17:09:14 STEP 1730 H= 432:30 +CPU= 21.421
  17:09:37 STEP 1731 H= 432:45 +CPU= 22.114
  17:09:59 STEP 1732 H= 433:00 +CPU= 22.499
  17:10:21 STEP 1733 H= 433:15 +CPU= 22.343
  17:10:44 STEP 1734 H= 433:30 +CPU= 22.639
  17:11:07 STEP 1735 H= 433:45 +CPU= 22.520
  17:11:31 STEP 1736 H= 434:00 +CPU= 23.673
  17:11:52 STEP 1737 H= 434:15 +CPU= 21.546
  17:12:14 STEP 1738 H= 434:30 +CPU= 22.242
  17:12:37 STEP 1739 H= 434:45 +CPU= 22.160
  17:13:08 STEP 1740 H= 435:00 +CPU= 29.490
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001740
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001740
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001740
  17:13:29 STEP 1741 H= 435:15 +CPU= 21.651
  17:13:52 STEP 1742 H= 435:30 +CPU= 22.628
  17:14:14 STEP 1743 H= 435:45 +CPU= 22.189
  17:14:36 STEP 1744 H= 436:00 +CPU= 21.891
  17:15:00 STEP 1745 H= 436:15 +CPU= 21.781
  17:15:23 STEP 1746 H= 436:30 +CPU= 22.529
  17:15:45 STEP 1747 H= 436:45 +CPU= 22.018
  17:16:08 STEP 1748 H= 437:00 +CPU= 22.942
  17:16:31 STEP 1749 H= 437:15 +CPU= 22.819
  17:16:53 STEP 1750 H= 437:30 +CPU= 22.297
  17:17:16 STEP 1751 H= 437:45 +CPU= 22.211
  17:17:44 STEP 1752 H= 438:00 +CPU= 28.531
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001752
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001752
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001752
  17:18:07 STEP 1753 H= 438:15 +CPU= 22.424
  17:18:29 STEP 1754 H= 438:30 +CPU= 22.752
  17:18:51 STEP 1755 H= 438:45 +CPU= 21.678
  17:19:15 STEP 1756 H= 439:00 +CPU= 23.307
  17:19:37 STEP 1757 H= 439:15 +CPU= 22.612
  17:19:59 STEP 1758 H= 439:30 +CPU= 22.190
  17:20:22 STEP 1759 H= 439:45 +CPU= 22.672
  17:20:45 STEP 1760 H= 440:00 +CPU= 23.253
  17:21:08 STEP 1761 H= 440:15 +CPU= 22.451
  17:21:30 STEP 1762 H= 440:30 +CPU= 21.783
  17:21:51 STEP 1763 H= 440:45 +CPU= 21.632
  17:22:22 STEP 1764 H= 441:00 +CPU= 30.140
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001764
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001764
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001764
  17:22:43 STEP 1765 H= 441:15 +CPU= 21.585
  17:23:05 STEP 1766 H= 441:30 +CPU= 21.318
  17:23:28 STEP 1767 H= 441:45 +CPU= 23.331
  17:23:51 STEP 1768 H= 442:00 +CPU= 23.347
  17:24:13 STEP 1769 H= 442:15 +CPU= 21.515
  17:24:35 STEP 1770 H= 442:30 +CPU= 21.660
  17:24:57 STEP 1771 H= 442:45 +CPU= 22.330
  17:25:20 STEP 1772 H= 443:00 +CPU= 22.523
  17:25:43 STEP 1773 H= 443:15 +CPU= 23.188
  17:26:05 STEP 1774 H= 443:30 +CPU= 22.034
  17:26:28 STEP 1775 H= 443:45 +CPU= 23.119
  17:27:04 STEP 1776 H= 444:00 +CPU= 31.887
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001776
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001776
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001776
  17:27:26 STEP 1777 H= 444:15 +CPU= 22.707
  17:27:49 STEP 1778 H= 444:30 +CPU= 22.051
  17:28:12 STEP 1779 H= 444:45 +CPU= 23.057
  17:28:35 STEP 1780 H= 445:00 +CPU= 23.479
  17:28:57 STEP 1781 H= 445:15 +CPU= 21.771
  17:29:19 STEP 1782 H= 445:30 +CPU= 21.614
  17:29:42 STEP 1783 H= 445:45 +CPU= 22.979
  17:30:06 STEP 1784 H= 446:00 +CPU= 23.949
  17:30:28 STEP 1785 H= 446:15 +CPU= 22.275
  17:30:50 STEP 1786 H= 446:30 +CPU= 22.202
  17:31:13 STEP 1787 H= 446:45 +CPU= 22.640
  17:31:42 STEP 1788 H= 447:00 +CPU= 28.752
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001788
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001788
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001788
  17:32:04 STEP 1789 H= 447:15 +CPU= 21.882
  17:32:27 STEP 1790 H= 447:30 +CPU= 23.199
  17:32:49 STEP 1791 H= 447:45 +CPU= 22.271
  17:33:12 STEP 1792 H= 448:00 +CPU= 22.813
  17:33:34 STEP 1793 H= 448:15 +CPU= 21.786
  17:33:57 STEP 1794 H= 448:30 +CPU= 23.120
  17:34:20 STEP 1795 H= 448:45 +CPU= 23.197
  17:34:43 STEP 1796 H= 449:00 +CPU= 22.892
  17:35:05 STEP 1797 H= 449:15 +CPU= 21.618
  17:35:28 STEP 1798 H= 449:30 +CPU= 22.829
  17:35:51 STEP 1799 H= 449:45 +CPU= 22.887
  17:36:18 STEP 1800 H= 450:00 +CPU= 27.396
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001800
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001800
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001800
  17:36:41 STEP 1801 H= 450:15 +CPU= 22.815
  17:37:04 STEP 1802 H= 450:30 +CPU= 23.264
  17:37:27 STEP 1803 H= 450:45 +CPU= 22.547
  17:37:49 STEP 1804 H= 451:00 +CPU= 22.384
  17:38:12 STEP 1805 H= 451:15 +CPU= 23.321
  17:38:36 STEP 1806 H= 451:30 +CPU= 23.135
  17:38:57 STEP 1807 H= 451:45 +CPU= 21.670
  17:39:19 STEP 1808 H= 452:00 +CPU= 22.060
  17:39:43 STEP 1809 H= 452:15 +CPU= 23.353
  17:40:05 STEP 1810 H= 452:30 +CPU= 22.556
  17:40:27 STEP 1811 H= 452:45 +CPU= 21.646
  17:40:54 STEP 1812 H= 453:00 +CPU= 26.910
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001812
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001812
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001812
  17:41:19 STEP 1813 H= 453:15 +CPU= 24.610
  17:41:42 STEP 1814 H= 453:30 +CPU= 23.049
  17:42:04 STEP 1815 H= 453:45 +CPU= 21.664
  17:42:27 STEP 1816 H= 454:00 +CPU= 22.990
  17:42:49 STEP 1817 H= 454:15 +CPU= 22.545
  17:43:12 STEP 1818 H= 454:30 +CPU= 22.110
  17:43:33 STEP 1819 H= 454:45 +CPU= 21.619
  17:43:57 STEP 1820 H= 455:00 +CPU= 24.048
  17:44:21 STEP 1821 H= 455:15 +CPU= 23.115
  17:44:42 STEP 1822 H= 455:30 +CPU= 21.691
  17:45:04 STEP 1823 H= 455:45 +CPU= 21.720
  17:45:40 STEP 1824 H= 456:00 +CPU= 33.458
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001824
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001824
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001824
  17:46:02 STEP 1825 H= 456:15 +CPU= 22.203
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMGGh7zg+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMGGh7zg+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMGGh7zg+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMGGh7zg+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMGGh7zg+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMGGh7zg+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMGGh7zg+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMGGh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+001824
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a381_2016092300_20_1018_12292504_0_r2114462758_18.zip
Uploading the intermediate file: upload_file_18.zip
  17:46:24 STEP 1826 H= 456:30 +CPU= 22.101
  17:46:47 STEP 1827 H= 456:45 +CPU= 22.881
  17:47:11 STEP 1828 H= 457:00 +CPU= 23.421
  17:47:33 STEP 1829 H= 457:15 +CPU= 21.870
  17:47:54 STEP 1830 H= 457:30 +CPU= 21.595
  17:48:18 STEP 1831 H= 457:45 +CPU= 23.897
  17:48:42 STEP 1832 H= 458:00 +CPU= 24.117
  17:49:04 STEP 1833 H= 458:15 +CPU= 21.743
  17:49:26 STEP 1834 H= 458:30 +CPU= 21.773
  17:49:48 STEP 1835 H= 458:45 +CPU= 22.354
  17:50:18 STEP 1836 H= 459:00 +CPU= 29.237
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001836
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001836
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001836
  17:50:40 STEP 1837 H= 459:15 +CPU= 22.488
  17:51:04 STEP 1838 H= 459:30 +CPU= 23.611
  17:51:26 STEP 1839 H= 459:45 +CPU= 22.355
  17:51:48 STEP 1840 H= 460:00 +CPU= 22.113
  17:52:10 STEP 1841 H= 460:15 +CPU= 21.863
  17:52:36 STEP 1842 H= 460:30 +CPU= 25.338
  17:52:57 STEP 1843 H= 460:45 +CPU= 21.571
  17:53:19 STEP 1844 H= 461:00 +CPU= 21.953
  17:53:42 STEP 1845 H= 461:15 +CPU= 22.937
  17:54:06 STEP 1846 H= 461:30 +CPU= 23.731
  17:54:28 STEP 1847 H= 461:45 +CPU= 21.987
  17:54:56 STEP 1848 H= 462:00 +CPU= 27.752
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001848
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001848
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001848
  17:55:19 STEP 1849 H= 462:15 +CPU= 23.536
  17:55:41 STEP 1850 H= 462:30 +CPU= 21.697
  17:56:03 STEP 1851 H= 462:45 +CPU= 21.727
  17:56:27 STEP 1852 H= 463:00 +CPU= 23.868
  17:56:50 STEP 1853 H= 463:15 +CPU= 22.969
  17:57:11 STEP 1854 H= 463:30 +CPU= 21.607
  17:57:33 STEP 1855 H= 463:45 +CPU= 21.840
  17:57:58 STEP 1856 H= 464:00 +CPU= 24.532
  17:58:20 STEP 1857 H= 464:15 +CPU= 21.934
  17:58:41 STEP 1858 H= 464:30 +CPU= 21.617
  17:59:04 STEP 1859 H= 464:45 +CPU= 22.002
  17:59:38 STEP 1860 H= 465:00 +CPU= 30.995
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001860
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001860
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001860
  17:59:59 STEP 1861 H= 465:15 +CPU= 21.302
  18:00:23 STEP 1862 H= 465:30 +CPU= 24.018
  18:00:48 STEP 1863 H= 465:45 +CPU= 24.980
  18:01:14 STEP 1864 H= 466:00 +CPU= 25.409
  18:01:36 STEP 1865 H= 466:15 +CPU= 21.754
  18:01:58 STEP 1866 H= 466:30 +CPU= 21.662
  18:02:21 STEP 1867 H= 466:45 +CPU= 23.093
  18:02:47 STEP 1868 H= 467:00 +CPU= 25.701
  18:03:09 STEP 1869 H= 467:15 +CPU= 21.699
  18:03:30 STEP 1870 H= 467:30 +CPU= 21.780
  18:03:54 STEP 1871 H= 467:45 +CPU= 23.401
  18:04:43 STEP 1872 H= 468:00 +CPU= 32.548
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001872
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001872
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001872
  18:05:05 STEP 1873 H= 468:15 +CPU= 21.864
  18:05:28 STEP 1874 H= 468:30 +CPU= 22.765
  18:05:52 STEP 1875 H= 468:45 +CPU= 24.249
  18:06:15 STEP 1876 H= 469:00 +CPU= 22.869
  18:06:37 STEP 1877 H= 469:15 +CPU= 21.655
  18:06:59 STEP 1878 H= 469:30 +CPU= 22.495
  18:07:23 STEP 1879 H= 469:45 +CPU= 23.773
  18:07:46 STEP 1880 H= 470:00 +CPU= 22.675
  18:08:07 STEP 1881 H= 470:15 +CPU= 21.325
  18:08:30 STEP 1882 H= 470:30 +CPU= 22.626
  18:08:54 STEP 1883 H= 470:45 +CPU= 23.956
  18:09:22 STEP 1884 H= 471:00 +CPU= 28.135
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001884
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001884
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001884
  18:09:44 STEP 1885 H= 471:15 +CPU= 21.714
  18:10:07 STEP 1886 H= 471:30 +CPU= 23.628
  18:10:32 STEP 1887 H= 471:45 +CPU= 24.455
  18:10:54 STEP 1888 H= 472:00 +CPU= 22.437
  18:11:16 STEP 1889 H= 472:15 +CPU= 21.773
  18:11:40 STEP 1890 H= 472:30 +CPU= 23.381
  18:12:04 STEP 1891 H= 472:45 +CPU= 24.169
  18:12:26 STEP 1892 H= 473:00 +CPU= 21.916
  18:12:47 STEP 1893 H= 473:15 +CPU= 21.581
  18:13:11 STEP 1894 H= 473:30 +CPU= 23.141
  18:13:35 STEP 1895 H= 473:45 +CPU= 24.208
  18:14:03 STEP 1896 H= 474:00 +CPU= 28.205
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001896
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001896
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001896
  18:14:25 STEP 1897 H= 474:15 +CPU= 21.585
  18:14:47 STEP 1898 H= 474:30 +CPU= 22.543
  18:15:11 STEP 1899 H= 474:45 +CPU= 23.462
  18:15:34 STEP 1900 H= 475:00 +CPU= 22.725
  18:15:56 STEP 1901 H= 475:15 +CPU= 21.788
  18:16:19 STEP 1902 H= 475:30 +CPU= 23.256
  18:16:42 STEP 1903 H= 475:45 +CPU= 22.793
  18:17:05 STEP 1904 H= 476:00 +CPU= 23.074
  18:17:26 STEP 1905 H= 476:15 +CPU= 21.557
  18:17:49 STEP 1906 H= 476:30 +CPU= 22.884
  18:18:14 STEP 1907 H= 476:45 +CPU= 25.011
  18:18:48 STEP 1908 H= 477:00 +CPU= 31.288
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001908
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001908
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001908
  18:19:10 STEP 1909 H= 477:15 +CPU= 21.804
  18:19:32 STEP 1910 H= 477:30 +CPU= 21.816
  18:19:56 STEP 1911 H= 477:45 +CPU= 24.165
  18:20:20 STEP 1912 H= 478:00 +CPU= 23.864
  18:20:42 STEP 1913 H= 478:15 +CPU= 21.423
  18:21:05 STEP 1914 H= 478:30 +CPU= 22.699
  18:21:28 STEP 1915 H= 478:45 +CPU= 22.957
  18:21:51 STEP 1916 H= 479:00 +CPU= 23.078
  18:22:14 STEP 1917 H= 479:15 +CPU= 22.883
  18:22:35 STEP 1918 H= 479:30 +CPU= 21.624
  18:22:59 STEP 1919 H= 479:45 +CPU= 23.648
  18:23:33 STEP 1920 H= 480:00 +CPU= 31.783
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  480.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I      0.1181123132E-20      I       0.4060772263E-05      I
ICloud fractionI      0.0000000000E+00      I       0.2831773804E-01      I
I  Relat. Hum. I      0.4212181117E+00      I       0.4640187501E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.5303753366E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1920 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001920 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001920
 MPI-TASK:   1 -    311374404 BYTES IN      7 RECORDS TRANSFERRED IN    0.0016 SECONDS194609.0 Mbytes/s, TOTAL TIME=    0.0191( 8.4%)
 18:23:33 STEP 1920 H= 480:00 +CPU= 31.783
 END CNT3
 NSTEP =  1920 CNT0   000000000  22.763  22.763  23.731   0.959               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           46/  1069125708 WRITTEN         5720/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    103    0       46      1044068     5720 ************    26.4    13.7    12.7    14.6    39.1
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 4543244.2 4543244.2    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 4526675.7 4526675.7     99.64      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                  209    4123.4    4123.4     18.97      0.00
   9 SPCM     - SPECTRAL COMP.                     192     665.3     665.3      2.81      0.00
  10 SCAN2M - PHYSICS                              193   10430.1   10430.1     44.31      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                 16    1450.1    1450.1      0.51      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                  9      89.5      89.5      0.02      0.00
  17 GRIDFPOS IN CNT4                               16      28.3      28.3      0.01      0.00
  27 RESTART FILES - WRITING                         4    5680.2    5680.2      0.50      0.00
  28 RESTART FILES - READING                         1   15448.2   15448.2      0.34      0.00
  29 SU4FPOS IN CNT4                                16       7.1       7.1      0.00      0.00
  30 DYNFPOS IN CNT4                                16    5705.5    5705.5      2.01      0.00
  31 POSDDH IN STEPO                                 1     214.8     214.8      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                    193    5080.6    5080.6     21.58      0.00
  39 SU0YOMB                                         1     365.0     365.0      0.01      0.00
  51 SCAN2M   - SL COMM. PART 1                    193      20.6      20.6      0.09      0.00
  54 SPCM     - M TO S/S TO M TRANSP.              192     311.0     311.0      1.31      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.              192      49.4      49.4      0.21      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                  9      22.0      22.0      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM      420     316.1     316.1      2.92      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM       400     174.7     174.7      1.54      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM        400      65.2      65.2      0.57      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM       420      86.0      86.0      0.80      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      36.4      36.4      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION            420      62.8      62.8      0.58      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION            400      31.7      31.7      0.28      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION            420      58.6      58.6      0.54      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION            400      32.8      32.8      0.29      0.00
 400 GSTATS                                      23311       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                 21635       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME     4543.2 CPU TIME    4487.8 VECTOR TIME     4487.8


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY      381.7
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001920
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001920
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001920
Adding to the zip: /var/lib/boinc-client/slots/1/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/1/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMGGh7zg+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMGGh7zg+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMGGh7zg+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMGGh7zg+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMGGh7zg+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMGGh7zg+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMGGh7zg+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMGGh7zg+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMSHh7zg+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMUAh7zg+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12292504/ICMGGh7zg+000384
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a381_2016092300_20_1018_12292504_0_r2114462758_19.zip
Uploading the final file: upload_file_19.zip
Uploading trickle at timestep: 1727100
18:27:32 (10880): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
17 Jun 2024 17:08:51 1469580 22446110 oifs_43r3_bl_a381_2016092300_20_1018_12292504_0 1,727,100 40,471 0.0234
17 Jun 2024 13:56:13 1469580 22446110 oifs_43r3_bl_a381_2016092300_20_1018_12292504_0 1,210,500 28,112 0.0232


©2024 climateprediction.net