climateprediction.net home page
Task 22304874

Task 22304874

Name oifs_43r3_ps_0773_1990050100_123_959_12176417_2
Workunit 12176417
Created 30 Jan 2023, 16:31:40 UTC
Sent 30 Jan 2023, 16:32:10 UTC
Report deadline 31 Mar 2023, 16:32:10 UTC
Received 31 Jan 2023, 17:12:58 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1538037
Run time 17 hours 54 min 31 sec
CPU time 17 hours 50 min 47 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 4.76 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,796.11 MB
Peak swap size 4,978.06 MB
Peak disk usage 3,764.36 MB
Stderr
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<stderr_txt>
ermediate file: upload_file_102.zip
  16:26:01 STEP 2473 H=2473:00 +CPU= 17.190
  16:26:18 STEP 2474 H=2474:00 +CPU= 17.690
  16:26:46 STEP 2475 H=2475:00 +CPU= 27.620
  16:27:04 STEP 2476 H=2476:00 +CPU= 17.751
  16:27:21 STEP 2477 H=2477:00 +CPU= 17.158
  16:27:49 STEP 2478 H=2478:00 +CPU= 28.272
  16:28:06 STEP 2479 H=2479:00 +CPU= 17.234
  16:28:24 STEP 2480 H=2480:00 +CPU= 17.728
  16:28:52 STEP 2481 H=2481:00 +CPU= 27.667
  16:29:09 STEP 2482 H=2482:00 +CPU= 17.788
  16:29:27 STEP 2483 H=2483:00 +CPU= 17.200
  16:29:58 STEP 2484 H=2484:00 +CPU= 30.835
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002484
  16:30:15 STEP 2485 H=2485:00 +CPU= 17.259
  16:30:33 STEP 2486 H=2486:00 +CPU= 17.754
  16:31:00 STEP 2487 H=2487:00 +CPU= 27.652
  16:31:18 STEP 2488 H=2488:00 +CPU= 17.790
  16:31:35 STEP 2489 H=2489:00 +CPU= 17.166
  16:32:03 STEP 2490 H=2490:00 +CPU= 28.269
  16:32:21 STEP 2491 H=2491:00 +CPU= 17.217
  16:32:38 STEP 2492 H=2492:00 +CPU= 17.719
  16:33:06 STEP 2493 H=2493:00 +CPU= 27.626
  16:33:24 STEP 2494 H=2494:00 +CPU= 17.772
  16:33:41 STEP 2495 H=2495:00 +CPU= 17.737
  16:34:14 STEP 2496 H=2496:00 +CPU= 32.866
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMGGhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMSHhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMGGhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMSHhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMUAhq0f+002484
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0773_1990050100_123_959_12176417_2_r1415087854_103.zip
Uploading the intermediate file: upload_file_103.zip
  16:34:32 STEP 2497 H=2497:00 +CPU= 17.225
  16:34:49 STEP 2498 H=2498:00 +CPU= 17.719
  16:35:17 STEP 2499 H=2499:00 +CPU= 27.668
  16:35:35 STEP 2500 H=2500:00 +CPU= 17.823
  16:35:52 STEP 2501 H=2501:00 +CPU= 17.174
  16:36:20 STEP 2502 H=2502:00 +CPU= 28.316
  16:36:38 STEP 2503 H=2503:00 +CPU= 17.252
  16:36:55 STEP 2504 H=2504:00 +CPU= 17.748
  16:37:23 STEP 2505 H=2505:00 +CPU= 27.662
  16:37:41 STEP 2506 H=2506:00 +CPU= 17.807
  16:37:58 STEP 2507 H=2507:00 +CPU= 17.206
  16:38:29 STEP 2508 H=2508:00 +CPU= 30.782
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002508
  16:38:46 STEP 2509 H=2509:00 +CPU= 17.276
  16:39:04 STEP 2510 H=2510:00 +CPU= 17.766
  16:39:31 STEP 2511 H=2511:00 +CPU= 27.681
  16:39:49 STEP 2512 H=2512:00 +CPU= 17.811
  16:40:06 STEP 2513 H=2513:00 +CPU= 17.193
  16:40:35 STEP 2514 H=2514:00 +CPU= 28.296
  16:40:52 STEP 2515 H=2515:00 +CPU= 17.251
  16:41:10 STEP 2516 H=2516:00 +CPU= 17.723
  16:41:37 STEP 2517 H=2517:00 +CPU= 27.664
  16:41:55 STEP 2518 H=2518:00 +CPU= 17.795
  16:42:13 STEP 2519 H=2519:00 +CPU= 17.745
  16:42:46 STEP 2520 H=2520:00 +CPU= 32.737
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMGGhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMSHhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMGGhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMSHhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMUAhq0f+002508
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0773_1990050100_123_959_12176417_2_r1415087854_104.zip
Uploading the intermediate file: upload_file_104.zip
  16:43:03 STEP 2521 H=2521:00 +CPU= 17.174
  16:43:21 STEP 2522 H=2522:00 +CPU= 17.672
  16:43:48 STEP 2523 H=2523:00 +CPU= 27.621
  16:44:06 STEP 2524 H=2524:00 +CPU= 17.743
  16:44:23 STEP 2525 H=2525:00 +CPU= 17.153
  16:44:51 STEP 2526 H=2526:00 +CPU= 28.272
  16:45:09 STEP 2527 H=2527:00 +CPU= 17.212
  16:45:26 STEP 2528 H=2528:00 +CPU= 17.718
  16:45:54 STEP 2529 H=2529:00 +CPU= 27.626
  16:46:12 STEP 2530 H=2530:00 +CPU= 17.784
  16:46:29 STEP 2531 H=2531:00 +CPU= 17.162
  16:47:00 STEP 2532 H=2532:00 +CPU= 30.801
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002532
  16:47:17 STEP 2533 H=2533:00 +CPU= 17.218
  16:47:35 STEP 2534 H=2534:00 +CPU= 17.730
  16:48:02 STEP 2535 H=2535:00 +CPU= 27.603
  16:48:20 STEP 2536 H=2536:00 +CPU= 17.780
  16:48:37 STEP 2537 H=2537:00 +CPU= 17.163
  16:49:05 STEP 2538 H=2538:00 +CPU= 28.237
  16:49:23 STEP 2539 H=2539:00 +CPU= 17.213
  16:49:40 STEP 2540 H=2540:00 +CPU= 17.701
  16:50:08 STEP 2541 H=2541:00 +CPU= 27.589
  16:50:26 STEP 2542 H=2542:00 +CPU= 17.766
  16:50:43 STEP 2543 H=2543:00 +CPU= 17.764
  16:51:16 STEP 2544 H=2544:00 +CPU= 32.725
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMGGhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMSHhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMGGhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMSHhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMUAhq0f+002532
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0773_1990050100_123_959_12176417_2_r1415087854_105.zip
Uploading the intermediate file: upload_file_105.zip
  16:51:33 STEP 2545 H=2545:00 +CPU= 17.116
  16:51:51 STEP 2546 H=2546:00 +CPU= 17.609
  16:52:18 STEP 2547 H=2547:00 +CPU= 27.529
  16:52:36 STEP 2548 H=2548:00 +CPU= 17.675
  16:52:53 STEP 2549 H=2549:00 +CPU= 17.072
  16:53:21 STEP 2550 H=2550:00 +CPU= 28.135
  16:53:38 STEP 2551 H=2551:00 +CPU= 17.143
  16:53:56 STEP 2552 H=2552:00 +CPU= 17.636
  16:54:24 STEP 2553 H=2553:00 +CPU= 27.493
  16:54:41 STEP 2554 H=2554:00 +CPU= 17.694
  16:54:58 STEP 2555 H=2555:00 +CPU= 17.103
  16:55:29 STEP 2556 H=2556:00 +CPU= 30.780
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002556
  16:55:46 STEP 2557 H=2557:00 +CPU= 17.211
  16:56:04 STEP 2558 H=2558:00 +CPU= 17.713
  16:56:32 STEP 2559 H=2559:00 +CPU= 27.682
  16:56:49 STEP 2560 H=2560:00 +CPU= 17.714
  16:57:07 STEP 2561 H=2561:00 +CPU= 17.096
  16:57:35 STEP 2562 H=2562:00 +CPU= 28.149
  16:57:52 STEP 2563 H=2563:00 +CPU= 17.137
  16:58:10 STEP 2564 H=2564:00 +CPU= 17.679
  16:58:37 STEP 2565 H=2565:00 +CPU= 27.582
  16:58:55 STEP 2566 H=2566:00 +CPU= 17.744
  16:59:13 STEP 2567 H=2567:00 +CPU= 17.686
  16:59:45 STEP 2568 H=2568:00 +CPU= 32.755
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMGGhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMSHhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMGGhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMSHhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMUAhq0f+002556
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0773_1990050100_123_959_12176417_2_r1415087854_106.zip
Uploading the intermediate file: upload_file_106.zip
  17:00:02 STEP 2569 H=2569:00 +CPU= 17.185
  17:00:20 STEP 2570 H=2570:00 +CPU= 17.680
  17:00:48 STEP 2571 H=2571:00 +CPU= 27.619
  17:01:06 STEP 2572 H=2572:00 +CPU= 17.751
  17:01:23 STEP 2573 H=2573:00 +CPU= 17.151
  17:01:51 STEP 2574 H=2574:00 +CPU= 28.256
  17:02:08 STEP 2575 H=2575:00 +CPU= 17.225
  17:02:26 STEP 2576 H=2576:00 +CPU= 17.721
  17:02:54 STEP 2577 H=2577:00 +CPU= 27.629
  17:03:11 STEP 2578 H=2578:00 +CPU= 17.767
  17:03:28 STEP 2579 H=2579:00 +CPU= 17.146
  17:03:59 STEP 2580 H=2580:00 +CPU= 30.860
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002580
  17:04:17 STEP 2581 H=2581:00 +CPU= 17.231
  17:04:34 STEP 2582 H=2582:00 +CPU= 17.707
  17:05:02 STEP 2583 H=2583:00 +CPU= 27.624
  17:05:20 STEP 2584 H=2584:00 +CPU= 17.762
  17:05:37 STEP 2585 H=2585:00 +CPU= 17.155
  17:06:05 STEP 2586 H=2586:00 +CPU= 28.306
  17:06:22 STEP 2587 H=2587:00 +CPU= 17.230
  17:06:40 STEP 2588 H=2588:00 +CPU= 17.712
  17:07:08 STEP 2589 H=2589:00 +CPU= 27.668
  17:07:25 STEP 2590 H=2590:00 +CPU= 17.785
  17:07:43 STEP 2591 H=2591:00 +CPU= 17.735
  17:08:16 STEP 2592 H=2592:00 +CPU= 32.803
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMGGhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMSHhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMGGhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMSHhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMUAhq0f+002580
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0773_1990050100_123_959_12176417_2_r1415087854_107.zip
Uploading the intermediate file: upload_file_107.zip
  17:08:33 STEP 2593 H=2593:00 +CPU= 17.203
  17:08:51 STEP 2594 H=2594:00 +CPU= 17.698
  17:09:19 STEP 2595 H=2595:00 +CPU= 27.671
  17:09:36 STEP 2596 H=2596:00 +CPU= 17.782
  17:09:54 STEP 2597 H=2597:00 +CPU= 17.172
  17:10:22 STEP 2598 H=2598:00 +CPU= 28.320
  17:10:39 STEP 2599 H=2599:00 +CPU= 17.243
  17:10:57 STEP 2600 H=2600:00 +CPU= 17.733
  17:11:24 STEP 2601 H=2601:00 +CPU= 27.632
  17:11:42 STEP 2602 H=2602:00 +CPU= 17.771
  17:11:59 STEP 2603 H=2603:00 +CPU= 17.154
  17:12:30 STEP 2604 H=2604:00 +CPU= 30.745
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002604
  17:12:47 STEP 2605 H=2605:00 +CPU= 17.213
  17:13:05 STEP 2606 H=2606:00 +CPU= 17.703
  17:13:33 STEP 2607 H=2607:00 +CPU= 27.614
  17:13:50 STEP 2608 H=2608:00 +CPU= 17.755
  17:14:08 STEP 2609 H=2609:00 +CPU= 17.145
  17:14:36 STEP 2610 H=2610:00 +CPU= 28.250
  17:14:53 STEP 2611 H=2611:00 +CPU= 17.193
  17:15:11 STEP 2612 H=2612:00 +CPU= 17.688
  17:15:38 STEP 2613 H=2613:00 +CPU= 27.624
  17:15:56 STEP 2614 H=2614:00 +CPU= 17.763
  17:16:14 STEP 2615 H=2615:00 +CPU= 17.700
  17:16:47 STEP 2616 H=2616:00 +CPU= 32.879
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMGGhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMSHhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMGGhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMSHhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMUAhq0f+002604
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0773_1990050100_123_959_12176417_2_r1415087854_108.zip
Uploading the intermediate file: upload_file_108.zip
  17:17:04 STEP 2617 H=2617:00 +CPU= 17.175
  17:17:22 STEP 2618 H=2618:00 +CPU= 17.675
  17:17:49 STEP 2619 H=2619:00 +CPU= 27.607
  17:18:07 STEP 2620 H=2620:00 +CPU= 17.740
  17:18:24 STEP 2621 H=2621:00 +CPU= 17.137
  17:18:52 STEP 2622 H=2622:00 +CPU= 28.261
  17:19:10 STEP 2623 H=2623:00 +CPU= 17.204
  17:19:27 STEP 2624 H=2624:00 +CPU= 17.697
  17:19:55 STEP 2625 H=2625:00 +CPU= 27.611
  17:20:13 STEP 2626 H=2626:00 +CPU= 18.020
  17:20:30 STEP 2627 H=2627:00 +CPU= 17.149
  17:21:01 STEP 2628 H=2628:00 +CPU= 30.751
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002628
  17:21:18 STEP 2629 H=2629:00 +CPU= 17.146
  17:21:36 STEP 2630 H=2630:00 +CPU= 17.651
  17:22:03 STEP 2631 H=2631:00 +CPU= 27.496
  17:22:21 STEP 2632 H=2632:00 +CPU= 17.688
  17:22:38 STEP 2633 H=2633:00 +CPU= 17.073
  17:23:06 STEP 2634 H=2634:00 +CPU= 28.135
  17:23:23 STEP 2635 H=2635:00 +CPU= 17.125
  17:23:41 STEP 2636 H=2636:00 +CPU= 17.620
  17:24:08 STEP 2637 H=2637:00 +CPU= 27.487
  17:24:26 STEP 2638 H=2638:00 +CPU= 17.678
  17:24:43 STEP 2639 H=2639:00 +CPU= 17.627
  17:25:16 STEP 2640 H=2640:00 +CPU= 32.614
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMGGhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMSHhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMGGhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMSHhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMUAhq0f+002628
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0773_1990050100_123_959_12176417_2_r1415087854_109.zip
Uploading the intermediate file: upload_file_109.zip
  17:25:33 STEP 2641 H=2641:00 +CPU= 17.107
Uploading trickle at timestep: 9504000
  17:25:51 STEP 2642 H=2642:00 +CPU= 17.601
  17:26:18 STEP 2643 H=2643:00 +CPU= 27.515
  17:26:36 STEP 2644 H=2644:00 +CPU= 17.672
  17:26:53 STEP 2645 H=2645:00 +CPU= 17.069
  17:27:21 STEP 2646 H=2646:00 +CPU= 28.154
  17:27:38 STEP 2647 H=2647:00 +CPU= 17.146
  17:27:56 STEP 2648 H=2648:00 +CPU= 17.634
  17:28:24 STEP 2649 H=2649:00 +CPU= 27.519
  17:28:41 STEP 2650 H=2650:00 +CPU= 17.705
  17:28:58 STEP 2651 H=2651:00 +CPU= 17.098
  17:29:29 STEP 2652 H=2652:00 +CPU= 30.676
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002652
  17:29:46 STEP 2653 H=2653:00 +CPU= 17.190
  17:30:04 STEP 2654 H=2654:00 +CPU= 17.687
  17:30:31 STEP 2655 H=2655:00 +CPU= 27.564
  17:30:49 STEP 2656 H=2656:00 +CPU= 17.723
  17:31:06 STEP 2657 H=2657:00 +CPU= 17.109
  17:31:34 STEP 2658 H=2658:00 +CPU= 28.195
  17:31:52 STEP 2659 H=2659:00 +CPU= 17.165
  17:32:09 STEP 2660 H=2660:00 +CPU= 17.647
  17:32:37 STEP 2661 H=2661:00 +CPU= 27.554
  17:32:55 STEP 2662 H=2662:00 +CPU= 17.728
  17:33:12 STEP 2663 H=2663:00 +CPU= 17.661
  17:33:45 STEP 2664 H=2664:00 +CPU= 32.636
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMGGhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMSHhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMGGhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMSHhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMUAhq0f+002652
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0773_1990050100_123_959_12176417_2_r1415087854_110.zip
Uploading the intermediate file: upload_file_110.zip
  17:34:02 STEP 2665 H=2665:00 +CPU= 17.148
  17:34:20 STEP 2666 H=2666:00 +CPU= 17.639
  17:34:47 STEP 2667 H=2667:00 +CPU= 27.531
  17:35:05 STEP 2668 H=2668:00 +CPU= 17.705
  17:35:22 STEP 2669 H=2669:00 +CPU= 17.117
  17:35:50 STEP 2670 H=2670:00 +CPU= 28.202
  17:36:07 STEP 2671 H=2671:00 +CPU= 17.179
  17:36:25 STEP 2672 H=2672:00 +CPU= 17.675
  17:36:53 STEP 2673 H=2673:00 +CPU= 27.559
  17:37:10 STEP 2674 H=2674:00 +CPU= 17.747
  17:37:28 STEP 2675 H=2675:00 +CPU= 17.127
  17:37:58 STEP 2676 H=2676:00 +CPU= 30.682
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002676
  17:38:15 STEP 2677 H=2677:00 +CPU= 17.197
  17:38:33 STEP 2678 H=2678:00 +CPU= 17.683
  17:39:01 STEP 2679 H=2679:00 +CPU= 27.550
  17:39:18 STEP 2680 H=2680:00 +CPU= 17.736
  17:39:35 STEP 2681 H=2681:00 +CPU= 17.118
  17:40:04 STEP 2682 H=2682:00 +CPU= 28.167
  17:40:21 STEP 2683 H=2683:00 +CPU= 17.169
  17:40:38 STEP 2684 H=2684:00 +CPU= 17.646
  17:41:06 STEP 2685 H=2685:00 +CPU= 27.540
  17:41:24 STEP 2686 H=2686:00 +CPU= 17.725
  17:41:41 STEP 2687 H=2687:00 +CPU= 17.657
  17:42:14 STEP 2688 H=2688:00 +CPU= 32.639
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMGGhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMSHhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMGGhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMSHhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMUAhq0f+002676
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0773_1990050100_123_959_12176417_2_r1415087854_111.zip
Uploading the intermediate file: upload_file_111.zip
  17:42:31 STEP 2689 H=2689:00 +CPU= 17.125
  17:42:49 STEP 2690 H=2690:00 +CPU= 17.617
  17:43:16 STEP 2691 H=2691:00 +CPU= 27.513
  17:43:34 STEP 2692 H=2692:00 +CPU= 17.699
  17:43:51 STEP 2693 H=2693:00 +CPU= 17.083
  17:44:19 STEP 2694 H=2694:00 +CPU= 28.179
  17:44:36 STEP 2695 H=2695:00 +CPU= 17.154
  17:44:54 STEP 2696 H=2696:00 +CPU= 17.653
  17:45:22 STEP 2697 H=2697:00 +CPU= 27.519
  17:45:39 STEP 2698 H=2698:00 +CPU= 17.721
  17:45:56 STEP 2699 H=2699:00 +CPU= 17.116
  17:46:27 STEP 2700 H=2700:00 +CPU= 30.690
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002700
  17:46:44 STEP 2701 H=2701:00 +CPU= 17.156
  17:47:02 STEP 2702 H=2702:00 +CPU= 17.649
  17:47:29 STEP 2703 H=2703:00 +CPU= 27.502
  17:47:47 STEP 2704 H=2704:00 +CPU= 17.693
  17:48:04 STEP 2705 H=2705:00 +CPU= 17.074
  17:48:32 STEP 2706 H=2706:00 +CPU= 28.134
  17:48:49 STEP 2707 H=2707:00 +CPU= 17.128
  17:49:07 STEP 2708 H=2708:00 +CPU= 17.611
  17:49:35 STEP 2709 H=2709:00 +CPU= 27.494
  17:49:52 STEP 2710 H=2710:00 +CPU= 17.663
  17:50:10 STEP 2711 H=2711:00 +CPU= 17.620
  17:50:42 STEP 2712 H=2712:00 +CPU= 32.596
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMGGhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMSHhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMGGhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMSHhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMUAhq0f+002700
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0773_1990050100_123_959_12176417_2_r1415087854_112.zip
Uploading the intermediate file: upload_file_112.zip
  17:51:00 STEP 2713 H=2713:00 +CPU= 17.141
  17:51:17 STEP 2714 H=2714:00 +CPU= 17.619
  17:51:45 STEP 2715 H=2715:00 +CPU= 27.523
  17:52:02 STEP 2716 H=2716:00 +CPU= 17.694
  17:52:20 STEP 2717 H=2717:00 +CPU= 17.090
  17:52:48 STEP 2718 H=2718:00 +CPU= 28.395
  17:53:05 STEP 2719 H=2719:00 +CPU= 17.204
  17:53:23 STEP 2720 H=2720:00 +CPU= 17.632
  17:53:50 STEP 2721 H=2721:00 +CPU= 27.476
  17:54:08 STEP 2722 H=2722:00 +CPU= 17.696
  17:54:25 STEP 2723 H=2723:00 +CPU= 17.098
  17:54:56 STEP 2724 H=2724:00 +CPU= 30.606
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002724
  17:55:13 STEP 2725 H=2725:00 +CPU= 17.133
  17:55:30 STEP 2726 H=2726:00 +CPU= 17.623
  17:55:58 STEP 2727 H=2727:00 +CPU= 27.557
  17:56:16 STEP 2728 H=2728:00 +CPU= 17.756
  17:56:33 STEP 2729 H=2729:00 +CPU= 17.123
  17:57:01 STEP 2730 H=2730:00 +CPU= 28.177
  17:57:18 STEP 2731 H=2731:00 +CPU= 17.175
  17:57:36 STEP 2732 H=2732:00 +CPU= 17.653
  17:58:03 STEP 2733 H=2733:00 +CPU= 27.528
  17:58:21 STEP 2734 H=2734:00 +CPU= 17.718
  17:58:39 STEP 2735 H=2735:00 +CPU= 17.666
  17:59:11 STEP 2736 H=2736:00 +CPU= 32.667
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMGGhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMSHhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMGGhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMSHhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMUAhq0f+002724
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0773_1990050100_123_959_12176417_2_r1415087854_113.zip
Uploading the intermediate file: upload_file_113.zip
  17:59:29 STEP 2737 H=2737:00 +CPU= 17.133
  17:59:46 STEP 2738 H=2738:00 +CPU= 17.590
  18:00:14 STEP 2739 H=2739:00 +CPU= 27.453
  18:00:31 STEP 2740 H=2740:00 +CPU= 17.666
  18:00:48 STEP 2741 H=2741:00 +CPU= 17.055
  18:01:16 STEP 2742 H=2742:00 +CPU= 28.128
  18:01:34 STEP 2743 H=2743:00 +CPU= 17.134
  18:01:51 STEP 2744 H=2744:00 +CPU= 17.634
  18:02:19 STEP 2745 H=2745:00 +CPU= 27.598
  18:02:37 STEP 2746 H=2746:00 +CPU= 17.775
  18:02:54 STEP 2747 H=2747:00 +CPU= 17.171
  18:03:24 STEP 2748 H=2748:00 +CPU= 30.730
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002748
  18:03:42 STEP 2749 H=2749:00 +CPU= 17.221
  18:03:59 STEP 2750 H=2750:00 +CPU= 17.712
  18:04:27 STEP 2751 H=2751:00 +CPU= 27.583
  18:04:45 STEP 2752 H=2752:00 +CPU= 17.757
  18:05:02 STEP 2753 H=2753:00 +CPU= 17.146
  18:05:30 STEP 2754 H=2754:00 +CPU= 28.216
  18:05:47 STEP 2755 H=2755:00 +CPU= 17.195
  18:06:05 STEP 2756 H=2756:00 +CPU= 17.683
  18:06:33 STEP 2757 H=2757:00 +CPU= 27.601
  18:06:50 STEP 2758 H=2758:00 +CPU= 17.749
  18:07:08 STEP 2759 H=2759:00 +CPU= 17.730
  18:07:41 STEP 2760 H=2760:00 +CPU= 32.724
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMGGhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMSHhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMGGhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMSHhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMUAhq0f+002748
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0773_1990050100_123_959_12176417_2_r1415087854_114.zip
Uploading the intermediate file: upload_file_114.zip
  18:07:58 STEP 2761 H=2761:00 +CPU= 17.224
  18:08:16 STEP 2762 H=2762:00 +CPU= 17.658
  18:08:43 STEP 2763 H=2763:00 +CPU= 27.564
  18:09:01 STEP 2764 H=2764:00 +CPU= 17.756
  18:09:18 STEP 2765 H=2765:00 +CPU= 17.129
  18:09:46 STEP 2766 H=2766:00 +CPU= 28.251
  18:10:04 STEP 2767 H=2767:00 +CPU= 17.205
  18:10:21 STEP 2768 H=2768:00 +CPU= 17.711
  18:10:49 STEP 2769 H=2769:00 +CPU= 27.590
  18:11:07 STEP 2770 H=2770:00 +CPU= 17.746
  18:11:24 STEP 2771 H=2771:00 +CPU= 17.152
  18:11:55 STEP 2772 H=2772:00 +CPU= 30.742
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002772
  18:12:12 STEP 2773 H=2773:00 +CPU= 17.238
  18:12:30 STEP 2774 H=2774:00 +CPU= 17.722
  18:12:57 STEP 2775 H=2775:00 +CPU= 27.599
  18:13:15 STEP 2776 H=2776:00 +CPU= 17.781
  18:13:32 STEP 2777 H=2777:00 +CPU= 17.160
  18:14:00 STEP 2778 H=2778:00 +CPU= 28.248
  18:14:18 STEP 2779 H=2779:00 +CPU= 17.205
  18:14:35 STEP 2780 H=2780:00 +CPU= 17.694
  18:15:03 STEP 2781 H=2781:00 +CPU= 27.603
  18:15:21 STEP 2782 H=2782:00 +CPU= 17.742
  18:15:38 STEP 2783 H=2783:00 +CPU= 17.732
  18:16:11 STEP 2784 H=2784:00 +CPU= 32.757
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMGGhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMSHhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMGGhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMSHhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMUAhq0f+002772
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0773_1990050100_123_959_12176417_2_r1415087854_115.zip
Uploading the intermediate file: upload_file_115.zip
  18:16:28 STEP 2785 H=2785:00 +CPU= 17.184
  18:16:46 STEP 2786 H=2786:00 +CPU= 17.683
  18:17:14 STEP 2787 H=2787:00 +CPU= 27.736
  18:17:31 STEP 2788 H=2788:00 +CPU= 17.755
  18:17:49 STEP 2789 H=2789:00 +CPU= 17.143
  18:18:17 STEP 2790 H=2790:00 +CPU= 28.245
  18:18:34 STEP 2791 H=2791:00 +CPU= 17.216
  18:18:52 STEP 2792 H=2792:00 +CPU= 17.722
  18:19:19 STEP 2793 H=2793:00 +CPU= 27.598
  18:19:37 STEP 2794 H=2794:00 +CPU= 17.773
  18:19:54 STEP 2795 H=2795:00 +CPU= 17.173
  18:20:25 STEP 2796 H=2796:00 +CPU= 30.710
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002796
  18:20:42 STEP 2797 H=2797:00 +CPU= 17.226
  18:21:00 STEP 2798 H=2798:00 +CPU= 17.721
  18:21:28 STEP 2799 H=2799:00 +CPU= 27.601
  18:21:45 STEP 2800 H=2800:00 +CPU= 17.773
  18:22:03 STEP 2801 H=2801:00 +CPU= 17.156
  18:22:31 STEP 2802 H=2802:00 +CPU= 28.259
  18:22:48 STEP 2803 H=2803:00 +CPU= 17.213
  18:23:06 STEP 2804 H=2804:00 +CPU= 17.690
  18:23:33 STEP 2805 H=2805:00 +CPU= 27.599
  18:23:51 STEP 2806 H=2806:00 +CPU= 17.759
  18:24:09 STEP 2807 H=2807:00 +CPU= 17.818
  18:24:42 STEP 2808 H=2808:00 +CPU= 32.800
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMGGhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMSHhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMGGhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMSHhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMUAhq0f+002796
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0773_1990050100_123_959_12176417_2_r1415087854_116.zip
Uploading the intermediate file: upload_file_116.zip
  18:24:59 STEP 2809 H=2809:00 +CPU= 17.242
  18:25:17 STEP 2810 H=2810:00 +CPU= 17.696
  18:25:44 STEP 2811 H=2811:00 +CPU= 27.643
  18:26:02 STEP 2812 H=2812:00 +CPU= 17.819
  18:26:19 STEP 2813 H=2813:00 +CPU= 17.178
  18:26:48 STEP 2814 H=2814:00 +CPU= 28.301
  18:27:05 STEP 2815 H=2815:00 +CPU= 17.255
  18:27:23 STEP 2816 H=2816:00 +CPU= 17.746
  18:27:50 STEP 2817 H=2817:00 +CPU= 27.654
  18:28:08 STEP 2818 H=2818:00 +CPU= 17.813
  18:28:25 STEP 2819 H=2819:00 +CPU= 17.195
  18:28:56 STEP 2820 H=2820:00 +CPU= 30.811
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002820
  18:29:13 STEP 2821 H=2821:00 +CPU= 17.258
  18:29:31 STEP 2822 H=2822:00 +CPU= 17.753
  18:29:59 STEP 2823 H=2823:00 +CPU= 27.630
  18:30:16 STEP 2824 H=2824:00 +CPU= 17.797
  18:30:34 STEP 2825 H=2825:00 +CPU= 17.187
  18:31:02 STEP 2826 H=2826:00 +CPU= 28.283
  18:31:19 STEP 2827 H=2827:00 +CPU= 17.241
  18:31:37 STEP 2828 H=2828:00 +CPU= 17.730
  18:32:05 STEP 2829 H=2829:00 +CPU= 27.628
  18:32:22 STEP 2830 H=2830:00 +CPU= 17.785
  18:32:40 STEP 2831 H=2831:00 +CPU= 17.806
  18:33:13 STEP 2832 H=2832:00 +CPU= 32.745
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMGGhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMSHhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMGGhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMSHhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMUAhq0f+002820
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0773_1990050100_123_959_12176417_2_r1415087854_117.zip
Uploading the intermediate file: upload_file_117.zip
  18:33:30 STEP 2833 H=2833:00 +CPU= 17.289
  18:33:48 STEP 2834 H=2834:00 +CPU= 17.604
  18:34:15 STEP 2835 H=2835:00 +CPU= 27.469
  18:34:33 STEP 2836 H=2836:00 +CPU= 17.724
  18:34:50 STEP 2837 H=2837:00 +CPU= 17.079
  18:35:18 STEP 2838 H=2838:00 +CPU= 28.257
  18:35:36 STEP 2839 H=2839:00 +CPU= 17.230
  18:35:53 STEP 2840 H=2840:00 +CPU= 17.719
  18:36:21 STEP 2841 H=2841:00 +CPU= 27.650
  18:36:39 STEP 2842 H=2842:00 +CPU= 17.821
  18:36:56 STEP 2843 H=2843:00 +CPU= 17.194
  18:37:27 STEP 2844 H=2844:00 +CPU= 30.829
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002844
  18:37:44 STEP 2845 H=2845:00 +CPU= 17.269
  18:38:02 STEP 2846 H=2846:00 +CPU= 17.761
  18:38:30 STEP 2847 H=2847:00 +CPU= 27.664
  18:38:47 STEP 2848 H=2848:00 +CPU= 17.809
  18:39:05 STEP 2849 H=2849:00 +CPU= 17.192
  18:39:33 STEP 2850 H=2850:00 +CPU= 28.292
  18:39:50 STEP 2851 H=2851:00 +CPU= 17.236
  18:40:08 STEP 2852 H=2852:00 +CPU= 17.746
  18:40:35 STEP 2853 H=2853:00 +CPU= 27.667
  18:40:53 STEP 2854 H=2854:00 +CPU= 17.812
  18:41:11 STEP 2855 H=2855:00 +CPU= 17.750
  18:41:44 STEP 2856 H=2856:00 +CPU= 32.818
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMGGhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMSHhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMGGhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMSHhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMUAhq0f+002844
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0773_1990050100_123_959_12176417_2_r1415087854_118.zip
Uploading the intermediate file: upload_file_118.zip
  18:42:01 STEP 2857 H=2857:00 +CPU= 17.224
  18:42:19 STEP 2858 H=2858:00 +CPU= 17.726
  18:42:46 STEP 2859 H=2859:00 +CPU= 27.681
  18:43:04 STEP 2860 H=2860:00 +CPU= 17.800
  18:43:21 STEP 2861 H=2861:00 +CPU= 17.197
  18:43:50 STEP 2862 H=2862:00 +CPU= 28.290
  18:44:07 STEP 2863 H=2863:00 +CPU= 17.231
  18:44:25 STEP 2864 H=2864:00 +CPU= 17.738
  18:44:52 STEP 2865 H=2865:00 +CPU= 27.637
  18:45:10 STEP 2866 H=2866:00 +CPU= 17.802
  18:45:27 STEP 2867 H=2867:00 +CPU= 17.243
  18:45:58 STEP 2868 H=2868:00 +CPU= 30.809
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002868
  18:46:16 STEP 2869 H=2869:00 +CPU= 17.272
  18:46:33 STEP 2870 H=2870:00 +CPU= 17.763
  18:47:01 STEP 2871 H=2871:00 +CPU= 27.650
  18:47:19 STEP 2872 H=2872:00 +CPU= 17.803
  18:47:36 STEP 2873 H=2873:00 +CPU= 17.206
  18:48:04 STEP 2874 H=2874:00 +CPU= 28.296
  18:48:22 STEP 2875 H=2875:00 +CPU= 17.233
  18:48:39 STEP 2876 H=2876:00 +CPU= 17.737
  18:49:07 STEP 2877 H=2877:00 +CPU= 27.657
  18:49:25 STEP 2878 H=2878:00 +CPU= 17.812
  18:49:43 STEP 2879 H=2879:00 +CPU= 17.811
  18:50:15 STEP 2880 H=2880:00 +CPU= 32.800
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMGGhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMSHhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMGGhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMSHhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMUAhq0f+002868
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0773_1990050100_123_959_12176417_2_r1415087854_119.zip
Uploading the intermediate file: upload_file_119.zip
  18:50:33 STEP 2881 H=2881:00 +CPU= 17.228
Uploading trickle at timestep: 10368000
  18:50:50 STEP 2882 H=2882:00 +CPU= 17.693
  18:51:18 STEP 2883 H=2883:00 +CPU= 27.598
  18:51:36 STEP 2884 H=2884:00 +CPU= 17.830
  18:51:53 STEP 2885 H=2885:00 +CPU= 17.177
  18:52:21 STEP 2886 H=2886:00 +CPU= 28.250
  18:52:38 STEP 2887 H=2887:00 +CPU= 17.227
  18:52:56 STEP 2888 H=2888:00 +CPU= 17.737
  18:53:24 STEP 2889 H=2889:00 +CPU= 27.634
  18:53:42 STEP 2890 H=2890:00 +CPU= 17.816
  18:53:59 STEP 2891 H=2891:00 +CPU= 17.193
  18:54:29 STEP 2892 H=2892:00 +CPU= 30.751
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002892
  18:54:47 STEP 2893 H=2893:00 +CPU= 17.246
  18:55:04 STEP 2894 H=2894:00 +CPU= 17.749
  18:55:32 STEP 2895 H=2895:00 +CPU= 27.622
  18:55:50 STEP 2896 H=2896:00 +CPU= 17.780
  18:56:07 STEP 2897 H=2897:00 +CPU= 17.184
  18:56:36 STEP 2898 H=2898:00 +CPU= 28.587
  18:56:53 STEP 2899 H=2899:00 +CPU= 17.224
  18:57:11 STEP 2900 H=2900:00 +CPU= 17.733
[EC_DRHOOK:z640:1:1:122013:122013] [20230131:185713:1675159033:62658.384] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1538] Received signal#15 (SIGTERM) :: 3896MB (heap), 4798MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:z640:1:1:122013:122013] [20230131:185713:1675159033:62658.384] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:z640:1:1:122013:122013] [20230131:185713:1675159033:62658.384] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x81f3c0 (old at (nil))
[EC_DRHOOK:z640:1:1:122013:122013] [20230131:185713:1675159033:62658.384] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1617] Signal#15 was caused by unrecognized si_code [memaddr=0x1], nsigs = 1
[EC_DRHOOK:z640:1:1:122013:122013] [20230131:185713:1675159033:62658.384] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#15, nsigs = 1
[EC_DRHOOK:z640:1:1:122013:122013] [20230131:185713:1675159033:62658.384] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3843] 3896 MB (maxheap), 4798 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:z640:1:1:122013:122013] [20230131:185713:1675159033:62658.384] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :  MASTER 
[EC_DRHOOK:z640:1:1:122013:122013] [20230131:185713:1675159033:62658.384] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :   CNT0 
[EC_DRHOOK:z640:1:1:122013:122013] [20230131:185713:1675159033:62658.384] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :    CNT1 
[EC_DRHOOK:z640:1:1:122013:122013] [20230131:185713:1675159033:62658.384] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :     CNT2 
[EC_DRHOOK:z640:1:1:122013:122013] [20230131:185713:1675159033:62658.384] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :      CNT3 
[EC_DRHOOK:z640:1:1:122013:122013] [20230131:185713:1675159033:62658.384] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :       CNT4 
[EC_DRHOOK:z640:1:1:122013:122013] [20230131:185713:1675159033:62658.384] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :        STEPO 
[EC_DRHOOK:z640:1:1:122013:122013] [20230131:185713:1675159033:62658.384] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :         SCAN2M 
[EC_DRHOOK:z640:1:1:122013:122013] [20230131:185713:1675159033:62658.384] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :          GP_MODEL_HEAP 
[EC_DRHOOK:z640:1:1:122013:122013] [20230131:185713:1675159033:62658.384] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :           GP_MODEL 
[EC_DRHOOK:z640:1:1:122013:122013] [20230131:185713:1675159033:62658.384] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :            RADDRV 
[EC_DRHOOK:z640:1:1:122013:122013] [20230131:185713:1675159033:62658.384] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :             >OMP-RADDRV      2        (1202) 
[EC_DRHOOK:z640:1:1:122013:122013] [20230131:185714:1675159034:62659.385] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#15, nsigs = 1
[EC_DRHOOK:z640:1:1:122013:122013] [20230131:185714:1675159034:62659.385] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1ce8bb0 for signal#15, nsigs = 1
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
oifs_43r3_model.e  0000000001CE916B  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000081FFF1  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DC9090  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000126F7CF  raddrv_                   515  raddrv.F90
oifs_43r3_model.e  0000000000BFD839  gp_model_                 482  gp_model.F90
oifs_43r3_model.e  00000000012E9482  gp_model_heap_             74  gp_model_heap.F90
oifs_43r3_model.e  0000000000BBC1CE  scan2m_                   535  scan2m.F90
oifs_43r3_model.e  000000000057A664  stepo_                    327  stepo.F90
oifs_43r3_model.e  000000000055DEEC  cnt4_                    1133  cnt4.F90
oifs_43r3_model.e  00000000005471C9  cnt3_                     267  cnt3.F90
oifs_43r3_model.e  0000000000546412  cnt2_                      88  cnt2.F90
oifs_43r3_model.e  0000000000545E28  cnt1_                      92  cnt1.F90
oifs_43r3_model.e  000000000040708D  cnt0_                     146  cnt0.F90
oifs_43r3_model.e  000000000040220F  MAIN__                     96  master.F90
oifs_43r3_model.e  00000000004021A2  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCA390  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000040206E  Unknown               Unknown  Unknown
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1990050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0773
(argv4) batchid: 959
(argv5) wuid: 12176417
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/1
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/1/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/1/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_580eeb1e6b375387b9ec72818f8ba2d5 to: /var/lib/boinc-client/slots/1/oifs_43r3_ps_0773_1990050100_123_959_12176417.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/1/oifs_43r3_ps_0773_1990050100_123_959_12176417.zip
ic_ancil_file: ic_ancil_12176417
ifsdata_file: ifsdata_12176417
climate_data_file: clim_data_12176417
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_cec43c6cf14dd6e289e4a6c6d2bcb000 to: /var/lib/boinc-client/slots/1/ic_ancil_12176417.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/1/ic_ancil_12176417.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_7d5bd5a01b06c4d3a175abb4fe0efe92 to: /var/lib/boinc-client/slots/1/ifsdata/ifsdata_12176417.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/1/ifsdata/ifsdata_12176417.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/1/159l_2/clim_data_12176417.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/1/159l_2/clim_data_12176417.zip
Checking for progress XML file: /var/lib/boinc-client/slots/1/progress_file_12176417.xml
Opened progress file ok : /var/lib/boinc-client/slots/1/progress_file_12176417.xml
-- Model is restarting --
Adjusting last_iter, 2900, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/1/progress_file_12176417.xml
last_cpu_time: 62642
upload_file_number: 120
last_iter: 2879
last_upload: 10368000
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0773_1990050100_123_959_12176417_2_r1415087854
The child process has been launched with process id: 3683
Executing the command: /var/lib/boinc-client/slots/1/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:z640:1:1:3683:3683] [20230131:190757:1675159677:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:z640:1:1:3683:3683] [20230131:190757:1675159677:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:z640:1:1:3683:3683] [20230131:190757:1675159677:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:z640:1:1:3683:3683] [20230131:190757:1675159677:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:z640:1:1:3683:3683] [20230131:190757:1675159677:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:z640:1:1:3683:3683] [20230131:190757:1675159677:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:z640:1:1:3683:3683] [20230131:190757:1675159677:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:z640:1:1:3683:3683] [20230131:190757:1675159677:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:z640:1:1:3683:3683] [20230131:190757:1675159677:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:z640:1:1:3683:3683] [20230131:190757:1675159677:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:z640:1:1:3683:3683] [20230131:190757:1675159677:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:z640:1:1:3683:3683] [20230131:190757:1675159677:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:z640:1:1:3683:3683] [20230131:190757:1675159677:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:z640:1:1:3683:3683] [20230131:190757:1675159677:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:z640:1:1:3683:3683] [20230131:190757:1675159677:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:z640:1:1:3683:3683] [20230131:190757:1675159677:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:z640:1:1:3683:3683] [20230131:190757:1675159677:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:z640:1:1:3683:3683] [20230131:190757:1675159677:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:z640:1:1:3683:3683] [20230131:190757:1675159677:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:z640:1:1:3683:3683] [20230131:190757:1675159677:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:z640:1:1:3683:3683] [20230131:190757:1675159677:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:z640:1:1:3683:3683] [20230131:190757:1675159677:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:z640:1:1:3683:3683] [20230131:190757:1675159677:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:z640:1:1:3683:3683] [20230131:190757:1675159677:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:z640:1:1:3683:3683] [20230131:190757:1675159677:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:z640:1:1:3683:3683] [20230131:190757:1675159677:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:z640:1:1:3683:3683] [20230131:190757:1675159677:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:z640:1:1:3683:3683] [20230131:190757:1675159677:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:z640:1:1:3683:3683] [20230131:190757:1675159677:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:z640:1:1:3683:3683] [20230131:190757:1675159677:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  19:08:36 STEP 2880 H=2880:00 +CPU= 32.484
  19:08:53 STEP 2881 H=2881:00 +CPU= 17.515
  19:09:11 STEP 2882 H=2882:00 +CPU= 18.155
  19:09:40 STEP 2883 H=2883:00 +CPU= 28.481
  19:09:58 STEP 2884 H=2884:00 +CPU= 18.178
  19:10:16 STEP 2885 H=2885:00 +CPU= 17.494
  19:10:44 STEP 2886 H=2886:00 +CPU= 28.659
  19:11:02 STEP 2887 H=2887:00 +CPU= 17.571
  19:11:20 STEP 2888 H=2888:00 +CPU= 18.105
  19:11:48 STEP 2889 H=2889:00 +CPU= 28.081
  19:12:06 STEP 2890 H=2890:00 +CPU= 18.050
  19:12:24 STEP 2891 H=2891:00 +CPU= 17.476
  19:12:55 STEP 2892 H=2892:00 +CPU= 31.525
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002892
  19:13:13 STEP 2893 H=2893:00 +CPU= 17.811
  19:13:31 STEP 2894 H=2894:00 +CPU= 18.060
  19:13:59 STEP 2895 H=2895:00 +CPU= 28.294
  19:14:17 STEP 2896 H=2896:00 +CPU= 18.258
  19:14:35 STEP 2897 H=2897:00 +CPU= 17.885
  19:15:04 STEP 2898 H=2898:00 +CPU= 28.756
  19:15:22 STEP 2899 H=2899:00 +CPU= 17.494
  19:15:40 STEP 2900 H=2900:00 +CPU= 18.097
  19:16:08 STEP 2901 H=2901:00 +CPU= 28.639
  19:16:26 STEP 2902 H=2902:00 +CPU= 18.085
  19:16:45 STEP 2903 H=2903:00 +CPU= 18.106
  19:17:18 STEP 2904 H=2904:00 +CPU= 33.444
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMGGhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMSHhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMGGhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMSHhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMUAhq0f+002892
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0773_1990050100_123_959_12176417_2_r1415087854_120.zip
Uploading the intermediate file: upload_file_120.zip
  19:17:36 STEP 2905 H=2905:00 +CPU= 18.080
  19:17:54 STEP 2906 H=2906:00 +CPU= 18.153
  19:18:23 STEP 2907 H=2907:00 +CPU= 28.402
  19:18:41 STEP 2908 H=2908:00 +CPU= 18.062
  19:18:58 STEP 2909 H=2909:00 +CPU= 17.497
  19:19:27 STEP 2910 H=2910:00 +CPU= 29.194
  19:19:45 STEP 2911 H=2911:00 +CPU= 17.538
  19:20:03 STEP 2912 H=2912:00 +CPU= 18.268
  19:20:31 STEP 2913 H=2913:00 +CPU= 28.042
  19:20:49 STEP 2914 H=2914:00 +CPU= 18.036
  19:21:07 STEP 2915 H=2915:00 +CPU= 17.531
  19:21:38 STEP 2916 H=2916:00 +CPU= 31.358
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002916
  19:21:56 STEP 2917 H=2917:00 +CPU= 17.518
  19:22:14 STEP 2918 H=2918:00 +CPU= 18.133
  19:22:42 STEP 2919 H=2919:00 +CPU= 28.586
  19:23:01 STEP 2920 H=2920:00 +CPU= 18.095
  19:23:18 STEP 2921 H=2921:00 +CPU= 17.494
  19:23:47 STEP 2922 H=2922:00 +CPU= 29.148
  19:24:05 STEP 2923 H=2923:00 +CPU= 17.389
  19:24:23 STEP 2924 H=2924:00 +CPU= 18.097
  19:24:51 STEP 2925 H=2925:00 +CPU= 28.228
  19:25:09 STEP 2926 H=2926:00 +CPU= 18.216
  19:25:27 STEP 2927 H=2927:00 +CPU= 17.958
  19:26:00 STEP 2928 H=2928:00 +CPU= 33.246
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMGGhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMSHhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMGGhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMSHhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMUAhq0f+002916
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0773_1990050100_123_959_12176417_2_r1415087854_121.zip
Uploading the intermediate file: upload_file_121.zip
  19:26:18 STEP 2929 H=2929:00 +CPU= 17.557
  19:26:36 STEP 2930 H=2930:00 +CPU= 18.146
  19:27:05 STEP 2931 H=2931:00 +CPU= 28.515
  19:27:23 STEP 2932 H=2932:00 +CPU= 18.499
  19:27:41 STEP 2933 H=2933:00 +CPU= 17.876
  19:28:10 STEP 2934 H=2934:00 +CPU= 29.244
  19:28:28 STEP 2935 H=2935:00 +CPU= 18.024
  19:28:47 STEP 2936 H=2936:00 +CPU= 18.398
  19:29:15 STEP 2937 H=2937:00 +CPU= 28.118
  19:29:33 STEP 2938 H=2938:00 +CPU= 18.384
  19:29:51 STEP 2939 H=2939:00 +CPU= 17.977
  19:30:23 STEP 2940 H=2940:00 +CPU= 31.933
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002940
  19:30:41 STEP 2941 H=2941:00 +CPU= 17.780
  19:30:59 STEP 2942 H=2942:00 +CPU= 18.358
  19:31:28 STEP 2943 H=2943:00 +CPU= 28.326
  19:31:46 STEP 2944 H=2944:00 +CPU= 18.206
  19:32:03 STEP 2945 H=2945:00 +CPU= 17.569
  19:32:32 STEP 2946 H=2946:00 +CPU= 28.814
  19:32:50 STEP 2947 H=2947:00 +CPU= 17.908
  19:33:08 STEP 2948 H=2948:00 +CPU= 18.325
  19:33:37 STEP 2949 H=2949:00 +CPU= 28.345
  19:33:55 STEP 2950 H=2950:00 +CPU= 18.244
  19:34:13 STEP 2951 H=2951:00 +CPU= 18.296
  19:34:46 STEP 2952 H=2952:00 +CPU= 32.666
The child process terminated with status: 0
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMUAhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMGGhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMSHhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMSHhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMSHhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMGGhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12176417/ICMGGhq0f+002928
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0773_1990050100_123_959_12176417_2_r1415087854_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
19:38:09 (3660): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:45:58 1538037 22304874 oifs_43r3_ps_0773_1990050100_123_959_12176417_2 10,623,600 64,247 0.0060
09 May 2023 16:45:56 1538037 22304874 oifs_43r3_ps_0773_1990050100_123_959_12176417_2 10,368,000 62,240 0.0060
09 May 2023 16:45:56 1538037 22304874 oifs_43r3_ps_0773_1990050100_123_959_12176417_2 10,368,000 62,240 0.0060
09 May 2023 16:45:55 1538037 22304874 oifs_43r3_ps_0773_1990050100_123_959_12176417_2 9,504,000 57,141 0.0060
09 May 2023 16:45:55 1538037 22304874 oifs_43r3_ps_0773_1990050100_123_959_12176417_2 9,504,000 57,141 0.0060
09 May 2023 16:45:54 1538037 22304874 oifs_43r3_ps_0773_1990050100_123_959_12176417_2 8,640,000 52,033 0.0060
09 May 2023 16:45:54 1538037 22304874 oifs_43r3_ps_0773_1990050100_123_959_12176417_2 8,640,000 52,033 0.0060
09 May 2023 16:45:51 1538037 22304874 oifs_43r3_ps_0773_1990050100_123_959_12176417_2 7,776,000 46,925 0.0060
09 May 2023 16:45:50 1538037 22304874 oifs_43r3_ps_0773_1990050100_123_959_12176417_2 6,912,000 41,818 0.0061
09 May 2023 16:45:49 1538037 22304874 oifs_43r3_ps_0773_1990050100_123_959_12176417_2 6,048,000 36,649 0.0061
09 May 2023 16:45:49 1538037 22304874 oifs_43r3_ps_0773_1990050100_123_959_12176417_2 6,048,000 36,649 0.0061
09 May 2023 16:45:47 1538037 22304874 oifs_43r3_ps_0773_1990050100_123_959_12176417_2 5,184,000 31,150 0.0060
09 May 2023 16:45:46 1538037 22304874 oifs_43r3_ps_0773_1990050100_123_959_12176417_2 4,320,000 25,663 0.0059
09 May 2023 16:45:43 1538037 22304874 oifs_43r3_ps_0773_1990050100_123_959_12176417_2 3,456,000 20,567 0.0060
09 May 2023 16:45:42 1538037 22304874 oifs_43r3_ps_0773_1990050100_123_959_12176417_2 2,592,000 15,441 0.0060
09 May 2023 16:45:40 1538037 22304874 oifs_43r3_ps_0773_1990050100_123_959_12176417_2 1,728,000 10,314 0.0060
09 May 2023 16:45:39 1538037 22304874 oifs_43r3_ps_0773_1990050100_123_959_12176417_2 864,000 5,184 0.0060


©2024 climateprediction.net