climateprediction.net home page
Task 22250199

Task 22250199

Name oifs_43r3_ps_0808_2021050100_123_945_12163897_2
Workunit 12163897
Created 13 Dec 2022, 13:47:08 UTC
Sent 13 Dec 2022, 13:52:11 UTC
Report deadline 12 Jan 2023, 13:52:11 UTC
Received 19 Dec 2022, 11:11:17 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1535230
Run time 12 hours 34 min 47 sec
CPU time 12 hours 23 min 44 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 7.13 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,418.42 MB
Peak swap size 4,978.08 MB
Peak disk usage 2,834.09 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<stderr_txt>
7:28:42 STEP 2487 H=2487:00 +CPU= 18.570
  17:28:54 STEP 2488 H=2488:00 +CPU= 12.111
  17:29:06 STEP 2489 H=2489:00 +CPU= 11.812
  17:29:25 STEP 2490 H=2490:00 +CPU= 18.976
  17:29:37 STEP 2491 H=2491:00 +CPU= 11.790
  17:29:49 STEP 2492 H=2492:00 +CPU= 12.088
  17:30:08 STEP 2493 H=2493:00 +CPU= 18.537
  17:30:20 STEP 2494 H=2494:00 +CPU= 12.091
  17:30:32 STEP 2495 H=2495:00 +CPU= 12.199
  17:30:55 STEP 2496 H=2496:00 +CPU= 22.265
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhpi1+002496
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhpi1+002496
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhpi1+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMGGhpi1+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMSHhpi1+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMUAhpi1+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMGGhpi1+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMSHhpi1+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMUAhpi1+002484
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0808_2021050100_123_945_12163897_2_r578345748_103.zip
Uploading the intermediate file: upload_file_103.zip
  17:31:07 STEP 2497 H=2497:00 +CPU= 11.717
  17:31:19 STEP 2498 H=2498:00 +CPU= 12.171
  17:31:38 STEP 2499 H=2499:00 +CPU= 18.595
  17:31:50 STEP 2500 H=2500:00 +CPU= 12.132
  17:32:01 STEP 2501 H=2501:00 +CPU= 11.700
  17:32:21 STEP 2502 H=2502:00 +CPU= 19.017
  17:32:32 STEP 2503 H=2503:00 +CPU= 11.802
  17:32:45 STEP 2504 H=2504:00 +CPU= 12.076
  17:33:03 STEP 2505 H=2505:00 +CPU= 18.526
  17:33:15 STEP 2506 H=2506:00 +CPU= 12.165
  17:33:27 STEP 2507 H=2507:00 +CPU= 11.766
  17:33:48 STEP 2508 H=2508:00 +CPU= 20.574
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhpi1+002508
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhpi1+002508
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhpi1+002508
  17:34:00 STEP 2509 H=2509:00 +CPU= 11.854
  17:34:12 STEP 2510 H=2510:00 +CPU= 12.215
  17:34:31 STEP 2511 H=2511:00 +CPU= 18.559
  17:34:43 STEP 2512 H=2512:00 +CPU= 12.147
  17:34:55 STEP 2513 H=2513:00 +CPU= 11.742
  17:35:14 STEP 2514 H=2514:00 +CPU= 18.910
  17:35:26 STEP 2515 H=2515:00 +CPU= 11.753
  17:35:38 STEP 2516 H=2516:00 +CPU= 12.083
  17:35:56 STEP 2517 H=2517:00 +CPU= 18.562
  17:36:09 STEP 2518 H=2518:00 +CPU= 12.061
  17:36:21 STEP 2519 H=2519:00 +CPU= 12.224
  17:36:44 STEP 2520 H=2520:00 +CPU= 22.315
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhpi1+002520
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhpi1+002520
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhpi1+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMGGhpi1+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMSHhpi1+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMUAhpi1+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMGGhpi1+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMSHhpi1+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMUAhpi1+002508
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0808_2021050100_123_945_12163897_2_r578345748_104.zip
Uploading the intermediate file: upload_file_104.zip
  17:36:55 STEP 2521 H=2521:00 +CPU= 11.809
  17:37:08 STEP 2522 H=2522:00 +CPU= 12.064
  17:37:26 STEP 2523 H=2523:00 +CPU= 18.683
  17:37:39 STEP 2524 H=2524:00 +CPU= 12.451
  17:37:51 STEP 2525 H=2525:00 +CPU= 11.778
  17:38:10 STEP 2526 H=2526:00 +CPU= 18.915
  17:38:22 STEP 2527 H=2527:00 +CPU= 11.803
  17:38:34 STEP 2528 H=2528:00 +CPU= 12.128
  17:38:52 STEP 2529 H=2529:00 +CPU= 18.502
  17:39:05 STEP 2530 H=2530:00 +CPU= 12.127
  17:39:17 STEP 2531 H=2531:00 +CPU= 11.804
  17:39:37 STEP 2532 H=2532:00 +CPU= 20.724
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhpi1+002532
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhpi1+002532
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhpi1+002532
  17:39:49 STEP 2533 H=2533:00 +CPU= 11.842
  17:40:02 STEP 2534 H=2534:00 +CPU= 12.355
  17:40:20 STEP 2535 H=2535:00 +CPU= 18.580
  17:40:33 STEP 2536 H=2536:00 +CPU= 12.163
  17:40:44 STEP 2537 H=2537:00 +CPU= 11.728
  17:41:03 STEP 2538 H=2538:00 +CPU= 18.930
  17:41:15 STEP 2539 H=2539:00 +CPU= 11.745
  17:41:27 STEP 2540 H=2540:00 +CPU= 12.091
  17:41:46 STEP 2541 H=2541:00 +CPU= 18.553
  17:41:58 STEP 2542 H=2542:00 +CPU= 12.085
  17:42:10 STEP 2543 H=2543:00 +CPU= 12.141
  17:42:33 STEP 2544 H=2544:00 +CPU= 22.366
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhpi1+002544
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhpi1+002544
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhpi1+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMGGhpi1+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMSHhpi1+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMUAhpi1+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMGGhpi1+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMSHhpi1+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMUAhpi1+002532
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0808_2021050100_123_945_12163897_2_r578345748_105.zip
Uploading the intermediate file: upload_file_105.zip
  17:42:45 STEP 2545 H=2545:00 +CPU= 11.773
  17:42:57 STEP 2546 H=2546:00 +CPU= 12.084
  17:43:16 STEP 2547 H=2547:00 +CPU= 18.712
  17:43:28 STEP 2548 H=2548:00 +CPU= 12.200
  17:43:40 STEP 2549 H=2549:00 +CPU= 11.748
  17:43:59 STEP 2550 H=2550:00 +CPU= 18.986
  17:44:11 STEP 2551 H=2551:00 +CPU= 11.787
  17:44:23 STEP 2552 H=2552:00 +CPU= 12.156
  17:44:42 STEP 2553 H=2553:00 +CPU= 18.672
  17:44:54 STEP 2554 H=2554:00 +CPU= 12.159
  17:45:06 STEP 2555 H=2555:00 +CPU= 11.764
  17:45:27 STEP 2556 H=2556:00 +CPU= 20.554
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhpi1+002556
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhpi1+002556
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhpi1+002556
  17:45:39 STEP 2557 H=2557:00 +CPU= 11.794
  17:45:51 STEP 2558 H=2558:00 +CPU= 12.148
  17:46:09 STEP 2559 H=2559:00 +CPU= 18.481
  17:46:22 STEP 2560 H=2560:00 +CPU= 12.141
  17:46:34 STEP 2561 H=2561:00 +CPU= 11.890
  17:46:52 STEP 2562 H=2562:00 +CPU= 18.871
  17:47:04 STEP 2563 H=2563:00 +CPU= 11.805
  17:47:17 STEP 2564 H=2564:00 +CPU= 12.156
  17:47:35 STEP 2565 H=2565:00 +CPU= 18.566
  17:47:47 STEP 2566 H=2566:00 +CPU= 12.089
  17:48:00 STEP 2567 H=2567:00 +CPU= 12.099
  17:48:23 STEP 2568 H=2568:00 +CPU= 22.251
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhpi1+002568
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhpi1+002568
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhpi1+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMGGhpi1+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMSHhpi1+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMUAhpi1+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMGGhpi1+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMSHhpi1+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMUAhpi1+002556
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0808_2021050100_123_945_12163897_2_r578345748_106.zip
Uploading the intermediate file: upload_file_106.zip
  17:48:34 STEP 2569 H=2569:00 +CPU= 11.790
  17:48:47 STEP 2570 H=2570:00 +CPU= 12.080
  17:49:05 STEP 2571 H=2571:00 +CPU= 18.572
  17:49:18 STEP 2572 H=2572:00 +CPU= 12.179
  17:49:30 STEP 2573 H=2573:00 +CPU= 12.565
  17:49:52 STEP 2574 H=2574:00 +CPU= 20.880
  17:50:04 STEP 2575 H=2575:00 +CPU= 12.615
  17:50:17 STEP 2576 H=2576:00 +CPU= 12.759
  17:50:37 STEP 2577 H=2577:00 +CPU= 19.343
  17:50:51 STEP 2578 H=2578:00 +CPU= 13.877
  17:51:04 STEP 2579 H=2579:00 +CPU= 13.050
  17:51:26 STEP 2580 H=2580:00 +CPU= 21.915
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhpi1+002580
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhpi1+002580
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhpi1+002580
  17:51:41 STEP 2581 H=2581:00 +CPU= 14.319
  17:51:55 STEP 2582 H=2582:00 +CPU= 13.498
  17:52:16 STEP 2583 H=2583:00 +CPU= 21.015
  17:52:31 STEP 2584 H=2584:00 +CPU= 14.469
  17:52:45 STEP 2585 H=2585:00 +CPU= 13.613
  17:53:06 STEP 2586 H=2586:00 +CPU= 20.785
  17:53:19 STEP 2587 H=2587:00 +CPU= 13.031
  17:53:32 STEP 2588 H=2588:00 +CPU= 13.330
  17:53:55 STEP 2589 H=2589:00 +CPU= 21.716
  17:54:09 STEP 2590 H=2590:00 +CPU= 14.320
  17:54:23 STEP 2591 H=2591:00 +CPU= 13.911
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:55:00 STEP 2592 H=2592:00 +CPU= 25.086
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhpi1+002592
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhpi1+002592
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhpi1+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMGGhpi1+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMSHhpi1+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMUAhpi1+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMGGhpi1+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMSHhpi1+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMUAhpi1+002580
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0808_2021050100_123_945_12163897_2_r578345748_107.zip
Uploading the intermediate file: upload_file_107.zip
  17:55:14 STEP 2593 H=2593:00 +CPU= 13.965
Uploading trickle at timestep: 9331200
  17:55:29 STEP 2594 H=2594:00 +CPU= 14.430
  17:55:50 STEP 2595 H=2595:00 +CPU= 20.352
  17:56:06 STEP 2596 H=2596:00 +CPU= 16.116
  17:56:22 STEP 2597 H=2597:00 +CPU= 15.514
  17:56:46 STEP 2598 H=2598:00 +CPU= 23.667
  17:57:03 STEP 2599 H=2599:00 +CPU= 16.363
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  17:59:00 STEP 2600 H=2600:00 +CPU= 15.130
  17:59:31 STEP 2601 H=2601:00 +CPU= 29.131
  17:59:52 STEP 2602 H=2602:00 +CPU= 20.228
  18:00:12 STEP 2603 H=2603:00 +CPU= 19.773
  18:00:48 STEP 2604 H=2604:00 +CPU= 35.001
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhpi1+002604
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhpi1+002604
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhpi1+002604
  18:01:02 STEP 2605 H=2605:00 +CPU= 13.848
  18:01:17 STEP 2606 H=2606:00 +CPU= 14.014
  18:01:37 STEP 2607 H=2607:00 +CPU= 20.068
  18:01:49 STEP 2608 H=2608:00 +CPU= 12.218
  18:02:01 STEP 2609 H=2609:00 +CPU= 11.824
  18:02:20 STEP 2610 H=2610:00 +CPU= 19.157
  18:02:32 STEP 2611 H=2611:00 +CPU= 11.740
  18:02:44 STEP 2612 H=2612:00 +CPU= 12.122
  18:03:03 STEP 2613 H=2613:00 +CPU= 18.761
  18:03:16 STEP 2614 H=2614:00 +CPU= 12.369
  18:03:28 STEP 2615 H=2615:00 +CPU= 12.092
  18:03:51 STEP 2616 H=2616:00 +CPU= 22.259
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhpi1+002616
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhpi1+002616
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhpi1+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMGGhpi1+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMSHhpi1+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMUAhpi1+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMGGhpi1+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMSHhpi1+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMUAhpi1+002604
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0808_2021050100_123_945_12163897_2_r578345748_108.zip
Uploading the intermediate file: upload_file_108.zip
  18:04:02 STEP 2617 H=2617:00 +CPU= 11.708
  18:04:15 STEP 2618 H=2618:00 +CPU= 12.149
  18:04:33 STEP 2619 H=2619:00 +CPU= 18.561
  18:04:46 STEP 2620 H=2620:00 +CPU= 12.247
  18:04:58 STEP 2621 H=2621:00 +CPU= 11.904
  18:05:17 STEP 2622 H=2622:00 +CPU= 18.962
  18:05:29 STEP 2623 H=2623:00 +CPU= 11.777
  18:05:41 STEP 2624 H=2624:00 +CPU= 12.132
  18:05:59 STEP 2625 H=2625:00 +CPU= 18.596
  18:06:12 STEP 2626 H=2626:00 +CPU= 12.155
  18:06:24 STEP 2627 H=2627:00 +CPU= 11.994
  18:06:44 STEP 2628 H=2628:00 +CPU= 20.575
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhpi1+002628
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhpi1+002628
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhpi1+002628
  18:06:56 STEP 2629 H=2629:00 +CPU= 11.876
  18:07:09 STEP 2630 H=2630:00 +CPU= 12.150
  18:07:27 STEP 2631 H=2631:00 +CPU= 18.555
  18:07:40 STEP 2632 H=2632:00 +CPU= 12.254
  18:07:51 STEP 2633 H=2633:00 +CPU= 11.765
  18:08:10 STEP 2634 H=2634:00 +CPU= 18.928
  18:08:22 STEP 2635 H=2635:00 +CPU= 11.883
  18:08:35 STEP 2636 H=2636:00 +CPU= 12.146
  18:08:53 STEP 2637 H=2637:00 +CPU= 18.648
  18:09:06 STEP 2638 H=2638:00 +CPU= 12.254
  18:09:19 STEP 2639 H=2639:00 +CPU= 13.040
  18:09:43 STEP 2640 H=2640:00 +CPU= 23.168
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhpi1+002640
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhpi1+002640
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhpi1+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMGGhpi1+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMSHhpi1+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMUAhpi1+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMGGhpi1+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMSHhpi1+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMUAhpi1+002628
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0808_2021050100_123_945_12163897_2_r578345748_109.zip
Uploading the intermediate file: upload_file_109.zip
  18:09:55 STEP 2641 H=2641:00 +CPU= 12.001
  18:10:08 STEP 2642 H=2642:00 +CPU= 12.651
  18:10:27 STEP 2643 H=2643:00 +CPU= 19.305
  18:10:40 STEP 2644 H=2644:00 +CPU= 13.042
  18:10:52 STEP 2645 H=2645:00 +CPU= 12.170
  18:11:12 STEP 2646 H=2646:00 +CPU= 19.870
  18:11:25 STEP 2647 H=2647:00 +CPU= 12.569
  18:11:38 STEP 2648 H=2648:00 +CPU= 12.977
  18:11:58 STEP 2649 H=2649:00 +CPU= 19.495
  18:12:11 STEP 2650 H=2650:00 +CPU= 12.981
  18:12:24 STEP 2651 H=2651:00 +CPU= 13.151
  18:12:46 STEP 2652 H=2652:00 +CPU= 21.809
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhpi1+002652
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhpi1+002652
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhpi1+002652
  18:12:59 STEP 2653 H=2653:00 +CPU= 12.601
  18:13:12 STEP 2654 H=2654:00 +CPU= 12.616
  18:13:31 STEP 2655 H=2655:00 +CPU= 19.029
  18:13:43 STEP 2656 H=2656:00 +CPU= 12.570
  18:13:56 STEP 2657 H=2657:00 +CPU= 12.120
  18:14:15 STEP 2658 H=2658:00 +CPU= 19.658
  18:14:28 STEP 2659 H=2659:00 +CPU= 12.028
  18:14:40 STEP 2660 H=2660:00 +CPU= 12.469
  18:14:59 STEP 2661 H=2661:00 +CPU= 19.215
  18:15:12 STEP 2662 H=2662:00 +CPU= 12.321
  18:15:25 STEP 2663 H=2663:00 +CPU= 12.764
  18:15:48 STEP 2664 H=2664:00 +CPU= 22.891
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhpi1+002664
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhpi1+002664
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhpi1+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMGGhpi1+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMSHhpi1+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMUAhpi1+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMGGhpi1+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMSHhpi1+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMUAhpi1+002652
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0808_2021050100_123_945_12163897_2_r578345748_110.zip
Uploading the intermediate file: upload_file_110.zip
  18:16:00 STEP 2665 H=2665:00 +CPU= 11.979
  18:16:13 STEP 2666 H=2666:00 +CPU= 13.035
  18:16:33 STEP 2667 H=2667:00 +CPU= 19.514
  18:16:46 STEP 2668 H=2668:00 +CPU= 12.697
  18:16:58 STEP 2669 H=2669:00 +CPU= 12.382
  18:17:19 STEP 2670 H=2670:00 +CPU= 20.256
  18:17:31 STEP 2671 H=2671:00 +CPU= 12.414
  18:17:44 STEP 2672 H=2672:00 +CPU= 12.378
  18:18:03 STEP 2673 H=2673:00 +CPU= 19.573
  18:18:16 STEP 2674 H=2674:00 +CPU= 12.540
  18:18:28 STEP 2675 H=2675:00 +CPU= 12.306
  18:18:50 STEP 2676 H=2676:00 +CPU= 21.184
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhpi1+002676
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhpi1+002676
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhpi1+002676
  18:19:02 STEP 2677 H=2677:00 +CPU= 12.314
  18:19:15 STEP 2678 H=2678:00 +CPU= 12.948
  18:19:35 STEP 2679 H=2679:00 +CPU= 19.608
  18:19:48 STEP 2680 H=2680:00 +CPU= 12.688
  18:20:00 STEP 2681 H=2681:00 +CPU= 12.211
  18:20:20 STEP 2682 H=2682:00 +CPU= 19.950
  18:20:32 STEP 2683 H=2683:00 +CPU= 12.104
  18:20:45 STEP 2684 H=2684:00 +CPU= 12.418
  18:21:04 STEP 2685 H=2685:00 +CPU= 18.859
  18:21:17 STEP 2686 H=2686:00 +CPU= 13.035
  18:21:30 STEP 2687 H=2687:00 +CPU= 12.735
  18:21:53 STEP 2688 H=2688:00 +CPU= 22.894
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhpi1+002688
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhpi1+002688
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhpi1+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMGGhpi1+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMSHhpi1+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMUAhpi1+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMGGhpi1+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMSHhpi1+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMUAhpi1+002676
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0808_2021050100_123_945_12163897_2_r578345748_111.zip
Uploading the intermediate file: upload_file_111.zip
  18:22:06 STEP 2689 H=2689:00 +CPU= 12.392
  18:22:18 STEP 2690 H=2690:00 +CPU= 12.323
  18:22:38 STEP 2691 H=2691:00 +CPU= 19.965
  18:22:52 STEP 2692 H=2692:00 +CPU= 13.438
  18:23:04 STEP 2693 H=2693:00 +CPU= 12.540
  18:23:24 STEP 2694 H=2694:00 +CPU= 19.717
  18:23:37 STEP 2695 H=2695:00 +CPU= 12.693
  18:23:50 STEP 2696 H=2696:00 +CPU= 13.104
  18:24:09 STEP 2697 H=2697:00 +CPU= 18.947
  18:24:22 STEP 2698 H=2698:00 +CPU= 12.614
  18:24:34 STEP 2699 H=2699:00 +CPU= 12.280
  18:24:56 STEP 2700 H=2700:00 +CPU= 21.585
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhpi1+002700
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhpi1+002700
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhpi1+002700
  18:25:09 STEP 2701 H=2701:00 +CPU= 12.221
  18:25:22 STEP 2702 H=2702:00 +CPU= 13.078
  18:25:42 STEP 2703 H=2703:00 +CPU= 19.835
  18:25:55 STEP 2704 H=2704:00 +CPU= 12.679
  18:26:07 STEP 2705 H=2705:00 +CPU= 12.315
  18:26:27 STEP 2706 H=2706:00 +CPU= 19.645
  18:26:39 STEP 2707 H=2707:00 +CPU= 12.403
  18:26:52 STEP 2708 H=2708:00 +CPU= 12.327
  18:27:11 STEP 2709 H=2709:00 +CPU= 19.416
  18:27:24 STEP 2710 H=2710:00 +CPU= 12.434
  18:27:36 STEP 2711 H=2711:00 +CPU= 12.384
  18:28:00 STEP 2712 H=2712:00 +CPU= 23.042
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhpi1+002712
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhpi1+002712
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhpi1+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMGGhpi1+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMSHhpi1+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMUAhpi1+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMGGhpi1+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMSHhpi1+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMUAhpi1+002700
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0808_2021050100_123_945_12163897_2_r578345748_112.zip
Uploading the intermediate file: upload_file_112.zip
  18:28:12 STEP 2713 H=2713:00 +CPU= 12.142
  18:28:25 STEP 2714 H=2714:00 +CPU= 12.434
  18:28:44 STEP 2715 H=2715:00 +CPU= 19.371
  18:28:57 STEP 2716 H=2716:00 +CPU= 12.390
  18:29:09 STEP 2717 H=2717:00 +CPU= 12.176
  18:29:30 STEP 2718 H=2718:00 +CPU= 20.872
  18:29:42 STEP 2719 H=2719:00 +CPU= 12.125
  18:29:55 STEP 2720 H=2720:00 +CPU= 13.050
  18:30:14 STEP 2721 H=2721:00 +CPU= 19.138
  18:30:27 STEP 2722 H=2722:00 +CPU= 12.597
  18:30:39 STEP 2723 H=2723:00 +CPU= 12.068
  18:31:01 STEP 2724 H=2724:00 +CPU= 21.349
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhpi1+002724
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhpi1+002724
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhpi1+002724
  18:31:13 STEP 2725 H=2725:00 +CPU= 12.332
  18:31:26 STEP 2726 H=2726:00 +CPU= 12.726
  18:31:46 STEP 2727 H=2727:00 +CPU= 19.401
  18:31:59 STEP 2728 H=2728:00 +CPU= 13.200
  18:32:11 STEP 2729 H=2729:00 +CPU= 12.078
  18:32:31 STEP 2730 H=2730:00 +CPU= 19.624
  18:32:44 STEP 2731 H=2731:00 +CPU= 12.818
  18:32:56 STEP 2732 H=2732:00 +CPU= 12.442
  18:33:16 STEP 2733 H=2733:00 +CPU= 19.505
  18:33:29 STEP 2734 H=2734:00 +CPU= 12.451
  18:33:42 STEP 2735 H=2735:00 +CPU= 12.847
  18:34:05 STEP 2736 H=2736:00 +CPU= 23.339
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhpi1+002736
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhpi1+002736
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhpi1+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMGGhpi1+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMSHhpi1+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMUAhpi1+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMGGhpi1+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMSHhpi1+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMUAhpi1+002724
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0808_2021050100_123_945_12163897_2_r578345748_113.zip
Uploading the intermediate file: upload_file_113.zip
  18:34:17 STEP 2737 H=2737:00 +CPU= 11.963
  18:34:31 STEP 2738 H=2738:00 +CPU= 13.232
  18:34:50 STEP 2739 H=2739:00 +CPU= 18.955
  18:35:02 STEP 2740 H=2740:00 +CPU= 12.440
  18:35:15 STEP 2741 H=2741:00 +CPU= 12.256
  18:35:35 STEP 2742 H=2742:00 +CPU= 20.570
  18:35:48 STEP 2743 H=2743:00 +CPU= 12.415
  18:36:01 STEP 2744 H=2744:00 +CPU= 12.794
  18:36:20 STEP 2745 H=2745:00 +CPU= 19.434
  18:36:33 STEP 2746 H=2746:00 +CPU= 12.406
  18:36:45 STEP 2747 H=2747:00 +CPU= 12.289
  18:37:07 STEP 2748 H=2748:00 +CPU= 21.101
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhpi1+002748
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhpi1+002748
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhpi1+002748
  18:37:19 STEP 2749 H=2749:00 +CPU= 12.087
  18:37:31 STEP 2750 H=2750:00 +CPU= 12.622
  18:37:51 STEP 2751 H=2751:00 +CPU= 19.011
  18:38:03 STEP 2752 H=2752:00 +CPU= 12.501
  18:38:16 STEP 2753 H=2753:00 +CPU= 12.465
  18:38:35 STEP 2754 H=2754:00 +CPU= 19.337
  18:38:48 STEP 2755 H=2755:00 +CPU= 12.576
  18:39:01 STEP 2756 H=2756:00 +CPU= 12.661
  18:39:20 STEP 2757 H=2757:00 +CPU= 19.173
  18:39:33 STEP 2758 H=2758:00 +CPU= 12.695
  18:39:45 STEP 2759 H=2759:00 +CPU= 12.533
  18:40:09 STEP 2760 H=2760:00 +CPU= 22.932
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhpi1+002760
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhpi1+002760
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhpi1+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMGGhpi1+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMSHhpi1+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMUAhpi1+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMGGhpi1+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMSHhpi1+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMUAhpi1+002748
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0808_2021050100_123_945_12163897_2_r578345748_114.zip
Uploading the intermediate file: upload_file_114.zip
  18:40:21 STEP 2761 H=2761:00 +CPU= 12.315
  18:40:34 STEP 2762 H=2762:00 +CPU= 12.483
  18:40:54 STEP 2763 H=2763:00 +CPU= 19.613
  18:41:07 STEP 2764 H=2764:00 +CPU= 12.824
  18:41:19 STEP 2765 H=2765:00 +CPU= 12.188
  18:41:39 STEP 2766 H=2766:00 +CPU= 19.810
  18:41:52 STEP 2767 H=2767:00 +CPU= 13.058
  18:42:05 STEP 2768 H=2768:00 +CPU= 12.517
  18:42:24 STEP 2769 H=2769:00 +CPU= 19.773
  18:42:37 STEP 2770 H=2770:00 +CPU= 12.812
  18:42:51 STEP 2771 H=2771:00 +CPU= 13.080
  18:43:13 STEP 2772 H=2772:00 +CPU= 22.043
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhpi1+002772
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhpi1+002772
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhpi1+002772
  18:43:26 STEP 2773 H=2773:00 +CPU= 13.069
  18:43:39 STEP 2774 H=2774:00 +CPU= 12.338
  18:43:58 STEP 2775 H=2775:00 +CPU= 19.198
  18:44:11 STEP 2776 H=2776:00 +CPU= 12.690
  18:44:23 STEP 2777 H=2777:00 +CPU= 12.107
  18:44:43 STEP 2778 H=2778:00 +CPU= 20.166
  18:45:00 STEP 2779 H=2779:00 +CPU= 15.819
  18:45:15 STEP 2780 H=2780:00 +CPU= 15.115
  18:45:37 STEP 2781 H=2781:00 +CPU= 21.870
  18:45:50 STEP 2782 H=2782:00 +CPU= 13.033
  18:46:05 STEP 2783 H=2783:00 +CPU= 13.986
  18:46:29 STEP 2784 H=2784:00 +CPU= 23.945
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhpi1+002784
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhpi1+002784
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhpi1+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMGGhpi1+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMSHhpi1+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMUAhpi1+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMGGhpi1+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMSHhpi1+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMUAhpi1+002772
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0808_2021050100_123_945_12163897_2_r578345748_115.zip
Uploading the intermediate file: upload_file_115.zip
  18:46:42 STEP 2785 H=2785:00 +CPU= 12.725
  18:46:55 STEP 2786 H=2786:00 +CPU= 12.950
  18:47:15 STEP 2787 H=2787:00 +CPU= 19.787
  18:47:28 STEP 2788 H=2788:00 +CPU= 12.723
  18:47:41 STEP 2789 H=2789:00 +CPU= 12.590
  18:48:01 STEP 2790 H=2790:00 +CPU= 20.114
  18:48:14 STEP 2791 H=2791:00 +CPU= 12.481
  18:48:27 STEP 2792 H=2792:00 +CPU= 13.229
  18:48:48 STEP 2793 H=2793:00 +CPU= 20.654
  18:49:02 STEP 2794 H=2794:00 +CPU= 13.911
  18:49:16 STEP 2795 H=2795:00 +CPU= 13.281
  18:49:38 STEP 2796 H=2796:00 +CPU= 21.593
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhpi1+002796
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhpi1+002796
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhpi1+002796
  18:49:50 STEP 2797 H=2797:00 +CPU= 12.188
  18:50:04 STEP 2798 H=2798:00 +CPU= 13.392
  18:50:24 STEP 2799 H=2799:00 +CPU= 20.384
  18:50:37 STEP 2800 H=2800:00 +CPU= 13.061
  18:50:51 STEP 2801 H=2801:00 +CPU= 13.730
  18:51:12 STEP 2802 H=2802:00 +CPU= 20.716
  18:51:25 STEP 2803 H=2803:00 +CPU= 12.502
  18:51:38 STEP 2804 H=2804:00 +CPU= 12.440
  18:51:58 STEP 2805 H=2805:00 +CPU= 19.666
  18:52:11 STEP 2806 H=2806:00 +CPU= 13.288
  18:52:24 STEP 2807 H=2807:00 +CPU= 13.043
  18:52:49 STEP 2808 H=2808:00 +CPU= 23.812
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhpi1+002808
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhpi1+002808
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhpi1+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMGGhpi1+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMSHhpi1+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMUAhpi1+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMGGhpi1+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMSHhpi1+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMUAhpi1+002796
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0808_2021050100_123_945_12163897_2_r578345748_116.zip
Uploading the intermediate file: upload_file_116.zip
  18:53:01 STEP 2809 H=2809:00 +CPU= 12.619
  18:53:16 STEP 2810 H=2810:00 +CPU= 14.153
  18:53:36 STEP 2811 H=2811:00 +CPU= 19.865
  18:53:49 STEP 2812 H=2812:00 +CPU= 12.955
  18:54:03 STEP 2813 H=2813:00 +CPU= 13.753
  18:54:26 STEP 2814 H=2814:00 +CPU= 22.062
  18:54:41 STEP 2815 H=2815:00 +CPU= 14.394
  18:54:55 STEP 2816 H=2816:00 +CPU= 14.299
  18:55:17 STEP 2817 H=2817:00 +CPU= 21.705
  18:55:33 STEP 2818 H=2818:00 +CPU= 14.629
  18:55:47 STEP 2819 H=2819:00 +CPU= 13.896
  18:56:11 STEP 2820 H=2820:00 +CPU= 23.997
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhpi1+002820
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhpi1+002820
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhpi1+002820
  18:56:25 STEP 2821 H=2821:00 +CPU= 13.813
  18:56:40 STEP 2822 H=2822:00 +CPU= 14.660
  18:57:02 STEP 2823 H=2823:00 +CPU= 21.288
  18:57:17 STEP 2824 H=2824:00 +CPU= 14.652
  18:57:32 STEP 2825 H=2825:00 +CPU= 14.032
  18:57:55 STEP 2826 H=2826:00 +CPU= 22.401
  18:58:08 STEP 2827 H=2827:00 +CPU= 13.293
  18:58:23 STEP 2828 H=2828:00 +CPU= 14.383
  18:58:44 STEP 2829 H=2829:00 +CPU= 20.893
  18:58:58 STEP 2830 H=2830:00 +CPU= 13.587
  18:59:12 STEP 2831 H=2831:00 +CPU= 13.471
  18:59:37 STEP 2832 H=2832:00 +CPU= 24.240
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhpi1+002832
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhpi1+002832
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhpi1+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMGGhpi1+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMSHhpi1+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMUAhpi1+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMGGhpi1+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMSHhpi1+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMUAhpi1+002820
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0808_2021050100_123_945_12163897_2_r578345748_117.zip
Uploading the intermediate file: upload_file_117.zip
  18:59:50 STEP 2833 H=2833:00 +CPU= 12.916
  19:00:04 STEP 2834 H=2834:00 +CPU= 13.708
Uploading trickle at timestep: 10195200
  19:00:26 STEP 2835 H=2835:00 +CPU= 20.972
  19:00:40 STEP 2836 H=2836:00 +CPU= 13.752
  19:00:53 STEP 2837 H=2837:00 +CPU= 13.177
  19:01:15 STEP 2838 H=2838:00 +CPU= 21.723
  19:01:29 STEP 2839 H=2839:00 +CPU= 13.739
  19:01:44 STEP 2840 H=2840:00 +CPU= 13.800
  19:02:05 STEP 2841 H=2841:00 +CPU= 21.240
  19:02:20 STEP 2842 H=2842:00 +CPU= 14.536
  19:02:34 STEP 2843 H=2843:00 +CPU= 14.008
  19:02:59 STEP 2844 H=2844:00 +CPU= 23.722
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhpi1+002844
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhpi1+002844
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhpi1+002844
  19:03:13 STEP 2845 H=2845:00 +CPU= 13.942
  19:03:28 STEP 2846 H=2846:00 +CPU= 14.287
  19:03:50 STEP 2847 H=2847:00 +CPU= 21.559
  19:04:04 STEP 2848 H=2848:00 +CPU= 13.892
  19:04:18 STEP 2849 H=2849:00 +CPU= 14.043
  19:04:40 STEP 2850 H=2850:00 +CPU= 21.013
  19:04:53 STEP 2851 H=2851:00 +CPU= 12.763
  19:05:07 STEP 2852 H=2852:00 +CPU= 13.925
  19:05:28 STEP 2853 H=2853:00 +CPU= 20.614
  19:05:43 STEP 2854 H=2854:00 +CPU= 14.365
  19:05:56 STEP 2855 H=2855:00 +CPU= 13.432
  19:06:22 STEP 2856 H=2856:00 +CPU= 24.529
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhpi1+002856
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhpi1+002856
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhpi1+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMGGhpi1+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMSHhpi1+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMUAhpi1+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMGGhpi1+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMSHhpi1+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMUAhpi1+002844
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0808_2021050100_123_945_12163897_2_r578345748_118.zip
Uploading the intermediate file: upload_file_118.zip
  19:06:36 STEP 2857 H=2857:00 +CPU= 13.690
  19:06:51 STEP 2858 H=2858:00 +CPU= 14.366
  19:07:12 STEP 2859 H=2859:00 +CPU= 21.299
  19:07:27 STEP 2860 H=2860:00 +CPU= 13.985
  19:07:40 STEP 2861 H=2861:00 +CPU= 13.248
  19:08:03 STEP 2862 H=2862:00 +CPU= 21.935
  19:08:17 STEP 2863 H=2863:00 +CPU= 13.895
  19:08:31 STEP 2864 H=2864:00 +CPU= 13.713
  19:08:53 STEP 2865 H=2865:00 +CPU= 21.888
  19:09:08 STEP 2866 H=2866:00 +CPU= 13.979
  19:09:22 STEP 2867 H=2867:00 +CPU= 13.768
  19:09:46 STEP 2868 H=2868:00 +CPU= 23.644
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhpi1+002868
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhpi1+002868
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhpi1+002868
  19:10:00 STEP 2869 H=2869:00 +CPU= 14.035
  19:10:15 STEP 2870 H=2870:00 +CPU= 14.393
  19:10:37 STEP 2871 H=2871:00 +CPU= 21.665
  19:10:51 STEP 2872 H=2872:00 +CPU= 13.668
  19:11:05 STEP 2873 H=2873:00 +CPU= 13.952
  19:11:27 STEP 2874 H=2874:00 +CPU= 20.975
  19:11:40 STEP 2875 H=2875:00 +CPU= 13.170
  19:11:54 STEP 2876 H=2876:00 +CPU= 13.727
  19:12:16 STEP 2877 H=2877:00 +CPU= 21.174
  19:12:30 STEP 2878 H=2878:00 +CPU= 13.555
  19:12:44 STEP 2879 H=2879:00 +CPU= 14.063
  19:13:11 STEP 2880 H=2880:00 +CPU= 25.786
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhpi1+002880
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhpi1+002880
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhpi1+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMGGhpi1+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMSHhpi1+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMUAhpi1+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMGGhpi1+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMSHhpi1+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMUAhpi1+002868
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0808_2021050100_123_945_12163897_2_r578345748_119.zip
Uploading the intermediate file: upload_file_119.zip
  19:13:24 STEP 2881 H=2881:00 +CPU= 13.031
  19:13:38 STEP 2882 H=2882:00 +CPU= 13.968
  19:14:00 STEP 2883 H=2883:00 +CPU= 20.951
  19:14:14 STEP 2884 H=2884:00 +CPU= 13.620
  19:14:27 STEP 2885 H=2885:00 +CPU= 12.675
  19:14:48 STEP 2886 H=2886:00 +CPU= 20.989
  19:15:01 STEP 2887 H=2887:00 +CPU= 12.899
  19:15:15 STEP 2888 H=2888:00 +CPU= 13.246
  19:15:36 STEP 2889 H=2889:00 +CPU= 20.506
  19:15:49 STEP 2890 H=2890:00 +CPU= 13.366
  19:16:03 STEP 2891 H=2891:00 +CPU= 13.902
  19:16:27 STEP 2892 H=2892:00 +CPU= 22.934
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhpi1+002892
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhpi1+002892
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhpi1+002892
  19:16:41 STEP 2893 H=2893:00 +CPU= 13.670
  19:16:56 STEP 2894 H=2894:00 +CPU= 14.497
  19:17:17 STEP 2895 H=2895:00 +CPU= 21.147
  19:17:32 STEP 2896 H=2896:00 +CPU= 14.293
  19:17:46 STEP 2897 H=2897:00 +CPU= 13.653
  19:18:07 STEP 2898 H=2898:00 +CPU= 21.313
  19:18:22 STEP 2899 H=2899:00 +CPU= 14.271
  19:18:36 STEP 2900 H=2900:00 +CPU= 14.190
  19:18:58 STEP 2901 H=2901:00 +CPU= 21.095
  19:19:12 STEP 2902 H=2902:00 +CPU= 13.811
  19:19:26 STEP 2903 H=2903:00 +CPU= 13.769
  19:19:52 STEP 2904 H=2904:00 +CPU= 24.949
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhpi1+002904
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhpi1+002904
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhpi1+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMGGhpi1+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMSHhpi1+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMUAhpi1+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMGGhpi1+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMSHhpi1+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMUAhpi1+002892
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0808_2021050100_123_945_12163897_2_r578345748_120.zip
Uploading the intermediate file: upload_file_120.zip
  19:20:05 STEP 2905 H=2905:00 +CPU= 13.296
  19:20:19 STEP 2906 H=2906:00 +CPU= 13.557
  19:20:41 STEP 2907 H=2907:00 +CPU= 20.834
  19:20:54 STEP 2908 H=2908:00 +CPU= 13.365
  19:21:08 STEP 2909 H=2909:00 +CPU= 13.338
  19:21:29 STEP 2910 H=2910:00 +CPU= 20.946
  19:21:43 STEP 2911 H=2911:00 +CPU= 13.578
Suspend request received from the BOINC client, suspending the child process
[EC_DRHOOK:aspire:1:1:3231:3231] [20221215:002625:1671060385:46727.603] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1538] Received signal#15 (SIGTERM) :: 4749MB (heap), 4419MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:aspire:1:1:3231:3231] [20221215:002625:1671060385:46727.604] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:aspire:1:1:3231:3231] [20221215:002625:1671060385:46727.604] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x81f3c0 (old at (nil))
[EC_DRHOOK:aspire:1:1:3231:3231] [20221215:002625:1671060385:46727.604] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1617] Signal#15 was caused by unrecognized si_code [memaddr=0x1], nsigs = 1
[EC_DRHOOK:aspire:1:1:3231:3231] [20221215:002626:1671060386:46727.609] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#15, nsigs = 1
[EC_DRHOOK:aspire:1:1:3231:3231] [20221215:002626:1671060386:46727.609] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3843] 4749 MB (maxheap), 4419 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:aspire:1:1:3231:3231] [20221215:002626:1671060386:46727.631] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :  MASTER 
[EC_DRHOOK:aspire:1:1:3231:3231] [20221215:002626:1671060386:46727.632] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :   CNT0 
[EC_DRHOOK:aspire:1:1:3231:3231] [20221215:002626:1671060386:46727.632] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :    CNT1 
[EC_DRHOOK:aspire:1:1:3231:3231] [20221215:002626:1671060386:46727.632] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :     CNT2 
[EC_DRHOOK:aspire:1:1:3231:3231] [20221215:002626:1671060386:46727.633] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :      CNT3 
[EC_DRHOOK:aspire:1:1:3231:3231] [20221215:002626:1671060386:46727.633] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :       CNT4 
[EC_DRHOOK:aspire:1:1:3231:3231] [20221215:002626:1671060386:46727.633] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :        STEPO 
[EC_DRHOOK:aspire:1:1:3231:3231] [20221215:002626:1671060386:46727.634] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :         SCAN2M 
[EC_DRHOOK:aspire:1:1:3231:3231] [20221215:002626:1671060386:46727.634] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :          GP_MODEL_HEAP 
[EC_DRHOOK:aspire:1:1:3231:3231] [20221215:002626:1671060386:46727.634] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :           GP_MODEL 
[EC_DRHOOK:aspire:1:1:3231:3231] [20221215:002626:1671060386:46727.634] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :            CALL_SL_HEAP 
[EC_DRHOOK:aspire:1:1:3231:3231] [20221215:002626:1671060386:46727.634] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :             CALL_SL 
[EC_DRHOOK:aspire:1:1:3231:3231] [20221215:002626:1671060386:46727.634] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :              >OMP-CALL_SL     1        (1004) 
[EC_DRHOOK:aspire:1:1:3231:3231] [20221215:002626:1671060386:46727.634] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :               LAPINEA 
[EC_DRHOOK:aspire:1:1:3231:3231] [20221215:002626:1671060386:46727.634] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :                LARMES 
[EC_DRHOOK:aspire:1:1:3231:3231] [20221215:002626:1671060386:46727.634] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :                 LARCINA 
[EC_DRHOOK:aspire:1:1:3231:3231] [20221215:002626:1671060386:46727.634] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :                  LAITLI 
[EC_DRHOOK:aspire:1:1:3231:3231] [20221215:002627:1671060387:46728.634] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#15, nsigs = 1
[EC_DRHOOK:aspire:1:1:3231:3231] [20221215:002627:1671060387:46728.634] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1ce8bb0 for signal#15, nsigs = 1
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
oifs_43r3_model.e  0000000001CE916B  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000081FFF1  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DC9090  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000000C1A968  laitli_                   155  laitli.F90
oifs_43r3_model.e  0000000000DEE544  larcina_                  405  larcina.F90
oifs_43r3_model.e  0000000000DEABF8  larmes_                   603  larmes.F90
oifs_43r3_model.e  0000000000DE50FD  lapinea_                  270  lapinea.F90
oifs_43r3_model.e  0000000000D7A4EC  call_sl_                  300  call_sl.F90
oifs_43r3_model.e  0000000000D784FD  call_sl_heap_              94  call_sl_heap.F90
oifs_43r3_model.e  0000000000BF9958  gp_model_                 533  gp_model.F90
oifs_43r3_model.e  00000000012E9482  gp_model_heap_             74  gp_model_heap.F90
oifs_43r3_model.e  0000000000BBC1CE  scan2m_                   535  scan2m.F90
oifs_43r3_model.e  000000000057A664  stepo_                    327  stepo.F90
oifs_43r3_model.e  000000000055DEEC  cnt4_                    1133  cnt4.F90
oifs_43r3_model.e  00000000005471C9  cnt3_                     267  cnt3.F90
oifs_43r3_model.e  0000000000546412  cnt2_                      88  cnt2.F90
oifs_43r3_model.e  0000000000545E28  cnt1_                      92  cnt1.F90
oifs_43r3_model.e  000000000040708D  cnt0_                     146  cnt0.F90
oifs_43r3_model.e  000000000040220F  MAIN__                     96  master.F90
oifs_43r3_model.e  00000000004021A2  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCA390  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000040206E  Unknown               Unknown  Unknown
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2021050100
(argv2) exptid: hpi1
(argv3) unique_member_id: 0808
(argv4) batchid: 945
(argv5) wuid: 12163897
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/0
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_c20a82cc7c843c27529f9d774fed5f61 to: /var/lib/boinc-client/slots/0/oifs_43r3_ps_0808_2021050100_123_945_12163897.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/0/oifs_43r3_ps_0808_2021050100_123_945_12163897.zip
ic_ancil_file: ic_ancil_12163897
ifsdata_file: ifsdata_12163897
climate_data_file: clim_data_12163897
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_c6a0ba35d8ae20c7efbb652e531abd8c to: /var/lib/boinc-client/slots/0/ic_ancil_12163897.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/0/ic_ancil_12163897.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_c4458898b8b51508919e4e922978e3d1 to: /var/lib/boinc-client/slots/0/ifsdata/ifsdata_12163897.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/0/ifsdata/ifsdata_12163897.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/0/159l_2/clim_data_12163897.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/0/159l_2/clim_data_12163897.zip
Checking for progress XML file: /var/lib/boinc-client/slots/0/progress_file_12163897.xml
Opened progress file ok : /var/lib/boinc-client/slots/0/progress_file_12163897.xml
-- Model is restarting --
Adjusting last_iter, 2911, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/0/progress_file_12163897.xml
last_cpu_time: 43923
upload_file_number: 121
last_iter: 2903
last_upload: 10454400
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0808_2021050100_123_945_12163897_2_r578345748
The child process has been launched with process id: 12503
Executing the command: /var/lib/boinc-client/slots/0/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:aspire:1:1:12503:12503] [20221219:105518:1671443718:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:aspire:1:1:12503:12503] [20221219:105518:1671443718:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:aspire:1:1:12503:12503] [20221219:105518:1671443718:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:aspire:1:1:12503:12503] [20221219:105518:1671443718:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:aspire:1:1:12503:12503] [20221219:105518:1671443718:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:aspire:1:1:12503:12503] [20221219:105518:1671443718:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:aspire:1:1:12503:12503] [20221219:105518:1671443718:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:aspire:1:1:12503:12503] [20221219:105518:1671443718:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:aspire:1:1:12503:12503] [20221219:105518:1671443718:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:aspire:1:1:12503:12503] [20221219:105518:1671443718:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:aspire:1:1:12503:12503] [20221219:105518:1671443718:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:aspire:1:1:12503:12503] [20221219:105518:1671443718:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:aspire:1:1:12503:12503] [20221219:105518:1671443718:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:aspire:1:1:12503:12503] [20221219:105518:1671443718:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:aspire:1:1:12503:12503] [20221219:105518:1671443718:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:aspire:1:1:12503:12503] [20221219:105518:1671443718:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:aspire:1:1:12503:12503] [20221219:105518:1671443718:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:aspire:1:1:12503:12503] [20221219:105518:1671443718:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:aspire:1:1:12503:12503] [20221219:105518:1671443718:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:aspire:1:1:12503:12503] [20221219:105518:1671443718:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:aspire:1:1:12503:12503] [20221219:105518:1671443718:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:aspire:1:1:12503:12503] [20221219:105518:1671443718:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:aspire:1:1:12503:12503] [20221219:105518:1671443718:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:aspire:1:1:12503:12503] [20221219:105518:1671443718:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:aspire:1:1:12503:12503] [20221219:105518:1671443718:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:aspire:1:1:12503:12503] [20221219:105518:1671443718:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:aspire:1:1:12503:12503] [20221219:105518:1671443718:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:aspire:1:1:12503:12503] [20221219:105518:1671443718:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:aspire:1:1:12503:12503] [20221219:105518:1671443718:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:aspire:1:1:12503:12503] [20221219:105518:1671443718:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  10:55:43 STEP 2904 H=2904:00 +CPU= 20.690
  10:55:55 STEP 2905 H=2905:00 +CPU= 11.562
  10:56:07 STEP 2906 H=2906:00 +CPU= 11.853
  10:56:25 STEP 2907 H=2907:00 +CPU= 18.205
  10:56:37 STEP 2908 H=2908:00 +CPU= 11.839
  10:56:49 STEP 2909 H=2909:00 +CPU= 11.474
  10:57:07 STEP 2910 H=2910:00 +CPU= 18.653
  10:57:19 STEP 2911 H=2911:00 +CPU= 11.482
  10:57:31 STEP 2912 H=2912:00 +CPU= 11.926
  10:57:49 STEP 2913 H=2913:00 +CPU= 18.239
  10:58:01 STEP 2914 H=2914:00 +CPU= 11.891
  10:58:13 STEP 2915 H=2915:00 +CPU= 11.490
  10:58:33 STEP 2916 H=2916:00 +CPU= 20.158
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhpi1+002916
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhpi1+002916
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhpi1+002916
  10:58:44 STEP 2917 H=2917:00 +CPU= 11.526
  10:58:56 STEP 2918 H=2918:00 +CPU= 11.908
  10:59:15 STEP 2919 H=2919:00 +CPU= 18.231
  10:59:26 STEP 2920 H=2920:00 +CPU= 11.859
  10:59:38 STEP 2921 H=2921:00 +CPU= 11.538
  10:59:57 STEP 2922 H=2922:00 +CPU= 18.625
  11:00:08 STEP 2923 H=2923:00 +CPU= 11.544
  11:00:20 STEP 2924 H=2924:00 +CPU= 11.831
  11:00:38 STEP 2925 H=2925:00 +CPU= 18.240
  11:00:50 STEP 2926 H=2926:00 +CPU= 11.833
  11:01:02 STEP 2927 H=2927:00 +CPU= 11.910
  11:01:25 STEP 2928 H=2928:00 +CPU= 21.760
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhpi1+002928
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhpi1+002928
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhpi1+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMGGhpi1+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMSHhpi1+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMUAhpi1+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMGGhpi1+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMSHhpi1+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMUAhpi1+002916
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0808_2021050100_123_945_12163897_2_r578345748_121.zip
Uploading the intermediate file: upload_file_121.zip
  11:01:36 STEP 2929 H=2929:00 +CPU= 11.557
  11:01:48 STEP 2930 H=2930:00 +CPU= 11.824
  11:02:06 STEP 2931 H=2931:00 +CPU= 18.382
  11:02:18 STEP 2932 H=2932:00 +CPU= 11.825
  11:02:30 STEP 2933 H=2933:00 +CPU= 11.587
  11:02:49 STEP 2934 H=2934:00 +CPU= 18.616
  11:03:00 STEP 2935 H=2935:00 +CPU= 11.590
  11:03:12 STEP 2936 H=2936:00 +CPU= 11.863
  11:03:30 STEP 2937 H=2937:00 +CPU= 18.221
  11:03:42 STEP 2938 H=2938:00 +CPU= 11.886
  11:03:54 STEP 2939 H=2939:00 +CPU= 11.542
  11:04:14 STEP 2940 H=2940:00 +CPU= 20.218
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhpi1+002940
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhpi1+002940
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhpi1+002940
  11:04:26 STEP 2941 H=2941:00 +CPU= 11.495
  11:04:38 STEP 2942 H=2942:00 +CPU= 11.937
  11:04:56 STEP 2943 H=2943:00 +CPU= 18.216
  11:05:08 STEP 2944 H=2944:00 +CPU= 11.918
  11:05:20 STEP 2945 H=2945:00 +CPU= 11.481
  11:05:38 STEP 2946 H=2946:00 +CPU= 18.679
  11:05:50 STEP 2947 H=2947:00 +CPU= 11.514
  11:06:02 STEP 2948 H=2948:00 +CPU= 11.899
  11:06:20 STEP 2949 H=2949:00 +CPU= 18.185
  11:06:32 STEP 2950 H=2950:00 +CPU= 11.873
  11:06:44 STEP 2951 H=2951:00 +CPU= 11.905
  11:07:05 STEP 2952 H=2952:00 +CPU= 21.135
The child process terminated with status: 0
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhpi1+002952
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhpi1+002952
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhpi1+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMUAhpi1+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMUAhpi1+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMGGhpi1+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMSHhpi1+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMGGhpi1+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMSHhpi1+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMUAhpi1+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMGGhpi1+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163897/ICMSHhpi1+002940
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0808_2021050100_123_945_12163897_2_r578345748_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
11:10:28 (12498): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 15:44:41 1535230 22250199 oifs_43r3_ps_0808_2021050100_123_945_12163897_2 10,623,600 44,624 0.0042
09 May 2023 15:42:50 1535230 22250199 oifs_43r3_ps_0808_2021050100_123_945_12163897_2 10,195,200 42,638 0.0042
09 May 2023 15:42:49 1535230 22250199 oifs_43r3_ps_0808_2021050100_123_945_12163897_2 9,331,200 38,901 0.0042
09 May 2023 15:42:48 1535230 22250199 oifs_43r3_ps_0808_2021050100_123_945_12163897_2 8,467,200 35,404 0.0042
09 May 2023 15:42:47 1535230 22250199 oifs_43r3_ps_0808_2021050100_123_945_12163897_2 7,603,200 31,926 0.0042
09 May 2023 15:42:46 1535230 22250199 oifs_43r3_ps_0808_2021050100_123_945_12163897_2 6,739,200 28,458 0.0042
09 May 2023 15:42:45 1535230 22250199 oifs_43r3_ps_0808_2021050100_123_945_12163897_2 5,875,200 24,982 0.0043
09 May 2023 15:42:12 1535230 22250199 oifs_43r3_ps_0808_2021050100_123_945_12163897_2 4,320,000 18,403 0.0043
09 May 2023 15:42:09 1535230 22250199 oifs_43r3_ps_0808_2021050100_123_945_12163897_2 3,456,000 14,788 0.0043
09 May 2023 15:42:05 1535230 22250199 oifs_43r3_ps_0808_2021050100_123_945_12163897_2 2,592,000 11,147 0.0043
09 May 2023 15:41:59 1535230 22250199 oifs_43r3_ps_0808_2021050100_123_945_12163897_2 1,728,000 7,518 0.0044
09 May 2023 15:41:56 1535230 22250199 oifs_43r3_ps_0808_2021050100_123_945_12163897_2 864,000 3,595 0.0042


©2024 climateprediction.net