climateprediction.net home page
Task 22303988

Task 22303988

Name oifs_43r3_ps_0595_1999050100_123_968_12185239_1
Workunit 12185239
Created 26 Jan 2023, 18:14:24 UTC
Sent 26 Jan 2023, 18:14:57 UTC
Report deadline 27 Mar 2023, 18:14:57 UTC
Received 29 Jan 2023, 7:15:45 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1524863
Run time 9 hours 36 min 3 sec
CPU time 9 hours 28 min 21 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 9.39 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,779.62 MB
Peak swap size 4,978.07 MB
Peak disk usage 2,018.80 MB
Stderr
<core_client_version>7.16.16</core_client_version>
<![CDATA[
<stderr_txt>
532
  00:12:29 STEP 2533 H=2533:00 +CPU=  9.426
  00:12:39 STEP 2534 H=2534:00 +CPU=  9.583
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:13:38 STEP 2535 H=2535:00 +CPU= 16.726
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:14:19 STEP 2536 H=2536:00 +CPU= 10.272
  00:14:30 STEP 2537 H=2537:00 +CPU= 10.243
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:15:18 STEP 2538 H=2538:00 +CPU= 17.130
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:16:00 STEP 2539 H=2539:00 +CPU= 10.615
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:16:53 STEP 2540 H=2540:00 +CPU= 10.523
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:18:21 STEP 2541 H=2541:00 +CPU= 16.500
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:19:14 STEP 2542 H=2542:00 +CPU= 11.041
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:20:38 STEP 2543 H=2543:00 +CPU= 10.941
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:21:28 STEP 2544 H=2544:00 +CPU= 18.855
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMGGhq0f+002544
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMSHhq0f+002544
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMUAhq0f+002544
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMGGhq0f+002520
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMSHhq0f+002520
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMUAhq0f+002520
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMGGhq0f+002532
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMSHhq0f+002532
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMUAhq0f+002532
Zipping up the intermediate file: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_0595_1999050100_123_968_12185239_1_r1345310331_105.zip
Uploading the intermediate file: upload_file_105.zip
  00:21:37 STEP 2545 H=2545:00 +CPU=  9.641
  00:21:47 STEP 2546 H=2546:00 +CPU=  9.209
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:22:15 STEP 2547 H=2547:00 +CPU= 15.250
  00:22:25 STEP 2548 H=2548:00 +CPU= 10.060
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:23:57 STEP 2549 H=2549:00 +CPU=  9.991
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:24:55 STEP 2550 H=2550:00 +CPU= 16.806
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:25:47 STEP 2551 H=2551:00 +CPU= 10.744
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:27:19 STEP 2552 H=2552:00 +CPU=  9.852
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:28:06 STEP 2553 H=2553:00 +CPU= 15.804
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:28:57 STEP 2554 H=2554:00 +CPU= 10.295
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:30:20 STEP 2555 H=2555:00 +CPU=  9.891
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:31:19 STEP 2556 H=2556:00 +CPU= 18.344
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMGGhq0f+002556
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMSHhq0f+002556
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMUAhq0f+002556
  00:32:01 STEP 2557 H=2557:00 +CPU= 10.092
  00:32:11 STEP 2558 H=2558:00 +CPU= 10.264
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:32:58 STEP 2559 H=2559:00 +CPU= 15.820
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:34:21 STEP 2560 H=2560:00 +CPU= 10.466
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:35:02 STEP 2561 H=2561:00 +CPU=  9.602
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:35:59 STEP 2562 H=2562:00 +CPU= 16.020
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:37:22 STEP 2563 H=2563:00 +CPU=  9.800
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:38:03 STEP 2564 H=2564:00 +CPU=  9.839
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:39:00 STEP 2565 H=2565:00 +CPU= 15.689
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:39:51 STEP 2566 H=2566:00 +CPU= 10.013
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:41:04 STEP 2567 H=2567:00 +CPU=  9.862
  00:41:21 STEP 2568 H=2568:00 +CPU= 17.491
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMGGhq0f+002568
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMSHhq0f+002568
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMUAhq0f+002568
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMGGhq0f+002544
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMSHhq0f+002544
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMUAhq0f+002544
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMGGhq0f+002556
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMSHhq0f+002556
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMUAhq0f+002556
Zipping up the intermediate file: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_0595_1999050100_123_968_12185239_1_r1345310331_106.zip
Uploading the intermediate file: upload_file_106.zip
  00:41:30 STEP 2569 H=2569:00 +CPU=  8.953
  00:41:39 STEP 2570 H=2570:00 +CPU=  9.343
  00:41:54 STEP 2571 H=2571:00 +CPU= 14.701
  00:42:03 STEP 2572 H=2572:00 +CPU=  9.084
  00:42:12 STEP 2573 H=2573:00 +CPU=  9.015
  00:42:27 STEP 2574 H=2574:00 +CPU= 14.727
  00:42:36 STEP 2575 H=2575:00 +CPU=  8.950
  00:42:45 STEP 2576 H=2576:00 +CPU=  9.313
  00:43:00 STEP 2577 H=2577:00 +CPU= 14.536
  00:43:09 STEP 2578 H=2578:00 +CPU=  9.157
  00:43:18 STEP 2579 H=2579:00 +CPU=  9.115
  00:43:34 STEP 2580 H=2580:00 +CPU= 16.295
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMGGhq0f+002580
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMSHhq0f+002580
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMUAhq0f+002580
  00:43:43 STEP 2581 H=2581:00 +CPU=  8.969
  00:43:53 STEP 2582 H=2582:00 +CPU=  9.303
  00:44:07 STEP 2583 H=2583:00 +CPU= 14.608
  00:44:17 STEP 2584 H=2584:00 +CPU=  9.154
  00:44:25 STEP 2585 H=2585:00 +CPU=  8.976
  00:44:40 STEP 2586 H=2586:00 +CPU= 14.802
  00:44:49 STEP 2587 H=2587:00 +CPU=  8.937
  00:44:58 STEP 2588 H=2588:00 +CPU=  9.147
  00:45:13 STEP 2589 H=2589:00 +CPU= 14.413
  00:45:22 STEP 2590 H=2590:00 +CPU=  9.050
  00:45:31 STEP 2591 H=2591:00 +CPU=  9.249
  00:45:48 STEP 2592 H=2592:00 +CPU= 17.113
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMGGhq0f+002592
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMSHhq0f+002592
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMUAhq0f+002592
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMGGhq0f+002568
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMSHhq0f+002568
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMUAhq0f+002568
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMGGhq0f+002580
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMSHhq0f+002580
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMUAhq0f+002580
Zipping up the intermediate file: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_0595_1999050100_123_968_12185239_1_r1345310331_107.zip
Uploading the intermediate file: upload_file_107.zip
  00:45:57 STEP 2593 H=2593:00 +CPU=  8.907
  00:46:07 STEP 2594 H=2594:00 +CPU=  9.357
  00:46:21 STEP 2595 H=2595:00 +CPU= 14.717
  00:46:30 STEP 2596 H=2596:00 +CPU=  9.050
  00:46:39 STEP 2597 H=2597:00 +CPU=  9.060
  00:46:54 STEP 2598 H=2598:00 +CPU= 15.001
  00:47:03 STEP 2599 H=2599:00 +CPU=  8.917
  00:47:13 STEP 2600 H=2600:00 +CPU=  9.407
  00:47:27 STEP 2601 H=2601:00 +CPU= 14.635
  00:47:37 STEP 2602 H=2602:00 +CPU=  9.251
  00:47:46 STEP 2603 H=2603:00 +CPU=  9.053
  00:48:02 STEP 2604 H=2604:00 +CPU= 16.288
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMGGhq0f+002604
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMSHhq0f+002604
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMUAhq0f+002604
  00:48:11 STEP 2605 H=2605:00 +CPU=  9.128
  00:48:21 STEP 2606 H=2606:00 +CPU=  9.315
  00:48:35 STEP 2607 H=2607:00 +CPU= 14.607
  00:48:44 STEP 2608 H=2608:00 +CPU=  9.095
  00:48:53 STEP 2609 H=2609:00 +CPU=  9.008
  00:49:08 STEP 2610 H=2610:00 +CPU= 14.740
  00:49:17 STEP 2611 H=2611:00 +CPU=  9.029
  00:49:26 STEP 2612 H=2612:00 +CPU=  9.271
  00:49:41 STEP 2613 H=2613:00 +CPU= 14.459
  00:49:50 STEP 2614 H=2614:00 +CPU=  9.099
  00:49:59 STEP 2615 H=2615:00 +CPU=  9.266
  00:50:16 STEP 2616 H=2616:00 +CPU= 17.028
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMGGhq0f+002616
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMSHhq0f+002616
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMUAhq0f+002616
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMGGhq0f+002592
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMSHhq0f+002592
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMUAhq0f+002592
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMGGhq0f+002604
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMSHhq0f+002604
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMUAhq0f+002604
Zipping up the intermediate file: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_0595_1999050100_123_968_12185239_1_r1345310331_108.zip
Uploading the intermediate file: upload_file_108.zip
  00:50:25 STEP 2617 H=2617:00 +CPU=  9.020
  00:50:35 STEP 2618 H=2618:00 +CPU=  9.337
  00:50:49 STEP 2619 H=2619:00 +CPU= 14.499
  00:50:58 STEP 2620 H=2620:00 +CPU=  9.040
  00:51:07 STEP 2621 H=2621:00 +CPU=  9.195
  00:51:22 STEP 2622 H=2622:00 +CPU= 14.982
  00:51:31 STEP 2623 H=2623:00 +CPU=  9.045
  00:51:41 STEP 2624 H=2624:00 +CPU=  9.322
  00:51:55 STEP 2625 H=2625:00 +CPU= 14.519
  00:52:05 STEP 2626 H=2626:00 +CPU=  9.206
  00:52:14 STEP 2627 H=2627:00 +CPU=  9.122
  00:52:30 STEP 2628 H=2628:00 +CPU= 16.419
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMGGhq0f+002628
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMSHhq0f+002628
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMUAhq0f+002628
  00:52:39 STEP 2629 H=2629:00 +CPU=  9.200
  00:52:49 STEP 2630 H=2630:00 +CPU=  9.470
  00:53:04 STEP 2631 H=2631:00 +CPU= 14.976
  00:53:13 STEP 2632 H=2632:00 +CPU=  9.272
  00:53:22 STEP 2633 H=2633:00 +CPU=  9.188
  00:53:37 STEP 2634 H=2634:00 +CPU= 14.955
  00:53:46 STEP 2635 H=2635:00 +CPU=  8.866
  00:53:56 STEP 2636 H=2636:00 +CPU=  9.395
  00:54:10 STEP 2637 H=2637:00 +CPU= 14.663
  00:54:20 STEP 2638 H=2638:00 +CPU=  9.142
  00:54:29 STEP 2639 H=2639:00 +CPU=  9.344
  00:54:47 STEP 2640 H=2640:00 +CPU= 17.728
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMGGhq0f+002640
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMSHhq0f+002640
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMUAhq0f+002640
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMGGhq0f+002616
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMSHhq0f+002616
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMUAhq0f+002616
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMGGhq0f+002628
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMSHhq0f+002628
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMUAhq0f+002628
Zipping up the intermediate file: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_0595_1999050100_123_968_12185239_1_r1345310331_109.zip
Uploading the intermediate file: upload_file_109.zip
  00:54:56 STEP 2641 H=2641:00 +CPU=  9.114
  00:55:06 STEP 2642 H=2642:00 +CPU=  9.701
Uploading trickle at timestep: 9504000
  00:55:21 STEP 2643 H=2643:00 +CPU= 15.194
  00:55:30 STEP 2644 H=2644:00 +CPU=  9.415
  00:55:39 STEP 2645 H=2645:00 +CPU=  9.197
  00:55:55 STEP 2646 H=2646:00 +CPU= 15.070
  00:56:04 STEP 2647 H=2647:00 +CPU=  9.000
  00:56:13 STEP 2648 H=2648:00 +CPU=  9.398
  00:56:28 STEP 2649 H=2649:00 +CPU= 14.799
  00:56:37 STEP 2650 H=2650:00 +CPU=  9.566
  00:56:47 STEP 2651 H=2651:00 +CPU=  9.409
  00:57:03 STEP 2652 H=2652:00 +CPU= 16.357
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMGGhq0f+002652
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMSHhq0f+002652
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMUAhq0f+002652
  00:57:12 STEP 2653 H=2653:00 +CPU=  9.122
  00:57:22 STEP 2654 H=2654:00 +CPU=  9.806
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:58:11 STEP 2655 H=2655:00 +CPU= 16.282
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:58:42 STEP 2656 H=2656:00 +CPU= 10.219
  00:58:52 STEP 2657 H=2657:00 +CPU= 10.147
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:59:40 STEP 2658 H=2658:00 +CPU= 15.913
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:00:01 STEP 2659 H=2659:00 +CPU=  9.763
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:00:23 STEP 2660 H=2660:00 +CPU= 10.572
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:11:36 STEP 2661 H=2661:00 +CPU= 15.030
  01:11:46 STEP 2662 H=2662:00 +CPU=  9.362
  01:11:55 STEP 2663 H=2663:00 +CPU=  9.242
  01:12:12 STEP 2664 H=2664:00 +CPU= 17.389
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMGGhq0f+002664
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMSHhq0f+002664
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMUAhq0f+002664
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMGGhq0f+002640
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMSHhq0f+002640
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMUAhq0f+002640
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMGGhq0f+002652
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMSHhq0f+002652
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMUAhq0f+002652
Zipping up the intermediate file: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_0595_1999050100_123_968_12185239_1_r1345310331_110.zip
Uploading the intermediate file: upload_file_110.zip
  01:12:21 STEP 2665 H=2665:00 +CPU=  9.171
  01:12:31 STEP 2666 H=2666:00 +CPU=  9.203
  01:12:45 STEP 2667 H=2667:00 +CPU= 14.698
  01:12:55 STEP 2668 H=2668:00 +CPU=  9.371
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:14:10 STEP 2669 H=2669:00 +CPU=  8.990
  01:14:25 STEP 2670 H=2670:00 +CPU= 14.995
  01:14:34 STEP 2671 H=2671:00 +CPU=  9.218
  01:14:43 STEP 2672 H=2672:00 +CPU=  9.346
  01:14:58 STEP 2673 H=2673:00 +CPU= 14.713
  01:15:08 STEP 2674 H=2674:00 +CPU=  9.783
  01:15:18 STEP 2675 H=2675:00 +CPU=  9.451
  01:15:34 STEP 2676 H=2676:00 +CPU= 16.809
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMGGhq0f+002676
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMSHhq0f+002676
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMUAhq0f+002676
  01:15:44 STEP 2677 H=2677:00 +CPU=  9.358
  01:15:53 STEP 2678 H=2678:00 +CPU=  9.426
  01:16:08 STEP 2679 H=2679:00 +CPU= 14.927
  01:16:18 STEP 2680 H=2680:00 +CPU=  9.645
  01:16:27 STEP 2681 H=2681:00 +CPU=  9.130
  01:16:43 STEP 2682 H=2682:00 +CPU= 15.601
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:33:03 STEP 2683 H=2683:00 +CPU=  9.359
  01:33:12 STEP 2684 H=2684:00 +CPU=  9.511
  01:33:27 STEP 2685 H=2685:00 +CPU= 14.610
  01:33:36 STEP 2686 H=2686:00 +CPU=  9.479
  01:33:46 STEP 2687 H=2687:00 +CPU=  9.444
  01:34:03 STEP 2688 H=2688:00 +CPU= 17.414
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMGGhq0f+002688
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMSHhq0f+002688
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMUAhq0f+002688
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMGGhq0f+002664
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMSHhq0f+002664
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMUAhq0f+002664
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMGGhq0f+002676
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMSHhq0f+002676
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMUAhq0f+002676
Zipping up the intermediate file: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_0595_1999050100_123_968_12185239_1_r1345310331_111.zip
Uploading the intermediate file: upload_file_111.zip
  01:34:12 STEP 2689 H=2689:00 +CPU=  9.005
  01:34:22 STEP 2690 H=2690:00 +CPU=  9.304
  01:34:36 STEP 2691 H=2691:00 +CPU= 14.705
  01:34:46 STEP 2692 H=2692:00 +CPU=  9.663
  01:34:55 STEP 2693 H=2693:00 +CPU=  9.096
  01:35:11 STEP 2694 H=2694:00 +CPU= 15.358
  01:35:20 STEP 2695 H=2695:00 +CPU=  9.442
  01:35:30 STEP 2696 H=2696:00 +CPU=  9.340
  01:35:44 STEP 2697 H=2697:00 +CPU= 14.705
  01:35:54 STEP 2698 H=2698:00 +CPU=  9.683
  01:36:03 STEP 2699 H=2699:00 +CPU=  9.310
  01:36:20 STEP 2700 H=2700:00 +CPU= 16.258
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMGGhq0f+002700
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMSHhq0f+002700
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMUAhq0f+002700
  01:36:29 STEP 2701 H=2701:00 +CPU=  9.195
  01:36:38 STEP 2702 H=2702:00 +CPU=  9.281
  01:36:53 STEP 2703 H=2703:00 +CPU= 14.893
  01:37:03 STEP 2704 H=2704:00 +CPU=  9.586
  01:37:12 STEP 2705 H=2705:00 +CPU=  9.204
  01:37:27 STEP 2706 H=2706:00 +CPU= 15.262
  01:37:37 STEP 2707 H=2707:00 +CPU=  9.414
  01:37:46 STEP 2708 H=2708:00 +CPU=  9.522
  01:38:01 STEP 2709 H=2709:00 +CPU= 14.803
[EC_DRHOOK:tyz-computer:1:1:949066:949066] [20230129:013804:1674927484:40091.434] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1538] Received signal#15 (SIGTERM) :: 3992MB (heap), 4785MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:tyz-computer:1:1:949066:949066] [20230129:013804:1674927484:40091.436] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:tyz-computer:1:1:949066:949066] [20230129:013804:1674927484:40091.436] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x81f3c0 (old at (nil))
[EC_DRHOOK:tyz-computer:1:1:949066:949066] [20230129:013804:1674927484:40091.436] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1617] Signal#15 was caused by unrecognized si_code [memaddr=0x1], nsigs = 1
[EC_DRHOOK:tyz-computer:1:1:949066:949066] [20230129:013804:1674927484:40091.436] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#15, nsigs = 1
[EC_DRHOOK:tyz-computer:1:1:949066:949066] [20230129:013804:1674927484:40091.436] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3843] 3992 MB (maxheap), 4785 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:tyz-computer:1:1:949066:949066] [20230129:013804:1674927484:40091.436] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :  MASTER 
[EC_DRHOOK:tyz-computer:1:1:949066:949066] [20230129:013804:1674927484:40091.436] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :   CNT0 
[EC_DRHOOK:tyz-computer:1:1:949066:949066] [20230129:013804:1674927484:40091.436] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :    CNT1 
[EC_DRHOOK:tyz-computer:1:1:949066:949066] [20230129:013804:1674927484:40091.436] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :     CNT2 
[EC_DRHOOK:tyz-computer:1:1:949066:949066] [20230129:013804:1674927484:40091.436] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :      CNT3 
[EC_DRHOOK:tyz-computer:1:1:949066:949066] [20230129:013804:1674927484:40091.436] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :       CNT4 
[EC_DRHOOK:tyz-computer:1:1:949066:949066] [20230129:013804:1674927484:40091.436] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :        STEPO 
[EC_DRHOOK:tyz-computer:1:1:949066:949066] [20230129:013804:1674927484:40091.436] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :         SCAN2M 
[EC_DRHOOK:tyz-computer:1:1:949066:949066] [20230129:013804:1674927484:40091.436] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :          GP_MODEL_HEAP 
[EC_DRHOOK:tyz-computer:1:1:949066:949066] [20230129:013804:1674927484:40091.436] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :           GP_MODEL 
[EC_DRHOOK:tyz-computer:1:1:949066:949066] [20230129:013804:1674927484:40091.436] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :            EC_PHYS_DRV 
[EC_DRHOOK:tyz-computer:1:1:949066:949066] [20230129:013804:1674927484:40091.436] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :             >OMP-PHYSICS              (1001) 
[EC_DRHOOK:tyz-computer:1:1:949066:949066] [20230129:013804:1674927484:40091.436] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :              EC_PHYS 
[EC_DRHOOK:tyz-computer:1:1:949066:949066] [20230129:013804:1674927484:40091.436] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :               CALLPAR 
[EC_DRHOOK:tyz-computer:1:1:949066:949066] [20230129:013804:1674927484:40091.436] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :                TURBULENCE_LAYER 
[EC_DRHOOK:tyz-computer:1:1:949066:949066] [20230129:013804:1674927484:40091.436] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :                 VDFOUTER 
[EC_DRHOOK:tyz-computer:1:1:949066:949066] [20230129:013804:1674927484:40091.436] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :                  VDFMAIN 
[EC_DRHOOK:tyz-computer:1:1:949066:949066] [20230129:013805:1674927485:40092.436] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#15, nsigs = 1
[EC_DRHOOK:tyz-computer:1:1:949066:949066] [20230129:013805:1674927485:40092.436] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1ce8bb0 for signal#15, nsigs = 1
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
oifs_43r3_model.e  0000000001CE916B  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000081FFF1  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DC9090  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000000FB1880  vdfmain_                 1395  vdfmain.F90
oifs_43r3_model.e  0000000000F92699  vdfouter_                 739  vdfouter.F90
oifs_43r3_model.e  0000000000F88512  turbulence_layer_         158  turbulence_layer.F90
oifs_43r3_model.e  0000000000F0B683  callpar_                  869  callpar.F90
oifs_43r3_model.e  0000000000E4940F  ec_phys_                  670  ec_phys.F90
oifs_43r3_model.e  0000000000E3610C  ec_phys_drv_              599  ec_phys_drv.F90
oifs_43r3_model.e  0000000000BFA3D3  gp_model_                 613  gp_model.F90
oifs_43r3_model.e  00000000012E9482  gp_model_heap_             74  gp_model_heap.F90
oifs_43r3_model.e  0000000000BBC1CE  scan2m_                   535  scan2m.F90
oifs_43r3_model.e  000000000057A664  stepo_                    327  stepo.F90
oifs_43r3_model.e  000000000055DEEC  cnt4_                    1133  cnt4.F90
oifs_43r3_model.e  00000000005471C9  cnt3_                     267  cnt3.F90
oifs_43r3_model.e  0000000000546412  cnt2_                      88  cnt2.F90
oifs_43r3_model.e  0000000000545E28  cnt1_                      92  cnt1.F90
oifs_43r3_model.e  000000000040708D  cnt0_                     146  cnt0.F90
oifs_43r3_model.e  000000000040220F  MAIN__                     96  master.F90
oifs_43r3_model.e  00000000004021A2  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCA390  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000040206E  Unknown               Unknown  Unknown
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1999050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0595
(argv4) batchid: 968
(argv5) wuid: 12185239
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /mnt/fast/.BOINC/slots/2
Project directory is: /mnt/fast/.BOINC/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239
..mkdir for temp folder for results failed
Copying: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /mnt/fast/.BOINC/slots/2/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /mnt/fast/.BOINC/slots/2/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_5b1694a55af2b1756ae2c9c242e265bd to: /mnt/fast/.BOINC/slots/2/oifs_43r3_ps_0595_1999050100_123_968_12185239.zip
Unzipping the namelist zip file: /mnt/fast/.BOINC/slots/2/oifs_43r3_ps_0595_1999050100_123_968_12185239.zip
ic_ancil_file: ic_ancil_12185239
ifsdata_file: ifsdata_12185239
climate_data_file: clim_data_12185239
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_b20b449cadf04ddecf4dc6356f5e35b6 to: /mnt/fast/.BOINC/slots/2/ic_ancil_12185239.zip
Unzipping the IC ancils zip file: /mnt/fast/.BOINC/slots/2/ic_ancil_12185239.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_e60ef4b518f02d0153a1f1365fa8e58e to: /mnt/fast/.BOINC/slots/2/ifsdata/ifsdata_12185239.zip
Unzipping the ifsdata_zip file: /mnt/fast/.BOINC/slots/2/ifsdata/ifsdata_12185239.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /mnt/fast/.BOINC/slots/2/159l_2/clim_data_12185239.zip
Unzipping the climate data zip file: /mnt/fast/.BOINC/slots/2/159l_2/clim_data_12185239.zip
Checking for progress XML file: /mnt/fast/.BOINC/slots/2/progress_file_12185239.xml
Opened progress file ok : /mnt/fast/.BOINC/slots/2/progress_file_12185239.xml
-- Model is restarting --
Adjusting last_iter, 2710, to previous model restart step.
Creating progress file: /mnt/fast/.BOINC/slots/2/progress_file_12185239.xml
last_cpu_time: 31085
upload_file_number: 112
last_iter: 2687
last_upload: 9676800
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0595_1999050100_123_968_12185239_1_r1345310331
The child process has been launched with process id: 2430
Executing the command: /mnt/fast/.BOINC/slots/2/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:tyz-computer:1:1:2430:2430] [20230129:131422:1674969262:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:tyz-computer:1:1:2430:2430] [20230129:131422:1674969262:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:tyz-computer:1:1:2430:2430] [20230129:131422:1674969262:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:tyz-computer:1:1:2430:2430] [20230129:131422:1674969262:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:tyz-computer:1:1:2430:2430] [20230129:131422:1674969262:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:tyz-computer:1:1:2430:2430] [20230129:131422:1674969262:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:tyz-computer:1:1:2430:2430] [20230129:131422:1674969262:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:tyz-computer:1:1:2430:2430] [20230129:131422:1674969262:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:tyz-computer:1:1:2430:2430] [20230129:131422:1674969262:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:tyz-computer:1:1:2430:2430] [20230129:131422:1674969262:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:tyz-computer:1:1:2430:2430] [20230129:131422:1674969262:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:tyz-computer:1:1:2430:2430] [20230129:131422:1674969262:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:tyz-computer:1:1:2430:2430] [20230129:131422:1674969262:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:tyz-computer:1:1:2430:2430] [20230129:131422:1674969262:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:tyz-computer:1:1:2430:2430] [20230129:131422:1674969262:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:tyz-computer:1:1:2430:2430] [20230129:131422:1674969262:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tyz-computer:1:1:2430:2430] [20230129:131422:1674969262:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:tyz-computer:1:1:2430:2430] [20230129:131422:1674969262:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tyz-computer:1:1:2430:2430] [20230129:131422:1674969262:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:tyz-computer:1:1:2430:2430] [20230129:131422:1674969262:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:tyz-computer:1:1:2430:2430] [20230129:131422:1674969262:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tyz-computer:1:1:2430:2430] [20230129:131422:1674969262:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tyz-computer:1:1:2430:2430] [20230129:131422:1674969262:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:tyz-computer:1:1:2430:2430] [20230129:131422:1674969262:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tyz-computer:1:1:2430:2430] [20230129:131422:1674969262:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tyz-computer:1:1:2430:2430] [20230129:131422:1674969262:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tyz-computer:1:1:2430:2430] [20230129:131422:1674969262:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:tyz-computer:1:1:2430:2430] [20230129:131422:1674969262:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:tyz-computer:1:1:2430:2430] [20230129:131422:1674969262:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:tyz-computer:1:1:2430:2430] [20230129:131422:1674969262:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  13:14:43 STEP 2688 H=2688:00 +CPU= 17.495
  13:14:52 STEP 2689 H=2689:00 +CPU=  9.377
  13:15:02 STEP 2690 H=2690:00 +CPU=  9.579
  13:15:17 STEP 2691 H=2691:00 +CPU= 15.015
  13:15:27 STEP 2692 H=2692:00 +CPU=  9.683
  13:15:36 STEP 2693 H=2693:00 +CPU=  9.447
  13:15:52 STEP 2694 H=2694:00 +CPU= 15.241
  13:16:01 STEP 2695 H=2695:00 +CPU=  9.516
  13:16:11 STEP 2696 H=2696:00 +CPU=  9.765
  13:16:26 STEP 2697 H=2697:00 +CPU= 15.060
  13:16:36 STEP 2698 H=2698:00 +CPU=  9.740
  13:16:45 STEP 2699 H=2699:00 +CPU=  9.293
  13:17:02 STEP 2700 H=2700:00 +CPU= 16.607
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMGGhq0f+002700
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMSHhq0f+002700
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMUAhq0f+002700
  13:17:11 STEP 2701 H=2701:00 +CPU=  9.412
  13:17:21 STEP 2702 H=2702:00 +CPU=  9.561
  13:17:36 STEP 2703 H=2703:00 +CPU= 14.813
  13:17:45 STEP 2704 H=2704:00 +CPU=  9.637
  13:17:55 STEP 2705 H=2705:00 +CPU=  9.364
  13:18:10 STEP 2706 H=2706:00 +CPU= 15.426
  13:18:19 STEP 2707 H=2707:00 +CPU=  9.301
  13:18:29 STEP 2708 H=2708:00 +CPU=  9.559
  13:18:44 STEP 2709 H=2709:00 +CPU= 14.839
  13:18:53 STEP 2710 H=2710:00 +CPU=  9.529
  13:19:03 STEP 2711 H=2711:00 +CPU=  9.692
  13:19:21 STEP 2712 H=2712:00 +CPU= 17.705
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMGGhq0f+002712
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMSHhq0f+002712
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMUAhq0f+002712
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMGGhq0f+002688
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMSHhq0f+002688
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMUAhq0f+002688
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMGGhq0f+002700
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMSHhq0f+002700
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMUAhq0f+002700
Zipping up the intermediate file: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_0595_1999050100_123_968_12185239_1_r1345310331_112.zip
Uploading the intermediate file: upload_file_112.zip
  13:19:30 STEP 2713 H=2713:00 +CPU=  9.544
  13:19:40 STEP 2714 H=2714:00 +CPU=  9.732
  13:19:55 STEP 2715 H=2715:00 +CPU= 14.844
  13:20:05 STEP 2716 H=2716:00 +CPU=  9.637
  13:20:14 STEP 2717 H=2717:00 +CPU=  9.320
  13:20:29 STEP 2718 H=2718:00 +CPU= 15.214
  13:20:39 STEP 2719 H=2719:00 +CPU=  9.301
  13:20:48 STEP 2720 H=2720:00 +CPU=  9.437
  13:21:03 STEP 2721 H=2721:00 +CPU= 14.592
  13:21:12 STEP 2722 H=2722:00 +CPU=  9.443
  13:21:22 STEP 2723 H=2723:00 +CPU=  9.288
  13:21:38 STEP 2724 H=2724:00 +CPU= 16.614
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMGGhq0f+002724
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMSHhq0f+002724
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMUAhq0f+002724
  13:21:48 STEP 2725 H=2725:00 +CPU=  9.404
  13:21:57 STEP 2726 H=2726:00 +CPU=  9.626
  13:22:12 STEP 2727 H=2727:00 +CPU= 14.835
  13:22:22 STEP 2728 H=2728:00 +CPU=  9.540
  13:22:31 STEP 2729 H=2729:00 +CPU=  9.165
  13:22:46 STEP 2730 H=2730:00 +CPU= 15.028
  13:22:56 STEP 2731 H=2731:00 +CPU=  9.358
  13:23:05 STEP 2732 H=2732:00 +CPU=  9.706
  13:23:21 STEP 2733 H=2733:00 +CPU= 15.152
  13:23:30 STEP 2734 H=2734:00 +CPU=  9.540
  13:23:40 STEP 2735 H=2735:00 +CPU=  9.657
  13:23:58 STEP 2736 H=2736:00 +CPU= 17.838
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMGGhq0f+002736
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMSHhq0f+002736
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMUAhq0f+002736
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMGGhq0f+002712
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMSHhq0f+002712
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMUAhq0f+002712
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMGGhq0f+002724
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMSHhq0f+002724
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMUAhq0f+002724
Zipping up the intermediate file: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_0595_1999050100_123_968_12185239_1_r1345310331_113.zip
Uploading the intermediate file: upload_file_113.zip
  13:24:07 STEP 2737 H=2737:00 +CPU=  9.428
  13:24:17 STEP 2738 H=2738:00 +CPU=  9.677
  13:24:32 STEP 2739 H=2739:00 +CPU= 14.907
  13:24:42 STEP 2740 H=2740:00 +CPU=  9.550
  13:24:51 STEP 2741 H=2741:00 +CPU=  9.275
  13:25:06 STEP 2742 H=2742:00 +CPU= 14.940
  13:25:15 STEP 2743 H=2743:00 +CPU=  9.341
  13:25:25 STEP 2744 H=2744:00 +CPU=  9.620
  13:25:40 STEP 2745 H=2745:00 +CPU= 14.983
  13:25:50 STEP 2746 H=2746:00 +CPU=  9.835
  13:25:59 STEP 2747 H=2747:00 +CPU=  9.504
  13:26:16 STEP 2748 H=2748:00 +CPU= 16.802
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMGGhq0f+002748
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMSHhq0f+002748
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMUAhq0f+002748
  13:26:26 STEP 2749 H=2749:00 +CPU=  9.450
  13:26:36 STEP 2750 H=2750:00 +CPU=  9.708
  13:26:51 STEP 2751 H=2751:00 +CPU= 14.915
  13:27:00 STEP 2752 H=2752:00 +CPU=  9.638
  13:27:10 STEP 2753 H=2753:00 +CPU=  9.333
  13:27:25 STEP 2754 H=2754:00 +CPU= 15.232
  13:27:34 STEP 2755 H=2755:00 +CPU=  9.422
  13:27:44 STEP 2756 H=2756:00 +CPU=  9.503
  13:27:59 STEP 2757 H=2757:00 +CPU= 14.815
  13:28:08 STEP 2758 H=2758:00 +CPU=  9.506
  13:28:18 STEP 2759 H=2759:00 +CPU=  9.447
  13:28:36 STEP 2760 H=2760:00 +CPU= 17.776
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMGGhq0f+002760
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMSHhq0f+002760
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMUAhq0f+002760
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMGGhq0f+002736
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMSHhq0f+002736
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMUAhq0f+002736
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMGGhq0f+002748
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMSHhq0f+002748
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMUAhq0f+002748
Zipping up the intermediate file: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_0595_1999050100_123_968_12185239_1_r1345310331_114.zip
Uploading the intermediate file: upload_file_114.zip
  13:28:45 STEP 2761 H=2761:00 +CPU=  9.251
  13:28:54 STEP 2762 H=2762:00 +CPU=  9.666
  13:29:09 STEP 2763 H=2763:00 +CPU= 14.848
  13:29:19 STEP 2764 H=2764:00 +CPU=  9.453
  13:29:28 STEP 2765 H=2765:00 +CPU=  9.242
  13:29:43 STEP 2766 H=2766:00 +CPU= 14.806
  13:29:52 STEP 2767 H=2767:00 +CPU=  9.145
  13:30:02 STEP 2768 H=2768:00 +CPU=  9.382
  13:30:16 STEP 2769 H=2769:00 +CPU= 14.694
  13:30:26 STEP 2770 H=2770:00 +CPU=  9.500
  13:30:35 STEP 2771 H=2771:00 +CPU=  9.194
  13:30:52 STEP 2772 H=2772:00 +CPU= 16.463
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMGGhq0f+002772
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMSHhq0f+002772
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMUAhq0f+002772
  13:31:01 STEP 2773 H=2773:00 +CPU=  9.306
  13:31:10 STEP 2774 H=2774:00 +CPU=  9.470
  13:31:25 STEP 2775 H=2775:00 +CPU= 14.854
  13:31:35 STEP 2776 H=2776:00 +CPU=  9.643
  13:31:44 STEP 2777 H=2777:00 +CPU=  9.221
  13:31:59 STEP 2778 H=2778:00 +CPU= 14.955
  13:32:08 STEP 2779 H=2779:00 +CPU=  9.161
  13:32:18 STEP 2780 H=2780:00 +CPU=  9.497
  13:32:33 STEP 2781 H=2781:00 +CPU= 14.724
  13:32:42 STEP 2782 H=2782:00 +CPU=  9.533
  13:32:52 STEP 2783 H=2783:00 +CPU=  9.553
  13:33:10 STEP 2784 H=2784:00 +CPU= 17.805
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMGGhq0f+002784
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMSHhq0f+002784
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMUAhq0f+002784
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMGGhq0f+002760
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMSHhq0f+002760
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMUAhq0f+002760
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMGGhq0f+002772
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMSHhq0f+002772
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMUAhq0f+002772
Zipping up the intermediate file: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_0595_1999050100_123_968_12185239_1_r1345310331_115.zip
Uploading the intermediate file: upload_file_115.zip
  13:33:19 STEP 2785 H=2785:00 +CPU=  9.316
  13:33:29 STEP 2786 H=2786:00 +CPU=  9.495
  13:33:43 STEP 2787 H=2787:00 +CPU= 14.738
  13:33:53 STEP 2788 H=2788:00 +CPU=  9.509
  13:34:02 STEP 2789 H=2789:00 +CPU=  9.432
  13:34:17 STEP 2790 H=2790:00 +CPU= 15.077
  13:34:27 STEP 2791 H=2791:00 +CPU=  9.392
  13:34:37 STEP 2792 H=2792:00 +CPU=  9.705
  13:34:51 STEP 2793 H=2793:00 +CPU= 14.763
  13:35:01 STEP 2794 H=2794:00 +CPU=  9.570
  13:35:10 STEP 2795 H=2795:00 +CPU=  9.247
  13:35:27 STEP 2796 H=2796:00 +CPU= 16.354
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMGGhq0f+002796
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMSHhq0f+002796
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMUAhq0f+002796
  13:35:36 STEP 2797 H=2797:00 +CPU=  9.201
  13:35:45 STEP 2798 H=2798:00 +CPU=  9.393
  13:36:00 STEP 2799 H=2799:00 +CPU= 14.729
  13:36:10 STEP 2800 H=2800:00 +CPU=  9.396
  13:36:19 STEP 2801 H=2801:00 +CPU=  9.240
  13:36:34 STEP 2802 H=2802:00 +CPU= 14.943
  13:36:43 STEP 2803 H=2803:00 +CPU=  9.182
  13:36:52 STEP 2804 H=2804:00 +CPU=  9.305
  13:37:07 STEP 2805 H=2805:00 +CPU= 14.534
  13:37:17 STEP 2806 H=2806:00 +CPU=  9.467
  13:37:26 STEP 2807 H=2807:00 +CPU=  9.526
  13:37:44 STEP 2808 H=2808:00 +CPU= 17.492
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMGGhq0f+002808
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMSHhq0f+002808
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMUAhq0f+002808
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMGGhq0f+002784
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMSHhq0f+002784
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMUAhq0f+002784
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMGGhq0f+002796
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMSHhq0f+002796
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMUAhq0f+002796
Zipping up the intermediate file: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_0595_1999050100_123_968_12185239_1_r1345310331_116.zip
Uploading the intermediate file: upload_file_116.zip
  13:37:53 STEP 2809 H=2809:00 +CPU=  9.243
  13:38:02 STEP 2810 H=2810:00 +CPU=  9.353
  13:38:17 STEP 2811 H=2811:00 +CPU= 14.565
  13:38:26 STEP 2812 H=2812:00 +CPU=  9.350
  13:38:35 STEP 2813 H=2813:00 +CPU=  9.208
  13:38:50 STEP 2814 H=2814:00 +CPU= 14.959
  13:39:00 STEP 2815 H=2815:00 +CPU=  9.232
  13:39:09 STEP 2816 H=2816:00 +CPU=  9.318
  13:39:24 STEP 2817 H=2817:00 +CPU= 14.551
  13:39:33 STEP 2818 H=2818:00 +CPU=  9.410
  13:39:42 STEP 2819 H=2819:00 +CPU=  9.156
  13:39:59 STEP 2820 H=2820:00 +CPU= 16.227
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMGGhq0f+002820
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMSHhq0f+002820
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMUAhq0f+002820
  13:40:08 STEP 2821 H=2821:00 +CPU=  9.249
  13:40:17 STEP 2822 H=2822:00 +CPU=  9.458
  13:40:32 STEP 2823 H=2823:00 +CPU= 14.809
  13:40:42 STEP 2824 H=2824:00 +CPU=  9.445
  13:40:51 STEP 2825 H=2825:00 +CPU=  9.208
  13:41:06 STEP 2826 H=2826:00 +CPU= 15.069
  13:41:15 STEP 2827 H=2827:00 +CPU=  9.182
  13:41:25 STEP 2828 H=2828:00 +CPU=  9.430
  13:41:39 STEP 2829 H=2829:00 +CPU= 14.771
  13:41:49 STEP 2830 H=2830:00 +CPU=  9.408
  13:41:58 STEP 2831 H=2831:00 +CPU=  9.470
  13:42:17 STEP 2832 H=2832:00 +CPU= 18.033
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  13:48:54 STEP 2833 H=2833:00 +CPU=  9.437
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMGGhq0f+002832
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMSHhq0f+002832
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMUAhq0f+002832
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMGGhq0f+002808
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMSHhq0f+002808
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMUAhq0f+002808
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMGGhq0f+002820
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMSHhq0f+002820
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMUAhq0f+002820
Zipping up the intermediate file: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_0595_1999050100_123_968_12185239_1_r1345310331_117.zip
Uploading the intermediate file: upload_file_117.zip
  13:49:04 STEP 2834 H=2834:00 +CPU=  9.600
  13:49:19 STEP 2835 H=2835:00 +CPU= 14.844
  13:49:28 STEP 2836 H=2836:00 +CPU=  9.468
  13:49:37 STEP 2837 H=2837:00 +CPU=  9.229
  13:49:52 STEP 2838 H=2838:00 +CPU= 14.990
  13:50:02 STEP 2839 H=2839:00 +CPU=  9.366
  13:50:12 STEP 2840 H=2840:00 +CPU=  9.611
  13:50:26 STEP 2841 H=2841:00 +CPU= 14.847
  13:50:36 STEP 2842 H=2842:00 +CPU=  9.318
  13:50:45 STEP 2843 H=2843:00 +CPU=  9.269
  13:51:02 STEP 2844 H=2844:00 +CPU= 16.530
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMGGhq0f+002844
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMSHhq0f+002844
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMUAhq0f+002844
  13:51:11 STEP 2845 H=2845:00 +CPU=  9.421
  13:51:21 STEP 2846 H=2846:00 +CPU=  9.654
  13:51:36 STEP 2847 H=2847:00 +CPU= 14.895
  13:51:45 STEP 2848 H=2848:00 +CPU=  9.399
  13:51:55 STEP 2849 H=2849:00 +CPU=  9.300
  13:52:10 STEP 2850 H=2850:00 +CPU= 15.109
  13:52:19 STEP 2851 H=2851:00 +CPU=  9.452
  13:52:29 STEP 2852 H=2852:00 +CPU=  9.490
  13:52:43 STEP 2853 H=2853:00 +CPU= 14.799
  13:52:53 STEP 2854 H=2854:00 +CPU=  9.443
  13:53:03 STEP 2855 H=2855:00 +CPU=  9.664
  13:53:20 STEP 2856 H=2856:00 +CPU= 17.722
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMGGhq0f+002856
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMSHhq0f+002856
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMUAhq0f+002856
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMGGhq0f+002832
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMSHhq0f+002832
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMUAhq0f+002832
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMGGhq0f+002844
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMSHhq0f+002844
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMUAhq0f+002844
Zipping up the intermediate file: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_0595_1999050100_123_968_12185239_1_r1345310331_118.zip
Uploading the intermediate file: upload_file_118.zip
  13:53:30 STEP 2857 H=2857:00 +CPU=  9.264
  13:53:39 STEP 2858 H=2858:00 +CPU=  9.373
  13:53:54 STEP 2859 H=2859:00 +CPU= 14.871
  13:54:03 STEP 2860 H=2860:00 +CPU=  9.386
  13:54:13 STEP 2861 H=2861:00 +CPU=  9.195
  13:54:28 STEP 2862 H=2862:00 +CPU= 14.879
  13:54:37 STEP 2863 H=2863:00 +CPU=  9.287
  13:54:46 STEP 2864 H=2864:00 +CPU=  9.359
  13:55:01 STEP 2865 H=2865:00 +CPU= 14.496
  13:55:11 STEP 2866 H=2866:00 +CPU=  9.690
  13:55:20 STEP 2867 H=2867:00 +CPU=  9.213
  13:55:36 STEP 2868 H=2868:00 +CPU= 16.361
  13:55:45 STEP 2869 H=2869:00 +CPU=  9.129
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMGGhq0f+002868
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMSHhq0f+002868
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMUAhq0f+002868
  13:55:55 STEP 2870 H=2870:00 +CPU=  9.408
  13:56:10 STEP 2871 H=2871:00 +CPU= 14.717
  13:56:19 STEP 2872 H=2872:00 +CPU=  9.368
  13:56:28 STEP 2873 H=2873:00 +CPU=  9.130
  13:56:43 STEP 2874 H=2874:00 +CPU= 14.976
  13:56:52 STEP 2875 H=2875:00 +CPU=  9.154
  13:57:02 STEP 2876 H=2876:00 +CPU=  9.343
  13:57:16 STEP 2877 H=2877:00 +CPU= 14.518
  13:57:26 STEP 2878 H=2878:00 +CPU=  9.288
  13:57:35 STEP 2879 H=2879:00 +CPU=  9.531
  13:57:53 STEP 2880 H=2880:00 +CPU= 17.418
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMGGhq0f+002880
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMSHhq0f+002880
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMUAhq0f+002880
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMGGhq0f+002856
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMSHhq0f+002856
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMUAhq0f+002856
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMGGhq0f+002868
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMSHhq0f+002868
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMUAhq0f+002868
Zipping up the intermediate file: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_0595_1999050100_123_968_12185239_1_r1345310331_119.zip
Uploading the intermediate file: upload_file_119.zip
  13:58:02 STEP 2881 H=2881:00 +CPU=  9.154
  13:58:11 STEP 2882 H=2882:00 +CPU=  9.326
  13:58:26 STEP 2883 H=2883:00 +CPU= 14.555
  13:58:35 STEP 2884 H=2884:00 +CPU=  9.320
  13:58:44 STEP 2885 H=2885:00 +CPU=  9.191
  13:58:59 STEP 2886 H=2886:00 +CPU= 14.960
  13:59:08 STEP 2887 H=2887:00 +CPU=  9.142
  13:59:18 STEP 2888 H=2888:00 +CPU=  9.495
  13:59:33 STEP 2889 H=2889:00 +CPU= 14.716
  13:59:42 STEP 2890 H=2890:00 +CPU=  9.438
  13:59:51 STEP 2891 H=2891:00 +CPU=  9.295
  14:00:08 STEP 2892 H=2892:00 +CPU= 16.337
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMGGhq0f+002892
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMSHhq0f+002892
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMUAhq0f+002892
  14:00:17 STEP 2893 H=2893:00 +CPU=  9.195
  14:00:26 STEP 2894 H=2894:00 +CPU=  9.379
  14:00:41 STEP 2895 H=2895:00 +CPU= 14.606
  14:00:51 STEP 2896 H=2896:00 +CPU=  9.341
  14:01:00 STEP 2897 H=2897:00 +CPU=  9.131
  14:01:15 STEP 2898 H=2898:00 +CPU= 15.403
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  14:08:33 STEP 2899 H=2899:00 +CPU=  9.345
  14:08:42 STEP 2900 H=2900:00 +CPU=  9.338
  14:08:57 STEP 2901 H=2901:00 +CPU= 14.725
  14:09:06 STEP 2902 H=2902:00 +CPU=  9.353
  14:09:16 STEP 2903 H=2903:00 +CPU=  9.438
  14:09:33 STEP 2904 H=2904:00 +CPU= 17.556
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMGGhq0f+002904
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMSHhq0f+002904
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMUAhq0f+002904
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMGGhq0f+002880
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMSHhq0f+002880
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMUAhq0f+002880
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMGGhq0f+002892
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMSHhq0f+002892
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMUAhq0f+002892
Zipping up the intermediate file: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_0595_1999050100_123_968_12185239_1_r1345310331_120.zip
Uploading the intermediate file: upload_file_120.zip
  14:09:43 STEP 2905 H=2905:00 +CPU=  9.264
  14:09:52 STEP 2906 H=2906:00 +CPU=  9.492
  14:10:07 STEP 2907 H=2907:00 +CPU= 14.717
  14:10:16 STEP 2908 H=2908:00 +CPU=  9.372
  14:10:26 STEP 2909 H=2909:00 +CPU=  9.236
  14:10:41 STEP 2910 H=2910:00 +CPU= 15.098
  14:10:50 STEP 2911 H=2911:00 +CPU=  9.299
  14:11:00 STEP 2912 H=2912:00 +CPU=  9.486
  14:11:14 STEP 2913 H=2913:00 +CPU= 14.609
  14:11:24 STEP 2914 H=2914:00 +CPU=  9.502
  14:11:33 STEP 2915 H=2915:00 +CPU=  9.226
  14:11:49 STEP 2916 H=2916:00 +CPU= 16.404
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMGGhq0f+002916
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMSHhq0f+002916
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMUAhq0f+002916
  14:11:59 STEP 2917 H=2917:00 +CPU=  9.228
  14:12:08 STEP 2918 H=2918:00 +CPU=  9.436
  14:12:23 STEP 2919 H=2919:00 +CPU= 14.836
  14:12:33 STEP 2920 H=2920:00 +CPU=  9.619
  14:12:42 STEP 2921 H=2921:00 +CPU=  9.218
  14:12:57 STEP 2922 H=2922:00 +CPU= 15.004
  14:13:06 STEP 2923 H=2923:00 +CPU=  9.219
  14:13:16 STEP 2924 H=2924:00 +CPU=  9.474
  14:13:30 STEP 2925 H=2925:00 +CPU= 14.797
  14:13:40 STEP 2926 H=2926:00 +CPU=  9.311
  14:13:49 STEP 2927 H=2927:00 +CPU=  9.399
  14:14:07 STEP 2928 H=2928:00 +CPU= 17.510
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMGGhq0f+002928
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMSHhq0f+002928
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMUAhq0f+002928
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMGGhq0f+002904
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMSHhq0f+002904
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMUAhq0f+002904
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMGGhq0f+002916
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMSHhq0f+002916
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMUAhq0f+002916
Zipping up the intermediate file: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_0595_1999050100_123_968_12185239_1_r1345310331_121.zip
  14:14:15 STEP 2929 H=2929:00 +CPU=  8.738
Uploading the intermediate file: upload_file_121.zip
  14:14:24 STEP 2930 H=2930:00 +CPU=  8.958
Uploading trickle at timestep: 10540800
  14:14:39 STEP 2931 H=2931:00 +CPU= 14.101
  14:14:48 STEP 2932 H=2932:00 +CPU=  9.018
  14:14:56 STEP 2933 H=2933:00 +CPU=  8.725
  14:15:11 STEP 2934 H=2934:00 +CPU= 14.422
  14:15:20 STEP 2935 H=2935:00 +CPU=  8.784
  14:15:29 STEP 2936 H=2936:00 +CPU=  9.058
  14:15:43 STEP 2937 H=2937:00 +CPU= 14.109
  14:15:52 STEP 2938 H=2938:00 +CPU=  9.029
  14:16:01 STEP 2939 H=2939:00 +CPU=  8.772
  14:16:16 STEP 2940 H=2940:00 +CPU= 15.752
  14:16:25 STEP 2941 H=2941:00 +CPU=  8.779
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMGGhq0f+002940
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMSHhq0f+002940
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMUAhq0f+002940
  14:16:34 STEP 2942 H=2942:00 +CPU=  9.002
  14:16:48 STEP 2943 H=2943:00 +CPU= 14.073
  14:16:57 STEP 2944 H=2944:00 +CPU=  9.035
  14:17:06 STEP 2945 H=2945:00 +CPU=  8.721
  14:17:21 STEP 2946 H=2946:00 +CPU= 14.319
  14:17:29 STEP 2947 H=2947:00 +CPU=  8.761
  14:17:40 STEP 2948 H=2948:00 +CPU=  9.061
  14:17:54 STEP 2949 H=2949:00 +CPU= 14.021
  14:18:03 STEP 2950 H=2950:00 +CPU=  8.925
  14:18:12 STEP 2951 H=2951:00 +CPU=  8.862
  14:18:28 STEP 2952 H=2952:00 +CPU= 15.991
The child process terminated with status: 0
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMGGhq0f+002952
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMSHhq0f+002952
Moving to projects directory: /mnt/fast/.BOINC/slots/2/ICMUAhq0f+002952
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMSHhq0f+002928
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMGGhq0f+002940
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMGGhq0f+002952
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMSHhq0f+002952
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMUAhq0f+002952
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMUAhq0f+002928
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMSHhq0f+002940
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMGGhq0f+002928
Adding to the zip: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_12185239/ICMUAhq0f+002940
Zipping up the final file: /mnt/fast/.BOINC/projects/climateprediction.net/oifs_43r3_ps_0595_1999050100_123_968_12185239_1_r1345310331_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
14:21:50 (2399): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:44:49 1524863 22303988 oifs_43r3_ps_0595_1999050100_123_968_12185239_1 10,623,600 34,101 0.0032
09 May 2023 16:44:48 1524863 22303988 oifs_43r3_ps_0595_1999050100_123_968_12185239_1 10,540,800 33,850 0.0032
09 May 2023 16:44:46 1524863 22303988 oifs_43r3_ps_0595_1999050100_123_968_12185239_1 9,504,000 30,295 0.0032
09 May 2023 16:44:21 1524863 22303988 oifs_43r3_ps_0595_1999050100_123_968_12185239_1 8,640,000 27,520 0.0032
09 May 2023 16:44:21 1524863 22303988 oifs_43r3_ps_0595_1999050100_123_968_12185239_1 7,776,000 24,757 0.0032
09 May 2023 16:44:17 1524863 22303988 oifs_43r3_ps_0595_1999050100_123_968_12185239_1 6,912,000 21,930 0.0032
09 May 2023 16:44:15 1524863 22303988 oifs_43r3_ps_0595_1999050100_123_968_12185239_1 6,048,000 19,141 0.0032
09 May 2023 16:44:13 1524863 22303988 oifs_43r3_ps_0595_1999050100_123_968_12185239_1 5,184,000 16,373 0.0032
09 May 2023 16:44:13 1524863 22303988 oifs_43r3_ps_0595_1999050100_123_968_12185239_1 4,320,000 13,653 0.0032
09 May 2023 16:44:08 1524863 22303988 oifs_43r3_ps_0595_1999050100_123_968_12185239_1 3,456,000 10,930 0.0032
09 May 2023 16:44:08 1524863 22303988 oifs_43r3_ps_0595_1999050100_123_968_12185239_1 2,592,000 8,246 0.0032
09 May 2023 16:44:06 1524863 22303988 oifs_43r3_ps_0595_1999050100_123_968_12185239_1 1,728,000 5,563 0.0032
09 May 2023 16:44:03 1524863 22303988 oifs_43r3_ps_0595_1999050100_123_968_12185239_1 864,000 2,820 0.0033


©2024 climateprediction.net