climateprediction.net home page
Task 22265504

Task 22265504

Name oifs_43r3_ps_0894_1994050100_123_963_12180538_0
Workunit 12180538
Created 22 Dec 2022, 6:56:02 UTC
Sent 11 Jan 2023, 12:44:55 UTC
Report deadline 10 Feb 2023, 12:44:55 UTC
Received 12 Jan 2023, 12:59:11 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 196 (0x000000C4) EXIT_DISK_LIMIT_EXCEEDED
Computer ID 1536520
Run time 22 hours 46 min 15 sec
CPU time 22 hours 18 min 46 sec
Validate state Invalid
Credit 6,410.88
Device peak FLOPS 1.00 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,417.93 MB
Peak swap size 4,978.08 MB
Peak disk usage 7,169.23 MB
Stderr
<core_client_version>7.20.2</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+000600
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+000600
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+000600
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+000612
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+000612
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+000612
Zipping up the intermediate file: /home/steve/projects/climateprediction.net/oifs_43r3_ps_0894_1994050100_123_963_12180538_0_r1683884544_25.zip
Uploading the intermediate file: upload_file_25.zip
  17:46:32 STEP  625 H= 625:00 +CPU= 62.072
  17:47:33 STEP  626 H= 626:00 +CPU= 60.153
  17:48:59 STEP  627 H= 627:00 +CPU= 84.456
  17:50:04 STEP  628 H= 628:00 +CPU= 63.799
  17:51:04 STEP  629 H= 629:00 +CPU= 58.178
  17:52:34 STEP  630 H= 630:00 +CPU= 88.805
  17:53:38 STEP  631 H= 631:00 +CPU= 62.465
  17:54:39 STEP  632 H= 632:00 +CPU= 60.568
  17:56:14 STEP  633 H= 633:00 +CPU= 93.496
  17:57:17 STEP  634 H= 634:00 +CPU= 61.705
  17:58:22 STEP  635 H= 635:00 +CPU= 63.480
  18:00:01 STEP  636 H= 636:00 +CPU= 97.598
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+000636
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+000636
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+000636
  18:01:06 STEP  637 H= 637:00 +CPU= 64.031
  18:02:10 STEP  638 H= 638:00 +CPU= 62.334
  18:03:40 STEP  639 H= 639:00 +CPU= 88.615
  18:04:42 STEP  640 H= 640:00 +CPU= 60.540
  18:05:39 STEP  641 H= 641:00 +CPU= 55.635
  18:07:03 STEP  642 H= 642:00 +CPU= 83.193
  18:08:01 STEP  643 H= 643:00 +CPU= 56.927
  18:09:03 STEP  644 H= 644:00 +CPU= 61.012
  18:10:21 STEP  645 H= 645:00 +CPU= 75.876
  18:11:20 STEP  646 H= 646:00 +CPU= 58.538
  18:12:20 STEP  647 H= 647:00 +CPU= 58.799
  18:13:57 STEP  648 H= 648:00 +CPU= 95.369
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+000648
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+000648
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+000648
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+000624
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+000624
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+000624
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+000636
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+000636
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+000636
Zipping up the intermediate file: /home/steve/projects/climateprediction.net/oifs_43r3_ps_0894_1994050100_123_963_12180538_0_r1683884544_26.zip
Uploading the intermediate file: upload_file_26.zip
  18:14:56 STEP  649 H= 649:00 +CPU= 58.069
  18:15:54 STEP  650 H= 650:00 +CPU= 57.103
  18:17:18 STEP  651 H= 651:00 +CPU= 82.150
  18:18:20 STEP  652 H= 652:00 +CPU= 61.672
  18:19:16 STEP  653 H= 653:00 +CPU= 55.386
  18:20:41 STEP  654 H= 654:00 +CPU= 83.305
  18:21:41 STEP  655 H= 655:00 +CPU= 58.533
  18:22:38 STEP  656 H= 656:00 +CPU= 56.862
  18:24:00 STEP  657 H= 657:00 +CPU= 80.544
  18:24:56 STEP  658 H= 658:00 +CPU= 55.045
  18:25:53 STEP  659 H= 659:00 +CPU= 56.480
  18:27:29 STEP  660 H= 660:00 +CPU= 94.064
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+000660
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+000660
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+000660
  18:28:27 STEP  661 H= 661:00 +CPU= 57.035
  18:29:25 STEP  662 H= 662:00 +CPU= 57.140
  18:30:48 STEP  663 H= 663:00 +CPU= 82.231
  18:31:45 STEP  664 H= 664:00 +CPU= 56.162
  18:32:39 STEP  665 H= 665:00 +CPU= 53.030
  18:34:06 STEP  666 H= 666:00 +CPU= 86.285
  18:35:05 STEP  667 H= 667:00 +CPU= 57.657
  18:36:02 STEP  668 H= 668:00 +CPU= 55.613
  18:37:27 STEP  669 H= 669:00 +CPU= 83.544
  18:38:24 STEP  670 H= 670:00 +CPU= 55.490
  18:39:21 STEP  671 H= 671:00 +CPU= 56.519
  18:41:02 STEP  672 H= 672:00 +CPU= 98.971
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+000672
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+000672
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+000672
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+000648
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+000648
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+000648
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+000660
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+000660
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+000660
Zipping up the intermediate file: /home/steve/projects/climateprediction.net/oifs_43r3_ps_0894_1994050100_123_963_12180538_0_r1683884544_27.zip
Uploading the intermediate file: upload_file_27.zip
  18:42:00 STEP  673 H= 673:00 +CPU= 57.065
  18:42:59 STEP  674 H= 674:00 +CPU= 58.136
  18:44:22 STEP  675 H= 675:00 +CPU= 81.733
  18:45:29 STEP  676 H= 676:00 +CPU= 65.617
  18:46:23 STEP  677 H= 677:00 +CPU= 53.722
  18:47:54 STEP  678 H= 678:00 +CPU= 89.649
  18:48:51 STEP  679 H= 679:00 +CPU= 56.395
  18:49:48 STEP  680 H= 680:00 +CPU= 56.088
  18:51:15 STEP  681 H= 681:00 +CPU= 84.891
  18:52:13 STEP  682 H= 682:00 +CPU= 57.440
  18:53:09 STEP  683 H= 683:00 +CPU= 54.480
  18:54:47 STEP  684 H= 684:00 +CPU= 95.846
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+000684
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+000684
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+000684
  18:55:41 STEP  685 H= 685:00 +CPU= 53.591
  18:56:42 STEP  686 H= 686:00 +CPU= 59.333
  18:58:05 STEP  687 H= 687:00 +CPU= 81.959
  18:59:01 STEP  688 H= 688:00 +CPU= 55.378
  18:59:58 STEP  689 H= 689:00 +CPU= 55.717
  19:01:31 STEP  690 H= 690:00 +CPU= 92.321
  19:02:26 STEP  691 H= 691:00 +CPU= 53.639
  19:03:29 STEP  692 H= 692:00 +CPU= 61.961
  19:05:01 STEP  693 H= 693:00 +CPU= 90.883
  19:05:57 STEP  694 H= 694:00 +CPU= 55.074
  19:06:57 STEP  695 H= 695:00 +CPU= 59.308
  19:08:41 STEP  696 H= 696:00 +CPU=101.590
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+000696
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+000696
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+000696
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+000672
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+000672
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+000672
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+000684
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+000684
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+000684
Zipping up the intermediate file: /home/steve/projects/climateprediction.net/oifs_43r3_ps_0894_1994050100_123_963_12180538_0_r1683884544_28.zip
Uploading the intermediate file: upload_file_28.zip
  19:09:38 STEP  697 H= 697:00 +CPU= 55.784
  19:10:42 STEP  698 H= 698:00 +CPU= 62.498
  19:12:07 STEP  699 H= 699:00 +CPU= 84.342
  19:13:09 STEP  700 H= 700:00 +CPU= 60.119
  19:14:06 STEP  701 H= 701:00 +CPU= 56.238
  19:15:36 STEP  702 H= 702:00 +CPU= 89.205
  19:16:30 STEP  703 H= 703:00 +CPU= 52.887
  19:17:32 STEP  704 H= 704:00 +CPU= 60.970
  19:18:51 STEP  705 H= 705:00 +CPU= 78.010
  19:19:51 STEP  706 H= 706:00 +CPU= 59.034
  19:20:46 STEP  707 H= 707:00 +CPU= 54.315
  19:22:18 STEP  708 H= 708:00 +CPU= 89.787
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+000708
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+000708
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+000708
  19:23:14 STEP  709 H= 709:00 +CPU= 55.027
  19:24:09 STEP  710 H= 710:00 +CPU= 54.901
  19:25:32 STEP  711 H= 711:00 +CPU= 81.593
  19:26:28 STEP  712 H= 712:00 +CPU= 54.837
  19:27:24 STEP  713 H= 713:00 +CPU= 55.037
  19:28:54 STEP  714 H= 714:00 +CPU= 89.230
  19:29:58 STEP  715 H= 715:00 +CPU= 62.508
  19:31:01 STEP  716 H= 716:00 +CPU= 61.863
  19:32:24 STEP  717 H= 717:00 +CPU= 82.624
  19:33:25 STEP  718 H= 718:00 +CPU= 59.850
  19:34:28 STEP  719 H= 719:00 +CPU= 61.348
  19:36:06 STEP  720 H= 720:00 +CPU= 97.251
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+000720
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+000720
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+000720
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+000696
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+000696
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+000696
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+000708
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+000708
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+000708
Zipping up the intermediate file: /home/steve/projects/climateprediction.net/oifs_43r3_ps_0894_1994050100_123_963_12180538_0_r1683884544_29.zip
Uploading the intermediate file: upload_file_29.zip
  19:37:07 STEP  721 H= 721:00 +CPU= 59.979
  19:38:07 STEP  722 H= 722:00 +CPU= 58.333
  19:39:31 STEP  723 H= 723:00 +CPU= 82.656
  19:40:28 STEP  724 H= 724:00 +CPU= 56.841
  19:41:26 STEP  725 H= 725:00 +CPU= 57.037
  19:42:49 STEP  726 H= 726:00 +CPU= 79.866
  19:43:47 STEP  727 H= 727:00 +CPU= 54.725
  19:44:43 STEP  728 H= 728:00 +CPU= 54.443
  19:46:11 STEP  729 H= 729:00 +CPU= 85.447
  19:47:13 STEP  730 H= 730:00 +CPU= 59.048
  19:48:09 STEP  731 H= 731:00 +CPU= 55.392
  19:49:41 STEP  732 H= 732:00 +CPU= 91.061
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+000732
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+000732
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+000732
  19:50:35 STEP  733 H= 733:00 +CPU= 52.755
  19:51:28 STEP  734 H= 734:00 +CPU= 53.354
  19:52:55 STEP  735 H= 735:00 +CPU= 85.059
  19:53:55 STEP  736 H= 736:00 +CPU= 59.446
  19:54:50 STEP  737 H= 737:00 +CPU= 54.427
  19:56:13 STEP  738 H= 738:00 +CPU= 81.526
  19:57:07 STEP  739 H= 739:00 +CPU= 53.512
  19:58:04 STEP  740 H= 740:00 +CPU= 55.629
  19:59:29 STEP  741 H= 741:00 +CPU= 82.839
  20:00:24 STEP  742 H= 742:00 +CPU= 54.248
  20:01:23 STEP  743 H= 743:00 +CPU= 57.004
  20:03:01 STEP  744 H= 744:00 +CPU= 95.243
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+000744
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+000744
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+000744
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+000720
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+000720
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+000720
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+000732
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+000732
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+000732
Zipping up the intermediate file: /home/steve/projects/climateprediction.net/oifs_43r3_ps_0894_1994050100_123_963_12180538_0_r1683884544_30.zip
Uploading the intermediate file: upload_file_30.zip
  20:03:58 STEP  745 H= 745:00 +CPU= 55.719
  20:05:00 STEP  746 H= 746:00 +CPU= 59.618
  20:06:23 STEP  747 H= 747:00 +CPU= 79.618
  20:07:21 STEP  748 H= 748:00 +CPU= 55.398
  20:08:20 STEP  749 H= 749:00 +CPU= 55.485
  20:09:49 STEP  750 H= 750:00 +CPU= 82.227
  20:10:45 STEP  751 H= 751:00 +CPU= 52.842
  20:11:47 STEP  752 H= 752:00 +CPU= 55.608
  20:13:13 STEP  753 H= 753:00 +CPU= 78.647
  20:14:13 STEP  754 H= 754:00 +CPU= 55.244
  20:15:13 STEP  755 H= 755:00 +CPU= 55.961
  20:16:51 STEP  756 H= 756:00 +CPU= 90.761
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+000756
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+000756
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+000756
  20:17:49 STEP  757 H= 757:00 +CPU= 54.930
  20:18:48 STEP  758 H= 758:00 +CPU= 56.514
  20:20:17 STEP  759 H= 759:00 +CPU= 86.901
  20:21:15 STEP  760 H= 760:00 +CPU= 55.824
  20:22:10 STEP  761 H= 761:00 +CPU= 53.637
  20:23:37 STEP  762 H= 762:00 +CPU= 84.609
  20:24:35 STEP  763 H= 763:00 +CPU= 56.198
  20:25:37 STEP  764 H= 764:00 +CPU= 59.765
  20:27:02 STEP  765 H= 765:00 +CPU= 82.818
  20:28:00 STEP  766 H= 766:00 +CPU= 55.761
  20:29:05 STEP  767 H= 767:00 +CPU= 61.839
  20:30:50 STEP  768 H= 768:00 +CPU= 99.941
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+000768
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+000768
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+000768
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+000744
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+000744
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+000744
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+000756
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+000756
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+000756
Zipping up the intermediate file: /home/steve/projects/climateprediction.net/oifs_43r3_ps_0894_1994050100_123_963_12180538_0_r1683884544_31.zip
Uploading the intermediate file: upload_file_31.zip
  20:31:42 STEP  769 H= 769:00 +CPU= 51.430
  20:32:40 STEP  770 H= 770:00 +CPU= 56.810
  20:34:02 STEP  771 H= 771:00 +CPU= 81.050
  20:34:56 STEP  772 H= 772:00 +CPU= 53.262
  20:35:55 STEP  773 H= 773:00 +CPU= 57.774
  20:37:21 STEP  774 H= 774:00 +CPU= 85.554
  20:38:13 STEP  775 H= 775:00 +CPU= 51.287
  20:39:11 STEP  776 H= 776:00 +CPU= 56.499
  20:40:37 STEP  777 H= 777:00 +CPU= 82.007
  20:41:36 STEP  778 H= 778:00 +CPU= 55.065
  20:42:38 STEP  779 H= 779:00 +CPU= 58.162
  20:44:16 STEP  780 H= 780:00 +CPU= 88.644
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+000780
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+000780
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+000780
  20:45:13 STEP  781 H= 781:00 +CPU= 53.258
  20:46:16 STEP  782 H= 782:00 +CPU= 61.982
  20:47:40 STEP  783 H= 783:00 +CPU= 82.518
  20:48:36 STEP  784 H= 784:00 +CPU= 54.573
  20:49:35 STEP  785 H= 785:00 +CPU= 57.726
  20:50:56 STEP  786 H= 786:00 +CPU= 78.101
  20:51:48 STEP  787 H= 787:00 +CPU= 50.133
  20:52:43 STEP  788 H= 788:00 +CPU= 52.776
  20:54:03 STEP  789 H= 789:00 +CPU= 76.023
  20:54:56 STEP  790 H= 790:00 +CPU= 50.876
  20:55:53 STEP  791 H= 791:00 +CPU= 55.213
  20:57:22 STEP  792 H= 792:00 +CPU= 88.475
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+000792
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+000792
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+000792
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+000768
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+000768
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+000768
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+000780
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+000780
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+000780
Zipping up the intermediate file: /home/steve/projects/climateprediction.net/oifs_43r3_ps_0894_1994050100_123_963_12180538_0_r1683884544_32.zip
Uploading the intermediate file: upload_file_32.zip
Uploading trickle at timestep: 2851200
  20:58:19 STEP  793 H= 793:00 +CPU= 54.605
  20:59:13 STEP  794 H= 794:00 +CPU= 53.213
  21:00:28 STEP  795 H= 795:00 +CPU= 74.853
  21:01:19 STEP  796 H= 796:00 +CPU= 50.471
  21:02:11 STEP  797 H= 797:00 +CPU= 51.374
  21:03:27 STEP  798 H= 798:00 +CPU= 74.867
  21:04:23 STEP  799 H= 799:00 +CPU= 53.636
  21:05:17 STEP  800 H= 800:00 +CPU= 51.675
  21:06:45 STEP  801 H= 801:00 +CPU= 72.394
  21:07:39 STEP  802 H= 802:00 +CPU= 51.883
  21:08:35 STEP  803 H= 803:00 +CPU= 54.115
  21:10:05 STEP  804 H= 804:00 +CPU= 84.794
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+000804
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+000804
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+000804
  21:10:59 STEP  805 H= 805:00 +CPU= 52.069
  21:11:52 STEP  806 H= 806:00 +CPU= 52.488
  21:13:11 STEP  807 H= 807:00 +CPU= 76.367
  21:14:05 STEP  808 H= 808:00 +CPU= 53.156
  21:15:00 STEP  809 H= 809:00 +CPU= 53.052
  21:16:18 STEP  810 H= 810:00 +CPU= 75.658
  21:17:12 STEP  811 H= 811:00 +CPU= 52.344
  21:18:06 STEP  812 H= 812:00 +CPU= 51.164
  21:19:25 STEP  813 H= 813:00 +CPU= 75.367
  21:20:23 STEP  814 H= 814:00 +CPU= 53.749
  21:21:18 STEP  815 H= 815:00 +CPU= 53.192
  21:22:46 STEP  816 H= 816:00 +CPU= 87.261
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+000816
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+000816
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+000816
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+000792
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+000792
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+000792
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+000804
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+000804
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+000804
Zipping up the intermediate file: /home/steve/projects/climateprediction.net/oifs_43r3_ps_0894_1994050100_123_963_12180538_0_r1683884544_33.zip
Uploading the intermediate file: upload_file_33.zip
  21:23:37 STEP  817 H= 817:00 +CPU= 50.119
  21:24:32 STEP  818 H= 818:00 +CPU= 53.752
  21:25:48 STEP  819 H= 819:00 +CPU= 74.836
  21:26:40 STEP  820 H= 820:00 +CPU= 50.983
  21:27:33 STEP  821 H= 821:00 +CPU= 52.060
  21:28:55 STEP  822 H= 822:00 +CPU= 78.300
  21:29:50 STEP  823 H= 823:00 +CPU= 52.225
  21:30:43 STEP  824 H= 824:00 +CPU= 51.713
  21:32:03 STEP  825 H= 825:00 +CPU= 78.817
  21:32:57 STEP  826 H= 826:00 +CPU= 53.619
  21:33:48 STEP  827 H= 827:00 +CPU= 50.423
  21:35:14 STEP  828 H= 828:00 +CPU= 84.884
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+000828
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+000828
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+000828
  21:36:06 STEP  829 H= 829:00 +CPU= 51.158
  21:37:00 STEP  830 H= 830:00 +CPU= 52.485
  21:38:23 STEP  831 H= 831:00 +CPU= 76.176
  21:39:17 STEP  832 H= 832:00 +CPU= 50.920
  21:40:13 STEP  833 H= 833:00 +CPU= 53.736
  21:41:31 STEP  834 H= 834:00 +CPU= 77.310
  21:42:19 STEP  835 H= 835:00 +CPU= 47.621
  21:43:14 STEP  836 H= 836:00 +CPU= 52.796
  21:44:35 STEP  837 H= 837:00 +CPU= 78.788
  21:45:27 STEP  838 H= 838:00 +CPU= 51.067
  21:46:20 STEP  839 H= 839:00 +CPU= 52.077
  21:47:53 STEP  840 H= 840:00 +CPU= 91.605
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+000840
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+000840
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+000840
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+000816
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+000816
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+000816
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+000828
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+000828
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+000828
Zipping up the intermediate file: /home/steve/projects/climateprediction.net/oifs_43r3_ps_0894_1994050100_123_963_12180538_0_r1683884544_34.zip
Uploading the intermediate file: upload_file_34.zip
  21:48:44 STEP  841 H= 841:00 +CPU= 50.668
  21:49:38 STEP  842 H= 842:00 +CPU= 53.616
  21:50:58 STEP  843 H= 843:00 +CPU= 77.918
  21:51:50 STEP  844 H= 844:00 +CPU= 52.244
  21:52:45 STEP  845 H= 845:00 +CPU= 53.533
  21:54:05 STEP  846 H= 846:00 +CPU= 78.795
  21:55:00 STEP  847 H= 847:00 +CPU= 53.927
  21:55:54 STEP  848 H= 848:00 +CPU= 52.997
  21:57:13 STEP  849 H= 849:00 +CPU= 78.882
  21:58:07 STEP  850 H= 850:00 +CPU= 53.190
  21:59:01 STEP  851 H= 851:00 +CPU= 52.653
  22:00:27 STEP  852 H= 852:00 +CPU= 84.843
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+000852
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+000852
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+000852
  22:01:19 STEP  853 H= 853:00 +CPU= 50.866
  22:02:13 STEP  854 H= 854:00 +CPU= 53.761
  22:03:28 STEP  855 H= 855:00 +CPU= 73.659
  22:04:21 STEP  856 H= 856:00 +CPU= 52.365
  22:05:11 STEP  857 H= 857:00 +CPU= 49.860
  22:06:29 STEP  858 H= 858:00 +CPU= 76.794
  22:07:21 STEP  859 H= 859:00 +CPU= 51.512
  22:08:17 STEP  860 H= 860:00 +CPU= 54.294
  22:09:36 STEP  861 H= 861:00 +CPU= 77.305
  22:10:26 STEP  862 H= 862:00 +CPU= 49.647
  22:11:23 STEP  863 H= 863:00 +CPU= 56.397
  22:12:54 STEP  864 H= 864:00 +CPU= 90.109
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+000864
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+000864
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+000864
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+000840
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+000840
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+000840
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+000852
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+000852
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+000852
Zipping up the intermediate file: /home/steve/projects/climateprediction.net/oifs_43r3_ps_0894_1994050100_123_963_12180538_0_r1683884544_35.zip
Uploading the intermediate file: upload_file_35.zip
  22:13:46 STEP  865 H= 865:00 +CPU= 52.004
  22:14:38 STEP  866 H= 866:00 +CPU= 51.547
  22:15:59 STEP  867 H= 867:00 +CPU= 79.756
  22:16:57 STEP  868 H= 868:00 +CPU= 57.352
  22:17:51 STEP  869 H= 869:00 +CPU= 53.444
  22:19:10 STEP  870 H= 870:00 +CPU= 76.766
  22:20:02 STEP  871 H= 871:00 +CPU= 51.182
  22:20:54 STEP  872 H= 872:00 +CPU= 51.334
  22:22:14 STEP  873 H= 873:00 +CPU= 78.771
  22:23:07 STEP  874 H= 874:00 +CPU= 52.534
  22:24:01 STEP  875 H= 875:00 +CPU= 52.392
  22:25:29 STEP  876 H= 876:00 +CPU= 86.913
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+000876
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+000876
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+000876
  22:26:19 STEP  877 H= 877:00 +CPU= 49.699
  22:27:16 STEP  878 H= 878:00 +CPU= 56.329
  22:28:33 STEP  879 H= 879:00 +CPU= 75.809
  22:29:29 STEP  880 H= 880:00 +CPU= 55.053
  22:30:21 STEP  881 H= 881:00 +CPU= 51.964
  22:31:42 STEP  882 H= 882:00 +CPU= 79.746
  22:32:38 STEP  883 H= 883:00 +CPU= 54.870
  22:33:32 STEP  884 H= 884:00 +CPU= 53.394
  22:34:53 STEP  885 H= 885:00 +CPU= 79.345
  22:35:45 STEP  886 H= 886:00 +CPU= 51.137
  22:36:38 STEP  887 H= 887:00 +CPU= 52.591
  22:38:13 STEP  888 H= 888:00 +CPU= 93.032
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+000888
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+000888
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+000888
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+000864
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+000864
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+000864
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+000876
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+000876
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+000876
Zipping up the intermediate file: /home/steve/projects/climateprediction.net/oifs_43r3_ps_0894_1994050100_123_963_12180538_0_r1683884544_36.zip
Uploading the intermediate file: upload_file_36.zip
  22:39:03 STEP  889 H= 889:00 +CPU= 49.652
  22:39:55 STEP  890 H= 890:00 +CPU= 51.265
  22:41:11 STEP  891 H= 891:00 +CPU= 74.954
  22:42:07 STEP  892 H= 892:00 +CPU= 55.043
  22:42:58 STEP  893 H= 893:00 +CPU= 50.268
  22:44:22 STEP  894 H= 894:00 +CPU= 83.301
  22:45:12 STEP  895 H= 895:00 +CPU= 49.248
  22:46:04 STEP  896 H= 896:00 +CPU= 51.486
  22:47:23 STEP  897 H= 897:00 +CPU= 77.852
  22:48:17 STEP  898 H= 898:00 +CPU= 53.091
  22:49:11 STEP  899 H= 899:00 +CPU= 52.675
  22:50:40 STEP  900 H= 900:00 +CPU= 87.555
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+000900
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+000900
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+000900
  22:51:29 STEP  901 H= 901:00 +CPU= 48.741
  22:52:22 STEP  902 H= 902:00 +CPU= 52.176
  22:53:43 STEP  903 H= 903:00 +CPU= 79.917
  22:54:35 STEP  904 H= 904:00 +CPU= 51.680
  22:55:29 STEP  905 H= 905:00 +CPU= 52.496
  22:56:49 STEP  906 H= 906:00 +CPU= 79.457
  22:57:41 STEP  907 H= 907:00 +CPU= 50.880
  22:58:34 STEP  908 H= 908:00 +CPU= 52.493
  22:59:54 STEP  909 H= 909:00 +CPU= 78.617
  23:00:48 STEP  910 H= 910:00 +CPU= 53.108
  23:01:41 STEP  911 H= 911:00 +CPU= 52.382
  23:03:12 STEP  912 H= 912:00 +CPU= 90.029
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+000912
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+000912
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+000912
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+000888
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+000888
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+000888
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+000900
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+000900
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+000900
Zipping up the intermediate file: /home/steve/projects/climateprediction.net/oifs_43r3_ps_0894_1994050100_123_963_12180538_0_r1683884544_37.zip
Uploading the intermediate file: upload_file_37.zip
  23:04:02 STEP  913 H= 913:00 +CPU= 48.865
  23:04:56 STEP  914 H= 914:00 +CPU= 53.392
  23:06:20 STEP  915 H= 915:00 +CPU= 83.052
  23:07:11 STEP  916 H= 916:00 +CPU= 50.692
  23:08:04 STEP  917 H= 917:00 +CPU= 52.342
  23:09:27 STEP  918 H= 918:00 +CPU= 81.330
  23:10:19 STEP  919 H= 919:00 +CPU= 51.213
  23:11:13 STEP  920 H= 920:00 +CPU= 53.124
  23:12:31 STEP  921 H= 921:00 +CPU= 76.882
  23:13:22 STEP  922 H= 922:00 +CPU= 50.405
  23:14:14 STEP  923 H= 923:00 +CPU= 51.392
  23:15:44 STEP  924 H= 924:00 +CPU= 88.301
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+000924
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+000924
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+000924
  23:16:34 STEP  925 H= 925:00 +CPU= 50.038
  23:17:30 STEP  926 H= 926:00 +CPU= 54.724
  23:18:48 STEP  927 H= 927:00 +CPU= 76.267
  23:19:43 STEP  928 H= 928:00 +CPU= 54.740
  23:20:37 STEP  929 H= 929:00 +CPU= 52.868
  23:21:53 STEP  930 H= 930:00 +CPU= 75.145
  23:22:46 STEP  931 H= 931:00 +CPU= 52.077
  23:23:39 STEP  932 H= 932:00 +CPU= 52.348
  23:24:57 STEP  933 H= 933:00 +CPU= 76.638
  23:25:48 STEP  934 H= 934:00 +CPU= 50.653
  23:26:42 STEP  935 H= 935:00 +CPU= 52.857
  23:28:13 STEP  936 H= 936:00 +CPU= 89.352
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+000936
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+000936
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+000936
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+000912
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+000912
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+000912
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+000924
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+000924
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+000924
Zipping up the intermediate file: /home/steve/projects/climateprediction.net/oifs_43r3_ps_0894_1994050100_123_963_12180538_0_r1683884544_38.zip
Uploading the intermediate file: upload_file_38.zip
  23:29:06 STEP  937 H= 937:00 +CPU= 52.717
  23:29:58 STEP  938 H= 938:00 +CPU= 50.673
  23:31:14 STEP  939 H= 939:00 +CPU= 75.447
  23:32:06 STEP  940 H= 940:00 +CPU= 51.516
  23:33:02 STEP  941 H= 941:00 +CPU= 54.771
  23:34:20 STEP  942 H= 942:00 +CPU= 77.056
  23:35:14 STEP  943 H= 943:00 +CPU= 53.486
  23:36:07 STEP  944 H= 944:00 +CPU= 51.800
  23:37:22 STEP  945 H= 945:00 +CPU= 74.215
  23:38:16 STEP  946 H= 946:00 +CPU= 53.769
  23:39:10 STEP  947 H= 947:00 +CPU= 52.957
  23:40:33 STEP  948 H= 948:00 +CPU= 82.486
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+000948
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+000948
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+000948
  23:41:26 STEP  949 H= 949:00 +CPU= 51.504
  23:42:20 STEP  950 H= 950:00 +CPU= 53.884
  23:43:37 STEP  951 H= 951:00 +CPU= 76.046
  23:44:33 STEP  952 H= 952:00 +CPU= 54.914
  23:45:26 STEP  953 H= 953:00 +CPU= 52.690
  23:46:51 STEP  954 H= 954:00 +CPU= 83.814
  23:47:45 STEP  955 H= 955:00 +CPU= 52.557
  23:48:38 STEP  956 H= 956:00 +CPU= 52.496
  23:49:57 STEP  957 H= 957:00 +CPU= 77.397
  23:50:49 STEP  958 H= 958:00 +CPU= 51.525
  23:51:42 STEP  959 H= 959:00 +CPU= 51.913
  23:53:16 STEP  960 H= 960:00 +CPU= 92.769
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+000960
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+000960
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+000960
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+000936
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+000936
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+000936
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+000948
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+000948
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+000948
Zipping up the intermediate file: /home/steve/projects/climateprediction.net/oifs_43r3_ps_0894_1994050100_123_963_12180538_0_r1683884544_39.zip
Uploading the intermediate file: upload_file_39.zip
  23:54:09 STEP  961 H= 961:00 +CPU= 52.276
  23:55:03 STEP  962 H= 962:00 +CPU= 54.064
  23:56:20 STEP  963 H= 963:00 +CPU= 75.777
  23:57:14 STEP  964 H= 964:00 +CPU= 52.988
  23:58:04 STEP  965 H= 965:00 +CPU= 50.124
  23:59:21 STEP  966 H= 966:00 +CPU= 76.097
  00:00:15 STEP  967 H= 967:00 +CPU= 52.409
  00:01:04 STEP  968 H= 968:00 +CPU= 48.340
  00:02:23 STEP  969 H= 969:00 +CPU= 78.218
  00:03:14 STEP  970 H= 970:00 +CPU= 50.233
  00:04:07 STEP  971 H= 971:00 +CPU= 52.803
  00:05:33 STEP  972 H= 972:00 +CPU= 83.985
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+000972
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+000972
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+000972
  00:06:24 STEP  973 H= 973:00 +CPU= 50.754
  00:07:16 STEP  974 H= 974:00 +CPU= 50.965
  00:08:37 STEP  975 H= 975:00 +CPU= 80.688
  00:09:26 STEP  976 H= 976:00 +CPU= 48.240
  00:10:20 STEP  977 H= 977:00 +CPU= 52.701
  00:11:40 STEP  978 H= 978:00 +CPU= 78.902
  00:12:34 STEP  979 H= 979:00 +CPU= 53.336
  00:13:26 STEP  980 H= 980:00 +CPU= 51.311
  00:14:41 STEP  981 H= 981:00 +CPU= 73.745
  00:15:34 STEP  982 H= 982:00 +CPU= 52.603
  00:16:33 STEP  983 H= 983:00 +CPU= 57.344
  00:18:03 STEP  984 H= 984:00 +CPU= 89.315
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+000984
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+000984
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+000984
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+000960
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+000960
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+000960
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+000972
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+000972
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+000972
Zipping up the intermediate file: /home/steve/projects/climateprediction.net/oifs_43r3_ps_0894_1994050100_123_963_12180538_0_r1683884544_40.zip
Uploading the intermediate file: upload_file_40.zip
  00:18:56 STEP  985 H= 985:00 +CPU= 51.915
  00:19:46 STEP  986 H= 986:00 +CPU= 49.468
  00:21:06 STEP  987 H= 987:00 +CPU= 78.522
  00:21:59 STEP  988 H= 988:00 +CPU= 52.603
  00:22:48 STEP  989 H= 989:00 +CPU= 48.439
  00:24:07 STEP  990 H= 990:00 +CPU= 78.090
  00:25:01 STEP  991 H= 991:00 +CPU= 53.071
  00:25:56 STEP  992 H= 992:00 +CPU= 53.596
  00:27:08 STEP  993 H= 993:00 +CPU= 71.488
  00:27:58 STEP  994 H= 994:00 +CPU= 49.160
  00:28:50 STEP  995 H= 995:00 +CPU= 51.012
  00:30:17 STEP  996 H= 996:00 +CPU= 86.767
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+000996
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+000996
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+000996
  00:31:08 STEP  997 H= 997:00 +CPU= 49.588
  00:32:00 STEP  998 H= 998:00 +CPU= 51.626
  00:33:18 STEP  999 H= 999:00 +CPU= 77.064
  00:34:10 STEP 1000 H=1000:00 +CPU= 50.993
  00:35:01 STEP 1001 H=1001:00 +CPU= 50.734
  00:36:18 STEP 1002 H=1002:00 +CPU= 75.193
  00:37:08 STEP 1003 H=1003:00 +CPU= 49.976
  00:38:02 STEP 1004 H=1004:00 +CPU= 53.281
  00:39:19 STEP 1005 H=1005:00 +CPU= 75.852
  00:40:10 STEP 1006 H=1006:00 +CPU= 49.842
  00:41:05 STEP 1007 H=1007:00 +CPU= 54.634
  00:42:35 STEP 1008 H=1008:00 +CPU= 88.550
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+001008
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+001008
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+001008
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+000984
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+000984
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+000984
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+000996
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+000996
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+000996
Zipping up the intermediate file: /home/steve/projects/climateprediction.net/oifs_43r3_ps_0894_1994050100_123_963_12180538_0_r1683884544_41.zip
Uploading the intermediate file: upload_file_41.zip
  00:43:27 STEP 1009 H=1009:00 +CPU= 50.833
  00:44:25 STEP 1010 H=1010:00 +CPU= 57.305
  00:45:39 STEP 1011 H=1011:00 +CPU= 72.887
  00:46:32 STEP 1012 H=1012:00 +CPU= 51.800
  00:47:21 STEP 1013 H=1013:00 +CPU= 48.422
  00:48:38 STEP 1014 H=1014:00 +CPU= 76.260
  00:49:29 STEP 1015 H=1015:00 +CPU= 49.897
  00:50:24 STEP 1016 H=1016:00 +CPU= 54.790
  00:51:42 STEP 1017 H=1017:00 +CPU= 76.793
  00:52:35 STEP 1018 H=1018:00 +CPU= 52.632
  00:53:28 STEP 1019 H=1019:00 +CPU= 51.942
  00:54:54 STEP 1020 H=1020:00 +CPU= 85.383
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+001020
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+001020
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+001020
  00:55:44 STEP 1021 H=1021:00 +CPU= 48.878
  00:56:36 STEP 1022 H=1022:00 +CPU= 51.775
  00:57:54 STEP 1023 H=1023:00 +CPU= 76.750
  00:58:45 STEP 1024 H=1024:00 +CPU= 50.672
  00:59:38 STEP 1025 H=1025:00 +CPU= 52.110
  01:00:55 STEP 1026 H=1026:00 +CPU= 75.466
  01:01:46 STEP 1027 H=1027:00 +CPU= 50.498
  01:02:41 STEP 1028 H=1028:00 +CPU= 54.645
  01:03:57 STEP 1029 H=1029:00 +CPU= 74.858
  01:04:50 STEP 1030 H=1030:00 +CPU= 52.280
  01:05:45 STEP 1031 H=1031:00 +CPU= 54.319
  01:07:14 STEP 1032 H=1032:00 +CPU= 87.466
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+001032
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+001032
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+001032
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+001008
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+001008
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+001008
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+001020
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+001020
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+001020
Zipping up the intermediate file: /home/steve/projects/climateprediction.net/oifs_43r3_ps_0894_1994050100_123_963_12180538_0_r1683884544_42.zip
Uploading the intermediate file: upload_file_42.zip
Uploading trickle at timestep: 3715200
  01:08:06 STEP 1033 H=1033:00 +CPU= 50.833
  01:09:00 STEP 1034 H=1034:00 +CPU= 53.569
  01:10:12 STEP 1035 H=1035:00 +CPU= 71.223
  01:11:04 STEP 1036 H=1036:00 +CPU= 51.183
  01:12:00 STEP 1037 H=1037:00 +CPU= 54.672
  01:13:17 STEP 1038 H=1038:00 +CPU= 76.187
  01:14:10 STEP 1039 H=1039:00 +CPU= 52.399
  01:15:04 STEP 1040 H=1040:00 +CPU= 53.578
  01:16:23 STEP 1041 H=1041:00 +CPU= 77.881
  01:17:17 STEP 1042 H=1042:00 +CPU= 52.698
  01:18:09 STEP 1043 H=1043:00 +CPU= 51.801
  01:19:34 STEP 1044 H=1044:00 +CPU= 83.875
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+001044
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+001044
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+001044
  01:20:29 STEP 1045 H=1045:00 +CPU= 54.163
  01:21:21 STEP 1046 H=1046:00 +CPU= 50.420
  01:22:37 STEP 1047 H=1047:00 +CPU= 75.586
  01:23:32 STEP 1048 H=1048:00 +CPU= 53.759
  01:24:23 STEP 1049 H=1049:00 +CPU= 50.280
  01:25:44 STEP 1050 H=1050:00 +CPU= 79.381
  01:26:34 STEP 1051 H=1051:00 +CPU= 49.401
  01:27:28 STEP 1052 H=1052:00 +CPU= 53.072
  01:28:45 STEP 1053 H=1053:00 +CPU= 75.444
  01:29:38 STEP 1054 H=1054:00 +CPU= 51.893
  01:30:32 STEP 1055 H=1055:00 +CPU= 53.303
  01:32:09 STEP 1056 H=1056:00 +CPU= 95.136
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+001056
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+001056
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+001056
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+001032
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+001032
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+001032
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+001044
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+001044
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+001044
Zipping up the intermediate file: /home/steve/projects/climateprediction.net/oifs_43r3_ps_0894_1994050100_123_963_12180538_0_r1683884544_43.zip
Uploading the intermediate file: upload_file_43.zip
  01:33:01 STEP 1057 H=1057:00 +CPU= 51.656
  01:33:54 STEP 1058 H=1058:00 +CPU= 52.780
  01:35:09 STEP 1059 H=1059:00 +CPU= 73.732
  01:36:02 STEP 1060 H=1060:00 +CPU= 51.925
  01:36:53 STEP 1061 H=1061:00 +CPU= 50.086
  01:38:10 STEP 1062 H=1062:00 +CPU= 76.366
  01:39:08 STEP 1063 H=1063:00 +CPU= 56.657
  01:39:58 STEP 1064 H=1064:00 +CPU= 49.143
  01:41:14 STEP 1065 H=1065:00 +CPU= 75.020
  01:42:04 STEP 1066 H=1066:00 +CPU= 49.674
  01:42:58 STEP 1067 H=1067:00 +CPU= 53.028
  01:44:20 STEP 1068 H=1068:00 +CPU= 81.134
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+001068
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+001068
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+001068
  01:45:11 STEP 1069 H=1069:00 +CPU= 50.319
  01:46:01 STEP 1070 H=1070:00 +CPU= 49.516
  01:47:17 STEP 1071 H=1071:00 +CPU= 74.556
  01:48:09 STEP 1072 H=1072:00 +CPU= 51.123
  01:49:01 STEP 1073 H=1073:00 +CPU= 52.014
  01:50:22 STEP 1074 H=1074:00 +CPU= 79.115
  01:51:13 STEP 1075 H=1075:00 +CPU= 50.079
  01:52:05 STEP 1076 H=1076:00 +CPU= 51.652
  01:53:26 STEP 1077 H=1077:00 +CPU= 79.421
  01:54:18 STEP 1078 H=1078:00 +CPU= 51.612
  01:55:11 STEP 1079 H=1079:00 +CPU= 52.489
  01:56:46 STEP 1080 H=1080:00 +CPU= 93.207
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+001080
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+001080
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+001080
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+001056
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+001056
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+001056
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+001068
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+001068
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+001068
Zipping up the intermediate file: /home/steve/projects/climateprediction.net/oifs_43r3_ps_0894_1994050100_123_963_12180538_0_r1683884544_44.zip
Uploading the intermediate file: upload_file_44.zip
  01:57:36 STEP 1081 H=1081:00 +CPU= 49.585
  01:58:29 STEP 1082 H=1082:00 +CPU= 51.892
  01:59:48 STEP 1083 H=1083:00 +CPU= 78.155
  02:00:38 STEP 1084 H=1084:00 +CPU= 49.426
  02:01:38 STEP 1085 H=1085:00 +CPU= 59.578
  02:02:58 STEP 1086 H=1086:00 +CPU= 79.160
  02:03:51 STEP 1087 H=1087:00 +CPU= 51.862
  02:04:45 STEP 1088 H=1088:00 +CPU= 53.290
  02:06:02 STEP 1089 H=1089:00 +CPU= 75.784
  02:06:55 STEP 1090 H=1090:00 +CPU= 52.302
  02:07:47 STEP 1091 H=1091:00 +CPU= 51.756
  02:09:14 STEP 1092 H=1092:00 +CPU= 85.135
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+001092
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+001092
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+001092
  02:10:05 STEP 1093 H=1093:00 +CPU= 50.554
  02:11:02 STEP 1094 H=1094:00 +CPU= 56.051
  02:12:16 STEP 1095 H=1095:00 +CPU= 73.191
  02:13:10 STEP 1096 H=1096:00 +CPU= 53.202
  02:14:02 STEP 1097 H=1097:00 +CPU= 51.390
  02:15:21 STEP 1098 H=1098:00 +CPU= 77.945
  02:16:17 STEP 1099 H=1099:00 +CPU= 54.389
  02:17:08 STEP 1100 H=1100:00 +CPU= 50.707
  02:18:25 STEP 1101 H=1101:00 +CPU= 75.726
  02:19:19 STEP 1102 H=1102:00 +CPU= 53.059
  02:20:18 STEP 1103 H=1103:00 +CPU= 57.792
  02:21:48 STEP 1104 H=1104:00 +CPU= 88.631
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+001104
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+001104
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+001104
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+001080
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+001080
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+001080
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+001092
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+001092
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+001092
Zipping up the intermediate file: /home/steve/projects/climateprediction.net/oifs_43r3_ps_0894_1994050100_123_963_12180538_0_r1683884544_45.zip
Uploading the intermediate file: upload_file_45.zip
  02:22:41 STEP 1105 H=1105:00 +CPU= 52.348
  02:23:36 STEP 1106 H=1106:00 +CPU= 54.012
  02:24:51 STEP 1107 H=1107:00 +CPU= 74.137
  02:25:43 STEP 1108 H=1108:00 +CPU= 51.642
  02:26:38 STEP 1109 H=1109:00 +CPU= 54.462
  02:27:53 STEP 1110 H=1110:00 +CPU= 74.224
  02:28:51 STEP 1111 H=1111:00 +CPU= 57.058
  02:29:44 STEP 1112 H=1112:00 +CPU= 52.283
  02:30:59 STEP 1113 H=1113:00 +CPU= 74.253
  02:31:55 STEP 1114 H=1114:00 +CPU= 55.171
  02:32:46 STEP 1115 H=1115:00 +CPU= 49.915
  02:34:05 STEP 1116 H=1116:00 +CPU= 78.782
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+001116
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+001116
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+001116
  02:35:03 STEP 1117 H=1117:00 +CPU= 56.467
  02:35:57 STEP 1118 H=1118:00 +CPU= 53.559
  02:37:15 STEP 1119 H=1119:00 +CPU= 77.422
  02:38:08 STEP 1120 H=1120:00 +CPU= 52.518
  02:38:58 STEP 1121 H=1121:00 +CPU= 48.640
  02:40:16 STEP 1122 H=1122:00 +CPU= 77.522
  02:41:12 STEP 1123 H=1123:00 +CPU= 54.892
  02:42:03 STEP 1124 H=1124:00 +CPU= 50.963
  02:43:16 STEP 1125 H=1125:00 +CPU= 72.113
  02:44:11 STEP 1126 H=1126:00 +CPU= 54.304
  02:45:04 STEP 1127 H=1127:00 +CPU= 51.743
  02:46:35 STEP 1128 H=1128:00 +CPU= 89.569
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+001128
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+001128
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+001128
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+001104
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+001104
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+001104
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+001116
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+001116
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+001116
Zipping up the intermediate file: /home/steve/projects/climateprediction.net/oifs_43r3_ps_0894_1994050100_123_963_12180538_0_r1683884544_46.zip
Uploading the intermediate file: upload_file_46.zip
  02:47:27 STEP 1129 H=1129:00 +CPU= 51.143
  02:48:17 STEP 1130 H=1130:00 +CPU= 50.160
  02:49:35 STEP 1131 H=1131:00 +CPU= 76.633
  02:50:27 STEP 1132 H=1132:00 +CPU= 50.978
  02:51:20 STEP 1133 H=1133:00 +CPU= 53.244
  02:52:35 STEP 1134 H=1134:00 +CPU= 73.645
  02:53:24 STEP 1135 H=1135:00 +CPU= 48.325
  02:54:18 STEP 1136 H=1136:00 +CPU= 52.677
  02:55:37 STEP 1137 H=1137:00 +CPU= 78.056
  02:56:29 STEP 1138 H=1138:00 +CPU= 50.840
  02:57:20 STEP 1139 H=1139:00 +CPU= 50.982
  02:58:51 STEP 1140 H=1140:00 +CPU= 89.355
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+001140
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+001140
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+001140
  02:59:41 STEP 1141 H=1141:00 +CPU= 49.866
  03:00:34 STEP 1142 H=1142:00 +CPU= 52.580
  03:01:52 STEP 1143 H=1143:00 +CPU= 75.985
  03:02:43 STEP 1144 H=1144:00 +CPU= 50.565
  03:03:35 STEP 1145 H=1145:00 +CPU= 51.499
  03:04:55 STEP 1146 H=1146:00 +CPU= 78.653
  03:05:48 STEP 1147 H=1147:00 +CPU= 51.828
  03:06:41 STEP 1148 H=1148:00 +CPU= 52.427
  03:07:56 STEP 1149 H=1149:00 +CPU= 74.281
  03:08:49 STEP 1150 H=1150:00 +CPU= 51.900
  03:09:43 STEP 1151 H=1151:00 +CPU= 52.781
  03:11:12 STEP 1152 H=1152:00 +CPU= 87.548
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+001152
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+001152
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+001152
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+001128
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+001128
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+001128
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+001140
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+001140
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+001140
Zipping up the intermediate file: /home/steve/projects/climateprediction.net/oifs_43r3_ps_0894_1994050100_123_963_12180538_0_r1683884544_47.zip
Uploading the intermediate file: upload_file_47.zip
  03:12:04 STEP 1153 H=1153:00 +CPU= 52.022
  03:12:56 STEP 1154 H=1154:00 +CPU= 50.461
  03:14:09 STEP 1155 H=1155:00 +CPU= 72.085
  03:15:05 STEP 1156 H=1156:00 +CPU= 55.833
  03:15:58 STEP 1157 H=1157:00 +CPU= 51.899
  03:17:16 STEP 1158 H=1158:00 +CPU= 77.282
  03:18:06 STEP 1159 H=1159:00 +CPU= 48.461
  03:18:59 STEP 1160 H=1160:00 +CPU= 52.637
  03:20:21 STEP 1161 H=1161:00 +CPU= 81.328
  03:21:18 STEP 1162 H=1162:00 +CPU= 56.288
  03:22:15 STEP 1163 H=1163:00 +CPU= 55.602
  03:23:49 STEP 1164 H=1164:00 +CPU= 92.744
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+001164
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+001164
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+001164
  03:24:47 STEP 1165 H=1165:00 +CPU= 56.758
  03:25:45 STEP 1166 H=1166:00 +CPU= 57.301
  03:27:08 STEP 1167 H=1167:00 +CPU= 82.182
  03:28:06 STEP 1168 H=1168:00 +CPU= 57.072
  03:28:58 STEP 1169 H=1169:00 +CPU= 51.396
  03:30:24 STEP 1170 H=1170:00 +CPU= 83.907
  03:31:20 STEP 1171 H=1171:00 +CPU= 55.173
  03:32:16 STEP 1172 H=1172:00 +CPU= 55.366
  03:33:39 STEP 1173 H=1173:00 +CPU= 81.382
  03:34:36 STEP 1174 H=1174:00 +CPU= 56.264
  03:35:34 STEP 1175 H=1175:00 +CPU= 57.881
  03:37:17 STEP 1176 H=1176:00 +CPU=101.431
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+001176
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+001176
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+001176
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+001152
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+001152
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+001152
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+001164
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+001164
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+001164
Zipping up the intermediate file: /home/steve/projects/climateprediction.net/oifs_43r3_ps_0894_1994050100_123_963_12180538_0_r1683884544_48.zip
Uploading the intermediate file: upload_file_48.zip
  03:38:13 STEP 1177 H=1177:00 +CPU= 54.387
  03:39:08 STEP 1178 H=1178:00 +CPU= 54.796
  03:40:29 STEP 1179 H=1179:00 +CPU= 79.503
  03:41:29 STEP 1180 H=1180:00 +CPU= 58.745
  03:42:27 STEP 1181 H=1181:00 +CPU= 57.899
  03:43:54 STEP 1182 H=1182:00 +CPU= 84.847
  03:44:54 STEP 1183 H=1183:00 +CPU= 59.533
  03:45:53 STEP 1184 H=1184:00 +CPU= 58.037
  03:47:19 STEP 1185 H=1185:00 +CPU= 85.126
  03:48:19 STEP 1186 H=1186:00 +CPU= 59.131
  03:49:14 STEP 1187 H=1187:00 +CPU= 53.874
  03:50:48 STEP 1188 H=1188:00 +CPU= 92.644
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+001188
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+001188
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+001188
  03:51:46 STEP 1189 H=1189:00 +CPU= 57.620
  03:52:41 STEP 1190 H=1190:00 +CPU= 54.590
  03:54:07 STEP 1191 H=1191:00 +CPU= 84.615
  03:55:07 STEP 1192 H=1192:00 +CPU= 59.026
  03:56:00 STEP 1193 H=1193:00 +CPU= 52.044
  03:57:27 STEP 1194 H=1194:00 +CPU= 85.364
  03:58:23 STEP 1195 H=1195:00 +CPU= 55.549
  03:59:19 STEP 1196 H=1196:00 +CPU= 55.263
  04:00:40 STEP 1197 H=1197:00 +CPU= 79.426
  04:01:44 STEP 1198 H=1198:00 +CPU= 63.504
  04:02:39 STEP 1199 H=1199:00 +CPU= 53.671
  04:04:28 STEP 1200 H=1200:00 +CPU=107.551
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+001200
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+001200
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+001200
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+001176
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+001176
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+001176
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+001188
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+001188
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+001188
Zipping up the intermediate file: /home/steve/projects/climateprediction.net/oifs_43r3_ps_0894_1994050100_123_963_12180538_0_r1683884544_49.zip
Uploading the intermediate file: upload_file_49.zip
  04:05:26 STEP 1201 H=1201:00 +CPU= 57.708
  04:06:23 STEP 1202 H=1202:00 +CPU= 56.164
  04:07:45 STEP 1203 H=1203:00 +CPU= 80.632
  04:08:41 STEP 1204 H=1204:00 +CPU= 55.512
  04:09:38 STEP 1205 H=1205:00 +CPU= 55.983
  04:11:04 STEP 1206 H=1206:00 +CPU= 84.099
  04:12:04 STEP 1207 H=1207:00 +CPU= 59.835
  04:13:01 STEP 1208 H=1208:00 +CPU= 55.674
  04:14:22 STEP 1209 H=1209:00 +CPU= 80.431
  04:15:17 STEP 1210 H=1210:00 +CPU= 53.341
  04:16:11 STEP 1211 H=1211:00 +CPU= 52.988
  04:17:44 STEP 1212 H=1212:00 +CPU= 91.579
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+001212
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+001212
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+001212
  04:18:40 STEP 1213 H=1213:00 +CPU= 56.020
  04:19:38 STEP 1214 H=1214:00 +CPU= 57.006
  04:21:06 STEP 1215 H=1215:00 +CPU= 86.334
  04:22:03 STEP 1216 H=1216:00 +CPU= 56.381
  04:22:58 STEP 1217 H=1217:00 +CPU= 54.364
  04:24:20 STEP 1218 H=1218:00 +CPU= 80.857
  04:25:17 STEP 1219 H=1219:00 +CPU= 56.082
  04:26:13 STEP 1220 H=1220:00 +CPU= 55.043
  04:27:39 STEP 1221 H=1221:00 +CPU= 84.506
  04:28:34 STEP 1222 H=1222:00 +CPU= 54.005
  04:29:32 STEP 1223 H=1223:00 +CPU= 57.284
  04:31:15 STEP 1224 H=1224:00 +CPU=100.975
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+001224
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+001224
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+001224
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+001200
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+001200
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+001200
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+001212
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+001212
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+001212
Zipping up the intermediate file: /home/steve/projects/climateprediction.net/oifs_43r3_ps_0894_1994050100_123_963_12180538_0_r1683884544_50.zip
Uploading the intermediate file: upload_file_50.zip
  04:32:12 STEP 1225 H=1225:00 +CPU= 55.929
  04:33:13 STEP 1226 H=1226:00 +CPU= 59.991
  04:34:33 STEP 1227 H=1227:00 +CPU= 79.337
  04:35:31 STEP 1228 H=1228:00 +CPU= 57.698
  04:36:27 STEP 1229 H=1229:00 +CPU= 55.187
  04:37:49 STEP 1230 H=1230:00 +CPU= 80.718
  04:38:50 STEP 1231 H=1231:00 +CPU= 60.222
  04:39:51 STEP 1232 H=1232:00 +CPU= 59.616
  04:41:14 STEP 1233 H=1233:00 +CPU= 81.858
  04:42:12 STEP 1234 H=1234:00 +CPU= 57.464
  04:43:07 STEP 1235 H=1235:00 +CPU= 53.640
  04:44:37 STEP 1236 H=1236:00 +CPU= 89.078
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+001236
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+001236
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+001236
  04:45:33 STEP 1237 H=1237:00 +CPU= 54.937
  04:46:32 STEP 1238 H=1238:00 +CPU= 58.328
  04:47:52 STEP 1239 H=1239:00 +CPU= 79.693
  04:48:56 STEP 1240 H=1240:00 +CPU= 62.958
  04:49:51 STEP 1241 H=1241:00 +CPU= 53.712
  04:51:16 STEP 1242 H=1242:00 +CPU= 84.328
  04:52:16 STEP 1243 H=1243:00 +CPU= 58.948
  04:53:16 STEP 1244 H=1244:00 +CPU= 58.546
  04:54:38 STEP 1245 H=1245:00 +CPU= 80.396
  04:55:33 STEP 1246 H=1246:00 +CPU= 54.452
  04:56:38 STEP 1247 H=1247:00 +CPU= 64.228
  04:58:22 STEP 1248 H=1248:00 +CPU=102.509
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+001248
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+001248
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+001248
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+001224
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+001224
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+001224
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+001236
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+001236
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+001236
Zipping up the intermediate file: /home/steve/projects/climateprediction.net/oifs_43r3_ps_0894_1994050100_123_963_12180538_0_r1683884544_51.zip
Uploading the intermediate file: upload_file_51.zip
  04:59:22 STEP 1249 H=1249:00 +CPU= 59.582
  05:00:24 STEP 1250 H=1250:00 +CPU= 60.428
  05:01:56 STEP 1251 H=1251:00 +CPU= 91.267
  05:02:57 STEP 1252 H=1252:00 +CPU= 59.966
  05:03:56 STEP 1253 H=1253:00 +CPU= 58.491
  05:05:22 STEP 1254 H=1254:00 +CPU= 84.438
  05:06:22 STEP 1255 H=1255:00 +CPU= 59.461
  05:07:24 STEP 1256 H=1256:00 +CPU= 61.820
  05:08:49 STEP 1257 H=1257:00 +CPU= 84.221
  05:09:52 STEP 1258 H=1258:00 +CPU= 61.854
  05:10:51 STEP 1259 H=1259:00 +CPU= 58.245
  05:12:33 STEP 1260 H=1260:00 +CPU=100.846
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+001260
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+001260
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+001260
  05:13:34 STEP 1261 H=1261:00 +CPU= 60.716
  05:14:35 STEP 1262 H=1262:00 +CPU= 59.878
  05:16:03 STEP 1263 H=1263:00 +CPU= 87.153
  05:17:08 STEP 1264 H=1264:00 +CPU= 63.691
  05:18:06 STEP 1265 H=1265:00 +CPU= 57.174
  05:19:37 STEP 1266 H=1266:00 +CPU= 90.898
  05:20:35 STEP 1267 H=1267:00 +CPU= 56.628
  05:21:39 STEP 1268 H=1268:00 +CPU= 63.898
  05:23:08 STEP 1269 H=1269:00 +CPU= 87.535
  05:24:12 STEP 1270 H=1270:00 +CPU= 63.497
  05:25:14 STEP 1271 H=1271:00 +CPU= 60.781
  05:27:10 STEP 1272 H=1272:00 +CPU=114.524
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+001272
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+001272
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+001272
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+001248
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+001248
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+001248
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+001260
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+001260
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+001260
Zipping up the intermediate file: /home/steve/projects/climateprediction.net/oifs_43r3_ps_0894_1994050100_123_963_12180538_0_r1683884544_52.zip
Uploading the intermediate file: upload_file_52.zip
Uploading trickle at timestep: 4579200
  05:28:09 STEP 1273 H=1273:00 +CPU= 57.779
  05:29:13 STEP 1274 H=1274:00 +CPU= 63.235
  05:30:38 STEP 1275 H=1275:00 +CPU= 84.858
  05:31:38 STEP 1276 H=1276:00 +CPU= 59.206
  05:32:39 STEP 1277 H=1277:00 +CPU= 59.912
  05:34:12 STEP 1278 H=1278:00 +CPU= 92.085
  05:35:12 STEP 1279 H=1279:00 +CPU= 58.918
  05:36:14 STEP 1280 H=1280:00 +CPU= 61.251
  05:37:44 STEP 1281 H=1281:00 +CPU= 88.564
  05:38:43 STEP 1282 H=1282:00 +CPU= 58.628
  05:39:43 STEP 1283 H=1283:00 +CPU= 59.481
  05:41:18 STEP 1284 H=1284:00 +CPU= 93.628
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+001284
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+001284
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+001284
  05:42:18 STEP 1285 H=1285:00 +CPU= 59.004
  05:43:25 STEP 1286 H=1286:00 +CPU= 66.104
  05:44:51 STEP 1287 H=1287:00 +CPU= 85.400
  05:45:55 STEP 1288 H=1288:00 +CPU= 62.706
  05:46:54 STEP 1289 H=1289:00 +CPU= 58.044
  05:48:26 STEP 1290 H=1290:00 +CPU= 91.647
  05:49:26 STEP 1291 H=1291:00 +CPU= 59.016
  05:50:33 STEP 1292 H=1292:00 +CPU= 65.905
  05:52:04 STEP 1293 H=1293:00 +CPU= 89.528
  05:53:09 STEP 1294 H=1294:00 +CPU= 64.498
  05:54:13 STEP 1295 H=1295:00 +CPU= 62.238
  05:56:00 STEP 1296 H=1296:00 +CPU=105.897
Moving to projects directory: /home/steve/slots/20/ICMGGhq0f+001296
Moving to projects directory: /home/steve/slots/20/ICMSHhq0f+001296
Moving to projects directory: /home/steve/slots/20/ICMUAhq0f+001296
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+001272
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+001272
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+001272
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMGGhq0f+001284
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMSHhq0f+001284
Adding to the zip: /home/steve/projects/climateprediction.net/oifs_43r3_ps_12180538/ICMUAhq0f+001284
Zipping up the intermediate file: /home/steve/projects/climateprediction.net/oifs_43r3_ps_0894_1994050100_123_963_12180538_0_r1683884544_53.zip
Uploading the intermediate file: upload_file_53.zip
  05:57:03 STEP 1297 H=1297:00 +CPU= 62.171
  05:58:08 STEP 1298 H=1298:00 +CPU= 63.735
Abort request received from BOINC client, ending the child process

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:16:40 1536520 22265504 oifs_43r3_ps_0894_1994050100_123_963_12180538_0 4,579,200 78,433 0.0171
09 May 2023 16:16:27 1536520 22265504 oifs_43r3_ps_0894_1994050100_123_963_12180538_0 3,715,200 63,066 0.0170
09 May 2023 16:16:13 1536520 22265504 oifs_43r3_ps_0894_1994050100_123_963_12180538_0 2,851,200 48,333 0.0170


©2024 climateprediction.net