climateprediction.net home page
Task 22280115

Task 22280115

Name oifs_43r3_ps_0644_2008050100_123_977_12194288_0
Workunit 12194288
Created 23 Dec 2022, 18:58:36 UTC
Sent 23 Dec 2022, 19:22:27 UTC
Report deadline 22 Jan 2023, 19:22:27 UTC
Received 24 Dec 2022, 7:30:27 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1528749
Run time 10 hours 38 min 50 sec
CPU time 10 hours 36 min 17 sec
Validate state Invalid
Credit 10,886.40
Device peak FLOPS 7.52 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,396.41 MB
Peak swap size 4,974.80 MB
Peak disk usage 1,222.92 MB
Stderr
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
on.net/oifs_43r3_ps_12194288/ICMUAhq0f+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMGGhq0f+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMSHhq0f+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMUAhq0f+001836
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0644_2008050100_123_977_12194288_0_r400635784_76.zip
Uploading the intermediate file: upload_file_76.zip
  05:09:01 STEP 1849 H=1849:00 +CPU= 12.665
  05:09:14 STEP 1850 H=1850:00 +CPU= 13.042
  05:09:34 STEP 1851 H=1851:00 +CPU= 20.747
  05:09:47 STEP 1852 H=1852:00 +CPU= 12.915
  05:10:00 STEP 1853 H=1853:00 +CPU= 12.725
  05:10:21 STEP 1854 H=1854:00 +CPU= 20.698
  05:10:34 STEP 1855 H=1855:00 +CPU= 13.095
  05:10:47 STEP 1856 H=1856:00 +CPU= 13.380
  05:11:08 STEP 1857 H=1857:00 +CPU= 20.369
  05:11:21 STEP 1858 H=1858:00 +CPU= 13.398
  05:11:34 STEP 1859 H=1859:00 +CPU= 13.158
  05:11:58 STEP 1860 H=1860:00 +CPU= 23.385
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+001860
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+001860
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+001860
  05:12:11 STEP 1861 H=1861:00 +CPU= 12.808
  05:12:24 STEP 1862 H=1862:00 +CPU= 13.113
  05:12:44 STEP 1863 H=1863:00 +CPU= 20.547
  05:12:58 STEP 1864 H=1864:00 +CPU= 13.279
  05:13:10 STEP 1865 H=1865:00 +CPU= 12.771
  05:13:32 STEP 1866 H=1866:00 +CPU= 21.547
  05:13:45 STEP 1867 H=1867:00 +CPU= 12.426
  05:13:58 STEP 1868 H=1868:00 +CPU= 13.230
  05:14:18 STEP 1869 H=1869:00 +CPU= 20.613
  05:14:32 STEP 1870 H=1870:00 +CPU= 13.219
  05:14:45 STEP 1871 H=1871:00 +CPU= 13.214
  05:15:10 STEP 1872 H=1872:00 +CPU= 24.934
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+001872
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+001872
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMGGhq0f+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMSHhq0f+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMUAhq0f+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMGGhq0f+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMSHhq0f+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMUAhq0f+001860
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0644_2008050100_123_977_12194288_0_r400635784_77.zip
Uploading the intermediate file: upload_file_77.zip
  05:15:23 STEP 1873 H=1873:00 +CPU= 13.183
  05:15:37 STEP 1874 H=1874:00 +CPU= 13.506
  05:15:57 STEP 1875 H=1875:00 +CPU= 20.548
  05:16:11 STEP 1876 H=1876:00 +CPU= 13.359
  05:16:23 STEP 1877 H=1877:00 +CPU= 12.860
  05:16:45 STEP 1878 H=1878:00 +CPU= 21.269
  05:16:58 STEP 1879 H=1879:00 +CPU= 12.888
  05:17:11 STEP 1880 H=1880:00 +CPU= 13.208
  05:17:32 STEP 1881 H=1881:00 +CPU= 20.829
  05:17:45 STEP 1882 H=1882:00 +CPU= 13.464
  05:17:58 STEP 1883 H=1883:00 +CPU= 12.869
  05:18:21 STEP 1884 H=1884:00 +CPU= 23.161
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+001884
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+001884
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+001884
  05:18:34 STEP 1885 H=1885:00 +CPU= 12.795
  05:18:47 STEP 1886 H=1886:00 +CPU= 13.271
  05:19:08 STEP 1887 H=1887:00 +CPU= 20.404
  05:19:22 STEP 1888 H=1888:00 +CPU= 13.558
  05:19:34 STEP 1889 H=1889:00 +CPU= 12.962
  05:19:56 STEP 1890 H=1890:00 +CPU= 21.333
  05:20:09 STEP 1891 H=1891:00 +CPU= 12.738
  05:20:22 STEP 1892 H=1892:00 +CPU= 13.172
  05:20:43 STEP 1893 H=1893:00 +CPU= 21.146
  05:20:56 STEP 1894 H=1894:00 +CPU= 13.305
  05:21:10 STEP 1895 H=1895:00 +CPU= 13.227
  05:21:34 STEP 1896 H=1896:00 +CPU= 24.308
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+001896
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+001896
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMGGhq0f+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMSHhq0f+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMUAhq0f+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMGGhq0f+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMSHhq0f+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMUAhq0f+001884
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0644_2008050100_123_977_12194288_0_r400635784_78.zip
Uploading the intermediate file: upload_file_78.zip
  05:21:47 STEP 1897 H=1897:00 +CPU= 13.040
  05:22:01 STEP 1898 H=1898:00 +CPU= 13.472
  05:22:21 STEP 1899 H=1899:00 +CPU= 20.398
  05:22:34 STEP 1900 H=1900:00 +CPU= 13.318
  05:22:47 STEP 1901 H=1901:00 +CPU= 12.941
  05:23:08 STEP 1902 H=1902:00 +CPU= 21.009
  05:23:21 STEP 1903 H=1903:00 +CPU= 12.773
  05:23:35 STEP 1904 H=1904:00 +CPU= 13.443
  05:23:55 STEP 1905 H=1905:00 +CPU= 20.666
  05:24:08 STEP 1906 H=1906:00 +CPU= 13.212
  05:24:21 STEP 1907 H=1907:00 +CPU= 12.924
  05:24:45 STEP 1908 H=1908:00 +CPU= 23.289
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+001908
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+001908
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+001908
  05:24:58 STEP 1909 H=1909:00 +CPU= 12.880
  05:25:11 STEP 1910 H=1910:00 +CPU= 13.331
  05:25:31 STEP 1911 H=1911:00 +CPU= 20.429
  05:25:45 STEP 1912 H=1912:00 +CPU= 13.919
  05:25:59 STEP 1913 H=1913:00 +CPU= 13.081
  05:26:20 STEP 1914 H=1914:00 +CPU= 21.295
  05:26:33 STEP 1915 H=1915:00 +CPU= 12.837
  05:26:46 STEP 1916 H=1916:00 +CPU= 13.132
  05:27:07 STEP 1917 H=1917:00 +CPU= 20.671
  05:27:20 STEP 1918 H=1918:00 +CPU= 13.077
  05:27:33 STEP 1919 H=1919:00 +CPU= 13.325
  05:27:57 STEP 1920 H=1920:00 +CPU= 24.246
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+001920
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+001920
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMGGhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMSHhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMUAhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMGGhq0f+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMSHhq0f+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMUAhq0f+001908
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0644_2008050100_123_977_12194288_0_r400635784_79.zip
Uploading the intermediate file: upload_file_79.zip
  05:28:10 STEP 1921 H=1921:00 +CPU= 12.831
Uploading trickle at timestep: 6912000
  05:28:24 STEP 1922 H=1922:00 +CPU= 13.277
  05:28:44 STEP 1923 H=1923:00 +CPU= 20.655
  05:28:57 STEP 1924 H=1924:00 +CPU= 13.000
  05:29:10 STEP 1925 H=1925:00 +CPU= 12.702
  05:29:31 STEP 1926 H=1926:00 +CPU= 20.990
  05:29:44 STEP 1927 H=1927:00 +CPU= 13.186
  05:29:57 STEP 1928 H=1928:00 +CPU= 13.208
  05:30:18 STEP 1929 H=1929:00 +CPU= 20.700
  05:30:31 STEP 1930 H=1930:00 +CPU= 13.279
  05:30:45 STEP 1931 H=1931:00 +CPU= 13.119
  05:31:08 STEP 1932 H=1932:00 +CPU= 23.108
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+001932
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+001932
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+001932
  05:31:21 STEP 1933 H=1933:00 +CPU= 13.149
  05:31:34 STEP 1934 H=1934:00 +CPU= 12.759
  05:31:55 STEP 1935 H=1935:00 +CPU= 21.083
  05:32:09 STEP 1936 H=1936:00 +CPU= 13.795
  05:32:22 STEP 1937 H=1937:00 +CPU= 12.882
  05:32:43 STEP 1938 H=1938:00 +CPU= 21.261
  05:32:56 STEP 1939 H=1939:00 +CPU= 12.832
  05:33:09 STEP 1940 H=1940:00 +CPU= 12.998
  05:33:30 STEP 1941 H=1941:00 +CPU= 20.994
  05:33:43 STEP 1942 H=1942:00 +CPU= 13.440
  05:33:56 STEP 1943 H=1943:00 +CPU= 13.170
  05:34:21 STEP 1944 H=1944:00 +CPU= 24.414
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+001944
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+001944
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMGGhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMSHhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMUAhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMGGhq0f+001932
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMSHhq0f+001932
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMUAhq0f+001932
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0644_2008050100_123_977_12194288_0_r400635784_80.zip
Uploading the intermediate file: upload_file_80.zip
  05:34:34 STEP 1945 H=1945:00 +CPU= 13.241
  05:34:48 STEP 1946 H=1946:00 +CPU= 13.378
  05:35:08 STEP 1947 H=1947:00 +CPU= 20.785
  05:35:22 STEP 1948 H=1948:00 +CPU= 13.736
  05:35:35 STEP 1949 H=1949:00 +CPU= 13.011
  05:35:56 STEP 1950 H=1950:00 +CPU= 21.232
  05:36:09 STEP 1951 H=1951:00 +CPU= 12.712
  05:36:22 STEP 1952 H=1952:00 +CPU= 13.293
  05:36:43 STEP 1953 H=1953:00 +CPU= 20.691
  05:36:57 STEP 1954 H=1954:00 +CPU= 13.329
  05:37:10 STEP 1955 H=1955:00 +CPU= 13.072
  05:37:33 STEP 1956 H=1956:00 +CPU= 23.118
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+001956
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+001956
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+001956
  05:37:46 STEP 1957 H=1957:00 +CPU= 13.237
  05:37:59 STEP 1958 H=1958:00 +CPU= 13.417
  05:38:20 STEP 1959 H=1959:00 +CPU= 20.792
  05:38:34 STEP 1960 H=1960:00 +CPU= 13.389
  05:38:46 STEP 1961 H=1961:00 +CPU= 12.548
  05:39:08 STEP 1962 H=1962:00 +CPU= 21.426
  05:39:21 STEP 1963 H=1963:00 +CPU= 12.960
  05:39:34 STEP 1964 H=1964:00 +CPU= 13.466
  05:39:55 STEP 1965 H=1965:00 +CPU= 20.901
  05:40:08 STEP 1966 H=1966:00 +CPU= 13.101
  05:40:22 STEP 1967 H=1967:00 +CPU= 13.403
  05:40:46 STEP 1968 H=1968:00 +CPU= 24.527
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+001968
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+001968
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMGGhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMSHhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMUAhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMGGhq0f+001956
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMSHhq0f+001956
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMUAhq0f+001956
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0644_2008050100_123_977_12194288_0_r400635784_81.zip
Uploading the intermediate file: upload_file_81.zip
  05:41:00 STEP 1969 H=1969:00 +CPU= 13.283
  05:41:14 STEP 1970 H=1970:00 +CPU= 13.806
  05:41:35 STEP 1971 H=1971:00 +CPU= 20.998
  05:41:48 STEP 1972 H=1972:00 +CPU= 13.286
  05:42:01 STEP 1973 H=1973:00 +CPU= 13.181
  05:42:23 STEP 1974 H=1974:00 +CPU= 21.433
  05:42:36 STEP 1975 H=1975:00 +CPU= 13.191
  05:42:49 STEP 1976 H=1976:00 +CPU= 13.448
  05:43:10 STEP 1977 H=1977:00 +CPU= 20.348
  05:43:23 STEP 1978 H=1978:00 +CPU= 13.877
  05:43:36 STEP 1979 H=1979:00 +CPU= 12.902
  05:44:00 STEP 1980 H=1980:00 +CPU= 23.090
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+001980
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+001980
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+001980
  05:44:13 STEP 1981 H=1981:00 +CPU= 13.236
  05:44:26 STEP 1982 H=1982:00 +CPU= 13.262
  05:44:47 STEP 1983 H=1983:00 +CPU= 20.870
  05:45:01 STEP 1984 H=1984:00 +CPU= 13.708
  05:45:14 STEP 1985 H=1985:00 +CPU= 12.995
  05:45:35 STEP 1986 H=1986:00 +CPU= 21.143
  05:45:48 STEP 1987 H=1987:00 +CPU= 12.956
  05:46:01 STEP 1988 H=1988:00 +CPU= 13.475
  05:46:22 STEP 1989 H=1989:00 +CPU= 20.671
  05:46:35 STEP 1990 H=1990:00 +CPU= 13.215
  05:46:49 STEP 1991 H=1991:00 +CPU= 13.364
  05:47:14 STEP 1992 H=1992:00 +CPU= 24.771
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+001992
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+001992
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMGGhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMSHhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMUAhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMGGhq0f+001980
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMSHhq0f+001980
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMUAhq0f+001980
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0644_2008050100_123_977_12194288_0_r400635784_82.zip
Uploading the intermediate file: upload_file_82.zip
  05:47:26 STEP 1993 H=1993:00 +CPU= 12.833
  05:47:40 STEP 1994 H=1994:00 +CPU= 13.170
  05:48:00 STEP 1995 H=1995:00 +CPU= 20.491
  05:48:13 STEP 1996 H=1996:00 +CPU= 13.305
  05:48:27 STEP 1997 H=1997:00 +CPU= 13.074
  05:48:47 STEP 1998 H=1998:00 +CPU= 20.927
  05:49:01 STEP 1999 H=1999:00 +CPU= 13.404
  05:49:15 STEP 2000 H=2000:00 +CPU= 13.655
  05:49:36 STEP 2001 H=2001:00 +CPU= 20.998
  05:49:49 STEP 2002 H=2002:00 +CPU= 13.357
  05:50:02 STEP 2003 H=2003:00 +CPU= 12.727
  05:50:25 STEP 2004 H=2004:00 +CPU= 22.860
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002004
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002004
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002004
  05:50:38 STEP 2005 H=2005:00 +CPU= 13.191
  05:50:51 STEP 2006 H=2006:00 +CPU= 13.294
  05:51:12 STEP 2007 H=2007:00 +CPU= 20.900
  05:51:26 STEP 2008 H=2008:00 +CPU= 13.597
  05:51:39 STEP 2009 H=2009:00 +CPU= 12.950
  05:52:00 STEP 2010 H=2010:00 +CPU= 20.883
  05:52:13 STEP 2011 H=2011:00 +CPU= 12.888
  05:52:26 STEP 2012 H=2012:00 +CPU= 13.312
  05:52:47 STEP 2013 H=2013:00 +CPU= 21.321
  05:53:01 STEP 2014 H=2014:00 +CPU= 13.272
  05:53:14 STEP 2015 H=2015:00 +CPU= 13.192
  05:53:38 STEP 2016 H=2016:00 +CPU= 24.582
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002016
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002016
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMGGhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMSHhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMUAhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMGGhq0f+002004
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMSHhq0f+002004
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMUAhq0f+002004
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0644_2008050100_123_977_12194288_0_r400635784_83.zip
Uploading the intermediate file: upload_file_83.zip
  05:53:51 STEP 2017 H=2017:00 +CPU= 12.647
  05:54:04 STEP 2018 H=2018:00 +CPU= 13.216
  05:54:25 STEP 2019 H=2019:00 +CPU= 21.001
  05:54:39 STEP 2020 H=2020:00 +CPU= 13.205
  05:54:51 STEP 2021 H=2021:00 +CPU= 12.618
  05:55:12 STEP 2022 H=2022:00 +CPU= 21.218
  05:55:25 STEP 2023 H=2023:00 +CPU= 12.891
  05:55:39 STEP 2024 H=2024:00 +CPU= 13.221
  05:55:59 STEP 2025 H=2025:00 +CPU= 20.695
  05:56:13 STEP 2026 H=2026:00 +CPU= 13.589
  05:56:26 STEP 2027 H=2027:00 +CPU= 12.784
  05:56:49 STEP 2028 H=2028:00 +CPU= 23.073
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002028
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002028
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002028
  05:57:02 STEP 2029 H=2029:00 +CPU= 12.933
  05:57:15 STEP 2030 H=2030:00 +CPU= 13.376
  05:57:36 STEP 2031 H=2031:00 +CPU= 20.427
  05:57:49 STEP 2032 H=2032:00 +CPU= 13.357
  05:58:02 STEP 2033 H=2033:00 +CPU= 13.117
  05:58:23 STEP 2034 H=2034:00 +CPU= 20.896
  05:58:36 STEP 2035 H=2035:00 +CPU= 12.917
  05:58:49 STEP 2036 H=2036:00 +CPU= 13.073
  05:59:10 STEP 2037 H=2037:00 +CPU= 21.072
  05:59:24 STEP 2038 H=2038:00 +CPU= 13.421
  05:59:37 STEP 2039 H=2039:00 +CPU= 12.990
  06:00:02 STEP 2040 H=2040:00 +CPU= 24.770
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002040
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002040
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMGGhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMSHhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMUAhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMGGhq0f+002028
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMSHhq0f+002028
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMUAhq0f+002028
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0644_2008050100_123_977_12194288_0_r400635784_84.zip
Uploading the intermediate file: upload_file_84.zip
  06:00:14 STEP 2041 H=2041:00 +CPU= 12.944
  06:00:27 STEP 2042 H=2042:00 +CPU= 12.955
  06:00:48 STEP 2043 H=2043:00 +CPU= 20.414
  06:01:01 STEP 2044 H=2044:00 +CPU= 13.398
  06:01:14 STEP 2045 H=2045:00 +CPU= 12.930
  06:01:35 STEP 2046 H=2046:00 +CPU= 21.147
  06:01:49 STEP 2047 H=2047:00 +CPU= 13.010
  06:02:02 STEP 2048 H=2048:00 +CPU= 13.299
  06:02:23 STEP 2049 H=2049:00 +CPU= 21.082
  06:02:36 STEP 2050 H=2050:00 +CPU= 13.259
  06:02:49 STEP 2051 H=2051:00 +CPU= 12.837
  06:03:12 STEP 2052 H=2052:00 +CPU= 23.159
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002052
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002052
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002052
  06:03:25 STEP 2053 H=2053:00 +CPU= 13.050
  06:03:39 STEP 2054 H=2054:00 +CPU= 13.597
  06:04:00 STEP 2055 H=2055:00 +CPU= 20.742
  06:04:13 STEP 2056 H=2056:00 +CPU= 13.313
  06:04:26 STEP 2057 H=2057:00 +CPU= 12.636
  06:04:47 STEP 2058 H=2058:00 +CPU= 21.054
  06:05:00 STEP 2059 H=2059:00 +CPU= 13.345
  06:05:13 STEP 2060 H=2060:00 +CPU= 13.163
  06:05:34 STEP 2061 H=2061:00 +CPU= 20.683
  06:05:48 STEP 2062 H=2062:00 +CPU= 13.367
  06:06:01 STEP 2063 H=2063:00 +CPU= 13.081
  06:06:25 STEP 2064 H=2064:00 +CPU= 24.515
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002064
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002064
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMGGhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMSHhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMUAhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMGGhq0f+002052
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMSHhq0f+002052
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMUAhq0f+002052
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0644_2008050100_123_977_12194288_0_r400635784_85.zip
Uploading the intermediate file: upload_file_85.zip
  06:06:38 STEP 2065 H=2065:00 +CPU= 12.983
  06:06:51 STEP 2066 H=2066:00 +CPU= 13.252
  06:07:12 STEP 2067 H=2067:00 +CPU= 20.614
  06:07:25 STEP 2068 H=2068:00 +CPU= 13.264
  06:07:38 STEP 2069 H=2069:00 +CPU= 12.822
  06:07:59 STEP 2070 H=2070:00 +CPU= 20.936
  06:08:12 STEP 2071 H=2071:00 +CPU= 13.004
  06:08:26 STEP 2072 H=2072:00 +CPU= 13.405
  06:08:46 STEP 2073 H=2073:00 +CPU= 20.576
  06:08:59 STEP 2074 H=2074:00 +CPU= 12.946
  06:09:13 STEP 2075 H=2075:00 +CPU= 13.293
  06:09:36 STEP 2076 H=2076:00 +CPU= 23.205
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002076
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002076
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002076
  06:09:49 STEP 2077 H=2077:00 +CPU= 13.333
  06:10:02 STEP 2078 H=2078:00 +CPU= 13.303
  06:10:23 STEP 2079 H=2079:00 +CPU= 20.649
  06:10:37 STEP 2080 H=2080:00 +CPU= 13.418
  06:10:49 STEP 2081 H=2081:00 +CPU= 12.675
  06:11:10 STEP 2082 H=2082:00 +CPU= 21.016
  06:11:23 STEP 2083 H=2083:00 +CPU= 13.139
  06:11:37 STEP 2084 H=2084:00 +CPU= 13.354
  06:11:58 STEP 2085 H=2085:00 +CPU= 20.988
  06:12:11 STEP 2086 H=2086:00 +CPU= 13.394
  06:12:24 STEP 2087 H=2087:00 +CPU= 13.103
  06:12:49 STEP 2088 H=2088:00 +CPU= 24.318
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002088
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002088
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMGGhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMSHhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMUAhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMGGhq0f+002076
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMSHhq0f+002076
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMUAhq0f+002076
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0644_2008050100_123_977_12194288_0_r400635784_86.zip
Uploading the intermediate file: upload_file_86.zip
  06:13:02 STEP 2089 H=2089:00 +CPU= 12.907
  06:13:15 STEP 2090 H=2090:00 +CPU= 13.450
  06:13:36 STEP 2091 H=2091:00 +CPU= 20.771
  06:13:49 STEP 2092 H=2092:00 +CPU= 13.286
  06:14:02 STEP 2093 H=2093:00 +CPU= 12.809
  06:14:23 STEP 2094 H=2094:00 +CPU= 21.050
  06:14:37 STEP 2095 H=2095:00 +CPU= 13.257
  06:14:50 STEP 2096 H=2096:00 +CPU= 13.267
  06:15:10 STEP 2097 H=2097:00 +CPU= 20.539
  06:15:24 STEP 2098 H=2098:00 +CPU= 13.461
  06:15:37 STEP 2099 H=2099:00 +CPU= 12.820
  06:16:00 STEP 2100 H=2100:00 +CPU= 23.282
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002100
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002100
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002100
  06:16:13 STEP 2101 H=2101:00 +CPU= 12.755
  06:16:27 STEP 2102 H=2102:00 +CPU= 13.732
  06:16:47 STEP 2103 H=2103:00 +CPU= 20.719
  06:17:01 STEP 2104 H=2104:00 +CPU= 13.279
  06:17:14 STEP 2105 H=2105:00 +CPU= 12.908
  06:17:35 STEP 2106 H=2106:00 +CPU= 21.100
  06:17:48 STEP 2107 H=2107:00 +CPU= 12.992
  06:18:01 STEP 2108 H=2108:00 +CPU= 12.975
  06:18:21 STEP 2109 H=2109:00 +CPU= 20.250
  06:18:34 STEP 2110 H=2110:00 +CPU= 13.344
  06:18:48 STEP 2111 H=2111:00 +CPU= 13.435
  06:19:12 STEP 2112 H=2112:00 +CPU= 24.532
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002112
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002112
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMGGhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMSHhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMUAhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMGGhq0f+002100
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMSHhq0f+002100
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMUAhq0f+002100
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0644_2008050100_123_977_12194288_0_r400635784_87.zip
Uploading the intermediate file: upload_file_87.zip
  06:19:25 STEP 2113 H=2113:00 +CPU= 12.804
  06:19:38 STEP 2114 H=2114:00 +CPU= 12.908
  06:19:59 STEP 2115 H=2115:00 +CPU= 20.913
  06:20:12 STEP 2116 H=2116:00 +CPU= 12.938
  06:20:25 STEP 2117 H=2117:00 +CPU= 12.989
  06:20:47 STEP 2118 H=2118:00 +CPU= 21.581
  06:21:00 STEP 2119 H=2119:00 +CPU= 12.849
  06:21:13 STEP 2120 H=2120:00 +CPU= 13.305
  06:21:34 STEP 2121 H=2121:00 +CPU= 20.745
  06:21:47 STEP 2122 H=2122:00 +CPU= 13.425
  06:22:00 STEP 2123 H=2123:00 +CPU= 12.888
  06:22:23 STEP 2124 H=2124:00 +CPU= 23.214
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002124
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002124
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002124
  06:22:37 STEP 2125 H=2125:00 +CPU= 13.223
  06:22:50 STEP 2126 H=2126:00 +CPU= 13.480
  06:23:11 STEP 2127 H=2127:00 +CPU= 20.720
  06:23:24 STEP 2128 H=2128:00 +CPU= 13.268
  06:23:37 STEP 2129 H=2129:00 +CPU= 13.021
  06:23:58 STEP 2130 H=2130:00 +CPU= 20.855
  06:24:11 STEP 2131 H=2131:00 +CPU= 12.980
  06:24:24 STEP 2132 H=2132:00 +CPU= 13.313
  06:24:46 STEP 2133 H=2133:00 +CPU= 21.098
  06:24:59 STEP 2134 H=2134:00 +CPU= 13.438
  06:25:13 STEP 2135 H=2135:00 +CPU= 13.533
  06:25:38 STEP 2136 H=2136:00 +CPU= 24.998
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002136
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002136
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMGGhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMSHhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMUAhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMGGhq0f+002124
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMSHhq0f+002124
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMUAhq0f+002124
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0644_2008050100_123_977_12194288_0_r400635784_88.zip
Uploading the intermediate file: upload_file_88.zip
  06:25:51 STEP 2137 H=2137:00 +CPU= 13.222
  06:26:04 STEP 2138 H=2138:00 +CPU= 13.374
  06:26:25 STEP 2139 H=2139:00 +CPU= 20.952
  06:26:39 STEP 2140 H=2140:00 +CPU= 13.332
  06:26:52 STEP 2141 H=2141:00 +CPU= 12.922
  06:27:13 STEP 2142 H=2142:00 +CPU= 21.062
  06:27:26 STEP 2143 H=2143:00 +CPU= 13.244
  06:27:39 STEP 2144 H=2144:00 +CPU= 13.046
  06:28:00 STEP 2145 H=2145:00 +CPU= 20.830
  06:28:13 STEP 2146 H=2146:00 +CPU= 13.329
  06:28:26 STEP 2147 H=2147:00 +CPU= 13.170
  06:28:49 STEP 2148 H=2148:00 +CPU= 22.889
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002148
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002148
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002148
  06:29:02 STEP 2149 H=2149:00 +CPU= 12.825
  06:29:16 STEP 2150 H=2150:00 +CPU= 13.828
  06:29:37 STEP 2151 H=2151:00 +CPU= 20.417
  06:29:50 STEP 2152 H=2152:00 +CPU= 13.679
  06:30:04 STEP 2153 H=2153:00 +CPU= 13.284
  06:30:25 STEP 2154 H=2154:00 +CPU= 21.209
  06:30:38 STEP 2155 H=2155:00 +CPU= 12.766
  06:30:51 STEP 2156 H=2156:00 +CPU= 13.409
  06:31:12 STEP 2157 H=2157:00 +CPU= 20.902
  06:31:25 STEP 2158 H=2158:00 +CPU= 13.368
  06:31:39 STEP 2159 H=2159:00 +CPU= 13.401
  06:32:04 STEP 2160 H=2160:00 +CPU= 24.662
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002160
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002160
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMGGhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMSHhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMUAhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMGGhq0f+002148
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMSHhq0f+002148
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMUAhq0f+002148
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0644_2008050100_123_977_12194288_0_r400635784_89.zip
Uploading the intermediate file: upload_file_89.zip
  06:32:16 STEP 2161 H=2161:00 +CPU= 12.889
Uploading trickle at timestep: 7776000
  06:32:30 STEP 2162 H=2162:00 +CPU= 13.210
  06:32:50 STEP 2163 H=2163:00 +CPU= 20.395
  06:33:04 STEP 2164 H=2164:00 +CPU= 13.763
  06:33:17 STEP 2165 H=2165:00 +CPU= 13.082
  06:33:38 STEP 2166 H=2166:00 +CPU= 20.899
  06:33:51 STEP 2167 H=2167:00 +CPU= 12.952
  06:34:04 STEP 2168 H=2168:00 +CPU= 13.156
  06:34:24 STEP 2169 H=2169:00 +CPU= 20.354
  06:34:38 STEP 2170 H=2170:00 +CPU= 13.709
  06:34:51 STEP 2171 H=2171:00 +CPU= 12.697
  06:35:14 STEP 2172 H=2172:00 +CPU= 23.125
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002172
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002172
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002172
  06:35:27 STEP 2173 H=2173:00 +CPU= 12.849
  06:35:40 STEP 2174 H=2174:00 +CPU= 13.246
  06:36:01 STEP 2175 H=2175:00 +CPU= 20.805
  06:36:14 STEP 2176 H=2176:00 +CPU= 13.418
  06:36:27 STEP 2177 H=2177:00 +CPU= 12.922
  06:36:49 STEP 2178 H=2178:00 +CPU= 21.284
  06:37:02 STEP 2179 H=2179:00 +CPU= 12.878
  06:37:15 STEP 2180 H=2180:00 +CPU= 13.221
  06:37:36 STEP 2181 H=2181:00 +CPU= 20.706
  06:37:49 STEP 2182 H=2182:00 +CPU= 13.347
  06:38:02 STEP 2183 H=2183:00 +CPU= 13.136
  06:38:27 STEP 2184 H=2184:00 +CPU= 24.760
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002184
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002184
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMGGhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMSHhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMUAhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMGGhq0f+002172
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMSHhq0f+002172
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMUAhq0f+002172
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0644_2008050100_123_977_12194288_0_r400635784_90.zip
Uploading the intermediate file: upload_file_90.zip
  06:38:40 STEP 2185 H=2185:00 +CPU= 13.027
  06:38:53 STEP 2186 H=2186:00 +CPU= 13.052
  06:39:14 STEP 2187 H=2187:00 +CPU= 20.967
  06:39:28 STEP 2188 H=2188:00 +CPU= 13.364
  06:39:40 STEP 2189 H=2189:00 +CPU= 12.833
  06:40:02 STEP 2190 H=2190:00 +CPU= 21.203
  06:40:15 STEP 2191 H=2191:00 +CPU= 12.805
  06:40:28 STEP 2192 H=2192:00 +CPU= 13.148
  06:40:49 STEP 2193 H=2193:00 +CPU= 20.928
  06:41:02 STEP 2194 H=2194:00 +CPU= 13.420
  06:41:15 STEP 2195 H=2195:00 +CPU= 13.130
  06:41:38 STEP 2196 H=2196:00 +CPU= 22.460
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002196
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002196
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002196
  06:41:50 STEP 2197 H=2197:00 +CPU= 12.645
  06:42:04 STEP 2198 H=2198:00 +CPU= 13.655
  06:42:25 STEP 2199 H=2199:00 +CPU= 20.863
  06:42:39 STEP 2200 H=2200:00 +CPU= 13.627
  06:42:52 STEP 2201 H=2201:00 +CPU= 12.934
  06:43:13 STEP 2202 H=2202:00 +CPU= 21.209
  06:43:26 STEP 2203 H=2203:00 +CPU= 12.880
  06:43:39 STEP 2204 H=2204:00 +CPU= 13.531
  06:44:00 STEP 2205 H=2205:00 +CPU= 21.140
  06:44:14 STEP 2206 H=2206:00 +CPU= 13.094
  06:44:27 STEP 2207 H=2207:00 +CPU= 12.974
  06:44:51 STEP 2208 H=2208:00 +CPU= 24.471
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002208
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002208
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMGGhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMSHhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMUAhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMGGhq0f+002196
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMSHhq0f+002196
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMUAhq0f+002196
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0644_2008050100_123_977_12194288_0_r400635784_91.zip
Uploading the intermediate file: upload_file_91.zip
  06:45:04 STEP 2209 H=2209:00 +CPU= 12.854
  06:45:17 STEP 2210 H=2210:00 +CPU= 13.416
  06:45:38 STEP 2211 H=2211:00 +CPU= 20.483
  06:45:51 STEP 2212 H=2212:00 +CPU= 13.475
  06:46:04 STEP 2213 H=2213:00 +CPU= 12.787
  06:46:25 STEP 2214 H=2214:00 +CPU= 21.118
  06:46:39 STEP 2215 H=2215:00 +CPU= 13.092
  06:46:52 STEP 2216 H=2216:00 +CPU= 13.254
  06:47:13 STEP 2217 H=2217:00 +CPU= 21.020
  06:47:26 STEP 2218 H=2218:00 +CPU= 13.287
  06:47:39 STEP 2219 H=2219:00 +CPU= 12.789
  06:48:02 STEP 2220 H=2220:00 +CPU= 23.133
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002220
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002220
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002220
  06:48:16 STEP 2221 H=2221:00 +CPU= 13.377
  06:48:29 STEP 2222 H=2222:00 +CPU= 13.464
  06:48:50 STEP 2223 H=2223:00 +CPU= 20.492
  06:49:04 STEP 2224 H=2224:00 +CPU= 13.909
  06:49:17 STEP 2225 H=2225:00 +CPU= 12.981
  06:49:38 STEP 2226 H=2226:00 +CPU= 21.141
  06:49:51 STEP 2227 H=2227:00 +CPU= 13.045
  06:50:04 STEP 2228 H=2228:00 +CPU= 13.331
  06:50:24 STEP 2229 H=2229:00 +CPU= 20.178
  06:50:38 STEP 2230 H=2230:00 +CPU= 13.303
  06:50:51 STEP 2231 H=2231:00 +CPU= 13.299
  06:51:15 STEP 2232 H=2232:00 +CPU= 24.158
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002232
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002232
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMGGhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMSHhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMUAhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMGGhq0f+002220
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMSHhq0f+002220
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMUAhq0f+002220
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0644_2008050100_123_977_12194288_0_r400635784_92.zip
Uploading the intermediate file: upload_file_92.zip
  06:51:28 STEP 2233 H=2233:00 +CPU= 12.835
  06:51:41 STEP 2234 H=2234:00 +CPU= 13.128
  06:52:02 STEP 2235 H=2235:00 +CPU= 20.458
  06:52:15 STEP 2236 H=2236:00 +CPU= 13.232
  06:52:28 STEP 2237 H=2237:00 +CPU= 12.778
  06:52:49 STEP 2238 H=2238:00 +CPU= 21.202
  06:53:02 STEP 2239 H=2239:00 +CPU= 13.428
  06:53:16 STEP 2240 H=2240:00 +CPU= 13.183
  06:53:36 STEP 2241 H=2241:00 +CPU= 20.697
  06:53:50 STEP 2242 H=2242:00 +CPU= 13.267
  06:54:02 STEP 2243 H=2243:00 +CPU= 12.764
  06:54:25 STEP 2244 H=2244:00 +CPU= 22.846
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002244
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002244
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002244
  06:54:38 STEP 2245 H=2245:00 +CPU= 13.031
  06:54:52 STEP 2246 H=2246:00 +CPU= 13.127
  06:55:12 STEP 2247 H=2247:00 +CPU= 20.533
  06:55:26 STEP 2248 H=2248:00 +CPU= 13.712
  06:55:39 STEP 2249 H=2249:00 +CPU= 12.624
  06:56:00 STEP 2250 H=2250:00 +CPU= 21.519
  06:56:13 STEP 2251 H=2251:00 +CPU= 12.700
  06:56:26 STEP 2252 H=2252:00 +CPU= 13.287
  06:56:47 STEP 2253 H=2253:00 +CPU= 20.785
  06:57:00 STEP 2254 H=2254:00 +CPU= 13.147
  06:57:13 STEP 2255 H=2255:00 +CPU= 13.331
  06:57:38 STEP 2256 H=2256:00 +CPU= 24.367
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002256
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002256
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMGGhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMSHhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMUAhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMGGhq0f+002244
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMSHhq0f+002244
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMUAhq0f+002244
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0644_2008050100_123_977_12194288_0_r400635784_93.zip
Uploading the intermediate file: upload_file_93.zip
  06:57:51 STEP 2257 H=2257:00 +CPU= 12.997
  06:58:04 STEP 2258 H=2258:00 +CPU= 13.304
  06:58:25 STEP 2259 H=2259:00 +CPU= 20.678
  06:58:38 STEP 2260 H=2260:00 +CPU= 13.323
  06:58:52 STEP 2261 H=2261:00 +CPU= 13.248
  06:59:13 STEP 2262 H=2262:00 +CPU= 21.107
  06:59:26 STEP 2263 H=2263:00 +CPU= 13.364
  06:59:40 STEP 2264 H=2264:00 +CPU= 13.494
  07:00:01 STEP 2265 H=2265:00 +CPU= 20.964
  07:00:14 STEP 2266 H=2266:00 +CPU= 13.504
  07:00:27 STEP 2267 H=2267:00 +CPU= 13.210
  07:00:50 STEP 2268 H=2268:00 +CPU= 22.827
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002268
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002268
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002268
  07:01:03 STEP 2269 H=2269:00 +CPU= 12.926
  07:01:16 STEP 2270 H=2270:00 +CPU= 13.127
  07:01:37 STEP 2271 H=2271:00 +CPU= 20.611
  07:01:51 STEP 2272 H=2272:00 +CPU= 13.598
  07:02:04 STEP 2273 H=2273:00 +CPU= 12.935
  07:02:24 STEP 2274 H=2274:00 +CPU= 20.917
  07:02:37 STEP 2275 H=2275:00 +CPU= 12.899
  07:02:51 STEP 2276 H=2276:00 +CPU= 13.353
  07:03:12 STEP 2277 H=2277:00 +CPU= 20.714
  07:03:25 STEP 2278 H=2278:00 +CPU= 13.180
  07:03:38 STEP 2279 H=2279:00 +CPU= 13.220
  07:04:03 STEP 2280 H=2280:00 +CPU= 24.729
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002280
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002280
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMGGhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMSHhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMUAhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMGGhq0f+002268
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMSHhq0f+002268
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMUAhq0f+002268
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0644_2008050100_123_977_12194288_0_r400635784_94.zip
Uploading the intermediate file: upload_file_94.zip
  07:04:16 STEP 2281 H=2281:00 +CPU= 13.237
  07:04:29 STEP 2282 H=2282:00 +CPU= 13.353
  07:04:50 STEP 2283 H=2283:00 +CPU= 20.923
  07:05:03 STEP 2284 H=2284:00 +CPU= 12.827
  07:05:16 STEP 2285 H=2285:00 +CPU= 12.639
  07:05:37 STEP 2286 H=2286:00 +CPU= 20.703
  07:05:50 STEP 2287 H=2287:00 +CPU= 13.049
  07:06:03 STEP 2288 H=2288:00 +CPU= 13.596
  07:06:24 STEP 2289 H=2289:00 +CPU= 20.570
  07:06:37 STEP 2290 H=2290:00 +CPU= 13.079
  07:06:50 STEP 2291 H=2291:00 +CPU= 12.714
  07:07:13 STEP 2292 H=2292:00 +CPU= 23.050
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002292
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002292
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002292
  07:07:26 STEP 2293 H=2293:00 +CPU= 13.123
  07:07:39 STEP 2294 H=2294:00 +CPU= 13.340
  07:08:00 STEP 2295 H=2295:00 +CPU= 20.827
  07:08:13 STEP 2296 H=2296:00 +CPU= 13.143
  07:08:26 STEP 2297 H=2297:00 +CPU= 12.942
  07:08:48 STEP 2298 H=2298:00 +CPU= 21.321
  07:09:01 STEP 2299 H=2299:00 +CPU= 12.894
  07:09:14 STEP 2300 H=2300:00 +CPU= 13.087
  07:09:35 STEP 2301 H=2301:00 +CPU= 20.879
  07:09:48 STEP 2302 H=2302:00 +CPU= 13.477
  07:10:01 STEP 2303 H=2303:00 +CPU= 13.159
  07:10:26 STEP 2304 H=2304:00 +CPU= 24.172
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002304
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002304
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMGGhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMSHhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMUAhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMGGhq0f+002292
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMSHhq0f+002292
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMUAhq0f+002292
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0644_2008050100_123_977_12194288_0_r400635784_95.zip
Uploading the intermediate file: upload_file_95.zip
  07:10:39 STEP 2305 H=2305:00 +CPU= 13.034
  07:10:52 STEP 2306 H=2306:00 +CPU= 13.165
  07:11:13 STEP 2307 H=2307:00 +CPU= 20.748
  07:11:26 STEP 2308 H=2308:00 +CPU= 13.517
  07:11:39 STEP 2309 H=2309:00 +CPU= 12.992
  07:12:01 STEP 2310 H=2310:00 +CPU= 21.363
  07:12:13 STEP 2311 H=2311:00 +CPU= 12.891
  07:12:27 STEP 2312 H=2312:00 +CPU= 13.451
  07:12:48 STEP 2313 H=2313:00 +CPU= 20.904
  07:13:01 STEP 2314 H=2314:00 +CPU= 13.494
  07:13:14 STEP 2315 H=2315:00 +CPU= 12.924
  07:13:37 STEP 2316 H=2316:00 +CPU= 22.859
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002316
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002316
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002316
  07:13:50 STEP 2317 H=2317:00 +CPU= 13.059
  07:14:03 STEP 2318 H=2318:00 +CPU= 13.162
  07:14:24 STEP 2319 H=2319:00 +CPU= 20.878
  07:14:38 STEP 2320 H=2320:00 +CPU= 13.468
  07:14:51 STEP 2321 H=2321:00 +CPU= 12.866
  07:15:12 STEP 2322 H=2322:00 +CPU= 21.245
  07:15:25 STEP 2323 H=2323:00 +CPU= 12.633
  07:15:38 STEP 2324 H=2324:00 +CPU= 13.254
  07:15:59 STEP 2325 H=2325:00 +CPU= 21.235
  07:16:13 STEP 2326 H=2326:00 +CPU= 13.245
  07:16:26 STEP 2327 H=2327:00 +CPU= 13.326
  07:16:51 STEP 2328 H=2328:00 +CPU= 24.596
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002328
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002328
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMGGhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMSHhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMUAhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMGGhq0f+002316
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMSHhq0f+002316
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMUAhq0f+002316
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0644_2008050100_123_977_12194288_0_r400635784_96.zip
Uploading the intermediate file: upload_file_96.zip
  07:17:04 STEP 2329 H=2329:00 +CPU= 13.043
  07:17:17 STEP 2330 H=2330:00 +CPU= 13.089
  07:17:37 STEP 2331 H=2331:00 +CPU= 20.669
  07:17:51 STEP 2332 H=2332:00 +CPU= 13.325
  07:18:04 STEP 2333 H=2333:00 +CPU= 13.036
  07:18:25 STEP 2334 H=2334:00 +CPU= 21.435
  07:18:39 STEP 2335 H=2335:00 +CPU= 13.188
  07:18:52 STEP 2336 H=2336:00 +CPU= 13.590
  07:19:13 STEP 2337 H=2337:00 +CPU= 20.803
  07:19:26 STEP 2338 H=2338:00 +CPU= 13.092
  07:19:39 STEP 2339 H=2339:00 +CPU= 12.757
  07:20:02 STEP 2340 H=2340:00 +CPU= 22.694
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002340
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002340
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002340
  07:20:14 STEP 2341 H=2341:00 +CPU= 12.858
  07:20:28 STEP 2342 H=2342:00 +CPU= 13.560
  07:20:49 STEP 2343 H=2343:00 +CPU= 20.927
  07:21:02 STEP 2344 H=2344:00 +CPU= 13.357
  07:21:15 STEP 2345 H=2345:00 +CPU= 12.726
  07:21:36 STEP 2346 H=2346:00 +CPU= 21.174
  07:21:49 STEP 2347 H=2347:00 +CPU= 12.965
  07:22:03 STEP 2348 H=2348:00 +CPU= 13.493
  07:22:24 STEP 2349 H=2349:00 +CPU= 20.733
  07:22:37 STEP 2350 H=2350:00 +CPU= 13.582
  07:22:51 STEP 2351 H=2351:00 +CPU= 13.514
  07:23:15 STEP 2352 H=2352:00 +CPU= 24.342
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002352
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002352
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMGGhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMSHhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMUAhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMGGhq0f+002340
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMSHhq0f+002340
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMUAhq0f+002340
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0644_2008050100_123_977_12194288_0_r400635784_97.zip
Uploading the intermediate file: upload_file_97.zip
  07:23:28 STEP 2353 H=2353:00 +CPU= 13.105
  07:23:41 STEP 2354 H=2354:00 +CPU= 12.991
  07:24:02 STEP 2355 H=2355:00 +CPU= 20.189
  07:24:15 STEP 2356 H=2356:00 +CPU= 13.442
  07:24:28 STEP 2357 H=2357:00 +CPU= 12.942
  07:24:49 STEP 2358 H=2358:00 +CPU= 20.723
  07:25:02 STEP 2359 H=2359:00 +CPU= 13.143
  07:25:15 STEP 2360 H=2360:00 +CPU= 13.264
  07:25:36 STEP 2361 H=2361:00 +CPU= 20.959
  07:25:50 STEP 2362 H=2362:00 +CPU= 13.720
  07:26:03 STEP 2363 H=2363:00 +CPU= 12.947
  07:26:26 STEP 2364 H=2364:00 +CPU= 23.148
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002364
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002364
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002364
  07:26:39 STEP 2365 H=2365:00 +CPU= 12.985
  07:26:53 STEP 2366 H=2366:00 +CPU= 13.435
  07:27:13 STEP 2367 H=2367:00 +CPU= 20.726
  07:27:27 STEP 2368 H=2368:00 +CPU= 13.886
  07:27:40 STEP 2369 H=2369:00 +CPU= 12.868
  07:28:01 STEP 2370 H=2370:00 +CPU= 21.259
  07:28:14 STEP 2371 H=2371:00 +CPU= 12.976
  07:28:28 STEP 2372 H=2372:00 +CPU= 13.475
  07:28:48 STEP 2373 H=2373:00 +CPU= 20.282
  07:29:02 STEP 2374 H=2374:00 +CPU= 13.281
  07:29:15 STEP 2375 H=2375:00 +CPU= 12.977
  07:29:39 STEP 2376 H=2376:00 +CPU= 24.186
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002376
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002376
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMGGhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMSHhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMUAhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMGGhq0f+002364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMSHhq0f+002364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288/ICMUAhq0f+002364
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0644_2008050100_123_977_12194288_0_r400635784_98.zip
Uploading the intermediate file: upload_file_98.zip
  07:29:52 STEP 2377 H=2377:00 +CPU= 13.365
  07:30:07 STEP 2378 H=2378:00 +CPU= 14.414
  07:30:28 STEP 2379 H=2379:00 +CPU= 21.278
  07:30:43 STEP 2380 H=2380:00 +CPU= 14.290
  07:30:56 STEP 2381 H=2381:00 +CPU= 13.365
  07:31:18 STEP 2382 H=2382:00 +CPU= 21.840
  07:31:33 STEP 2383 H=2383:00 +CPU= 13.305
  07:31:46 STEP 2384 H=2384:00 +CPU= 12.821
  07:32:06 STEP 2385 H=2385:00 +CPU= 19.683
  07:32:19 STEP 2386 H=2386:00 +CPU= 13.189
  07:32:32 STEP 2387 H=2387:00 +CPU= 12.871
  07:32:53 STEP 2388 H=2388:00 +CPU= 20.978
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMGGhq0f+002388
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMSHhq0f+002388
Moving to projects directory: /var/lib/boinc-client/slots/18/ICMUAhq0f+002388
  07:33:05 STEP 2389 H=2389:00 +CPU= 11.522
  07:33:17 STEP 2390 H=2390:00 +CPU= 11.927
Quit request received from BOINC client, ending the child process
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2008050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0644
(argv4) batchid: 977
(argv5) wuid: 12194288
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/18
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12194288
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/18/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/18/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_74afa25bc0251f83d809195afda602da to: /var/lib/boinc-client/slots/18/oifs_43r3_ps_0644_2008050100_123_977_12194288.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/18/oifs_43r3_ps_0644_2008050100_123_977_12194288.zip
ic_ancil_file: ic_ancil_12194288
ifsdata_file: ifsdata_12194288
climate_data_file: clim_data_12194288
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_0d2faeef78ec83bd3bbe92d87b600b1e to: /var/lib/boinc-client/slots/18/ic_ancil_12194288.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/18/ic_ancil_12194288.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_17df8d3a87887c8068f2fbc25fae0f0d to: /var/lib/boinc-client/slots/18/ifsdata/ifsdata_12194288.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/18/ifsdata/ifsdata_12194288.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/18/159l_2/clim_data_12194288.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/18/159l_2/clim_data_12194288.zip
Checking for progress XML file: /var/lib/boinc-client/slots/18/progress_file_12194288.xml
Opened progress file ok : /var/lib/boinc-client/slots/18/progress_file_12194288.xml
-- Model is restarting --
Adjusting last_iter, 2391, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/18/progress_file_12194288.xml
last_cpu_time: 38102
upload_file_number: 99
last_iter: 2375
last_upload: 8553600
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0644_2008050100_123_977_12194288_0_r400635784
The child process has been launched with process id: 334481
Executing the command: /var/lib/boinc-client/slots/18/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:Sanger-sein-Mint:1:1:334481:334481] [20221224:073609:1671863769:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:Sanger-sein-Mint:1:1:334481:334481] [20221224:073609:1671863769:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:Sanger-sein-Mint:1:1:334481:334481] [20221224:073609:1671863769:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:Sanger-sein-Mint:1:1:334481:334481] [20221224:073609:1671863769:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:Sanger-sein-Mint:1:1:334481:334481] [20221224:073609:1671863769:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:Sanger-sein-Mint:1:1:334481:334481] [20221224:073609:1671863769:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:Sanger-sein-Mint:1:1:334481:334481] [20221224:073609:1671863769:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:Sanger-sein-Mint:1:1:334481:334481] [20221224:073609:1671863769:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:Sanger-sein-Mint:1:1:334481:334481] [20221224:073609:1671863769:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:Sanger-sein-Mint:1:1:334481:334481] [20221224:073609:1671863769:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:Sanger-sein-Mint:1:1:334481:334481] [20221224:073609:1671863769:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:Sanger-sein-Mint:1:1:334481:334481] [20221224:073609:1671863769:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:Sanger-sein-Mint:1:1:334481:334481] [20221224:073609:1671863769:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:Sanger-sein-Mint:1:1:334481:334481] [20221224:073609:1671863769:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:Sanger-sein-Mint:1:1:334481:334481] [20221224:073609:1671863769:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:Sanger-sein-Mint:1:1:334481:334481] [20221224:073609:1671863769:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Sanger-sein-Mint:1:1:334481:334481] [20221224:073609:1671863769:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:Sanger-sein-Mint:1:1:334481:334481] [20221224:073609:1671863769:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Sanger-sein-Mint:1:1:334481:334481] [20221224:073609:1671863769:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:Sanger-sein-Mint:1:1:334481:334481] [20221224:073609:1671863769:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:Sanger-sein-Mint:1:1:334481:334481] [20221224:073609:1671863769:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Sanger-sein-Mint:1:1:334481:334481] [20221224:073609:1671863769:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Sanger-sein-Mint:1:1:334481:334481] [20221224:073609:1671863769:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:Sanger-sein-Mint:1:1:334481:334481] [20221224:073609:1671863769:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Sanger-sein-Mint:1:1:334481:334481] [20221224:073609:1671863769:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Sanger-sein-Mint:1:1:334481:334481] [20221224:073609:1671863769:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Sanger-sein-Mint:1:1:334481:334481] [20221224:073609:1671863769:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:Sanger-sein-Mint:1:1:334481:334481] [20221224:073609:1671863769:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:Sanger-sein-Mint:1:1:334481:334481] [20221224:073609:1671863769:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:Sanger-sein-Mint:1:1:334481:334481] [20221224:073609:1671863769:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  07:36:34 STEP 2376 H=2376:00 +CPU= 23.334
  07:36:47 STEP 2377 H=2377:00 +CPU= 12.987
  07:37:00 STEP 2378 H=2378:00 +CPU= 12.932
  07:37:21 STEP 2379 H=2379:00 +CPU= 21.120
The child process terminated with status: 0
..Failed, model did not complete successfully

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 15:51:47 1528749 22280115 oifs_43r3_ps_0644_2008050100_123_977_12194288_0 7,776,000 34,435 0.0044
09 May 2023 15:51:36 1528749 22280115 oifs_43r3_ps_0644_2008050100_123_977_12194288_0 6,912,000 30,596 0.0044
09 May 2023 15:51:30 1528749 22280115 oifs_43r3_ps_0644_2008050100_123_977_12194288_0 6,048,000 26,780 0.0044
09 May 2023 15:51:25 1528749 22280115 oifs_43r3_ps_0644_2008050100_123_977_12194288_0 5,184,000 23,052 0.0044
09 May 2023 15:51:20 1528749 22280115 oifs_43r3_ps_0644_2008050100_123_977_12194288_0 4,320,000 19,245 0.0045
09 May 2023 15:51:15 1528749 22280115 oifs_43r3_ps_0644_2008050100_123_977_12194288_0 3,456,000 15,428 0.0045
09 May 2023 15:51:10 1528749 22280115 oifs_43r3_ps_0644_2008050100_123_977_12194288_0 2,592,000 11,601 0.0045
09 May 2023 15:51:04 1528749 22280115 oifs_43r3_ps_0644_2008050100_123_977_12194288_0 1,728,000 7,784 0.0045
09 May 2023 15:50:58 1528749 22280115 oifs_43r3_ps_0644_2008050100_123_977_12194288_0 864,000 3,957 0.0046


©2024 climateprediction.net