climateprediction.net home page
Task 22436899

Task 22436899

Name oifs_43r3_bl_a2ok_2016092300_20_1017_12285303_0
Workunit 12285303
Created 7 Jun 2024, 15:52:16 UTC
Sent 7 Jun 2024, 16:04:29 UTC
Report deadline 6 Aug 2024, 16:04:29 UTC
Received 8 Jun 2024, 5:02:02 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1538890
Run time 12 hours 40 min 11 sec
CPU time 12 hours 34 min 46 sec
Validate state Invalid
Credit 1,976.32
Device peak FLOPS 5.44 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,024.91 MB
Peak swap size 5,980.81 MB
Peak disk usage 1,286.59 MB
Stderr
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<stderr_txt>
 208:30 +CPU= 30.364
  17:56:24 STEP  835 H= 208:45 +CPU= 31.139
  17:56:55 STEP  836 H= 209:00 +CPU= 30.820
  17:57:26 STEP  837 H= 209:15 +CPU= 30.843
  17:57:56 STEP  838 H= 209:30 +CPU= 29.889
  17:58:27 STEP  839 H= 209:45 +CPU= 30.934
  17:59:05 STEP  840 H= 210:00 +CPU= 37.541
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000840
  17:59:38 STEP  841 H= 210:15 +CPU= 33.013
  18:00:11 STEP  842 H= 210:30 +CPU= 33.013
  18:00:41 STEP  843 H= 210:45 +CPU= 30.358
  18:01:12 STEP  844 H= 211:00 +CPU= 30.958
  18:01:42 STEP  845 H= 211:15 +CPU= 30.236
  18:02:13 STEP  846 H= 211:30 +CPU= 30.642
  18:02:44 STEP  847 H= 211:45 +CPU= 30.777
  18:03:16 STEP  848 H= 212:00 +CPU= 31.769
  18:03:47 STEP  849 H= 212:15 +CPU= 31.255
  18:04:18 STEP  850 H= 212:30 +CPU= 31.343
  18:04:49 STEP  851 H= 212:45 +CPU= 31.244
  18:05:28 STEP  852 H= 213:00 +CPU= 39.013
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000852
  18:06:00 STEP  853 H= 213:15 +CPU= 31.566
  18:06:33 STEP  854 H= 213:30 +CPU= 32.295
  18:07:04 STEP  855 H= 213:45 +CPU= 31.772
  18:07:36 STEP  856 H= 214:00 +CPU= 32.073
  18:08:10 STEP  857 H= 214:15 +CPU= 33.813
  18:08:43 STEP  858 H= 214:30 +CPU= 32.542
  18:09:15 STEP  859 H= 214:45 +CPU= 32.536
  18:09:49 STEP  860 H= 215:00 +CPU= 33.105
  18:10:21 STEP  861 H= 215:15 +CPU= 32.483
  18:10:55 STEP  862 H= 215:30 +CPU= 33.731
  18:11:30 STEP  863 H= 215:45 +CPU= 35.452
  18:12:15 STEP  864 H= 216:00 +CPU= 44.803
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+000852
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a2ok_2016092300_20_1017_12285303_0_r1152014568_8.zip
Uploading the intermediate file: upload_file_8.zip
  18:12:47 STEP  865 H= 216:15 +CPU= 31.792
  18:13:19 STEP  866 H= 216:30 +CPU= 31.773
  18:13:51 STEP  867 H= 216:45 +CPU= 31.882
  18:14:23 STEP  868 H= 217:00 +CPU= 32.314
  18:14:55 STEP  869 H= 217:15 +CPU= 32.177
  18:15:30 STEP  870 H= 217:30 +CPU= 34.900
  18:16:04 STEP  871 H= 217:45 +CPU= 33.512
  18:16:36 STEP  872 H= 218:00 +CPU= 32.367
  18:17:07 STEP  873 H= 218:15 +CPU= 31.416
  18:17:41 STEP  874 H= 218:30 +CPU= 33.347
  18:18:13 STEP  875 H= 218:45 +CPU= 32.219
  18:18:53 STEP  876 H= 219:00 +CPU= 39.904
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000876
  18:19:25 STEP  877 H= 219:15 +CPU= 31.986
  18:19:57 STEP  878 H= 219:30 +CPU= 32.011
  18:20:30 STEP  879 H= 219:45 +CPU= 32.117
  18:21:04 STEP  880 H= 220:00 +CPU= 34.204
  18:21:38 STEP  881 H= 220:15 +CPU= 34.076
  18:22:13 STEP  882 H= 220:30 +CPU= 34.368
  18:22:44 STEP  883 H= 220:45 +CPU= 31.641
  18:23:16 STEP  884 H= 221:00 +CPU= 32.016
  18:23:48 STEP  885 H= 221:15 +CPU= 31.777
  18:24:20 STEP  886 H= 221:30 +CPU= 31.836
  18:24:55 STEP  887 H= 221:45 +CPU= 34.867
  18:25:37 STEP  888 H= 222:00 +CPU= 42.004
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000888
  18:26:09 STEP  889 H= 222:15 +CPU= 32.279
  18:26:42 STEP  890 H= 222:30 +CPU= 32.397
  18:27:14 STEP  891 H= 222:45 +CPU= 32.611
  18:27:47 STEP  892 H= 223:00 +CPU= 33.115
  18:28:22 STEP  893 H= 223:15 +CPU= 34.185
  18:28:57 STEP  894 H= 223:30 +CPU= 35.295
  18:29:33 STEP  895 H= 223:45 +CPU= 35.265
  18:30:07 STEP  896 H= 224:00 +CPU= 34.018
  18:30:39 STEP  897 H= 224:15 +CPU= 32.157
  18:31:14 STEP  898 H= 224:30 +CPU= 34.422
  18:31:47 STEP  899 H= 224:45 +CPU= 33.736
  18:32:27 STEP  900 H= 225:00 +CPU= 39.341
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000900
  18:32:58 STEP  901 H= 225:15 +CPU= 31.665
  18:33:30 STEP  902 H= 225:30 +CPU= 31.951
  18:34:03 STEP  903 H= 225:45 +CPU= 32.835
  18:34:39 STEP  904 H= 226:00 +CPU= 35.360
  18:35:14 STEP  905 H= 226:15 +CPU= 34.875
  18:35:46 STEP  906 H= 226:30 +CPU= 31.964
  18:36:17 STEP  907 H= 226:45 +CPU= 31.532
  18:36:50 STEP  908 H= 227:00 +CPU= 32.298
  18:37:22 STEP  909 H= 227:15 +CPU= 31.669
  18:37:53 STEP  910 H= 227:30 +CPU= 31.698
  18:38:25 STEP  911 H= 227:45 +CPU= 31.865
  18:39:10 STEP  912 H= 228:00 +CPU= 44.546
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000912
  18:39:43 STEP  913 H= 228:15 +CPU= 33.145
  18:40:16 STEP  914 H= 228:30 +CPU= 32.489
  18:40:50 STEP  915 H= 228:45 +CPU= 34.193
  18:41:23 STEP  916 H= 229:00 +CPU= 33.024
  18:41:56 STEP  917 H= 229:15 +CPU= 32.205
  18:42:30 STEP  918 H= 229:30 +CPU= 34.705
  18:43:02 STEP  919 H= 229:45 +CPU= 32.135
  18:43:35 STEP  920 H= 230:00 +CPU= 32.469
  18:44:07 STEP  921 H= 230:15 +CPU= 31.972
  18:44:39 STEP  922 H= 230:30 +CPU= 31.900
  18:45:12 STEP  923 H= 230:45 +CPU= 32.696
  18:45:53 STEP  924 H= 231:00 +CPU= 41.288
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000924
  18:46:26 STEP  925 H= 231:15 +CPU= 32.060
  18:46:57 STEP  926 H= 231:30 +CPU= 31.870
  18:47:29 STEP  927 H= 231:45 +CPU= 31.991
  18:48:05 STEP  928 H= 232:00 +CPU= 35.560
  18:48:37 STEP  929 H= 232:15 +CPU= 32.055
  18:49:09 STEP  930 H= 232:30 +CPU= 32.099
  18:49:42 STEP  931 H= 232:45 +CPU= 32.146
  18:50:14 STEP  932 H= 233:00 +CPU= 32.741
  18:50:47 STEP  933 H= 233:15 +CPU= 32.132
  18:51:21 STEP  934 H= 233:30 +CPU= 34.201
  18:51:56 STEP  935 H= 233:45 +CPU= 35.056
  18:52:38 STEP  936 H= 234:00 +CPU= 41.868
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000936
  18:53:10 STEP  937 H= 234:15 +CPU= 32.084
  18:53:43 STEP  938 H= 234:30 +CPU= 32.638
  18:54:16 STEP  939 H= 234:45 +CPU= 32.609
  18:54:49 STEP  940 H= 235:00 +CPU= 33.247
  18:55:22 STEP  941 H= 235:15 +CPU= 32.751
  18:55:55 STEP  942 H= 235:30 +CPU= 33.573
  18:56:30 STEP  943 H= 235:45 +CPU= 33.713
  18:57:03 STEP  944 H= 236:00 +CPU= 33.532
  18:57:36 STEP  945 H= 236:15 +CPU= 32.133
  18:58:08 STEP  946 H= 236:30 +CPU= 32.752
  18:58:43 STEP  947 H= 236:45 +CPU= 34.252
  18:59:27 STEP  948 H= 237:00 +CPU= 44.126
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000948
  19:00:03 STEP  949 H= 237:15 +CPU= 35.789
  19:00:38 STEP  950 H= 237:30 +CPU= 35.140
  19:01:11 STEP  951 H= 237:45 +CPU= 32.754
  19:01:44 STEP  952 H= 238:00 +CPU= 33.138
  19:02:17 STEP  953 H= 238:15 +CPU= 33.046
  19:02:50 STEP  954 H= 238:30 +CPU= 33.091
  19:03:23 STEP  955 H= 238:45 +CPU= 32.704
  19:03:57 STEP  956 H= 239:00 +CPU= 33.510
  19:04:29 STEP  957 H= 239:15 +CPU= 32.668
  19:05:02 STEP  958 H= 239:30 +CPU= 32.666
  19:05:36 STEP  959 H= 239:45 +CPU= 33.781
  19:06:25 STEP  960 H= 240:00 +CPU= 48.281
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+000948
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a2ok_2016092300_20_1017_12285303_0_r1152014568_9.zip
Uploading the intermediate file: upload_file_9.zip
  19:06:57 STEP  961 H= 240:15 +CPU= 32.430
Uploading trickle at timestep: 864000
  19:07:30 STEP  962 H= 240:30 +CPU= 32.896
  19:08:03 STEP  963 H= 240:45 +CPU= 32.850
  19:08:36 STEP  964 H= 241:00 +CPU= 33.331
  19:09:09 STEP  965 H= 241:15 +CPU= 32.682
  19:09:42 STEP  966 H= 241:30 +CPU= 32.615
  19:10:15 STEP  967 H= 241:45 +CPU= 33.561
  19:10:49 STEP  968 H= 242:00 +CPU= 33.670
  19:11:22 STEP  969 H= 242:15 +CPU= 32.939
  19:11:55 STEP  970 H= 242:30 +CPU= 32.683
  19:12:27 STEP  971 H= 242:45 +CPU= 32.337
  19:13:09 STEP  972 H= 243:00 +CPU= 40.940
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000972
  19:13:41 STEP  973 H= 243:15 +CPU= 31.898
  19:14:14 STEP  974 H= 243:30 +CPU= 32.797
  19:14:47 STEP  975 H= 243:45 +CPU= 33.610
  19:15:21 STEP  976 H= 244:00 +CPU= 33.329
  19:15:54 STEP  977 H= 244:15 +CPU= 32.720
  19:16:27 STEP  978 H= 244:30 +CPU= 33.313
  19:17:00 STEP  979 H= 244:45 +CPU= 33.119
  19:17:33 STEP  980 H= 245:00 +CPU= 32.375
  19:18:08 STEP  981 H= 245:15 +CPU= 34.923
  19:18:41 STEP  982 H= 245:30 +CPU= 33.233
  19:19:14 STEP  983 H= 245:45 +CPU= 33.525
  19:19:58 STEP  984 H= 246:00 +CPU= 43.603
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000984
  19:20:34 STEP  985 H= 246:15 +CPU= 35.054
  19:21:06 STEP  986 H= 246:30 +CPU= 32.435
  19:21:40 STEP  987 H= 246:45 +CPU= 34.174
  19:22:17 STEP  988 H= 247:00 +CPU= 36.916
  19:22:53 STEP  989 H= 247:15 +CPU= 35.751
  19:23:28 STEP  990 H= 247:30 +CPU= 34.701
  19:24:00 STEP  991 H= 247:45 +CPU= 32.184
  19:24:33 STEP  992 H= 248:00 +CPU= 32.856
  19:25:05 STEP  993 H= 248:15 +CPU= 32.220
  19:25:39 STEP  994 H= 248:30 +CPU= 33.436
  19:26:13 STEP  995 H= 248:45 +CPU= 33.073
  19:26:56 STEP  996 H= 249:00 +CPU= 43.251
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000996
  19:27:31 STEP  997 H= 249:15 +CPU= 34.844
  19:28:06 STEP  998 H= 249:30 +CPU= 35.414
  19:28:42 STEP  999 H= 249:45 +CPU= 35.551
  19:29:17 STEP 1000 H= 250:00 +CPU= 34.672
  19:29:49 STEP 1001 H= 250:15 +CPU= 32.406
  19:30:21 STEP 1002 H= 250:30 +CPU= 32.393
  19:30:54 STEP 1003 H= 250:45 +CPU= 32.415
  19:31:27 STEP 1004 H= 251:00 +CPU= 33.014
  19:31:59 STEP 1005 H= 251:15 +CPU= 32.405
  19:32:34 STEP 1006 H= 251:30 +CPU= 34.390
  19:33:08 STEP 1007 H= 251:45 +CPU= 34.059
  19:33:56 STEP 1008 H= 252:00 +CPU= 47.826
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001008
  19:34:29 STEP 1009 H= 252:15 +CPU= 33.372
  19:35:05 STEP 1010 H= 252:30 +CPU= 35.540
  19:35:39 STEP 1011 H= 252:45 +CPU= 34.150
  19:36:13 STEP 1012 H= 253:00 +CPU= 33.844
  19:36:46 STEP 1013 H= 253:15 +CPU= 32.822
  19:37:20 STEP 1014 H= 253:30 +CPU= 33.326
  19:37:53 STEP 1015 H= 253:45 +CPU= 32.829
  19:38:29 STEP 1016 H= 254:00 +CPU= 36.113
  19:39:02 STEP 1017 H= 254:15 +CPU= 32.907
  19:39:35 STEP 1018 H= 254:30 +CPU= 32.918
  19:40:08 STEP 1019 H= 254:45 +CPU= 32.940
  19:40:53 STEP 1020 H= 255:00 +CPU= 44.466
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001020
  19:41:26 STEP 1021 H= 255:15 +CPU= 33.393
  19:41:59 STEP 1022 H= 255:30 +CPU= 32.587
  19:42:33 STEP 1023 H= 255:45 +CPU= 33.898
  19:43:11 STEP 1024 H= 256:00 +CPU= 37.210
  19:43:44 STEP 1025 H= 256:15 +CPU= 33.321
  19:44:17 STEP 1026 H= 256:30 +CPU= 32.749
  19:44:53 STEP 1027 H= 256:45 +CPU= 36.279
  19:45:30 STEP 1028 H= 257:00 +CPU= 36.575
  19:46:04 STEP 1029 H= 257:15 +CPU= 33.624
  19:46:37 STEP 1030 H= 257:30 +CPU= 33.152
  19:47:10 STEP 1031 H= 257:45 +CPU= 33.090
  19:47:51 STEP 1032 H= 258:00 +CPU= 40.417
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001032
  19:48:24 STEP 1033 H= 258:15 +CPU= 32.892
  19:48:57 STEP 1034 H= 258:30 +CPU= 32.649
  19:49:32 STEP 1035 H= 258:45 +CPU= 34.350
  19:50:07 STEP 1036 H= 259:00 +CPU= 34.608
  19:50:41 STEP 1037 H= 259:15 +CPU= 34.153
  19:51:14 STEP 1038 H= 259:30 +CPU= 32.946
  19:51:50 STEP 1039 H= 259:45 +CPU= 35.936
  19:52:27 STEP 1040 H= 260:00 +CPU= 36.320
  19:53:02 STEP 1041 H= 260:15 +CPU= 35.430
  19:53:38 STEP 1042 H= 260:30 +CPU= 35.184
  19:54:11 STEP 1043 H= 260:45 +CPU= 32.710
  19:54:54 STEP 1044 H= 261:00 +CPU= 42.756
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001044
  19:55:30 STEP 1045 H= 261:15 +CPU= 36.342
  19:56:04 STEP 1046 H= 261:30 +CPU= 33.594
  19:56:38 STEP 1047 H= 261:45 +CPU= 33.726
  19:57:15 STEP 1048 H= 262:00 +CPU= 36.859
  19:57:51 STEP 1049 H= 262:15 +CPU= 36.392
  19:58:25 STEP 1050 H= 262:30 +CPU= 33.162
  19:58:58 STEP 1051 H= 262:45 +CPU= 33.148
  19:59:31 STEP 1052 H= 263:00 +CPU= 33.471
  20:00:05 STEP 1053 H= 263:15 +CPU= 33.354
  20:00:41 STEP 1054 H= 263:30 +CPU= 36.467
  20:01:18 STEP 1055 H= 263:45 +CPU= 36.247
  20:02:04 STEP 1056 H= 264:00 +CPU= 45.495
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+001044
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a2ok_2016092300_20_1017_12285303_0_r1152014568_10.zip
Uploading the intermediate file: upload_file_10.zip
  20:02:40 STEP 1057 H= 264:15 +CPU= 36.448
  20:03:16 STEP 1058 H= 264:30 +CPU= 36.023
  20:03:53 STEP 1059 H= 264:45 +CPU= 36.793
  20:04:28 STEP 1060 H= 265:00 +CPU= 34.516
  20:05:01 STEP 1061 H= 265:15 +CPU= 33.843
  20:05:36 STEP 1062 H= 265:30 +CPU= 34.640
  20:06:10 STEP 1063 H= 265:45 +CPU= 33.202
  20:06:47 STEP 1064 H= 266:00 +CPU= 36.981
  20:07:21 STEP 1065 H= 266:15 +CPU= 33.511
  20:07:57 STEP 1066 H= 266:30 +CPU= 36.131
  20:08:30 STEP 1067 H= 266:45 +CPU= 33.646
  20:09:12 STEP 1068 H= 267:00 +CPU= 41.042
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001068
  20:09:45 STEP 1069 H= 267:15 +CPU= 33.249
  20:10:19 STEP 1070 H= 267:30 +CPU= 34.474
  20:10:56 STEP 1071 H= 267:45 +CPU= 36.376
  20:11:30 STEP 1072 H= 268:00 +CPU= 33.848
  20:12:04 STEP 1073 H= 268:15 +CPU= 33.672
  20:12:40 STEP 1074 H= 268:30 +CPU= 36.671
  20:13:18 STEP 1075 H= 268:45 +CPU= 37.294
  20:13:54 STEP 1076 H= 269:00 +CPU= 36.210
  20:14:28 STEP 1077 H= 269:15 +CPU= 33.284
  20:15:01 STEP 1078 H= 269:30 +CPU= 32.807
  20:15:34 STEP 1079 H= 269:45 +CPU= 33.199
  20:16:15 STEP 1080 H= 270:00 +CPU= 41.005
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001080
  20:16:48 STEP 1081 H= 270:15 +CPU= 33.153
  20:17:22 STEP 1082 H= 270:30 +CPU= 33.670
  20:17:56 STEP 1083 H= 270:45 +CPU= 34.247
  20:18:32 STEP 1084 H= 271:00 +CPU= 35.342
  20:19:07 STEP 1085 H= 271:15 +CPU= 35.759
  20:19:43 STEP 1086 H= 271:30 +CPU= 35.692
  20:20:19 STEP 1087 H= 271:45 +CPU= 36.004
  20:20:54 STEP 1088 H= 272:00 +CPU= 33.758
  20:21:27 STEP 1089 H= 272:15 +CPU= 32.900
  20:22:03 STEP 1090 H= 272:30 +CPU= 36.475
  20:22:40 STEP 1091 H= 272:45 +CPU= 36.559
  20:23:23 STEP 1092 H= 273:00 +CPU= 42.636
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001092
  20:23:56 STEP 1093 H= 273:15 +CPU= 33.705
  20:24:30 STEP 1094 H= 273:30 +CPU= 33.464
  20:25:05 STEP 1095 H= 273:45 +CPU= 34.718
  20:25:41 STEP 1096 H= 274:00 +CPU= 35.686
  20:26:14 STEP 1097 H= 274:15 +CPU= 33.525
  20:26:48 STEP 1098 H= 274:30 +CPU= 33.506
  20:27:23 STEP 1099 H= 274:45 +CPU= 35.882
  20:28:01 STEP 1100 H= 275:00 +CPU= 37.574
  20:28:35 STEP 1101 H= 275:15 +CPU= 33.484
  20:29:08 STEP 1102 H= 275:30 +CPU= 33.394
  20:29:41 STEP 1103 H= 275:45 +CPU= 33.071
  20:30:26 STEP 1104 H= 276:00 +CPU= 45.171
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001104
  20:30:59 STEP 1105 H= 276:15 +CPU= 32.882
  20:31:32 STEP 1106 H= 276:30 +CPU= 32.767
  20:32:08 STEP 1107 H= 276:45 +CPU= 35.691
  20:32:42 STEP 1108 H= 277:00 +CPU= 34.563
  20:33:17 STEP 1109 H= 277:15 +CPU= 34.471
  20:33:50 STEP 1110 H= 277:30 +CPU= 32.750
  20:34:22 STEP 1111 H= 277:45 +CPU= 32.329
  20:34:55 STEP 1112 H= 278:00 +CPU= 32.792
  20:35:28 STEP 1113 H= 278:15 +CPU= 32.619
  20:36:02 STEP 1114 H= 278:30 +CPU= 34.475
  20:36:35 STEP 1115 H= 278:45 +CPU= 32.653
  20:37:15 STEP 1116 H= 279:00 +CPU= 39.845
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001116
  20:37:47 STEP 1117 H= 279:15 +CPU= 31.878
  20:38:20 STEP 1118 H= 279:30 +CPU= 32.419
  20:38:53 STEP 1119 H= 279:45 +CPU= 33.287
  20:39:26 STEP 1120 H= 280:00 +CPU= 33.059
  20:40:02 STEP 1121 H= 280:15 +CPU= 35.395
  20:40:35 STEP 1122 H= 280:30 +CPU= 32.493
  20:41:07 STEP 1123 H= 280:45 +CPU= 32.520
  20:41:41 STEP 1124 H= 281:00 +CPU= 33.437
  20:42:13 STEP 1125 H= 281:15 +CPU= 32.592
  20:42:46 STEP 1126 H= 281:30 +CPU= 32.572
  20:43:19 STEP 1127 H= 281:45 +CPU= 32.722
  20:44:04 STEP 1128 H= 282:00 +CPU= 40.328
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001128
  20:44:37 STEP 1129 H= 282:15 +CPU= 32.540
  20:45:11 STEP 1130 H= 282:30 +CPU= 34.135
  20:45:44 STEP 1131 H= 282:45 +CPU= 33.280
  20:46:18 STEP 1132 H= 283:00 +CPU= 32.868
  20:46:53 STEP 1133 H= 283:15 +CPU= 34.615
  20:47:29 STEP 1134 H= 283:30 +CPU= 36.126
  20:48:02 STEP 1135 H= 283:45 +CPU= 33.213
  20:48:36 STEP 1136 H= 284:00 +CPU= 33.494
  20:49:12 STEP 1137 H= 284:15 +CPU= 35.772
  20:49:48 STEP 1138 H= 284:30 +CPU= 35.981
  20:50:24 STEP 1139 H= 284:45 +CPU= 35.847
  20:51:05 STEP 1140 H= 285:00 +CPU= 41.517
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001140
  20:51:38 STEP 1141 H= 285:15 +CPU= 32.630
  20:52:10 STEP 1142 H= 285:30 +CPU= 32.278
  20:52:43 STEP 1143 H= 285:45 +CPU= 32.828
  20:53:17 STEP 1144 H= 286:00 +CPU= 33.465
  20:53:49 STEP 1145 H= 286:15 +CPU= 32.386
  20:54:24 STEP 1146 H= 286:30 +CPU= 35.190
  20:54:58 STEP 1147 H= 286:45 +CPU= 33.193
  20:55:31 STEP 1148 H= 287:00 +CPU= 33.020
  20:56:05 STEP 1149 H= 287:15 +CPU= 33.852
  20:56:40 STEP 1150 H= 287:30 +CPU= 35.452
  20:57:16 STEP 1151 H= 287:45 +CPU= 35.606
  20:58:01 STEP 1152 H= 288:00 +CPU= 45.028
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+001140
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a2ok_2016092300_20_1017_12285303_0_r1152014568_11.zip
Uploading the intermediate file: upload_file_11.zip
  20:58:33 STEP 1153 H= 288:15 +CPU= 32.149
  20:59:06 STEP 1154 H= 288:30 +CPU= 32.465
  20:59:41 STEP 1155 H= 288:45 +CPU= 34.956
  21:00:14 STEP 1156 H= 289:00 +CPU= 33.152
  21:00:48 STEP 1157 H= 289:15 +CPU= 33.556
  21:01:20 STEP 1158 H= 289:30 +CPU= 32.273
  21:01:52 STEP 1159 H= 289:45 +CPU= 32.093
  21:02:28 STEP 1160 H= 290:00 +CPU= 36.002
  21:03:03 STEP 1161 H= 290:15 +CPU= 35.210
  21:03:36 STEP 1162 H= 290:30 +CPU= 32.698
  21:04:09 STEP 1163 H= 290:45 +CPU= 32.821
  21:04:50 STEP 1164 H= 291:00 +CPU= 41.381
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001164
  21:05:24 STEP 1165 H= 291:15 +CPU= 33.182
  21:05:56 STEP 1166 H= 291:30 +CPU= 32.575
  21:06:30 STEP 1167 H= 291:45 +CPU= 33.580
  21:07:03 STEP 1168 H= 292:00 +CPU= 33.145
  21:07:35 STEP 1169 H= 292:15 +CPU= 32.531
  21:08:08 STEP 1170 H= 292:30 +CPU= 32.592
  21:08:41 STEP 1171 H= 292:45 +CPU= 32.586
  21:09:14 STEP 1172 H= 293:00 +CPU= 33.196
  21:09:47 STEP 1173 H= 293:15 +CPU= 32.708
  21:10:22 STEP 1174 H= 293:30 +CPU= 35.702
  21:10:59 STEP 1175 H= 293:45 +CPU= 36.896
  21:11:42 STEP 1176 H= 294:00 +CPU= 42.277
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001176
  21:12:15 STEP 1177 H= 294:15 +CPU= 33.322
  21:12:48 STEP 1178 H= 294:30 +CPU= 32.991
  21:13:21 STEP 1179 H= 294:45 +CPU= 32.924
  21:13:54 STEP 1180 H= 295:00 +CPU= 33.470
  21:14:27 STEP 1181 H= 295:15 +CPU= 32.828
  21:15:01 STEP 1182 H= 295:30 +CPU= 32.897
  21:15:34 STEP 1183 H= 295:45 +CPU= 32.825
  21:16:08 STEP 1184 H= 296:00 +CPU= 34.009
  21:16:41 STEP 1185 H= 296:15 +CPU= 33.544
  21:17:17 STEP 1186 H= 296:30 +CPU= 35.830
  21:17:51 STEP 1187 H= 296:45 +CPU= 33.908
  21:18:33 STEP 1188 H= 297:00 +CPU= 42.240
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001188
  21:19:06 STEP 1189 H= 297:15 +CPU= 33.164
  21:19:43 STEP 1190 H= 297:30 +CPU= 36.333
  21:20:19 STEP 1191 H= 297:45 +CPU= 36.318
  21:20:53 STEP 1192 H= 298:00 +CPU= 33.453
  21:21:26 STEP 1193 H= 298:15 +CPU= 33.340
  21:21:59 STEP 1194 H= 298:30 +CPU= 33.111
  21:22:33 STEP 1195 H= 298:45 +CPU= 33.249
  21:23:06 STEP 1196 H= 299:00 +CPU= 33.361
  21:23:39 STEP 1197 H= 299:15 +CPU= 32.704
  21:24:12 STEP 1198 H= 299:30 +CPU= 32.657
  21:24:44 STEP 1199 H= 299:45 +CPU= 32.786
  21:25:30 STEP 1200 H= 300:00 +CPU= 45.416
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001200
  21:26:03 STEP 1201 H= 300:15 +CPU= 33.053
  21:26:36 STEP 1202 H= 300:30 +CPU= 33.048
  21:27:10 STEP 1203 H= 300:45 +CPU= 33.566
  21:27:46 STEP 1204 H= 301:00 +CPU= 35.962
  21:28:19 STEP 1205 H= 301:15 +CPU= 33.504
  21:28:53 STEP 1206 H= 301:30 +CPU= 33.245
  21:29:26 STEP 1207 H= 301:45 +CPU= 33.415
  21:30:00 STEP 1208 H= 302:00 +CPU= 34.253
  21:30:37 STEP 1209 H= 302:15 +CPU= 35.964
  21:31:10 STEP 1210 H= 302:30 +CPU= 33.198
  21:31:44 STEP 1211 H= 302:45 +CPU= 33.152
  21:32:24 STEP 1212 H= 303:00 +CPU= 40.805
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001212
  21:32:57 STEP 1213 H= 303:15 +CPU= 33.109
  21:33:33 STEP 1214 H= 303:30 +CPU= 35.880
  21:34:09 STEP 1215 H= 303:45 +CPU= 35.655
  21:34:45 STEP 1216 H= 304:00 +CPU= 35.735
  21:35:20 STEP 1217 H= 304:15 +CPU= 35.169
  21:35:56 STEP 1218 H= 304:30 +CPU= 35.338
  21:36:30 STEP 1219 H= 304:45 +CPU= 34.181
  21:37:07 STEP 1220 H= 305:00 +CPU= 36.780
  21:37:43 STEP 1221 H= 305:15 +CPU= 36.114
  21:38:16 STEP 1222 H= 305:30 +CPU= 32.783
  21:38:49 STEP 1223 H= 305:45 +CPU= 32.729
  21:39:29 STEP 1224 H= 306:00 +CPU= 39.921
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001224
  21:40:01 STEP 1225 H= 306:15 +CPU= 32.293
  21:40:34 STEP 1226 H= 306:30 +CPU= 32.410
  21:41:06 STEP 1227 H= 306:45 +CPU= 32.353
  21:41:39 STEP 1228 H= 307:00 +CPU= 33.120
  21:42:12 STEP 1229 H= 307:15 +CPU= 33.321
  21:42:49 STEP 1230 H= 307:30 +CPU= 36.112
  21:43:23 STEP 1231 H= 307:45 +CPU= 34.562
  21:44:00 STEP 1232 H= 308:00 +CPU= 36.853
  21:44:36 STEP 1233 H= 308:15 +CPU= 35.806
  21:45:10 STEP 1234 H= 308:30 +CPU= 33.603
  21:45:46 STEP 1235 H= 308:45 +CPU= 36.576
  21:46:32 STEP 1236 H= 309:00 +CPU= 45.512
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001236
  21:47:08 STEP 1237 H= 309:15 +CPU= 35.960
  21:47:41 STEP 1238 H= 309:30 +CPU= 32.745
  21:48:13 STEP 1239 H= 309:45 +CPU= 32.656
  21:48:47 STEP 1240 H= 310:00 +CPU= 33.295
  21:49:21 STEP 1241 H= 310:15 +CPU= 34.139
  21:49:56 STEP 1242 H= 310:30 +CPU= 35.401
  21:50:31 STEP 1243 H= 310:45 +CPU= 34.990
  21:51:06 STEP 1244 H= 311:00 +CPU= 34.840
  21:51:41 STEP 1245 H= 311:15 +CPU= 34.324
  21:52:14 STEP 1246 H= 311:30 +CPU= 33.250
  21:52:47 STEP 1247 H= 311:45 +CPU= 33.149
  21:53:33 STEP 1248 H= 312:00 +CPU= 44.848
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+001236
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a2ok_2016092300_20_1017_12285303_0_r1152014568_12.zip
Uploading the intermediate file: upload_file_12.zip
  21:54:06 STEP 1249 H= 312:15 +CPU= 33.275
  21:54:42 STEP 1250 H= 312:30 +CPU= 35.777
  21:55:19 STEP 1251 H= 312:45 +CPU= 36.884
  21:55:53 STEP 1252 H= 313:00 +CPU= 34.144
  21:56:27 STEP 1253 H= 313:15 +CPU= 33.587
  21:57:02 STEP 1254 H= 313:30 +CPU= 35.027
  21:57:37 STEP 1255 H= 313:45 +CPU= 34.832
  21:58:13 STEP 1256 H= 314:00 +CPU= 36.256
  21:58:46 STEP 1257 H= 314:15 +CPU= 33.176
  21:59:20 STEP 1258 H= 314:30 +CPU= 33.670
  21:59:53 STEP 1259 H= 314:45 +CPU= 32.735
  22:00:35 STEP 1260 H= 315:00 +CPU= 42.076
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001260
  22:01:10 STEP 1261 H= 315:15 +CPU= 35.467
  22:01:47 STEP 1262 H= 315:30 +CPU= 36.515
  22:02:21 STEP 1263 H= 315:45 +CPU= 34.621
  22:02:56 STEP 1264 H= 316:00 +CPU= 34.285
  22:03:31 STEP 1265 H= 316:15 +CPU= 34.809
  22:04:07 STEP 1266 H= 316:30 +CPU= 36.377
  22:04:43 STEP 1267 H= 316:45 +CPU= 36.261
  22:05:18 STEP 1268 H= 317:00 +CPU= 35.144
  22:05:52 STEP 1269 H= 317:15 +CPU= 33.410
  22:06:27 STEP 1270 H= 317:30 +CPU= 34.943
  22:07:01 STEP 1271 H= 317:45 +CPU= 34.045
  22:07:43 STEP 1272 H= 318:00 +CPU= 41.667
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001272
  22:08:16 STEP 1273 H= 318:15 +CPU= 33.092
  22:08:50 STEP 1274 H= 318:30 +CPU= 33.845
  22:09:23 STEP 1275 H= 318:45 +CPU= 32.739
  22:09:57 STEP 1276 H= 319:00 +CPU= 34.158
  22:10:32 STEP 1277 H= 319:15 +CPU= 33.579
  22:11:05 STEP 1278 H= 319:30 +CPU= 33.441
  22:11:38 STEP 1279 H= 319:45 +CPU= 33.147
  22:12:12 STEP 1280 H= 320:00 +CPU= 33.426
  22:12:48 STEP 1281 H= 320:15 +CPU= 35.482
  22:13:21 STEP 1282 H= 320:30 +CPU= 32.860
  22:13:56 STEP 1283 H= 320:45 +CPU= 35.211
  22:14:40 STEP 1284 H= 321:00 +CPU= 43.926
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001284
  22:15:14 STEP 1285 H= 321:15 +CPU= 34.126
  22:15:47 STEP 1286 H= 321:30 +CPU= 32.739
  22:16:23 STEP 1287 H= 321:45 +CPU= 35.991
  22:16:59 STEP 1288 H= 322:00 +CPU= 36.108
  22:17:35 STEP 1289 H= 322:15 +CPU= 35.440
  22:18:10 STEP 1290 H= 322:30 +CPU= 35.293
  22:18:47 STEP 1291 H= 322:45 +CPU= 36.282
  22:19:23 STEP 1292 H= 323:00 +CPU= 36.259
  22:19:56 STEP 1293 H= 323:15 +CPU= 33.275
  22:20:30 STEP 1294 H= 323:30 +CPU= 34.208
  22:21:07 STEP 1295 H= 323:45 +CPU= 36.590
  22:21:53 STEP 1296 H= 324:00 +CPU= 46.039
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001296
  22:22:29 STEP 1297 H= 324:15 +CPU= 34.335
  22:23:02 STEP 1298 H= 324:30 +CPU= 33.458
  22:23:36 STEP 1299 H= 324:45 +CPU= 33.531
  22:24:10 STEP 1300 H= 325:00 +CPU= 33.935
  22:24:44 STEP 1301 H= 325:15 +CPU= 33.686
  22:25:16 STEP 1302 H= 325:30 +CPU= 32.697
  22:25:49 STEP 1303 H= 325:45 +CPU= 32.710
  22:26:22 STEP 1304 H= 326:00 +CPU= 33.273
  22:26:55 STEP 1305 H= 326:15 +CPU= 32.814
  22:27:30 STEP 1306 H= 326:30 +CPU= 34.130
  22:28:05 STEP 1307 H= 326:45 +CPU= 35.259
  22:28:46 STEP 1308 H= 327:00 +CPU= 41.123
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001308
  22:29:18 STEP 1309 H= 327:15 +CPU= 32.389
  22:29:51 STEP 1310 H= 327:30 +CPU= 32.404
  22:30:23 STEP 1311 H= 327:45 +CPU= 32.287
  22:30:56 STEP 1312 H= 328:00 +CPU= 32.774
  22:31:29 STEP 1313 H= 328:15 +CPU= 33.069
  22:32:02 STEP 1314 H= 328:30 +CPU= 32.505
  22:32:36 STEP 1315 H= 328:45 +CPU= 33.133
  22:33:09 STEP 1316 H= 329:00 +CPU= 32.791
  22:33:41 STEP 1317 H= 329:15 +CPU= 32.244
  22:34:13 STEP 1318 H= 329:30 +CPU= 32.176
  22:34:45 STEP 1319 H= 329:45 +CPU= 31.448
  22:35:25 STEP 1320 H= 330:00 +CPU= 39.887
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001320
  22:35:59 STEP 1321 H= 330:15 +CPU= 33.725
  22:36:31 STEP 1322 H= 330:30 +CPU= 32.076
  22:37:03 STEP 1323 H= 330:45 +CPU= 32.050
  22:37:36 STEP 1324 H= 331:00 +CPU= 32.666
  22:38:08 STEP 1325 H= 331:15 +CPU= 32.367
  22:38:41 STEP 1326 H= 331:30 +CPU= 33.103
  22:39:15 STEP 1327 H= 331:45 +CPU= 33.316
  22:39:50 STEP 1328 H= 332:00 +CPU= 35.486
  22:40:23 STEP 1329 H= 332:15 +CPU= 32.892
  22:40:56 STEP 1330 H= 332:30 +CPU= 32.499
  22:41:30 STEP 1331 H= 332:45 +CPU= 33.555
  22:42:10 STEP 1332 H= 333:00 +CPU= 39.693
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001332
  22:42:41 STEP 1333 H= 333:15 +CPU= 31.749
  22:43:14 STEP 1334 H= 333:30 +CPU= 32.086
  22:43:46 STEP 1335 H= 333:45 +CPU= 32.024
  22:44:18 STEP 1336 H= 334:00 +CPU= 32.483
  22:44:50 STEP 1337 H= 334:15 +CPU= 31.924
  22:45:22 STEP 1338 H= 334:30 +CPU= 31.956
  22:45:54 STEP 1339 H= 334:45 +CPU= 31.903
  22:46:27 STEP 1340 H= 335:00 +CPU= 32.722
  22:46:59 STEP 1341 H= 335:15 +CPU= 32.418
  22:47:32 STEP 1342 H= 335:30 +CPU= 32.544
  22:48:04 STEP 1343 H= 335:45 +CPU= 32.548
  22:48:52 STEP 1344 H= 336:00 +CPU= 46.625
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+001332
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a2ok_2016092300_20_1017_12285303_0_r1152014568_13.zip
Uploading the intermediate file: upload_file_13.zip
  22:49:26 STEP 1345 H= 336:15 +CPU= 33.678
  22:50:00 STEP 1346 H= 336:30 +CPU= 33.718
  22:50:32 STEP 1347 H= 336:45 +CPU= 32.605
  22:51:06 STEP 1348 H= 337:00 +CPU= 32.922
  22:51:40 STEP 1349 H= 337:15 +CPU= 33.962
  22:52:14 STEP 1350 H= 337:30 +CPU= 33.985
  22:52:48 STEP 1351 H= 337:45 +CPU= 34.175
  22:53:21 STEP 1352 H= 338:00 +CPU= 32.929
  22:53:55 STEP 1353 H= 338:15 +CPU= 33.335
  22:54:27 STEP 1354 H= 338:30 +CPU= 31.790
  22:54:59 STEP 1355 H= 338:45 +CPU= 31.805
  22:55:38 STEP 1356 H= 339:00 +CPU= 39.276
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001356
  22:56:10 STEP 1357 H= 339:15 +CPU= 31.631
  22:56:42 STEP 1358 H= 339:30 +CPU= 32.285
  22:57:15 STEP 1359 H= 339:45 +CPU= 32.481
  22:57:47 STEP 1360 H= 340:00 +CPU= 32.415
  22:58:22 STEP 1361 H= 340:15 +CPU= 34.695
  22:58:56 STEP 1362 H= 340:30 +CPU= 34.223
  22:59:30 STEP 1363 H= 340:45 +CPU= 33.488
  23:00:03 STEP 1364 H= 341:00 +CPU= 33.183
  23:00:35 STEP 1365 H= 341:15 +CPU= 32.190
  23:01:07 STEP 1366 H= 341:30 +CPU= 32.322
  23:01:41 STEP 1367 H= 341:45 +CPU= 33.299
  23:02:21 STEP 1368 H= 342:00 +CPU= 40.113
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001368
  23:02:54 STEP 1369 H= 342:15 +CPU= 32.653
  23:03:28 STEP 1370 H= 342:30 +CPU= 33.456
  23:04:01 STEP 1371 H= 342:45 +CPU= 32.614
  23:04:34 STEP 1372 H= 343:00 +CPU= 33.257
  23:05:07 STEP 1373 H= 343:15 +CPU= 32.781
  23:05:40 STEP 1374 H= 343:30 +CPU= 32.825
  23:06:13 STEP 1375 H= 343:45 +CPU= 32.882
  23:06:47 STEP 1376 H= 344:00 +CPU= 33.472
  23:07:20 STEP 1377 H= 344:15 +CPU= 32.910
  23:07:52 STEP 1378 H= 344:30 +CPU= 32.869
  23:08:27 STEP 1379 H= 344:45 +CPU= 34.320
  23:09:10 STEP 1380 H= 345:00 +CPU= 43.619
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001380
  23:09:46 STEP 1381 H= 345:15 +CPU= 35.168
  23:10:21 STEP 1382 H= 345:30 +CPU= 35.272
  23:10:56 STEP 1383 H= 345:45 +CPU= 34.595
  23:11:32 STEP 1384 H= 346:00 +CPU= 36.134
  23:12:07 STEP 1385 H= 346:15 +CPU= 34.863
  23:12:39 STEP 1386 H= 346:30 +CPU= 32.396
  23:13:13 STEP 1387 H= 346:45 +CPU= 33.598
  23:13:49 STEP 1388 H= 347:00 +CPU= 36.018
  23:14:22 STEP 1389 H= 347:15 +CPU= 33.116
  23:14:55 STEP 1390 H= 347:30 +CPU= 32.822
  23:15:29 STEP 1391 H= 347:45 +CPU= 33.791
  23:16:13 STEP 1392 H= 348:00 +CPU= 43.846
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001392
  23:16:45 STEP 1393 H= 348:15 +CPU= 32.062
  23:17:17 STEP 1394 H= 348:30 +CPU= 32.154
  23:17:48 STEP 1395 H= 348:45 +CPU= 31.606
  23:18:23 STEP 1396 H= 349:00 +CPU= 33.986
  23:18:57 STEP 1397 H= 349:15 +CPU= 34.265
  23:19:32 STEP 1398 H= 349:30 +CPU= 34.122
  23:20:06 STEP 1399 H= 349:45 +CPU= 34.076
  23:20:43 STEP 1400 H= 350:00 +CPU= 35.865
  23:21:16 STEP 1401 H= 350:15 +CPU= 32.986
  23:21:49 STEP 1402 H= 350:30 +CPU= 32.323
  23:22:21 STEP 1403 H= 350:45 +CPU= 32.208
  23:23:00 STEP 1404 H= 351:00 +CPU= 39.503
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001404
  23:23:32 STEP 1405 H= 351:15 +CPU= 31.934
  23:24:04 STEP 1406 H= 351:30 +CPU= 31.771
  23:24:37 STEP 1407 H= 351:45 +CPU= 32.261
  23:25:10 STEP 1408 H= 352:00 +CPU= 32.381
  23:25:41 STEP 1409 H= 352:15 +CPU= 31.943
  23:26:13 STEP 1410 H= 352:30 +CPU= 31.808
  23:26:45 STEP 1411 H= 352:45 +CPU= 31.910
  23:27:18 STEP 1412 H= 353:00 +CPU= 32.453
  23:27:49 STEP 1413 H= 353:15 +CPU= 31.660
  23:28:24 STEP 1414 H= 353:30 +CPU= 34.441
  23:28:56 STEP 1415 H= 353:45 +CPU= 31.707
  23:29:37 STEP 1416 H= 354:00 +CPU= 41.058
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001416
  23:30:09 STEP 1417 H= 354:15 +CPU= 32.352
  23:30:41 STEP 1418 H= 354:30 +CPU= 32.392
  23:31:14 STEP 1419 H= 354:45 +CPU= 32.756
  23:31:47 STEP 1420 H= 355:00 +CPU= 32.762
  23:32:19 STEP 1421 H= 355:15 +CPU= 31.506
  23:32:51 STEP 1422 H= 355:30 +CPU= 31.814
  23:33:23 STEP 1423 H= 355:45 +CPU= 32.117
  23:33:56 STEP 1424 H= 356:00 +CPU= 33.016
  23:34:28 STEP 1425 H= 356:15 +CPU= 32.378
  23:35:01 STEP 1426 H= 356:30 +CPU= 32.174
  23:35:33 STEP 1427 H= 356:45 +CPU= 31.970
  23:36:13 STEP 1428 H= 357:00 +CPU= 39.945
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001428
  23:36:47 STEP 1429 H= 357:15 +CPU= 34.303
  23:37:21 STEP 1430 H= 357:30 +CPU= 33.838
  23:37:54 STEP 1431 H= 357:45 +CPU= 32.153
  23:38:27 STEP 1432 H= 358:00 +CPU= 32.975
  23:39:00 STEP 1433 H= 358:15 +CPU= 33.275
  23:39:33 STEP 1434 H= 358:30 +CPU= 32.500
  23:40:05 STEP 1435 H= 358:45 +CPU= 32.380
  23:40:38 STEP 1436 H= 359:00 +CPU= 32.994
  23:41:10 STEP 1437 H= 359:15 +CPU= 32.113
  23:41:43 STEP 1438 H= 359:30 +CPU= 32.180
  23:42:14 STEP 1439 H= 359:45 +CPU= 31.841
  23:42:55 STEP 1440 H= 360:00 +CPU= 40.577
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.1876756414E-20      I       0.1808680974E-05      I
ICloud fractionI      0.0000000000E+00      I       0.2722834775E-01      I
I  Relat. Hum. I      0.3155147655E+00      I       0.3864803531E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.4166342038E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    300920276 BYTES IN      7 RECORDS TRANSFERRED IN    0.0008 SECONDS376150.3 Mbytes/s, TOTAL TIME=    0.0146( 5.5%)
 23:42:55 STEP 1440 H= 360:00 +CPU= 40.577
 END CNT3
 NSTEP =  1440 CNT0   000000000  29.674  29.674  29.688   1.000               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ            0/           0 WRITTEN        43246/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    758    0        0            0    43246 ************    89.7     0.0    89.7     0.0   195.9
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.98      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 1562    4949.3    4949.3     17.03      0.00
   9 SPCM     - SPECTRAL COMP.                    1440     900.9     900.9      2.86      0.00
  10 SCAN2M - PHYSICS                             1441   14493.5   14493.5     46.00      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                121     994.9     994.9      0.27      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 63      42.9      42.9      0.01      0.00
  14 SUINIF                                          1    8061.8    8061.8      0.02      0.00
  17 GRIDFPOS IN CNT4                              121      77.2      77.2      0.02      0.00
  18 SUSPECG                                         1    3950.8    3950.8      0.01      0.00
  19 SUSPEC                                          1    3958.1    3958.1      0.01      0.00
  24 SUGRIDU                                         1    3173.3    3173.3      0.01      0.00
  25 SPECRT                                          1     290.3     290.3      0.00      0.00
  26 SUGRIDF                                         1     640.1     640.1      0.00      0.00
  27 RESTART FILES - WRITING                        30    4012.6    4012.6      0.27      0.00
  28 RESTART FILES - READING                         1       0.0       0.0      0.00      0.00
  29 SU4FPOS IN CNT4                               121       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                               121    6820.6    6820.6      1.82      0.00
  31 POSDDH IN STEPO                                 7       1.0       1.0      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   1441    6521.3    6521.3     20.70      0.00
  39 SU0YOMB                                         1     445.3     445.3      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   1441      29.1      29.1      0.09      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             1440     354.6     354.6      1.12      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             1440      80.3      80.3      0.25      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 63       0.3       0.3      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     3125     591.7     591.7      4.07      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      3006     331.3     331.3      2.19      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       3006     122.2     122.2      0.81      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      3125     167.1     167.1      1.15      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      43.0      43.0      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           3125      67.2      67.2      0.46      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           3006      33.7      33.7      0.22      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           3125     112.6     112.6      0.78      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           3006      56.4      56.4      0.37      0.00
 400 GSTATS                                     167734       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                156066       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    45404.8 CPU TIME   45286.0 VECTOR TIME    45286.0


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       28.5
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/slots/4/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/4/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285303/ICMUAh7zg+001392
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a2ok_2016092300_20_1017_12285303_0_r1152014568_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
23:46:28 (3890873): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>oifs_43r3_bl_a2ok_2016092300_20_1017_12285303_0_r1152014568_15.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a2ok_2016092300_20_1017_12285303_0_r1152014568_16.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a2ok_2016092300_20_1017_12285303_0_r1152014568_17.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a2ok_2016092300_20_1017_12285303_0_r1152014568_18.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a2ok_2016092300_20_1017_12285303_0_r1152014568_19.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
08 Jun 2024 05:02:52 1538890 22436899 oifs_43r3_bl_a2ok_2016092300_20_1017_12285303_0 1,295,100 45,286 0.0350
08 Jun 2024 01:04:34 1538890 22436899 oifs_43r3_bl_a2ok_2016092300_20_1017_12285303_0 864,000 28,752 0.0333


©2024 climateprediction.net