climateprediction.net home page
Task 22433467

Task 22433467

Name oifs_43r3_bl_a021_2016092300_20_1017_12281900_0
Workunit 12281900
Created 7 Jun 2024, 10:57:16 UTC
Sent 7 Jun 2024, 11:14:04 UTC
Report deadline 6 Aug 2024, 11:14:04 UTC
Received 8 Jun 2024, 4:31:57 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1550999
Run time 11 hours 45 min
CPU time 11 hours 11 min 43 sec
Validate state Invalid
Credit 1,976.32
Device peak FLOPS 7.29 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,021.26 MB
Peak swap size 5,980.80 MB
Peak disk usage 1,378.16 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<stderr_txt>
U= 28.355
  01:32:11 STEP  834 H= 208:30 +CPU= 27.407
  01:32:39 STEP  835 H= 208:45 +CPU= 27.065
  01:33:08 STEP  836 H= 209:00 +CPU= 28.451
  01:33:37 STEP  837 H= 209:15 +CPU= 27.710
  01:34:05 STEP  838 H= 209:30 +CPU= 28.033
  01:34:33 STEP  839 H= 209:45 +CPU= 27.382
  01:35:11 STEP  840 H= 210:00 +CPU= 36.248
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+000840
  01:35:39 STEP  841 H= 210:15 +CPU= 27.392
  01:36:09 STEP  842 H= 210:30 +CPU= 27.836
  01:36:37 STEP  843 H= 210:45 +CPU= 26.992
  01:37:05 STEP  844 H= 211:00 +CPU= 27.714
  01:37:34 STEP  845 H= 211:15 +CPU= 28.577
  01:38:02 STEP  846 H= 211:30 +CPU= 27.223
  01:38:30 STEP  847 H= 211:45 +CPU= 27.823
  01:38:58 STEP  848 H= 212:00 +CPU= 27.287
  01:39:27 STEP  849 H= 212:15 +CPU= 27.862
  01:39:54 STEP  850 H= 212:30 +CPU= 27.461
  01:40:24 STEP  851 H= 212:45 +CPU= 29.058
  01:40:59 STEP  852 H= 213:00 +CPU= 34.083
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+000852
  01:41:27 STEP  853 H= 213:15 +CPU= 26.792
  01:41:55 STEP  854 H= 213:30 +CPU= 27.957
  01:42:24 STEP  855 H= 213:45 +CPU= 28.152
  01:42:52 STEP  856 H= 214:00 +CPU= 27.691
  01:43:21 STEP  857 H= 214:15 +CPU= 28.251
  01:43:49 STEP  858 H= 214:30 +CPU= 27.364
  01:44:17 STEP  859 H= 214:45 +CPU= 27.692
  01:44:47 STEP  860 H= 215:00 +CPU= 29.165
  01:45:15 STEP  861 H= 215:15 +CPU= 27.258
  01:45:43 STEP  862 H= 215:30 +CPU= 27.253
  01:46:11 STEP  863 H= 215:45 +CPU= 27.305
  01:46:54 STEP  864 H= 216:00 +CPU= 41.431
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+000864
  01:47:22 STEP  865 H= 216:15 +CPU= 27.327
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+000864
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a021_2016092300_20_1017_12281900_0_r1282380368_8.zip
Uploading the intermediate file: upload_file_8.zip
  01:47:50 STEP  866 H= 216:30 +CPU= 27.040
  01:48:20 STEP  867 H= 216:45 +CPU= 29.321
  01:48:50 STEP  868 H= 217:00 +CPU= 28.995
  01:49:18 STEP  869 H= 217:15 +CPU= 27.552
  01:49:47 STEP  870 H= 217:30 +CPU= 28.133
  01:50:16 STEP  871 H= 217:45 +CPU= 28.585
  01:50:46 STEP  872 H= 218:00 +CPU= 28.834
  01:51:13 STEP  873 H= 218:15 +CPU= 26.930
  01:51:42 STEP  874 H= 218:30 +CPU= 27.994
  01:52:10 STEP  875 H= 218:45 +CPU= 27.823
  01:52:47 STEP  876 H= 219:00 +CPU= 35.646
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+000876
  01:53:14 STEP  877 H= 219:15 +CPU= 26.748
  01:53:42 STEP  878 H= 219:30 +CPU= 26.947
  01:54:10 STEP  879 H= 219:45 +CPU= 27.343
  01:54:39 STEP  880 H= 220:00 +CPU= 28.115
  01:55:08 STEP  881 H= 220:15 +CPU= 28.092
  01:55:35 STEP  882 H= 220:30 +CPU= 26.287
  01:56:02 STEP  883 H= 220:45 +CPU= 27.180
  01:56:31 STEP  884 H= 221:00 +CPU= 27.622
  01:56:57 STEP  885 H= 221:15 +CPU= 26.088
  01:57:24 STEP  886 H= 221:30 +CPU= 26.114
  01:57:51 STEP  887 H= 221:45 +CPU= 26.898
  01:58:28 STEP  888 H= 222:00 +CPU= 36.479
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+000888
  01:58:57 STEP  889 H= 222:15 +CPU= 27.488
  01:59:25 STEP  890 H= 222:30 +CPU= 27.536
  01:59:51 STEP  891 H= 222:45 +CPU= 26.113
  02:00:18 STEP  892 H= 223:00 +CPU= 26.542
  02:00:46 STEP  893 H= 223:15 +CPU= 27.157
  02:01:14 STEP  894 H= 223:30 +CPU= 27.691
  02:01:41 STEP  895 H= 223:45 +CPU= 26.636
  02:02:09 STEP  896 H= 224:00 +CPU= 27.427
  02:02:37 STEP  897 H= 224:15 +CPU= 27.772
  02:03:04 STEP  898 H= 224:30 +CPU= 26.430
  02:03:32 STEP  899 H= 224:45 +CPU= 27.704
  02:04:09 STEP  900 H= 225:00 +CPU= 35.977
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+000900
  02:04:37 STEP  901 H= 225:15 +CPU= 27.299
  02:05:05 STEP  902 H= 225:30 +CPU= 27.547
  02:05:34 STEP  903 H= 225:45 +CPU= 28.159
  02:06:03 STEP  904 H= 226:00 +CPU= 27.907
  02:06:31 STEP  905 H= 226:15 +CPU= 27.241
  02:07:01 STEP  906 H= 226:30 +CPU= 28.695
  02:07:28 STEP  907 H= 226:45 +CPU= 26.621
  02:07:57 STEP  908 H= 227:00 +CPU= 28.234
  02:08:23 STEP  909 H= 227:15 +CPU= 26.247
  02:08:52 STEP  910 H= 227:30 +CPU= 27.800
  02:09:21 STEP  911 H= 227:45 +CPU= 28.006
  02:10:02 STEP  912 H= 228:00 +CPU= 40.053
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+000912
  02:10:31 STEP  913 H= 228:15 +CPU= 27.658
  02:11:01 STEP  914 H= 228:30 +CPU= 28.827
  02:11:30 STEP  915 H= 228:45 +CPU= 28.319
  02:11:58 STEP  916 H= 229:00 +CPU= 27.778
  02:12:27 STEP  917 H= 229:15 +CPU= 27.793
  02:12:56 STEP  918 H= 229:30 +CPU= 28.743
  02:13:24 STEP  919 H= 229:45 +CPU= 27.195
  02:13:53 STEP  920 H= 230:00 +CPU= 28.170
  02:14:21 STEP  921 H= 230:15 +CPU= 27.547
  02:14:49 STEP  922 H= 230:30 +CPU= 27.500
  02:15:17 STEP  923 H= 230:45 +CPU= 27.684
  02:15:53 STEP  924 H= 231:00 +CPU= 34.399
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+000924
  02:16:21 STEP  925 H= 231:15 +CPU= 27.761
  02:16:51 STEP  926 H= 231:30 +CPU= 29.078
  02:17:19 STEP  927 H= 231:45 +CPU= 27.972
  02:17:49 STEP  928 H= 232:00 +CPU= 29.146
  02:18:18 STEP  929 H= 232:15 +CPU= 27.723
  02:18:45 STEP  930 H= 232:30 +CPU= 26.698
  02:19:14 STEP  931 H= 232:45 +CPU= 28.347
  02:19:42 STEP  932 H= 233:00 +CPU= 27.434
  02:20:09 STEP  933 H= 233:15 +CPU= 26.530
  02:20:37 STEP  934 H= 233:30 +CPU= 27.236
  02:21:04 STEP  935 H= 233:45 +CPU= 26.771
  02:21:40 STEP  936 H= 234:00 +CPU= 34.674
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+000936
  02:22:08 STEP  937 H= 234:15 +CPU= 27.139
  02:22:37 STEP  938 H= 234:30 +CPU= 27.922
  02:23:06 STEP  939 H= 234:45 +CPU= 28.205
  02:23:36 STEP  940 H= 235:00 +CPU= 29.068
  02:24:04 STEP  941 H= 235:15 +CPU= 27.805
  02:24:32 STEP  942 H= 235:30 +CPU= 26.889
  02:25:01 STEP  943 H= 235:45 +CPU= 28.300
  02:25:29 STEP  944 H= 236:00 +CPU= 28.044
  02:25:57 STEP  945 H= 236:15 +CPU= 27.092
  02:26:25 STEP  946 H= 236:30 +CPU= 27.651
  02:26:54 STEP  947 H= 236:45 +CPU= 27.900
  02:27:28 STEP  948 H= 237:00 +CPU= 34.168
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+000948
  02:27:56 STEP  949 H= 237:15 +CPU= 27.001
  02:28:24 STEP  950 H= 237:30 +CPU= 26.679
  02:28:53 STEP  951 H= 237:45 +CPU= 29.193
  02:29:23 STEP  952 H= 238:00 +CPU= 28.753
  02:29:50 STEP  953 H= 238:15 +CPU= 26.323
  02:30:18 STEP  954 H= 238:30 +CPU= 27.023
  02:30:47 STEP  955 H= 238:45 +CPU= 28.564
  02:31:14 STEP  956 H= 239:00 +CPU= 26.865
  02:31:44 STEP  957 H= 239:15 +CPU= 28.686
  02:32:11 STEP  958 H= 239:30 +CPU= 26.557
  02:32:40 STEP  959 H= 239:45 +CPU= 28.806
  02:33:21 STEP  960 H= 240:00 +CPU= 39.750
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+000960
  02:33:49 STEP  961 H= 240:15 +CPU= 27.302
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+000960
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a021_2016092300_20_1017_12281900_0_r1282380368_9.zip
Uploading the intermediate file: upload_file_9.zip
  02:34:17 STEP  962 H= 240:30 +CPU= 27.169
  02:34:45 STEP  963 H= 240:45 +CPU= 27.412
  02:35:14 STEP  964 H= 241:00 +CPU= 27.873
  02:35:41 STEP  965 H= 241:15 +CPU= 26.867
  02:36:11 STEP  966 H= 241:30 +CPU= 29.353
  02:36:40 STEP  967 H= 241:45 +CPU= 28.706
  02:37:10 STEP  968 H= 242:00 +CPU= 28.521
  02:37:38 STEP  969 H= 242:15 +CPU= 27.559
  02:38:06 STEP  970 H= 242:30 +CPU= 27.401
  02:38:33 STEP  971 H= 242:45 +CPU= 26.439
  02:39:08 STEP  972 H= 243:00 +CPU= 33.962
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+000972
  02:39:36 STEP  973 H= 243:15 +CPU= 27.114
  02:40:04 STEP  974 H= 243:30 +CPU= 27.726
  02:40:32 STEP  975 H= 243:45 +CPU= 27.188
  02:41:02 STEP  976 H= 244:00 +CPU= 29.195
  02:41:31 STEP  977 H= 244:15 +CPU= 28.653
  02:42:00 STEP  978 H= 244:30 +CPU= 27.799
  02:42:29 STEP  979 H= 244:45 +CPU= 28.325
  02:42:57 STEP  980 H= 245:00 +CPU= 28.015
  02:43:25 STEP  981 H= 245:15 +CPU= 27.362
  02:43:54 STEP  982 H= 245:30 +CPU= 27.655
  02:44:23 STEP  983 H= 245:45 +CPU= 28.489
  02:44:59 STEP  984 H= 246:00 +CPU= 35.538
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+000984
  02:45:29 STEP  985 H= 246:15 +CPU= 28.314
  02:45:57 STEP  986 H= 246:30 +CPU= 28.071
  02:46:27 STEP  987 H= 246:45 +CPU= 28.397
  02:46:56 STEP  988 H= 247:00 +CPU= 28.642
  02:47:25 STEP  989 H= 247:15 +CPU= 28.127
  02:47:53 STEP  990 H= 247:30 +CPU= 27.582
  02:48:21 STEP  991 H= 247:45 +CPU= 27.186
  02:48:49 STEP  992 H= 248:00 +CPU= 27.791
  02:49:17 STEP  993 H= 248:15 +CPU= 27.667
  02:49:46 STEP  994 H= 248:30 +CPU= 28.253
  02:50:15 STEP  995 H= 248:45 +CPU= 28.197
  02:50:53 STEP  996 H= 249:00 +CPU= 36.456
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+000996
  02:51:22 STEP  997 H= 249:15 +CPU= 29.483
  02:51:52 STEP  998 H= 249:30 +CPU= 28.765
  02:52:21 STEP  999 H= 249:45 +CPU= 27.856
  02:52:51 STEP 1000 H= 250:00 +CPU= 29.203
  02:53:19 STEP 1001 H= 250:15 +CPU= 27.565
  02:53:49 STEP 1002 H= 250:30 +CPU= 28.907
  02:54:20 STEP 1003 H= 250:45 +CPU= 29.997
  02:54:49 STEP 1004 H= 251:00 +CPU= 28.622
  02:55:17 STEP 1005 H= 251:15 +CPU= 27.360
  02:55:45 STEP 1006 H= 251:30 +CPU= 28.005
  02:56:12 STEP 1007 H= 251:45 +CPU= 26.546
  02:56:54 STEP 1008 H= 252:00 +CPU= 40.106
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001008
  02:57:22 STEP 1009 H= 252:15 +CPU= 28.154
  02:57:51 STEP 1010 H= 252:30 +CPU= 28.092
  02:58:21 STEP 1011 H= 252:45 +CPU= 28.867
  02:58:49 STEP 1012 H= 253:00 +CPU= 28.072
  02:59:17 STEP 1013 H= 253:15 +CPU= 27.044
  02:59:45 STEP 1014 H= 253:30 +CPU= 27.585
  03:00:11 STEP 1015 H= 253:45 +CPU= 25.873
  03:00:38 STEP 1016 H= 254:00 +CPU= 26.531
  03:01:05 STEP 1017 H= 254:15 +CPU= 26.388
  03:01:33 STEP 1018 H= 254:30 +CPU= 26.760
  03:01:59 STEP 1019 H= 254:45 +CPU= 26.292
  03:02:32 STEP 1020 H= 255:00 +CPU= 32.510
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001020
  03:02:58 STEP 1021 H= 255:15 +CPU= 25.419
  03:03:23 STEP 1022 H= 255:30 +CPU= 24.536
  03:03:49 STEP 1023 H= 255:45 +CPU= 25.039
  03:04:15 STEP 1024 H= 256:00 +CPU= 25.792
  03:04:40 STEP 1025 H= 256:15 +CPU= 25.054
  03:05:06 STEP 1026 H= 256:30 +CPU= 25.683
  03:05:32 STEP 1027 H= 256:45 +CPU= 25.424
  03:05:58 STEP 1028 H= 257:00 +CPU= 25.401
  03:06:24 STEP 1029 H= 257:15 +CPU= 26.081
  03:06:50 STEP 1030 H= 257:30 +CPU= 25.335
  03:07:19 STEP 1031 H= 257:45 +CPU= 27.841
  03:07:55 STEP 1032 H= 258:00 +CPU= 35.084
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001032
  03:08:22 STEP 1033 H= 258:15 +CPU= 26.770
  03:08:48 STEP 1034 H= 258:30 +CPU= 26.090
  03:09:15 STEP 1035 H= 258:45 +CPU= 25.833
  03:09:43 STEP 1036 H= 259:00 +CPU= 27.040
  03:10:09 STEP 1037 H= 259:15 +CPU= 25.125
  03:10:34 STEP 1038 H= 259:30 +CPU= 25.318
  03:11:01 STEP 1039 H= 259:45 +CPU= 26.680
  03:11:28 STEP 1040 H= 260:00 +CPU= 26.477
  03:11:53 STEP 1041 H= 260:15 +CPU= 24.753
  03:12:19 STEP 1042 H= 260:30 +CPU= 24.993
  03:12:44 STEP 1043 H= 260:45 +CPU= 24.771
  03:13:17 STEP 1044 H= 261:00 +CPU= 32.029
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001044
  03:13:43 STEP 1045 H= 261:15 +CPU= 26.028
  03:14:11 STEP 1046 H= 261:30 +CPU= 26.758
  03:14:39 STEP 1047 H= 261:45 +CPU= 28.090
  03:15:06 STEP 1048 H= 262:00 +CPU= 26.250
  03:15:31 STEP 1049 H= 262:15 +CPU= 24.707
  03:16:00 STEP 1050 H= 262:30 +CPU= 27.781
  03:16:27 STEP 1051 H= 262:45 +CPU= 26.842
  03:16:55 STEP 1052 H= 263:00 +CPU= 27.425
  03:17:21 STEP 1053 H= 263:15 +CPU= 25.360
  03:17:48 STEP 1054 H= 263:30 +CPU= 26.474
  03:18:13 STEP 1055 H= 263:45 +CPU= 25.026
  03:18:54 STEP 1056 H= 264:00 +CPU= 40.443
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001056
  03:19:20 STEP 1057 H= 264:15 +CPU= 25.743
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+001056
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a021_2016092300_20_1017_12281900_0_r1282380368_10.zip
Uploading the intermediate file: upload_file_10.zip
  03:19:48 STEP 1058 H= 264:30 +CPU= 26.171
  03:20:14 STEP 1059 H= 264:45 +CPU= 26.000
  03:20:43 STEP 1060 H= 265:00 +CPU= 28.816
  03:21:10 STEP 1061 H= 265:15 +CPU= 25.911
  03:21:36 STEP 1062 H= 265:30 +CPU= 25.839
  03:22:02 STEP 1063 H= 265:45 +CPU= 25.956
  03:22:30 STEP 1064 H= 266:00 +CPU= 27.409
  03:22:58 STEP 1065 H= 266:15 +CPU= 27.821
  03:23:26 STEP 1066 H= 266:30 +CPU= 27.179
  03:23:52 STEP 1067 H= 266:45 +CPU= 25.327
  03:24:27 STEP 1068 H= 267:00 +CPU= 34.331
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001068
  03:24:52 STEP 1069 H= 267:15 +CPU= 25.284
  03:25:21 STEP 1070 H= 267:30 +CPU= 27.381
  03:25:47 STEP 1071 H= 267:45 +CPU= 26.028
  03:26:13 STEP 1072 H= 268:00 +CPU= 25.702
  03:26:41 STEP 1073 H= 268:15 +CPU= 27.470
  03:27:07 STEP 1074 H= 268:30 +CPU= 25.696
  03:27:34 STEP 1075 H= 268:45 +CPU= 26.067
  03:28:02 STEP 1076 H= 269:00 +CPU= 27.015
  03:28:29 STEP 1077 H= 269:15 +CPU= 26.954
  03:28:56 STEP 1078 H= 269:30 +CPU= 26.656
  03:29:24 STEP 1079 H= 269:45 +CPU= 27.063
  03:29:58 STEP 1080 H= 270:00 +CPU= 33.223
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001080
  03:30:24 STEP 1081 H= 270:15 +CPU= 25.751
  03:30:51 STEP 1082 H= 270:30 +CPU= 26.820
  03:31:18 STEP 1083 H= 270:45 +CPU= 26.461
  03:31:46 STEP 1084 H= 271:00 +CPU= 27.362
  03:32:14 STEP 1085 H= 271:15 +CPU= 27.084
  03:32:39 STEP 1086 H= 271:30 +CPU= 25.268
  03:33:05 STEP 1087 H= 271:45 +CPU= 24.981
  03:33:33 STEP 1088 H= 272:00 +CPU= 27.907
  03:33:59 STEP 1089 H= 272:15 +CPU= 25.437
  03:34:25 STEP 1090 H= 272:30 +CPU= 25.204
  03:34:51 STEP 1091 H= 272:45 +CPU= 25.308
  03:35:24 STEP 1092 H= 273:00 +CPU= 32.498
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001092
  03:35:49 STEP 1093 H= 273:15 +CPU= 24.713
  03:36:16 STEP 1094 H= 273:30 +CPU= 26.357
  03:36:43 STEP 1095 H= 273:45 +CPU= 26.024
  03:37:11 STEP 1096 H= 274:00 +CPU= 27.455
  03:37:38 STEP 1097 H= 274:15 +CPU= 26.096
  03:38:04 STEP 1098 H= 274:30 +CPU= 25.850
  03:38:31 STEP 1099 H= 274:45 +CPU= 25.746
  03:38:58 STEP 1100 H= 275:00 +CPU= 26.789
  03:39:26 STEP 1101 H= 275:15 +CPU= 27.232
  03:39:52 STEP 1102 H= 275:30 +CPU= 25.290
  03:40:22 STEP 1103 H= 275:45 +CPU= 27.435
  03:40:59 STEP 1104 H= 276:00 +CPU= 36.825
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001104
  03:41:27 STEP 1105 H= 276:15 +CPU= 27.499
  03:41:55 STEP 1106 H= 276:30 +CPU= 27.511
  03:42:22 STEP 1107 H= 276:45 +CPU= 26.397
  03:42:50 STEP 1108 H= 277:00 +CPU= 27.064
  03:43:17 STEP 1109 H= 277:15 +CPU= 26.420
  03:43:44 STEP 1110 H= 277:30 +CPU= 26.291
  03:44:12 STEP 1111 H= 277:45 +CPU= 27.101
  03:44:38 STEP 1112 H= 278:00 +CPU= 25.575
  03:45:04 STEP 1113 H= 278:15 +CPU= 26.266
  03:45:31 STEP 1114 H= 278:30 +CPU= 26.224
  03:45:56 STEP 1115 H= 278:45 +CPU= 25.312
  03:46:28 STEP 1116 H= 279:00 +CPU= 31.241
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001116
  03:46:55 STEP 1117 H= 279:15 +CPU= 26.294
  03:47:22 STEP 1118 H= 279:30 +CPU= 26.804
  03:47:48 STEP 1119 H= 279:45 +CPU= 25.621
  03:48:15 STEP 1120 H= 280:00 +CPU= 26.043
  03:48:40 STEP 1121 H= 280:15 +CPU= 24.802
  03:49:05 STEP 1122 H= 280:30 +CPU= 24.930
  03:49:33 STEP 1123 H= 280:45 +CPU= 27.234
  03:50:00 STEP 1124 H= 281:00 +CPU= 25.885
  03:50:27 STEP 1125 H= 281:15 +CPU= 26.849
  03:50:53 STEP 1126 H= 281:30 +CPU= 25.199
  03:51:21 STEP 1127 H= 281:45 +CPU= 27.886
  03:51:54 STEP 1128 H= 282:00 +CPU= 32.142
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001128
  03:52:21 STEP 1129 H= 282:15 +CPU= 26.664
  03:52:49 STEP 1130 H= 282:30 +CPU= 27.100
  03:53:13 STEP 1131 H= 282:45 +CPU= 24.435
  03:53:39 STEP 1132 H= 283:00 +CPU= 25.517
  03:54:06 STEP 1133 H= 283:15 +CPU= 25.973
  03:54:31 STEP 1134 H= 283:30 +CPU= 25.192
  03:54:56 STEP 1135 H= 283:45 +CPU= 24.887
  03:55:22 STEP 1136 H= 284:00 +CPU= 24.962
  03:55:47 STEP 1137 H= 284:15 +CPU= 24.571
  03:56:12 STEP 1138 H= 284:30 +CPU= 24.863
  03:56:37 STEP 1139 H= 284:45 +CPU= 25.148
  03:57:10 STEP 1140 H= 285:00 +CPU= 32.111
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001140
  03:57:35 STEP 1141 H= 285:15 +CPU= 24.455
  03:57:59 STEP 1142 H= 285:30 +CPU= 24.195
  03:58:24 STEP 1143 H= 285:45 +CPU= 23.865
  03:58:49 STEP 1144 H= 286:00 +CPU= 25.468
  03:59:14 STEP 1145 H= 286:15 +CPU= 24.072
  03:59:39 STEP 1146 H= 286:30 +CPU= 24.557
  04:00:03 STEP 1147 H= 286:45 +CPU= 24.308
  04:00:28 STEP 1148 H= 287:00 +CPU= 24.551
  04:00:52 STEP 1149 H= 287:15 +CPU= 23.287
  04:01:17 STEP 1150 H= 287:30 +CPU= 24.428
  04:01:42 STEP 1151 H= 287:45 +CPU= 24.556
  04:02:19 STEP 1152 H= 288:00 +CPU= 36.881
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001152
  04:02:44 STEP 1153 H= 288:15 +CPU= 24.476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+001152
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a021_2016092300_20_1017_12281900_0_r1282380368_11.zip
Uploading the intermediate file: upload_file_11.zip
  04:03:11 STEP 1154 H= 288:30 +CPU= 26.527
  04:03:38 STEP 1155 H= 288:45 +CPU= 26.282
  04:04:04 STEP 1156 H= 289:00 +CPU= 24.856
  04:04:27 STEP 1157 H= 289:15 +CPU= 23.147
  04:04:52 STEP 1158 H= 289:30 +CPU= 23.950
  04:05:18 STEP 1159 H= 289:45 +CPU= 25.666
  04:05:46 STEP 1160 H= 290:00 +CPU= 27.547
  04:06:13 STEP 1161 H= 290:15 +CPU= 27.001
  04:06:39 STEP 1162 H= 290:30 +CPU= 25.284
  04:07:06 STEP 1163 H= 290:45 +CPU= 26.411
  04:07:39 STEP 1164 H= 291:00 +CPU= 32.583
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001164
  04:08:05 STEP 1165 H= 291:15 +CPU= 25.382
  04:08:31 STEP 1166 H= 291:30 +CPU= 25.554
  04:08:57 STEP 1167 H= 291:45 +CPU= 25.032
  04:09:24 STEP 1168 H= 292:00 +CPU= 27.224
  04:09:51 STEP 1169 H= 292:15 +CPU= 26.509
  04:10:19 STEP 1170 H= 292:30 +CPU= 26.947
  04:10:43 STEP 1171 H= 292:45 +CPU= 24.434
  04:11:10 STEP 1172 H= 293:00 +CPU= 26.366
  04:11:36 STEP 1173 H= 293:15 +CPU= 25.641
  04:12:03 STEP 1174 H= 293:30 +CPU= 25.949
  04:12:29 STEP 1175 H= 293:45 +CPU= 25.604
  04:13:01 STEP 1176 H= 294:00 +CPU= 31.501
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001176
  04:13:26 STEP 1177 H= 294:15 +CPU= 24.824
  04:13:49 STEP 1178 H= 294:30 +CPU= 23.091
  04:14:16 STEP 1179 H= 294:45 +CPU= 25.751
  04:14:42 STEP 1180 H= 295:00 +CPU= 25.769
  04:15:09 STEP 1181 H= 295:15 +CPU= 26.578
  04:15:33 STEP 1182 H= 295:30 +CPU= 24.091
  04:15:59 STEP 1183 H= 295:45 +CPU= 25.161
  04:16:27 STEP 1184 H= 296:00 +CPU= 27.659
  04:16:53 STEP 1185 H= 296:15 +CPU= 25.747
  04:17:20 STEP 1186 H= 296:30 +CPU= 26.298
  04:17:45 STEP 1187 H= 296:45 +CPU= 24.359
  04:18:18 STEP 1188 H= 297:00 +CPU= 32.661
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001188
  04:18:44 STEP 1189 H= 297:15 +CPU= 25.544
  04:19:10 STEP 1190 H= 297:30 +CPU= 25.801
  04:19:36 STEP 1191 H= 297:45 +CPU= 25.204
  04:20:04 STEP 1192 H= 298:00 +CPU= 27.963
  04:20:31 STEP 1193 H= 298:15 +CPU= 26.419
  04:20:58 STEP 1194 H= 298:30 +CPU= 25.963
  04:21:26 STEP 1195 H= 298:45 +CPU= 27.766
  04:21:54 STEP 1196 H= 299:00 +CPU= 27.677
  04:22:21 STEP 1197 H= 299:15 +CPU= 25.938
  04:22:47 STEP 1198 H= 299:30 +CPU= 25.451
  04:23:11 STEP 1199 H= 299:45 +CPU= 23.757
  04:23:47 STEP 1200 H= 300:00 +CPU= 35.023
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001200
  04:24:13 STEP 1201 H= 300:15 +CPU= 25.873
  04:24:39 STEP 1202 H= 300:30 +CPU= 25.887
  04:25:05 STEP 1203 H= 300:45 +CPU= 25.110
  04:25:32 STEP 1204 H= 301:00 +CPU= 26.820
  04:25:59 STEP 1205 H= 301:15 +CPU= 26.015
  04:26:25 STEP 1206 H= 301:30 +CPU= 25.169
  04:26:52 STEP 1207 H= 301:45 +CPU= 26.835
  04:27:18 STEP 1208 H= 302:00 +CPU= 25.895
  04:27:46 STEP 1209 H= 302:15 +CPU= 27.522
  04:28:14 STEP 1210 H= 302:30 +CPU= 27.467
  04:28:39 STEP 1211 H= 302:45 +CPU= 24.444
  04:29:12 STEP 1212 H= 303:00 +CPU= 32.281
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001212
  04:29:37 STEP 1213 H= 303:15 +CPU= 24.740
  04:30:04 STEP 1214 H= 303:30 +CPU= 25.757
  04:30:31 STEP 1215 H= 303:45 +CPU= 26.358
  04:30:59 STEP 1216 H= 304:00 +CPU= 27.558
  04:31:23 STEP 1217 H= 304:15 +CPU= 23.616
  04:31:47 STEP 1218 H= 304:30 +CPU= 24.224
  04:32:14 STEP 1219 H= 304:45 +CPU= 25.795
  04:32:40 STEP 1220 H= 305:00 +CPU= 26.029
  04:33:06 STEP 1221 H= 305:15 +CPU= 25.574
  04:33:31 STEP 1222 H= 305:30 +CPU= 24.249
  04:33:57 STEP 1223 H= 305:45 +CPU= 25.509
  04:34:30 STEP 1224 H= 306:00 +CPU= 31.807
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001224
  04:34:56 STEP 1225 H= 306:15 +CPU= 25.390
  04:35:23 STEP 1226 H= 306:30 +CPU= 26.463
  04:35:49 STEP 1227 H= 306:45 +CPU= 26.189
  04:36:16 STEP 1228 H= 307:00 +CPU= 26.586
  04:36:43 STEP 1229 H= 307:15 +CPU= 25.927
  04:37:08 STEP 1230 H= 307:30 +CPU= 24.994
  04:37:34 STEP 1231 H= 307:45 +CPU= 25.280
  04:38:00 STEP 1232 H= 308:00 +CPU= 25.934
  04:38:25 STEP 1233 H= 308:15 +CPU= 24.478
  04:38:50 STEP 1234 H= 308:30 +CPU= 24.386
  04:39:17 STEP 1235 H= 308:45 +CPU= 26.557
  04:39:48 STEP 1236 H= 309:00 +CPU= 30.425
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001236
  04:40:13 STEP 1237 H= 309:15 +CPU= 24.544
  04:40:41 STEP 1238 H= 309:30 +CPU= 26.926
  04:41:06 STEP 1239 H= 309:45 +CPU= 24.942
  04:41:33 STEP 1240 H= 310:00 +CPU= 27.077
  04:42:01 STEP 1241 H= 310:15 +CPU= 27.645
  04:42:27 STEP 1242 H= 310:30 +CPU= 24.709
  04:42:52 STEP 1243 H= 310:45 +CPU= 24.956
  04:43:16 STEP 1244 H= 311:00 +CPU= 23.348
  04:43:41 STEP 1245 H= 311:15 +CPU= 24.590
  04:44:08 STEP 1246 H= 311:30 +CPU= 26.179
  04:44:33 STEP 1247 H= 311:45 +CPU= 25.207
  04:45:12 STEP 1248 H= 312:00 +CPU= 37.834
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001248
  04:45:36 STEP 1249 H= 312:15 +CPU= 23.721
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+001248
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a021_2016092300_20_1017_12281900_0_r1282380368_12.zip
Uploading the intermediate file: upload_file_12.zip
  04:46:02 STEP 1250 H= 312:30 +CPU= 25.250
Uploading trickle at timestep: 1124100
  04:46:28 STEP 1251 H= 312:45 +CPU= 25.170
  04:46:56 STEP 1252 H= 313:00 +CPU= 27.743
  04:47:21 STEP 1253 H= 313:15 +CPU= 24.566
  04:47:47 STEP 1254 H= 313:30 +CPU= 25.910
  04:48:15 STEP 1255 H= 313:45 +CPU= 27.134
  04:48:43 STEP 1256 H= 314:00 +CPU= 27.492
  04:49:09 STEP 1257 H= 314:15 +CPU= 25.556
  04:49:37 STEP 1258 H= 314:30 +CPU= 27.042
  04:50:04 STEP 1259 H= 314:45 +CPU= 26.897
  04:50:39 STEP 1260 H= 315:00 +CPU= 34.664
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001260
  04:51:06 STEP 1261 H= 315:15 +CPU= 25.970
  04:51:31 STEP 1262 H= 315:30 +CPU= 24.632
  04:51:58 STEP 1263 H= 315:45 +CPU= 26.917
  04:52:26 STEP 1264 H= 316:00 +CPU= 27.149
  04:52:51 STEP 1265 H= 316:15 +CPU= 24.417
  04:53:17 STEP 1266 H= 316:30 +CPU= 25.629
  04:53:43 STEP 1267 H= 316:45 +CPU= 24.896
  04:54:11 STEP 1268 H= 317:00 +CPU= 27.730
  04:54:36 STEP 1269 H= 317:15 +CPU= 25.025
  04:55:03 STEP 1270 H= 317:30 +CPU= 26.784
  04:55:27 STEP 1271 H= 317:45 +CPU= 23.530
  04:56:00 STEP 1272 H= 318:00 +CPU= 31.684
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001272
  04:56:27 STEP 1273 H= 318:15 +CPU= 26.134
  04:56:51 STEP 1274 H= 318:30 +CPU= 24.560
  04:57:18 STEP 1275 H= 318:45 +CPU= 26.492
  04:57:46 STEP 1276 H= 319:00 +CPU= 26.886
  04:58:10 STEP 1277 H= 319:15 +CPU= 24.359
  04:58:37 STEP 1278 H= 319:30 +CPU= 25.960
  04:59:03 STEP 1279 H= 319:45 +CPU= 25.504
  04:59:31 STEP 1280 H= 320:00 +CPU= 27.835
  04:59:58 STEP 1281 H= 320:15 +CPU= 26.804
  05:00:26 STEP 1282 H= 320:30 +CPU= 27.429
  05:00:53 STEP 1283 H= 320:45 +CPU= 26.489
  05:01:26 STEP 1284 H= 321:00 +CPU= 32.639
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001284
  05:01:53 STEP 1285 H= 321:15 +CPU= 26.740
  05:02:20 STEP 1286 H= 321:30 +CPU= 25.957
  05:02:46 STEP 1287 H= 321:45 +CPU= 25.291
  05:03:14 STEP 1288 H= 322:00 +CPU= 27.248
  05:03:38 STEP 1289 H= 322:15 +CPU= 24.092
  05:04:04 STEP 1290 H= 322:30 +CPU= 25.468
  05:04:28 STEP 1291 H= 322:45 +CPU= 23.809
  05:04:56 STEP 1292 H= 323:00 +CPU= 27.125
  05:05:24 STEP 1293 H= 323:15 +CPU= 27.212
  05:05:52 STEP 1294 H= 323:30 +CPU= 27.065
  05:06:19 STEP 1295 H= 323:45 +CPU= 26.757
  05:06:59 STEP 1296 H= 324:00 +CPU= 38.573
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001296
  05:07:24 STEP 1297 H= 324:15 +CPU= 25.542
  05:07:51 STEP 1298 H= 324:30 +CPU= 26.465
  05:08:17 STEP 1299 H= 324:45 +CPU= 25.665
  05:08:43 STEP 1300 H= 325:00 +CPU= 24.973
  05:09:07 STEP 1301 H= 325:15 +CPU= 24.041
  05:09:33 STEP 1302 H= 325:30 +CPU= 25.171
  05:10:01 STEP 1303 H= 325:45 +CPU= 27.589
  05:10:29 STEP 1304 H= 326:00 +CPU= 27.350
  05:10:54 STEP 1305 H= 326:15 +CPU= 25.110
  05:11:21 STEP 1306 H= 326:30 +CPU= 26.165
  05:11:46 STEP 1307 H= 326:45 +CPU= 24.917
  05:12:20 STEP 1308 H= 327:00 +CPU= 33.351
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001308
  05:12:47 STEP 1309 H= 327:15 +CPU= 26.304
  05:13:12 STEP 1310 H= 327:30 +CPU= 24.459
  05:13:36 STEP 1311 H= 327:45 +CPU= 23.832
  05:14:03 STEP 1312 H= 328:00 +CPU= 25.981
  05:14:29 STEP 1313 H= 328:15 +CPU= 25.653
  05:14:56 STEP 1314 H= 328:30 +CPU= 26.617
  05:15:22 STEP 1315 H= 328:45 +CPU= 25.933
  05:15:48 STEP 1316 H= 329:00 +CPU= 25.090
  05:16:12 STEP 1317 H= 329:15 +CPU= 23.678
  05:16:40 STEP 1318 H= 329:30 +CPU= 27.081
  05:17:07 STEP 1319 H= 329:45 +CPU= 26.802
  05:17:40 STEP 1320 H= 330:00 +CPU= 32.283
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001320
  05:18:05 STEP 1321 H= 330:15 +CPU= 25.009
  05:18:32 STEP 1322 H= 330:30 +CPU= 26.630
  05:19:00 STEP 1323 H= 330:45 +CPU= 26.873
  05:19:27 STEP 1324 H= 331:00 +CPU= 26.144
  05:19:52 STEP 1325 H= 331:15 +CPU= 24.770
  05:20:18 STEP 1326 H= 331:30 +CPU= 25.647
  05:20:42 STEP 1327 H= 331:45 +CPU= 23.733
  05:21:08 STEP 1328 H= 332:00 +CPU= 25.339
  05:21:35 STEP 1329 H= 332:15 +CPU= 26.954
  05:22:01 STEP 1330 H= 332:30 +CPU= 25.186
  05:22:27 STEP 1331 H= 332:45 +CPU= 25.044
  05:23:01 STEP 1332 H= 333:00 +CPU= 33.727
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001332
  05:23:28 STEP 1333 H= 333:15 +CPU= 27.029
  05:23:53 STEP 1334 H= 333:30 +CPU= 23.800
  05:24:19 STEP 1335 H= 333:45 +CPU= 25.704
  05:24:47 STEP 1336 H= 334:00 +CPU= 27.118
  05:25:14 STEP 1337 H= 334:15 +CPU= 26.914
  05:25:40 STEP 1338 H= 334:30 +CPU= 25.507
  05:26:05 STEP 1339 H= 334:45 +CPU= 24.634
  05:26:30 STEP 1340 H= 335:00 +CPU= 24.750
  05:26:55 STEP 1341 H= 335:15 +CPU= 24.693
  05:27:19 STEP 1342 H= 335:30 +CPU= 23.642
  05:27:44 STEP 1343 H= 335:45 +CPU= 24.525
  05:28:19 STEP 1344 H= 336:00 +CPU= 33.974
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001344
  05:28:43 STEP 1345 H= 336:15 +CPU= 23.716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+001344
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a021_2016092300_20_1017_12281900_0_r1282380368_13.zip
Uploading the intermediate file: upload_file_13.zip
  05:29:07 STEP 1346 H= 336:30 +CPU= 23.504
  05:29:33 STEP 1347 H= 336:45 +CPU= 25.264
  05:29:59 STEP 1348 H= 337:00 +CPU= 25.841
  05:30:23 STEP 1349 H= 337:15 +CPU= 23.352
  05:30:49 STEP 1350 H= 337:30 +CPU= 26.051
  05:31:15 STEP 1351 H= 337:45 +CPU= 25.527
  05:31:41 STEP 1352 H= 338:00 +CPU= 25.525
  05:32:08 STEP 1353 H= 338:15 +CPU= 25.837
  05:32:35 STEP 1354 H= 338:30 +CPU= 26.623
  05:33:02 STEP 1355 H= 338:45 +CPU= 26.071
  05:33:34 STEP 1356 H= 339:00 +CPU= 31.525
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001356
  05:33:59 STEP 1357 H= 339:15 +CPU= 25.179
  05:34:24 STEP 1358 H= 339:30 +CPU= 24.055
  05:34:47 STEP 1359 H= 339:45 +CPU= 23.342
  05:35:15 STEP 1360 H= 340:00 +CPU= 27.333
  05:35:40 STEP 1361 H= 340:15 +CPU= 24.819
  05:36:06 STEP 1362 H= 340:30 +CPU= 25.398
  05:36:31 STEP 1363 H= 340:45 +CPU= 24.238
  05:36:59 STEP 1364 H= 341:00 +CPU= 27.394
  05:37:25 STEP 1365 H= 341:15 +CPU= 25.685
  05:37:52 STEP 1366 H= 341:30 +CPU= 26.578
  05:38:18 STEP 1367 H= 341:45 +CPU= 25.156
  05:38:50 STEP 1368 H= 342:00 +CPU= 32.026
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001368
  05:39:16 STEP 1369 H= 342:15 +CPU= 25.318
  05:39:42 STEP 1370 H= 342:30 +CPU= 25.000
  05:40:08 STEP 1371 H= 342:45 +CPU= 25.907
  05:40:36 STEP 1372 H= 343:00 +CPU= 26.933
  05:41:02 STEP 1373 H= 343:15 +CPU= 25.991
  05:41:28 STEP 1374 H= 343:30 +CPU= 26.136
  05:41:55 STEP 1375 H= 343:45 +CPU= 26.540
  05:42:22 STEP 1376 H= 344:00 +CPU= 26.540
  05:42:48 STEP 1377 H= 344:15 +CPU= 25.477
  05:43:14 STEP 1378 H= 344:30 +CPU= 25.751
  05:43:39 STEP 1379 H= 344:45 +CPU= 24.340
  05:44:11 STEP 1380 H= 345:00 +CPU= 31.237
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001380
  05:44:37 STEP 1381 H= 345:15 +CPU= 25.730
  05:45:03 STEP 1382 H= 345:30 +CPU= 25.571
  05:45:26 STEP 1383 H= 345:45 +CPU= 22.424
  05:45:53 STEP 1384 H= 346:00 +CPU= 27.049
  05:46:17 STEP 1385 H= 346:15 +CPU= 23.468
  05:46:43 STEP 1386 H= 346:30 +CPU= 25.225
  05:47:09 STEP 1387 H= 346:45 +CPU= 26.610
  05:47:36 STEP 1388 H= 347:00 +CPU= 26.432
  05:48:03 STEP 1389 H= 347:15 +CPU= 26.131
  05:48:29 STEP 1390 H= 347:30 +CPU= 25.841
  05:48:53 STEP 1391 H= 347:45 +CPU= 23.123
  05:49:30 STEP 1392 H= 348:00 +CPU= 36.438
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001392
  05:49:54 STEP 1393 H= 348:15 +CPU= 24.014
  05:50:18 STEP 1394 H= 348:30 +CPU= 23.222
  05:50:42 STEP 1395 H= 348:45 +CPU= 23.843
  05:51:07 STEP 1396 H= 349:00 +CPU= 24.907
  05:51:33 STEP 1397 H= 349:15 +CPU= 25.001
  05:52:00 STEP 1398 H= 349:30 +CPU= 26.563
  05:52:23 STEP 1399 H= 349:45 +CPU= 23.471
  05:52:51 STEP 1400 H= 350:00 +CPU= 27.233
  05:53:16 STEP 1401 H= 350:15 +CPU= 24.058
  05:53:41 STEP 1402 H= 350:30 +CPU= 25.353
  05:54:08 STEP 1403 H= 350:45 +CPU= 26.078
  05:54:40 STEP 1404 H= 351:00 +CPU= 32.042
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001404
  05:55:06 STEP 1405 H= 351:15 +CPU= 25.362
  05:55:32 STEP 1406 H= 351:30 +CPU= 25.761
  05:55:59 STEP 1407 H= 351:45 +CPU= 26.544
  05:56:23 STEP 1408 H= 352:00 +CPU= 23.868
  05:56:51 STEP 1409 H= 352:15 +CPU= 26.859
  05:57:17 STEP 1410 H= 352:30 +CPU= 26.397
  05:57:44 STEP 1411 H= 352:45 +CPU= 26.092
  05:58:11 STEP 1412 H= 353:00 +CPU= 26.673
  05:58:39 STEP 1413 H= 353:15 +CPU= 26.929
  05:59:05 STEP 1414 H= 353:30 +CPU= 25.841
  05:59:30 STEP 1415 H= 353:45 +CPU= 24.590
  06:00:03 STEP 1416 H= 354:00 +CPU= 32.464
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001416
  06:00:26 STEP 1417 H= 354:15 +CPU= 22.663
  06:00:52 STEP 1418 H= 354:30 +CPU= 25.805
  06:01:19 STEP 1419 H= 354:45 +CPU= 26.845
  06:01:42 STEP 1420 H= 355:00 +CPU= 22.737
  06:02:08 STEP 1421 H= 355:15 +CPU= 24.710
  06:02:30 STEP 1422 H= 355:30 +CPU= 22.622
  06:02:54 STEP 1423 H= 355:45 +CPU= 23.660
  06:03:22 STEP 1424 H= 356:00 +CPU= 27.149
  06:03:47 STEP 1425 H= 356:15 +CPU= 24.472
  06:04:12 STEP 1426 H= 356:30 +CPU= 24.125
  06:04:39 STEP 1427 H= 356:45 +CPU= 27.070
  06:05:12 STEP 1428 H= 357:00 +CPU= 31.919
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001428
  06:05:35 STEP 1429 H= 357:15 +CPU= 23.391
  06:06:00 STEP 1430 H= 357:30 +CPU= 23.947
  06:06:26 STEP 1431 H= 357:45 +CPU= 25.562
  06:06:53 STEP 1432 H= 358:00 +CPU= 26.303
  06:07:19 STEP 1433 H= 358:15 +CPU= 26.486
  06:07:43 STEP 1434 H= 358:30 +CPU= 23.572
  06:08:09 STEP 1435 H= 358:45 +CPU= 25.313
  06:08:35 STEP 1436 H= 359:00 +CPU= 25.916
  06:08:59 STEP 1437 H= 359:15 +CPU= 22.937
  06:09:23 STEP 1438 H= 359:30 +CPU= 23.370
  06:09:47 STEP 1439 H= 359:45 +CPU= 23.807
  06:10:23 STEP 1440 H= 360:00 +CPU= 35.012
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  360.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I      0.6448521519E-21      I       0.6619121358E-05      I
ICloud fractionI      0.0000000000E+00      I       0.2991674936E-01      I
I  Relat. Hum. I      0.3701902069E+00      I       0.4077016209E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.5425258248E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    322567796 BYTES IN      7 RECORDS TRANSFERRED IN    0.0008 SECONDS403209.7 Mbytes/s, TOTAL TIME=    0.0084( 9.5%)
 06:10:23 STEP 1440 H= 360:00 +CPU= 35.012
 END CNT3
 NSTEP =  1440 CNT0   000000000  24.603  24.603  25.340   0.971               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           46/  1069125708 WRITTEN        31460/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    553    0       46      1044068    31460 ************    74.0     1.6    72.4     2.4   133.1
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.99      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 1145    4889.1    4889.1     18.87      0.00
   9 SPCM     - SPECTRAL COMP.                    1056     808.6     808.6      2.88      0.00
  10 SCAN2M - PHYSICS                             1057   11996.7   11996.7     42.73      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                 88    1084.2    1084.2      0.32      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 45      50.8      50.8      0.01      0.00
  17 GRIDFPOS IN CNT4                               88      30.0      30.0      0.01      0.00
  27 RESTART FILES - WRITING                        22    4336.3    4336.3      0.32      0.00
  28 RESTART FILES - READING                         1    3274.4    3274.4      0.01      0.00
  29 SU4FPOS IN CNT4                                88       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                                88    6197.1    6197.1      1.84      0.00
  31 POSDDH IN STEPO                                 5       3.3       3.3      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   1057    6632.7    6632.7     23.63      0.00
  39 SU0YOMB                                         1     404.9     404.9      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   1057      17.9      17.9      0.06      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             1056     377.0     377.0      1.34      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             1056      60.6      60.6      0.22      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 45       0.2       0.2      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     2292     412.2     412.2      3.18      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      2200     251.3     251.3      1.86      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       2200      86.8      86.8      0.64      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      2292     116.1     116.1      0.90      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      38.4      38.4      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           2292      75.2      75.2      0.58      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           2200      36.1      36.1      0.27      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           2292      74.4      74.4      0.57      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           2200      35.0      35.0      0.26      0.00
 400 GSTATS                                     123195       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                114571       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    29672.9 CPU TIME   29025.3 VECTOR TIME    29025.3


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       43.7
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/slots/22/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/22/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281900/ICMGGh7zg+000384
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a021_2016092300_20_1017_12281900_0_r1282380368_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
06:13:54 (834483): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>oifs_43r3_bl_a021_2016092300_20_1017_12281900_0_r1282380368_15.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a021_2016092300_20_1017_12281900_0_r1282380368_16.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a021_2016092300_20_1017_12281900_0_r1282380368_17.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a021_2016092300_20_1017_12281900_0_r1282380368_18.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a021_2016092300_20_1017_12281900_0_r1282380368_19.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
08 Jun 2024 04:32:10 1550999 22433467 oifs_43r3_bl_a021_2016092300_20_1017_12281900_0 1,295,100 40,303 0.0311
08 Jun 2024 03:32:12 1550999 22433467 oifs_43r3_bl_a021_2016092300_20_1017_12281900_0 1,124,100 35,306 0.0314


©2024 climateprediction.net