climateprediction.net home page
Task 22438127

Task 22438127

Name oifs_43r3_bl_a3lz_2016092300_20_1017_12286506_0
Workunit 12286506
Created 7 Jun 2024, 17:36:40 UTC
Sent 8 Jun 2024, 3:04:38 UTC
Report deadline 7 Aug 2024, 3:04:38 UTC
Received 8 Jun 2024, 21:00:09 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1538905
Run time 16 hours 49 min 58 sec
CPU time 16 hours 41 min 48 sec
Validate state Invalid
Credit 1,976.32
Device peak FLOPS 3.84 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,024.93 MB
Peak swap size 5,980.80 MB
Peak disk usage 1,330.93 MB
Stderr
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<stderr_txt>
 208:30 +CPU= 46.630
  07:44:22 STEP  835 H= 208:45 +CPU= 45.782
  07:45:08 STEP  836 H= 209:00 +CPU= 46.176
  07:45:52 STEP  837 H= 209:15 +CPU= 44.257
  07:46:36 STEP  838 H= 209:30 +CPU= 43.395
  07:47:22 STEP  839 H= 209:45 +CPU= 46.156
  07:48:17 STEP  840 H= 210:00 +CPU= 55.051
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000840
  07:49:01 STEP  841 H= 210:15 +CPU= 44.192
  07:49:45 STEP  842 H= 210:30 +CPU= 42.967
  07:50:30 STEP  843 H= 210:45 +CPU= 45.258
  07:51:17 STEP  844 H= 211:00 +CPU= 46.219
  07:52:03 STEP  845 H= 211:15 +CPU= 45.812
  07:52:50 STEP  846 H= 211:30 +CPU= 46.028
  07:53:36 STEP  847 H= 211:45 +CPU= 46.616
  07:54:24 STEP  848 H= 212:00 +CPU= 47.140
  07:55:11 STEP  849 H= 212:15 +CPU= 46.557
  07:55:57 STEP  850 H= 212:30 +CPU= 46.568
  07:56:43 STEP  851 H= 212:45 +CPU= 45.699
  07:57:40 STEP  852 H= 213:00 +CPU= 56.875
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000852
  07:58:25 STEP  853 H= 213:15 +CPU= 44.908
  07:59:09 STEP  854 H= 213:30 +CPU= 43.280
  07:59:56 STEP  855 H= 213:45 +CPU= 46.480
  08:00:36 STEP  856 H= 214:00 +CPU= 40.542
  08:01:16 STEP  857 H= 214:15 +CPU= 39.041
  08:01:54 STEP  858 H= 214:30 +CPU= 38.310
  08:02:33 STEP  859 H= 214:45 +CPU= 39.177
  08:03:15 STEP  860 H= 215:00 +CPU= 41.099
  08:03:54 STEP  861 H= 215:15 +CPU= 39.699
  08:04:35 STEP  862 H= 215:30 +CPU= 39.920
  08:05:16 STEP  863 H= 215:45 +CPU= 40.600
  08:06:12 STEP  864 H= 216:00 +CPU= 55.297
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+000852
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3lz_2016092300_20_1017_12286506_0_r1538896375_8.zip
Uploading the intermediate file: upload_file_8.zip
  08:06:52 STEP  865 H= 216:15 +CPU= 39.523
  08:07:33 STEP  866 H= 216:30 +CPU= 39.604
  08:08:14 STEP  867 H= 216:45 +CPU= 39.964
  08:08:56 STEP  868 H= 217:00 +CPU= 40.834
  08:09:37 STEP  869 H= 217:15 +CPU= 40.246
  08:10:16 STEP  870 H= 217:30 +CPU= 39.390
  08:10:57 STEP  871 H= 217:45 +CPU= 39.495
  08:11:38 STEP  872 H= 218:00 +CPU= 40.589
  08:12:19 STEP  873 H= 218:15 +CPU= 40.762
  08:12:59 STEP  874 H= 218:30 +CPU= 39.789
  08:13:38 STEP  875 H= 218:45 +CPU= 39.261
  08:14:28 STEP  876 H= 219:00 +CPU= 49.839
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000876
  08:15:07 STEP  877 H= 219:15 +CPU= 39.100
  08:15:46 STEP  878 H= 219:30 +CPU= 38.198
  08:16:26 STEP  879 H= 219:45 +CPU= 40.558
  08:17:07 STEP  880 H= 220:00 +CPU= 40.319
  08:17:49 STEP  881 H= 220:15 +CPU= 41.180
  08:18:28 STEP  882 H= 220:30 +CPU= 38.951
  08:19:10 STEP  883 H= 220:45 +CPU= 42.019
  08:19:52 STEP  884 H= 221:00 +CPU= 41.573
  08:20:30 STEP  885 H= 221:15 +CPU= 38.310
  08:21:10 STEP  886 H= 221:30 +CPU= 39.088
  08:21:49 STEP  887 H= 221:45 +CPU= 39.375
  08:22:41 STEP  888 H= 222:00 +CPU= 51.534
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000888
  08:23:22 STEP  889 H= 222:15 +CPU= 40.763
  08:24:04 STEP  890 H= 222:30 +CPU= 41.894
  08:24:42 STEP  891 H= 222:45 +CPU= 38.575
  08:25:23 STEP  892 H= 223:00 +CPU= 40.625
  08:26:05 STEP  893 H= 223:15 +CPU= 41.594
  08:26:44 STEP  894 H= 223:30 +CPU= 38.778
  08:27:25 STEP  895 H= 223:45 +CPU= 41.287
  08:28:06 STEP  896 H= 224:00 +CPU= 41.224
  08:28:45 STEP  897 H= 224:15 +CPU= 38.452
  08:29:25 STEP  898 H= 224:30 +CPU= 39.731
  08:30:05 STEP  899 H= 224:45 +CPU= 39.783
  08:30:53 STEP  900 H= 225:00 +CPU= 48.740
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000900
  08:31:32 STEP  901 H= 225:15 +CPU= 38.435
  08:32:11 STEP  902 H= 225:30 +CPU= 38.435
  08:32:49 STEP  903 H= 225:45 +CPU= 38.628
  08:33:31 STEP  904 H= 226:00 +CPU= 41.438
  08:34:12 STEP  905 H= 226:15 +CPU= 41.425
  08:34:55 STEP  906 H= 226:30 +CPU= 42.087
  08:35:35 STEP  907 H= 226:45 +CPU= 39.618
  08:36:16 STEP  908 H= 227:00 +CPU= 40.424
  08:36:56 STEP  909 H= 227:15 +CPU= 40.206
  08:37:36 STEP  910 H= 227:30 +CPU= 39.821
  08:38:14 STEP  911 H= 227:45 +CPU= 37.943
  08:39:11 STEP  912 H= 228:00 +CPU= 56.702
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000912
  08:39:54 STEP  913 H= 228:15 +CPU= 42.823
  08:40:34 STEP  914 H= 228:30 +CPU= 40.238
  08:41:13 STEP  915 H= 228:45 +CPU= 38.645
  08:41:54 STEP  916 H= 229:00 +CPU= 40.736
  08:42:34 STEP  917 H= 229:15 +CPU= 39.982
  08:43:16 STEP  918 H= 229:30 +CPU= 42.585
  08:43:59 STEP  919 H= 229:45 +CPU= 42.752
  08:44:43 STEP  920 H= 230:00 +CPU= 43.653
  08:45:25 STEP  921 H= 230:15 +CPU= 41.612
  08:46:04 STEP  922 H= 230:30 +CPU= 39.115
  08:46:45 STEP  923 H= 230:45 +CPU= 41.032
  08:47:37 STEP  924 H= 231:00 +CPU= 51.785
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000924
  08:48:16 STEP  925 H= 231:15 +CPU= 39.516
  08:48:59 STEP  926 H= 231:30 +CPU= 42.380
  08:49:41 STEP  927 H= 231:45 +CPU= 42.579
  08:50:24 STEP  928 H= 232:00 +CPU= 42.247
  08:51:04 STEP  929 H= 232:15 +CPU= 40.058
  08:51:47 STEP  930 H= 232:30 +CPU= 42.712
  08:52:30 STEP  931 H= 232:45 +CPU= 42.596
  08:53:13 STEP  932 H= 233:00 +CPU= 42.922
  08:53:55 STEP  933 H= 233:15 +CPU= 41.684
  08:54:33 STEP  934 H= 233:30 +CPU= 38.566
  08:55:11 STEP  935 H= 233:45 +CPU= 38.101
  08:55:59 STEP  936 H= 234:00 +CPU= 47.635
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000936
  08:56:40 STEP  937 H= 234:15 +CPU= 41.279
  08:57:22 STEP  938 H= 234:30 +CPU= 41.897
  08:58:02 STEP  939 H= 234:45 +CPU= 39.954
  08:58:41 STEP  940 H= 235:00 +CPU= 39.019
  08:59:23 STEP  941 H= 235:15 +CPU= 41.835
  09:00:03 STEP  942 H= 235:30 +CPU= 40.059
  09:00:43 STEP  943 H= 235:45 +CPU= 39.316
  09:01:27 STEP  944 H= 236:00 +CPU= 43.799
  09:02:10 STEP  945 H= 236:15 +CPU= 42.699
  09:02:54 STEP  946 H= 236:30 +CPU= 44.185
  09:03:35 STEP  947 H= 236:45 +CPU= 40.887
  09:04:25 STEP  948 H= 237:00 +CPU= 49.950
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000948
  09:05:07 STEP  949 H= 237:15 +CPU= 42.274
  09:05:48 STEP  950 H= 237:30 +CPU= 40.240
  09:06:30 STEP  951 H= 237:45 +CPU= 40.816
  09:07:14 STEP  952 H= 238:00 +CPU= 44.446
  09:07:57 STEP  953 H= 238:15 +CPU= 42.560
  09:08:38 STEP  954 H= 238:30 +CPU= 40.956
  09:09:20 STEP  955 H= 238:45 +CPU= 41.042
  09:10:04 STEP  956 H= 239:00 +CPU= 43.272
  09:10:47 STEP  957 H= 239:15 +CPU= 41.229
  09:11:30 STEP  958 H= 239:30 +CPU= 42.626
  09:12:14 STEP  959 H= 239:45 +CPU= 43.310
  09:13:10 STEP  960 H= 240:00 +CPU= 55.240
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+000948
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3lz_2016092300_20_1017_12286506_0_r1538896375_9.zip
Uploading the intermediate file: upload_file_9.zip
Uploading trickle at timestep: 864000
  09:13:51 STEP  961 H= 240:15 +CPU= 41.325
  09:14:34 STEP  962 H= 240:30 +CPU= 42.242
  09:15:14 STEP  963 H= 240:45 +CPU= 40.464
  09:15:57 STEP  964 H= 241:00 +CPU= 41.850
  09:16:37 STEP  965 H= 241:15 +CPU= 39.596
  09:17:20 STEP  966 H= 241:30 +CPU= 42.101
  09:18:02 STEP  967 H= 241:45 +CPU= 41.969
  09:18:46 STEP  968 H= 242:00 +CPU= 43.165
  09:19:30 STEP  969 H= 242:15 +CPU= 42.952
  09:20:10 STEP  970 H= 242:30 +CPU= 40.014
  09:20:52 STEP  971 H= 242:45 +CPU= 42.013
  09:21:45 STEP  972 H= 243:00 +CPU= 52.173
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000972
  09:22:29 STEP  973 H= 243:15 +CPU= 41.936
  09:23:12 STEP  974 H= 243:30 +CPU= 42.507
  09:23:53 STEP  975 H= 243:45 +CPU= 41.654
  09:24:36 STEP  976 H= 244:00 +CPU= 42.487
  09:25:19 STEP  977 H= 244:15 +CPU= 42.341
  09:26:00 STEP  978 H= 244:30 +CPU= 41.183
  09:26:40 STEP  979 H= 244:45 +CPU= 40.421
  09:27:23 STEP  980 H= 245:00 +CPU= 42.220
  09:28:06 STEP  981 H= 245:15 +CPU= 43.361
  09:28:49 STEP  982 H= 245:30 +CPU= 42.382
  09:29:32 STEP  983 H= 245:45 +CPU= 43.674
  09:30:26 STEP  984 H= 246:00 +CPU= 53.211
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000984
  09:31:08 STEP  985 H= 246:15 +CPU= 42.606
  09:31:49 STEP  986 H= 246:30 +CPU= 40.210
  09:32:28 STEP  987 H= 246:45 +CPU= 39.503
  09:33:13 STEP  988 H= 247:00 +CPU= 44.204
  09:33:53 STEP  989 H= 247:15 +CPU= 40.420
  09:34:36 STEP  990 H= 247:30 +CPU= 42.236
  09:35:19 STEP  991 H= 247:45 +CPU= 43.026
  09:36:03 STEP  992 H= 248:00 +CPU= 43.542
  09:36:46 STEP  993 H= 248:15 +CPU= 42.876
  09:37:29 STEP  994 H= 248:30 +CPU= 42.895
  09:38:09 STEP  995 H= 248:45 +CPU= 40.152
  09:39:00 STEP  996 H= 249:00 +CPU= 50.554
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000996
  09:39:42 STEP  997 H= 249:15 +CPU= 42.294
  09:40:23 STEP  998 H= 249:30 +CPU= 41.056
  09:41:06 STEP  999 H= 249:45 +CPU= 42.515
  09:41:47 STEP 1000 H= 250:00 +CPU= 40.546
  09:42:28 STEP 1001 H= 250:15 +CPU= 40.947
  09:43:11 STEP 1002 H= 250:30 +CPU= 43.147
  09:43:50 STEP 1003 H= 250:45 +CPU= 39.454
  09:44:33 STEP 1004 H= 251:00 +CPU= 42.801
  09:45:15 STEP 1005 H= 251:15 +CPU= 41.250
  09:45:57 STEP 1006 H= 251:30 +CPU= 42.088
  09:46:37 STEP 1007 H= 251:45 +CPU= 39.937
  09:47:37 STEP 1008 H= 252:00 +CPU= 59.409
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001008
  09:48:20 STEP 1009 H= 252:15 +CPU= 42.494
  09:48:59 STEP 1010 H= 252:30 +CPU= 39.275
  09:49:40 STEP 1011 H= 252:45 +CPU= 40.554
  09:50:24 STEP 1012 H= 253:00 +CPU= 43.564
  09:51:06 STEP 1013 H= 253:15 +CPU= 41.459
  09:51:49 STEP 1014 H= 253:30 +CPU= 43.358
  09:52:33 STEP 1015 H= 253:45 +CPU= 44.050
  09:53:18 STEP 1016 H= 254:00 +CPU= 44.730
  09:53:58 STEP 1017 H= 254:15 +CPU= 39.814
  09:54:37 STEP 1018 H= 254:30 +CPU= 39.130
  09:55:16 STEP 1019 H= 254:45 +CPU= 39.094
  09:56:06 STEP 1020 H= 255:00 +CPU= 49.574
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001020
  09:56:47 STEP 1021 H= 255:15 +CPU= 40.579
  09:57:29 STEP 1022 H= 255:30 +CPU= 41.448
  09:58:10 STEP 1023 H= 255:45 +CPU= 41.697
  09:58:53 STEP 1024 H= 256:00 +CPU= 42.921
  09:59:35 STEP 1025 H= 256:15 +CPU= 41.567
  10:00:18 STEP 1026 H= 256:30 +CPU= 42.885
  10:01:01 STEP 1027 H= 256:45 +CPU= 43.045
  10:01:42 STEP 1028 H= 257:00 +CPU= 40.661
  10:02:21 STEP 1029 H= 257:15 +CPU= 39.014
  10:03:01 STEP 1030 H= 257:30 +CPU= 39.684
  10:03:45 STEP 1031 H= 257:45 +CPU= 43.523
  10:04:38 STEP 1032 H= 258:00 +CPU= 52.714
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001032
  10:05:17 STEP 1033 H= 258:15 +CPU= 39.707
  10:06:00 STEP 1034 H= 258:30 +CPU= 42.262
  10:06:43 STEP 1035 H= 258:45 +CPU= 42.251
  10:07:26 STEP 1036 H= 259:00 +CPU= 43.795
  10:08:07 STEP 1037 H= 259:15 +CPU= 40.306
  10:08:50 STEP 1038 H= 259:30 +CPU= 42.216
  10:09:32 STEP 1039 H= 259:45 +CPU= 42.246
  10:10:16 STEP 1040 H= 260:00 +CPU= 43.856
  10:10:59 STEP 1041 H= 260:15 +CPU= 43.233
  10:11:43 STEP 1042 H= 260:30 +CPU= 43.345
  10:12:23 STEP 1043 H= 260:45 +CPU= 40.357
  10:13:15 STEP 1044 H= 261:00 +CPU= 51.279
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001044
  10:13:54 STEP 1045 H= 261:15 +CPU= 39.817
  10:14:38 STEP 1046 H= 261:30 +CPU= 43.605
  10:15:19 STEP 1047 H= 261:45 +CPU= 40.185
  10:16:00 STEP 1048 H= 262:00 +CPU= 41.731
  10:16:43 STEP 1049 H= 262:15 +CPU= 42.782
  10:17:27 STEP 1050 H= 262:30 +CPU= 43.640
  10:18:11 STEP 1051 H= 262:45 +CPU= 43.300
  10:18:54 STEP 1052 H= 263:00 +CPU= 42.944
  10:19:34 STEP 1053 H= 263:15 +CPU= 40.025
  10:20:17 STEP 1054 H= 263:30 +CPU= 42.322
  10:20:57 STEP 1055 H= 263:45 +CPU= 40.707
  10:21:54 STEP 1056 H= 264:00 +CPU= 55.558
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+001044
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3lz_2016092300_20_1017_12286506_0_r1538896375_10.zip
Uploading the intermediate file: upload_file_10.zip
  10:22:35 STEP 1057 H= 264:15 +CPU= 40.232
  10:23:15 STEP 1058 H= 264:30 +CPU= 39.937
  10:23:58 STEP 1059 H= 264:45 +CPU= 42.634
  10:24:42 STEP 1060 H= 265:00 +CPU= 44.094
  10:25:23 STEP 1061 H= 265:15 +CPU= 40.612
  10:26:03 STEP 1062 H= 265:30 +CPU= 40.117
  10:26:44 STEP 1063 H= 265:45 +CPU= 40.092
  10:27:27 STEP 1064 H= 266:00 +CPU= 43.255
  10:28:09 STEP 1065 H= 266:15 +CPU= 41.960
  10:28:49 STEP 1066 H= 266:30 +CPU= 39.394
  10:29:30 STEP 1067 H= 266:45 +CPU= 40.278
  10:30:22 STEP 1068 H= 267:00 +CPU= 52.143
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001068
  10:31:03 STEP 1069 H= 267:15 +CPU= 40.932
  10:31:43 STEP 1070 H= 267:30 +CPU= 40.230
  10:32:27 STEP 1071 H= 267:45 +CPU= 42.189
  10:33:10 STEP 1072 H= 268:00 +CPU= 43.192
  10:33:54 STEP 1073 H= 268:15 +CPU= 43.260
  10:34:36 STEP 1074 H= 268:30 +CPU= 42.021
  10:35:20 STEP 1075 H= 268:45 +CPU= 42.963
  10:36:02 STEP 1076 H= 269:00 +CPU= 42.445
  10:36:43 STEP 1077 H= 269:15 +CPU= 40.758
  10:37:26 STEP 1078 H= 269:30 +CPU= 42.388
  10:38:09 STEP 1079 H= 269:45 +CPU= 42.869
  10:39:04 STEP 1080 H= 270:00 +CPU= 53.969
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001080
  10:39:45 STEP 1081 H= 270:15 +CPU= 40.595
  10:40:28 STEP 1082 H= 270:30 +CPU= 42.986
  10:41:11 STEP 1083 H= 270:45 +CPU= 43.239
  10:41:55 STEP 1084 H= 271:00 +CPU= 43.589
  10:42:37 STEP 1085 H= 271:15 +CPU= 41.596
  10:43:17 STEP 1086 H= 271:30 +CPU= 39.986
  10:43:57 STEP 1087 H= 271:45 +CPU= 40.167
  10:44:38 STEP 1088 H= 272:00 +CPU= 41.067
  10:45:18 STEP 1089 H= 272:15 +CPU= 39.405
  10:46:01 STEP 1090 H= 272:30 +CPU= 42.556
  10:46:44 STEP 1091 H= 272:45 +CPU= 42.931
  10:47:36 STEP 1092 H= 273:00 +CPU= 52.611
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001092
  10:48:17 STEP 1093 H= 273:15 +CPU= 40.847
  10:48:57 STEP 1094 H= 273:30 +CPU= 39.710
  10:49:39 STEP 1095 H= 273:45 +CPU= 42.026
  10:50:24 STEP 1096 H= 274:00 +CPU= 44.225
  10:51:08 STEP 1097 H= 274:15 +CPU= 43.518
  10:51:48 STEP 1098 H= 274:30 +CPU= 40.227
  10:52:29 STEP 1099 H= 274:45 +CPU= 40.782
  10:53:13 STEP 1100 H= 275:00 +CPU= 43.808
  10:53:53 STEP 1101 H= 275:15 +CPU= 39.680
  10:54:36 STEP 1102 H= 275:30 +CPU= 42.519
  10:55:19 STEP 1103 H= 275:45 +CPU= 42.861
  10:56:15 STEP 1104 H= 276:00 +CPU= 56.320
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001104
  10:56:58 STEP 1105 H= 276:15 +CPU= 43.173
  10:57:40 STEP 1106 H= 276:30 +CPU= 41.329
  10:58:21 STEP 1107 H= 276:45 +CPU= 40.998
  10:59:03 STEP 1108 H= 277:00 +CPU= 42.057
  10:59:43 STEP 1109 H= 277:15 +CPU= 40.256
  11:00:27 STEP 1110 H= 277:30 +CPU= 43.745
  11:01:11 STEP 1111 H= 277:45 +CPU= 43.533
  11:01:55 STEP 1112 H= 278:00 +CPU= 44.546
  11:02:38 STEP 1113 H= 278:15 +CPU= 42.269
  11:03:19 STEP 1114 H= 278:30 +CPU= 41.229
  11:04:03 STEP 1115 H= 278:45 +CPU= 43.758
  11:04:59 STEP 1116 H= 279:00 +CPU= 54.440
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001116
  11:05:42 STEP 1117 H= 279:15 +CPU= 42.712
  11:06:23 STEP 1118 H= 279:30 +CPU= 41.365
  11:07:06 STEP 1119 H= 279:45 +CPU= 42.950
  11:07:48 STEP 1120 H= 280:00 +CPU= 42.106
  11:08:32 STEP 1121 H= 280:15 +CPU= 43.527
  11:09:14 STEP 1122 H= 280:30 +CPU= 41.484
  11:09:54 STEP 1123 H= 280:45 +CPU= 40.183
  11:10:38 STEP 1124 H= 281:00 +CPU= 44.143
  11:11:20 STEP 1125 H= 281:15 +CPU= 41.679
  11:12:03 STEP 1126 H= 281:30 +CPU= 42.708
  11:12:43 STEP 1127 H= 281:45 +CPU= 39.685
  11:13:35 STEP 1128 H= 282:00 +CPU= 52.467
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001128
  11:14:16 STEP 1129 H= 282:15 +CPU= 41.081
  11:14:58 STEP 1130 H= 282:30 +CPU= 41.151
  11:15:41 STEP 1131 H= 282:45 +CPU= 42.874
  11:16:25 STEP 1132 H= 283:00 +CPU= 44.542
  11:17:08 STEP 1133 H= 283:15 +CPU= 42.802
  11:17:51 STEP 1134 H= 283:30 +CPU= 42.834
  11:18:34 STEP 1135 H= 283:45 +CPU= 42.979
  11:19:19 STEP 1136 H= 284:00 +CPU= 44.370
  11:20:01 STEP 1137 H= 284:15 +CPU= 41.577
  11:20:43 STEP 1138 H= 284:30 +CPU= 42.389
  11:21:26 STEP 1139 H= 284:45 +CPU= 41.861
  11:22:19 STEP 1140 H= 285:00 +CPU= 52.989
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001140
  11:23:02 STEP 1141 H= 285:15 +CPU= 43.142
  11:23:46 STEP 1142 H= 285:30 +CPU= 43.714
  11:24:27 STEP 1143 H= 285:45 +CPU= 41.300
  11:25:10 STEP 1144 H= 286:00 +CPU= 41.910
  11:25:53 STEP 1145 H= 286:15 +CPU= 42.524
  11:26:33 STEP 1146 H= 286:30 +CPU= 40.723
  11:27:16 STEP 1147 H= 286:45 +CPU= 42.437
  11:28:01 STEP 1148 H= 287:00 +CPU= 44.157
  11:28:42 STEP 1149 H= 287:15 +CPU= 41.295
  11:29:25 STEP 1150 H= 287:30 +CPU= 42.783
  11:30:08 STEP 1151 H= 287:45 +CPU= 40.477
  11:31:04 STEP 1152 H= 288:00 +CPU= 56.660
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+001140
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3lz_2016092300_20_1017_12286506_0_r1538896375_11.zip
Uploading the intermediate file: upload_file_11.zip
  11:31:47 STEP 1153 H= 288:15 +CPU= 42.660
  11:32:28 STEP 1154 H= 288:30 +CPU= 40.413
  11:33:08 STEP 1155 H= 288:45 +CPU= 40.334
  11:33:52 STEP 1156 H= 289:00 +CPU= 43.099
  11:34:34 STEP 1157 H= 289:15 +CPU= 42.807
  11:35:15 STEP 1158 H= 289:30 +CPU= 40.077
  11:35:57 STEP 1159 H= 289:45 +CPU= 41.987
  11:36:42 STEP 1160 H= 290:00 +CPU= 43.664
  11:37:22 STEP 1161 H= 290:15 +CPU= 39.915
  11:38:03 STEP 1162 H= 290:30 +CPU= 41.440
  11:38:43 STEP 1163 H= 290:45 +CPU= 40.095
  11:39:35 STEP 1164 H= 291:00 +CPU= 50.661
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001164
  11:40:17 STEP 1165 H= 291:15 +CPU= 42.164
  11:41:00 STEP 1166 H= 291:30 +CPU= 42.438
  11:41:44 STEP 1167 H= 291:45 +CPU= 43.187
  11:42:26 STEP 1168 H= 292:00 +CPU= 41.910
  11:43:08 STEP 1169 H= 292:15 +CPU= 41.719
  11:43:51 STEP 1170 H= 292:30 +CPU= 42.554
  11:44:35 STEP 1171 H= 292:45 +CPU= 43.893
  11:45:16 STEP 1172 H= 293:00 +CPU= 41.114
  11:45:56 STEP 1173 H= 293:15 +CPU= 39.454
  11:46:38 STEP 1174 H= 293:30 +CPU= 41.952
  11:47:18 STEP 1175 H= 293:45 +CPU= 40.229
  11:48:10 STEP 1176 H= 294:00 +CPU= 52.261
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001176
  11:48:50 STEP 1177 H= 294:15 +CPU= 39.533
  11:49:34 STEP 1178 H= 294:30 +CPU= 43.458
  11:50:16 STEP 1179 H= 294:45 +CPU= 41.373
  11:50:59 STEP 1180 H= 295:00 +CPU= 43.269
  11:51:44 STEP 1181 H= 295:15 +CPU= 44.561
  11:52:27 STEP 1182 H= 295:30 +CPU= 42.834
  11:53:09 STEP 1183 H= 295:45 +CPU= 42.240
  11:53:55 STEP 1184 H= 296:00 +CPU= 44.668
  11:54:36 STEP 1185 H= 296:15 +CPU= 41.712
  11:55:19 STEP 1186 H= 296:30 +CPU= 42.906
  11:56:03 STEP 1187 H= 296:45 +CPU= 43.857
  11:56:58 STEP 1188 H= 297:00 +CPU= 54.167
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001188
  11:57:41 STEP 1189 H= 297:15 +CPU= 42.999
  11:58:24 STEP 1190 H= 297:30 +CPU= 43.442
  11:59:07 STEP 1191 H= 297:45 +CPU= 43.269
  11:59:48 STEP 1192 H= 298:00 +CPU= 40.330
  12:00:27 STEP 1193 H= 298:15 +CPU= 39.426
  12:01:09 STEP 1194 H= 298:30 +CPU= 41.281
  12:01:50 STEP 1195 H= 298:45 +CPU= 41.114
  12:02:34 STEP 1196 H= 299:00 +CPU= 44.193
  12:03:18 STEP 1197 H= 299:15 +CPU= 43.258
  12:03:58 STEP 1198 H= 299:30 +CPU= 40.456
  12:04:39 STEP 1199 H= 299:45 +CPU= 40.647
  12:05:39 STEP 1200 H= 300:00 +CPU= 59.419
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001200
  12:06:22 STEP 1201 H= 300:15 +CPU= 42.151
  12:07:01 STEP 1202 H= 300:30 +CPU= 39.636
  12:07:42 STEP 1203 H= 300:45 +CPU= 40.654
  12:08:24 STEP 1204 H= 301:00 +CPU= 42.081
  12:09:05 STEP 1205 H= 301:15 +CPU= 40.178
  12:09:47 STEP 1206 H= 301:30 +CPU= 42.402
  12:10:28 STEP 1207 H= 301:45 +CPU= 40.588
  12:11:11 STEP 1208 H= 302:00 +CPU= 43.152
  12:11:55 STEP 1209 H= 302:15 +CPU= 43.414
  12:12:34 STEP 1210 H= 302:30 +CPU= 39.525
  12:13:17 STEP 1211 H= 302:45 +CPU= 42.365
  12:14:10 STEP 1212 H= 303:00 +CPU= 53.011
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001212
  12:14:53 STEP 1213 H= 303:15 +CPU= 43.383
  12:15:36 STEP 1214 H= 303:30 +CPU= 43.076
  12:16:20 STEP 1215 H= 303:45 +CPU= 43.407
  12:17:04 STEP 1216 H= 304:00 +CPU= 44.756
  12:17:45 STEP 1217 H= 304:15 +CPU= 39.879
  12:18:26 STEP 1218 H= 304:30 +CPU= 41.128
  12:19:06 STEP 1219 H= 304:45 +CPU= 39.708
  12:19:49 STEP 1220 H= 305:00 +CPU= 43.094
  12:20:31 STEP 1221 H= 305:15 +CPU= 41.630
  12:21:11 STEP 1222 H= 305:30 +CPU= 39.773
  12:21:51 STEP 1223 H= 305:45 +CPU= 40.065
  12:22:42 STEP 1224 H= 306:00 +CPU= 50.439
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001224
  12:23:24 STEP 1225 H= 306:15 +CPU= 41.734
  12:24:05 STEP 1226 H= 306:30 +CPU= 40.898
  12:24:44 STEP 1227 H= 306:45 +CPU= 39.294
  12:25:25 STEP 1228 H= 307:00 +CPU= 40.597
  12:26:06 STEP 1229 H= 307:15 +CPU= 41.324
  12:26:48 STEP 1230 H= 307:30 +CPU= 41.453
  12:27:29 STEP 1231 H= 307:45 +CPU= 41.313
  12:28:13 STEP 1232 H= 308:00 +CPU= 43.522
  12:28:56 STEP 1233 H= 308:15 +CPU= 42.465
  12:29:40 STEP 1234 H= 308:30 +CPU= 44.124
  12:30:24 STEP 1235 H= 308:45 +CPU= 44.369
  12:31:19 STEP 1236 H= 309:00 +CPU= 54.631
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001236
  12:32:01 STEP 1237 H= 309:15 +CPU= 41.809
  12:32:44 STEP 1238 H= 309:30 +CPU= 43.223
  12:33:27 STEP 1239 H= 309:45 +CPU= 42.200
  12:34:09 STEP 1240 H= 310:00 +CPU= 41.368
  12:34:51 STEP 1241 H= 310:15 +CPU= 42.551
  12:35:33 STEP 1242 H= 310:30 +CPU= 41.514
  12:36:16 STEP 1243 H= 310:45 +CPU= 42.170
  12:36:57 STEP 1244 H= 311:00 +CPU= 41.209
  12:37:39 STEP 1245 H= 311:15 +CPU= 41.452
  12:38:22 STEP 1246 H= 311:30 +CPU= 42.564
  12:39:04 STEP 1247 H= 311:45 +CPU= 40.466
  12:40:01 STEP 1248 H= 312:00 +CPU= 56.181
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+001236
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3lz_2016092300_20_1017_12286506_0_r1538896375_12.zip
Uploading the intermediate file: upload_file_12.zip
  12:40:42 STEP 1249 H= 312:15 +CPU= 41.388
  12:41:22 STEP 1250 H= 312:30 +CPU= 39.637
  12:42:02 STEP 1251 H= 312:45 +CPU= 39.782
  12:42:45 STEP 1252 H= 313:00 +CPU= 43.057
  12:43:29 STEP 1253 H= 313:15 +CPU= 43.737
  12:44:11 STEP 1254 H= 313:30 +CPU= 41.498
  12:44:52 STEP 1255 H= 313:45 +CPU= 40.797
  12:45:35 STEP 1256 H= 314:00 +CPU= 42.484
  12:46:16 STEP 1257 H= 314:15 +CPU= 40.755
  12:46:58 STEP 1258 H= 314:30 +CPU= 41.752
  12:47:41 STEP 1259 H= 314:45 +CPU= 41.428
  12:48:35 STEP 1260 H= 315:00 +CPU= 53.489
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001260
  12:49:17 STEP 1261 H= 315:15 +CPU= 42.046
  12:49:58 STEP 1262 H= 315:30 +CPU= 40.487
  12:50:39 STEP 1263 H= 315:45 +CPU= 40.866
  12:51:21 STEP 1264 H= 316:00 +CPU= 40.978
  12:52:03 STEP 1265 H= 316:15 +CPU= 40.522
  12:52:43 STEP 1266 H= 316:30 +CPU= 40.172
  12:53:25 STEP 1267 H= 316:45 +CPU= 41.824
  12:54:06 STEP 1268 H= 317:00 +CPU= 40.296
  12:54:48 STEP 1269 H= 317:15 +CPU= 42.532
  12:55:28 STEP 1270 H= 317:30 +CPU= 39.437
  12:56:10 STEP 1271 H= 317:45 +CPU= 42.247
  12:57:02 STEP 1272 H= 318:00 +CPU= 52.300
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001272
  12:57:42 STEP 1273 H= 318:15 +CPU= 39.104
  12:58:23 STEP 1274 H= 318:30 +CPU= 41.014
  12:59:03 STEP 1275 H= 318:45 +CPU= 39.910
  12:59:44 STEP 1276 H= 319:00 +CPU= 41.193
  13:00:28 STEP 1277 H= 319:15 +CPU= 43.685
  13:01:13 STEP 1278 H= 319:30 +CPU= 42.701
  13:01:55 STEP 1279 H= 319:45 +CPU= 41.727
  13:02:38 STEP 1280 H= 320:00 +CPU= 42.169
  13:03:20 STEP 1281 H= 320:15 +CPU= 40.955
  13:03:59 STEP 1282 H= 320:30 +CPU= 39.209
  13:04:38 STEP 1283 H= 320:45 +CPU= 38.631
  13:05:27 STEP 1284 H= 321:00 +CPU= 48.746
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001284
  13:06:07 STEP 1285 H= 321:15 +CPU= 39.751
  13:06:49 STEP 1286 H= 321:30 +CPU= 41.403
  13:07:27 STEP 1287 H= 321:45 +CPU= 38.544
  13:08:10 STEP 1288 H= 322:00 +CPU= 43.148
  13:08:51 STEP 1289 H= 322:15 +CPU= 40.472
  13:09:35 STEP 1290 H= 322:30 +CPU= 43.587
  13:10:16 STEP 1291 H= 322:45 +CPU= 41.519
  13:11:00 STEP 1292 H= 323:00 +CPU= 43.238
  13:11:43 STEP 1293 H= 323:15 +CPU= 43.385
  13:12:27 STEP 1294 H= 323:30 +CPU= 43.197
  13:13:09 STEP 1295 H= 323:45 +CPU= 41.937
  13:14:05 STEP 1296 H= 324:00 +CPU= 56.668
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001296
  13:14:46 STEP 1297 H= 324:15 +CPU= 40.564
  13:15:25 STEP 1298 H= 324:30 +CPU= 38.962
  13:16:04 STEP 1299 H= 324:45 +CPU= 38.727
  13:16:44 STEP 1300 H= 325:00 +CPU= 40.058
  13:17:26 STEP 1301 H= 325:15 +CPU= 42.261
  13:18:06 STEP 1302 H= 325:30 +CPU= 39.407
  13:18:48 STEP 1303 H= 325:45 +CPU= 41.761
  13:19:31 STEP 1304 H= 326:00 +CPU= 43.099
  13:20:10 STEP 1305 H= 326:15 +CPU= 38.879
  13:20:51 STEP 1306 H= 326:30 +CPU= 40.997
  13:21:32 STEP 1307 H= 326:45 +CPU= 40.110
  13:22:22 STEP 1308 H= 327:00 +CPU= 49.735
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001308
  13:23:04 STEP 1309 H= 327:15 +CPU= 41.843
  13:23:45 STEP 1310 H= 327:30 +CPU= 41.098
  13:24:25 STEP 1311 H= 327:45 +CPU= 40.031
  13:25:07 STEP 1312 H= 328:00 +CPU= 41.874
  13:25:49 STEP 1313 H= 328:15 +CPU= 41.905
  13:26:32 STEP 1314 H= 328:30 +CPU= 43.146
  13:27:13 STEP 1315 H= 328:45 +CPU= 40.202
  13:27:55 STEP 1316 H= 329:00 +CPU= 42.400
  13:28:38 STEP 1317 H= 329:15 +CPU= 42.780
  13:29:19 STEP 1318 H= 329:30 +CPU= 41.277
  13:30:02 STEP 1319 H= 329:45 +CPU= 42.865
  13:30:54 STEP 1320 H= 330:00 +CPU= 51.935
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001320
  13:31:35 STEP 1321 H= 330:15 +CPU= 40.568
  13:32:17 STEP 1322 H= 330:30 +CPU= 41.488
  13:32:58 STEP 1323 H= 330:45 +CPU= 41.698
  13:33:42 STEP 1324 H= 331:00 +CPU= 42.929
  13:34:21 STEP 1325 H= 331:15 +CPU= 39.326
  13:35:00 STEP 1326 H= 331:30 +CPU= 38.887
  13:35:42 STEP 1327 H= 331:45 +CPU= 40.766
  13:36:23 STEP 1328 H= 332:00 +CPU= 40.736
  13:37:06 STEP 1329 H= 332:15 +CPU= 42.669
  13:37:47 STEP 1330 H= 332:30 +CPU= 41.068
  13:38:27 STEP 1331 H= 332:45 +CPU= 39.808
  13:39:20 STEP 1332 H= 333:00 +CPU= 52.902
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001332
  13:40:03 STEP 1333 H= 333:15 +CPU= 43.347
  13:40:46 STEP 1334 H= 333:30 +CPU= 43.101
  13:41:27 STEP 1335 H= 333:45 +CPU= 40.111
  13:42:11 STEP 1336 H= 334:00 +CPU= 43.977
  13:42:54 STEP 1337 H= 334:15 +CPU= 43.271
  13:43:35 STEP 1338 H= 334:30 +CPU= 41.140
  13:44:19 STEP 1339 H= 334:45 +CPU= 43.187
  13:45:03 STEP 1340 H= 335:00 +CPU= 44.129
  13:45:46 STEP 1341 H= 335:15 +CPU= 42.478
  13:46:27 STEP 1342 H= 335:30 +CPU= 41.884
  13:47:07 STEP 1343 H= 335:45 +CPU= 39.821
  13:48:02 STEP 1344 H= 336:00 +CPU= 54.366
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+001332
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3lz_2016092300_20_1017_12286506_0_r1538896375_13.zip
Uploading the intermediate file: upload_file_13.zip
  13:48:42 STEP 1345 H= 336:15 +CPU= 39.689
  13:49:23 STEP 1346 H= 336:30 +CPU= 40.565
  13:50:01 STEP 1347 H= 336:45 +CPU= 38.754
  13:50:42 STEP 1348 H= 337:00 +CPU= 40.043
  13:51:23 STEP 1349 H= 337:15 +CPU= 40.826
  13:52:02 STEP 1350 H= 337:30 +CPU= 39.070
  13:52:41 STEP 1351 H= 337:45 +CPU= 38.950
  13:53:23 STEP 1352 H= 338:00 +CPU= 42.014
  13:54:04 STEP 1353 H= 338:15 +CPU= 40.461
  13:54:45 STEP 1354 H= 338:30 +CPU= 41.222
  13:55:26 STEP 1355 H= 338:45 +CPU= 40.565
  13:56:15 STEP 1356 H= 339:00 +CPU= 48.561
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001356
  13:56:54 STEP 1357 H= 339:15 +CPU= 39.684
  13:57:34 STEP 1358 H= 339:30 +CPU= 39.439
  13:58:12 STEP 1359 H= 339:45 +CPU= 37.467
  13:58:52 STEP 1360 H= 340:00 +CPU= 40.775
  13:59:32 STEP 1361 H= 340:15 +CPU= 39.389
  14:00:12 STEP 1362 H= 340:30 +CPU= 39.846
  14:00:53 STEP 1363 H= 340:45 +CPU= 41.386
  14:01:34 STEP 1364 H= 341:00 +CPU= 40.626
  14:02:13 STEP 1365 H= 341:15 +CPU= 38.261
  14:02:55 STEP 1366 H= 341:30 +CPU= 41.368
  14:03:38 STEP 1367 H= 341:45 +CPU= 40.528
  14:04:25 STEP 1368 H= 342:00 +CPU= 47.762
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001368
  14:05:06 STEP 1369 H= 342:15 +CPU= 40.366
  14:05:44 STEP 1370 H= 342:30 +CPU= 38.076
  14:06:24 STEP 1371 H= 342:45 +CPU= 39.407
  14:07:05 STEP 1372 H= 343:00 +CPU= 40.619
  14:07:46 STEP 1373 H= 343:15 +CPU= 41.292
  14:08:27 STEP 1374 H= 343:30 +CPU= 40.364
  14:09:04 STEP 1375 H= 343:45 +CPU= 37.357
  14:09:42 STEP 1376 H= 344:00 +CPU= 38.064
  14:10:21 STEP 1377 H= 344:15 +CPU= 38.320
  14:11:00 STEP 1378 H= 344:30 +CPU= 39.485
  14:11:38 STEP 1379 H= 344:45 +CPU= 37.966
  14:12:28 STEP 1380 H= 345:00 +CPU= 49.051
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001380
  14:13:06 STEP 1381 H= 345:15 +CPU= 37.865
  14:13:44 STEP 1382 H= 345:30 +CPU= 37.940
  14:14:23 STEP 1383 H= 345:45 +CPU= 39.282
  14:15:03 STEP 1384 H= 346:00 +CPU= 39.873
  14:15:44 STEP 1385 H= 346:15 +CPU= 40.724
  14:16:22 STEP 1386 H= 346:30 +CPU= 38.362
  14:17:01 STEP 1387 H= 346:45 +CPU= 38.973
  14:17:41 STEP 1388 H= 347:00 +CPU= 39.517
  14:18:18 STEP 1389 H= 347:15 +CPU= 37.234
  14:18:57 STEP 1390 H= 347:30 +CPU= 38.501
  14:19:37 STEP 1391 H= 347:45 +CPU= 40.647
  14:20:33 STEP 1392 H= 348:00 +CPU= 55.069
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001392
  14:21:14 STEP 1393 H= 348:15 +CPU= 40.537
  14:21:53 STEP 1394 H= 348:30 +CPU= 39.205
  14:22:32 STEP 1395 H= 348:45 +CPU= 38.416
  14:23:13 STEP 1396 H= 349:00 +CPU= 40.571
  14:23:52 STEP 1397 H= 349:15 +CPU= 38.905
  14:24:31 STEP 1398 H= 349:30 +CPU= 39.690
  14:25:10 STEP 1399 H= 349:45 +CPU= 38.766
  14:25:49 STEP 1400 H= 350:00 +CPU= 39.266
  14:26:28 STEP 1401 H= 350:15 +CPU= 38.491
  14:27:07 STEP 1402 H= 350:30 +CPU= 39.111
  14:27:49 STEP 1403 H= 350:45 +CPU= 41.658
  14:28:39 STEP 1404 H= 351:00 +CPU= 50.193
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001404
  14:29:18 STEP 1405 H= 351:15 +CPU= 38.330
  14:29:56 STEP 1406 H= 351:30 +CPU= 38.340
  14:30:37 STEP 1407 H= 351:45 +CPU= 40.548
  14:31:19 STEP 1408 H= 352:00 +CPU= 42.487
  14:32:00 STEP 1409 H= 352:15 +CPU= 40.848
  14:32:40 STEP 1410 H= 352:30 +CPU= 40.174
  14:33:19 STEP 1411 H= 352:45 +CPU= 38.594
  14:34:01 STEP 1412 H= 353:00 +CPU= 40.893
  14:34:39 STEP 1413 H= 353:15 +CPU= 38.154
  14:35:17 STEP 1414 H= 353:30 +CPU= 38.060
  14:35:57 STEP 1415 H= 353:45 +CPU= 39.626
  14:36:47 STEP 1416 H= 354:00 +CPU= 49.239
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001416
  14:37:27 STEP 1417 H= 354:15 +CPU= 40.405
  14:38:09 STEP 1418 H= 354:30 +CPU= 40.963
  14:38:47 STEP 1419 H= 354:45 +CPU= 38.041
  14:39:26 STEP 1420 H= 355:00 +CPU= 38.851
  14:40:06 STEP 1421 H= 355:15 +CPU= 40.451
  14:40:45 STEP 1422 H= 355:30 +CPU= 38.224
  14:41:23 STEP 1423 H= 355:45 +CPU= 38.241
  14:42:02 STEP 1424 H= 356:00 +CPU= 39.178
  14:42:41 STEP 1425 H= 356:15 +CPU= 38.685
  14:43:20 STEP 1426 H= 356:30 +CPU= 39.281
  14:44:02 STEP 1427 H= 356:45 +CPU= 41.167
  14:44:53 STEP 1428 H= 357:00 +CPU= 51.361
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001428
  14:45:31 STEP 1429 H= 357:15 +CPU= 38.138
  14:46:10 STEP 1430 H= 357:30 +CPU= 38.091
  14:46:48 STEP 1431 H= 357:45 +CPU= 38.304
  14:47:27 STEP 1432 H= 358:00 +CPU= 38.990
  14:48:06 STEP 1433 H= 358:15 +CPU= 38.372
  14:48:44 STEP 1434 H= 358:30 +CPU= 37.961
  14:49:24 STEP 1435 H= 358:45 +CPU= 40.488
  14:50:04 STEP 1436 H= 359:00 +CPU= 39.076
  14:50:43 STEP 1437 H= 359:15 +CPU= 38.539
  14:51:23 STEP 1438 H= 359:30 +CPU= 39.227
  14:52:03 STEP 1439 H= 359:45 +CPU= 39.943
  14:52:52 STEP 1440 H= 360:00 +CPU= 49.210
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.6303266022E-22      I       0.1387591556E-05      I
ICloud fractionI      0.0000000000E+00      I       0.6909997263E-02      I
I  Relat. Hum. I      0.2271716006E+00      I       0.2509097711E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.1304506267E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    297053652 BYTES IN      7 RECORDS TRANSFERRED IN    0.0007 SECONDS424362.4 Mbytes/s, TOTAL TIME=    0.0159( 4.4%)
 14:52:52 STEP 1440 H= 360:00 +CPU= 49.210
 END CNT3
 NSTEP =  1440 CNT0   000000000  36.151  36.151  36.169   1.000               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ            0/           0 WRITTEN        43246/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    758    0        0            0    43246 ************   105.8     0.0   105.7     0.0   221.9
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.98      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 1562    6283.6    6283.6     16.26      0.00
   9 SPCM     - SPECTRAL COMP.                    1440    1117.8    1117.8      2.67      0.00
  10 SCAN2M - PHYSICS                             1441   19992.3   19992.3     47.71      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                121    1206.3    1206.3      0.24      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 63      56.1      56.1      0.01      0.00
  14 SUINIF                                          1   10496.6   10496.6      0.02      0.00
  17 GRIDFPOS IN CNT4                              121      48.4      48.4      0.01      0.00
  18 SUSPECG                                         1    5269.5    5269.5      0.01      0.00
  19 SUSPEC                                          1    5278.1    5278.1      0.01      0.00
  24 SUGRIDU                                         1    3962.5    3962.5      0.01      0.00
  25 SPECRT                                          1     329.6     329.6      0.00      0.00
  26 SUGRIDF                                         1     926.1     926.1      0.00      0.00
  27 RESTART FILES - WRITING                        30    4865.3    4865.3      0.24      0.00
  28 RESTART FILES - READING                         1       0.0       0.0      0.00      0.00
  29 SU4FPOS IN CNT4                               121       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                               121    9077.4    9077.4      1.82      0.00
  31 POSDDH IN STEPO                                 7       1.2       1.2      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   1441    8557.8    8557.8     20.42      0.00
  39 SU0YOMB                                         1     501.2     501.2      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   1441      39.5      39.5      0.09      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             1440     491.1     491.1      1.17      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             1440      88.6      88.6      0.21      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 63       0.3       0.3      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     3125     793.0     793.0      4.10      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      3006     411.5     411.5      2.05      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       3006     148.1     148.1      0.74      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      3125     216.9     216.9      1.12      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      54.7      54.7      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           3125      72.6      72.6      0.38      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           3006      36.2      36.2      0.18      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           3125     143.5     143.5      0.74      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           3006      68.6      68.6      0.34      0.00
 400 GSTATS                                     167734       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                156066       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    60380.8 CPU TIME   60108.2 VECTOR TIME    60108.2


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       21.5
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/slots/0/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/0/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286506/ICMGGh7zg+001344
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3lz_2016092300_20_1017_12286506_0_r1538896375_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
14:56:25 (1424917): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>oifs_43r3_bl_a3lz_2016092300_20_1017_12286506_0_r1538896375_15.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a3lz_2016092300_20_1017_12286506_0_r1538896375_16.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a3lz_2016092300_20_1017_12286506_0_r1538896375_17.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a3lz_2016092300_20_1017_12286506_0_r1538896375_18.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a3lz_2016092300_20_1017_12286506_0_r1538896375_19.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
08 Jun 2024 21:00:52 1538905 22438127 oifs_43r3_bl_a3lz_2016092300_20_1017_12286506_0 1,295,100 60,108 0.0464
08 Jun 2024 15:00:28 1538905 22438127 oifs_43r3_bl_a3lz_2016092300_20_1017_12286506_0 864,000 39,827 0.0461


©2024 climateprediction.net