climateprediction.net home page
Task 22439695

Task 22439695

Name oifs_43r3_bl_a4se_2016092300_20_1017_12288033_0
Workunit 12288033
Created 7 Jun 2024, 19:48:35 UTC
Sent 7 Jun 2024, 19:56:53 UTC
Report deadline 6 Aug 2024, 19:56:53 UTC
Received 8 Jun 2024, 8:24:02 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1541092
Run time 11 hours 24 min 55 sec
CPU time 10 hours 55 min 43 sec
Validate state Invalid
Credit 1,976.32
Device peak FLOPS 1.00 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,015.18 MB
Peak swap size 5,980.79 MB
Peak disk usage 1,351.47 MB
Stderr
<core_client_version>8.0.2</core_client_version>
<![CDATA[
<stderr_txt>
:45 +CPU= 25.078
  02:38:48 STEP  796 H= 199:00 +CPU= 26.284
  02:39:13 STEP  797 H= 199:15 +CPU= 24.640
  02:39:39 STEP  798 H= 199:30 +CPU= 25.098
  02:40:06 STEP  799 H= 199:45 +CPU= 25.732
  02:40:32 STEP  800 H= 200:00 +CPU= 26.209
  02:40:58 STEP  801 H= 200:15 +CPU= 24.866
  02:41:24 STEP  802 H= 200:30 +CPU= 24.825
  02:41:49 STEP  803 H= 200:45 +CPU= 25.246
  02:42:20 STEP  804 H= 201:00 +CPU= 30.514
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000804
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000804
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000804
  02:42:45 STEP  805 H= 201:15 +CPU= 24.791
  02:43:10 STEP  806 H= 201:30 +CPU= 24.937
  02:43:35 STEP  807 H= 201:45 +CPU= 24.578
  02:44:01 STEP  808 H= 202:00 +CPU= 25.378
  02:44:26 STEP  809 H= 202:15 +CPU= 24.728
  02:44:51 STEP  810 H= 202:30 +CPU= 25.154
  02:45:17 STEP  811 H= 202:45 +CPU= 24.977
  02:45:42 STEP  812 H= 203:00 +CPU= 25.588
  02:46:07 STEP  813 H= 203:15 +CPU= 24.277
  02:46:32 STEP  814 H= 203:30 +CPU= 25.059
  02:46:58 STEP  815 H= 203:45 +CPU= 24.911
  02:47:33 STEP  816 H= 204:00 +CPU= 34.942
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000816
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000816
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000816
  02:47:57 STEP  817 H= 204:15 +CPU= 24.097
  02:48:23 STEP  818 H= 204:30 +CPU= 25.732
  02:48:48 STEP  819 H= 204:45 +CPU= 24.928
  02:49:14 STEP  820 H= 205:00 +CPU= 25.673
  02:49:40 STEP  821 H= 205:15 +CPU= 25.013
  02:50:05 STEP  822 H= 205:30 +CPU= 25.078
  02:50:31 STEP  823 H= 205:45 +CPU= 25.119
  02:50:56 STEP  824 H= 206:00 +CPU= 24.967
  02:51:22 STEP  825 H= 206:15 +CPU= 25.195
  02:51:47 STEP  826 H= 206:30 +CPU= 24.868
  02:52:12 STEP  827 H= 206:45 +CPU= 25.001
  02:52:43 STEP  828 H= 207:00 +CPU= 30.700
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000828
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000828
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000828
  02:53:09 STEP  829 H= 207:15 +CPU= 25.367
  02:53:33 STEP  830 H= 207:30 +CPU= 23.963
  02:53:58 STEP  831 H= 207:45 +CPU= 24.594
  02:54:23 STEP  832 H= 208:00 +CPU= 25.242
  02:54:49 STEP  833 H= 208:15 +CPU= 25.808
  02:55:15 STEP  834 H= 208:30 +CPU= 24.904
  02:55:41 STEP  835 H= 208:45 +CPU= 25.565
  02:56:07 STEP  836 H= 209:00 +CPU= 26.024
  02:56:33 STEP  837 H= 209:15 +CPU= 24.922
  02:56:59 STEP  838 H= 209:30 +CPU= 25.683
  02:57:24 STEP  839 H= 209:45 +CPU= 25.328
  02:57:56 STEP  840 H= 210:00 +CPU= 31.565
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000840
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000840
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000840
  02:58:22 STEP  841 H= 210:15 +CPU= 25.070
  02:58:47 STEP  842 H= 210:30 +CPU= 25.011
  02:59:12 STEP  843 H= 210:45 +CPU= 25.195
  02:59:39 STEP  844 H= 211:00 +CPU= 26.186
  03:00:04 STEP  845 H= 211:15 +CPU= 24.768
  03:00:30 STEP  846 H= 211:30 +CPU= 25.458
  03:00:56 STEP  847 H= 211:45 +CPU= 25.859
  03:01:24 STEP  848 H= 212:00 +CPU= 25.862
  03:01:49 STEP  849 H= 212:15 +CPU= 24.979
  03:02:15 STEP  850 H= 212:30 +CPU= 25.243
  03:02:40 STEP  851 H= 212:45 +CPU= 24.409
  03:03:12 STEP  852 H= 213:00 +CPU= 30.988
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000852
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000852
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000852
  03:03:37 STEP  853 H= 213:15 +CPU= 24.923
  03:04:03 STEP  854 H= 213:30 +CPU= 25.354
  03:04:29 STEP  855 H= 213:45 +CPU= 25.060
  03:04:55 STEP  856 H= 214:00 +CPU= 25.611
  03:05:20 STEP  857 H= 214:15 +CPU= 24.956
  03:05:46 STEP  858 H= 214:30 +CPU= 25.167
  03:06:12 STEP  859 H= 214:45 +CPU= 25.460
  03:06:38 STEP  860 H= 215:00 +CPU= 25.673
  03:07:03 STEP  861 H= 215:15 +CPU= 24.546
  03:07:28 STEP  862 H= 215:30 +CPU= 25.019
  03:07:54 STEP  863 H= 215:45 +CPU= 25.509
  03:08:28 STEP  864 H= 216:00 +CPU= 33.981
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000864
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000864
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+000768
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+000768
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+000768
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+000780
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+000780
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+000780
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+000792
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+000792
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+000792
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+000804
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+000804
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+000804
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+000816
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+000816
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+000816
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+000828
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+000828
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+000828
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+000840
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+000840
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+000840
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+000852
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+000852
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+000852
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a4se_2016092300_20_1017_12288033_0_r487054060_8.zip
Uploading the intermediate file: upload_file_8.zip
  03:08:54 STEP  865 H= 216:15 +CPU= 24.782
  03:09:19 STEP  866 H= 216:30 +CPU= 24.557
  03:09:45 STEP  867 H= 216:45 +CPU= 25.104
  03:10:11 STEP  868 H= 217:00 +CPU= 25.544
  03:10:36 STEP  869 H= 217:15 +CPU= 24.701
  03:11:02 STEP  870 H= 217:30 +CPU= 25.121
  03:11:28 STEP  871 H= 217:45 +CPU= 24.750
  03:11:55 STEP  872 H= 218:00 +CPU= 26.417
  03:12:21 STEP  873 H= 218:15 +CPU= 25.743
  03:12:47 STEP  874 H= 218:30 +CPU= 25.026
  03:13:13 STEP  875 H= 218:45 +CPU= 24.824
  03:13:45 STEP  876 H= 219:00 +CPU= 31.665
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000876
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000876
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000876
  03:14:11 STEP  877 H= 219:15 +CPU= 25.405
  03:14:36 STEP  878 H= 219:30 +CPU= 24.840
  03:15:01 STEP  879 H= 219:45 +CPU= 24.798
  03:15:28 STEP  880 H= 220:00 +CPU= 26.283
  03:15:53 STEP  881 H= 220:15 +CPU= 25.027
  03:16:19 STEP  882 H= 220:30 +CPU= 24.979
  03:16:44 STEP  883 H= 220:45 +CPU= 24.678
  03:17:11 STEP  884 H= 221:00 +CPU= 25.853
  03:17:36 STEP  885 H= 221:15 +CPU= 24.639
  03:18:01 STEP  886 H= 221:30 +CPU= 24.630
  03:18:26 STEP  887 H= 221:45 +CPU= 24.721
  03:18:57 STEP  888 H= 222:00 +CPU= 30.917
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000888
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000888
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000888
  03:19:23 STEP  889 H= 222:15 +CPU= 24.800
  03:19:48 STEP  890 H= 222:30 +CPU= 25.115
  03:20:13 STEP  891 H= 222:45 +CPU= 23.877
  03:20:39 STEP  892 H= 223:00 +CPU= 25.675
  03:21:05 STEP  893 H= 223:15 +CPU= 25.168
  03:21:30 STEP  894 H= 223:30 +CPU= 25.255
  03:21:56 STEP  895 H= 223:45 +CPU= 24.184
  03:22:22 STEP  896 H= 224:00 +CPU= 25.514
  03:22:47 STEP  897 H= 224:15 +CPU= 24.146
  03:23:12 STEP  898 H= 224:30 +CPU= 24.362
  03:23:37 STEP  899 H= 224:45 +CPU= 24.963
  03:24:09 STEP  900 H= 225:00 +CPU= 31.294
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000900
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000900
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000900
  03:24:34 STEP  901 H= 225:15 +CPU= 24.391
  03:24:59 STEP  902 H= 225:30 +CPU= 24.571
  03:25:24 STEP  903 H= 225:45 +CPU= 25.128
  03:25:51 STEP  904 H= 226:00 +CPU= 26.370
  03:26:17 STEP  905 H= 226:15 +CPU= 25.365
  03:26:42 STEP  906 H= 226:30 +CPU= 25.054
  03:27:07 STEP  907 H= 226:45 +CPU= 24.328
  03:27:33 STEP  908 H= 227:00 +CPU= 25.872
  03:27:59 STEP  909 H= 227:15 +CPU= 25.221
  03:28:25 STEP  910 H= 227:30 +CPU= 25.283
  03:28:51 STEP  911 H= 227:45 +CPU= 25.516
  03:29:28 STEP  912 H= 228:00 +CPU= 33.810
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000912
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000912
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000912
  03:29:54 STEP  913 H= 228:15 +CPU= 24.511
  03:30:20 STEP  914 H= 228:30 +CPU= 25.463
  03:30:45 STEP  915 H= 228:45 +CPU= 25.012
  03:31:11 STEP  916 H= 229:00 +CPU= 25.623
  03:31:36 STEP  917 H= 229:15 +CPU= 25.027
  03:32:01 STEP  918 H= 229:30 +CPU= 24.617
  03:32:27 STEP  919 H= 229:45 +CPU= 25.379
  03:32:53 STEP  920 H= 230:00 +CPU= 25.447
  03:33:19 STEP  921 H= 230:15 +CPU= 25.437
  03:33:45 STEP  922 H= 230:30 +CPU= 26.007
  03:34:11 STEP  923 H= 230:45 +CPU= 25.124
  03:34:42 STEP  924 H= 231:00 +CPU= 30.585
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000924
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000924
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000924
  03:35:07 STEP  925 H= 231:15 +CPU= 24.896
  03:35:33 STEP  926 H= 231:30 +CPU= 25.128
  03:35:58 STEP  927 H= 231:45 +CPU= 24.741
  03:36:24 STEP  928 H= 232:00 +CPU= 25.657
  03:36:50 STEP  929 H= 232:15 +CPU= 25.355
  03:37:16 STEP  930 H= 232:30 +CPU= 25.922
  03:37:42 STEP  931 H= 232:45 +CPU= 25.315
  03:38:08 STEP  932 H= 233:00 +CPU= 25.575
  03:38:33 STEP  933 H= 233:15 +CPU= 25.302
  03:38:59 STEP  934 H= 233:30 +CPU= 25.237
  03:39:26 STEP  935 H= 233:45 +CPU= 26.301
  03:40:00 STEP  936 H= 234:00 +CPU= 33.118
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000936
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000936
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000936
  03:40:28 STEP  937 H= 234:15 +CPU= 26.527
  03:40:56 STEP  938 H= 234:30 +CPU= 26.819
  03:41:24 STEP  939 H= 234:45 +CPU= 26.470
  03:41:52 STEP  940 H= 235:00 +CPU= 27.673
  03:42:20 STEP  941 H= 235:15 +CPU= 27.316
  03:42:48 STEP  942 H= 235:30 +CPU= 27.027
  03:43:16 STEP  943 H= 235:45 +CPU= 26.896
  03:43:45 STEP  944 H= 236:00 +CPU= 26.929
  03:44:13 STEP  945 H= 236:15 +CPU= 26.821
  03:44:40 STEP  946 H= 236:30 +CPU= 26.666
  03:45:08 STEP  947 H= 236:45 +CPU= 26.567
  03:45:41 STEP  948 H= 237:00 +CPU= 32.763
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000948
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000948
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000948
  03:46:09 STEP  949 H= 237:15 +CPU= 26.714
  03:46:37 STEP  950 H= 237:30 +CPU= 26.785
  03:47:04 STEP  951 H= 237:45 +CPU= 26.425
  03:47:32 STEP  952 H= 238:00 +CPU= 27.332
  03:47:59 STEP  953 H= 238:15 +CPU= 26.218
  03:48:29 STEP  954 H= 238:30 +CPU= 26.195
  03:48:56 STEP  955 H= 238:45 +CPU= 26.936
  03:49:24 STEP  956 H= 239:00 +CPU= 27.016
  03:49:51 STEP  957 H= 239:15 +CPU= 26.237
  03:50:18 STEP  958 H= 239:30 +CPU= 26.453
  03:50:46 STEP  959 H= 239:45 +CPU= 27.151
  03:51:23 STEP  960 H= 240:00 +CPU= 36.480
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000960
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000960
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+000864
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+000864
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+000876
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+000876
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+000876
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+000888
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+000888
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+000888
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+000900
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+000900
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+000900
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+000912
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+000912
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+000912
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+000924
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+000924
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+000924
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+000936
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+000936
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+000936
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+000948
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+000948
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+000948
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a4se_2016092300_20_1017_12288033_0_r487054060_9.zip
Uploading the intermediate file: upload_file_9.zip
  03:51:52 STEP  961 H= 240:15 +CPU= 27.011
Uploading trickle at timestep: 864000
  03:52:19 STEP  962 H= 240:30 +CPU= 26.287
  03:52:47 STEP  963 H= 240:45 +CPU= 26.990
  03:53:15 STEP  964 H= 241:00 +CPU= 26.900
  03:53:43 STEP  965 H= 241:15 +CPU= 26.622
  03:54:10 STEP  966 H= 241:30 +CPU= 26.430
  03:54:38 STEP  967 H= 241:45 +CPU= 26.217
  03:55:06 STEP  968 H= 242:00 +CPU= 26.838
  03:55:34 STEP  969 H= 242:15 +CPU= 26.474
  03:56:01 STEP  970 H= 242:30 +CPU= 26.944
  03:56:28 STEP  971 H= 242:45 +CPU= 25.988
  03:57:03 STEP  972 H= 243:00 +CPU= 32.338
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000972
  03:57:30 STEP  973 H= 243:15 +CPU= 26.960
  03:57:58 STEP  974 H= 243:30 +CPU= 27.343
  03:58:24 STEP  975 H= 243:45 +CPU= 26.358
  03:58:52 STEP  976 H= 244:00 +CPU= 27.761
  03:59:20 STEP  977 H= 244:15 +CPU= 26.837
  03:59:47 STEP  978 H= 244:30 +CPU= 26.526
  04:00:14 STEP  979 H= 244:45 +CPU= 26.405
  04:00:41 STEP  980 H= 245:00 +CPU= 27.489
  04:01:08 STEP  981 H= 245:15 +CPU= 26.652
  04:01:36 STEP  982 H= 245:30 +CPU= 26.765
  04:02:03 STEP  983 H= 245:45 +CPU= 27.225
  04:02:37 STEP  984 H= 246:00 +CPU= 32.941
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000984
  04:03:04 STEP  985 H= 246:15 +CPU= 26.724
  04:03:32 STEP  986 H= 246:30 +CPU= 26.771
  04:03:59 STEP  987 H= 246:45 +CPU= 27.233
  04:04:27 STEP  988 H= 247:00 +CPU= 27.789
  04:04:55 STEP  989 H= 247:15 +CPU= 26.678
  04:05:23 STEP  990 H= 247:30 +CPU= 27.066
  04:05:51 STEP  991 H= 247:45 +CPU= 26.446
  04:06:20 STEP  992 H= 248:00 +CPU= 27.268
  04:06:47 STEP  993 H= 248:15 +CPU= 26.265
  04:07:15 STEP  994 H= 248:30 +CPU= 26.359
  04:07:41 STEP  995 H= 248:45 +CPU= 25.887
  04:08:15 STEP  996 H= 249:00 +CPU= 32.540
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+000996
  04:08:42 STEP  997 H= 249:15 +CPU= 27.004
  04:09:09 STEP  998 H= 249:30 +CPU= 26.987
  04:09:36 STEP  999 H= 249:45 +CPU= 26.468
  04:10:04 STEP 1000 H= 250:00 +CPU= 27.539
  04:10:32 STEP 1001 H= 250:15 +CPU= 27.059
  04:10:59 STEP 1002 H= 250:30 +CPU= 26.689
  04:11:26 STEP 1003 H= 250:45 +CPU= 26.569
  04:11:54 STEP 1004 H= 251:00 +CPU= 27.350
  04:12:21 STEP 1005 H= 251:15 +CPU= 26.232
  04:12:49 STEP 1006 H= 251:30 +CPU= 27.481
  04:13:16 STEP 1007 H= 251:45 +CPU= 26.812
  04:13:52 STEP 1008 H= 252:00 +CPU= 35.494
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001008
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001008
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001008
  04:14:19 STEP 1009 H= 252:15 +CPU= 26.638
  04:14:46 STEP 1010 H= 252:30 +CPU= 26.332
  04:15:12 STEP 1011 H= 252:45 +CPU= 25.831
  04:15:40 STEP 1012 H= 253:00 +CPU= 27.264
  04:16:07 STEP 1013 H= 253:15 +CPU= 27.246
  04:16:35 STEP 1014 H= 253:30 +CPU= 26.727
  04:17:02 STEP 1015 H= 253:45 +CPU= 26.227
  04:17:30 STEP 1016 H= 254:00 +CPU= 27.213
  04:17:58 STEP 1017 H= 254:15 +CPU= 26.781
  04:18:25 STEP 1018 H= 254:30 +CPU= 26.798
  04:18:53 STEP 1019 H= 254:45 +CPU= 27.202
  04:19:27 STEP 1020 H= 255:00 +CPU= 33.318
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001020
  04:19:54 STEP 1021 H= 255:15 +CPU= 26.918
  04:20:22 STEP 1022 H= 255:30 +CPU= 27.302
  04:20:50 STEP 1023 H= 255:45 +CPU= 27.016
  04:21:18 STEP 1024 H= 256:00 +CPU= 27.643
  04:21:44 STEP 1025 H= 256:15 +CPU= 26.358
  04:22:11 STEP 1026 H= 256:30 +CPU= 26.661
  04:22:38 STEP 1027 H= 256:45 +CPU= 26.925
  04:23:07 STEP 1028 H= 257:00 +CPU= 27.995
  04:23:34 STEP 1029 H= 257:15 +CPU= 26.666
  04:24:01 STEP 1030 H= 257:30 +CPU= 26.825
  04:24:28 STEP 1031 H= 257:45 +CPU= 26.772
  04:25:03 STEP 1032 H= 258:00 +CPU= 33.068
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001032
  04:25:30 STEP 1033 H= 258:15 +CPU= 26.934
  04:25:57 STEP 1034 H= 258:30 +CPU= 26.199
  04:26:24 STEP 1035 H= 258:45 +CPU= 26.788
  04:26:52 STEP 1036 H= 259:00 +CPU= 27.635
  04:27:20 STEP 1037 H= 259:15 +CPU= 27.234
  04:27:47 STEP 1038 H= 259:30 +CPU= 26.913
  04:28:14 STEP 1039 H= 259:45 +CPU= 26.867
  04:28:43 STEP 1040 H= 260:00 +CPU= 27.323
  04:29:10 STEP 1041 H= 260:15 +CPU= 26.935
  04:29:38 STEP 1042 H= 260:30 +CPU= 27.165
  04:30:05 STEP 1043 H= 260:45 +CPU= 26.329
  04:30:39 STEP 1044 H= 261:00 +CPU= 33.289
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001044
  04:31:06 STEP 1045 H= 261:15 +CPU= 26.705
  04:31:33 STEP 1046 H= 261:30 +CPU= 27.183
  04:32:01 STEP 1047 H= 261:45 +CPU= 26.617
  04:32:28 STEP 1048 H= 262:00 +CPU= 26.807
  04:32:56 STEP 1049 H= 262:15 +CPU= 27.085
  04:33:23 STEP 1050 H= 262:30 +CPU= 26.993
  04:33:50 STEP 1051 H= 262:45 +CPU= 26.124
  04:34:17 STEP 1052 H= 263:00 +CPU= 26.896
  04:34:45 STEP 1053 H= 263:15 +CPU= 27.061
  04:35:12 STEP 1054 H= 263:30 +CPU= 26.583
  04:35:40 STEP 1055 H= 263:45 +CPU= 27.325
  04:36:19 STEP 1056 H= 264:00 +CPU= 37.881
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+001044
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a4se_2016092300_20_1017_12288033_0_r487054060_10.zip
Uploading the intermediate file: upload_file_10.zip
  04:36:46 STEP 1057 H= 264:15 +CPU= 26.511
  04:37:14 STEP 1058 H= 264:30 +CPU= 26.493
  04:37:41 STEP 1059 H= 264:45 +CPU= 26.732
  04:38:08 STEP 1060 H= 265:00 +CPU= 27.272
  04:38:36 STEP 1061 H= 265:15 +CPU= 26.549
  04:39:04 STEP 1062 H= 265:30 +CPU= 27.605
  04:39:32 STEP 1063 H= 265:45 +CPU= 27.562
  04:40:01 STEP 1064 H= 266:00 +CPU= 27.509
  04:40:28 STEP 1065 H= 266:15 +CPU= 26.721
  04:40:56 STEP 1066 H= 266:30 +CPU= 27.063
  04:41:23 STEP 1067 H= 266:45 +CPU= 26.891
  04:41:57 STEP 1068 H= 267:00 +CPU= 33.440
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001068
  04:42:24 STEP 1069 H= 267:15 +CPU= 27.227
  04:42:52 STEP 1070 H= 267:30 +CPU= 26.528
  04:43:19 STEP 1071 H= 267:45 +CPU= 26.342
  04:43:46 STEP 1072 H= 268:00 +CPU= 27.037
  04:44:14 STEP 1073 H= 268:15 +CPU= 26.084
  04:44:42 STEP 1074 H= 268:30 +CPU= 27.188
  04:45:09 STEP 1075 H= 268:45 +CPU= 26.734
  04:45:37 STEP 1076 H= 269:00 +CPU= 27.545
  04:46:04 STEP 1077 H= 269:15 +CPU= 26.925
  04:46:31 STEP 1078 H= 269:30 +CPU= 26.214
  04:46:58 STEP 1079 H= 269:45 +CPU= 26.547
  04:47:32 STEP 1080 H= 270:00 +CPU= 33.509
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001080
  04:47:58 STEP 1081 H= 270:15 +CPU= 26.612
  04:48:25 STEP 1082 H= 270:30 +CPU= 26.423
  04:48:53 STEP 1083 H= 270:45 +CPU= 26.837
  04:49:21 STEP 1084 H= 271:00 +CPU= 27.317
  04:49:47 STEP 1085 H= 271:15 +CPU= 26.707
  04:50:15 STEP 1086 H= 271:30 +CPU= 26.581
  04:50:42 STEP 1087 H= 271:45 +CPU= 25.891
  04:51:10 STEP 1088 H= 272:00 +CPU= 26.900
  04:51:37 STEP 1089 H= 272:15 +CPU= 26.464
  04:52:04 STEP 1090 H= 272:30 +CPU= 26.850
  04:52:31 STEP 1091 H= 272:45 +CPU= 26.342
  04:53:05 STEP 1092 H= 273:00 +CPU= 33.074
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001092
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001092
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001092
  04:53:33 STEP 1093 H= 273:15 +CPU= 26.724
  04:54:00 STEP 1094 H= 273:30 +CPU= 25.976
  04:54:27 STEP 1095 H= 273:45 +CPU= 26.386
  04:54:56 STEP 1096 H= 274:00 +CPU= 27.411
  04:55:22 STEP 1097 H= 274:15 +CPU= 26.409
  04:55:50 STEP 1098 H= 274:30 +CPU= 27.084
  04:56:17 STEP 1099 H= 274:45 +CPU= 26.439
  04:56:46 STEP 1100 H= 275:00 +CPU= 27.458
  04:57:13 STEP 1101 H= 275:15 +CPU= 26.830
  04:57:40 STEP 1102 H= 275:30 +CPU= 26.988
  04:58:08 STEP 1103 H= 275:45 +CPU= 27.127
  04:58:46 STEP 1104 H= 276:00 +CPU= 37.102
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001104
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001104
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001104
  04:59:13 STEP 1105 H= 276:15 +CPU= 26.395
  04:59:40 STEP 1106 H= 276:30 +CPU= 26.544
  05:00:07 STEP 1107 H= 276:45 +CPU= 26.888
  05:00:35 STEP 1108 H= 277:00 +CPU= 27.348
  05:01:02 STEP 1109 H= 277:15 +CPU= 26.340
  05:01:30 STEP 1110 H= 277:30 +CPU= 26.854
  05:01:58 STEP 1111 H= 277:45 +CPU= 27.156
  05:02:26 STEP 1112 H= 278:00 +CPU= 28.020
  05:02:54 STEP 1113 H= 278:15 +CPU= 26.652
  05:03:21 STEP 1114 H= 278:30 +CPU= 26.761
  05:03:48 STEP 1115 H= 278:45 +CPU= 26.658
  05:04:22 STEP 1116 H= 279:00 +CPU= 32.985
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001116
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001116
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001116
  05:04:49 STEP 1117 H= 279:15 +CPU= 27.262
  05:05:17 STEP 1118 H= 279:30 +CPU= 26.908
  05:05:44 STEP 1119 H= 279:45 +CPU= 26.529
  05:06:12 STEP 1120 H= 280:00 +CPU= 27.803
  05:06:40 STEP 1121 H= 280:15 +CPU= 26.883
  05:07:06 STEP 1122 H= 280:30 +CPU= 26.564
  05:07:34 STEP 1123 H= 280:45 +CPU= 26.868
  05:08:02 STEP 1124 H= 281:00 +CPU= 28.022
  05:08:30 STEP 1125 H= 281:15 +CPU= 27.097
  05:08:57 STEP 1126 H= 281:30 +CPU= 27.215
  05:09:24 STEP 1127 H= 281:45 +CPU= 26.580
  05:09:58 STEP 1128 H= 282:00 +CPU= 32.396
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001128
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001128
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001128
  05:10:25 STEP 1129 H= 282:15 +CPU= 26.719
  05:10:52 STEP 1130 H= 282:30 +CPU= 26.852
  05:11:19 STEP 1131 H= 282:45 +CPU= 26.515
  05:11:48 STEP 1132 H= 283:00 +CPU= 27.785
  05:12:16 STEP 1133 H= 283:15 +CPU= 27.118
  05:12:43 STEP 1134 H= 283:30 +CPU= 27.018
  05:13:11 STEP 1135 H= 283:45 +CPU= 26.479
  05:13:39 STEP 1136 H= 284:00 +CPU= 27.333
  05:14:05 STEP 1137 H= 284:15 +CPU= 26.104
  05:14:33 STEP 1138 H= 284:30 +CPU= 27.229
  05:15:00 STEP 1139 H= 284:45 +CPU= 26.507
  05:15:34 STEP 1140 H= 285:00 +CPU= 33.748
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001140
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001140
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001140
  05:16:02 STEP 1141 H= 285:15 +CPU= 26.967
  05:16:30 STEP 1142 H= 285:30 +CPU= 27.603
  05:16:57 STEP 1143 H= 285:45 +CPU= 26.651
  05:17:25 STEP 1144 H= 286:00 +CPU= 27.470
  05:17:53 STEP 1145 H= 286:15 +CPU= 26.888
  05:18:20 STEP 1146 H= 286:30 +CPU= 26.503
  05:18:47 STEP 1147 H= 286:45 +CPU= 26.705
  05:19:15 STEP 1148 H= 287:00 +CPU= 27.091
  05:19:42 STEP 1149 H= 287:15 +CPU= 26.327
  05:20:10 STEP 1150 H= 287:30 +CPU= 27.225
  05:20:37 STEP 1151 H= 287:45 +CPU= 26.293
  05:21:13 STEP 1152 H= 288:00 +CPU= 36.239
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+001140
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a4se_2016092300_20_1017_12288033_0_r487054060_11.zip
Uploading the intermediate file: upload_file_11.zip
  05:21:41 STEP 1153 H= 288:15 +CPU= 26.981
  05:22:08 STEP 1154 H= 288:30 +CPU= 26.646
  05:22:35 STEP 1155 H= 288:45 +CPU= 26.558
  05:23:03 STEP 1156 H= 289:00 +CPU= 27.545
  05:23:31 STEP 1157 H= 289:15 +CPU= 26.581
  05:23:59 STEP 1158 H= 289:30 +CPU= 27.365
  05:24:26 STEP 1159 H= 289:45 +CPU= 27.158
  05:24:55 STEP 1160 H= 290:00 +CPU= 28.038
  05:25:23 STEP 1161 H= 290:15 +CPU= 27.031
  05:25:51 STEP 1162 H= 290:30 +CPU= 26.767
  05:26:18 STEP 1163 H= 290:45 +CPU= 26.641
  05:26:52 STEP 1164 H= 291:00 +CPU= 32.656
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001164
  05:27:19 STEP 1165 H= 291:15 +CPU= 26.783
  05:27:46 STEP 1166 H= 291:30 +CPU= 26.654
  05:28:13 STEP 1167 H= 291:45 +CPU= 26.282
  05:28:41 STEP 1168 H= 292:00 +CPU= 26.940
  05:29:08 STEP 1169 H= 292:15 +CPU= 26.879
  05:29:35 STEP 1170 H= 292:30 +CPU= 26.843
  05:30:03 STEP 1171 H= 292:45 +CPU= 26.822
  05:30:30 STEP 1172 H= 293:00 +CPU= 27.024
  05:30:56 STEP 1173 H= 293:15 +CPU= 26.037
  05:31:24 STEP 1174 H= 293:30 +CPU= 26.904
  05:31:51 STEP 1175 H= 293:45 +CPU= 26.533
  05:32:23 STEP 1176 H= 294:00 +CPU= 32.008
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001176
  05:32:50 STEP 1177 H= 294:15 +CPU= 26.570
  05:33:17 STEP 1178 H= 294:30 +CPU= 26.700
  05:33:45 STEP 1179 H= 294:45 +CPU= 27.014
  05:34:12 STEP 1180 H= 295:00 +CPU= 26.737
  05:34:40 STEP 1181 H= 295:15 +CPU= 26.694
  05:35:08 STEP 1182 H= 295:30 +CPU= 27.316
  05:35:35 STEP 1183 H= 295:45 +CPU= 26.978
  05:36:03 STEP 1184 H= 296:00 +CPU= 26.949
  05:36:30 STEP 1185 H= 296:15 +CPU= 26.779
  05:36:57 STEP 1186 H= 296:30 +CPU= 27.095
  05:37:24 STEP 1187 H= 296:45 +CPU= 26.575
  05:37:59 STEP 1188 H= 297:00 +CPU= 33.480
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001188
  05:38:27 STEP 1189 H= 297:15 +CPU= 26.772
  05:38:54 STEP 1190 H= 297:30 +CPU= 27.310
  05:39:21 STEP 1191 H= 297:45 +CPU= 26.535
  05:39:50 STEP 1192 H= 298:00 +CPU= 27.527
  05:40:15 STEP 1193 H= 298:15 +CPU= 25.383
  05:40:43 STEP 1194 H= 298:30 +CPU= 25.864
  05:41:10 STEP 1195 H= 298:45 +CPU= 25.780
  05:41:38 STEP 1196 H= 299:00 +CPU= 27.462
  05:42:05 STEP 1197 H= 299:15 +CPU= 26.638
  05:42:32 STEP 1198 H= 299:30 +CPU= 26.559
  05:42:59 STEP 1199 H= 299:45 +CPU= 26.690
  05:43:38 STEP 1200 H= 300:00 +CPU= 35.774
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001200
  05:44:05 STEP 1201 H= 300:15 +CPU= 26.631
  05:44:32 STEP 1202 H= 300:30 +CPU= 26.811
  05:44:59 STEP 1203 H= 300:45 +CPU= 26.551
  05:45:27 STEP 1204 H= 301:00 +CPU= 27.934
  05:45:54 STEP 1205 H= 301:15 +CPU= 26.417
  05:46:21 STEP 1206 H= 301:30 +CPU= 27.002
  05:46:49 STEP 1207 H= 301:45 +CPU= 26.709
  05:47:17 STEP 1208 H= 302:00 +CPU= 27.450
  05:47:44 STEP 1209 H= 302:15 +CPU= 26.708
  05:48:11 STEP 1210 H= 302:30 +CPU= 26.060
  05:48:38 STEP 1211 H= 302:45 +CPU= 27.043
  05:49:11 STEP 1212 H= 303:00 +CPU= 32.583
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001212
  05:49:39 STEP 1213 H= 303:15 +CPU= 26.865
  05:50:06 STEP 1214 H= 303:30 +CPU= 26.728
  05:50:34 STEP 1215 H= 303:45 +CPU= 26.796
  05:51:01 STEP 1216 H= 304:00 +CPU= 26.952
  05:51:28 STEP 1217 H= 304:15 +CPU= 26.524
  05:51:55 STEP 1218 H= 304:30 +CPU= 26.686
  05:52:22 STEP 1219 H= 304:45 +CPU= 26.521
  05:52:51 STEP 1220 H= 305:00 +CPU= 27.704
  05:53:17 STEP 1221 H= 305:15 +CPU= 26.573
  05:53:44 STEP 1222 H= 305:30 +CPU= 26.378
  05:54:11 STEP 1223 H= 305:45 +CPU= 26.449
  05:54:45 STEP 1224 H= 306:00 +CPU= 32.138
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001224
  05:55:12 STEP 1225 H= 306:15 +CPU= 26.556
  05:55:38 STEP 1226 H= 306:30 +CPU= 26.070
  05:56:05 STEP 1227 H= 306:45 +CPU= 26.574
  05:56:32 STEP 1228 H= 307:00 +CPU= 26.616
  05:56:59 STEP 1229 H= 307:15 +CPU= 26.277
  05:57:26 STEP 1230 H= 307:30 +CPU= 26.616
  05:57:53 STEP 1231 H= 307:45 +CPU= 26.845
  05:58:21 STEP 1232 H= 308:00 +CPU= 27.216
  05:58:49 STEP 1233 H= 308:15 +CPU= 26.244
  05:59:16 STEP 1234 H= 308:30 +CPU= 27.143
  05:59:43 STEP 1235 H= 308:45 +CPU= 27.153
  06:00:17 STEP 1236 H= 309:00 +CPU= 32.763
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001236
  06:00:44 STEP 1237 H= 309:15 +CPU= 26.560
  06:01:11 STEP 1238 H= 309:30 +CPU= 26.691
  06:01:39 STEP 1239 H= 309:45 +CPU= 27.273
  06:02:06 STEP 1240 H= 310:00 +CPU= 26.597
  06:02:33 STEP 1241 H= 310:15 +CPU= 26.044
  06:03:00 STEP 1242 H= 310:30 +CPU= 26.581
  06:03:28 STEP 1243 H= 310:45 +CPU= 26.843
  06:03:55 STEP 1244 H= 311:00 +CPU= 27.181
  06:04:23 STEP 1245 H= 311:15 +CPU= 27.397
  06:04:50 STEP 1246 H= 311:30 +CPU= 26.436
  06:05:18 STEP 1247 H= 311:45 +CPU= 26.984
  06:05:56 STEP 1248 H= 312:00 +CPU= 36.748
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+001236
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a4se_2016092300_20_1017_12288033_0_r487054060_12.zip
Uploading the intermediate file: upload_file_12.zip
  06:06:23 STEP 1249 H= 312:15 +CPU= 26.576
  06:06:51 STEP 1250 H= 312:30 +CPU= 27.393
  06:07:19 STEP 1251 H= 312:45 +CPU= 27.095
  06:07:46 STEP 1252 H= 313:00 +CPU= 27.348
  06:08:15 STEP 1253 H= 313:15 +CPU= 27.151
  06:08:43 STEP 1254 H= 313:30 +CPU= 26.458
  06:09:10 STEP 1255 H= 313:45 +CPU= 26.934
  06:09:38 STEP 1256 H= 314:00 +CPU= 27.049
  06:10:05 STEP 1257 H= 314:15 +CPU= 26.983
  06:10:32 STEP 1258 H= 314:30 +CPU= 26.953
  06:11:00 STEP 1259 H= 314:45 +CPU= 26.593
  06:11:34 STEP 1260 H= 315:00 +CPU= 32.754
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001260
  06:12:01 STEP 1261 H= 315:15 +CPU= 26.933
  06:12:28 STEP 1262 H= 315:30 +CPU= 26.386
  06:12:55 STEP 1263 H= 315:45 +CPU= 26.776
  06:13:23 STEP 1264 H= 316:00 +CPU= 26.997
  06:13:50 STEP 1265 H= 316:15 +CPU= 26.821
  06:14:18 STEP 1266 H= 316:30 +CPU= 26.157
  06:14:44 STEP 1267 H= 316:45 +CPU= 26.330
  06:15:12 STEP 1268 H= 317:00 +CPU= 27.580
  06:15:39 STEP 1269 H= 317:15 +CPU= 26.953
  06:16:06 STEP 1270 H= 317:30 +CPU= 26.088
  06:16:33 STEP 1271 H= 317:45 +CPU= 25.976
  06:17:05 STEP 1272 H= 318:00 +CPU= 32.346
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001272
  06:17:32 STEP 1273 H= 318:15 +CPU= 26.268
  06:17:59 STEP 1274 H= 318:30 +CPU= 26.335
  06:18:26 STEP 1275 H= 318:45 +CPU= 26.549
  06:18:53 STEP 1276 H= 319:00 +CPU= 27.396
  06:19:20 STEP 1277 H= 319:15 +CPU= 26.582
  06:19:47 STEP 1278 H= 319:30 +CPU= 26.366
  06:20:14 STEP 1279 H= 319:45 +CPU= 26.229
  06:20:38 STEP 1280 H= 320:00 +CPU= 23.753
  06:21:05 STEP 1281 H= 320:15 +CPU= 26.565
  06:21:30 STEP 1282 H= 320:30 +CPU= 25.224
  06:21:55 STEP 1283 H= 320:45 +CPU= 24.753
  06:22:26 STEP 1284 H= 321:00 +CPU= 31.384
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001284
  06:22:50 STEP 1285 H= 321:15 +CPU= 23.671
  06:23:15 STEP 1286 H= 321:30 +CPU= 24.208
  06:23:38 STEP 1287 H= 321:45 +CPU= 23.351
  06:24:01 STEP 1288 H= 322:00 +CPU= 22.825
  06:24:22 STEP 1289 H= 322:15 +CPU= 21.133
  06:24:44 STEP 1290 H= 322:30 +CPU= 22.001
  06:25:07 STEP 1291 H= 322:45 +CPU= 22.526
  06:25:31 STEP 1292 H= 323:00 +CPU= 24.142
  06:25:54 STEP 1293 H= 323:15 +CPU= 22.812
  06:26:14 STEP 1294 H= 323:30 +CPU= 19.783
  06:26:33 STEP 1295 H= 323:45 +CPU= 18.836
  06:26:59 STEP 1296 H= 324:00 +CPU= 25.943
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001296
  06:27:18 STEP 1297 H= 324:15 +CPU= 19.234
  06:27:37 STEP 1298 H= 324:30 +CPU= 18.933
  06:27:56 STEP 1299 H= 324:45 +CPU= 18.958
  06:28:16 STEP 1300 H= 325:00 +CPU= 19.296
  06:28:35 STEP 1301 H= 325:15 +CPU= 19.324
  06:28:55 STEP 1302 H= 325:30 +CPU= 19.663
  06:29:14 STEP 1303 H= 325:45 +CPU= 19.446
  06:29:35 STEP 1304 H= 326:00 +CPU= 20.677
  06:29:56 STEP 1305 H= 326:15 +CPU= 20.237
  06:30:18 STEP 1306 H= 326:30 +CPU= 21.587
  06:30:40 STEP 1307 H= 326:45 +CPU= 21.816
  06:31:07 STEP 1308 H= 327:00 +CPU= 27.114
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001308
  06:31:29 STEP 1309 H= 327:15 +CPU= 22.011
  06:31:51 STEP 1310 H= 327:30 +CPU= 21.639
  06:32:13 STEP 1311 H= 327:45 +CPU= 22.241
  06:32:37 STEP 1312 H= 328:00 +CPU= 23.165
  06:32:59 STEP 1313 H= 328:15 +CPU= 22.143
  06:33:22 STEP 1314 H= 328:30 +CPU= 22.508
  06:33:44 STEP 1315 H= 328:45 +CPU= 22.189
  06:34:05 STEP 1316 H= 329:00 +CPU= 21.192
  06:34:28 STEP 1317 H= 329:15 +CPU= 22.232
  06:34:49 STEP 1318 H= 329:30 +CPU= 21.122
  06:35:11 STEP 1319 H= 329:45 +CPU= 21.876
  06:35:39 STEP 1320 H= 330:00 +CPU= 27.030
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001320
  06:36:02 STEP 1321 H= 330:15 +CPU= 21.778
  06:36:24 STEP 1322 H= 330:30 +CPU= 21.350
  06:36:45 STEP 1323 H= 330:45 +CPU= 21.671
  06:37:09 STEP 1324 H= 331:00 +CPU= 22.910
  06:37:29 STEP 1325 H= 331:15 +CPU= 20.156
  06:37:50 STEP 1326 H= 331:30 +CPU= 20.431
  06:38:11 STEP 1327 H= 331:45 +CPU= 20.965
  06:38:33 STEP 1328 H= 332:00 +CPU= 21.724
  06:38:55 STEP 1329 H= 332:15 +CPU= 21.622
  06:39:17 STEP 1330 H= 332:30 +CPU= 21.861
  06:39:40 STEP 1331 H= 332:45 +CPU= 22.095
  06:40:07 STEP 1332 H= 333:00 +CPU= 27.124
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001332
  06:40:29 STEP 1333 H= 333:15 +CPU= 21.193
  06:40:51 STEP 1334 H= 333:30 +CPU= 21.643
  06:41:13 STEP 1335 H= 333:45 +CPU= 22.231
  06:41:36 STEP 1336 H= 334:00 +CPU= 22.262
  06:41:59 STEP 1337 H= 334:15 +CPU= 21.990
  06:42:21 STEP 1338 H= 334:30 +CPU= 21.900
  06:42:43 STEP 1339 H= 334:45 +CPU= 21.573
  06:43:06 STEP 1340 H= 335:00 +CPU= 22.358
  06:43:29 STEP 1341 H= 335:15 +CPU= 21.456
  06:43:52 STEP 1342 H= 335:30 +CPU= 21.597
  06:44:15 STEP 1343 H= 335:45 +CPU= 21.614
  06:44:47 STEP 1344 H= 336:00 +CPU= 30.165
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+001332
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a4se_2016092300_20_1017_12288033_0_r487054060_13.zip
Uploading the intermediate file: upload_file_13.zip
  06:45:10 STEP 1345 H= 336:15 +CPU= 21.620
  06:45:33 STEP 1346 H= 336:30 +CPU= 22.213
  06:45:55 STEP 1347 H= 336:45 +CPU= 21.769
  06:46:17 STEP 1348 H= 337:00 +CPU= 22.214
  06:46:40 STEP 1349 H= 337:15 +CPU= 21.942
  06:47:02 STEP 1350 H= 337:30 +CPU= 21.839
  06:47:24 STEP 1351 H= 337:45 +CPU= 21.704
  06:47:47 STEP 1352 H= 338:00 +CPU= 22.072
  06:48:09 STEP 1353 H= 338:15 +CPU= 21.948
  06:48:32 STEP 1354 H= 338:30 +CPU= 21.359
  06:48:53 STEP 1355 H= 338:45 +CPU= 21.278
  06:49:21 STEP 1356 H= 339:00 +CPU= 27.140
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001356
  06:49:44 STEP 1357 H= 339:15 +CPU= 21.896
  06:50:06 STEP 1358 H= 339:30 +CPU= 21.371
  06:50:28 STEP 1359 H= 339:45 +CPU= 21.887
  06:50:51 STEP 1360 H= 340:00 +CPU= 22.402
  06:51:13 STEP 1361 H= 340:15 +CPU= 21.683
  06:51:36 STEP 1362 H= 340:30 +CPU= 21.994
  06:51:58 STEP 1363 H= 340:45 +CPU= 21.929
  06:52:21 STEP 1364 H= 341:00 +CPU= 22.455
  06:52:43 STEP 1365 H= 341:15 +CPU= 21.744
  06:53:06 STEP 1366 H= 341:30 +CPU= 21.450
  06:53:29 STEP 1367 H= 341:45 +CPU= 22.029
  06:53:56 STEP 1368 H= 342:00 +CPU= 26.832
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001368
  06:54:19 STEP 1369 H= 342:15 +CPU= 22.058
  06:54:41 STEP 1370 H= 342:30 +CPU= 22.135
  06:55:03 STEP 1371 H= 342:45 +CPU= 21.597
  06:55:26 STEP 1372 H= 343:00 +CPU= 22.716
  06:55:49 STEP 1373 H= 343:15 +CPU= 22.059
  06:56:12 STEP 1374 H= 343:30 +CPU= 21.642
  06:56:35 STEP 1375 H= 343:45 +CPU= 21.875
  06:56:59 STEP 1376 H= 344:00 +CPU= 22.232
  06:57:20 STEP 1377 H= 344:15 +CPU= 21.159
  06:57:43 STEP 1378 H= 344:30 +CPU= 21.433
  06:58:05 STEP 1379 H= 344:45 +CPU= 21.954
  06:58:33 STEP 1380 H= 345:00 +CPU= 27.172
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001380
  06:58:55 STEP 1381 H= 345:15 +CPU= 22.054
  06:59:18 STEP 1382 H= 345:30 +CPU= 22.260
  06:59:40 STEP 1383 H= 345:45 +CPU= 21.546
  07:00:03 STEP 1384 H= 346:00 +CPU= 22.418
  07:00:24 STEP 1385 H= 346:15 +CPU= 21.365
  07:00:46 STEP 1386 H= 346:30 +CPU= 21.759
  07:01:09 STEP 1387 H= 346:45 +CPU= 22.200
  07:01:31 STEP 1388 H= 347:00 +CPU= 22.228
  07:01:54 STEP 1389 H= 347:15 +CPU= 22.011
  07:02:17 STEP 1390 H= 347:30 +CPU= 22.620
  07:02:39 STEP 1391 H= 347:45 +CPU= 22.346
  07:03:11 STEP 1392 H= 348:00 +CPU= 30.908
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001392
  07:03:32 STEP 1393 H= 348:15 +CPU= 21.089
  07:03:54 STEP 1394 H= 348:30 +CPU= 22.168
  07:04:17 STEP 1395 H= 348:45 +CPU= 22.123
  07:04:39 STEP 1396 H= 349:00 +CPU= 22.377
  07:05:02 STEP 1397 H= 349:15 +CPU= 21.684
  07:05:24 STEP 1398 H= 349:30 +CPU= 21.808
  07:05:45 STEP 1399 H= 349:45 +CPU= 21.558
  07:06:08 STEP 1400 H= 350:00 +CPU= 22.706
  07:06:31 STEP 1401 H= 350:15 +CPU= 22.500
  07:06:53 STEP 1402 H= 350:30 +CPU= 22.129
  07:07:15 STEP 1403 H= 350:45 +CPU= 21.812
  07:07:42 STEP 1404 H= 351:00 +CPU= 26.832
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001404
  07:08:04 STEP 1405 H= 351:15 +CPU= 21.096
  07:08:26 STEP 1406 H= 351:30 +CPU= 21.936
  07:08:48 STEP 1407 H= 351:45 +CPU= 21.800
  07:09:12 STEP 1408 H= 352:00 +CPU= 23.192
  07:09:38 STEP 1409 H= 352:15 +CPU= 25.616
  07:10:03 STEP 1410 H= 352:30 +CPU= 25.123
  07:10:29 STEP 1411 H= 352:45 +CPU= 26.070
  07:10:57 STEP 1412 H= 353:00 +CPU= 26.639
  07:11:24 STEP 1413 H= 353:15 +CPU= 26.683
  07:11:51 STEP 1414 H= 353:30 +CPU= 27.140
  07:12:19 STEP 1415 H= 353:45 +CPU= 26.889
  07:12:51 STEP 1416 H= 354:00 +CPU= 31.732
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001416
  07:13:19 STEP 1417 H= 354:15 +CPU= 26.608
  07:13:46 STEP 1418 H= 354:30 +CPU= 26.400
  07:14:11 STEP 1419 H= 354:45 +CPU= 24.994
  07:14:37 STEP 1420 H= 355:00 +CPU= 25.753
  07:15:03 STEP 1421 H= 355:15 +CPU= 25.363
  07:15:29 STEP 1422 H= 355:30 +CPU= 25.526
  07:15:55 STEP 1423 H= 355:45 +CPU= 25.854
  07:16:22 STEP 1424 H= 356:00 +CPU= 26.589
  07:16:50 STEP 1425 H= 356:15 +CPU= 27.075
  07:17:17 STEP 1426 H= 356:30 +CPU= 25.782
  07:17:45 STEP 1427 H= 356:45 +CPU= 27.709
  07:18:18 STEP 1428 H= 357:00 +CPU= 32.550
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001428
  07:18:44 STEP 1429 H= 357:15 +CPU= 24.812
  07:19:09 STEP 1430 H= 357:30 +CPU= 24.077
  07:19:33 STEP 1431 H= 357:45 +CPU= 24.014
  07:19:58 STEP 1432 H= 358:00 +CPU= 24.442
  07:20:22 STEP 1433 H= 358:15 +CPU= 23.980
  07:20:47 STEP 1434 H= 358:30 +CPU= 25.024
  07:21:13 STEP 1435 H= 358:45 +CPU= 25.311
  07:21:39 STEP 1436 H= 359:00 +CPU= 25.731
  07:22:02 STEP 1437 H= 359:15 +CPU= 22.928
  07:22:25 STEP 1438 H= 359:30 +CPU= 22.049
  07:22:49 STEP 1439 H= 359:45 +CPU= 24.207
  07:23:22 STEP 1440 H= 360:00 +CPU= 32.552
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.1055139507E-20      I       0.2343444132E-06      I
ICloud fractionI      0.0000000000E+00      I       0.1001842456E-02      I
I  Relat. Hum. I      0.3945701946E+00      I       0.4081156380E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.1896583515E+02      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    316604308 BYTES IN      7 RECORDS TRANSFERRED IN    0.0004 SECONDS791510.8 Mbytes/s, TOTAL TIME=    0.0104( 3.8%)
 07:23:22 STEP 1440 H= 360:00 +CPU= 32.552
 END CNT3
 NSTEP =  1440 CNT0   000000000  23.942  23.942  24.269   0.987               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ            0/           0 WRITTEN        43246/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    758    0        0            0    43246 ************    87.7     0.0    87.7     0.0   177.7
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.98      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 1562    5431.4    5431.4     20.61      0.00
   9 SPCM     - SPECTRAL COMP.                    1440     891.9     891.9      3.12      0.00
  10 SCAN2M - PHYSICS                             1441   12194.6   12194.6     42.69      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                121     970.5     970.5      0.29      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 63      76.6      76.6      0.01      0.00
  14 SUINIF                                          1    6791.4    6791.4      0.02      0.00
  17 GRIDFPOS IN CNT4                              121     100.1     100.1      0.03      0.00
  18 SUSPECG                                         1    3091.6    3091.6      0.01      0.00
  19 SUSPEC                                          1    3098.1    3098.1      0.01      0.00
  24 SUGRIDU                                         1    3275.6    3275.6      0.01      0.00
  25 SPECRT                                          1     289.4     289.4      0.00      0.00
  26 SUGRIDF                                         1     128.3     128.3      0.00      0.00
  27 RESTART FILES - WRITING                        30    3909.3    3909.3      0.28      0.00
  28 RESTART FILES - READING                         1       0.0       0.0      0.00      0.00
  29 SU4FPOS IN CNT4                               121       0.7       0.7      0.00      0.00
  30 DYNFPOS IN CNT4                               121    5991.6    5991.6      1.76      0.00
  31 POSDDH IN STEPO                                 7     892.7     892.7      0.02      0.00
  37 CPGLAG   - SL COMPUTATIONS                   1441    5908.9    5908.9     20.68      0.00
  39 SU0YOMB                                         1     395.5     395.5      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   1441      30.0      30.0      0.11      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             1440     535.5     535.5      1.87      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             1440      66.5      66.5      0.23      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 63       0.5       0.5      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     3125     401.4     401.4      3.05      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      3006     238.1     238.1      1.74      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       3006      93.7      93.7      0.68      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      3125     123.7     123.7      0.94      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      41.8      41.8      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           3125      63.2      63.2      0.48      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           3006      34.0      34.0      0.25      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           3125     130.8     130.8      0.99      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           3006      57.2      57.2      0.42      0.00
 400 GSTATS                                     167734       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                156066       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    41164.9 CPU TIME   39343.4 VECTOR TIME    39343.4


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       31.5
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc/slots/2/NODE.001_01
Adding to the zip: /var/lib/boinc/slots/2/ifs.stat
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12288033/ICMSHh7zg+001380
Zipping up the final file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a4se_2016092300_20_1017_12288033_0_r487054060_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
07:26:51 (421): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>oifs_43r3_bl_a4se_2016092300_20_1017_12288033_0_r487054060_15.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a4se_2016092300_20_1017_12288033_0_r487054060_16.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a4se_2016092300_20_1017_12288033_0_r487054060_17.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a4se_2016092300_20_1017_12288033_0_r487054060_18.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a4se_2016092300_20_1017_12288033_0_r487054060_19.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
08 Jun 2024 08:25:22 1541092 22439695 oifs_43r3_bl_a4se_2016092300_20_1017_12288033_0 1,295,100 39,343 0.0304
08 Jun 2024 04:40:45 1541092 22439695 oifs_43r3_bl_a4se_2016092300_20_1017_12288033_0 864,000 26,892 0.0311


©2024 climateprediction.net