climateprediction.net home page
Task 22436650

Task 22436650

Name oifs_43r3_bl_a2hr_2016092300_20_1017_12285058_0
Workunit 12285058
Created 7 Jun 2024, 15:31:02 UTC
Sent 8 Jun 2024, 2:33:31 UTC
Report deadline 7 Aug 2024, 2:33:31 UTC
Received 11 Jun 2024, 2:20:10 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1533094
Run time 15 hours 52 min 39 sec
CPU time 15 hours 49 min 26 sec
Validate state Invalid
Credit 1,976.32
Device peak FLOPS 7.75 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,487.34 MB
Peak swap size 5,980.80 MB
Peak disk usage 1,350.05 MB
Stderr
<core_client_version>7.24.1</core_client_version>
<![CDATA[
<stderr_txt>
0792
  00:07:06 STEP  793 H= 198:15 +CPU= 32.087
  00:07:42 STEP  794 H= 198:30 +CPU= 35.637
  00:08:19 STEP  795 H= 198:45 +CPU= 35.914
  00:08:46 STEP  796 H= 199:00 +CPU= 27.200
  00:09:24 STEP  797 H= 199:15 +CPU= 36.142
  00:10:02 STEP  798 H= 199:30 +CPU= 37.447
  00:10:37 STEP  799 H= 199:45 +CPU= 33.269
  00:11:12 STEP  800 H= 200:00 +CPU= 34.237
  00:11:49 STEP  801 H= 200:15 +CPU= 36.130
  00:12:23 STEP  802 H= 200:30 +CPU= 33.682
  00:12:55 STEP  803 H= 200:45 +CPU= 31.116
  00:13:38 STEP  804 H= 201:00 +CPU= 41.755
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+000804
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+000804
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+000804
  00:14:14 STEP  805 H= 201:15 +CPU= 34.795
  00:14:50 STEP  806 H= 201:30 +CPU= 35.888
  00:15:21 STEP  807 H= 201:45 +CPU= 30.683
  00:15:51 STEP  808 H= 202:00 +CPU= 29.391
  00:16:17 STEP  809 H= 202:15 +CPU= 26.083
  00:16:40 STEP  810 H= 202:30 +CPU= 23.180
  00:17:02 STEP  811 H= 202:45 +CPU= 21.564
  00:17:23 STEP  812 H= 203:00 +CPU= 20.499
  00:17:46 STEP  813 H= 203:15 +CPU= 22.756
  00:18:17 STEP  814 H= 203:30 +CPU= 31.052
  00:18:53 STEP  815 H= 203:45 +CPU= 34.934
  00:19:31 STEP  816 H= 204:00 +CPU= 37.270
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+000816
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+000816
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+000816
  00:20:06 STEP  817 H= 204:15 +CPU= 33.451
  00:20:36 STEP  818 H= 204:30 +CPU= 29.958
  00:21:02 STEP  819 H= 204:45 +CPU= 25.015
  00:21:34 STEP  820 H= 205:00 +CPU= 31.924
  00:22:08 STEP  821 H= 205:15 +CPU= 33.482
  00:22:40 STEP  822 H= 205:30 +CPU= 31.360
  00:23:11 STEP  823 H= 205:45 +CPU= 31.358
  00:23:44 STEP  824 H= 206:00 +CPU= 32.411
  00:24:19 STEP  825 H= 206:15 +CPU= 34.083
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:27:10 STEP  826 H= 206:30 +CPU= 31.760
  00:27:38 STEP  827 H= 206:45 +CPU= 27.860
  00:28:15 STEP  828 H= 207:00 +CPU= 36.093
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+000828
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+000828
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+000828
  00:28:47 STEP  829 H= 207:15 +CPU= 31.085
  00:29:15 STEP  830 H= 207:30 +CPU= 28.261
  00:29:43 STEP  831 H= 207:45 +CPU= 27.379
  00:30:09 STEP  832 H= 208:00 +CPU= 25.010
  00:30:38 STEP  833 H= 208:15 +CPU= 28.868
  00:31:08 STEP  834 H= 208:30 +CPU= 28.444
  00:31:36 STEP  835 H= 208:45 +CPU= 27.862
  00:32:05 STEP  836 H= 209:00 +CPU= 28.141
  00:32:32 STEP  837 H= 209:15 +CPU= 26.982
  00:33:02 STEP  838 H= 209:30 +CPU= 28.808
  00:33:30 STEP  839 H= 209:45 +CPU= 28.270
  00:34:07 STEP  840 H= 210:00 +CPU= 35.931
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+000840
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+000840
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+000840
  00:34:33 STEP  841 H= 210:15 +CPU= 25.894
  00:35:04 STEP  842 H= 210:30 +CPU= 30.260
  00:35:30 STEP  843 H= 210:45 +CPU= 26.299
  00:36:03 STEP  844 H= 211:00 +CPU= 31.942
  00:36:31 STEP  845 H= 211:15 +CPU= 27.522
  00:36:56 STEP  846 H= 211:30 +CPU= 24.483
  00:37:25 STEP  847 H= 211:45 +CPU= 28.996
  00:37:58 STEP  848 H= 212:00 +CPU= 32.071
  00:38:27 STEP  849 H= 212:15 +CPU= 28.427
  00:38:55 STEP  850 H= 212:30 +CPU= 28.121
  00:39:21 STEP  851 H= 212:45 +CPU= 25.825
  00:39:53 STEP  852 H= 213:00 +CPU= 31.267
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+000852
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+000852
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+000852
  00:40:21 STEP  853 H= 213:15 +CPU= 28.171
  00:40:49 STEP  854 H= 213:30 +CPU= 27.057
  00:41:16 STEP  855 H= 213:45 +CPU= 26.156
  00:41:44 STEP  856 H= 214:00 +CPU= 28.070
  00:42:07 STEP  857 H= 214:15 +CPU= 22.715
  00:42:31 STEP  858 H= 214:30 +CPU= 24.078
  00:42:56 STEP  859 H= 214:45 +CPU= 24.145
  00:43:24 STEP  860 H= 215:00 +CPU= 27.383
  00:43:53 STEP  861 H= 215:15 +CPU= 28.869
  00:44:16 STEP  862 H= 215:30 +CPU= 23.024
  00:44:39 STEP  863 H= 215:45 +CPU= 22.300
  00:45:14 STEP  864 H= 216:00 +CPU= 34.752
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+000864
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+000864
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+000768
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+000768
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+000768
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+000780
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+000780
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+000780
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+000792
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+000792
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+000792
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+000804
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+000804
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+000804
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+000816
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+000816
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+000816
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+000828
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+000828
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+000828
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+000840
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+000840
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+000840
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+000852
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+000852
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+000852
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a2hr_2016092300_20_1017_12285058_0_r720526872_8.zip
Uploading the intermediate file: upload_file_8.zip
  00:45:39 STEP  865 H= 216:15 +CPU= 24.361
  00:46:03 STEP  866 H= 216:30 +CPU= 23.945
  00:46:32 STEP  867 H= 216:45 +CPU= 28.340
  00:46:54 STEP  868 H= 217:00 +CPU= 21.600
  00:47:15 STEP  869 H= 217:15 +CPU= 20.916
  00:47:37 STEP  870 H= 217:30 +CPU= 22.193
  00:48:05 STEP  871 H= 217:45 +CPU= 27.770
  00:48:33 STEP  872 H= 218:00 +CPU= 27.110
  00:48:59 STEP  873 H= 218:15 +CPU= 25.846
  00:49:23 STEP  874 H= 218:30 +CPU= 23.247
  00:49:45 STEP  875 H= 218:45 +CPU= 22.572
  00:50:16 STEP  876 H= 219:00 +CPU= 30.403
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+000876
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+000876
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+000876
  00:50:41 STEP  877 H= 219:15 +CPU= 24.609
  00:51:04 STEP  878 H= 219:30 +CPU= 21.736
  00:51:31 STEP  879 H= 219:45 +CPU= 27.182
  00:52:00 STEP  880 H= 220:00 +CPU= 28.156
  00:52:24 STEP  881 H= 220:15 +CPU= 23.775
  00:52:43 STEP  882 H= 220:30 +CPU= 19.310
  00:53:10 STEP  883 H= 220:45 +CPU= 26.323
  00:53:33 STEP  884 H= 221:00 +CPU= 23.058
  00:53:54 STEP  885 H= 221:15 +CPU= 20.131
  00:54:18 STEP  886 H= 221:30 +CPU= 23.866
  00:54:44 STEP  887 H= 221:45 +CPU= 25.555
  00:55:16 STEP  888 H= 222:00 +CPU= 31.651
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+000888
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+000888
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+000888
  00:55:44 STEP  889 H= 222:15 +CPU= 27.636
  00:56:09 STEP  890 H= 222:30 +CPU= 24.743
  00:56:31 STEP  891 H= 222:45 +CPU= 22.034
  00:56:53 STEP  892 H= 223:00 +CPU= 21.925
  00:57:17 STEP  893 H= 223:15 +CPU= 23.451
  00:57:40 STEP  894 H= 223:30 +CPU= 22.791
  00:58:03 STEP  895 H= 223:45 +CPU= 22.648
  00:58:23 STEP  896 H= 224:00 +CPU= 19.587
  00:58:43 STEP  897 H= 224:15 +CPU= 20.773
  00:59:06 STEP  898 H= 224:30 +CPU= 22.634
  00:59:27 STEP  899 H= 224:45 +CPU= 20.107
  00:59:54 STEP  900 H= 225:00 +CPU= 27.051
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+000900
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+000900
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+000900
  01:00:16 STEP  901 H= 225:15 +CPU= 22.129
  01:00:37 STEP  902 H= 225:30 +CPU= 20.847
  01:00:58 STEP  903 H= 225:45 +CPU= 20.231
  01:01:19 STEP  904 H= 226:00 +CPU= 20.896
  01:01:39 STEP  905 H= 226:15 +CPU= 20.646
  01:02:03 STEP  906 H= 226:30 +CPU= 22.936
  01:02:25 STEP  907 H= 226:45 +CPU= 21.931
  01:02:46 STEP  908 H= 227:00 +CPU= 21.450
  01:03:09 STEP  909 H= 227:15 +CPU= 22.457
  01:03:32 STEP  910 H= 227:30 +CPU= 22.661
  01:03:55 STEP  911 H= 227:45 +CPU= 22.763
  01:04:24 STEP  912 H= 228:00 +CPU= 28.876
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+000912
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+000912
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+000912
  01:04:45 STEP  913 H= 228:15 +CPU= 21.329
  01:05:08 STEP  914 H= 228:30 +CPU= 22.148
  01:05:31 STEP  915 H= 228:45 +CPU= 22.911
  01:05:54 STEP  916 H= 229:00 +CPU= 22.815
  01:06:15 STEP  917 H= 229:15 +CPU= 21.466
  01:06:36 STEP  918 H= 229:30 +CPU= 20.174
  01:06:57 STEP  919 H= 229:45 +CPU= 20.941
  01:07:20 STEP  920 H= 230:00 +CPU= 22.200
  01:07:43 STEP  921 H= 230:15 +CPU= 23.047
  01:08:05 STEP  922 H= 230:30 +CPU= 22.286
  01:08:26 STEP  923 H= 230:45 +CPU= 20.826
  01:08:58 STEP  924 H= 231:00 +CPU= 31.181
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+000924
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+000924
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+000924
  01:09:19 STEP  925 H= 231:15 +CPU= 20.514
  01:09:44 STEP  926 H= 231:30 +CPU= 24.778
  01:10:11 STEP  927 H= 231:45 +CPU= 26.994
  01:10:41 STEP  928 H= 232:00 +CPU= 29.997
  01:11:08 STEP  929 H= 232:15 +CPU= 25.918
  01:11:33 STEP  930 H= 232:30 +CPU= 24.676
  01:11:56 STEP  931 H= 232:45 +CPU= 23.343
  01:12:19 STEP  932 H= 233:00 +CPU= 22.496
  01:12:41 STEP  933 H= 233:15 +CPU= 22.058
  01:13:03 STEP  934 H= 233:30 +CPU= 21.940
  01:13:24 STEP  935 H= 233:45 +CPU= 20.549
  01:13:53 STEP  936 H= 234:00 +CPU= 29.064
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+000936
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+000936
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+000936
  01:14:14 STEP  937 H= 234:15 +CPU= 20.409
  01:14:35 STEP  938 H= 234:30 +CPU= 20.529
  01:14:54 STEP  939 H= 234:45 +CPU= 19.426
  01:15:18 STEP  940 H= 235:00 +CPU= 23.371
  01:15:40 STEP  941 H= 235:15 +CPU= 22.597
  01:16:04 STEP  942 H= 235:30 +CPU= 23.015
  01:16:26 STEP  943 H= 235:45 +CPU= 22.631
  01:16:50 STEP  944 H= 236:00 +CPU= 22.912
  01:17:13 STEP  945 H= 236:15 +CPU= 22.903
  01:17:35 STEP  946 H= 236:30 +CPU= 22.302
  01:17:56 STEP  947 H= 236:45 +CPU= 21.056
  01:18:23 STEP  948 H= 237:00 +CPU= 26.437
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+000948
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+000948
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+000948
  01:18:44 STEP  949 H= 237:15 +CPU= 20.680
  01:19:05 STEP  950 H= 237:30 +CPU= 20.456
  01:19:27 STEP  951 H= 237:45 +CPU= 21.638
  01:19:47 STEP  952 H= 238:00 +CPU= 20.519
  01:20:06 STEP  953 H= 238:15 +CPU= 18.885
  01:20:25 STEP  954 H= 238:30 +CPU= 18.916
  01:20:46 STEP  955 H= 238:45 +CPU= 19.807
  01:21:03 STEP  956 H= 239:00 +CPU= 16.957
  01:21:21 STEP  957 H= 239:15 +CPU= 18.043
  01:21:39 STEP  958 H= 239:30 +CPU= 17.510
  01:21:57 STEP  959 H= 239:45 +CPU= 18.261
  01:22:23 STEP  960 H= 240:00 +CPU= 25.528
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+000960
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+000960
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+000864
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+000864
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+000876
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+000876
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+000876
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+000888
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+000888
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+000888
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+000900
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+000900
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+000900
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+000912
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+000912
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+000912
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+000924
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+000924
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+000924
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+000936
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+000936
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+000936
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+000948
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+000948
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+000948
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a2hr_2016092300_20_1017_12285058_0_r720526872_9.zip
Uploading the intermediate file: upload_file_9.zip
  01:22:43 STEP  961 H= 240:15 +CPU= 19.160
  01:23:01 STEP  962 H= 240:30 +CPU= 17.464
  01:23:19 STEP  963 H= 240:45 +CPU= 18.017
  01:23:37 STEP  964 H= 241:00 +CPU= 17.702
  01:23:57 STEP  965 H= 241:15 +CPU= 19.745
  01:24:18 STEP  966 H= 241:30 +CPU= 20.920
  01:24:38 STEP  967 H= 241:45 +CPU= 20.354
  01:24:57 STEP  968 H= 242:00 +CPU= 18.621
  01:25:17 STEP  969 H= 242:15 +CPU= 19.871
  01:25:37 STEP  970 H= 242:30 +CPU= 19.598
  01:25:55 STEP  971 H= 242:45 +CPU= 17.885
  01:26:20 STEP  972 H= 243:00 +CPU= 24.444
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+000972
  01:26:40 STEP  973 H= 243:15 +CPU= 20.106
  01:26:59 STEP  974 H= 243:30 +CPU= 19.070
  01:27:18 STEP  975 H= 243:45 +CPU= 18.610
  01:27:37 STEP  976 H= 244:00 +CPU= 18.481
  01:27:56 STEP  977 H= 244:15 +CPU= 18.947
  01:28:15 STEP  978 H= 244:30 +CPU= 18.679
  01:28:33 STEP  979 H= 244:45 +CPU= 17.463
  01:28:51 STEP  980 H= 245:00 +CPU= 17.757
  01:29:08 STEP  981 H= 245:15 +CPU= 17.042
  01:29:26 STEP  982 H= 245:30 +CPU= 17.231
  01:29:42 STEP  983 H= 245:45 +CPU= 16.590
  01:30:05 STEP  984 H= 246:00 +CPU= 22.010
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+000984
  01:30:22 STEP  985 H= 246:15 +CPU= 17.047
  01:30:40 STEP  986 H= 246:30 +CPU= 17.958
  01:30:58 STEP  987 H= 246:45 +CPU= 17.866
  01:31:15 STEP  988 H= 247:00 +CPU= 16.919
  01:31:32 STEP  989 H= 247:15 +CPU= 16.706
  01:31:50 STEP  990 H= 247:30 +CPU= 17.779
  01:32:08 STEP  991 H= 247:45 +CPU= 17.944
  01:32:27 STEP  992 H= 248:00 +CPU= 18.296
  01:32:46 STEP  993 H= 248:15 +CPU= 19.492
  01:33:04 STEP  994 H= 248:30 +CPU= 17.280
  01:33:21 STEP  995 H= 248:45 +CPU= 17.194
  01:33:44 STEP  996 H= 249:00 +CPU= 22.506
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+000996
  01:34:01 STEP  997 H= 249:15 +CPU= 16.545
  01:34:20 STEP  998 H= 249:30 +CPU= 19.271
  01:34:38 STEP  999 H= 249:45 +CPU= 17.364
  01:34:56 STEP 1000 H= 250:00 +CPU= 17.899
  01:35:14 STEP 1001 H= 250:15 +CPU= 17.644
  01:35:31 STEP 1002 H= 250:30 +CPU= 17.146
  01:35:49 STEP 1003 H= 250:45 +CPU= 17.668
  01:36:06 STEP 1004 H= 251:00 +CPU= 17.494
  01:36:22 STEP 1005 H= 251:15 +CPU= 15.711
  01:36:38 STEP 1006 H= 251:30 +CPU= 15.484
  01:36:53 STEP 1007 H= 251:45 +CPU= 15.342
  01:37:16 STEP 1008 H= 252:00 +CPU= 22.724
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+001008
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+001008
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+001008
  01:37:33 STEP 1009 H= 252:15 +CPU= 16.863
  01:37:50 STEP 1010 H= 252:30 +CPU= 16.896
  01:38:07 STEP 1011 H= 252:45 +CPU= 17.075
  01:38:26 STEP 1012 H= 253:00 +CPU= 18.423
  01:38:44 STEP 1013 H= 253:15 +CPU= 18.132
  01:39:02 STEP 1014 H= 253:30 +CPU= 17.714
  01:39:19 STEP 1015 H= 253:45 +CPU= 17.560
  01:39:37 STEP 1016 H= 254:00 +CPU= 17.522
  01:39:54 STEP 1017 H= 254:15 +CPU= 17.321
  01:40:11 STEP 1018 H= 254:30 +CPU= 16.479
  01:40:28 STEP 1019 H= 254:45 +CPU= 17.377
  01:40:51 STEP 1020 H= 255:00 +CPU= 22.330
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+001020
  01:41:08 STEP 1021 H= 255:15 +CPU= 16.742
  01:41:25 STEP 1022 H= 255:30 +CPU= 17.221
  01:41:42 STEP 1023 H= 255:45 +CPU= 16.598
  01:41:59 STEP 1024 H= 256:00 +CPU= 16.600
  01:42:16 STEP 1025 H= 256:15 +CPU= 16.945
  01:42:33 STEP 1026 H= 256:30 +CPU= 17.398
  01:42:50 STEP 1027 H= 256:45 +CPU= 16.294
  01:43:06 STEP 1028 H= 257:00 +CPU= 15.705
  01:43:22 STEP 1029 H= 257:15 +CPU= 16.053
  01:43:41 STEP 1030 H= 257:30 +CPU= 19.085
  01:44:00 STEP 1031 H= 257:45 +CPU= 18.551
  01:44:24 STEP 1032 H= 258:00 +CPU= 24.135
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+001032
  01:44:43 STEP 1033 H= 258:15 +CPU= 18.791
  01:45:01 STEP 1034 H= 258:30 +CPU= 18.020
  01:45:20 STEP 1035 H= 258:45 +CPU= 18.623
  01:45:40 STEP 1036 H= 259:00 +CPU= 19.088
  01:45:57 STEP 1037 H= 259:15 +CPU= 17.618
  01:46:16 STEP 1038 H= 259:30 +CPU= 18.337
  01:46:35 STEP 1039 H= 259:45 +CPU= 18.820
  01:46:55 STEP 1040 H= 260:00 +CPU= 19.812
  01:47:11 STEP 1041 H= 260:15 +CPU= 16.555
  01:47:29 STEP 1042 H= 260:30 +CPU= 17.146
  01:47:46 STEP 1043 H= 260:45 +CPU= 16.959
  01:48:07 STEP 1044 H= 261:00 +CPU= 20.716
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+001044
  01:48:23 STEP 1045 H= 261:15 +CPU= 16.164
  01:48:41 STEP 1046 H= 261:30 +CPU= 17.412
  01:48:59 STEP 1047 H= 261:45 +CPU= 17.826
  01:49:19 STEP 1048 H= 262:00 +CPU= 20.224
  01:49:38 STEP 1049 H= 262:15 +CPU= 18.949
  01:49:57 STEP 1050 H= 262:30 +CPU= 19.209
  01:50:15 STEP 1051 H= 262:45 +CPU= 17.634
  01:50:33 STEP 1052 H= 263:00 +CPU= 17.624
  01:50:51 STEP 1053 H= 263:15 +CPU= 18.170
  01:51:11 STEP 1054 H= 263:30 +CPU= 19.276
  01:51:31 STEP 1055 H= 263:45 +CPU= 20.139
  01:51:58 STEP 1056 H= 264:00 +CPU= 26.855
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+001044
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a2hr_2016092300_20_1017_12285058_0_r720526872_10.zip
Uploading the intermediate file: upload_file_10.zip
  01:52:17 STEP 1057 H= 264:15 +CPU= 18.623
  01:52:33 STEP 1058 H= 264:30 +CPU= 15.922
  01:52:52 STEP 1059 H= 264:45 +CPU= 18.522
  01:53:11 STEP 1060 H= 265:00 +CPU= 18.715
  01:53:28 STEP 1061 H= 265:15 +CPU= 16.589
  01:53:45 STEP 1062 H= 265:30 +CPU= 17.218
  01:54:03 STEP 1063 H= 265:45 +CPU= 17.210
  01:54:21 STEP 1064 H= 266:00 +CPU= 18.198
  01:54:40 STEP 1065 H= 266:15 +CPU= 18.880
  01:54:59 STEP 1066 H= 266:30 +CPU= 18.616
  01:55:18 STEP 1067 H= 266:45 +CPU= 18.978
  01:55:42 STEP 1068 H= 267:00 +CPU= 23.502
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+001068
  01:56:02 STEP 1069 H= 267:15 +CPU= 19.469
  01:56:21 STEP 1070 H= 267:30 +CPU= 18.873
  01:56:39 STEP 1071 H= 267:45 +CPU= 17.812
  01:56:58 STEP 1072 H= 268:00 +CPU= 18.673
  01:57:16 STEP 1073 H= 268:15 +CPU= 18.103
  01:57:33 STEP 1074 H= 268:30 +CPU= 17.220
  01:57:50 STEP 1075 H= 268:45 +CPU= 16.719
  01:58:07 STEP 1076 H= 269:00 +CPU= 16.957
  01:58:24 STEP 1077 H= 269:15 +CPU= 16.874
  01:58:42 STEP 1078 H= 269:30 +CPU= 18.077
  01:59:01 STEP 1079 H= 269:45 +CPU= 18.231
  01:59:25 STEP 1080 H= 270:00 +CPU= 23.566
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+001080
  01:59:44 STEP 1081 H= 270:15 +CPU= 18.593
  02:00:03 STEP 1082 H= 270:30 +CPU= 18.606
  02:00:23 STEP 1083 H= 270:45 +CPU= 20.116
  02:00:42 STEP 1084 H= 271:00 +CPU= 18.282
  02:01:01 STEP 1085 H= 271:15 +CPU= 18.665
  02:01:20 STEP 1086 H= 271:30 +CPU= 18.919
  02:01:40 STEP 1087 H= 271:45 +CPU= 20.311
  02:02:01 STEP 1088 H= 272:00 +CPU= 20.966
  02:02:21 STEP 1089 H= 272:15 +CPU= 19.099
  02:02:39 STEP 1090 H= 272:30 +CPU= 18.418
  02:02:58 STEP 1091 H= 272:45 +CPU= 18.164
  02:03:21 STEP 1092 H= 273:00 +CPU= 22.992
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+001092
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+001092
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+001092
  02:03:39 STEP 1093 H= 273:15 +CPU= 18.353
  02:03:58 STEP 1094 H= 273:30 +CPU= 18.993
  02:04:17 STEP 1095 H= 273:45 +CPU= 18.883
  02:04:37 STEP 1096 H= 274:00 +CPU= 19.058
  02:04:55 STEP 1097 H= 274:15 +CPU= 17.919
  02:05:12 STEP 1098 H= 274:30 +CPU= 17.173
  02:05:29 STEP 1099 H= 274:45 +CPU= 16.616
  02:05:47 STEP 1100 H= 275:00 +CPU= 18.405
  02:06:06 STEP 1101 H= 275:15 +CPU= 18.751
  02:06:25 STEP 1102 H= 275:30 +CPU= 18.578
  02:06:43 STEP 1103 H= 275:45 +CPU= 17.677
  02:07:08 STEP 1104 H= 276:00 +CPU= 24.758
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+001104
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+001104
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+001104
  02:07:26 STEP 1105 H= 276:15 +CPU= 17.932
  02:07:44 STEP 1106 H= 276:30 +CPU= 17.490
  02:08:04 STEP 1107 H= 276:45 +CPU= 19.758
  02:08:23 STEP 1108 H= 277:00 +CPU= 19.287
  02:08:44 STEP 1109 H= 277:15 +CPU= 20.506
  02:09:03 STEP 1110 H= 277:30 +CPU= 19.296
  02:09:25 STEP 1111 H= 277:45 +CPU= 21.187
  02:09:46 STEP 1112 H= 278:00 +CPU= 21.697
  02:10:07 STEP 1113 H= 278:15 +CPU= 20.841
  02:10:25 STEP 1114 H= 278:30 +CPU= 17.995
  02:10:44 STEP 1115 H= 278:45 +CPU= 18.569
  02:11:09 STEP 1116 H= 279:00 +CPU= 24.851
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+001116
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+001116
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+001116
  02:11:29 STEP 1117 H= 279:15 +CPU= 19.550
  02:11:48 STEP 1118 H= 279:30 +CPU= 19.114
  02:12:06 STEP 1119 H= 279:45 +CPU= 17.494
  02:12:26 STEP 1120 H= 280:00 +CPU= 19.531
  02:12:44 STEP 1121 H= 280:15 +CPU= 18.256
  02:13:02 STEP 1122 H= 280:30 +CPU= 17.933
  02:13:22 STEP 1123 H= 280:45 +CPU= 19.686
  02:13:40 STEP 1124 H= 281:00 +CPU= 18.123
  02:13:58 STEP 1125 H= 281:15 +CPU= 17.518
  02:14:15 STEP 1126 H= 281:30 +CPU= 17.269
  02:14:33 STEP 1127 H= 281:45 +CPU= 17.266
  02:14:55 STEP 1128 H= 282:00 +CPU= 21.882
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+001128
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+001128
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+001128
  02:15:12 STEP 1129 H= 282:15 +CPU= 17.105
  02:15:30 STEP 1130 H= 282:30 +CPU= 17.565
  02:15:47 STEP 1131 H= 282:45 +CPU= 16.980
  02:16:03 STEP 1132 H= 283:00 +CPU= 16.354
  02:16:21 STEP 1133 H= 283:15 +CPU= 17.482
  02:16:38 STEP 1134 H= 283:30 +CPU= 16.941
  02:16:55 STEP 1135 H= 283:45 +CPU= 17.052
  02:17:14 STEP 1136 H= 284:00 +CPU= 18.614
  02:17:32 STEP 1137 H= 284:15 +CPU= 18.247
  02:17:51 STEP 1138 H= 284:30 +CPU= 18.526
  02:18:08 STEP 1139 H= 284:45 +CPU= 17.200
  02:18:31 STEP 1140 H= 285:00 +CPU= 22.474
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+001140
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+001140
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+001140
  02:18:49 STEP 1141 H= 285:15 +CPU= 18.015
  02:19:07 STEP 1142 H= 285:30 +CPU= 17.838
  02:19:26 STEP 1143 H= 285:45 +CPU= 18.315
  02:19:45 STEP 1144 H= 286:00 +CPU= 19.558
  02:20:04 STEP 1145 H= 286:15 +CPU= 18.656
  02:20:24 STEP 1146 H= 286:30 +CPU= 19.438
  02:20:43 STEP 1147 H= 286:45 +CPU= 18.669
  02:21:02 STEP 1148 H= 287:00 +CPU= 18.657
  02:21:20 STEP 1149 H= 287:15 +CPU= 18.638
  02:21:40 STEP 1150 H= 287:30 +CPU= 19.316
  02:21:59 STEP 1151 H= 287:45 +CPU= 18.803
  02:22:25 STEP 1152 H= 288:00 +CPU= 25.322
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+001140
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a2hr_2016092300_20_1017_12285058_0_r720526872_11.zip
Uploading the intermediate file: upload_file_11.zip
  02:22:43 STEP 1153 H= 288:15 +CPU= 18.451
  02:23:01 STEP 1154 H= 288:30 +CPU= 17.750
  02:23:20 STEP 1155 H= 288:45 +CPU= 18.719
  02:23:40 STEP 1156 H= 289:00 +CPU= 19.759
  02:23:59 STEP 1157 H= 289:15 +CPU= 18.719
  02:24:18 STEP 1158 H= 289:30 +CPU= 19.180
  02:24:37 STEP 1159 H= 289:45 +CPU= 18.591
  02:24:56 STEP 1160 H= 290:00 +CPU= 18.887
  02:25:14 STEP 1161 H= 290:15 +CPU= 17.716
  02:25:32 STEP 1162 H= 290:30 +CPU= 17.985
  02:25:50 STEP 1163 H= 290:45 +CPU= 17.204
  02:26:14 STEP 1164 H= 291:00 +CPU= 23.572
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+001164
  02:26:32 STEP 1165 H= 291:15 +CPU= 18.105
  02:26:50 STEP 1166 H= 291:30 +CPU= 18.000
  02:27:09 STEP 1167 H= 291:45 +CPU= 18.936
  02:27:29 STEP 1168 H= 292:00 +CPU= 19.510
  02:27:48 STEP 1169 H= 292:15 +CPU= 18.575
  02:28:07 STEP 1170 H= 292:30 +CPU= 19.006
  02:28:26 STEP 1171 H= 292:45 +CPU= 19.212
  02:28:45 STEP 1172 H= 293:00 +CPU= 18.210
  02:29:02 STEP 1173 H= 293:15 +CPU= 17.502
  02:29:21 STEP 1174 H= 293:30 +CPU= 18.419
  02:29:39 STEP 1175 H= 293:45 +CPU= 17.726
  02:30:03 STEP 1176 H= 294:00 +CPU= 23.977
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+001176
  02:30:21 STEP 1177 H= 294:15 +CPU= 17.781
  02:30:40 STEP 1178 H= 294:30 +CPU= 19.083
  02:31:00 STEP 1179 H= 294:45 +CPU= 19.811
  02:31:21 STEP 1180 H= 295:00 +CPU= 20.434
  02:31:39 STEP 1181 H= 295:15 +CPU= 18.071
  02:31:59 STEP 1182 H= 295:30 +CPU= 18.658
  02:32:17 STEP 1183 H= 295:45 +CPU= 18.629
  02:32:36 STEP 1184 H= 296:00 +CPU= 18.358
  02:32:54 STEP 1185 H= 296:15 +CPU= 18.060
  02:33:13 STEP 1186 H= 296:30 +CPU= 18.288
  02:33:31 STEP 1187 H= 296:45 +CPU= 18.365
  02:33:55 STEP 1188 H= 297:00 +CPU= 23.751
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+001188
  02:34:13 STEP 1189 H= 297:15 +CPU= 17.856
  02:34:31 STEP 1190 H= 297:30 +CPU= 17.614
  02:34:49 STEP 1191 H= 297:45 +CPU= 18.144
  02:35:07 STEP 1192 H= 298:00 +CPU= 18.078
  02:35:26 STEP 1193 H= 298:15 +CPU= 18.399
  02:35:45 STEP 1194 H= 298:30 +CPU= 18.750
  02:36:03 STEP 1195 H= 298:45 +CPU= 17.841
  02:36:22 STEP 1196 H= 299:00 +CPU= 19.100
  02:36:42 STEP 1197 H= 299:15 +CPU= 19.285
  02:36:58 STEP 1198 H= 299:30 +CPU= 16.363
  02:37:15 STEP 1199 H= 299:45 +CPU= 16.423
  02:37:38 STEP 1200 H= 300:00 +CPU= 23.372
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+001200
  02:37:54 STEP 1201 H= 300:15 +CPU= 15.644
  02:38:10 STEP 1202 H= 300:30 +CPU= 15.988
  02:38:27 STEP 1203 H= 300:45 +CPU= 17.165
  02:38:44 STEP 1204 H= 301:00 +CPU= 17.104
  02:39:01 STEP 1205 H= 301:15 +CPU= 16.074
  02:39:17 STEP 1206 H= 301:30 +CPU= 16.337
  02:39:34 STEP 1207 H= 301:45 +CPU= 17.110
  02:39:52 STEP 1208 H= 302:00 +CPU= 17.475
  02:40:09 STEP 1209 H= 302:15 +CPU= 16.613
  02:40:26 STEP 1210 H= 302:30 +CPU= 17.489
  02:40:43 STEP 1211 H= 302:45 +CPU= 16.699
  02:41:06 STEP 1212 H= 303:00 +CPU= 23.034
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+001212
  02:41:24 STEP 1213 H= 303:15 +CPU= 17.263
  02:41:41 STEP 1214 H= 303:30 +CPU= 16.908
  02:41:59 STEP 1215 H= 303:45 +CPU= 17.546
  02:42:16 STEP 1216 H= 304:00 +CPU= 17.529
  02:42:34 STEP 1217 H= 304:15 +CPU= 17.237
  02:42:50 STEP 1218 H= 304:30 +CPU= 16.548
  02:43:07 STEP 1219 H= 304:45 +CPU= 16.918
  02:43:24 STEP 1220 H= 305:00 +CPU= 16.884
  02:43:41 STEP 1221 H= 305:15 +CPU= 16.640
  02:43:58 STEP 1222 H= 305:30 +CPU= 16.770
  02:44:15 STEP 1223 H= 305:45 +CPU= 16.915
  02:44:37 STEP 1224 H= 306:00 +CPU= 22.003
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+001224
  02:44:54 STEP 1225 H= 306:15 +CPU= 17.092
  02:45:11 STEP 1226 H= 306:30 +CPU= 16.724
  02:45:28 STEP 1227 H= 306:45 +CPU= 16.530
  02:45:46 STEP 1228 H= 307:00 +CPU= 17.844
  02:46:03 STEP 1229 H= 307:15 +CPU= 17.493
  02:46:21 STEP 1230 H= 307:30 +CPU= 17.626
  02:46:39 STEP 1231 H= 307:45 +CPU= 17.539
  02:46:56 STEP 1232 H= 308:00 +CPU= 17.152
  02:47:13 STEP 1233 H= 308:15 +CPU= 17.260
  02:47:31 STEP 1234 H= 308:30 +CPU= 17.124
  02:47:47 STEP 1235 H= 308:45 +CPU= 16.804
  02:48:10 STEP 1236 H= 309:00 +CPU= 22.365
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+001236
  02:48:27 STEP 1237 H= 309:15 +CPU= 17.195
  02:48:44 STEP 1238 H= 309:30 +CPU= 16.773
  02:49:01 STEP 1239 H= 309:45 +CPU= 16.745
  02:49:18 STEP 1240 H= 310:00 +CPU= 17.302
  02:49:36 STEP 1241 H= 310:15 +CPU= 17.169
  02:49:53 STEP 1242 H= 310:30 +CPU= 17.327
  02:50:11 STEP 1243 H= 310:45 +CPU= 17.847
  02:50:29 STEP 1244 H= 311:00 +CPU= 17.524
  02:50:47 STEP 1245 H= 311:15 +CPU= 17.610
  02:51:04 STEP 1246 H= 311:30 +CPU= 17.297
  02:51:21 STEP 1247 H= 311:45 +CPU= 16.499
  02:51:46 STEP 1248 H= 312:00 +CPU= 24.494
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+001236
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a2hr_2016092300_20_1017_12285058_0_r720526872_12.zip
Uploading the intermediate file: upload_file_12.zip
  02:52:04 STEP 1249 H= 312:15 +CPU= 17.851
  02:52:21 STEP 1250 H= 312:30 +CPU= 16.478
  02:52:38 STEP 1251 H= 312:45 +CPU= 17.247
  02:52:56 STEP 1252 H= 313:00 +CPU= 17.667
  02:53:14 STEP 1253 H= 313:15 +CPU= 17.679
  02:53:30 STEP 1254 H= 313:30 +CPU= 16.269
  02:53:47 STEP 1255 H= 313:45 +CPU= 16.623
  02:54:04 STEP 1256 H= 314:00 +CPU= 16.751
  02:54:20 STEP 1257 H= 314:15 +CPU= 15.462
  02:54:35 STEP 1258 H= 314:30 +CPU= 15.888
  02:54:51 STEP 1259 H= 314:45 +CPU= 15.777
  02:55:13 STEP 1260 H= 315:00 +CPU= 20.811
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+001260
  02:55:30 STEP 1261 H= 315:15 +CPU= 17.451
  02:55:48 STEP 1262 H= 315:30 +CPU= 17.428
  02:56:06 STEP 1263 H= 315:45 +CPU= 17.709
  02:56:24 STEP 1264 H= 316:00 +CPU= 17.633
  02:56:40 STEP 1265 H= 316:15 +CPU= 16.666
  02:56:58 STEP 1266 H= 316:30 +CPU= 17.758
  02:57:16 STEP 1267 H= 316:45 +CPU= 17.643
  02:57:34 STEP 1268 H= 317:00 +CPU= 17.466
  02:57:50 STEP 1269 H= 317:15 +CPU= 16.298
  02:58:07 STEP 1270 H= 317:30 +CPU= 16.376
  02:58:23 STEP 1271 H= 317:45 +CPU= 16.640
  02:58:45 STEP 1272 H= 318:00 +CPU= 21.287
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+001272
  02:59:02 STEP 1273 H= 318:15 +CPU= 16.896
  02:59:20 STEP 1274 H= 318:30 +CPU= 17.888
  02:59:37 STEP 1275 H= 318:45 +CPU= 17.453
  02:59:55 STEP 1276 H= 319:00 +CPU= 17.404
  03:00:12 STEP 1277 H= 319:15 +CPU= 16.651
  03:00:29 STEP 1278 H= 319:30 +CPU= 17.639
  03:00:46 STEP 1279 H= 319:45 +CPU= 16.842
  03:01:05 STEP 1280 H= 320:00 +CPU= 17.984
  03:01:22 STEP 1281 H= 320:15 +CPU= 17.102
  03:01:39 STEP 1282 H= 320:30 +CPU= 17.027
  03:01:54 STEP 1283 H= 320:45 +CPU= 15.286
  03:02:15 STEP 1284 H= 321:00 +CPU= 20.267
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+001284
  03:02:31 STEP 1285 H= 321:15 +CPU= 16.720
  03:02:48 STEP 1286 H= 321:30 +CPU= 16.922
  03:03:05 STEP 1287 H= 321:45 +CPU= 17.033
  03:03:23 STEP 1288 H= 322:00 +CPU= 17.005
  03:03:38 STEP 1289 H= 322:15 +CPU= 15.188
  03:03:54 STEP 1290 H= 322:30 +CPU= 16.387
  03:04:11 STEP 1291 H= 322:45 +CPU= 16.501
  03:04:28 STEP 1292 H= 323:00 +CPU= 17.184
  03:04:45 STEP 1293 H= 323:15 +CPU= 16.648
  03:05:02 STEP 1294 H= 323:30 +CPU= 16.836
  03:05:19 STEP 1295 H= 323:45 +CPU= 16.771
  03:05:42 STEP 1296 H= 324:00 +CPU= 22.972
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+001296
  03:05:58 STEP 1297 H= 324:15 +CPU= 16.012
  03:06:14 STEP 1298 H= 324:30 +CPU= 16.411
  03:06:31 STEP 1299 H= 324:45 +CPU= 16.426
  03:06:47 STEP 1300 H= 325:00 +CPU= 16.413
  03:07:04 STEP 1301 H= 325:15 +CPU= 16.318
  03:07:20 STEP 1302 H= 325:30 +CPU= 15.604
  03:07:37 STEP 1303 H= 325:45 +CPU= 16.822
  03:07:53 STEP 1304 H= 326:00 +CPU= 16.551
  03:08:09 STEP 1305 H= 326:15 +CPU= 16.134
  03:08:26 STEP 1306 H= 326:30 +CPU= 16.422
  03:08:42 STEP 1307 H= 326:45 +CPU= 16.376
  03:09:03 STEP 1308 H= 327:00 +CPU= 20.263
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+001308
  03:09:18 STEP 1309 H= 327:15 +CPU= 15.151
  03:09:33 STEP 1310 H= 327:30 +CPU= 15.402
  03:09:49 STEP 1311 H= 327:45 +CPU= 15.414
  03:10:05 STEP 1312 H= 328:00 +CPU= 16.144
  03:10:21 STEP 1313 H= 328:15 +CPU= 16.097
  03:10:38 STEP 1314 H= 328:30 +CPU= 16.522
  03:10:54 STEP 1315 H= 328:45 +CPU= 16.192
  03:11:11 STEP 1316 H= 329:00 +CPU= 16.584
  03:11:27 STEP 1317 H= 329:15 +CPU= 16.155
  03:11:43 STEP 1318 H= 329:30 +CPU= 15.547
  03:11:58 STEP 1319 H= 329:45 +CPU= 15.181
  03:12:19 STEP 1320 H= 330:00 +CPU= 20.694
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+001320
  03:12:35 STEP 1321 H= 330:15 +CPU= 16.015
  03:12:52 STEP 1322 H= 330:30 +CPU= 16.518
  03:13:08 STEP 1323 H= 330:45 +CPU= 16.341
  03:13:25 STEP 1324 H= 331:00 +CPU= 16.719
  03:13:41 STEP 1325 H= 331:15 +CPU= 16.230
  03:13:57 STEP 1326 H= 331:30 +CPU= 15.569
  03:14:13 STEP 1327 H= 331:45 +CPU= 15.828
  03:14:29 STEP 1328 H= 332:00 +CPU= 16.406
  03:14:46 STEP 1329 H= 332:15 +CPU= 16.308
  03:15:03 STEP 1330 H= 332:30 +CPU= 16.559
  03:15:19 STEP 1331 H= 332:45 +CPU= 16.019
  03:15:39 STEP 1332 H= 333:00 +CPU= 20.053
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+001332
  03:15:54 STEP 1333 H= 333:15 +CPU= 15.247
  03:16:10 STEP 1334 H= 333:30 +CPU= 15.834
  03:16:26 STEP 1335 H= 333:45 +CPU= 15.797
  03:16:43 STEP 1336 H= 334:00 +CPU= 16.713
  03:16:59 STEP 1337 H= 334:15 +CPU= 16.193
  03:17:16 STEP 1338 H= 334:30 +CPU= 16.915
  03:17:32 STEP 1339 H= 334:45 +CPU= 16.065
  03:17:49 STEP 1340 H= 335:00 +CPU= 16.790
  03:18:06 STEP 1341 H= 335:15 +CPU= 16.498
  03:18:22 STEP 1342 H= 335:30 +CPU= 16.087
  03:18:39 STEP 1343 H= 335:45 +CPU= 16.985
  03:19:03 STEP 1344 H= 336:00 +CPU= 23.473
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+001332
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a2hr_2016092300_20_1017_12285058_0_r720526872_13.zip
Uploading the intermediate file: upload_file_13.zip
  03:19:20 STEP 1345 H= 336:15 +CPU= 16.482
  03:19:37 STEP 1346 H= 336:30 +CPU= 16.968
  03:19:54 STEP 1347 H= 336:45 +CPU= 16.747
  03:20:11 STEP 1348 H= 337:00 +CPU= 16.781
  03:20:27 STEP 1349 H= 337:15 +CPU= 16.239
  03:20:44 STEP 1350 H= 337:30 +CPU= 16.048
  03:20:59 STEP 1351 H= 337:45 +CPU= 15.546
  03:21:16 STEP 1352 H= 338:00 +CPU= 16.956
  03:21:33 STEP 1353 H= 338:15 +CPU= 16.350
  03:21:49 STEP 1354 H= 338:30 +CPU= 16.021
  03:22:05 STEP 1355 H= 338:45 +CPU= 16.034
  03:22:26 STEP 1356 H= 339:00 +CPU= 21.250
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+001356
  03:22:43 STEP 1357 H= 339:15 +CPU= 16.360
  03:22:59 STEP 1358 H= 339:30 +CPU= 15.859
  03:23:15 STEP 1359 H= 339:45 +CPU= 16.084
  03:23:32 STEP 1360 H= 340:00 +CPU= 16.670
  03:23:48 STEP 1361 H= 340:15 +CPU= 16.028
  03:24:04 STEP 1362 H= 340:30 +CPU= 15.983
  03:24:21 STEP 1363 H= 340:45 +CPU= 16.321
  03:24:38 STEP 1364 H= 341:00 +CPU= 16.798
  03:24:54 STEP 1365 H= 341:15 +CPU= 16.146
  03:25:10 STEP 1366 H= 341:30 +CPU= 16.107
  03:25:26 STEP 1367 H= 341:45 +CPU= 15.763
  03:25:47 STEP 1368 H= 342:00 +CPU= 21.020
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+001368
  03:26:03 STEP 1369 H= 342:15 +CPU= 15.396
  03:26:19 STEP 1370 H= 342:30 +CPU= 16.206
  03:26:35 STEP 1371 H= 342:45 +CPU= 15.706
  03:26:51 STEP 1372 H= 343:00 +CPU= 16.084
  03:27:07 STEP 1373 H= 343:15 +CPU= 15.942
  03:27:23 STEP 1374 H= 343:30 +CPU= 16.021
  03:27:39 STEP 1375 H= 343:45 +CPU= 16.388
  03:27:56 STEP 1376 H= 344:00 +CPU= 16.410
  03:28:12 STEP 1377 H= 344:15 +CPU= 16.246
  03:28:29 STEP 1378 H= 344:30 +CPU= 16.094
  03:28:45 STEP 1379 H= 344:45 +CPU= 16.006
  03:29:05 STEP 1380 H= 345:00 +CPU= 20.296
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+001380
  03:29:22 STEP 1381 H= 345:15 +CPU= 16.502
  03:29:38 STEP 1382 H= 345:30 +CPU= 15.911
  03:29:54 STEP 1383 H= 345:45 +CPU= 16.176
  03:30:11 STEP 1384 H= 346:00 +CPU= 16.894
  03:30:27 STEP 1385 H= 346:15 +CPU= 16.071
  03:30:43 STEP 1386 H= 346:30 +CPU= 16.058
  03:30:59 STEP 1387 H= 346:45 +CPU= 15.858
  03:31:16 STEP 1388 H= 347:00 +CPU= 16.986
  03:31:33 STEP 1389 H= 347:15 +CPU= 16.259
  03:31:49 STEP 1390 H= 347:30 +CPU= 16.113
  03:32:05 STEP 1391 H= 347:45 +CPU= 15.936
  03:32:28 STEP 1392 H= 348:00 +CPU= 23.008
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+001392
  03:32:44 STEP 1393 H= 348:15 +CPU= 16.185
  03:33:01 STEP 1394 H= 348:30 +CPU= 16.223
  03:33:17 STEP 1395 H= 348:45 +CPU= 16.194
  03:33:34 STEP 1396 H= 349:00 +CPU= 16.898
  03:33:51 STEP 1397 H= 349:15 +CPU= 16.439
  03:34:07 STEP 1398 H= 349:30 +CPU= 16.738
  03:34:24 STEP 1399 H= 349:45 +CPU= 16.411
  03:34:41 STEP 1400 H= 350:00 +CPU= 16.932
  03:34:58 STEP 1401 H= 350:15 +CPU= 16.842
  03:35:14 STEP 1402 H= 350:30 +CPU= 16.370
  03:35:31 STEP 1403 H= 350:45 +CPU= 16.383
  03:35:52 STEP 1404 H= 351:00 +CPU= 21.038
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+001404
  03:36:08 STEP 1405 H= 351:15 +CPU= 16.202
  03:36:25 STEP 1406 H= 351:30 +CPU= 16.045
  03:36:41 STEP 1407 H= 351:45 +CPU= 15.839
  03:36:57 STEP 1408 H= 352:00 +CPU= 16.083
  03:37:12 STEP 1409 H= 352:15 +CPU= 15.087
  03:37:28 STEP 1410 H= 352:30 +CPU= 16.344
  03:37:45 STEP 1411 H= 352:45 +CPU= 16.311
  03:38:01 STEP 1412 H= 353:00 +CPU= 16.605
  03:38:18 STEP 1413 H= 353:15 +CPU= 16.364
  03:38:35 STEP 1414 H= 353:30 +CPU= 16.363
  03:38:51 STEP 1415 H= 353:45 +CPU= 16.162
  03:39:12 STEP 1416 H= 354:00 +CPU= 20.911
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+001416
  03:39:28 STEP 1417 H= 354:15 +CPU= 15.834
  03:39:44 STEP 1418 H= 354:30 +CPU= 16.305
  03:40:01 STEP 1419 H= 354:45 +CPU= 16.235
  03:40:18 STEP 1420 H= 355:00 +CPU= 17.067
  03:40:35 STEP 1421 H= 355:15 +CPU= 16.636
  03:40:51 STEP 1422 H= 355:30 +CPU= 16.287
  03:41:07 STEP 1423 H= 355:45 +CPU= 16.148
  03:41:25 STEP 1424 H= 356:00 +CPU= 17.542
  03:41:41 STEP 1425 H= 356:15 +CPU= 16.137
  03:41:57 STEP 1426 H= 356:30 +CPU= 16.199
  03:42:14 STEP 1427 H= 356:45 +CPU= 16.123
  03:42:35 STEP 1428 H= 357:00 +CPU= 21.600
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+001428
  03:42:52 STEP 1429 H= 357:15 +CPU= 16.195
  03:43:09 STEP 1430 H= 357:30 +CPU= 16.750
  03:43:25 STEP 1431 H= 357:45 +CPU= 16.185
  03:43:41 STEP 1432 H= 358:00 +CPU= 16.079
  03:43:57 STEP 1433 H= 358:15 +CPU= 16.223
  03:44:14 STEP 1434 H= 358:30 +CPU= 16.108
  03:44:30 STEP 1435 H= 358:45 +CPU= 15.957
  03:44:47 STEP 1436 H= 359:00 +CPU= 16.778
  03:45:02 STEP 1437 H= 359:15 +CPU= 15.604
  03:45:18 STEP 1438 H= 359:30 +CPU= 15.941
  03:45:35 STEP 1439 H= 359:45 +CPU= 16.253
  03:45:56 STEP 1440 H= 360:00 +CPU= 21.517
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  360.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I      0.1313217962E-20      I       0.2381482883E-05      I
ICloud fractionI      0.0000000000E+00      I       0.2600343518E-01      I
I  Relat. Hum. I      0.2830042507E+00      I       0.3376031024E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.3628501462E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    313811540 BYTES IN      7 RECORDS TRANSFERRED IN    0.0003 SECONDS******** Mbytes/s, TOTAL TIME=    0.0074( 4.1%)
 03:45:56 STEP 1440 H= 360:00 +CPU= 21.517
 END CNT3
 NSTEP =  1440 CNT0   000000000  15.207  15.207  15.318   0.993               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           46/  1069125708 WRITTEN        22880/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    403    0       46      1044068    22880 ************    32.0     3.1    28.9     5.1    59.2
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.95      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                  833    3312.4    3312.4     16.45      0.00
   9 SPCM     - SPECTRAL COMP.                     768     678.2     678.2      3.11      0.00
  10 SCAN2M - PHYSICS                              769   10369.0   10369.0     47.54      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                 64     611.6     611.6      0.23      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 33      42.6      42.6      0.01      0.00
  17 GRIDFPOS IN CNT4                               64      24.2      24.2      0.01      0.00
  27 RESTART FILES - WRITING                        16    2446.2    2446.2      0.23      0.00
  28 RESTART FILES - READING                         1    7396.1    7396.1      0.04      0.00
  29 SU4FPOS IN CNT4                                64       0.0       0.0      0.00      0.00
  30 DYNFPOS IN CNT4                                64    4590.5    4590.5      1.75      0.00
  31 POSDDH IN STEPO                                 4       1.3       1.3      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                    769    4531.5    4531.5     20.78      0.00
  39 SU0YOMB                                         1     393.9     393.9      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                    769      14.9      14.9      0.07      0.00
  54 SPCM     - M TO S/S TO M TRANSP.              768     445.2     445.2      2.04      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.              768      42.4      42.4      0.19      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 33       0.2       0.2      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     1668     312.2     312.2      3.10      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      1600     190.5     190.5      1.82      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       1600      61.0      61.0      0.58      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      1668     101.9     101.9      1.01      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      44.5      44.5      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           1668      31.9      31.9      0.32      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           1600      20.9      20.9      0.20      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           1668      63.5      63.5      0.63      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           1600      32.8      32.8      0.31      0.00
 400 GSTATS                                      89902       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                 83594       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    16772.4 CPU TIME   16418.3 VECTOR TIME    16418.3


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       77.3
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc/slots/6/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc/slots/6/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc/slots/6/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc/slots/6/NODE.001_01
Adding to the zip: /var/lib/boinc/slots/6/ifs.stat
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12285058/ICMUAh7zg+001440
Zipping up the final file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a2hr_2016092300_20_1017_12285058_0_r720526872_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
03:49:24 (45029): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>oifs_43r3_bl_a2hr_2016092300_20_1017_12285058_0_r720526872_15.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a2hr_2016092300_20_1017_12285058_0_r720526872_16.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a2hr_2016092300_20_1017_12285058_0_r720526872_17.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a2hr_2016092300_20_1017_12285058_0_r720526872_18.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a2hr_2016092300_20_1017_12285058_0_r720526872_19.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
11 Jun 2024 02:21:11 1533094 22436650 oifs_43r3_bl_a2hr_2016092300_20_1017_12285058_0 1,295,100 56,966 0.0440


©2024 climateprediction.net