climateprediction.net home page
Task 22311805

Task 22311805

Name oifs_43r3_bl_a3ol_2016092300_15_991_12211560_0
Workunit 12211560
Created 13 Feb 2023, 20:47:45 UTC
Sent 13 Feb 2023, 21:04:35 UTC
Report deadline 14 Apr 2023, 21:04:35 UTC
Received 17 Feb 2023, 3:40:18 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 9 (0x00000009) Unknown error code
Computer ID 1522997
Run time 10 hours 50 min 21 sec
CPU time 10 hours 46 min 44 sec
Validate state Invalid
Credit 1,813.14
Device peak FLOPS 3.95 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.11
x86_64-pc-linux-gnu
Peak working set size 5,618.23 MB
Peak swap size 5,930.79 MB
Peak disk usage 1,358.76 MB
Stderr
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<message>
process exited with code 9 (0x9, -247)</message>
<stderr_txt>
 +CPU= 25.843
  22:53:59 STEP  835 H= 208:45 +CPU= 25.865
  22:54:25 STEP  836 H= 209:00 +CPU= 26.053
  22:54:52 STEP  837 H= 209:15 +CPU= 26.340
  22:55:18 STEP  838 H= 209:30 +CPU= 26.563
  22:55:44 STEP  839 H= 209:45 +CPU= 25.401
  22:56:16 STEP  840 H= 210:00 +CPU= 31.908
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+000840
  22:56:41 STEP  841 H= 210:15 +CPU= 25.757
  22:57:08 STEP  842 H= 210:30 +CPU= 26.581
  22:57:34 STEP  843 H= 210:45 +CPU= 25.722
  22:58:00 STEP  844 H= 211:00 +CPU= 26.007
  22:58:25 STEP  845 H= 211:15 +CPU= 25.436
  22:58:51 STEP  846 H= 211:30 +CPU= 25.471
  22:59:17 STEP  847 H= 211:45 +CPU= 26.246
  22:59:44 STEP  848 H= 212:00 +CPU= 27.460
  23:00:11 STEP  849 H= 212:15 +CPU= 26.834
  23:00:38 STEP  850 H= 212:30 +CPU= 26.450
  23:01:04 STEP  851 H= 212:45 +CPU= 26.309
  23:01:36 STEP  852 H= 213:00 +CPU= 31.808
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+000852
  23:02:02 STEP  853 H= 213:15 +CPU= 26.386
  23:02:28 STEP  854 H= 213:30 +CPU= 26.234
  23:02:55 STEP  855 H= 213:45 +CPU= 26.262
  23:03:22 STEP  856 H= 214:00 +CPU= 26.967
  23:03:48 STEP  857 H= 214:15 +CPU= 26.836
  23:04:15 STEP  858 H= 214:30 +CPU= 26.537
  23:04:40 STEP  859 H= 214:45 +CPU= 25.500
  23:05:07 STEP  860 H= 215:00 +CPU= 26.892
  23:05:34 STEP  861 H= 215:15 +CPU= 26.787
  23:06:01 STEP  862 H= 215:30 +CPU= 26.800
  23:06:27 STEP  863 H= 215:45 +CPU= 25.599
  23:07:02 STEP  864 H= 216:00 +CPU= 35.308
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+000852
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3ol_2016092300_15_991_12211560_0_r401167807_8.zip
Uploading the intermediate file: upload_file_8.zip
  23:07:28 STEP  865 H= 216:15 +CPU= 26.431
  23:07:55 STEP  866 H= 216:30 +CPU= 26.336
  23:08:20 STEP  867 H= 216:45 +CPU= 25.719
  23:08:47 STEP  868 H= 217:00 +CPU= 27.051
  23:09:13 STEP  869 H= 217:15 +CPU= 25.747
  23:09:39 STEP  870 H= 217:30 +CPU= 25.800
  23:10:05 STEP  871 H= 217:45 +CPU= 26.205
  23:10:31 STEP  872 H= 218:00 +CPU= 25.935
  23:10:56 STEP  873 H= 218:15 +CPU= 25.221
  23:11:22 STEP  874 H= 218:30 +CPU= 25.736
  23:11:49 STEP  875 H= 218:45 +CPU= 26.791
  23:12:21 STEP  876 H= 219:00 +CPU= 32.457
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+000876
  23:12:47 STEP  877 H= 219:15 +CPU= 25.896
  23:13:13 STEP  878 H= 219:30 +CPU= 25.727
  23:13:38 STEP  879 H= 219:45 +CPU= 25.397
  23:14:05 STEP  880 H= 220:00 +CPU= 26.726
  23:14:32 STEP  881 H= 220:15 +CPU= 26.720
  23:14:59 STEP  882 H= 220:30 +CPU= 26.988
  23:15:26 STEP  883 H= 220:45 +CPU= 26.918
  23:15:53 STEP  884 H= 221:00 +CPU= 26.937
  23:16:19 STEP  885 H= 221:15 +CPU= 26.898
  23:16:46 STEP  886 H= 221:30 +CPU= 26.941
  23:17:13 STEP  887 H= 221:45 +CPU= 26.633
  23:17:45 STEP  888 H= 222:00 +CPU= 32.280
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+000888
  23:18:11 STEP  889 H= 222:15 +CPU= 25.708
  23:18:37 STEP  890 H= 222:30 +CPU= 26.031
  23:19:03 STEP  891 H= 222:45 +CPU= 25.888
  23:19:29 STEP  892 H= 223:00 +CPU= 26.426
  23:19:56 STEP  893 H= 223:15 +CPU= 26.226
  23:20:22 STEP  894 H= 223:30 +CPU= 26.154
  23:20:48 STEP  895 H= 223:45 +CPU= 26.550
  23:21:16 STEP  896 H= 224:00 +CPU= 27.345
  23:21:42 STEP  897 H= 224:15 +CPU= 26.794
  23:22:09 STEP  898 H= 224:30 +CPU= 26.770
  23:22:35 STEP  899 H= 224:45 +CPU= 25.427
  23:23:06 STEP  900 H= 225:00 +CPU= 31.400
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+000900
  23:23:33 STEP  901 H= 225:15 +CPU= 26.637
  23:24:00 STEP  902 H= 225:30 +CPU= 26.970
  23:24:27 STEP  903 H= 225:45 +CPU= 26.912
  23:24:53 STEP  904 H= 226:00 +CPU= 26.826
  23:25:20 STEP  905 H= 226:15 +CPU= 26.491
  23:25:46 STEP  906 H= 226:30 +CPU= 26.040
  23:26:12 STEP  907 H= 226:45 +CPU= 25.950
  23:26:39 STEP  908 H= 227:00 +CPU= 27.097
  23:27:05 STEP  909 H= 227:15 +CPU= 26.109
  23:27:31 STEP  910 H= 227:30 +CPU= 26.409
  23:27:58 STEP  911 H= 227:45 +CPU= 26.346
  23:28:33 STEP  912 H= 228:00 +CPU= 35.585
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+000912
  23:29:00 STEP  913 H= 228:15 +CPU= 26.449
  23:29:27 STEP  914 H= 228:30 +CPU= 27.050
  23:29:54 STEP  915 H= 228:45 +CPU= 26.733
  23:30:20 STEP  916 H= 229:00 +CPU= 26.431
  23:30:47 STEP  917 H= 229:15 +CPU= 26.577
  23:31:13 STEP  918 H= 229:30 +CPU= 26.772
  23:31:40 STEP  919 H= 229:45 +CPU= 26.865
  23:32:07 STEP  920 H= 230:00 +CPU= 27.006
  23:32:34 STEP  921 H= 230:15 +CPU= 26.506
  23:33:01 STEP  922 H= 230:30 +CPU= 26.880
  23:33:27 STEP  923 H= 230:45 +CPU= 26.510
  23:34:01 STEP  924 H= 231:00 +CPU= 33.520
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+000924
  23:34:27 STEP  925 H= 231:15 +CPU= 26.568
  23:34:54 STEP  926 H= 231:30 +CPU= 26.563
  23:35:21 STEP  927 H= 231:45 +CPU= 26.753
  23:35:47 STEP  928 H= 232:00 +CPU= 26.577
  23:36:13 STEP  929 H= 232:15 +CPU= 25.616
  23:36:38 STEP  930 H= 232:30 +CPU= 25.417
  23:37:04 STEP  931 H= 232:45 +CPU= 25.769
  23:37:31 STEP  932 H= 233:00 +CPU= 26.852
  23:37:56 STEP  933 H= 233:15 +CPU= 25.592
  23:38:23 STEP  934 H= 233:30 +CPU= 26.092
  23:38:49 STEP  935 H= 233:45 +CPU= 26.388
  23:39:22 STEP  936 H= 234:00 +CPU= 32.809
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+000936
  23:39:48 STEP  937 H= 234:15 +CPU= 26.436
  23:40:14 STEP  938 H= 234:30 +CPU= 25.976
  23:40:40 STEP  939 H= 234:45 +CPU= 25.598
  23:41:07 STEP  940 H= 235:00 +CPU= 27.017
  23:41:32 STEP  941 H= 235:15 +CPU= 25.321
  23:41:57 STEP  942 H= 235:30 +CPU= 25.280
  23:42:23 STEP  943 H= 235:45 +CPU= 25.585
  23:42:50 STEP  944 H= 236:00 +CPU= 27.111
  23:43:16 STEP  945 H= 236:15 +CPU= 26.299
  23:43:43 STEP  946 H= 236:30 +CPU= 26.850
  23:44:10 STEP  947 H= 236:45 +CPU= 26.827
  23:44:43 STEP  948 H= 237:00 +CPU= 33.106
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+000948
  23:45:10 STEP  949 H= 237:15 +CPU= 26.401
  23:45:37 STEP  950 H= 237:30 +CPU= 26.970
  23:46:03 STEP  951 H= 237:45 +CPU= 26.978
  23:46:31 STEP  952 H= 238:00 +CPU= 27.503
  23:46:58 STEP  953 H= 238:15 +CPU= 26.611
  23:47:25 STEP  954 H= 238:30 +CPU= 27.113
  23:47:51 STEP  955 H= 238:45 +CPU= 26.271
  23:48:17 STEP  956 H= 239:00 +CPU= 26.132
  23:48:43 STEP  957 H= 239:15 +CPU= 25.664
  23:49:10 STEP  958 H= 239:30 +CPU= 26.848
  23:49:36 STEP  959 H= 239:45 +CPU= 26.538
  23:50:11 STEP  960 H= 240:00 +CPU= 35.299
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+000948
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3ol_2016092300_15_991_12211560_0_r401167807_9.zip
Uploading the intermediate file: upload_file_9.zip
  23:50:37 STEP  961 H= 240:15 +CPU= 25.645
Uploading trickle at timestep: 864000
  23:51:03 STEP  962 H= 240:30 +CPU= 25.700
  23:51:29 STEP  963 H= 240:45 +CPU= 26.463
  23:51:56 STEP  964 H= 241:00 +CPU= 26.847
  23:52:23 STEP  965 H= 241:15 +CPU= 26.783
  23:52:49 STEP  966 H= 241:30 +CPU= 26.370
  23:53:16 STEP  967 H= 241:45 +CPU= 26.648
  23:53:43 STEP  968 H= 242:00 +CPU= 26.634
  23:54:08 STEP  969 H= 242:15 +CPU= 25.642
  23:54:34 STEP  970 H= 242:30 +CPU= 25.692
  23:55:00 STEP  971 H= 242:45 +CPU= 25.860
  23:55:31 STEP  972 H= 243:00 +CPU= 31.688
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+000972
  23:55:58 STEP  973 H= 243:15 +CPU= 26.305
  23:56:24 STEP  974 H= 243:30 +CPU= 25.909
  23:56:49 STEP  975 H= 243:45 +CPU= 25.711
  23:57:16 STEP  976 H= 244:00 +CPU= 26.309
  23:57:41 STEP  977 H= 244:15 +CPU= 25.760
  23:58:07 STEP  978 H= 244:30 +CPU= 25.435
  23:58:32 STEP  979 H= 244:45 +CPU= 25.468
  23:58:59 STEP  980 H= 245:00 +CPU= 26.639
  23:59:26 STEP  981 H= 245:15 +CPU= 26.507
  23:59:51 STEP  982 H= 245:30 +CPU= 25.282
  00:00:16 STEP  983 H= 245:45 +CPU= 25.360
  00:00:47 STEP  984 H= 246:00 +CPU= 31.242
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+000984
  00:01:14 STEP  985 H= 246:15 +CPU= 26.683
  00:01:40 STEP  986 H= 246:30 +CPU= 26.420
  00:02:06 STEP  987 H= 246:45 +CPU= 25.771
  00:02:32 STEP  988 H= 247:00 +CPU= 25.748
  00:02:59 STEP  989 H= 247:15 +CPU= 26.556
  00:03:25 STEP  990 H= 247:30 +CPU= 26.159
  00:03:51 STEP  991 H= 247:45 +CPU= 26.691
  00:04:18 STEP  992 H= 248:00 +CPU= 26.073
  00:04:43 STEP  993 H= 248:15 +CPU= 25.889
  00:05:10 STEP  994 H= 248:30 +CPU= 26.406
  00:05:35 STEP  995 H= 248:45 +CPU= 25.381
  00:06:07 STEP  996 H= 249:00 +CPU= 31.418
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+000996
  00:06:32 STEP  997 H= 249:15 +CPU= 25.220
  00:06:57 STEP  998 H= 249:30 +CPU= 25.372
  00:07:23 STEP  999 H= 249:45 +CPU= 25.705
  00:07:49 STEP 1000 H= 250:00 +CPU= 26.571
  00:08:15 STEP 1001 H= 250:15 +CPU= 25.830
  00:08:41 STEP 1002 H= 250:30 +CPU= 26.176
  00:09:07 STEP 1003 H= 250:45 +CPU= 25.853
  00:09:34 STEP 1004 H= 251:00 +CPU= 26.717
  00:10:01 STEP 1005 H= 251:15 +CPU= 26.480
  00:10:26 STEP 1006 H= 251:30 +CPU= 25.205
  00:10:51 STEP 1007 H= 251:45 +CPU= 24.800
  00:11:25 STEP 1008 H= 252:00 +CPU= 34.214
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001008
  00:11:50 STEP 1009 H= 252:15 +CPU= 25.097
  00:12:15 STEP 1010 H= 252:30 +CPU= 25.158
  00:12:40 STEP 1011 H= 252:45 +CPU= 24.992
  00:13:06 STEP 1012 H= 253:00 +CPU= 25.536
  00:13:31 STEP 1013 H= 253:15 +CPU= 25.067
  00:13:57 STEP 1014 H= 253:30 +CPU= 26.310
  00:14:24 STEP 1015 H= 253:45 +CPU= 26.969
  00:14:51 STEP 1016 H= 254:00 +CPU= 26.655
  00:15:16 STEP 1017 H= 254:15 +CPU= 25.479
  00:15:42 STEP 1018 H= 254:30 +CPU= 26.063
  00:16:09 STEP 1019 H= 254:45 +CPU= 26.941
  00:16:41 STEP 1020 H= 255:00 +CPU= 31.684
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001020
  00:17:07 STEP 1021 H= 255:15 +CPU= 25.964
  00:17:32 STEP 1022 H= 255:30 +CPU= 25.591
  00:17:58 STEP 1023 H= 255:45 +CPU= 25.393
  00:18:24 STEP 1024 H= 256:00 +CPU= 25.912
  00:18:49 STEP 1025 H= 256:15 +CPU= 25.722
  00:19:15 STEP 1026 H= 256:30 +CPU= 25.404
  00:19:42 STEP 1027 H= 256:45 +CPU= 26.900
  00:20:09 STEP 1028 H= 257:00 +CPU= 27.491
  00:20:35 STEP 1029 H= 257:15 +CPU= 26.016
  00:21:02 STEP 1030 H= 257:30 +CPU= 26.926
  00:21:29 STEP 1031 H= 257:45 +CPU= 26.789
  00:22:00 STEP 1032 H= 258:00 +CPU= 31.447
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001032
  00:22:26 STEP 1033 H= 258:15 +CPU= 26.198
  00:22:52 STEP 1034 H= 258:30 +CPU= 25.895
  00:23:18 STEP 1035 H= 258:45 +CPU= 25.360
  00:23:44 STEP 1036 H= 259:00 +CPU= 26.564
  00:24:11 STEP 1037 H= 259:15 +CPU= 26.876
  00:24:37 STEP 1038 H= 259:30 +CPU= 26.291
  00:25:04 STEP 1039 H= 259:45 +CPU= 27.003
  00:25:32 STEP 1040 H= 260:00 +CPU= 27.097
  00:25:58 STEP 1041 H= 260:15 +CPU= 26.290
  00:26:25 STEP 1042 H= 260:30 +CPU= 26.810
  00:26:52 STEP 1043 H= 260:45 +CPU= 26.894
  00:27:25 STEP 1044 H= 261:00 +CPU= 33.384
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001044
  00:27:51 STEP 1045 H= 261:15 +CPU= 25.845
  00:28:17 STEP 1046 H= 261:30 +CPU= 26.079
  00:28:44 STEP 1047 H= 261:45 +CPU= 26.802
  00:29:11 STEP 1048 H= 262:00 +CPU= 27.224
  00:29:37 STEP 1049 H= 262:15 +CPU= 26.412
  00:30:04 STEP 1050 H= 262:30 +CPU= 26.849
  00:30:30 STEP 1051 H= 262:45 +CPU= 25.810
  00:30:57 STEP 1052 H= 263:00 +CPU= 26.614
  00:31:23 STEP 1053 H= 263:15 +CPU= 26.203
  00:31:49 STEP 1054 H= 263:30 +CPU= 26.565
  00:32:15 STEP 1055 H= 263:45 +CPU= 25.857
  00:32:51 STEP 1056 H= 264:00 +CPU= 35.892
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+001044
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3ol_2016092300_15_991_12211560_0_r401167807_10.zip
Uploading the intermediate file: upload_file_10.zip
  00:33:18 STEP 1057 H= 264:15 +CPU= 26.567
  00:33:44 STEP 1058 H= 264:30 +CPU= 26.545
  00:34:11 STEP 1059 H= 264:45 +CPU= 26.845
  00:34:38 STEP 1060 H= 265:00 +CPU= 27.409
  00:35:05 STEP 1061 H= 265:15 +CPU= 26.514
  00:35:31 STEP 1062 H= 265:30 +CPU= 25.591
  00:35:56 STEP 1063 H= 265:45 +CPU= 25.665
  00:36:23 STEP 1064 H= 266:00 +CPU= 26.848
  00:36:49 STEP 1065 H= 266:15 +CPU= 26.260
  00:37:16 STEP 1066 H= 266:30 +CPU= 26.239
  00:37:42 STEP 1067 H= 266:45 +CPU= 26.672
  00:38:15 STEP 1068 H= 267:00 +CPU= 32.876
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001068
  00:38:42 STEP 1069 H= 267:15 +CPU= 26.745
  00:39:09 STEP 1070 H= 267:30 +CPU= 27.081
  00:39:35 STEP 1071 H= 267:45 +CPU= 26.514
  00:40:02 STEP 1072 H= 268:00 +CPU= 26.759
  00:40:28 STEP 1073 H= 268:15 +CPU= 25.485
  00:40:53 STEP 1074 H= 268:30 +CPU= 25.284
  00:41:18 STEP 1075 H= 268:45 +CPU= 25.397
  00:41:45 STEP 1076 H= 269:00 +CPU= 26.208
  00:42:11 STEP 1077 H= 269:15 +CPU= 26.820
  00:42:38 STEP 1078 H= 269:30 +CPU= 26.915
  00:43:05 STEP 1079 H= 269:45 +CPU= 27.019
  00:43:37 STEP 1080 H= 270:00 +CPU= 31.832
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001080
  00:44:04 STEP 1081 H= 270:15 +CPU= 26.462
  00:44:31 STEP 1082 H= 270:30 +CPU= 26.912
  00:44:57 STEP 1083 H= 270:45 +CPU= 26.898
  00:45:24 STEP 1084 H= 271:00 +CPU= 26.273
  00:45:49 STEP 1085 H= 271:15 +CPU= 25.516
  00:46:15 STEP 1086 H= 271:30 +CPU= 25.658
  00:46:41 STEP 1087 H= 271:45 +CPU= 25.851
  00:47:07 STEP 1088 H= 272:00 +CPU= 26.326
  00:47:33 STEP 1089 H= 272:15 +CPU= 25.776
  00:47:59 STEP 1090 H= 272:30 +CPU= 25.633
  00:48:25 STEP 1091 H= 272:45 +CPU= 26.612
  00:48:58 STEP 1092 H= 273:00 +CPU= 33.129
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001092
  00:49:25 STEP 1093 H= 273:15 +CPU= 27.075
  00:49:52 STEP 1094 H= 273:30 +CPU= 26.345
  00:50:19 STEP 1095 H= 273:45 +CPU= 26.935
  00:50:46 STEP 1096 H= 274:00 +CPU= 27.682
  00:51:13 STEP 1097 H= 274:15 +CPU= 27.030
  00:51:40 STEP 1098 H= 274:30 +CPU= 26.821
  00:52:06 STEP 1099 H= 274:45 +CPU= 26.035
  00:52:33 STEP 1100 H= 275:00 +CPU= 27.200
  00:53:00 STEP 1101 H= 275:15 +CPU= 26.242
  00:53:26 STEP 1102 H= 275:30 +CPU= 26.195
  00:53:52 STEP 1103 H= 275:45 +CPU= 26.509
  00:54:29 STEP 1104 H= 276:00 +CPU= 36.320
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001104
  00:54:56 STEP 1105 H= 276:15 +CPU= 26.834
  00:55:22 STEP 1106 H= 276:30 +CPU= 26.633
  00:55:49 STEP 1107 H= 276:45 +CPU= 26.524
  00:56:16 STEP 1108 H= 277:00 +CPU= 27.354
  00:56:43 STEP 1109 H= 277:15 +CPU= 26.875
  00:57:10 STEP 1110 H= 277:30 +CPU= 26.895
  00:57:36 STEP 1111 H= 277:45 +CPU= 26.081
  00:58:03 STEP 1112 H= 278:00 +CPU= 27.407
  00:58:30 STEP 1113 H= 278:15 +CPU= 26.726
  00:58:56 STEP 1114 H= 278:30 +CPU= 26.432
  00:59:23 STEP 1115 H= 278:45 +CPU= 27.041
  00:59:57 STEP 1116 H= 279:00 +CPU= 33.329
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001116
  01:00:23 STEP 1117 H= 279:15 +CPU= 26.440
  01:00:50 STEP 1118 H= 279:30 +CPU= 26.539
  01:01:17 STEP 1119 H= 279:45 +CPU= 27.031
  01:01:44 STEP 1120 H= 280:00 +CPU= 27.556
  01:02:11 STEP 1121 H= 280:15 +CPU= 26.429
  01:02:36 STEP 1122 H= 280:30 +CPU= 25.547
  01:03:02 STEP 1123 H= 280:45 +CPU= 25.984
  01:03:29 STEP 1124 H= 281:00 +CPU= 26.417
  01:03:54 STEP 1125 H= 281:15 +CPU= 25.520
  01:04:21 STEP 1126 H= 281:30 +CPU= 26.452
  01:04:47 STEP 1127 H= 281:45 +CPU= 26.751
  01:05:20 STEP 1128 H= 282:00 +CPU= 32.196
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001128
  01:05:46 STEP 1129 H= 282:15 +CPU= 26.642
  01:06:12 STEP 1130 H= 282:30 +CPU= 25.988
  01:06:38 STEP 1131 H= 282:45 +CPU= 25.515
  01:07:04 STEP 1132 H= 283:00 +CPU= 26.028
  01:07:31 STEP 1133 H= 283:15 +CPU= 26.790
  01:07:57 STEP 1134 H= 283:30 +CPU= 26.826
  01:08:24 STEP 1135 H= 283:45 +CPU= 26.969
  01:08:51 STEP 1136 H= 284:00 +CPU= 26.646
  01:09:16 STEP 1137 H= 284:15 +CPU= 25.396
  01:09:42 STEP 1138 H= 284:30 +CPU= 25.587
  01:10:08 STEP 1139 H= 284:45 +CPU= 25.515
  01:10:39 STEP 1140 H= 285:00 +CPU= 31.744
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001140
  01:11:05 STEP 1141 H= 285:15 +CPU= 26.161
  01:11:31 STEP 1142 H= 285:30 +CPU= 25.859
  01:11:57 STEP 1143 H= 285:45 +CPU= 25.874
  01:12:25 STEP 1144 H= 286:00 +CPU= 27.403
  01:12:51 STEP 1145 H= 286:15 +CPU= 26.808
  01:13:18 STEP 1146 H= 286:30 +CPU= 26.286
  01:13:45 STEP 1147 H= 286:45 +CPU= 27.095
  01:14:12 STEP 1148 H= 287:00 +CPU= 27.531
  01:14:39 STEP 1149 H= 287:15 +CPU= 26.667
  01:15:06 STEP 1150 H= 287:30 +CPU= 26.551
  01:15:32 STEP 1151 H= 287:45 +CPU= 26.538
  01:16:08 STEP 1152 H= 288:00 +CPU= 35.830
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+001140
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3ol_2016092300_15_991_12211560_0_r401167807_11.zip
Uploading the intermediate file: upload_file_11.zip
  01:16:35 STEP 1153 H= 288:15 +CPU= 26.776
  01:17:01 STEP 1154 H= 288:30 +CPU= 26.779
  01:17:28 STEP 1155 H= 288:45 +CPU= 26.431
  01:17:55 STEP 1156 H= 289:00 +CPU= 27.514
  01:18:22 STEP 1157 H= 289:15 +CPU= 26.562
  01:18:48 STEP 1158 H= 289:30 +CPU= 25.760
  01:19:15 STEP 1159 H= 289:45 +CPU= 26.841
  01:19:41 STEP 1160 H= 290:00 +CPU= 26.772
  01:20:07 STEP 1161 H= 290:15 +CPU= 25.572
  01:20:33 STEP 1162 H= 290:30 +CPU= 25.618
  01:20:59 STEP 1163 H= 290:45 +CPU= 26.620
  01:21:32 STEP 1164 H= 291:00 +CPU= 32.851
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001164
  01:21:59 STEP 1165 H= 291:15 +CPU= 26.567
  01:22:25 STEP 1166 H= 291:30 +CPU= 26.716
  01:22:51 STEP 1167 H= 291:45 +CPU= 25.503
  01:23:18 STEP 1168 H= 292:00 +CPU= 27.551
  01:23:45 STEP 1169 H= 292:15 +CPU= 26.254
  01:24:10 STEP 1170 H= 292:30 +CPU= 25.547
  01:24:36 STEP 1171 H= 292:45 +CPU= 25.511
  01:25:02 STEP 1172 H= 293:00 +CPU= 25.904
  01:25:27 STEP 1173 H= 293:15 +CPU= 25.753
  01:25:53 STEP 1174 H= 293:30 +CPU= 25.447
  01:26:18 STEP 1175 H= 293:45 +CPU= 25.576
  01:26:50 STEP 1176 H= 294:00 +CPU= 31.743
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001176
  01:27:16 STEP 1177 H= 294:15 +CPU= 25.693
  01:27:41 STEP 1178 H= 294:30 +CPU= 25.523
  01:28:07 STEP 1179 H= 294:45 +CPU= 25.761
  01:28:34 STEP 1180 H= 295:00 +CPU= 26.824
  01:29:00 STEP 1181 H= 295:15 +CPU= 25.606
  01:29:26 STEP 1182 H= 295:30 +CPU= 26.489
  01:29:53 STEP 1183 H= 295:45 +CPU= 27.069
  01:30:20 STEP 1184 H= 296:00 +CPU= 27.168
  01:30:47 STEP 1185 H= 296:15 +CPU= 26.262
  01:31:13 STEP 1186 H= 296:30 +CPU= 26.539
  01:31:39 STEP 1187 H= 296:45 +CPU= 26.323
  01:32:12 STEP 1188 H= 297:00 +CPU= 33.058
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001188
  01:32:39 STEP 1189 H= 297:15 +CPU= 26.892
  01:33:06 STEP 1190 H= 297:30 +CPU= 26.866
  01:33:33 STEP 1191 H= 297:45 +CPU= 26.663
  01:34:01 STEP 1192 H= 298:00 +CPU= 27.739
  01:34:27 STEP 1193 H= 298:15 +CPU= 26.065
  01:34:54 STEP 1194 H= 298:30 +CPU= 27.007
  01:35:20 STEP 1195 H= 298:45 +CPU= 26.689
  01:35:47 STEP 1196 H= 299:00 +CPU= 26.469
  01:36:13 STEP 1197 H= 299:15 +CPU= 25.836
  01:36:38 STEP 1198 H= 299:30 +CPU= 25.707
  01:37:04 STEP 1199 H= 299:45 +CPU= 25.315
  01:37:38 STEP 1200 H= 300:00 +CPU= 34.641
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001200
  01:38:04 STEP 1201 H= 300:15 +CPU= 25.568
  01:38:29 STEP 1202 H= 300:30 +CPU= 25.345
  01:38:55 STEP 1203 H= 300:45 +CPU= 25.339
  01:39:20 STEP 1204 H= 301:00 +CPU= 25.625
  01:39:45 STEP 1205 H= 301:15 +CPU= 25.078
  01:40:10 STEP 1206 H= 301:30 +CPU= 25.071
  01:40:35 STEP 1207 H= 301:45 +CPU= 24.950
  01:41:01 STEP 1208 H= 302:00 +CPU= 25.624
  01:41:26 STEP 1209 H= 302:15 +CPU= 25.109
  01:41:51 STEP 1210 H= 302:30 +CPU= 25.022
  01:42:16 STEP 1211 H= 302:45 +CPU= 25.221
  01:42:48 STEP 1212 H= 303:00 +CPU= 31.249
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001212
  01:43:13 STEP 1213 H= 303:15 +CPU= 25.380
  01:43:38 STEP 1214 H= 303:30 +CPU= 25.322
  01:44:03 STEP 1215 H= 303:45 +CPU= 25.082
  01:44:30 STEP 1216 H= 304:00 +CPU= 26.732
  01:44:56 STEP 1217 H= 304:15 +CPU= 25.662
  01:45:22 STEP 1218 H= 304:30 +CPU= 25.886
  01:45:47 STEP 1219 H= 304:45 +CPU= 25.594
  01:46:13 STEP 1220 H= 305:00 +CPU= 26.061
  01:46:39 STEP 1221 H= 305:15 +CPU= 26.238
  01:47:06 STEP 1222 H= 305:30 +CPU= 26.506
  01:47:32 STEP 1223 H= 305:45 +CPU= 25.894
  01:48:04 STEP 1224 H= 306:00 +CPU= 31.655
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001224
  01:48:30 STEP 1225 H= 306:15 +CPU= 25.950
  01:48:55 STEP 1226 H= 306:30 +CPU= 25.869
  01:49:22 STEP 1227 H= 306:45 +CPU= 26.572
  01:49:49 STEP 1228 H= 307:00 +CPU= 27.405
  01:50:17 STEP 1229 H= 307:15 +CPU= 27.293
  01:50:43 STEP 1230 H= 307:30 +CPU= 26.540
  01:51:09 STEP 1231 H= 307:45 +CPU= 25.981
  01:51:35 STEP 1232 H= 308:00 +CPU= 26.227
  01:52:02 STEP 1233 H= 308:15 +CPU= 26.872
  01:52:29 STEP 1234 H= 308:30 +CPU= 26.933
  01:52:56 STEP 1235 H= 308:45 +CPU= 26.826
  01:53:29 STEP 1236 H= 309:00 +CPU= 32.768
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001236
  01:53:55 STEP 1237 H= 309:15 +CPU= 26.051
  01:54:21 STEP 1238 H= 309:30 +CPU= 25.986
  01:54:47 STEP 1239 H= 309:45 +CPU= 25.860
  01:55:14 STEP 1240 H= 310:00 +CPU= 27.324
  01:55:41 STEP 1241 H= 310:15 +CPU= 27.103
  01:56:08 STEP 1242 H= 310:30 +CPU= 26.684
  01:56:34 STEP 1243 H= 310:45 +CPU= 26.245
  01:57:01 STEP 1244 H= 311:00 +CPU= 27.089
  01:57:28 STEP 1245 H= 311:15 +CPU= 26.946
  01:57:55 STEP 1246 H= 311:30 +CPU= 26.877
  01:58:22 STEP 1247 H= 311:45 +CPU= 27.149
  01:58:58 STEP 1248 H= 312:00 +CPU= 35.749
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+001236
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3ol_2016092300_15_991_12211560_0_r401167807_12.zip
Uploading the intermediate file: upload_file_12.zip
  01:59:24 STEP 1249 H= 312:15 +CPU= 26.550
  01:59:51 STEP 1250 H= 312:30 +CPU= 26.883
  02:00:17 STEP 1251 H= 312:45 +CPU= 25.286
  02:00:43 STEP 1252 H= 313:00 +CPU= 26.694
  02:01:09 STEP 1253 H= 313:15 +CPU= 25.648
  02:01:35 STEP 1254 H= 313:30 +CPU= 26.417
  02:02:02 STEP 1255 H= 313:45 +CPU= 26.710
  02:02:30 STEP 1256 H= 314:00 +CPU= 27.553
  02:02:56 STEP 1257 H= 314:15 +CPU= 26.702
  02:03:23 STEP 1258 H= 314:30 +CPU= 26.868
  02:03:50 STEP 1259 H= 314:45 +CPU= 26.891
  02:04:23 STEP 1260 H= 315:00 +CPU= 33.101
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001260
  02:04:50 STEP 1261 H= 315:15 +CPU= 26.404
  02:05:16 STEP 1262 H= 315:30 +CPU= 26.126
  02:05:42 STEP 1263 H= 315:45 +CPU= 26.207
  02:06:09 STEP 1264 H= 316:00 +CPU= 26.942
  02:06:35 STEP 1265 H= 316:15 +CPU= 26.081
  02:07:02 STEP 1266 H= 316:30 +CPU= 26.957
  02:07:29 STEP 1267 H= 316:45 +CPU= 26.939
  02:07:55 STEP 1268 H= 317:00 +CPU= 26.084
  02:08:20 STEP 1269 H= 317:15 +CPU= 25.286
  02:08:46 STEP 1270 H= 317:30 +CPU= 25.673
  02:09:12 STEP 1271 H= 317:45 +CPU= 25.950
  02:09:45 STEP 1272 H= 318:00 +CPU= 33.530
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001272
  02:10:12 STEP 1273 H= 318:15 +CPU= 26.758
  02:10:38 STEP 1274 H= 318:30 +CPU= 26.250
  02:11:05 STEP 1275 H= 318:45 +CPU= 27.026
  02:11:33 STEP 1276 H= 319:00 +CPU= 27.549
  02:11:59 STEP 1277 H= 319:15 +CPU= 26.284
  02:12:25 STEP 1278 H= 319:30 +CPU= 25.628
  02:12:51 STEP 1279 H= 319:45 +CPU= 25.660
  02:13:18 STEP 1280 H= 320:00 +CPU= 27.126
  02:13:44 STEP 1281 H= 320:15 +CPU= 26.799
  02:14:11 STEP 1282 H= 320:30 +CPU= 26.884
  02:14:38 STEP 1283 H= 320:45 +CPU= 27.025
  02:15:10 STEP 1284 H= 321:00 +CPU= 32.046
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001284
  02:15:36 STEP 1285 H= 321:15 +CPU= 25.816
  02:16:02 STEP 1286 H= 321:30 +CPU= 25.843
  02:16:29 STEP 1287 H= 321:45 +CPU= 26.882
  02:16:55 STEP 1288 H= 322:00 +CPU= 26.265
  02:17:21 STEP 1289 H= 322:15 +CPU= 25.967
  02:17:47 STEP 1290 H= 322:30 +CPU= 25.798
  02:18:13 STEP 1291 H= 322:45 +CPU= 25.637
  02:18:39 STEP 1292 H= 323:00 +CPU= 25.930
  02:19:04 STEP 1293 H= 323:15 +CPU= 25.172
  02:19:29 STEP 1294 H= 323:30 +CPU= 25.312
  02:19:54 STEP 1295 H= 323:45 +CPU= 25.336
  02:20:28 STEP 1296 H= 324:00 +CPU= 34.056
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001296
  02:20:54 STEP 1297 H= 324:15 +CPU= 25.157
  02:21:19 STEP 1298 H= 324:30 +CPU= 25.303
  02:21:44 STEP 1299 H= 324:45 +CPU= 25.331
  02:22:11 STEP 1300 H= 325:00 +CPU= 26.361
  02:22:37 STEP 1301 H= 325:15 +CPU= 26.660
  02:23:03 STEP 1302 H= 325:30 +CPU= 25.898
  02:23:29 STEP 1303 H= 325:45 +CPU= 25.702
  02:23:56 STEP 1304 H= 326:00 +CPU= 26.688
  02:24:21 STEP 1305 H= 326:15 +CPU= 25.872
  02:24:48 STEP 1306 H= 326:30 +CPU= 26.744
  02:25:15 STEP 1307 H= 326:45 +CPU= 26.485
  02:25:47 STEP 1308 H= 327:00 +CPU= 32.171
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001308
  02:26:14 STEP 1309 H= 327:15 +CPU= 26.791
  02:26:41 STEP 1310 H= 327:30 +CPU= 26.987
  02:27:07 STEP 1311 H= 327:45 +CPU= 26.835
  02:27:35 STEP 1312 H= 328:00 +CPU= 27.725
  02:28:02 STEP 1313 H= 328:15 +CPU= 26.701
  02:28:28 STEP 1314 H= 328:30 +CPU= 26.075
  02:28:54 STEP 1315 H= 328:45 +CPU= 26.153
  02:29:21 STEP 1316 H= 329:00 +CPU= 27.033
  02:29:47 STEP 1317 H= 329:15 +CPU= 25.520
  02:30:12 STEP 1318 H= 329:30 +CPU= 25.746
  02:30:39 STEP 1319 H= 329:45 +CPU= 26.323
  02:31:12 STEP 1320 H= 330:00 +CPU= 32.949
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001320
  02:31:38 STEP 1321 H= 330:15 +CPU= 26.597
  02:32:05 STEP 1322 H= 330:30 +CPU= 26.988
  02:32:32 STEP 1323 H= 330:45 +CPU= 26.886
  02:33:00 STEP 1324 H= 331:00 +CPU= 27.498
  02:33:26 STEP 1325 H= 331:15 +CPU= 25.941
  02:33:52 STEP 1326 H= 331:30 +CPU= 26.676
  02:34:19 STEP 1327 H= 331:45 +CPU= 26.770
  02:34:45 STEP 1328 H= 332:00 +CPU= 26.255
  02:35:11 STEP 1329 H= 332:15 +CPU= 26.016
  02:35:38 STEP 1330 H= 332:30 +CPU= 26.446
  02:36:04 STEP 1331 H= 332:45 +CPU= 26.375
  02:36:37 STEP 1332 H= 333:00 +CPU= 32.554
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001332
  02:37:03 STEP 1333 H= 333:15 +CPU= 26.823
  02:37:30 STEP 1334 H= 333:30 +CPU= 27.005
  02:37:57 STEP 1335 H= 333:45 +CPU= 26.779
  02:38:25 STEP 1336 H= 334:00 +CPU= 27.418
  02:38:51 STEP 1337 H= 334:15 +CPU= 26.749
  02:39:17 STEP 1338 H= 334:30 +CPU= 25.680
  02:39:44 STEP 1339 H= 334:45 +CPU= 26.540
  02:40:11 STEP 1340 H= 335:00 +CPU= 27.526
  02:40:38 STEP 1341 H= 335:15 +CPU= 26.432
  02:41:03 STEP 1342 H= 335:30 +CPU= 25.644
  02:41:30 STEP 1343 H= 335:45 +CPU= 27.099
  02:42:06 STEP 1344 H= 336:00 +CPU= 35.656
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+001332
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3ol_2016092300_15_991_12211560_0_r401167807_13.zip
Uploading the intermediate file: upload_file_13.zip
  02:42:33 STEP 1345 H= 336:15 +CPU= 26.914
  02:43:00 STEP 1346 H= 336:30 +CPU= 26.596
  02:43:26 STEP 1347 H= 336:45 +CPU= 26.852
  02:43:54 STEP 1348 H= 337:00 +CPU= 27.281
  02:44:20 STEP 1349 H= 337:15 +CPU= 26.786
  02:44:46 STEP 1350 H= 337:30 +CPU= 25.652
  02:45:11 STEP 1351 H= 337:45 +CPU= 25.367
  02:45:38 STEP 1352 H= 338:00 +CPU= 26.952
  02:46:05 STEP 1353 H= 338:15 +CPU= 26.857
  02:46:32 STEP 1354 H= 338:30 +CPU= 26.570
  02:46:59 STEP 1355 H= 338:45 +CPU= 26.797
  02:47:32 STEP 1356 H= 339:00 +CPU= 33.476
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001356
  02:47:59 STEP 1357 H= 339:15 +CPU= 26.987
  02:48:26 STEP 1358 H= 339:30 +CPU= 26.668
  02:48:52 STEP 1359 H= 339:45 +CPU= 26.498
  02:49:19 STEP 1360 H= 340:00 +CPU= 27.131
  02:49:46 STEP 1361 H= 340:15 +CPU= 26.982
  02:50:13 STEP 1362 H= 340:30 +CPU= 26.890
  02:50:39 STEP 1363 H= 340:45 +CPU= 25.990
  02:51:05 STEP 1364 H= 341:00 +CPU= 26.054
  02:51:31 STEP 1365 H= 341:15 +CPU= 25.500
  02:51:57 STEP 1366 H= 341:30 +CPU= 25.927
  02:52:23 STEP 1367 H= 341:45 +CPU= 26.156
  02:52:56 STEP 1368 H= 342:00 +CPU= 33.030
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001368
  02:53:23 STEP 1369 H= 342:15 +CPU= 26.739
  02:53:50 STEP 1370 H= 342:30 +CPU= 26.911
  02:54:16 STEP 1371 H= 342:45 +CPU= 26.032
  02:54:43 STEP 1372 H= 343:00 +CPU= 27.355
  02:55:09 STEP 1373 H= 343:15 +CPU= 26.241
  02:55:36 STEP 1374 H= 343:30 +CPU= 26.866
  02:56:03 STEP 1375 H= 343:45 +CPU= 26.499
  02:56:30 STEP 1376 H= 344:00 +CPU= 27.510
  02:56:57 STEP 1377 H= 344:15 +CPU= 26.726
  02:57:23 STEP 1378 H= 344:30 +CPU= 26.098
  02:57:50 STEP 1379 H= 344:45 +CPU= 26.845
  02:58:23 STEP 1380 H= 345:00 +CPU= 33.364
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001380
  02:58:50 STEP 1381 H= 345:15 +CPU= 26.487
  02:59:16 STEP 1382 H= 345:30 +CPU= 26.580
  02:59:43 STEP 1383 H= 345:45 +CPU= 27.152
  03:00:11 STEP 1384 H= 346:00 +CPU= 27.599
  03:00:38 STEP 1385 H= 346:15 +CPU= 26.640
  03:01:05 STEP 1386 H= 346:30 +CPU= 27.059
  03:01:32 STEP 1387 H= 346:45 +CPU= 27.011
  03:01:59 STEP 1388 H= 347:00 +CPU= 27.689
  03:02:26 STEP 1389 H= 347:15 +CPU= 26.566
  03:02:52 STEP 1390 H= 347:30 +CPU= 26.202
  03:03:18 STEP 1391 H= 347:45 +CPU= 26.135
  03:03:55 STEP 1392 H= 348:00 +CPU= 36.474
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001392
  03:04:21 STEP 1393 H= 348:15 +CPU= 26.505
  03:04:48 STEP 1394 H= 348:30 +CPU= 26.525
  03:05:13 STEP 1395 H= 348:45 +CPU= 25.610
  03:05:40 STEP 1396 H= 349:00 +CPU= 26.530
  03:06:06 STEP 1397 H= 349:15 +CPU= 26.460
  03:06:33 STEP 1398 H= 349:30 +CPU= 26.546
  03:07:00 STEP 1399 H= 349:45 +CPU= 26.668
  03:07:27 STEP 1400 H= 350:00 +CPU= 27.160
  03:07:54 STEP 1401 H= 350:15 +CPU= 26.974
  03:08:21 STEP 1402 H= 350:30 +CPU= 26.871
  03:08:47 STEP 1403 H= 350:45 +CPU= 26.206
  03:09:20 STEP 1404 H= 351:00 +CPU= 33.407
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001404
  03:09:46 STEP 1405 H= 351:15 +CPU= 26.197
  03:10:12 STEP 1406 H= 351:30 +CPU= 25.726
  03:10:39 STEP 1407 H= 351:45 +CPU= 27.201
  03:11:07 STEP 1408 H= 352:00 +CPU= 27.587
  03:11:34 STEP 1409 H= 352:15 +CPU= 27.169
  03:12:00 STEP 1410 H= 352:30 +CPU= 26.218
  03:12:27 STEP 1411 H= 352:45 +CPU= 26.873
  03:12:55 STEP 1412 H= 353:00 +CPU= 27.720
  03:13:22 STEP 1413 H= 353:15 +CPU= 26.657
  03:13:47 STEP 1414 H= 353:30 +CPU= 25.759
  03:14:13 STEP 1415 H= 353:45 +CPU= 25.441
  03:14:45 STEP 1416 H= 354:00 +CPU= 32.174
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001416
  03:15:12 STEP 1417 H= 354:15 +CPU= 27.096
  03:15:39 STEP 1418 H= 354:30 +CPU= 26.580
  03:16:06 STEP 1419 H= 354:45 +CPU= 27.065
  03:16:32 STEP 1420 H= 355:00 +CPU= 26.330
  03:16:58 STEP 1421 H= 355:15 +CPU= 25.968
  03:17:24 STEP 1422 H= 355:30 +CPU= 25.729
  03:17:49 STEP 1423 H= 355:45 +CPU= 25.606
  03:18:16 STEP 1424 H= 356:00 +CPU= 26.991
  03:18:43 STEP 1425 H= 356:15 +CPU= 26.954
  03:19:10 STEP 1426 H= 356:30 +CPU= 27.117
  03:19:37 STEP 1427 H= 356:45 +CPU= 26.704
  03:20:09 STEP 1428 H= 357:00 +CPU= 31.608
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001428
  03:20:34 STEP 1429 H= 357:15 +CPU= 25.655
  03:21:01 STEP 1430 H= 357:30 +CPU= 26.890
  03:21:28 STEP 1431 H= 357:45 +CPU= 26.554
  03:21:54 STEP 1432 H= 358:00 +CPU= 26.224
  03:22:20 STEP 1433 H= 358:15 +CPU= 25.600
  03:22:46 STEP 1434 H= 358:30 +CPU= 26.517
  03:23:12 STEP 1435 H= 358:45 +CPU= 26.238
  03:23:39 STEP 1436 H= 359:00 +CPU= 26.481
  03:24:05 STEP 1437 H= 359:15 +CPU= 26.615
  03:24:32 STEP 1438 H= 359:30 +CPU= 27.016
  03:24:59 STEP 1439 H= 359:45 +CPU= 26.820
  03:25:33 STEP 1440 H= 360:00 +CPU= 33.564
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I      0.7242451036E-21      I       0.1117978499E-05      I
ICloud fractionI      0.0000000000E+00      I       0.3282221538E-01      I
I  Relat. Hum. I      0.4089043372E+00      I       0.4464687267E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.2448177977E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    305477921 BYTES IN      7 RECORDS TRANSFERRED IN    0.0005 SECONDS610955.8 Mbytes/s, TOTAL TIME=    0.0114( 4.4%)
 03:25:33 STEP 1440 H= 360:00 +CPU= 33.564
 END CNT3
 NSTEP =  1440 CNT0   000000000  25.297  25.297  25.296   1.000               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ            0/           0 WRITTEN        42886/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    758    0        0            0    42886 ************    61.6     0.0    61.6     0.0   127.3
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.99      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 1562    3741.5    3741.5     15.06      0.00
   9 SPCM     - SPECTRAL COMP.                    1440     885.5     885.5      3.29      0.00
  10 SCAN2M - PHYSICS                             1441   13963.4   13963.4     51.85      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                121     723.2     723.2      0.23      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 63      38.1      38.1      0.01      0.00
  14 SUINIF                                          1    3335.6    3335.6      0.01      0.00
  17 GRIDFPOS IN CNT4                              121      25.5      25.5      0.01      0.00
  18 SUSPECG                                         1    1680.9    1680.9      0.00      0.00
  19 SUSPEC                                          1    1686.6    1686.6      0.00      0.00
  24 SUGRIDU                                         1     975.9     975.9      0.00      0.00
  25 SPECRT                                          1     240.8     240.8      0.00      0.00
  26 SUGRIDF                                         1     432.2     432.2      0.00      0.00
  27 RESTART FILES - WRITING                        30    2916.9    2916.9      0.23      0.00
  28 RESTART FILES - READING                         1       0.0       0.0      0.00      0.00
  29 SU4FPOS IN CNT4                               121       0.0       0.0      0.00      0.00
  30 DYNFPOS IN CNT4                               121    5423.4    5423.4      1.69      0.00
  31 POSDDH IN STEPO                                 7       0.8       0.8      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   1441    4635.2    4635.2     17.21      0.00
  39 SU0YOMB                                         1     297.2     297.2      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   1441      24.1      24.1      0.09      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             1440     464.9     464.9      1.73      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             1440      71.1      71.1      0.26      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 63       0.3       0.3      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     3125     461.1     461.1      3.71      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      3006     243.8     243.8      1.89      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       3006      77.4      77.4      0.60      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      3125     130.0     130.0      1.05      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      39.8      39.8      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           3125      37.7      37.7      0.30      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           3006      21.2      21.2      0.16      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           3125      89.1      89.1      0.72      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           3006      48.8      48.8      0.38      0.00
 400 GSTATS                                     167374       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                155706       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    38805.3 CPU TIME   38804.7 VECTOR TIME    38804.7


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       33.4
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/slots/7/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/7/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211560/ICMUAh7zg+001440
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3ol_2016092300_15_991_12211560_0_r401167807_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
03:29:03 (2264): called boinc_finish(0)
free(): invalid pointer

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:52:01 1522997 22311805 oifs_43r3_bl_a3ol_2016092300_15_991_12211560_0 1,295,100 38,804 0.0300
09 May 2023 16:51:59 1522997 22311805 oifs_43r3_bl_a3ol_2016092300_15_991_12211560_0 864,000 25,891 0.0300


©2024 climateprediction.net