climateprediction.net home page
Task 22437523

Task 22437523

Name oifs_43r3_bl_a35e_2016092300_20_1017_12285909_0
Workunit 12285909
Created 7 Jun 2024, 16:44:46 UTC
Sent 8 Jun 2024, 10:00:49 UTC
Report deadline 7 Aug 2024, 10:00:49 UTC
Received 8 Jun 2024, 23:30:52 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1538875
Run time 12 hours 42 min 35 sec
CPU time 12 hours 36 min 35 sec
Validate state Invalid
Credit 1,976.32
Device peak FLOPS 5.39 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,025.09 MB
Peak swap size 5,980.80 MB
Peak disk usage 1,269.66 MB
Stderr
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<stderr_txt>
 208:30 +CPU= 30.210
  17:42:20 STEP  835 H= 208:45 +CPU= 29.261
  17:42:50 STEP  836 H= 209:00 +CPU= 30.400
  17:43:20 STEP  837 H= 209:15 +CPU= 29.837
  17:43:50 STEP  838 H= 209:30 +CPU= 29.472
  17:44:19 STEP  839 H= 209:45 +CPU= 29.762
  17:44:56 STEP  840 H= 210:00 +CPU= 36.718
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+000840
  17:45:26 STEP  841 H= 210:15 +CPU= 29.499
  17:45:55 STEP  842 H= 210:30 +CPU= 29.481
  17:46:25 STEP  843 H= 210:45 +CPU= 29.398
  17:46:55 STEP  844 H= 211:00 +CPU= 29.958
  17:47:25 STEP  845 H= 211:15 +CPU= 29.464
  17:47:54 STEP  846 H= 211:30 +CPU= 29.801
  17:48:24 STEP  847 H= 211:45 +CPU= 29.584
  17:48:54 STEP  848 H= 212:00 +CPU= 30.171
  17:49:24 STEP  849 H= 212:15 +CPU= 29.400
  17:49:53 STEP  850 H= 212:30 +CPU= 29.425
  17:50:24 STEP  851 H= 212:45 +CPU= 30.006
  17:51:00 STEP  852 H= 213:00 +CPU= 36.695
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+000852
  17:51:30 STEP  853 H= 213:15 +CPU= 29.237
  17:52:00 STEP  854 H= 213:30 +CPU= 30.468
  17:52:30 STEP  855 H= 213:45 +CPU= 29.654
  17:53:02 STEP  856 H= 214:00 +CPU= 31.524
  17:53:32 STEP  857 H= 214:15 +CPU= 29.560
  17:54:02 STEP  858 H= 214:30 +CPU= 30.336
  17:54:33 STEP  859 H= 214:45 +CPU= 30.436
  17:55:03 STEP  860 H= 215:00 +CPU= 30.493
  17:55:33 STEP  861 H= 215:15 +CPU= 29.778
  17:56:03 STEP  862 H= 215:30 +CPU= 30.485
  17:56:36 STEP  863 H= 215:45 +CPU= 32.459
  17:57:19 STEP  864 H= 216:00 +CPU= 42.427
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+000852
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a35e_2016092300_20_1017_12285909_0_r1611392478_8.zip
Uploading the intermediate file: upload_file_8.zip
  17:57:49 STEP  865 H= 216:15 +CPU= 29.683
  17:58:20 STEP  866 H= 216:30 +CPU= 30.318
  17:58:50 STEP  867 H= 216:45 +CPU= 30.677
  17:59:22 STEP  868 H= 217:00 +CPU= 31.133
  17:59:52 STEP  869 H= 217:15 +CPU= 30.324
  18:00:22 STEP  870 H= 217:30 +CPU= 30.268
  18:00:52 STEP  871 H= 217:45 +CPU= 30.063
  18:01:23 STEP  872 H= 218:00 +CPU= 30.954
  18:01:54 STEP  873 H= 218:15 +CPU= 30.617
  18:02:27 STEP  874 H= 218:30 +CPU= 32.926
  18:02:58 STEP  875 H= 218:45 +CPU= 30.681
  18:03:36 STEP  876 H= 219:00 +CPU= 37.442
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+000876
  18:04:06 STEP  877 H= 219:15 +CPU= 29.984
  18:04:37 STEP  878 H= 219:30 +CPU= 31.638
  18:05:08 STEP  879 H= 219:45 +CPU= 30.103
  18:05:41 STEP  880 H= 220:00 +CPU= 33.027
  18:06:11 STEP  881 H= 220:15 +CPU= 29.944
  18:06:41 STEP  882 H= 220:30 +CPU= 29.828
  18:07:12 STEP  883 H= 220:45 +CPU= 31.675
  18:07:44 STEP  884 H= 221:00 +CPU= 31.292
  18:08:14 STEP  885 H= 221:15 +CPU= 30.619
  18:08:45 STEP  886 H= 221:30 +CPU= 30.330
  18:09:15 STEP  887 H= 221:45 +CPU= 30.367
  18:09:54 STEP  888 H= 222:00 +CPU= 39.174
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+000888
  18:10:27 STEP  889 H= 222:15 +CPU= 33.083
  18:11:00 STEP  890 H= 222:30 +CPU= 32.553
  18:11:32 STEP  891 H= 222:45 +CPU= 31.848
  18:12:02 STEP  892 H= 223:00 +CPU= 30.508
  18:12:32 STEP  893 H= 223:15 +CPU= 30.012
  18:13:02 STEP  894 H= 223:30 +CPU= 30.014
  18:13:34 STEP  895 H= 223:45 +CPU= 31.448
  18:14:05 STEP  896 H= 224:00 +CPU= 30.916
  18:14:35 STEP  897 H= 224:15 +CPU= 30.365
  18:15:06 STEP  898 H= 224:30 +CPU= 30.323
  18:15:36 STEP  899 H= 224:45 +CPU= 30.321
  18:16:14 STEP  900 H= 225:00 +CPU= 37.818
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+000900
  18:16:44 STEP  901 H= 225:15 +CPU= 30.024
  18:17:16 STEP  902 H= 225:30 +CPU= 32.101
  18:17:47 STEP  903 H= 225:45 +CPU= 30.240
  18:18:19 STEP  904 H= 226:00 +CPU= 32.484
  18:18:49 STEP  905 H= 226:15 +CPU= 30.002
  18:19:20 STEP  906 H= 226:30 +CPU= 30.183
  18:19:51 STEP  907 H= 226:45 +CPU= 31.648
  18:20:22 STEP  908 H= 227:00 +CPU= 30.596
  18:20:52 STEP  909 H= 227:15 +CPU= 29.859
  18:21:23 STEP  910 H= 227:30 +CPU= 30.876
  18:21:54 STEP  911 H= 227:45 +CPU= 31.198
  18:22:36 STEP  912 H= 228:00 +CPU= 42.382
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+000912
  18:23:07 STEP  913 H= 228:15 +CPU= 30.646
  18:23:38 STEP  914 H= 228:30 +CPU= 30.661
  18:24:09 STEP  915 H= 228:45 +CPU= 30.808
  18:24:41 STEP  916 H= 229:00 +CPU= 31.696
  18:25:13 STEP  917 H= 229:15 +CPU= 31.177
  18:25:44 STEP  918 H= 229:30 +CPU= 31.248
  18:26:14 STEP  919 H= 229:45 +CPU= 30.386
  18:26:45 STEP  920 H= 230:00 +CPU= 30.920
  18:27:17 STEP  921 H= 230:15 +CPU= 31.615
  18:27:47 STEP  922 H= 230:30 +CPU= 30.362
  18:28:21 STEP  923 H= 230:45 +CPU= 33.025
  18:29:01 STEP  924 H= 231:00 +CPU= 40.396
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+000924
  18:29:34 STEP  925 H= 231:15 +CPU= 33.303
  18:30:08 STEP  926 H= 231:30 +CPU= 33.645
  18:30:40 STEP  927 H= 231:45 +CPU= 31.719
  18:31:10 STEP  928 H= 232:00 +CPU= 30.459
  18:31:40 STEP  929 H= 232:15 +CPU= 30.071
  18:32:11 STEP  930 H= 232:30 +CPU= 30.011
  18:32:41 STEP  931 H= 232:45 +CPU= 30.541
  18:33:13 STEP  932 H= 233:00 +CPU= 31.417
  18:33:45 STEP  933 H= 233:15 +CPU= 32.578
  18:34:18 STEP  934 H= 233:30 +CPU= 32.643
  18:34:51 STEP  935 H= 233:45 +CPU= 32.758
  18:35:31 STEP  936 H= 234:00 +CPU= 39.570
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+000936
  18:36:03 STEP  937 H= 234:15 +CPU= 32.055
  18:36:33 STEP  938 H= 234:30 +CPU= 30.388
  18:37:05 STEP  939 H= 234:45 +CPU= 31.468
  18:37:36 STEP  940 H= 235:00 +CPU= 30.886
  18:38:07 STEP  941 H= 235:15 +CPU= 31.225
  18:38:38 STEP  942 H= 235:30 +CPU= 30.268
  18:39:08 STEP  943 H= 235:45 +CPU= 30.239
  18:39:40 STEP  944 H= 236:00 +CPU= 31.559
  18:40:10 STEP  945 H= 236:15 +CPU= 30.636
  18:40:41 STEP  946 H= 236:30 +CPU= 29.920
  18:41:10 STEP  947 H= 236:45 +CPU= 29.272
  18:41:48 STEP  948 H= 237:00 +CPU= 37.193
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+000948
  18:42:17 STEP  949 H= 237:15 +CPU= 29.386
  18:42:47 STEP  950 H= 237:30 +CPU= 29.625
  18:43:16 STEP  951 H= 237:45 +CPU= 29.372
  18:43:46 STEP  952 H= 238:00 +CPU= 30.160
  18:44:17 STEP  953 H= 238:15 +CPU= 30.487
  18:44:48 STEP  954 H= 238:30 +CPU= 30.122
  18:45:18 STEP  955 H= 238:45 +CPU= 29.772
  18:45:48 STEP  956 H= 239:00 +CPU= 29.786
  18:46:17 STEP  957 H= 239:15 +CPU= 29.123
  18:46:46 STEP  958 H= 239:30 +CPU= 29.498
  18:47:17 STEP  959 H= 239:45 +CPU= 30.136
  18:47:57 STEP  960 H= 240:00 +CPU= 40.331
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+000948
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a35e_2016092300_20_1017_12285909_0_r1611392478_9.zip
Uploading the intermediate file: upload_file_9.zip
  18:48:26 STEP  961 H= 240:15 +CPU= 28.908
Uploading trickle at timestep: 864000
  18:48:56 STEP  962 H= 240:30 +CPU= 29.522
  18:49:26 STEP  963 H= 240:45 +CPU= 29.716
  18:49:56 STEP  964 H= 241:00 +CPU= 30.300
  18:50:26 STEP  965 H= 241:15 +CPU= 29.597
  18:50:56 STEP  966 H= 241:30 +CPU= 29.701
  18:51:26 STEP  967 H= 241:45 +CPU= 30.742
  18:51:57 STEP  968 H= 242:00 +CPU= 30.157
  18:52:26 STEP  969 H= 242:15 +CPU= 29.479
  18:52:56 STEP  970 H= 242:30 +CPU= 29.381
  18:53:25 STEP  971 H= 242:45 +CPU= 29.108
  18:54:01 STEP  972 H= 243:00 +CPU= 36.359
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+000972
  18:54:31 STEP  973 H= 243:15 +CPU= 29.625
  18:55:00 STEP  974 H= 243:30 +CPU= 29.217
  18:55:30 STEP  975 H= 243:45 +CPU= 30.056
  18:56:00 STEP  976 H= 244:00 +CPU= 29.619
  18:56:30 STEP  977 H= 244:15 +CPU= 29.431
  18:56:59 STEP  978 H= 244:30 +CPU= 29.113
  18:57:28 STEP  979 H= 244:45 +CPU= 28.819
  18:57:58 STEP  980 H= 245:00 +CPU= 29.919
  18:58:29 STEP  981 H= 245:15 +CPU= 30.224
  18:58:59 STEP  982 H= 245:30 +CPU= 29.665
  18:59:29 STEP  983 H= 245:45 +CPU= 30.420
  19:00:06 STEP  984 H= 246:00 +CPU= 37.148
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+000984
  19:00:36 STEP  985 H= 246:15 +CPU= 29.346
  19:01:05 STEP  986 H= 246:30 +CPU= 29.472
  19:01:35 STEP  987 H= 246:45 +CPU= 29.711
  19:02:05 STEP  988 H= 247:00 +CPU= 29.836
  19:02:35 STEP  989 H= 247:15 +CPU= 29.280
  19:03:04 STEP  990 H= 247:30 +CPU= 29.401
  19:03:34 STEP  991 H= 247:45 +CPU= 29.912
  19:04:06 STEP  992 H= 248:00 +CPU= 31.743
  19:04:35 STEP  993 H= 248:15 +CPU= 29.181
  19:05:04 STEP  994 H= 248:30 +CPU= 29.227
  19:05:36 STEP  995 H= 248:45 +CPU= 31.218
  19:06:13 STEP  996 H= 249:00 +CPU= 37.521
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+000996
  19:06:42 STEP  997 H= 249:15 +CPU= 29.176
  19:07:13 STEP  998 H= 249:30 +CPU= 30.580
  19:07:43 STEP  999 H= 249:45 +CPU= 29.729
  19:08:15 STEP 1000 H= 250:00 +CPU= 31.747
  19:08:44 STEP 1001 H= 250:15 +CPU= 29.467
  19:09:14 STEP 1002 H= 250:30 +CPU= 29.545
  19:09:43 STEP 1003 H= 250:45 +CPU= 29.634
  19:10:14 STEP 1004 H= 251:00 +CPU= 30.191
  19:10:43 STEP 1005 H= 251:15 +CPU= 29.585
  19:11:13 STEP 1006 H= 251:30 +CPU= 29.487
  19:11:42 STEP 1007 H= 251:45 +CPU= 29.660
  19:12:24 STEP 1008 H= 252:00 +CPU= 41.451
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+001008
  19:12:54 STEP 1009 H= 252:15 +CPU= 29.880
  19:13:24 STEP 1010 H= 252:30 +CPU= 29.784
  19:13:54 STEP 1011 H= 252:45 +CPU= 30.066
  19:14:24 STEP 1012 H= 253:00 +CPU= 30.295
  19:14:54 STEP 1013 H= 253:15 +CPU= 29.818
  19:15:26 STEP 1014 H= 253:30 +CPU= 31.348
  19:15:58 STEP 1015 H= 253:45 +CPU= 32.049
  19:16:31 STEP 1016 H= 254:00 +CPU= 32.833
  19:17:03 STEP 1017 H= 254:15 +CPU= 31.991
  19:17:34 STEP 1018 H= 254:30 +CPU= 31.153
  19:18:04 STEP 1019 H= 254:45 +CPU= 29.980
  19:18:44 STEP 1020 H= 255:00 +CPU= 39.386
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+001020
  19:19:15 STEP 1021 H= 255:15 +CPU= 31.356
  19:19:45 STEP 1022 H= 255:30 +CPU= 29.641
  19:20:15 STEP 1023 H= 255:45 +CPU= 29.900
  19:20:47 STEP 1024 H= 256:00 +CPU= 32.493
  19:21:17 STEP 1025 H= 256:15 +CPU= 30.008
  19:21:50 STEP 1026 H= 256:30 +CPU= 32.754
  19:22:20 STEP 1027 H= 256:45 +CPU= 29.814
  19:22:52 STEP 1028 H= 257:00 +CPU= 31.218
  19:23:22 STEP 1029 H= 257:15 +CPU= 30.490
  19:23:53 STEP 1030 H= 257:30 +CPU= 30.602
  19:24:25 STEP 1031 H= 257:45 +CPU= 31.774
  19:25:05 STEP 1032 H= 258:00 +CPU= 39.525
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+001032
  19:25:35 STEP 1033 H= 258:15 +CPU= 30.515
  19:26:06 STEP 1034 H= 258:30 +CPU= 30.801
  19:26:39 STEP 1035 H= 258:45 +CPU= 32.583
  19:27:10 STEP 1036 H= 259:00 +CPU= 31.098
  19:27:41 STEP 1037 H= 259:15 +CPU= 30.920
  19:28:12 STEP 1038 H= 259:30 +CPU= 30.763
  19:28:44 STEP 1039 H= 259:45 +CPU= 32.725
  19:29:18 STEP 1040 H= 260:00 +CPU= 34.005
  19:29:51 STEP 1041 H= 260:15 +CPU= 32.322
  19:30:21 STEP 1042 H= 260:30 +CPU= 30.114
  19:30:51 STEP 1043 H= 260:45 +CPU= 30.003
  19:31:28 STEP 1044 H= 261:00 +CPU= 37.239
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+001044
  19:31:58 STEP 1045 H= 261:15 +CPU= 29.949
  19:32:28 STEP 1046 H= 261:30 +CPU= 29.954
  19:32:59 STEP 1047 H= 261:45 +CPU= 30.254
  19:33:30 STEP 1048 H= 262:00 +CPU= 31.126
  19:34:00 STEP 1049 H= 262:15 +CPU= 29.916
  19:34:29 STEP 1050 H= 262:30 +CPU= 29.864
  19:34:58 STEP 1051 H= 262:45 +CPU= 28.126
  19:35:29 STEP 1052 H= 263:00 +CPU= 31.733
  19:35:59 STEP 1053 H= 263:15 +CPU= 29.831
  19:36:29 STEP 1054 H= 263:30 +CPU= 29.534
  19:36:59 STEP 1055 H= 263:45 +CPU= 30.140
  19:37:39 STEP 1056 H= 264:00 +CPU= 40.111
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+001044
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a35e_2016092300_20_1017_12285909_0_r1611392478_10.zip
Uploading the intermediate file: upload_file_10.zip
  19:38:09 STEP 1057 H= 264:15 +CPU= 29.603
  19:38:37 STEP 1058 H= 264:30 +CPU= 28.646
  19:39:05 STEP 1059 H= 264:45 +CPU= 27.703
  19:39:33 STEP 1060 H= 265:00 +CPU= 27.733
  19:40:00 STEP 1061 H= 265:15 +CPU= 27.098
  19:40:27 STEP 1062 H= 265:30 +CPU= 26.937
  19:40:54 STEP 1063 H= 265:45 +CPU= 27.222
  19:41:21 STEP 1064 H= 266:00 +CPU= 27.353
  19:41:50 STEP 1065 H= 266:15 +CPU= 28.118
  19:42:18 STEP 1066 H= 266:30 +CPU= 28.158
  19:42:47 STEP 1067 H= 266:45 +CPU= 28.252
  19:43:23 STEP 1068 H= 267:00 +CPU= 35.877
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+001068
  19:43:51 STEP 1069 H= 267:15 +CPU= 28.367
  19:44:22 STEP 1070 H= 267:30 +CPU= 30.260
  19:44:52 STEP 1071 H= 267:45 +CPU= 30.185
  19:45:21 STEP 1072 H= 268:00 +CPU= 28.847
  19:45:49 STEP 1073 H= 268:15 +CPU= 28.475
  19:46:17 STEP 1074 H= 268:30 +CPU= 28.148
  19:46:46 STEP 1075 H= 268:45 +CPU= 28.579
  19:47:16 STEP 1076 H= 269:00 +CPU= 29.260
  19:47:44 STEP 1077 H= 269:15 +CPU= 28.260
  19:48:12 STEP 1078 H= 269:30 +CPU= 27.714
  19:48:40 STEP 1079 H= 269:45 +CPU= 28.652
  19:49:15 STEP 1080 H= 270:00 +CPU= 34.850
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+001080
  19:49:43 STEP 1081 H= 270:15 +CPU= 27.356
  19:50:10 STEP 1082 H= 270:30 +CPU= 27.284
  19:50:38 STEP 1083 H= 270:45 +CPU= 27.745
  19:51:07 STEP 1084 H= 271:00 +CPU= 28.290
  19:51:36 STEP 1085 H= 271:15 +CPU= 29.153
  19:52:05 STEP 1086 H= 271:30 +CPU= 28.641
  19:52:33 STEP 1087 H= 271:45 +CPU= 28.212
  19:53:01 STEP 1088 H= 272:00 +CPU= 28.531
  19:53:29 STEP 1089 H= 272:15 +CPU= 27.893
  19:53:57 STEP 1090 H= 272:30 +CPU= 27.943
  19:54:25 STEP 1091 H= 272:45 +CPU= 27.885
  19:55:01 STEP 1092 H= 273:00 +CPU= 35.175
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+001092
  19:55:28 STEP 1093 H= 273:15 +CPU= 27.864
  19:55:56 STEP 1094 H= 273:30 +CPU= 27.435
  19:56:24 STEP 1095 H= 273:45 +CPU= 27.663
  19:56:52 STEP 1096 H= 274:00 +CPU= 28.203
  19:57:19 STEP 1097 H= 274:15 +CPU= 27.465
  19:57:47 STEP 1098 H= 274:30 +CPU= 27.386
  19:58:14 STEP 1099 H= 274:45 +CPU= 27.624
  19:58:44 STEP 1100 H= 275:00 +CPU= 28.622
  19:59:12 STEP 1101 H= 275:15 +CPU= 28.128
  19:59:40 STEP 1102 H= 275:30 +CPU= 28.015
  20:00:08 STEP 1103 H= 275:45 +CPU= 28.015
  20:00:49 STEP 1104 H= 276:00 +CPU= 39.959
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+001104
  20:01:17 STEP 1105 H= 276:15 +CPU= 28.350
  20:01:46 STEP 1106 H= 276:30 +CPU= 28.621
  20:02:14 STEP 1107 H= 276:45 +CPU= 28.481
  20:02:44 STEP 1108 H= 277:00 +CPU= 29.048
  20:03:13 STEP 1109 H= 277:15 +CPU= 28.782
  20:03:40 STEP 1110 H= 277:30 +CPU= 27.821
  20:04:09 STEP 1111 H= 277:45 +CPU= 27.935
  20:04:38 STEP 1112 H= 278:00 +CPU= 29.145
  20:05:06 STEP 1113 H= 278:15 +CPU= 28.056
  20:05:34 STEP 1114 H= 278:30 +CPU= 28.222
  20:06:03 STEP 1115 H= 278:45 +CPU= 28.464
  20:06:41 STEP 1116 H= 279:00 +CPU= 37.330
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+001116
  20:07:10 STEP 1117 H= 279:15 +CPU= 29.687
  20:07:38 STEP 1118 H= 279:30 +CPU= 27.882
  20:08:06 STEP 1119 H= 279:45 +CPU= 27.953
  20:08:35 STEP 1120 H= 280:00 +CPU= 28.799
  20:09:03 STEP 1121 H= 280:15 +CPU= 27.655
  20:09:30 STEP 1122 H= 280:30 +CPU= 27.719
  20:09:58 STEP 1123 H= 280:45 +CPU= 27.652
  20:10:26 STEP 1124 H= 281:00 +CPU= 28.125
  20:10:54 STEP 1125 H= 281:15 +CPU= 27.826
  20:11:23 STEP 1126 H= 281:30 +CPU= 29.193
  20:11:51 STEP 1127 H= 281:45 +CPU= 28.163
  20:12:25 STEP 1128 H= 282:00 +CPU= 33.677
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+001128
  20:12:53 STEP 1129 H= 282:15 +CPU= 27.965
  20:13:21 STEP 1130 H= 282:30 +CPU= 27.525
  20:13:48 STEP 1131 H= 282:45 +CPU= 27.762
  20:14:17 STEP 1132 H= 283:00 +CPU= 28.460
  20:14:45 STEP 1133 H= 283:15 +CPU= 27.757
  20:15:13 STEP 1134 H= 283:30 +CPU= 28.553
  20:15:41 STEP 1135 H= 283:45 +CPU= 28.045
  20:16:09 STEP 1136 H= 284:00 +CPU= 27.882
  20:16:36 STEP 1137 H= 284:15 +CPU= 27.137
  20:17:04 STEP 1138 H= 284:30 +CPU= 27.777
  20:17:32 STEP 1139 H= 284:45 +CPU= 28.184
  20:18:08 STEP 1140 H= 285:00 +CPU= 35.263
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+001140
  20:18:36 STEP 1141 H= 285:15 +CPU= 28.323
  20:19:05 STEP 1142 H= 285:30 +CPU= 28.362
  20:19:33 STEP 1143 H= 285:45 +CPU= 28.038
  20:20:01 STEP 1144 H= 286:00 +CPU= 28.785
  20:20:29 STEP 1145 H= 286:15 +CPU= 28.106
  20:20:58 STEP 1146 H= 286:30 +CPU= 28.118
  20:21:26 STEP 1147 H= 286:45 +CPU= 28.221
  20:21:55 STEP 1148 H= 287:00 +CPU= 29.163
  20:22:23 STEP 1149 H= 287:15 +CPU= 28.135
  20:22:51 STEP 1150 H= 287:30 +CPU= 27.612
  20:23:19 STEP 1151 H= 287:45 +CPU= 27.986
  20:23:59 STEP 1152 H= 288:00 +CPU= 40.176
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+001140
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a35e_2016092300_20_1017_12285909_0_r1611392478_11.zip
Uploading the intermediate file: upload_file_11.zip
  20:24:28 STEP 1153 H= 288:15 +CPU= 28.801
  20:24:57 STEP 1154 H= 288:30 +CPU= 28.785
  20:25:28 STEP 1155 H= 288:45 +CPU= 30.682
  20:25:58 STEP 1156 H= 289:00 +CPU= 29.430
  20:26:27 STEP 1157 H= 289:15 +CPU= 28.818
  20:26:56 STEP 1158 H= 289:30 +CPU= 28.823
  20:27:25 STEP 1159 H= 289:45 +CPU= 29.500
  20:27:55 STEP 1160 H= 290:00 +CPU= 29.703
  20:28:24 STEP 1161 H= 290:15 +CPU= 28.775
  20:28:53 STEP 1162 H= 290:30 +CPU= 28.886
  20:29:22 STEP 1163 H= 290:45 +CPU= 28.776
  20:29:58 STEP 1164 H= 291:00 +CPU= 35.790
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+001164
  20:30:26 STEP 1165 H= 291:15 +CPU= 28.558
  20:30:57 STEP 1166 H= 291:30 +CPU= 30.214
  20:31:25 STEP 1167 H= 291:45 +CPU= 28.825
  20:31:55 STEP 1168 H= 292:00 +CPU= 29.396
  20:32:24 STEP 1169 H= 292:15 +CPU= 28.842
  20:32:53 STEP 1170 H= 292:30 +CPU= 28.900
  20:33:22 STEP 1171 H= 292:45 +CPU= 28.937
  20:33:51 STEP 1172 H= 293:00 +CPU= 29.676
  20:34:21 STEP 1173 H= 293:15 +CPU= 28.910
  20:34:50 STEP 1174 H= 293:30 +CPU= 29.441
  20:35:19 STEP 1175 H= 293:45 +CPU= 28.958
  20:35:56 STEP 1176 H= 294:00 +CPU= 36.422
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+001176
  20:36:25 STEP 1177 H= 294:15 +CPU= 28.988
  20:36:54 STEP 1178 H= 294:30 +CPU= 28.743
  20:37:23 STEP 1179 H= 294:45 +CPU= 28.883
  20:37:52 STEP 1180 H= 295:00 +CPU= 29.475
  20:38:21 STEP 1181 H= 295:15 +CPU= 28.762
  20:38:51 STEP 1182 H= 295:30 +CPU= 30.161
  20:39:21 STEP 1183 H= 295:45 +CPU= 29.482
  20:39:51 STEP 1184 H= 296:00 +CPU= 29.404
  20:40:19 STEP 1185 H= 296:15 +CPU= 28.525
  20:40:48 STEP 1186 H= 296:30 +CPU= 28.395
  20:41:17 STEP 1187 H= 296:45 +CPU= 29.378
  20:41:55 STEP 1188 H= 297:00 +CPU= 37.390
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+001188
  20:42:26 STEP 1189 H= 297:15 +CPU= 30.863
  20:42:54 STEP 1190 H= 297:30 +CPU= 28.712
  20:43:24 STEP 1191 H= 297:45 +CPU= 29.754
  20:43:53 STEP 1192 H= 298:00 +CPU= 29.351
  20:44:22 STEP 1193 H= 298:15 +CPU= 28.338
  20:44:50 STEP 1194 H= 298:30 +CPU= 28.542
  20:45:20 STEP 1195 H= 298:45 +CPU= 28.567
  20:45:49 STEP 1196 H= 299:00 +CPU= 29.123
  20:46:18 STEP 1197 H= 299:15 +CPU= 28.450
  20:46:47 STEP 1198 H= 299:30 +CPU= 29.157
  20:47:16 STEP 1199 H= 299:45 +CPU= 29.427
  20:47:57 STEP 1200 H= 300:00 +CPU= 40.487
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+001200
  20:48:28 STEP 1201 H= 300:15 +CPU= 30.379
  20:48:56 STEP 1202 H= 300:30 +CPU= 28.758
  20:49:25 STEP 1203 H= 300:45 +CPU= 28.637
  20:49:54 STEP 1204 H= 301:00 +CPU= 29.199
  20:50:23 STEP 1205 H= 301:15 +CPU= 28.951
  20:50:53 STEP 1206 H= 301:30 +CPU= 29.487
  20:51:22 STEP 1207 H= 301:45 +CPU= 29.313
  20:51:52 STEP 1208 H= 302:00 +CPU= 29.991
  20:52:21 STEP 1209 H= 302:15 +CPU= 29.217
  20:52:52 STEP 1210 H= 302:30 +CPU= 30.327
  20:53:22 STEP 1211 H= 302:45 +CPU= 29.746
  20:53:59 STEP 1212 H= 303:00 +CPU= 37.134
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+001212
  20:54:26 STEP 1213 H= 303:15 +CPU= 26.907
  20:54:53 STEP 1214 H= 303:30 +CPU= 27.821
  20:55:22 STEP 1215 H= 303:45 +CPU= 28.192
  20:55:51 STEP 1216 H= 304:00 +CPU= 29.065
  20:56:19 STEP 1217 H= 304:15 +CPU= 28.598
  20:56:48 STEP 1218 H= 304:30 +CPU= 28.233
  20:57:16 STEP 1219 H= 304:45 +CPU= 28.668
  20:57:46 STEP 1220 H= 305:00 +CPU= 29.053
  20:58:14 STEP 1221 H= 305:15 +CPU= 28.217
  20:58:42 STEP 1222 H= 305:30 +CPU= 28.160
  20:59:10 STEP 1223 H= 305:45 +CPU= 28.067
  20:59:45 STEP 1224 H= 306:00 +CPU= 34.858
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+001224
  21:00:14 STEP 1225 H= 306:15 +CPU= 28.247
  21:00:42 STEP 1226 H= 306:30 +CPU= 28.071
  21:01:10 STEP 1227 H= 306:45 +CPU= 27.962
  21:01:38 STEP 1228 H= 307:00 +CPU= 28.402
  21:02:06 STEP 1229 H= 307:15 +CPU= 28.158
  21:02:35 STEP 1230 H= 307:30 +CPU= 28.846
  21:03:05 STEP 1231 H= 307:45 +CPU= 29.052
  21:03:34 STEP 1232 H= 308:00 +CPU= 29.071
  21:04:03 STEP 1233 H= 308:15 +CPU= 28.526
  21:04:31 STEP 1234 H= 308:30 +CPU= 28.313
  21:04:59 STEP 1235 H= 308:45 +CPU= 28.456
  21:05:35 STEP 1236 H= 309:00 +CPU= 35.594
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+001236
  21:06:04 STEP 1237 H= 309:15 +CPU= 28.411
  21:06:32 STEP 1238 H= 309:30 +CPU= 28.315
  21:07:00 STEP 1239 H= 309:45 +CPU= 28.174
  21:07:29 STEP 1240 H= 310:00 +CPU= 28.979
  21:07:58 STEP 1241 H= 310:15 +CPU= 28.214
  21:08:26 STEP 1242 H= 310:30 +CPU= 28.126
  21:08:54 STEP 1243 H= 310:45 +CPU= 28.060
  21:09:23 STEP 1244 H= 311:00 +CPU= 28.708
  21:09:51 STEP 1245 H= 311:15 +CPU= 28.148
  21:10:19 STEP 1246 H= 311:30 +CPU= 28.112
  21:10:47 STEP 1247 H= 311:45 +CPU= 28.266
  21:11:27 STEP 1248 H= 312:00 +CPU= 39.679
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+001236
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a35e_2016092300_20_1017_12285909_0_r1611392478_12.zip
Uploading the intermediate file: upload_file_12.zip
  21:11:55 STEP 1249 H= 312:15 +CPU= 27.878
  21:12:24 STEP 1250 H= 312:30 +CPU= 28.466
  21:12:52 STEP 1251 H= 312:45 +CPU= 28.613
  21:13:22 STEP 1252 H= 313:00 +CPU= 29.419
  21:13:51 STEP 1253 H= 313:15 +CPU= 28.424
  21:14:19 STEP 1254 H= 313:30 +CPU= 28.216
  21:14:48 STEP 1255 H= 313:45 +CPU= 28.676
  21:15:19 STEP 1256 H= 314:00 +CPU= 30.846
  21:15:47 STEP 1257 H= 314:15 +CPU= 28.036
  21:16:15 STEP 1258 H= 314:30 +CPU= 27.996
  21:16:43 STEP 1259 H= 314:45 +CPU= 28.013
  21:17:19 STEP 1260 H= 315:00 +CPU= 35.432
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+001260
  21:17:47 STEP 1261 H= 315:15 +CPU= 28.203
  21:18:17 STEP 1262 H= 315:30 +CPU= 29.330
  21:18:47 STEP 1263 H= 315:45 +CPU= 29.726
  21:19:17 STEP 1264 H= 316:00 +CPU= 29.692
  21:19:45 STEP 1265 H= 316:15 +CPU= 27.938
  21:20:13 STEP 1266 H= 316:30 +CPU= 27.824
  21:20:40 STEP 1267 H= 316:45 +CPU= 27.587
  21:21:09 STEP 1268 H= 317:00 +CPU= 29.232
  21:21:38 STEP 1269 H= 317:15 +CPU= 28.574
  21:22:06 STEP 1270 H= 317:30 +CPU= 27.941
  21:22:34 STEP 1271 H= 317:45 +CPU= 28.139
  21:23:12 STEP 1272 H= 318:00 +CPU= 37.291
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+001272
  21:23:42 STEP 1273 H= 318:15 +CPU= 30.469
  21:24:11 STEP 1274 H= 318:30 +CPU= 28.372
  21:24:39 STEP 1275 H= 318:45 +CPU= 28.488
  21:25:09 STEP 1276 H= 319:00 +CPU= 29.180
  21:25:37 STEP 1277 H= 319:15 +CPU= 28.816
  21:26:08 STEP 1278 H= 319:30 +CPU= 30.385
  21:26:36 STEP 1279 H= 319:45 +CPU= 28.600
  21:27:05 STEP 1280 H= 320:00 +CPU= 28.817
  21:27:34 STEP 1281 H= 320:15 +CPU= 28.284
  21:28:02 STEP 1282 H= 320:30 +CPU= 28.108
  21:28:30 STEP 1283 H= 320:45 +CPU= 28.040
  21:29:05 STEP 1284 H= 321:00 +CPU= 35.503
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+001284
  21:29:33 STEP 1285 H= 321:15 +CPU= 27.421
  21:30:01 STEP 1286 H= 321:30 +CPU= 27.865
  21:30:28 STEP 1287 H= 321:45 +CPU= 27.268
  21:30:57 STEP 1288 H= 322:00 +CPU= 28.719
  21:31:25 STEP 1289 H= 322:15 +CPU= 27.848
  21:31:53 STEP 1290 H= 322:30 +CPU= 27.932
  21:32:20 STEP 1291 H= 322:45 +CPU= 27.678
  21:32:49 STEP 1292 H= 323:00 +CPU= 28.755
  21:33:16 STEP 1293 H= 323:15 +CPU= 27.288
  21:33:43 STEP 1294 H= 323:30 +CPU= 26.963
  21:34:11 STEP 1295 H= 323:45 +CPU= 27.207
  21:34:50 STEP 1296 H= 324:00 +CPU= 39.297
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+001296
  21:35:17 STEP 1297 H= 324:15 +CPU= 27.289
  21:35:45 STEP 1298 H= 324:30 +CPU= 27.768
  21:36:13 STEP 1299 H= 324:45 +CPU= 27.819
  21:36:42 STEP 1300 H= 325:00 +CPU= 28.270
  21:37:09 STEP 1301 H= 325:15 +CPU= 27.795
  21:37:37 STEP 1302 H= 325:30 +CPU= 27.581
  21:38:05 STEP 1303 H= 325:45 +CPU= 28.412
  21:38:34 STEP 1304 H= 326:00 +CPU= 28.495
  21:39:03 STEP 1305 H= 326:15 +CPU= 28.525
  21:39:31 STEP 1306 H= 326:30 +CPU= 28.139
  21:39:59 STEP 1307 H= 326:45 +CPU= 28.233
  21:40:34 STEP 1308 H= 327:00 +CPU= 35.358
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+001308
  21:41:02 STEP 1309 H= 327:15 +CPU= 27.675
  21:41:30 STEP 1310 H= 327:30 +CPU= 27.648
  21:41:58 STEP 1311 H= 327:45 +CPU= 27.954
  21:42:26 STEP 1312 H= 328:00 +CPU= 28.180
  21:42:54 STEP 1313 H= 328:15 +CPU= 27.742
  21:43:22 STEP 1314 H= 328:30 +CPU= 27.728
  21:43:50 STEP 1315 H= 328:45 +CPU= 27.631
  21:44:18 STEP 1316 H= 329:00 +CPU= 28.486
  21:44:47 STEP 1317 H= 329:15 +CPU= 28.071
  21:45:14 STEP 1318 H= 329:30 +CPU= 27.655
  21:45:42 STEP 1319 H= 329:45 +CPU= 27.711
  21:46:17 STEP 1320 H= 330:00 +CPU= 34.919
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+001320
  21:46:45 STEP 1321 H= 330:15 +CPU= 28.075
  21:47:12 STEP 1322 H= 330:30 +CPU= 26.791
  21:47:38 STEP 1323 H= 330:45 +CPU= 26.594
  21:48:06 STEP 1324 H= 331:00 +CPU= 27.262
  21:48:33 STEP 1325 H= 331:15 +CPU= 27.158
  21:49:00 STEP 1326 H= 331:30 +CPU= 27.364
  21:49:28 STEP 1327 H= 331:45 +CPU= 27.224
  21:49:56 STEP 1328 H= 332:00 +CPU= 27.712
  21:50:23 STEP 1329 H= 332:15 +CPU= 27.169
  21:50:50 STEP 1330 H= 332:30 +CPU= 27.061
  21:51:18 STEP 1331 H= 332:45 +CPU= 28.148
  21:51:52 STEP 1332 H= 333:00 +CPU= 33.771
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+001332
  21:52:19 STEP 1333 H= 333:15 +CPU= 26.715
  21:52:46 STEP 1334 H= 333:30 +CPU= 26.860
  21:53:13 STEP 1335 H= 333:45 +CPU= 27.475
  21:53:41 STEP 1336 H= 334:00 +CPU= 27.338
  21:54:07 STEP 1337 H= 334:15 +CPU= 26.781
  21:54:35 STEP 1338 H= 334:30 +CPU= 27.340
  21:55:02 STEP 1339 H= 334:45 +CPU= 27.247
  21:55:30 STEP 1340 H= 335:00 +CPU= 28.431
  21:55:58 STEP 1341 H= 335:15 +CPU= 27.396
  21:56:25 STEP 1342 H= 335:30 +CPU= 26.875
  21:56:52 STEP 1343 H= 335:45 +CPU= 26.806
  21:57:29 STEP 1344 H= 336:00 +CPU= 37.408
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+001332
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a35e_2016092300_20_1017_12285909_0_r1611392478_13.zip
Uploading the intermediate file: upload_file_13.zip
  21:57:57 STEP 1345 H= 336:15 +CPU= 26.838
  21:58:24 STEP 1346 H= 336:30 +CPU= 27.276
  21:58:51 STEP 1347 H= 336:45 +CPU= 26.686
  21:59:18 STEP 1348 H= 337:00 +CPU= 27.231
  21:59:45 STEP 1349 H= 337:15 +CPU= 27.216
  22:00:13 STEP 1350 H= 337:30 +CPU= 27.303
  22:00:40 STEP 1351 H= 337:45 +CPU= 27.575
  22:01:08 STEP 1352 H= 338:00 +CPU= 27.992
  22:01:36 STEP 1353 H= 338:15 +CPU= 27.463
  22:02:03 STEP 1354 H= 338:30 +CPU= 27.288
  22:02:31 STEP 1355 H= 338:45 +CPU= 27.440
  22:03:05 STEP 1356 H= 339:00 +CPU= 34.600
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+001356
  22:03:33 STEP 1357 H= 339:15 +CPU= 27.243
  22:04:00 STEP 1358 H= 339:30 +CPU= 27.271
  22:04:27 STEP 1359 H= 339:45 +CPU= 27.380
  22:04:56 STEP 1360 H= 340:00 +CPU= 28.090
  22:05:23 STEP 1361 H= 340:15 +CPU= 27.319
  22:05:51 STEP 1362 H= 340:30 +CPU= 27.395
  22:06:18 STEP 1363 H= 340:45 +CPU= 27.332
  22:06:46 STEP 1364 H= 341:00 +CPU= 27.394
  22:07:13 STEP 1365 H= 341:15 +CPU= 27.239
  22:07:41 STEP 1366 H= 341:30 +CPU= 27.303
  22:08:09 STEP 1367 H= 341:45 +CPU= 27.869
  22:08:46 STEP 1368 H= 342:00 +CPU= 36.981
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+001368
  22:09:14 STEP 1369 H= 342:15 +CPU= 28.702
  22:09:41 STEP 1370 H= 342:30 +CPU= 27.245
  22:10:09 STEP 1371 H= 342:45 +CPU= 27.258
  22:10:37 STEP 1372 H= 343:00 +CPU= 28.190
  22:11:05 STEP 1373 H= 343:15 +CPU= 27.630
  22:11:32 STEP 1374 H= 343:30 +CPU= 27.715
  22:12:00 STEP 1375 H= 343:45 +CPU= 27.627
  22:12:28 STEP 1376 H= 344:00 +CPU= 27.992
  22:12:55 STEP 1377 H= 344:15 +CPU= 27.380
  22:13:23 STEP 1378 H= 344:30 +CPU= 27.393
  22:13:51 STEP 1379 H= 344:45 +CPU= 27.662
  22:14:25 STEP 1380 H= 345:00 +CPU= 34.970
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+001380
  22:14:53 STEP 1381 H= 345:15 +CPU= 27.529
  22:15:21 STEP 1382 H= 345:30 +CPU= 27.582
  22:15:48 STEP 1383 H= 345:45 +CPU= 27.331
  22:16:16 STEP 1384 H= 346:00 +CPU= 27.876
  22:16:44 STEP 1385 H= 346:15 +CPU= 27.327
  22:17:11 STEP 1386 H= 346:30 +CPU= 27.738
  22:17:39 STEP 1387 H= 346:45 +CPU= 27.334
  22:18:07 STEP 1388 H= 347:00 +CPU= 28.192
  22:18:35 STEP 1389 H= 347:15 +CPU= 27.357
  22:19:02 STEP 1390 H= 347:30 +CPU= 27.041
  22:19:29 STEP 1391 H= 347:45 +CPU= 27.177
  22:20:07 STEP 1392 H= 348:00 +CPU= 37.843
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+001392
  22:20:34 STEP 1393 H= 348:15 +CPU= 26.512
  22:21:01 STEP 1394 H= 348:30 +CPU= 27.175
  22:21:28 STEP 1395 H= 348:45 +CPU= 27.359
  22:21:56 STEP 1396 H= 349:00 +CPU= 27.949
  22:22:24 STEP 1397 H= 349:15 +CPU= 27.645
  22:22:52 STEP 1398 H= 349:30 +CPU= 27.684
  22:23:19 STEP 1399 H= 349:45 +CPU= 27.109
  22:23:46 STEP 1400 H= 350:00 +CPU= 27.099
  22:24:13 STEP 1401 H= 350:15 +CPU= 27.175
  22:24:41 STEP 1402 H= 350:30 +CPU= 27.926
  22:25:08 STEP 1403 H= 350:45 +CPU= 26.645
  22:25:41 STEP 1404 H= 351:00 +CPU= 33.592
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+001404
  22:26:09 STEP 1405 H= 351:15 +CPU= 27.912
  22:26:36 STEP 1406 H= 351:30 +CPU= 26.858
  22:27:03 STEP 1407 H= 351:45 +CPU= 26.880
  22:27:30 STEP 1408 H= 352:00 +CPU= 27.392
  22:27:57 STEP 1409 H= 352:15 +CPU= 26.714
  22:28:23 STEP 1410 H= 352:30 +CPU= 26.131
  22:28:49 STEP 1411 H= 352:45 +CPU= 26.203
  22:29:17 STEP 1412 H= 353:00 +CPU= 27.258
  22:29:44 STEP 1413 H= 353:15 +CPU= 26.803
  22:30:10 STEP 1414 H= 353:30 +CPU= 26.665
  22:30:37 STEP 1415 H= 353:45 +CPU= 26.460
  22:31:10 STEP 1416 H= 354:00 +CPU= 33.781
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+001416
  22:31:37 STEP 1417 H= 354:15 +CPU= 26.926
  22:32:05 STEP 1418 H= 354:30 +CPU= 27.341
  22:32:33 STEP 1419 H= 354:45 +CPU= 27.664
  22:33:01 STEP 1420 H= 355:00 +CPU= 28.077
  22:33:29 STEP 1421 H= 355:15 +CPU= 27.941
  22:33:56 STEP 1422 H= 355:30 +CPU= 27.454
  22:34:24 STEP 1423 H= 355:45 +CPU= 27.439
  22:34:52 STEP 1424 H= 356:00 +CPU= 27.898
  22:35:19 STEP 1425 H= 356:15 +CPU= 27.261
  22:35:46 STEP 1426 H= 356:30 +CPU= 27.159
  22:36:13 STEP 1427 H= 356:45 +CPU= 27.191
  22:36:48 STEP 1428 H= 357:00 +CPU= 34.528
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+001428
  22:37:15 STEP 1429 H= 357:15 +CPU= 27.399
  22:37:43 STEP 1430 H= 357:30 +CPU= 27.686
  22:38:11 STEP 1431 H= 357:45 +CPU= 27.529
  22:38:39 STEP 1432 H= 358:00 +CPU= 28.374
  22:39:07 STEP 1433 H= 358:15 +CPU= 27.633
  22:39:34 STEP 1434 H= 358:30 +CPU= 26.791
  22:40:01 STEP 1435 H= 358:45 +CPU= 27.149
  22:40:26 STEP 1436 H= 359:00 +CPU= 25.527
  22:40:52 STEP 1437 H= 359:15 +CPU= 25.586
  22:41:19 STEP 1438 H= 359:30 +CPU= 26.793
  22:41:45 STEP 1439 H= 359:45 +CPU= 25.955
  22:42:20 STEP 1440 H= 360:00 +CPU= 34.938
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.7819567766E-21      I       0.8470668776E-08      I
ICloud fractionI      0.0000000000E+00      I       0.5289784488E-03      I
I  Relat. Hum. I      0.3259450796E+00      I       0.3395589699E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.7522918747E+01      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    325895300 BYTES IN      7 RECORDS TRANSFERRED IN    0.0005 SECONDS651790.6 Mbytes/s, TOTAL TIME=    0.0132( 3.8%)
 22:42:20 STEP 1440 H= 360:00 +CPU= 34.938
 END CNT3
 NSTEP =  1440 CNT0   000000000  24.860  24.860  24.873   0.999               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ            0/           0 WRITTEN        43246/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    758    0        0            0    43246 ************    91.0     0.0    91.0     0.0   181.0
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.98      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 1562    5080.0    5080.0     17.42      0.00
   9 SPCM     - SPECTRAL COMP.                    1440     936.7     936.7      2.96      0.00
  10 SCAN2M - PHYSICS                             1441   14238.3   14238.3     45.05      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                121    1039.8    1039.8      0.28      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 63      47.6      47.6      0.01      0.00
  14 SUINIF                                          1    8681.8    8681.8      0.02      0.00
  17 GRIDFPOS IN CNT4                              121      33.0      33.0      0.01      0.00
  18 SUSPECG                                         1    4394.3    4394.3      0.01      0.00
  19 SUSPEC                                          1    4402.6    4402.6      0.01      0.00
  24 SUGRIDU                                         1    3655.9    3655.9      0.01      0.00
  25 SPECRT                                          1     331.9     331.9      0.00      0.00
  26 SUGRIDF                                         1     291.3     291.3      0.00      0.00
  27 RESTART FILES - WRITING                        30    4193.6    4193.6      0.28      0.00
  28 RESTART FILES - READING                         1       0.0       0.0      0.00      0.00
  29 SU4FPOS IN CNT4                               121       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                               121    6856.2    6856.2      1.82      0.00
  31 POSDDH IN STEPO                                 7       1.0       1.0      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   1441    6623.0    6623.0     20.96      0.00
  39 SU0YOMB                                         1     468.0     468.0      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   1441      30.0      30.0      0.09      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             1440     357.1     357.1      1.13      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             1440      83.9      83.9      0.27      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 63       0.3       0.3      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     3125     605.3     605.3      4.15      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      3006     339.3     339.3      2.24      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       3006     125.8     125.8      0.83      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      3125     171.1     171.1      1.17      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      48.7      48.7      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           3125      69.6      69.6      0.48      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           3006      34.7      34.7      0.23      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           3125     111.3     111.3      0.76      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           3006      58.9      58.9      0.39      0.00
 400 GSTATS                                     167734       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                156066       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    45539.9 CPU TIME   45394.9 VECTOR TIME    45394.9


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       28.5
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/slots/8/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/8/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285909/ICMUAh7zg+001428
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a35e_2016092300_20_1017_12285909_0_r1611392478_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
22:45:51 (1777703): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>oifs_43r3_bl_a35e_2016092300_20_1017_12285909_0_r1611392478_15.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a35e_2016092300_20_1017_12285909_0_r1611392478_16.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a35e_2016092300_20_1017_12285909_0_r1611392478_17.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a35e_2016092300_20_1017_12285909_0_r1611392478_18.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a35e_2016092300_20_1017_12285909_0_r1611392478_19.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
08 Jun 2024 23:31:41 1538875 22437523 oifs_43r3_bl_a35e_2016092300_20_1017_12285909_0 1,295,100 45,395 0.0351
08 Jun 2024 19:18:16 1538875 22437523 oifs_43r3_bl_a35e_2016092300_20_1017_12285909_0 864,000 31,373 0.0363


©2024 climateprediction.net