climateprediction.net home page
Task 22434372

Task 22434372

Name oifs_43r3_bl_a0r4_2016092300_20_1017_12282803_0
Workunit 12282803
Created 7 Jun 2024, 12:15:29 UTC
Sent 8 Jun 2024, 8:16:42 UTC
Report deadline 7 Aug 2024, 8:16:42 UTC
Received 9 Jun 2024, 2:07:46 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1538911
Run time 17 hours 46 min 21 sec
CPU time 17 hours 38 min 30 sec
Validate state Invalid
Credit 1,976.32
Device peak FLOPS 3.87 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,025.09 MB
Peak swap size 5,980.81 MB
Peak disk usage 1,336.35 MB
Stderr
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<stderr_txt>
 208:30 +CPU= 44.739
  14:11:15 STEP  835 H= 208:45 +CPU= 43.747
  14:11:58 STEP  836 H= 209:00 +CPU= 42.704
  14:12:39 STEP  837 H= 209:15 +CPU= 40.645
  14:13:20 STEP  838 H= 209:30 +CPU= 41.574
  14:14:05 STEP  839 H= 209:45 +CPU= 44.669
  14:14:59 STEP  840 H= 210:00 +CPU= 53.639
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+000840
  14:15:40 STEP  841 H= 210:15 +CPU= 41.636
  14:16:22 STEP  842 H= 210:30 +CPU= 41.986
  14:17:06 STEP  843 H= 210:45 +CPU= 42.997
  14:17:49 STEP  844 H= 211:00 +CPU= 43.277
  14:18:31 STEP  845 H= 211:15 +CPU= 42.107
  14:19:13 STEP  846 H= 211:30 +CPU= 41.984
  14:19:55 STEP  847 H= 211:45 +CPU= 41.824
  14:20:40 STEP  848 H= 212:00 +CPU= 44.623
  14:21:23 STEP  849 H= 212:15 +CPU= 42.464
  14:22:04 STEP  850 H= 212:30 +CPU= 41.655
  14:22:46 STEP  851 H= 212:45 +CPU= 40.917
  14:23:35 STEP  852 H= 213:00 +CPU= 49.733
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+000852
  14:24:16 STEP  853 H= 213:15 +CPU= 40.965
  14:24:57 STEP  854 H= 213:30 +CPU= 40.932
  14:25:38 STEP  855 H= 213:45 +CPU= 40.809
  14:26:19 STEP  856 H= 214:00 +CPU= 41.460
  14:27:00 STEP  857 H= 214:15 +CPU= 40.680
  14:27:41 STEP  858 H= 214:30 +CPU= 40.586
  14:28:21 STEP  859 H= 214:45 +CPU= 40.590
  14:29:06 STEP  860 H= 215:00 +CPU= 44.323
  14:29:49 STEP  861 H= 215:15 +CPU= 43.481
  14:30:32 STEP  862 H= 215:30 +CPU= 43.129
  14:31:14 STEP  863 H= 215:45 +CPU= 41.119
  14:32:11 STEP  864 H= 216:00 +CPU= 56.328
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+000852
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0r4_2016092300_20_1017_12282803_0_r1774540839_8.zip
Uploading the intermediate file: upload_file_8.zip
  14:32:52 STEP  865 H= 216:15 +CPU= 41.134
  14:33:33 STEP  866 H= 216:30 +CPU= 40.305
  14:34:12 STEP  867 H= 216:45 +CPU= 39.251
  14:34:52 STEP  868 H= 217:00 +CPU= 39.977
  14:35:33 STEP  869 H= 217:15 +CPU= 40.582
  14:36:12 STEP  870 H= 217:30 +CPU= 38.884
  14:36:51 STEP  871 H= 217:45 +CPU= 39.029
  14:37:31 STEP  872 H= 218:00 +CPU= 40.415
  14:38:11 STEP  873 H= 218:15 +CPU= 40.156
  14:38:53 STEP  874 H= 218:30 +CPU= 41.515
  14:39:32 STEP  875 H= 218:45 +CPU= 39.244
  14:40:21 STEP  876 H= 219:00 +CPU= 49.071
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+000876
  14:41:01 STEP  877 H= 219:15 +CPU= 39.495
  14:41:41 STEP  878 H= 219:30 +CPU= 39.731
  14:42:20 STEP  879 H= 219:45 +CPU= 39.687
  14:43:01 STEP  880 H= 220:00 +CPU= 40.517
  14:43:40 STEP  881 H= 220:15 +CPU= 39.171
  14:44:19 STEP  882 H= 220:30 +CPU= 39.423
  14:44:59 STEP  883 H= 220:45 +CPU= 39.598
  14:45:40 STEP  884 H= 221:00 +CPU= 40.698
  14:46:20 STEP  885 H= 221:15 +CPU= 39.971
  14:47:01 STEP  886 H= 221:30 +CPU= 40.301
  14:47:41 STEP  887 H= 221:45 +CPU= 39.489
  14:48:32 STEP  888 H= 222:00 +CPU= 51.048
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+000888
  14:49:12 STEP  889 H= 222:15 +CPU= 39.877
  14:49:51 STEP  890 H= 222:30 +CPU= 39.176
  14:50:31 STEP  891 H= 222:45 +CPU= 39.507
  14:51:13 STEP  892 H= 223:00 +CPU= 41.718
  14:51:56 STEP  893 H= 223:15 +CPU= 42.480
  14:52:38 STEP  894 H= 223:30 +CPU= 42.648
  14:53:21 STEP  895 H= 223:45 +CPU= 42.825
  14:54:03 STEP  896 H= 224:00 +CPU= 41.461
  14:54:43 STEP  897 H= 224:15 +CPU= 39.894
  14:55:22 STEP  898 H= 224:30 +CPU= 39.695
  14:56:02 STEP  899 H= 224:45 +CPU= 39.369
  14:56:51 STEP  900 H= 225:00 +CPU= 49.877
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+000900
  14:57:31 STEP  901 H= 225:15 +CPU= 39.739
  14:58:11 STEP  902 H= 225:30 +CPU= 39.775
  14:58:51 STEP  903 H= 225:45 +CPU= 39.683
  14:59:32 STEP  904 H= 226:00 +CPU= 40.758
  15:00:13 STEP  905 H= 226:15 +CPU= 41.283
  15:00:55 STEP  906 H= 226:30 +CPU= 41.684
  15:01:35 STEP  907 H= 226:45 +CPU= 40.359
  15:02:16 STEP  908 H= 227:00 +CPU= 40.509
  15:02:56 STEP  909 H= 227:15 +CPU= 39.744
  15:03:36 STEP  910 H= 227:30 +CPU= 39.833
  15:04:15 STEP  911 H= 227:45 +CPU= 39.758
  15:05:11 STEP  912 H= 228:00 +CPU= 54.944
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+000912
  15:05:50 STEP  913 H= 228:15 +CPU= 39.295
  15:06:30 STEP  914 H= 228:30 +CPU= 39.605
  15:07:10 STEP  915 H= 228:45 +CPU= 39.453
  15:07:50 STEP  916 H= 229:00 +CPU= 40.610
  15:08:30 STEP  917 H= 229:15 +CPU= 39.472
  15:09:09 STEP  918 H= 229:30 +CPU= 39.280
  15:09:48 STEP  919 H= 229:45 +CPU= 39.403
  15:10:29 STEP  920 H= 230:00 +CPU= 40.363
  15:11:11 STEP  921 H= 230:15 +CPU= 41.919
  15:11:50 STEP  922 H= 230:30 +CPU= 38.923
  15:12:28 STEP  923 H= 230:45 +CPU= 38.648
  15:13:17 STEP  924 H= 231:00 +CPU= 48.417
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+000924
  15:13:56 STEP  925 H= 231:15 +CPU= 38.728
  15:14:35 STEP  926 H= 231:30 +CPU= 39.029
  15:15:15 STEP  927 H= 231:45 +CPU= 40.318
  15:15:58 STEP  928 H= 232:00 +CPU= 43.032
  15:16:40 STEP  929 H= 232:15 +CPU= 41.878
  15:17:21 STEP  930 H= 232:30 +CPU= 40.949
  15:18:00 STEP  931 H= 232:45 +CPU= 38.977
  15:18:40 STEP  932 H= 233:00 +CPU= 40.038
  15:19:19 STEP  933 H= 233:15 +CPU= 38.962
  15:19:58 STEP  934 H= 233:30 +CPU= 38.788
  15:20:37 STEP  935 H= 233:45 +CPU= 38.550
  15:21:28 STEP  936 H= 234:00 +CPU= 51.144
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+000936
  15:22:10 STEP  937 H= 234:15 +CPU= 41.704
  15:22:52 STEP  938 H= 234:30 +CPU= 42.033
  15:23:32 STEP  939 H= 234:45 +CPU= 39.514
  15:24:15 STEP  940 H= 235:00 +CPU= 43.369
  15:24:57 STEP  941 H= 235:15 +CPU= 42.241
  15:25:37 STEP  942 H= 235:30 +CPU= 39.711
  15:26:17 STEP  943 H= 235:45 +CPU= 39.834
  15:26:58 STEP  944 H= 236:00 +CPU= 40.779
  15:27:37 STEP  945 H= 236:15 +CPU= 39.500
  15:28:17 STEP  946 H= 236:30 +CPU= 39.477
  15:28:56 STEP  947 H= 236:45 +CPU= 38.917
  15:29:48 STEP  948 H= 237:00 +CPU= 51.747
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+000948
  15:30:29 STEP  949 H= 237:15 +CPU= 41.558
  15:31:11 STEP  950 H= 237:30 +CPU= 41.546
  15:31:50 STEP  951 H= 237:45 +CPU= 38.672
  15:32:29 STEP  952 H= 238:00 +CPU= 39.586
  15:33:08 STEP  953 H= 238:15 +CPU= 38.814
  15:33:48 STEP  954 H= 238:30 +CPU= 39.802
  15:34:31 STEP  955 H= 238:45 +CPU= 42.675
  15:35:14 STEP  956 H= 239:00 +CPU= 43.107
  15:35:55 STEP  957 H= 239:15 +CPU= 41.316
  15:36:37 STEP  958 H= 239:30 +CPU= 41.480
  15:37:17 STEP  959 H= 239:45 +CPU= 40.031
  15:38:11 STEP  960 H= 240:00 +CPU= 54.000
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+000948
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0r4_2016092300_20_1017_12282803_0_r1774540839_9.zip
Uploading the intermediate file: upload_file_9.zip
Uploading trickle at timestep: 864000
  15:38:52 STEP  961 H= 240:15 +CPU= 40.946
  15:39:34 STEP  962 H= 240:30 +CPU= 42.174
  15:40:14 STEP  963 H= 240:45 +CPU= 39.190
  15:40:54 STEP  964 H= 241:00 +CPU= 40.502
  15:41:34 STEP  965 H= 241:15 +CPU= 39.652
  15:42:13 STEP  966 H= 241:30 +CPU= 39.534
  15:42:53 STEP  967 H= 241:45 +CPU= 39.586
  15:43:33 STEP  968 H= 242:00 +CPU= 40.373
  15:44:13 STEP  969 H= 242:15 +CPU= 39.312
  15:44:52 STEP  970 H= 242:30 +CPU= 39.262
  15:45:32 STEP  971 H= 242:45 +CPU= 39.885
  15:46:23 STEP  972 H= 243:00 +CPU= 50.151
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+000972
  15:47:03 STEP  973 H= 243:15 +CPU= 39.583
  15:47:42 STEP  974 H= 243:30 +CPU= 39.714
  15:48:22 STEP  975 H= 243:45 +CPU= 39.657
  15:49:03 STEP  976 H= 244:00 +CPU= 40.584
  15:49:43 STEP  977 H= 244:15 +CPU= 39.472
  15:50:22 STEP  978 H= 244:30 +CPU= 39.730
  15:51:02 STEP  979 H= 244:45 +CPU= 39.935
  15:51:43 STEP  980 H= 245:00 +CPU= 40.017
  15:52:22 STEP  981 H= 245:15 +CPU= 39.856
  15:53:02 STEP  982 H= 245:30 +CPU= 39.468
  15:53:42 STEP  983 H= 245:45 +CPU= 40.301
  15:54:33 STEP  984 H= 246:00 +CPU= 50.218
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+000984
  15:55:13 STEP  985 H= 246:15 +CPU= 40.033
  15:55:54 STEP  986 H= 246:30 +CPU= 40.783
  15:56:34 STEP  987 H= 246:45 +CPU= 40.634
  15:57:16 STEP  988 H= 247:00 +CPU= 41.494
  15:57:56 STEP  989 H= 247:15 +CPU= 40.420
  15:58:37 STEP  990 H= 247:30 +CPU= 40.864
  15:59:20 STEP  991 H= 247:45 +CPU= 42.701
  16:00:06 STEP  992 H= 248:00 +CPU= 45.584
  16:00:47 STEP  993 H= 248:15 +CPU= 41.511
  16:01:28 STEP  994 H= 248:30 +CPU= 40.995
  16:02:11 STEP  995 H= 248:45 +CPU= 42.486
  16:03:05 STEP  996 H= 249:00 +CPU= 53.172
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+000996
  16:03:47 STEP  997 H= 249:15 +CPU= 42.614
  16:04:31 STEP  998 H= 249:30 +CPU= 43.761
  16:05:16 STEP  999 H= 249:45 +CPU= 44.349
  16:05:59 STEP 1000 H= 250:00 +CPU= 43.020
  16:06:41 STEP 1001 H= 250:15 +CPU= 41.651
  16:07:23 STEP 1002 H= 250:30 +CPU= 42.252
  16:08:05 STEP 1003 H= 250:45 +CPU= 41.624
  16:08:46 STEP 1004 H= 251:00 +CPU= 41.444
  16:09:25 STEP 1005 H= 251:15 +CPU= 39.034
  16:10:06 STEP 1006 H= 251:30 +CPU= 40.538
  16:10:47 STEP 1007 H= 251:45 +CPU= 41.182
  16:11:45 STEP 1008 H= 252:00 +CPU= 57.398
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001008
  16:12:26 STEP 1009 H= 252:15 +CPU= 40.765
  16:13:07 STEP 1010 H= 252:30 +CPU= 40.660
  16:13:48 STEP 1011 H= 252:45 +CPU= 41.230
  16:14:30 STEP 1012 H= 253:00 +CPU= 42.243
  16:15:14 STEP 1013 H= 253:15 +CPU= 43.294
  16:15:58 STEP 1014 H= 253:30 +CPU= 43.470
  16:16:42 STEP 1015 H= 253:45 +CPU= 44.190
  16:17:25 STEP 1016 H= 254:00 +CPU= 43.595
  16:18:07 STEP 1017 H= 254:15 +CPU= 41.303
  16:18:48 STEP 1018 H= 254:30 +CPU= 40.573
  16:19:30 STEP 1019 H= 254:45 +CPU= 42.413
  16:20:23 STEP 1020 H= 255:00 +CPU= 52.258
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001020
  16:21:07 STEP 1021 H= 255:15 +CPU= 43.195
  16:21:50 STEP 1022 H= 255:30 +CPU= 43.717
  16:22:33 STEP 1023 H= 255:45 +CPU= 42.834
  16:23:15 STEP 1024 H= 256:00 +CPU= 42.190
  16:23:57 STEP 1025 H= 256:15 +CPU= 41.403
  16:24:38 STEP 1026 H= 256:30 +CPU= 41.612
  16:25:20 STEP 1027 H= 256:45 +CPU= 41.608
  16:26:03 STEP 1028 H= 257:00 +CPU= 42.539
  16:26:44 STEP 1029 H= 257:15 +CPU= 41.318
  16:27:25 STEP 1030 H= 257:30 +CPU= 41.039
  16:28:06 STEP 1031 H= 257:45 +CPU= 40.958
  16:28:57 STEP 1032 H= 258:00 +CPU= 51.220
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001032
  16:29:38 STEP 1033 H= 258:15 +CPU= 40.379
  16:30:18 STEP 1034 H= 258:30 +CPU= 40.585
  16:30:59 STEP 1035 H= 258:45 +CPU= 40.658
  16:31:41 STEP 1036 H= 259:00 +CPU= 41.773
  16:32:24 STEP 1037 H= 259:15 +CPU= 42.918
  16:33:08 STEP 1038 H= 259:30 +CPU= 43.744
  16:33:49 STEP 1039 H= 259:45 +CPU= 41.582
  16:34:32 STEP 1040 H= 260:00 +CPU= 42.274
  16:35:14 STEP 1041 H= 260:15 +CPU= 42.025
  16:35:58 STEP 1042 H= 260:30 +CPU= 44.089
  16:36:42 STEP 1043 H= 260:45 +CPU= 43.853
  16:37:36 STEP 1044 H= 261:00 +CPU= 53.893
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001044
  16:38:17 STEP 1045 H= 261:15 +CPU= 41.095
  16:39:00 STEP 1046 H= 261:30 +CPU= 42.844
  16:39:42 STEP 1047 H= 261:45 +CPU= 41.317
  16:40:26 STEP 1048 H= 262:00 +CPU= 44.452
  16:41:10 STEP 1049 H= 262:15 +CPU= 43.798
  16:41:54 STEP 1050 H= 262:30 +CPU= 43.529
  16:42:35 STEP 1051 H= 262:45 +CPU= 41.274
  16:43:17 STEP 1052 H= 263:00 +CPU= 41.934
  16:43:59 STEP 1053 H= 263:15 +CPU= 41.713
  16:44:41 STEP 1054 H= 263:30 +CPU= 41.676
  16:45:24 STEP 1055 H= 263:45 +CPU= 43.394
  16:46:22 STEP 1056 H= 264:00 +CPU= 57.883
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+001044
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0r4_2016092300_20_1017_12282803_0_r1774540839_10.zip
Uploading the intermediate file: upload_file_10.zip
  16:47:03 STEP 1057 H= 264:15 +CPU= 40.995
  16:47:47 STEP 1058 H= 264:30 +CPU= 43.557
  16:48:30 STEP 1059 H= 264:45 +CPU= 42.267
  16:49:12 STEP 1060 H= 265:00 +CPU= 41.975
  16:49:53 STEP 1061 H= 265:15 +CPU= 40.706
  16:50:35 STEP 1062 H= 265:30 +CPU= 41.860
  16:51:18 STEP 1063 H= 265:45 +CPU= 42.328
  16:52:01 STEP 1064 H= 266:00 +CPU= 42.378
  16:52:44 STEP 1065 H= 266:15 +CPU= 42.421
  16:53:28 STEP 1066 H= 266:30 +CPU= 44.594
  16:54:13 STEP 1067 H= 266:45 +CPU= 44.231
  16:55:05 STEP 1068 H= 267:00 +CPU= 51.940
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001068
  16:55:47 STEP 1069 H= 267:15 +CPU= 42.807
  16:56:29 STEP 1070 H= 267:30 +CPU= 41.066
  16:57:09 STEP 1071 H= 267:45 +CPU= 40.759
  16:57:51 STEP 1072 H= 268:00 +CPU= 41.841
  16:58:32 STEP 1073 H= 268:15 +CPU= 40.833
  16:59:13 STEP 1074 H= 268:30 +CPU= 40.969
  16:59:54 STEP 1075 H= 268:45 +CPU= 41.021
  17:00:36 STEP 1076 H= 269:00 +CPU= 41.859
  17:01:19 STEP 1077 H= 269:15 +CPU= 42.544
  17:02:02 STEP 1078 H= 269:30 +CPU= 43.693
  17:02:45 STEP 1079 H= 269:45 +CPU= 42.291
  17:03:37 STEP 1080 H= 270:00 +CPU= 51.964
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001080
  17:04:18 STEP 1081 H= 270:15 +CPU= 40.705
  17:04:58 STEP 1082 H= 270:30 +CPU= 40.531
  17:05:40 STEP 1083 H= 270:45 +CPU= 42.054
  17:06:21 STEP 1084 H= 271:00 +CPU= 40.918
  17:07:02 STEP 1085 H= 271:15 +CPU= 40.834
  17:07:46 STEP 1086 H= 271:30 +CPU= 43.761
  17:08:25 STEP 1087 H= 271:45 +CPU= 39.307
  17:09:07 STEP 1088 H= 272:00 +CPU= 42.107
  17:09:50 STEP 1089 H= 272:15 +CPU= 42.541
  17:10:32 STEP 1090 H= 272:30 +CPU= 41.504
  17:11:12 STEP 1091 H= 272:45 +CPU= 40.769
  17:12:05 STEP 1092 H= 273:00 +CPU= 52.623
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001092
  17:12:48 STEP 1093 H= 273:15 +CPU= 42.880
  17:13:31 STEP 1094 H= 273:30 +CPU= 43.031
  17:14:15 STEP 1095 H= 273:45 +CPU= 43.356
  17:14:56 STEP 1096 H= 274:00 +CPU= 41.103
  17:15:36 STEP 1097 H= 274:15 +CPU= 40.003
  17:16:16 STEP 1098 H= 274:30 +CPU= 40.094
  17:16:56 STEP 1099 H= 274:45 +CPU= 39.886
  17:17:37 STEP 1100 H= 275:00 +CPU= 40.832
  17:18:18 STEP 1101 H= 275:15 +CPU= 41.538
  17:19:02 STEP 1102 H= 275:30 +CPU= 43.100
  17:19:44 STEP 1103 H= 275:45 +CPU= 42.945
  17:20:41 STEP 1104 H= 276:00 +CPU= 55.969
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001104
  17:21:23 STEP 1105 H= 276:15 +CPU= 41.497
  17:22:02 STEP 1106 H= 276:30 +CPU= 39.134
  17:22:44 STEP 1107 H= 276:45 +CPU= 41.698
  17:23:25 STEP 1108 H= 277:00 +CPU= 41.011
  17:24:05 STEP 1109 H= 277:15 +CPU= 40.013
  17:24:44 STEP 1110 H= 277:30 +CPU= 38.852
  17:25:23 STEP 1111 H= 277:45 +CPU= 39.703
  17:26:04 STEP 1112 H= 278:00 +CPU= 41.007
  17:26:44 STEP 1113 H= 278:15 +CPU= 39.884
  17:27:25 STEP 1114 H= 278:30 +CPU= 40.748
  17:28:08 STEP 1115 H= 278:45 +CPU= 42.442
  17:28:58 STEP 1116 H= 279:00 +CPU= 50.261
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001116
  17:29:38 STEP 1117 H= 279:15 +CPU= 39.831
  17:30:18 STEP 1118 H= 279:30 +CPU= 39.962
  17:30:58 STEP 1119 H= 279:45 +CPU= 39.728
  17:31:38 STEP 1120 H= 280:00 +CPU= 40.042
  17:32:18 STEP 1121 H= 280:15 +CPU= 39.959
  17:33:00 STEP 1122 H= 280:30 +CPU= 41.993
  17:33:40 STEP 1123 H= 280:45 +CPU= 39.637
  17:34:20 STEP 1124 H= 281:00 +CPU= 40.197
  17:34:59 STEP 1125 H= 281:15 +CPU= 39.109
  17:35:39 STEP 1126 H= 281:30 +CPU= 39.172
  17:36:18 STEP 1127 H= 281:45 +CPU= 39.407
  17:37:11 STEP 1128 H= 282:00 +CPU= 52.530
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001128
  17:37:50 STEP 1129 H= 282:15 +CPU= 39.293
  17:38:29 STEP 1130 H= 282:30 +CPU= 39.288
  17:39:09 STEP 1131 H= 282:45 +CPU= 39.175
  17:39:49 STEP 1132 H= 283:00 +CPU= 40.098
  17:40:28 STEP 1133 H= 283:15 +CPU= 38.854
  17:41:07 STEP 1134 H= 283:30 +CPU= 39.449
  17:41:47 STEP 1135 H= 283:45 +CPU= 40.156
  17:42:28 STEP 1136 H= 284:00 +CPU= 40.975
  17:43:08 STEP 1137 H= 284:15 +CPU= 39.902
  17:43:48 STEP 1138 H= 284:30 +CPU= 39.832
  17:44:28 STEP 1139 H= 284:45 +CPU= 39.768
  17:45:18 STEP 1140 H= 285:00 +CPU= 49.753
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001140
  17:45:57 STEP 1141 H= 285:15 +CPU= 39.400
  17:46:39 STEP 1142 H= 285:30 +CPU= 42.085
  17:47:20 STEP 1143 H= 285:45 +CPU= 41.259
  17:48:01 STEP 1144 H= 286:00 +CPU= 40.253
  17:48:41 STEP 1145 H= 286:15 +CPU= 39.495
  17:49:20 STEP 1146 H= 286:30 +CPU= 38.966
  17:49:59 STEP 1147 H= 286:45 +CPU= 39.503
  17:50:40 STEP 1148 H= 287:00 +CPU= 40.621
  17:51:20 STEP 1149 H= 287:15 +CPU= 39.526
  17:51:59 STEP 1150 H= 287:30 +CPU= 39.149
  17:52:38 STEP 1151 H= 287:45 +CPU= 39.171
  17:53:33 STEP 1152 H= 288:00 +CPU= 54.715
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+001140
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0r4_2016092300_20_1017_12282803_0_r1774540839_11.zip
Uploading the intermediate file: upload_file_11.zip
  17:54:13 STEP 1153 H= 288:15 +CPU= 38.988
  17:54:52 STEP 1154 H= 288:30 +CPU= 38.885
  17:55:33 STEP 1155 H= 288:45 +CPU= 41.649
  17:56:13 STEP 1156 H= 289:00 +CPU= 39.793
  17:56:52 STEP 1157 H= 289:15 +CPU= 38.679
  17:57:30 STEP 1158 H= 289:30 +CPU= 37.679
  17:58:08 STEP 1159 H= 289:45 +CPU= 38.511
  17:58:47 STEP 1160 H= 290:00 +CPU= 38.819
  17:59:25 STEP 1161 H= 290:15 +CPU= 37.987
  18:00:05 STEP 1162 H= 290:30 +CPU= 39.881
  18:00:43 STEP 1163 H= 290:45 +CPU= 37.955
  18:01:31 STEP 1164 H= 291:00 +CPU= 47.788
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001164
  18:02:09 STEP 1165 H= 291:15 +CPU= 38.232
  18:02:50 STEP 1166 H= 291:30 +CPU= 40.805
  18:03:28 STEP 1167 H= 291:45 +CPU= 38.592
  18:04:08 STEP 1168 H= 292:00 +CPU= 39.320
  18:04:46 STEP 1169 H= 292:15 +CPU= 38.527
  18:05:25 STEP 1170 H= 292:30 +CPU= 38.712
  18:06:04 STEP 1171 H= 292:45 +CPU= 38.864
  18:06:44 STEP 1172 H= 293:00 +CPU= 39.766
  18:07:23 STEP 1173 H= 293:15 +CPU= 38.762
  18:08:02 STEP 1174 H= 293:30 +CPU= 38.764
  18:08:40 STEP 1175 H= 293:45 +CPU= 38.581
  18:09:28 STEP 1176 H= 294:00 +CPU= 47.778
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001176
  18:10:07 STEP 1177 H= 294:15 +CPU= 38.488
  18:10:45 STEP 1178 H= 294:30 +CPU= 38.500
  18:11:24 STEP 1179 H= 294:45 +CPU= 38.903
  18:12:04 STEP 1180 H= 295:00 +CPU= 39.810
  18:12:43 STEP 1181 H= 295:15 +CPU= 38.899
  18:13:22 STEP 1182 H= 295:30 +CPU= 38.825
  18:14:00 STEP 1183 H= 295:45 +CPU= 38.831
  18:14:40 STEP 1184 H= 296:00 +CPU= 39.558
  18:15:18 STEP 1185 H= 296:15 +CPU= 38.187
  18:15:56 STEP 1186 H= 296:30 +CPU= 38.221
  18:16:35 STEP 1187 H= 296:45 +CPU= 38.604
  18:17:23 STEP 1188 H= 297:00 +CPU= 47.745
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001188
  18:18:00 STEP 1189 H= 297:15 +CPU= 37.180
  18:18:38 STEP 1190 H= 297:30 +CPU= 37.706
  18:19:16 STEP 1191 H= 297:45 +CPU= 37.614
  18:19:54 STEP 1192 H= 298:00 +CPU= 38.477
  18:20:33 STEP 1193 H= 298:15 +CPU= 38.577
  18:21:12 STEP 1194 H= 298:30 +CPU= 39.399
  18:21:52 STEP 1195 H= 298:45 +CPU= 39.158
  18:22:31 STEP 1196 H= 299:00 +CPU= 39.090
  18:23:09 STEP 1197 H= 299:15 +CPU= 37.919
  18:23:47 STEP 1198 H= 299:30 +CPU= 37.853
  18:24:24 STEP 1199 H= 299:45 +CPU= 37.808
  18:25:18 STEP 1200 H= 300:00 +CPU= 51.985
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001200
  18:25:56 STEP 1201 H= 300:15 +CPU= 37.818
  18:26:34 STEP 1202 H= 300:30 +CPU= 37.738
  18:27:11 STEP 1203 H= 300:45 +CPU= 37.804
  18:27:51 STEP 1204 H= 301:00 +CPU= 39.468
  18:28:30 STEP 1205 H= 301:15 +CPU= 38.733
  18:29:08 STEP 1206 H= 301:30 +CPU= 38.693
  18:29:47 STEP 1207 H= 301:45 +CPU= 38.642
  18:30:27 STEP 1208 H= 302:00 +CPU= 39.737
  18:31:05 STEP 1209 H= 302:15 +CPU= 38.568
  18:31:44 STEP 1210 H= 302:30 +CPU= 38.750
  18:32:23 STEP 1211 H= 302:45 +CPU= 38.995
  18:33:12 STEP 1212 H= 303:00 +CPU= 49.103
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001212
  18:33:51 STEP 1213 H= 303:15 +CPU= 38.683
  18:34:30 STEP 1214 H= 303:30 +CPU= 38.763
  18:35:09 STEP 1215 H= 303:45 +CPU= 38.857
  18:35:49 STEP 1216 H= 304:00 +CPU= 39.842
  18:36:28 STEP 1217 H= 304:15 +CPU= 39.157
  18:37:09 STEP 1218 H= 304:30 +CPU= 40.892
  18:37:50 STEP 1219 H= 304:45 +CPU= 40.867
  18:38:30 STEP 1220 H= 305:00 +CPU= 39.574
  18:39:08 STEP 1221 H= 305:15 +CPU= 38.154
  18:39:46 STEP 1222 H= 305:30 +CPU= 38.197
  18:40:25 STEP 1223 H= 305:45 +CPU= 38.188
  18:41:12 STEP 1224 H= 306:00 +CPU= 47.651
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001224
  18:41:51 STEP 1225 H= 306:15 +CPU= 38.167
  18:42:29 STEP 1226 H= 306:30 +CPU= 38.808
  18:43:08 STEP 1227 H= 306:45 +CPU= 38.945
  18:43:49 STEP 1228 H= 307:00 +CPU= 39.920
  18:44:28 STEP 1229 H= 307:15 +CPU= 38.641
  18:45:07 STEP 1230 H= 307:30 +CPU= 38.857
  18:45:45 STEP 1231 H= 307:45 +CPU= 38.658
  18:46:25 STEP 1232 H= 308:00 +CPU= 39.799
  18:47:04 STEP 1233 H= 308:15 +CPU= 38.953
  18:47:43 STEP 1234 H= 308:30 +CPU= 38.523
  18:48:22 STEP 1235 H= 308:45 +CPU= 38.937
  18:49:10 STEP 1236 H= 309:00 +CPU= 48.038
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001236
  18:49:48 STEP 1237 H= 309:15 +CPU= 37.952
  18:50:28 STEP 1238 H= 309:30 +CPU= 39.735
  18:51:06 STEP 1239 H= 309:45 +CPU= 38.097
  18:51:45 STEP 1240 H= 310:00 +CPU= 38.847
  18:52:23 STEP 1241 H= 310:15 +CPU= 38.092
  18:53:01 STEP 1242 H= 310:30 +CPU= 37.701
  18:53:38 STEP 1243 H= 310:45 +CPU= 37.615
  18:54:17 STEP 1244 H= 311:00 +CPU= 38.620
  18:54:55 STEP 1245 H= 311:15 +CPU= 37.841
  18:55:34 STEP 1246 H= 311:30 +CPU= 38.939
  18:56:13 STEP 1247 H= 311:45 +CPU= 38.956
  18:57:06 STEP 1248 H= 312:00 +CPU= 53.603
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+001236
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0r4_2016092300_20_1017_12282803_0_r1774540839_12.zip
Uploading the intermediate file: upload_file_12.zip
  18:57:45 STEP 1249 H= 312:15 +CPU= 38.299
  18:58:23 STEP 1250 H= 312:30 +CPU= 38.275
  18:59:01 STEP 1251 H= 312:45 +CPU= 37.959
  18:59:40 STEP 1252 H= 313:00 +CPU= 38.948
  19:00:18 STEP 1253 H= 313:15 +CPU= 38.023
  19:00:57 STEP 1254 H= 313:30 +CPU= 38.640
  19:01:35 STEP 1255 H= 313:45 +CPU= 38.795
  19:02:15 STEP 1256 H= 314:00 +CPU= 39.745
  19:02:54 STEP 1257 H= 314:15 +CPU= 38.710
  19:03:33 STEP 1258 H= 314:30 +CPU= 38.878
  19:04:12 STEP 1259 H= 314:45 +CPU= 38.810
  19:05:01 STEP 1260 H= 315:00 +CPU= 48.562
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001260
  19:05:40 STEP 1261 H= 315:15 +CPU= 38.715
  19:06:19 STEP 1262 H= 315:30 +CPU= 39.229
  19:07:00 STEP 1263 H= 315:45 +CPU= 40.545
  19:07:41 STEP 1264 H= 316:00 +CPU= 41.364
  19:08:18 STEP 1265 H= 316:15 +CPU= 37.205
  19:08:56 STEP 1266 H= 316:30 +CPU= 37.253
  19:09:33 STEP 1267 H= 316:45 +CPU= 37.608
  19:10:11 STEP 1268 H= 317:00 +CPU= 37.641
  19:10:48 STEP 1269 H= 317:15 +CPU= 37.248
  19:11:25 STEP 1270 H= 317:30 +CPU= 36.992
  19:12:02 STEP 1271 H= 317:45 +CPU= 37.004
  19:12:49 STEP 1272 H= 318:00 +CPU= 46.734
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001272
  19:13:26 STEP 1273 H= 318:15 +CPU= 36.725
  19:14:03 STEP 1274 H= 318:30 +CPU= 36.869
  19:14:42 STEP 1275 H= 318:45 +CPU= 39.212
  19:15:21 STEP 1276 H= 319:00 +CPU= 38.964
  19:15:58 STEP 1277 H= 319:15 +CPU= 37.277
  19:16:36 STEP 1278 H= 319:30 +CPU= 38.400
  19:17:15 STEP 1279 H= 319:45 +CPU= 38.504
  19:17:54 STEP 1280 H= 320:00 +CPU= 38.766
  19:18:32 STEP 1281 H= 320:15 +CPU= 37.712
  19:19:10 STEP 1282 H= 320:30 +CPU= 38.669
  19:19:49 STEP 1283 H= 320:45 +CPU= 38.672
  19:20:37 STEP 1284 H= 321:00 +CPU= 48.147
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001284
  19:21:15 STEP 1285 H= 321:15 +CPU= 37.775
  19:21:53 STEP 1286 H= 321:30 +CPU= 37.776
  19:22:31 STEP 1287 H= 321:45 +CPU= 37.494
  19:23:10 STEP 1288 H= 322:00 +CPU= 39.402
  19:23:50 STEP 1289 H= 322:15 +CPU= 39.748
  19:24:28 STEP 1290 H= 322:30 +CPU= 38.238
  19:25:06 STEP 1291 H= 322:45 +CPU= 37.500
  19:25:44 STEP 1292 H= 323:00 +CPU= 38.242
  19:26:22 STEP 1293 H= 323:15 +CPU= 37.538
  19:26:59 STEP 1294 H= 323:30 +CPU= 37.488
  19:27:39 STEP 1295 H= 323:45 +CPU= 39.587
  19:28:31 STEP 1296 H= 324:00 +CPU= 52.445
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001296
  19:29:08 STEP 1297 H= 324:15 +CPU= 37.072
  19:29:46 STEP 1298 H= 324:30 +CPU= 37.891
  19:30:24 STEP 1299 H= 324:45 +CPU= 38.003
  19:31:02 STEP 1300 H= 325:00 +CPU= 37.717
  19:31:38 STEP 1301 H= 325:15 +CPU= 36.587
  19:32:15 STEP 1302 H= 325:30 +CPU= 36.601
  19:32:52 STEP 1303 H= 325:45 +CPU= 36.460
  19:33:29 STEP 1304 H= 326:00 +CPU= 37.606
  19:34:06 STEP 1305 H= 326:15 +CPU= 36.910
  19:34:44 STEP 1306 H= 326:30 +CPU= 37.540
  19:35:21 STEP 1307 H= 326:45 +CPU= 37.493
  19:36:09 STEP 1308 H= 327:00 +CPU= 47.729
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001308
  19:36:48 STEP 1309 H= 327:15 +CPU= 38.841
  19:37:27 STEP 1310 H= 327:30 +CPU= 38.278
  19:38:04 STEP 1311 H= 327:45 +CPU= 37.454
  19:38:42 STEP 1312 H= 328:00 +CPU= 38.314
  19:39:20 STEP 1313 H= 328:15 +CPU= 37.553
  19:39:57 STEP 1314 H= 328:30 +CPU= 37.461
  19:40:34 STEP 1315 H= 328:45 +CPU= 36.889
  19:41:12 STEP 1316 H= 329:00 +CPU= 37.691
  19:41:49 STEP 1317 H= 329:15 +CPU= 37.045
  19:42:26 STEP 1318 H= 329:30 +CPU= 37.060
  19:43:04 STEP 1319 H= 329:45 +CPU= 37.564
  19:43:53 STEP 1320 H= 330:00 +CPU= 49.634
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001320
  19:44:32 STEP 1321 H= 330:15 +CPU= 38.508
  19:45:09 STEP 1322 H= 330:30 +CPU= 37.123
  19:45:46 STEP 1323 H= 330:45 +CPU= 37.322
  19:46:24 STEP 1324 H= 331:00 +CPU= 38.094
  19:47:02 STEP 1325 H= 331:15 +CPU= 37.175
  19:47:39 STEP 1326 H= 331:30 +CPU= 37.085
  19:48:16 STEP 1327 H= 331:45 +CPU= 37.097
  19:48:54 STEP 1328 H= 332:00 +CPU= 37.953
  19:49:31 STEP 1329 H= 332:15 +CPU= 36.659
  19:50:08 STEP 1330 H= 332:30 +CPU= 36.882
  19:50:45 STEP 1331 H= 332:45 +CPU= 36.903
  19:51:33 STEP 1332 H= 333:00 +CPU= 47.939
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001332
  19:52:12 STEP 1333 H= 333:15 +CPU= 38.651
  19:52:51 STEP 1334 H= 333:30 +CPU= 39.311
  19:53:30 STEP 1335 H= 333:45 +CPU= 39.386
  19:54:11 STEP 1336 H= 334:00 +CPU= 40.142
  19:54:49 STEP 1337 H= 334:15 +CPU= 38.756
  19:55:28 STEP 1338 H= 334:30 +CPU= 38.574
  19:56:06 STEP 1339 H= 334:45 +CPU= 38.597
  19:56:46 STEP 1340 H= 335:00 +CPU= 39.653
  19:57:25 STEP 1341 H= 335:15 +CPU= 38.463
  19:58:02 STEP 1342 H= 335:30 +CPU= 37.691
  19:58:40 STEP 1343 H= 335:45 +CPU= 37.561
  19:59:32 STEP 1344 H= 336:00 +CPU= 51.539
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+001332
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0r4_2016092300_20_1017_12282803_0_r1774540839_13.zip
Uploading the intermediate file: upload_file_13.zip
  20:00:09 STEP 1345 H= 336:15 +CPU= 36.886
  20:00:46 STEP 1346 H= 336:30 +CPU= 36.619
  20:01:23 STEP 1347 H= 336:45 +CPU= 37.124
  20:02:01 STEP 1348 H= 337:00 +CPU= 37.923
  20:02:38 STEP 1349 H= 337:15 +CPU= 37.031
  20:03:15 STEP 1350 H= 337:30 +CPU= 37.052
  20:03:52 STEP 1351 H= 337:45 +CPU= 37.119
  20:04:30 STEP 1352 H= 338:00 +CPU= 37.563
  20:05:07 STEP 1353 H= 338:15 +CPU= 37.046
  20:05:45 STEP 1354 H= 338:30 +CPU= 37.059
  20:06:22 STEP 1355 H= 338:45 +CPU= 37.025
  20:07:09 STEP 1356 H= 339:00 +CPU= 47.065
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001356
  20:07:46 STEP 1357 H= 339:15 +CPU= 36.782
  20:08:22 STEP 1358 H= 339:30 +CPU= 36.795
  20:09:00 STEP 1359 H= 339:45 +CPU= 37.263
  20:09:38 STEP 1360 H= 340:00 +CPU= 38.501
  20:10:16 STEP 1361 H= 340:15 +CPU= 37.663
  20:10:54 STEP 1362 H= 340:30 +CPU= 37.691
  20:11:31 STEP 1363 H= 340:45 +CPU= 37.632
  20:12:10 STEP 1364 H= 341:00 +CPU= 38.647
  20:12:48 STEP 1365 H= 341:15 +CPU= 37.811
  20:13:25 STEP 1366 H= 341:30 +CPU= 37.283
  20:14:02 STEP 1367 H= 341:45 +CPU= 37.294
  20:14:49 STEP 1368 H= 342:00 +CPU= 46.631
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001368
  20:15:26 STEP 1369 H= 342:15 +CPU= 37.073
  20:16:03 STEP 1370 H= 342:30 +CPU= 37.097
  20:16:41 STEP 1371 H= 342:45 +CPU= 37.703
  20:17:20 STEP 1372 H= 343:00 +CPU= 38.716
  20:17:58 STEP 1373 H= 343:15 +CPU= 37.949
  20:18:35 STEP 1374 H= 343:30 +CPU= 37.382
  20:19:13 STEP 1375 H= 343:45 +CPU= 37.936
  20:19:52 STEP 1376 H= 344:00 +CPU= 38.777
  20:20:30 STEP 1377 H= 344:15 +CPU= 37.483
  20:21:08 STEP 1378 H= 344:30 +CPU= 37.604
  20:21:46 STEP 1379 H= 344:45 +CPU= 37.876
  20:22:34 STEP 1380 H= 345:00 +CPU= 48.067
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001380
  20:23:12 STEP 1381 H= 345:15 +CPU= 38.077
  20:23:50 STEP 1382 H= 345:30 +CPU= 38.481
  20:24:29 STEP 1383 H= 345:45 +CPU= 39.219
  20:25:09 STEP 1384 H= 346:00 +CPU= 39.979
  20:25:49 STEP 1385 H= 346:15 +CPU= 39.044
  20:26:28 STEP 1386 H= 346:30 +CPU= 38.990
  20:27:07 STEP 1387 H= 346:45 +CPU= 38.994
  20:27:46 STEP 1388 H= 347:00 +CPU= 39.621
  20:28:25 STEP 1389 H= 347:15 +CPU= 38.679
  20:29:03 STEP 1390 H= 347:30 +CPU= 38.348
  20:29:41 STEP 1391 H= 347:45 +CPU= 37.446
  20:30:33 STEP 1392 H= 348:00 +CPU= 51.721
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001392
  20:31:10 STEP 1393 H= 348:15 +CPU= 37.055
  20:31:48 STEP 1394 H= 348:30 +CPU= 38.114
  20:32:26 STEP 1395 H= 348:45 +CPU= 37.947
  20:33:04 STEP 1396 H= 349:00 +CPU= 37.853
  20:33:42 STEP 1397 H= 349:15 +CPU= 38.228
  20:34:20 STEP 1398 H= 349:30 +CPU= 37.796
  20:34:57 STEP 1399 H= 349:45 +CPU= 37.150
  20:35:37 STEP 1400 H= 350:00 +CPU= 39.466
  20:36:16 STEP 1401 H= 350:15 +CPU= 38.409
  20:36:54 STEP 1402 H= 350:30 +CPU= 38.004
  20:37:31 STEP 1403 H= 350:45 +CPU= 37.268
  20:38:18 STEP 1404 H= 351:00 +CPU= 47.008
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001404
  20:38:55 STEP 1405 H= 351:15 +CPU= 37.089
  20:39:33 STEP 1406 H= 351:30 +CPU= 37.717
  20:40:10 STEP 1407 H= 351:45 +CPU= 37.566
  20:40:48 STEP 1408 H= 352:00 +CPU= 37.955
  20:41:26 STEP 1409 H= 352:15 +CPU= 37.334
  20:42:03 STEP 1410 H= 352:30 +CPU= 37.266
  20:42:41 STEP 1411 H= 352:45 +CPU= 37.742
  20:43:20 STEP 1412 H= 353:00 +CPU= 38.867
  20:43:59 STEP 1413 H= 353:15 +CPU= 39.193
  20:44:38 STEP 1414 H= 353:30 +CPU= 39.085
  20:45:17 STEP 1415 H= 353:45 +CPU= 38.843
  20:46:05 STEP 1416 H= 354:00 +CPU= 47.837
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001416
  20:46:42 STEP 1417 H= 354:15 +CPU= 37.572
  20:47:20 STEP 1418 H= 354:30 +CPU= 37.741
  20:47:58 STEP 1419 H= 354:45 +CPU= 37.918
  20:48:38 STEP 1420 H= 355:00 +CPU= 39.606
  20:49:17 STEP 1421 H= 355:15 +CPU= 39.254
  20:49:56 STEP 1422 H= 355:30 +CPU= 39.249
  20:50:35 STEP 1423 H= 355:45 +CPU= 38.211
  20:51:14 STEP 1424 H= 356:00 +CPU= 38.937
  20:51:52 STEP 1425 H= 356:15 +CPU= 38.020
  20:52:30 STEP 1426 H= 356:30 +CPU= 38.526
  20:53:09 STEP 1427 H= 356:45 +CPU= 39.073
  20:53:57 STEP 1428 H= 357:00 +CPU= 47.746
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001428
  20:54:35 STEP 1429 H= 357:15 +CPU= 37.745
  20:55:13 STEP 1430 H= 357:30 +CPU= 37.816
  20:55:50 STEP 1431 H= 357:45 +CPU= 37.383
  20:56:29 STEP 1432 H= 358:00 +CPU= 38.625
  20:57:07 STEP 1433 H= 358:15 +CPU= 37.878
  20:57:45 STEP 1434 H= 358:30 +CPU= 37.889
  20:58:23 STEP 1435 H= 358:45 +CPU= 38.409
  20:59:02 STEP 1436 H= 359:00 +CPU= 39.069
  20:59:40 STEP 1437 H= 359:15 +CPU= 37.862
  21:00:18 STEP 1438 H= 359:30 +CPU= 38.107
  21:00:56 STEP 1439 H= 359:45 +CPU= 37.851
  21:01:46 STEP 1440 H= 360:00 +CPU= 49.451
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I      0.4440938485E-21      I       0.4433815631E-06      I
ICloud fractionI      0.0000000000E+00      I       0.1185040110E-01      I
I  Relat. Hum. I      0.5273470055E+00      I       0.5383320962E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.2364052201E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    302513620 BYTES IN      7 RECORDS TRANSFERRED IN    0.0006 SECONDS504189.4 Mbytes/s, TOTAL TIME=    0.0159( 3.8%)
 21:01:46 STEP 1440 H= 360:00 +CPU= 49.451
 END CNT3
 NSTEP =  1440 CNT0   000000000  35.804  35.804  35.824   0.999               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ            0/           0 WRITTEN        43246/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    758    0        0            0    43246 ************   123.6     0.0   123.6     0.0   254.0
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.98      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 1562    6620.4    6620.4     16.22      0.00
   9 SPCM     - SPECTRAL COMP.                    1440    1177.2    1177.2      2.66      0.00
  10 SCAN2M - PHYSICS                             1441   21263.1   21263.1     48.05      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                121    1294.9    1294.9      0.25      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 63      56.0      56.0      0.01      0.00
  14 SUINIF                                          1   10828.9   10828.9      0.02      0.00
  17 GRIDFPOS IN CNT4                              121      52.3      52.3      0.01      0.00
  18 SUSPECG                                         1    5216.9    5216.9      0.01      0.00
  19 SUSPEC                                          1    5225.5    5225.5      0.01      0.00
  24 SUGRIDU                                         1    4335.8    4335.8      0.01      0.00
  25 SPECRT                                          1     350.4     350.4      0.00      0.00
  26 SUGRIDF                                         1     917.2     917.2      0.00      0.00
  27 RESTART FILES - WRITING                        30    5222.8    5222.8      0.25      0.00
  28 RESTART FILES - READING                         1       0.0       0.0      0.00      0.00
  29 SU4FPOS IN CNT4                               121       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                               121    9761.7    9761.7      1.85      0.00
  31 POSDDH IN STEPO                                 7     150.2     150.2      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   1441    9030.6    9030.6     20.41      0.00
  39 SU0YOMB                                         1     362.4     362.4      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   1441      41.4      41.4      0.09      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             1440     447.0     447.0      1.01      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             1440      89.3      89.3      0.20      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 63       0.3       0.3      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     3125     813.8     813.8      3.99      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      3006     435.8     435.8      2.05      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       3006     160.6     160.6      0.76      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      3125     232.4     232.4      1.14      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      40.0      40.0      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           3125      77.3      77.3      0.38      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           3006      37.9      37.9      0.18      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           3125     144.6     144.6      0.71      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           3006      64.8      64.8      0.31      0.00
 400 GSTATS                                     167734       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                156066       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    63764.1 CPU TIME   63510.4 VECTOR TIME    63510.4


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       20.3
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/slots/1/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/1/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282803/ICMGGh7zg+001344
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0r4_2016092300_20_1017_12282803_0_r1774540839_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
21:05:19 (2449894): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>oifs_43r3_bl_a0r4_2016092300_20_1017_12282803_0_r1774540839_15.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a0r4_2016092300_20_1017_12282803_0_r1774540839_16.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a0r4_2016092300_20_1017_12282803_0_r1774540839_17.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a0r4_2016092300_20_1017_12282803_0_r1774540839_18.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a0r4_2016092300_20_1017_12282803_0_r1774540839_19.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 Jun 2024 02:09:04 1538911 22434372 oifs_43r3_bl_a0r4_2016092300_20_1017_12282803_0 1,295,100 63,510 0.0490
08 Jun 2024 21:00:52 1538911 22434372 oifs_43r3_bl_a0r4_2016092300_20_1017_12282803_0 864,000 44,136 0.0511


©2024 climateprediction.net