climateprediction.net home page
Task 22438829

Task 22438829

Name oifs_43r3_bl_a459_2016092300_20_1017_12287200_0
Workunit 12287200
Created 7 Jun 2024, 18:36:42 UTC
Sent 7 Jun 2024, 19:06:49 UTC
Report deadline 6 Aug 2024, 19:06:49 UTC
Received 8 Jun 2024, 8:12:38 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1538890
Run time 12 hours 55 min 51 sec
CPU time 12 hours 50 min 13 sec
Validate state Invalid
Credit 1,976.32
Device peak FLOPS 5.44 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,024.39 MB
Peak swap size 5,980.80 MB
Peak disk usage 1,285.81 MB
Stderr
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<stderr_txt>
 834 H= 208:30 +CPU= 32.879
  21:32:51 STEP  835 H= 208:45 +CPU= 32.894
  21:33:25 STEP  836 H= 209:00 +CPU= 33.562
  21:33:58 STEP  837 H= 209:15 +CPU= 32.734
  21:34:31 STEP  838 H= 209:30 +CPU= 32.546
  21:35:04 STEP  839 H= 209:45 +CPU= 32.836
  21:35:45 STEP  840 H= 210:00 +CPU= 41.144
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000840
  21:36:19 STEP  841 H= 210:15 +CPU= 33.030
  21:36:54 STEP  842 H= 210:30 +CPU= 34.722
  21:37:26 STEP  843 H= 210:45 +CPU= 32.448
  21:37:59 STEP  844 H= 211:00 +CPU= 32.996
  21:38:35 STEP  845 H= 211:15 +CPU= 34.448
  21:39:09 STEP  846 H= 211:30 +CPU= 34.694
  21:39:44 STEP  847 H= 211:45 +CPU= 34.403
  21:40:18 STEP  848 H= 212:00 +CPU= 33.327
  21:40:51 STEP  849 H= 212:15 +CPU= 32.971
  21:41:24 STEP  850 H= 212:30 +CPU= 33.069
  21:41:57 STEP  851 H= 212:45 +CPU= 32.987
  21:42:37 STEP  852 H= 213:00 +CPU= 40.614
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000852
  21:43:10 STEP  853 H= 213:15 +CPU= 32.566
  21:43:44 STEP  854 H= 213:30 +CPU= 33.460
  21:44:16 STEP  855 H= 213:45 +CPU= 32.203
  21:44:50 STEP  856 H= 214:00 +CPU= 33.605
  21:45:25 STEP  857 H= 214:15 +CPU= 35.682
  21:45:58 STEP  858 H= 214:30 +CPU= 32.342
  21:46:30 STEP  859 H= 214:45 +CPU= 32.265
  21:47:04 STEP  860 H= 215:00 +CPU= 33.943
  21:47:37 STEP  861 H= 215:15 +CPU= 33.088
  21:48:11 STEP  862 H= 215:30 +CPU= 33.312
  21:48:46 STEP  863 H= 215:45 +CPU= 35.446
  21:49:34 STEP  864 H= 216:00 +CPU= 47.866
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+000852
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a459_2016092300_20_1017_12287200_0_r684755819_8.zip
Uploading the intermediate file: upload_file_8.zip
  21:50:07 STEP  865 H= 216:15 +CPU= 32.820
  21:50:42 STEP  866 H= 216:30 +CPU= 34.608
  21:51:16 STEP  867 H= 216:45 +CPU= 34.760
  21:51:52 STEP  868 H= 217:00 +CPU= 35.971
  21:52:27 STEP  869 H= 217:15 +CPU= 34.683
  21:53:03 STEP  870 H= 217:30 +CPU= 36.016
  21:53:38 STEP  871 H= 217:45 +CPU= 34.387
  21:54:12 STEP  872 H= 218:00 +CPU= 34.013
  21:54:45 STEP  873 H= 218:15 +CPU= 33.634
  21:55:18 STEP  874 H= 218:30 +CPU= 32.874
  21:55:51 STEP  875 H= 218:45 +CPU= 32.715
  21:56:33 STEP  876 H= 219:00 +CPU= 42.386
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000876
  21:57:06 STEP  877 H= 219:15 +CPU= 32.864
  21:57:39 STEP  878 H= 219:30 +CPU= 32.446
  21:58:11 STEP  879 H= 219:45 +CPU= 32.374
  21:58:47 STEP  880 H= 220:00 +CPU= 36.126
  21:59:20 STEP  881 H= 220:15 +CPU= 32.117
  21:59:55 STEP  882 H= 220:30 +CPU= 35.605
  22:00:28 STEP  883 H= 220:45 +CPU= 32.496
  22:01:01 STEP  884 H= 221:00 +CPU= 32.906
  22:01:34 STEP  885 H= 221:15 +CPU= 33.108
  22:02:07 STEP  886 H= 221:30 +CPU= 32.724
  22:02:39 STEP  887 H= 221:45 +CPU= 32.516
  22:03:20 STEP  888 H= 222:00 +CPU= 40.111
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000888
  22:03:54 STEP  889 H= 222:15 +CPU= 34.223
  22:04:31 STEP  890 H= 222:30 +CPU= 36.570
  22:05:05 STEP  891 H= 222:45 +CPU= 34.524
  22:05:39 STEP  892 H= 223:00 +CPU= 33.326
  22:06:14 STEP  893 H= 223:15 +CPU= 35.589
  22:06:47 STEP  894 H= 223:30 +CPU= 32.326
  22:07:19 STEP  895 H= 223:45 +CPU= 32.375
  22:07:52 STEP  896 H= 224:00 +CPU= 32.921
  22:08:26 STEP  897 H= 224:15 +CPU= 33.699
  22:09:00 STEP  898 H= 224:30 +CPU= 34.084
  22:09:33 STEP  899 H= 224:45 +CPU= 32.696
  22:10:13 STEP  900 H= 225:00 +CPU= 40.079
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000900
  22:10:46 STEP  901 H= 225:15 +CPU= 33.307
  22:11:22 STEP  902 H= 225:30 +CPU= 35.330
  22:11:55 STEP  903 H= 225:45 +CPU= 32.790
  22:12:27 STEP  904 H= 226:00 +CPU= 32.829
  22:13:01 STEP  905 H= 226:15 +CPU= 33.442
  22:13:35 STEP  906 H= 226:30 +CPU= 34.485
  22:14:08 STEP  907 H= 226:45 +CPU= 32.213
  22:14:41 STEP  908 H= 227:00 +CPU= 33.283
  22:15:14 STEP  909 H= 227:15 +CPU= 32.868
  22:15:49 STEP  910 H= 227:30 +CPU= 35.375
  22:16:22 STEP  911 H= 227:45 +CPU= 32.737
  22:17:08 STEP  912 H= 228:00 +CPU= 45.557
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000912
  22:17:43 STEP  913 H= 228:15 +CPU= 35.588
  22:18:17 STEP  914 H= 228:30 +CPU= 33.463
  22:18:49 STEP  915 H= 228:45 +CPU= 32.210
  22:19:23 STEP  916 H= 229:00 +CPU= 33.968
  22:19:56 STEP  917 H= 229:15 +CPU= 32.353
  22:20:29 STEP  918 H= 229:30 +CPU= 33.394
  22:21:04 STEP  919 H= 229:45 +CPU= 34.681
  22:21:40 STEP  920 H= 230:00 +CPU= 36.104
  22:22:14 STEP  921 H= 230:15 +CPU= 33.434
  22:22:47 STEP  922 H= 230:30 +CPU= 32.843
  22:23:20 STEP  923 H= 230:45 +CPU= 32.734
  22:24:01 STEP  924 H= 231:00 +CPU= 41.339
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000924
  22:24:35 STEP  925 H= 231:15 +CPU= 33.076
  22:25:08 STEP  926 H= 231:30 +CPU= 32.930
  22:25:41 STEP  927 H= 231:45 +CPU= 33.012
  22:26:14 STEP  928 H= 232:00 +CPU= 33.559
  22:26:47 STEP  929 H= 232:15 +CPU= 32.793
  22:27:20 STEP  930 H= 232:30 +CPU= 32.629
  22:27:52 STEP  931 H= 232:45 +CPU= 32.306
  22:28:25 STEP  932 H= 233:00 +CPU= 33.253
  22:28:58 STEP  933 H= 233:15 +CPU= 32.627
  22:29:31 STEP  934 H= 233:30 +CPU= 32.563
  22:30:03 STEP  935 H= 233:45 +CPU= 32.581
  22:30:44 STEP  936 H= 234:00 +CPU= 40.166
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000936
  22:31:18 STEP  937 H= 234:15 +CPU= 34.196
  22:31:54 STEP  938 H= 234:30 +CPU= 35.570
  22:32:29 STEP  939 H= 234:45 +CPU= 35.509
  22:33:03 STEP  940 H= 235:00 +CPU= 33.605
  22:33:36 STEP  941 H= 235:15 +CPU= 32.381
  22:34:10 STEP  942 H= 235:30 +CPU= 33.958
  22:34:43 STEP  943 H= 235:45 +CPU= 32.900
  22:35:16 STEP  944 H= 236:00 +CPU= 32.990
  22:35:49 STEP  945 H= 236:15 +CPU= 32.870
  22:36:24 STEP  946 H= 236:30 +CPU= 35.635
  22:37:00 STEP  947 H= 236:45 +CPU= 35.324
  22:37:43 STEP  948 H= 237:00 +CPU= 43.349
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000948
  22:38:15 STEP  949 H= 237:15 +CPU= 32.357
  22:38:48 STEP  950 H= 237:30 +CPU= 32.482
  22:39:21 STEP  951 H= 237:45 +CPU= 32.811
  22:39:55 STEP  952 H= 238:00 +CPU= 34.162
  22:40:30 STEP  953 H= 238:15 +CPU= 34.748
  22:41:05 STEP  954 H= 238:30 +CPU= 34.997
  22:41:38 STEP  955 H= 238:45 +CPU= 32.697
  22:42:13 STEP  956 H= 239:00 +CPU= 35.358
  22:42:48 STEP  957 H= 239:15 +CPU= 34.566
  22:43:22 STEP  958 H= 239:30 +CPU= 34.592
  22:43:57 STEP  959 H= 239:45 +CPU= 34.391
  22:44:43 STEP  960 H= 240:00 +CPU= 46.506
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+000948
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a459_2016092300_20_1017_12287200_0_r684755819_9.zip
Uploading the intermediate file: upload_file_9.zip
  22:45:18 STEP  961 H= 240:15 +CPU= 34.468
Uploading trickle at timestep: 864000
  22:45:52 STEP  962 H= 240:30 +CPU= 34.482
  22:46:27 STEP  963 H= 240:45 +CPU= 34.545
  22:46:59 STEP  964 H= 241:00 +CPU= 32.280
  22:47:30 STEP  965 H= 241:15 +CPU= 31.503
  22:48:02 STEP  966 H= 241:30 +CPU= 31.659
  22:48:37 STEP  967 H= 241:45 +CPU= 34.744
  22:49:12 STEP  968 H= 242:00 +CPU= 35.281
  22:49:45 STEP  969 H= 242:15 +CPU= 32.562
  22:50:18 STEP  970 H= 242:30 +CPU= 32.500
  22:50:52 STEP  971 H= 242:45 +CPU= 33.910
  22:51:33 STEP  972 H= 243:00 +CPU= 41.014
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000972
  22:52:05 STEP  973 H= 243:15 +CPU= 31.996
  22:52:37 STEP  974 H= 243:30 +CPU= 31.576
  22:53:07 STEP  975 H= 243:45 +CPU= 30.239
  22:53:39 STEP  976 H= 244:00 +CPU= 32.197
  22:54:11 STEP  977 H= 244:15 +CPU= 31.992
  22:54:43 STEP  978 H= 244:30 +CPU= 32.130
  22:55:15 STEP  979 H= 244:45 +CPU= 32.139
  22:55:48 STEP  980 H= 245:00 +CPU= 32.667
  22:56:20 STEP  981 H= 245:15 +CPU= 32.299
  22:56:53 STEP  982 H= 245:30 +CPU= 32.191
  22:57:25 STEP  983 H= 245:45 +CPU= 32.063
  22:58:05 STEP  984 H= 246:00 +CPU= 39.903
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000984
  22:58:37 STEP  985 H= 246:15 +CPU= 31.910
  22:59:09 STEP  986 H= 246:30 +CPU= 31.715
  22:59:44 STEP  987 H= 246:45 +CPU= 34.717
  23:00:17 STEP  988 H= 247:00 +CPU= 32.912
  23:00:49 STEP  989 H= 247:15 +CPU= 32.023
  23:01:22 STEP  990 H= 247:30 +CPU= 32.893
  23:01:54 STEP  991 H= 247:45 +CPU= 32.064
  23:02:27 STEP  992 H= 248:00 +CPU= 32.822
  23:03:02 STEP  993 H= 248:15 +CPU= 34.900
  23:03:34 STEP  994 H= 248:30 +CPU= 32.006
  23:04:06 STEP  995 H= 248:45 +CPU= 32.113
  23:04:48 STEP  996 H= 249:00 +CPU= 41.874
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000996
  23:05:22 STEP  997 H= 249:15 +CPU= 34.020
  23:05:54 STEP  998 H= 249:30 +CPU= 32.016
  23:06:30 STEP  999 H= 249:45 +CPU= 35.412
  23:07:03 STEP 1000 H= 250:00 +CPU= 33.181
  23:07:36 STEP 1001 H= 250:15 +CPU= 33.065
  23:08:12 STEP 1002 H= 250:30 +CPU= 36.038
  23:08:47 STEP 1003 H= 250:45 +CPU= 34.766
  23:09:20 STEP 1004 H= 251:00 +CPU= 33.331
  23:09:53 STEP 1005 H= 251:15 +CPU= 32.816
  23:10:26 STEP 1006 H= 251:30 +CPU= 32.742
  23:10:59 STEP 1007 H= 251:45 +CPU= 32.980
  23:11:44 STEP 1008 H= 252:00 +CPU= 44.403
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001008
  23:12:16 STEP 1009 H= 252:15 +CPU= 32.494
  23:12:50 STEP 1010 H= 252:30 +CPU= 33.691
  23:13:22 STEP 1011 H= 252:45 +CPU= 32.290
  23:13:55 STEP 1012 H= 253:00 +CPU= 32.843
  23:14:27 STEP 1013 H= 253:15 +CPU= 32.295
  23:15:02 STEP 1014 H= 253:30 +CPU= 34.304
  23:15:34 STEP 1015 H= 253:45 +CPU= 31.898
  23:16:09 STEP 1016 H= 254:00 +CPU= 34.446
  23:16:39 STEP 1017 H= 254:15 +CPU= 30.580
  23:17:09 STEP 1018 H= 254:30 +CPU= 29.518
  23:17:38 STEP 1019 H= 254:45 +CPU= 29.268
  23:18:15 STEP 1020 H= 255:00 +CPU= 36.984
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001020
  23:18:45 STEP 1021 H= 255:15 +CPU= 30.019
  23:19:16 STEP 1022 H= 255:30 +CPU= 30.067
  23:19:46 STEP 1023 H= 255:45 +CPU= 30.112
  23:20:18 STEP 1024 H= 256:00 +CPU= 31.213
  23:20:48 STEP 1025 H= 256:15 +CPU= 29.946
  23:21:19 STEP 1026 H= 256:30 +CPU= 30.494
  23:21:49 STEP 1027 H= 256:45 +CPU= 30.351
  23:22:20 STEP 1028 H= 257:00 +CPU= 30.974
  23:22:51 STEP 1029 H= 257:15 +CPU= 30.576
  23:23:22 STEP 1030 H= 257:30 +CPU= 31.613
  23:23:55 STEP 1031 H= 257:45 +CPU= 32.777
  23:24:35 STEP 1032 H= 258:00 +CPU= 39.997
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001032
  23:25:07 STEP 1033 H= 258:15 +CPU= 31.256
  23:25:38 STEP 1034 H= 258:30 +CPU= 31.302
  23:26:09 STEP 1035 H= 258:45 +CPU= 31.514
  23:26:41 STEP 1036 H= 259:00 +CPU= 31.595
  23:27:12 STEP 1037 H= 259:15 +CPU= 29.719
  23:27:41 STEP 1038 H= 259:30 +CPU= 29.456
  23:28:11 STEP 1039 H= 259:45 +CPU= 29.413
  23:28:41 STEP 1040 H= 260:00 +CPU= 30.127
  23:29:11 STEP 1041 H= 260:15 +CPU= 29.132
  23:29:40 STEP 1042 H= 260:30 +CPU= 29.391
  23:30:10 STEP 1043 H= 260:45 +CPU= 29.536
  23:30:46 STEP 1044 H= 261:00 +CPU= 36.904
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001044
  23:31:17 STEP 1045 H= 261:15 +CPU= 30.314
  23:31:49 STEP 1046 H= 261:30 +CPU= 31.638
  23:32:19 STEP 1047 H= 261:45 +CPU= 30.094
  23:32:50 STEP 1048 H= 262:00 +CPU= 31.079
  23:33:21 STEP 1049 H= 262:15 +CPU= 30.754
  23:33:52 STEP 1050 H= 262:30 +CPU= 30.918
  23:34:22 STEP 1051 H= 262:45 +CPU= 29.776
  23:34:52 STEP 1052 H= 263:00 +CPU= 30.300
  23:35:22 STEP 1053 H= 263:15 +CPU= 29.669
  23:35:52 STEP 1054 H= 263:30 +CPU= 30.209
  23:36:23 STEP 1055 H= 263:45 +CPU= 30.224
  23:37:04 STEP 1056 H= 264:00 +CPU= 41.169
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+001044
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a459_2016092300_20_1017_12287200_0_r684755819_10.zip
Uploading the intermediate file: upload_file_10.zip
  23:37:36 STEP 1057 H= 264:15 +CPU= 29.978
  23:38:06 STEP 1058 H= 264:30 +CPU= 29.733
  23:38:36 STEP 1059 H= 264:45 +CPU= 29.384
  23:39:07 STEP 1060 H= 265:00 +CPU= 31.381
  23:39:38 STEP 1061 H= 265:15 +CPU= 30.723
  23:40:09 STEP 1062 H= 265:30 +CPU= 30.400
  23:40:39 STEP 1063 H= 265:45 +CPU= 30.693
  23:41:11 STEP 1064 H= 266:00 +CPU= 31.376
  23:41:44 STEP 1065 H= 266:15 +CPU= 32.414
  23:42:15 STEP 1066 H= 266:30 +CPU= 30.967
  23:42:46 STEP 1067 H= 266:45 +CPU= 31.492
  23:43:25 STEP 1068 H= 267:00 +CPU= 38.525
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001068
  23:43:56 STEP 1069 H= 267:15 +CPU= 31.571
  23:44:26 STEP 1070 H= 267:30 +CPU= 29.867
  23:44:56 STEP 1071 H= 267:45 +CPU= 29.344
  23:45:25 STEP 1072 H= 268:00 +CPU= 29.120
  23:45:54 STEP 1073 H= 268:15 +CPU= 29.266
  23:46:23 STEP 1074 H= 268:30 +CPU= 28.683
  23:46:52 STEP 1075 H= 268:45 +CPU= 29.712
  23:47:23 STEP 1076 H= 269:00 +CPU= 30.281
  23:47:52 STEP 1077 H= 269:15 +CPU= 29.459
  23:48:22 STEP 1078 H= 269:30 +CPU= 30.031
  23:48:53 STEP 1079 H= 269:45 +CPU= 30.413
  23:49:31 STEP 1080 H= 270:00 +CPU= 37.911
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001080
  23:50:01 STEP 1081 H= 270:15 +CPU= 30.427
  23:50:33 STEP 1082 H= 270:30 +CPU= 31.313
  23:51:05 STEP 1083 H= 270:45 +CPU= 31.575
  23:51:37 STEP 1084 H= 271:00 +CPU= 32.511
  23:52:08 STEP 1085 H= 271:15 +CPU= 30.958
  23:52:39 STEP 1086 H= 271:30 +CPU= 30.663
  23:53:10 STEP 1087 H= 271:45 +CPU= 31.042
  23:53:43 STEP 1088 H= 272:00 +CPU= 32.596
  23:54:13 STEP 1089 H= 272:15 +CPU= 30.605
  23:54:45 STEP 1090 H= 272:30 +CPU= 31.837
  23:55:16 STEP 1091 H= 272:45 +CPU= 30.659
  23:55:56 STEP 1092 H= 273:00 +CPU= 39.687
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001092
  23:56:27 STEP 1093 H= 273:15 +CPU= 30.926
  23:56:58 STEP 1094 H= 273:30 +CPU= 30.567
  23:57:28 STEP 1095 H= 273:45 +CPU= 30.485
  23:58:01 STEP 1096 H= 274:00 +CPU= 32.552
  23:58:31 STEP 1097 H= 274:15 +CPU= 30.631
  23:59:04 STEP 1098 H= 274:30 +CPU= 32.129
  23:59:36 STEP 1099 H= 274:45 +CPU= 32.308
  00:00:07 STEP 1100 H= 275:00 +CPU= 30.804
  00:00:37 STEP 1101 H= 275:15 +CPU= 30.507
  00:01:08 STEP 1102 H= 275:30 +CPU= 30.490
  00:01:38 STEP 1103 H= 275:45 +CPU= 30.210
  00:02:21 STEP 1104 H= 276:00 +CPU= 42.713
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001104
  00:02:52 STEP 1105 H= 276:15 +CPU= 30.974
  00:03:23 STEP 1106 H= 276:30 +CPU= 31.021
  00:03:54 STEP 1107 H= 276:45 +CPU= 30.992
  00:04:28 STEP 1108 H= 277:00 +CPU= 33.534
  00:05:00 STEP 1109 H= 277:15 +CPU= 32.258
  00:05:32 STEP 1110 H= 277:30 +CPU= 31.886
  00:06:02 STEP 1111 H= 277:45 +CPU= 30.273
  00:06:34 STEP 1112 H= 278:00 +CPU= 31.804
  00:07:06 STEP 1113 H= 278:15 +CPU= 31.008
  00:07:37 STEP 1114 H= 278:30 +CPU= 31.564
  00:08:08 STEP 1115 H= 278:45 +CPU= 30.977
  00:08:47 STEP 1116 H= 279:00 +CPU= 37.807
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001116
  00:09:18 STEP 1117 H= 279:15 +CPU= 30.695
  00:09:49 STEP 1118 H= 279:30 +CPU= 30.543
  00:10:20 STEP 1119 H= 279:45 +CPU= 30.675
  00:10:51 STEP 1120 H= 280:00 +CPU= 30.924
  00:11:21 STEP 1121 H= 280:15 +CPU= 30.480
  00:11:54 STEP 1122 H= 280:30 +CPU= 32.223
  00:12:25 STEP 1123 H= 280:45 +CPU= 30.784
  00:12:56 STEP 1124 H= 281:00 +CPU= 31.123
  00:13:26 STEP 1125 H= 281:15 +CPU= 30.797
  00:13:58 STEP 1126 H= 281:30 +CPU= 31.250
  00:14:29 STEP 1127 H= 281:45 +CPU= 31.106
  00:15:08 STEP 1128 H= 282:00 +CPU= 38.975
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001128
  00:15:39 STEP 1129 H= 282:15 +CPU= 30.771
  00:16:10 STEP 1130 H= 282:30 +CPU= 30.830
  00:16:42 STEP 1131 H= 282:45 +CPU= 32.320
  00:17:15 STEP 1132 H= 283:00 +CPU= 32.303
  00:17:47 STEP 1133 H= 283:15 +CPU= 31.612
  00:18:18 STEP 1134 H= 283:30 +CPU= 30.886
  00:18:49 STEP 1135 H= 283:45 +CPU= 31.296
  00:19:21 STEP 1136 H= 284:00 +CPU= 31.501
  00:19:51 STEP 1137 H= 284:15 +CPU= 30.824
  00:20:22 STEP 1138 H= 284:30 +CPU= 30.712
  00:20:54 STEP 1139 H= 284:45 +CPU= 31.555
  00:21:32 STEP 1140 H= 285:00 +CPU= 38.281
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001140
  00:22:03 STEP 1141 H= 285:15 +CPU= 30.794
  00:22:34 STEP 1142 H= 285:30 +CPU= 31.002
  00:23:05 STEP 1143 H= 285:45 +CPU= 31.045
  00:23:37 STEP 1144 H= 286:00 +CPU= 31.705
  00:24:08 STEP 1145 H= 286:15 +CPU= 31.144
  00:24:40 STEP 1146 H= 286:30 +CPU= 31.464
  00:25:10 STEP 1147 H= 286:45 +CPU= 30.649
  00:25:42 STEP 1148 H= 287:00 +CPU= 31.435
  00:26:13 STEP 1149 H= 287:15 +CPU= 30.663
  00:26:43 STEP 1150 H= 287:30 +CPU= 30.371
  00:27:14 STEP 1151 H= 287:45 +CPU= 30.613
  00:27:56 STEP 1152 H= 288:00 +CPU= 41.732
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+001140
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a459_2016092300_20_1017_12287200_0_r684755819_11.zip
Uploading the intermediate file: upload_file_11.zip
  00:28:27 STEP 1153 H= 288:15 +CPU= 30.821
  00:28:59 STEP 1154 H= 288:30 +CPU= 32.348
  00:29:31 STEP 1155 H= 288:45 +CPU= 31.957
  00:30:03 STEP 1156 H= 289:00 +CPU= 31.493
  00:30:35 STEP 1157 H= 289:15 +CPU= 32.198
  00:31:06 STEP 1158 H= 289:30 +CPU= 31.044
  00:31:38 STEP 1159 H= 289:45 +CPU= 31.661
  00:32:10 STEP 1160 H= 290:00 +CPU= 31.601
  00:32:44 STEP 1161 H= 290:15 +CPU= 32.099
  00:33:15 STEP 1162 H= 290:30 +CPU= 31.177
  00:33:47 STEP 1163 H= 290:45 +CPU= 31.351
  00:34:26 STEP 1164 H= 291:00 +CPU= 38.723
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001164
  00:34:57 STEP 1165 H= 291:15 +CPU= 30.773
  00:35:28 STEP 1166 H= 291:30 +CPU= 30.482
  00:35:59 STEP 1167 H= 291:45 +CPU= 31.131
  00:36:31 STEP 1168 H= 292:00 +CPU= 31.805
  00:37:01 STEP 1169 H= 292:15 +CPU= 30.534
  00:37:32 STEP 1170 H= 292:30 +CPU= 30.236
  00:38:02 STEP 1171 H= 292:45 +CPU= 30.502
  00:38:34 STEP 1172 H= 293:00 +CPU= 31.757
  00:39:05 STEP 1173 H= 293:15 +CPU= 30.782
  00:39:36 STEP 1174 H= 293:30 +CPU= 30.553
  00:40:06 STEP 1175 H= 293:45 +CPU= 30.430
  00:40:44 STEP 1176 H= 294:00 +CPU= 37.577
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001176
  00:41:14 STEP 1177 H= 294:15 +CPU= 30.366
  00:41:44 STEP 1178 H= 294:30 +CPU= 30.297
  00:42:15 STEP 1179 H= 294:45 +CPU= 30.850
  00:42:47 STEP 1180 H= 295:00 +CPU= 31.150
  00:43:17 STEP 1181 H= 295:15 +CPU= 30.323
  00:43:50 STEP 1182 H= 295:30 +CPU= 32.704
  00:44:20 STEP 1183 H= 295:45 +CPU= 30.301
  00:44:52 STEP 1184 H= 296:00 +CPU= 31.698
  00:45:24 STEP 1185 H= 296:15 +CPU= 30.641
  00:45:55 STEP 1186 H= 296:30 +CPU= 30.986
  00:46:27 STEP 1187 H= 296:45 +CPU= 31.599
  00:47:07 STEP 1188 H= 297:00 +CPU= 39.431
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001188
  00:47:39 STEP 1189 H= 297:15 +CPU= 32.162
  00:48:10 STEP 1190 H= 297:30 +CPU= 30.640
  00:48:40 STEP 1191 H= 297:45 +CPU= 30.633
  00:49:11 STEP 1192 H= 298:00 +CPU= 31.230
  00:49:42 STEP 1193 H= 298:15 +CPU= 30.702
  00:50:12 STEP 1194 H= 298:30 +CPU= 30.185
  00:50:43 STEP 1195 H= 298:45 +CPU= 30.102
  00:51:15 STEP 1196 H= 299:00 +CPU= 32.494
  00:51:47 STEP 1197 H= 299:15 +CPU= 31.123
  00:52:19 STEP 1198 H= 299:30 +CPU= 32.565
  00:52:50 STEP 1199 H= 299:45 +CPU= 30.850
  00:53:32 STEP 1200 H= 300:00 +CPU= 42.040
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001200
  00:54:03 STEP 1201 H= 300:15 +CPU= 30.652
  00:54:34 STEP 1202 H= 300:30 +CPU= 30.552
  00:55:05 STEP 1203 H= 300:45 +CPU= 31.616
  00:55:37 STEP 1204 H= 301:00 +CPU= 31.324
  00:56:08 STEP 1205 H= 301:15 +CPU= 31.550
  00:56:39 STEP 1206 H= 301:30 +CPU= 30.673
  00:57:10 STEP 1207 H= 301:45 +CPU= 30.486
  00:57:41 STEP 1208 H= 302:00 +CPU= 31.375
  00:58:12 STEP 1209 H= 302:15 +CPU= 30.933
  00:58:44 STEP 1210 H= 302:30 +CPU= 31.300
  00:59:16 STEP 1211 H= 302:45 +CPU= 31.944
  00:59:56 STEP 1212 H= 303:00 +CPU= 39.099
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001212
  01:00:28 STEP 1213 H= 303:15 +CPU= 32.178
  01:00:59 STEP 1214 H= 303:30 +CPU= 31.277
  01:01:30 STEP 1215 H= 303:45 +CPU= 31.182
  01:02:04 STEP 1216 H= 304:00 +CPU= 33.200
  01:02:36 STEP 1217 H= 304:15 +CPU= 32.621
  01:03:08 STEP 1218 H= 304:30 +CPU= 31.715
  01:03:39 STEP 1219 H= 304:45 +CPU= 30.695
  01:04:11 STEP 1220 H= 305:00 +CPU= 31.357
  01:04:42 STEP 1221 H= 305:15 +CPU= 31.419
  01:05:14 STEP 1222 H= 305:30 +CPU= 31.289
  01:05:45 STEP 1223 H= 305:45 +CPU= 31.678
  01:06:25 STEP 1224 H= 306:00 +CPU= 39.464
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001224
  01:06:58 STEP 1225 H= 306:15 +CPU= 32.631
  01:07:32 STEP 1226 H= 306:30 +CPU= 34.423
  01:08:05 STEP 1227 H= 306:45 +CPU= 32.885
  01:08:38 STEP 1228 H= 307:00 +CPU= 32.677
  01:09:10 STEP 1229 H= 307:15 +CPU= 31.818
  01:09:41 STEP 1230 H= 307:30 +CPU= 31.650
  01:10:13 STEP 1231 H= 307:45 +CPU= 31.610
  01:10:47 STEP 1232 H= 308:00 +CPU= 34.261
  01:11:20 STEP 1233 H= 308:15 +CPU= 32.936
  01:11:52 STEP 1234 H= 308:30 +CPU= 31.881
  01:12:24 STEP 1235 H= 308:45 +CPU= 31.833
  01:13:04 STEP 1236 H= 309:00 +CPU= 39.491
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001236
  01:13:36 STEP 1237 H= 309:15 +CPU= 32.338
  01:14:08 STEP 1238 H= 309:30 +CPU= 31.315
  01:14:39 STEP 1239 H= 309:45 +CPU= 31.003
  01:15:11 STEP 1240 H= 310:00 +CPU= 32.233
  01:15:43 STEP 1241 H= 310:15 +CPU= 31.890
  01:16:15 STEP 1242 H= 310:30 +CPU= 31.465
  01:16:46 STEP 1243 H= 310:45 +CPU= 31.564
  01:17:20 STEP 1244 H= 311:00 +CPU= 33.247
  01:17:51 STEP 1245 H= 311:15 +CPU= 31.218
  01:18:23 STEP 1246 H= 311:30 +CPU= 31.588
  01:18:55 STEP 1247 H= 311:45 +CPU= 32.249
  01:19:38 STEP 1248 H= 312:00 +CPU= 42.835
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+001236
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a459_2016092300_20_1017_12287200_0_r684755819_12.zip
Uploading the intermediate file: upload_file_12.zip
  01:20:10 STEP 1249 H= 312:15 +CPU= 31.677
  01:20:44 STEP 1250 H= 312:30 +CPU= 33.877
  01:21:16 STEP 1251 H= 312:45 +CPU= 31.968
  01:21:50 STEP 1252 H= 313:00 +CPU= 33.717
  01:22:21 STEP 1253 H= 313:15 +CPU= 31.488
  01:22:53 STEP 1254 H= 313:30 +CPU= 31.933
  01:23:25 STEP 1255 H= 313:45 +CPU= 31.788
  01:23:57 STEP 1256 H= 314:00 +CPU= 31.983
  01:24:31 STEP 1257 H= 314:15 +CPU= 34.291
  01:25:03 STEP 1258 H= 314:30 +CPU= 31.850
  01:25:34 STEP 1259 H= 314:45 +CPU= 30.718
  01:26:13 STEP 1260 H= 315:00 +CPU= 38.435
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001260
  01:26:45 STEP 1261 H= 315:15 +CPU= 31.575
  01:27:16 STEP 1262 H= 315:30 +CPU= 31.656
  01:27:47 STEP 1263 H= 315:45 +CPU= 31.026
  01:28:18 STEP 1264 H= 316:00 +CPU= 31.152
  01:28:50 STEP 1265 H= 316:15 +CPU= 31.220
  01:29:21 STEP 1266 H= 316:30 +CPU= 31.101
  01:29:53 STEP 1267 H= 316:45 +CPU= 31.672
  01:30:25 STEP 1268 H= 317:00 +CPU= 32.779
  01:30:56 STEP 1269 H= 317:15 +CPU= 30.472
  01:31:27 STEP 1270 H= 317:30 +CPU= 31.386
  01:31:58 STEP 1271 H= 317:45 +CPU= 30.941
  01:32:39 STEP 1272 H= 318:00 +CPU= 40.598
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001272
  01:33:10 STEP 1273 H= 318:15 +CPU= 31.170
  01:33:41 STEP 1274 H= 318:30 +CPU= 30.553
  01:34:13 STEP 1275 H= 318:45 +CPU= 31.386
  01:34:46 STEP 1276 H= 319:00 +CPU= 33.406
  01:35:17 STEP 1277 H= 319:15 +CPU= 31.146
  01:35:50 STEP 1278 H= 319:30 +CPU= 32.563
  01:36:21 STEP 1279 H= 319:45 +CPU= 31.148
  01:36:53 STEP 1280 H= 320:00 +CPU= 31.301
  01:37:24 STEP 1281 H= 320:15 +CPU= 30.661
  01:37:54 STEP 1282 H= 320:30 +CPU= 30.831
  01:38:25 STEP 1283 H= 320:45 +CPU= 30.498
  01:39:04 STEP 1284 H= 321:00 +CPU= 38.719
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001284
  01:39:35 STEP 1285 H= 321:15 +CPU= 30.487
  01:40:05 STEP 1286 H= 321:30 +CPU= 30.273
  01:40:35 STEP 1287 H= 321:45 +CPU= 30.294
  01:41:06 STEP 1288 H= 322:00 +CPU= 30.960
  01:41:39 STEP 1289 H= 322:15 +CPU= 32.523
  01:42:09 STEP 1290 H= 322:30 +CPU= 30.311
  01:42:40 STEP 1291 H= 322:45 +CPU= 30.527
  01:43:11 STEP 1292 H= 323:00 +CPU= 30.965
  01:43:43 STEP 1293 H= 323:15 +CPU= 32.004
  01:44:16 STEP 1294 H= 323:30 +CPU= 32.889
  01:44:48 STEP 1295 H= 323:45 +CPU= 32.734
  01:45:31 STEP 1296 H= 324:00 +CPU= 42.099
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001296
  01:46:01 STEP 1297 H= 324:15 +CPU= 30.191
  01:46:31 STEP 1298 H= 324:30 +CPU= 30.069
  01:47:01 STEP 1299 H= 324:45 +CPU= 30.422
  01:47:34 STEP 1300 H= 325:00 +CPU= 32.744
  01:48:06 STEP 1301 H= 325:15 +CPU= 31.768
  01:48:37 STEP 1302 H= 325:30 +CPU= 31.171
  01:49:10 STEP 1303 H= 325:45 +CPU= 31.216
  01:49:43 STEP 1304 H= 326:00 +CPU= 33.340
  01:50:16 STEP 1305 H= 326:15 +CPU= 32.718
  01:50:47 STEP 1306 H= 326:30 +CPU= 31.074
  01:51:19 STEP 1307 H= 326:45 +CPU= 31.800
  01:51:58 STEP 1308 H= 327:00 +CPU= 38.572
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001308
  01:52:29 STEP 1309 H= 327:15 +CPU= 30.998
  01:53:00 STEP 1310 H= 327:30 +CPU= 30.592
  01:53:31 STEP 1311 H= 327:45 +CPU= 30.539
  01:54:02 STEP 1312 H= 328:00 +CPU= 31.635
  01:54:33 STEP 1313 H= 328:15 +CPU= 31.030
  01:55:04 STEP 1314 H= 328:30 +CPU= 30.940
  01:55:36 STEP 1315 H= 328:45 +CPU= 31.090
  01:56:07 STEP 1316 H= 329:00 +CPU= 31.296
  01:56:39 STEP 1317 H= 329:15 +CPU= 31.945
  01:57:10 STEP 1318 H= 329:30 +CPU= 30.643
  01:57:41 STEP 1319 H= 329:45 +CPU= 30.547
  01:58:20 STEP 1320 H= 330:00 +CPU= 38.937
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001320
  01:58:50 STEP 1321 H= 330:15 +CPU= 30.477
  01:59:22 STEP 1322 H= 330:30 +CPU= 31.436
  01:59:52 STEP 1323 H= 330:45 +CPU= 30.631
  02:00:24 STEP 1324 H= 331:00 +CPU= 31.906
  02:00:57 STEP 1325 H= 331:15 +CPU= 32.414
  02:01:27 STEP 1326 H= 331:30 +CPU= 30.467
  02:01:58 STEP 1327 H= 331:45 +CPU= 30.408
  02:02:29 STEP 1328 H= 332:00 +CPU= 31.290
  02:02:59 STEP 1329 H= 332:15 +CPU= 30.449
  02:03:30 STEP 1330 H= 332:30 +CPU= 30.769
  02:04:03 STEP 1331 H= 332:45 +CPU= 32.639
  02:04:42 STEP 1332 H= 333:00 +CPU= 38.670
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001332
  02:05:13 STEP 1333 H= 333:15 +CPU= 31.376
  02:05:44 STEP 1334 H= 333:30 +CPU= 30.474
  02:06:14 STEP 1335 H= 333:45 +CPU= 30.172
  02:06:45 STEP 1336 H= 334:00 +CPU= 30.787
  02:07:17 STEP 1337 H= 334:15 +CPU= 31.415
  02:07:47 STEP 1338 H= 334:30 +CPU= 29.805
  02:08:16 STEP 1339 H= 334:45 +CPU= 29.827
  02:08:47 STEP 1340 H= 335:00 +CPU= 30.338
  02:09:18 STEP 1341 H= 335:15 +CPU= 31.141
  02:09:48 STEP 1342 H= 335:30 +CPU= 30.245
  02:10:18 STEP 1343 H= 335:45 +CPU= 29.761
  02:10:59 STEP 1344 H= 336:00 +CPU= 40.951
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+001332
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a459_2016092300_20_1017_12287200_0_r684755819_13.zip
Uploading the intermediate file: upload_file_13.zip
  02:11:29 STEP 1345 H= 336:15 +CPU= 29.812
  02:12:00 STEP 1346 H= 336:30 +CPU= 30.459
  02:12:32 STEP 1347 H= 336:45 +CPU= 30.717
  02:13:03 STEP 1348 H= 337:00 +CPU= 31.015
  02:13:33 STEP 1349 H= 337:15 +CPU= 30.105
  02:14:05 STEP 1350 H= 337:30 +CPU= 32.119
  02:14:35 STEP 1351 H= 337:45 +CPU= 30.374
  02:15:06 STEP 1352 H= 338:00 +CPU= 30.951
  02:15:38 STEP 1353 H= 338:15 +CPU= 30.936
  02:16:09 STEP 1354 H= 338:30 +CPU= 30.911
  02:16:39 STEP 1355 H= 338:45 +CPU= 30.799
  02:17:18 STEP 1356 H= 339:00 +CPU= 37.763
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001356
  02:17:48 STEP 1357 H= 339:15 +CPU= 30.436
  02:18:19 STEP 1358 H= 339:30 +CPU= 30.912
  02:18:49 STEP 1359 H= 339:45 +CPU= 30.116
  02:19:20 STEP 1360 H= 340:00 +CPU= 30.762
  02:19:51 STEP 1361 H= 340:15 +CPU= 30.875
  02:20:22 STEP 1362 H= 340:30 +CPU= 30.962
  02:20:52 STEP 1363 H= 340:45 +CPU= 29.659
  02:21:22 STEP 1364 H= 341:00 +CPU= 30.118
  02:21:52 STEP 1365 H= 341:15 +CPU= 30.155
  02:22:23 STEP 1366 H= 341:30 +CPU= 30.759
  02:22:53 STEP 1367 H= 341:45 +CPU= 29.884
  02:23:32 STEP 1368 H= 342:00 +CPU= 38.452
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001368
  02:24:01 STEP 1369 H= 342:15 +CPU= 29.791
  02:24:31 STEP 1370 H= 342:30 +CPU= 29.476
  02:25:01 STEP 1371 H= 342:45 +CPU= 29.691
  02:25:32 STEP 1372 H= 343:00 +CPU= 30.899
  02:26:02 STEP 1373 H= 343:15 +CPU= 29.975
  02:26:32 STEP 1374 H= 343:30 +CPU= 29.877
  02:27:02 STEP 1375 H= 343:45 +CPU= 29.970
  02:27:32 STEP 1376 H= 344:00 +CPU= 30.270
  02:28:02 STEP 1377 H= 344:15 +CPU= 30.094
  02:28:32 STEP 1378 H= 344:30 +CPU= 29.983
  02:29:03 STEP 1379 H= 344:45 +CPU= 30.345
  02:29:40 STEP 1380 H= 345:00 +CPU= 37.546
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001380
  02:30:13 STEP 1381 H= 345:15 +CPU= 32.338
  02:30:43 STEP 1382 H= 345:30 +CPU= 30.352
  02:31:14 STEP 1383 H= 345:45 +CPU= 30.716
  02:31:45 STEP 1384 H= 346:00 +CPU= 30.847
  02:32:16 STEP 1385 H= 346:15 +CPU= 30.960
  02:32:46 STEP 1386 H= 346:30 +CPU= 30.481
  02:33:17 STEP 1387 H= 346:45 +CPU= 30.370
  02:33:48 STEP 1388 H= 347:00 +CPU= 31.521
  02:34:21 STEP 1389 H= 347:15 +CPU= 32.510
  02:34:53 STEP 1390 H= 347:30 +CPU= 32.720
  02:35:24 STEP 1391 H= 347:45 +CPU= 30.397
  02:36:08 STEP 1392 H= 348:00 +CPU= 43.084
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001392
  02:36:38 STEP 1393 H= 348:15 +CPU= 30.379
  02:37:08 STEP 1394 H= 348:30 +CPU= 29.668
  02:37:38 STEP 1395 H= 348:45 +CPU= 29.757
  02:38:09 STEP 1396 H= 349:00 +CPU= 30.702
  02:38:39 STEP 1397 H= 349:15 +CPU= 29.740
  02:39:09 STEP 1398 H= 349:30 +CPU= 29.931
  02:39:39 STEP 1399 H= 349:45 +CPU= 30.053
  02:40:10 STEP 1400 H= 350:00 +CPU= 30.992
  02:40:40 STEP 1401 H= 350:15 +CPU= 30.355
  02:41:10 STEP 1402 H= 350:30 +CPU= 30.399
  02:41:40 STEP 1403 H= 350:45 +CPU= 29.710
  02:42:19 STEP 1404 H= 351:00 +CPU= 38.401
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001404
  02:42:50 STEP 1405 H= 351:15 +CPU= 30.497
  02:43:21 STEP 1406 H= 351:30 +CPU= 31.492
  02:43:51 STEP 1407 H= 351:45 +CPU= 30.029
  02:44:21 STEP 1408 H= 352:00 +CPU= 29.518
  02:44:51 STEP 1409 H= 352:15 +CPU= 30.036
  02:45:20 STEP 1410 H= 352:30 +CPU= 29.472
  02:45:51 STEP 1411 H= 352:45 +CPU= 30.313
  02:46:22 STEP 1412 H= 353:00 +CPU= 31.124
  02:46:52 STEP 1413 H= 353:15 +CPU= 29.954
  02:47:23 STEP 1414 H= 353:30 +CPU= 31.201
  02:47:54 STEP 1415 H= 353:45 +CPU= 30.318
  02:48:32 STEP 1416 H= 354:00 +CPU= 38.439
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001416
  02:49:04 STEP 1417 H= 354:15 +CPU= 31.710
  02:49:34 STEP 1418 H= 354:30 +CPU= 30.350
  02:50:05 STEP 1419 H= 354:45 +CPU= 30.757
  02:50:36 STEP 1420 H= 355:00 +CPU= 30.873
  02:51:07 STEP 1421 H= 355:15 +CPU= 30.983
  02:51:38 STEP 1422 H= 355:30 +CPU= 30.091
  02:52:08 STEP 1423 H= 355:45 +CPU= 30.360
  02:52:39 STEP 1424 H= 356:00 +CPU= 30.614
  02:53:09 STEP 1425 H= 356:15 +CPU= 30.383
  02:53:41 STEP 1426 H= 356:30 +CPU= 31.143
  02:54:11 STEP 1427 H= 356:45 +CPU= 30.336
  02:54:49 STEP 1428 H= 357:00 +CPU= 37.314
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001428
  02:55:19 STEP 1429 H= 357:15 +CPU= 29.956
  02:55:49 STEP 1430 H= 357:30 +CPU= 29.968
  02:56:21 STEP 1431 H= 357:45 +CPU= 32.032
  02:56:53 STEP 1432 H= 358:00 +CPU= 32.479
  02:57:26 STEP 1433 H= 358:15 +CPU= 32.263
  02:57:57 STEP 1434 H= 358:30 +CPU= 31.503
  02:58:27 STEP 1435 H= 358:45 +CPU= 29.930
  02:58:58 STEP 1436 H= 359:00 +CPU= 30.729
  02:59:28 STEP 1437 H= 359:15 +CPU= 29.918
  02:59:59 STEP 1438 H= 359:30 +CPU= 30.517
  03:00:30 STEP 1439 H= 359:45 +CPU= 30.382
  03:01:09 STEP 1440 H= 360:00 +CPU= 39.033
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.2175617316E-20      I       0.3100012838E-04      I
ICloud fractionI      0.0000000000E+00      I       0.1254363025E+00      I
I  Relat. Hum. I      0.2688288999E+00      I       0.4474251921E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.1720892754E+04      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    311287252 BYTES IN      7 RECORDS TRANSFERRED IN    0.0006 SECONDS518812.1 Mbytes/s, TOTAL TIME=    0.0137( 4.4%)
 03:01:09 STEP 1440 H= 360:00 +CPU= 39.033
 END CNT3
 NSTEP =  1440 CNT0   000000000  28.496  28.496  28.515   0.999               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ            0/           0 WRITTEN        43246/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    758    0        0            0    43246 ************    88.9     0.0    88.8     0.0   190.5
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.98      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 1562    5002.2    5002.2     16.86      0.00
   9 SPCM     - SPECTRAL COMP.                    1440     929.8     929.8      2.89      0.00
  10 SCAN2M - PHYSICS                             1441   15020.2   15020.2     46.71      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                121     998.7     998.7      0.26      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 63      44.0      44.0      0.01      0.00
  14 SUINIF                                          1    7833.7    7833.7      0.02      0.00
  17 GRIDFPOS IN CNT4                              121      67.8      67.8      0.02      0.00
  18 SUSPECG                                         1    3880.8    3880.8      0.01      0.00
  19 SUSPEC                                          1    3888.3    3888.3      0.01      0.00
  24 SUGRIDU                                         1    3501.5    3501.5      0.01      0.00
  25 SPECRT                                          1     320.6     320.6      0.00      0.00
  26 SUGRIDF                                         1     123.3     123.3      0.00      0.00
  27 RESTART FILES - WRITING                        30    4028.1    4028.1      0.26      0.00
  28 RESTART FILES - READING                         1       0.0       0.0      0.00      0.00
  29 SU4FPOS IN CNT4                               121       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                               121    6826.6    6826.6      1.78      0.00
  31 POSDDH IN STEPO                                 7       1.0       1.0      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   1441    6508.6    6508.6     20.24      0.00
  39 SU0YOMB                                         1     449.7     449.7      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   1441      29.3      29.3      0.09      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             1440     366.0     366.0      1.14      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             1440      82.7      82.7      0.26      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 63       0.3       0.3      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     3125     605.8     605.8      4.09      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      3006     335.8     335.8      2.18      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       3006     122.5     122.5      0.79      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      3125     168.1     168.1      1.13      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      45.8      45.8      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           3125      68.0      68.0      0.46      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           3006      33.9      33.9      0.22      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           3125     109.3     109.3      0.74      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           3006      57.3      57.3      0.37      0.00
 400 GSTATS                                     167734       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                156066       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    46339.0 CPU TIME   46213.6 VECTOR TIME    46213.6


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       28.0
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/slots/3/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/3/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287200/ICMUAh7zg+001392
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a459_2016092300_20_1017_12287200_0_r684755819_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
03:04:43 (3903571): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>oifs_43r3_bl_a459_2016092300_20_1017_12287200_0_r684755819_15.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a459_2016092300_20_1017_12287200_0_r684755819_16.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a459_2016092300_20_1017_12287200_0_r684755819_17.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a459_2016092300_20_1017_12287200_0_r684755819_18.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a459_2016092300_20_1017_12287200_0_r684755819_19.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
08 Jun 2024 08:13:18 1538890 22438829 oifs_43r3_bl_a459_2016092300_20_1017_12287200_0 1,295,100 46,213 0.0357
08 Jun 2024 04:02:02 1538890 22438829 oifs_43r3_bl_a459_2016092300_20_1017_12287200_0 864,000 30,883 0.0357


©2024 climateprediction.net