climateprediction.net home page
Task 22310565

Task 22310565

Name oifs_43r3_bl_a2r1_2016092300_15_991_12210352_0
Workunit 12210352
Created 13 Feb 2023, 18:34:32 UTC
Sent 14 Feb 2023, 5:45:22 UTC
Report deadline 15 Apr 2023, 5:45:22 UTC
Received 25 Feb 2023, 5:57:56 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1537194
Run time 13 hours 11 min 45 sec
CPU time 12 hours 57 min 42 sec
Validate state Valid
Credit 1,813.14
Device peak FLOPS 4.66 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.11
x86_64-pc-linux-gnu
Peak working set size 5,056.94 MB
Peak swap size 5,930.79 MB
Peak disk usage 1,366.51 MB
Stderr
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<stderr_txt>
9.391
  00:15:44 STEP  861 H= 215:15 +CPU= 30.306
  00:16:15 STEP  862 H= 215:30 +CPU= 30.250
  00:16:46 STEP  863 H= 215:45 +CPU= 30.654
  00:17:29 STEP  864 H= 216:00 +CPU= 43.172
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+000864
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+000864
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+000768
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+000768
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+000768
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+000780
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+000780
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+000780
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+000792
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+000792
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+000792
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+000804
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+000804
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+000804
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+000816
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+000816
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+000816
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+000828
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+000828
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+000828
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+000840
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+000840
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+000840
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+000852
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+000852
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+000852
Zipping up the intermediate file: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_a2r1_2016092300_15_991_12210352_0_r995678610_8.zip
Uploading the intermediate file: upload_file_8.zip
  00:17:59 STEP  865 H= 216:15 +CPU= 29.990
  00:18:28 STEP  866 H= 216:30 +CPU= 28.886
  00:18:59 STEP  867 H= 216:45 +CPU= 30.158
  00:19:31 STEP  868 H= 217:00 +CPU= 32.107
  00:20:01 STEP  869 H= 217:15 +CPU= 30.161
  00:20:34 STEP  870 H= 217:30 +CPU= 31.919
  00:21:04 STEP  871 H= 217:45 +CPU= 29.955
  00:21:33 STEP  872 H= 218:00 +CPU= 28.843
  00:22:03 STEP  873 H= 218:15 +CPU= 29.393
  00:22:32 STEP  874 H= 218:30 +CPU= 29.268
  00:23:01 STEP  875 H= 218:45 +CPU= 28.927
  00:23:38 STEP  876 H= 219:00 +CPU= 36.027
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+000876
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+000876
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+000876
  00:24:06 STEP  877 H= 219:15 +CPU= 28.682
  00:24:37 STEP  878 H= 219:30 +CPU= 30.040
  00:25:04 STEP  879 H= 219:45 +CPU= 27.171
  00:25:33 STEP  880 H= 220:00 +CPU= 28.983
  00:26:02 STEP  881 H= 220:15 +CPU= 28.726
  00:26:31 STEP  882 H= 220:30 +CPU= 28.473
  00:27:00 STEP  883 H= 220:45 +CPU= 28.651
  00:27:30 STEP  884 H= 221:00 +CPU= 30.348
  00:28:01 STEP  885 H= 221:15 +CPU= 30.256
  00:28:31 STEP  886 H= 221:30 +CPU= 29.878
  00:28:59 STEP  887 H= 221:45 +CPU= 27.826
  00:29:36 STEP  888 H= 222:00 +CPU= 37.304
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+000888
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+000888
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+000888
  00:30:07 STEP  889 H= 222:15 +CPU= 30.321
  00:30:36 STEP  890 H= 222:30 +CPU= 29.345
  00:31:06 STEP  891 H= 222:45 +CPU= 29.760
  00:31:36 STEP  892 H= 223:00 +CPU= 29.674
  00:32:06 STEP  893 H= 223:15 +CPU= 29.838
  00:32:35 STEP  894 H= 223:30 +CPU= 28.241
  00:33:05 STEP  895 H= 223:45 +CPU= 30.265
  00:33:38 STEP  896 H= 224:00 +CPU= 32.233
  00:34:08 STEP  897 H= 224:15 +CPU= 29.997
  00:34:37 STEP  898 H= 224:30 +CPU= 29.184
  00:35:06 STEP  899 H= 224:45 +CPU= 28.070
  00:35:42 STEP  900 H= 225:00 +CPU= 35.565
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+000900
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+000900
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+000900
  00:36:11 STEP  901 H= 225:15 +CPU= 29.206
  00:36:40 STEP  902 H= 225:30 +CPU= 28.313
  00:37:08 STEP  903 H= 225:45 +CPU= 27.934
  00:37:38 STEP  904 H= 226:00 +CPU= 29.875
  00:38:08 STEP  905 H= 226:15 +CPU= 30.515
  00:38:37 STEP  906 H= 226:30 +CPU= 28.401
  00:39:06 STEP  907 H= 226:45 +CPU= 28.686
  00:39:35 STEP  908 H= 227:00 +CPU= 28.445
  00:40:02 STEP  909 H= 227:15 +CPU= 26.880
  00:40:33 STEP  910 H= 227:30 +CPU= 31.380
  00:41:04 STEP  911 H= 227:45 +CPU= 30.831
  00:41:45 STEP  912 H= 228:00 +CPU= 40.985
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+000912
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+000912
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+000912
  00:42:16 STEP  913 H= 228:15 +CPU= 29.948
  00:42:46 STEP  914 H= 228:30 +CPU= 29.852
  00:43:13 STEP  915 H= 228:45 +CPU= 27.562
  00:43:42 STEP  916 H= 229:00 +CPU= 28.693
  00:44:10 STEP  917 H= 229:15 +CPU= 27.289
  00:44:37 STEP  918 H= 229:30 +CPU= 26.908
  00:45:07 STEP  919 H= 229:45 +CPU= 29.687
  00:45:37 STEP  920 H= 230:00 +CPU= 30.577
  00:46:08 STEP  921 H= 230:15 +CPU= 29.999
  00:46:38 STEP  922 H= 230:30 +CPU= 30.273
  00:47:07 STEP  923 H= 230:45 +CPU= 29.172
  00:47:45 STEP  924 H= 231:00 +CPU= 37.621
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+000924
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+000924
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+000924
  00:48:16 STEP  925 H= 231:15 +CPU= 30.348
  00:48:44 STEP  926 H= 231:30 +CPU= 27.646
  00:49:13 STEP  927 H= 231:45 +CPU= 29.056
  00:49:43 STEP  928 H= 232:00 +CPU= 29.624
  00:50:11 STEP  929 H= 232:15 +CPU= 27.581
  00:50:41 STEP  930 H= 232:30 +CPU= 30.069
  00:51:12 STEP  931 H= 232:45 +CPU= 31.077
  00:51:43 STEP  932 H= 233:00 +CPU= 30.698
  00:52:12 STEP  933 H= 233:15 +CPU= 28.631
  00:52:42 STEP  934 H= 233:30 +CPU= 30.012
  00:53:12 STEP  935 H= 233:45 +CPU= 29.774
  00:53:50 STEP  936 H= 234:00 +CPU= 37.204
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+000936
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+000936
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+000936
  00:54:21 STEP  937 H= 234:15 +CPU= 30.384
  00:54:49 STEP  938 H= 234:30 +CPU= 28.012
  00:55:18 STEP  939 H= 234:45 +CPU= 28.873
  00:55:50 STEP  940 H= 235:00 +CPU= 31.522
  00:56:20 STEP  941 H= 235:15 +CPU= 29.611
  00:56:49 STEP  942 H= 235:30 +CPU= 28.451
  00:57:17 STEP  943 H= 235:45 +CPU= 27.926
  00:57:47 STEP  944 H= 236:00 +CPU= 29.787
  00:58:15 STEP  945 H= 236:15 +CPU= 27.902
  00:58:43 STEP  946 H= 236:30 +CPU= 28.176
  00:59:13 STEP  947 H= 236:45 +CPU= 29.533
  00:59:51 STEP  948 H= 237:00 +CPU= 37.524
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+000948
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+000948
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+000948
  01:00:21 STEP  949 H= 237:15 +CPU= 29.499
  01:00:49 STEP  950 H= 237:30 +CPU= 28.269
  01:01:18 STEP  951 H= 237:45 +CPU= 27.902
  01:01:46 STEP  952 H= 238:00 +CPU= 28.602
  01:02:13 STEP  953 H= 238:15 +CPU= 26.671
  01:02:40 STEP  954 H= 238:30 +CPU= 26.982
  01:03:10 STEP  955 H= 238:45 +CPU= 29.613
  01:03:40 STEP  956 H= 239:00 +CPU= 29.618
  01:04:11 STEP  957 H= 239:15 +CPU= 30.298
  01:04:42 STEP  958 H= 239:30 +CPU= 30.662
  01:05:12 STEP  959 H= 239:45 +CPU= 30.065
  01:05:55 STEP  960 H= 240:00 +CPU= 42.868
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+000960
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+000960
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+000864
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+000864
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+000876
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+000876
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+000876
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+000888
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+000888
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+000888
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+000900
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+000900
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+000900
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+000912
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+000912
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+000912
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+000924
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+000924
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+000924
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+000936
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+000936
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+000936
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+000948
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+000948
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+000948
Zipping up the intermediate file: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_a2r1_2016092300_15_991_12210352_0_r995678610_9.zip
Uploading the intermediate file: upload_file_9.zip
  01:06:23 STEP  961 H= 240:15 +CPU= 27.798
Uploading trickle at timestep: 864000
  01:06:53 STEP  962 H= 240:30 +CPU= 29.558
  01:07:25 STEP  963 H= 240:45 +CPU= 31.381
  01:07:55 STEP  964 H= 241:00 +CPU= 30.416
  01:08:23 STEP  965 H= 241:15 +CPU= 27.650
  01:08:52 STEP  966 H= 241:30 +CPU= 28.147
  01:09:19 STEP  967 H= 241:45 +CPU= 27.034
  01:09:49 STEP  968 H= 242:00 +CPU= 29.416
  01:10:19 STEP  969 H= 242:15 +CPU= 29.929
  01:10:46 STEP  970 H= 242:30 +CPU= 26.939
  01:11:17 STEP  971 H= 242:45 +CPU= 29.995
  01:11:56 STEP  972 H= 243:00 +CPU= 38.736
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+000972
  01:12:26 STEP  973 H= 243:15 +CPU= 29.997
  01:12:55 STEP  974 H= 243:30 +CPU= 28.789
  01:13:27 STEP  975 H= 243:45 +CPU= 31.077
  01:13:56 STEP  976 H= 244:00 +CPU= 29.558
  01:14:25 STEP  977 H= 244:15 +CPU= 28.095
  01:14:55 STEP  978 H= 244:30 +CPU= 29.806
  01:15:23 STEP  979 H= 244:45 +CPU= 28.308
  01:15:54 STEP  980 H= 245:00 +CPU= 29.841
  01:16:23 STEP  981 H= 245:15 +CPU= 28.687
  01:16:52 STEP  982 H= 245:30 +CPU= 29.376
  01:17:22 STEP  983 H= 245:45 +CPU= 29.073
  01:17:59 STEP  984 H= 246:00 +CPU= 36.893
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+000984
  01:18:27 STEP  985 H= 246:15 +CPU= 28.522
  01:18:56 STEP  986 H= 246:30 +CPU= 28.288
  01:19:24 STEP  987 H= 246:45 +CPU= 28.272
  01:19:54 STEP  988 H= 247:00 +CPU= 29.407
  01:20:23 STEP  989 H= 247:15 +CPU= 28.571
  01:20:55 STEP  990 H= 247:30 +CPU= 31.430
  01:21:24 STEP  991 H= 247:45 +CPU= 28.950
  01:21:55 STEP  992 H= 248:00 +CPU= 31.348
  01:22:24 STEP  993 H= 248:15 +CPU= 28.439
  01:22:53 STEP  994 H= 248:30 +CPU= 29.218
  01:23:23 STEP  995 H= 248:45 +CPU= 29.580
  01:24:00 STEP  996 H= 249:00 +CPU= 36.444
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+000996
  01:24:30 STEP  997 H= 249:15 +CPU= 29.613
  01:24:59 STEP  998 H= 249:30 +CPU= 28.675
  01:25:28 STEP  999 H= 249:45 +CPU= 29.521
  01:25:59 STEP 1000 H= 250:00 +CPU= 30.446
  01:26:28 STEP 1001 H= 250:15 +CPU= 28.886
  01:26:57 STEP 1002 H= 250:30 +CPU= 28.464
  01:27:27 STEP 1003 H= 250:45 +CPU= 29.473
  01:27:56 STEP 1004 H= 251:00 +CPU= 28.706
  01:28:24 STEP 1005 H= 251:15 +CPU= 28.427
  01:28:53 STEP 1006 H= 251:30 +CPU= 28.149
  01:29:20 STEP 1007 H= 251:45 +CPU= 27.311
  01:30:03 STEP 1008 H= 252:00 +CPU= 42.582
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+001008
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+001008
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+001008
  01:30:32 STEP 1009 H= 252:15 +CPU= 28.514
  01:31:02 STEP 1010 H= 252:30 +CPU= 30.035
  01:31:31 STEP 1011 H= 252:45 +CPU= 28.934
  01:32:02 STEP 1012 H= 253:00 +CPU= 30.832
  01:32:29 STEP 1013 H= 253:15 +CPU= 26.215
  01:32:56 STEP 1014 H= 253:30 +CPU= 27.239
  01:33:24 STEP 1015 H= 253:45 +CPU= 27.987
  01:33:54 STEP 1016 H= 254:00 +CPU= 29.441
  01:34:23 STEP 1017 H= 254:15 +CPU= 28.224
  01:34:54 STEP 1018 H= 254:30 +CPU= 30.838
  01:35:24 STEP 1019 H= 254:45 +CPU= 30.200
  01:36:03 STEP 1020 H= 255:00 +CPU= 38.155
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+001020
  01:36:33 STEP 1021 H= 255:15 +CPU= 30.210
  01:37:03 STEP 1022 H= 255:30 +CPU= 29.807
  01:37:32 STEP 1023 H= 255:45 +CPU= 29.052
  01:38:05 STEP 1024 H= 256:00 +CPU= 32.399
  01:38:35 STEP 1025 H= 256:15 +CPU= 29.455
  01:39:02 STEP 1026 H= 256:30 +CPU= 26.915
  01:39:31 STEP 1027 H= 256:45 +CPU= 28.826
  01:40:02 STEP 1028 H= 257:00 +CPU= 30.826
  01:40:32 STEP 1029 H= 257:15 +CPU= 30.136
  01:41:02 STEP 1030 H= 257:30 +CPU= 29.180
  01:41:31 STEP 1031 H= 257:45 +CPU= 28.660
  01:42:09 STEP 1032 H= 258:00 +CPU= 37.787
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+001032
  01:42:39 STEP 1033 H= 258:15 +CPU= 29.481
  01:43:08 STEP 1034 H= 258:30 +CPU= 29.206
  01:43:37 STEP 1035 H= 258:45 +CPU= 28.732
  01:44:06 STEP 1036 H= 259:00 +CPU= 29.345
  01:44:36 STEP 1037 H= 259:15 +CPU= 29.023
  01:45:05 STEP 1038 H= 259:30 +CPU= 29.510
  01:45:36 STEP 1039 H= 259:45 +CPU= 29.879
  01:46:06 STEP 1040 H= 260:00 +CPU= 30.134
  01:46:35 STEP 1041 H= 260:15 +CPU= 28.014
  01:47:02 STEP 1042 H= 260:30 +CPU= 26.903
  01:47:33 STEP 1043 H= 260:45 +CPU= 31.363
  01:48:11 STEP 1044 H= 261:00 +CPU= 36.953
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+001044
  01:48:41 STEP 1045 H= 261:15 +CPU= 29.765
  01:49:09 STEP 1046 H= 261:30 +CPU= 27.599
  01:49:38 STEP 1047 H= 261:45 +CPU= 29.262
  01:50:09 STEP 1048 H= 262:00 +CPU= 30.874
  01:50:38 STEP 1049 H= 262:15 +CPU= 28.188
  01:51:06 STEP 1050 H= 262:30 +CPU= 27.731
  01:51:36 STEP 1051 H= 262:45 +CPU= 29.645
  01:52:06 STEP 1052 H= 263:00 +CPU= 30.148
  01:52:33 STEP 1053 H= 263:15 +CPU= 26.771
  01:53:01 STEP 1054 H= 263:30 +CPU= 28.181
  01:53:31 STEP 1055 H= 263:45 +CPU= 29.075
  01:54:15 STEP 1056 H= 264:00 +CPU= 43.752
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+001044
Zipping up the intermediate file: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_a2r1_2016092300_15_991_12210352_0_r995678610_10.zip
Uploading the intermediate file: upload_file_10.zip
  01:54:44 STEP 1057 H= 264:15 +CPU= 28.805
  01:55:14 STEP 1058 H= 264:30 +CPU= 29.374
  01:55:45 STEP 1059 H= 264:45 +CPU= 30.475
  01:56:15 STEP 1060 H= 265:00 +CPU= 29.871
  01:56:43 STEP 1061 H= 265:15 +CPU= 28.049
  01:57:12 STEP 1062 H= 265:30 +CPU= 28.960
  01:57:41 STEP 1063 H= 265:45 +CPU= 28.935
  01:58:13 STEP 1064 H= 266:00 +CPU= 31.002
  01:58:41 STEP 1065 H= 266:15 +CPU= 28.215
  01:59:10 STEP 1066 H= 266:30 +CPU= 28.646
  01:59:37 STEP 1067 H= 266:45 +CPU= 26.910
  02:00:14 STEP 1068 H= 267:00 +CPU= 36.165
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+001068
  02:00:43 STEP 1069 H= 267:15 +CPU= 29.542
  02:01:12 STEP 1070 H= 267:30 +CPU= 28.762
  02:01:42 STEP 1071 H= 267:45 +CPU= 28.998
  02:02:12 STEP 1072 H= 268:00 +CPU= 30.432
  02:02:40 STEP 1073 H= 268:15 +CPU= 27.472
  02:03:11 STEP 1074 H= 268:30 +CPU= 30.814
  02:03:40 STEP 1075 H= 268:45 +CPU= 29.297
  02:04:09 STEP 1076 H= 269:00 +CPU= 28.052
  02:04:37 STEP 1077 H= 269:15 +CPU= 27.975
  02:05:07 STEP 1078 H= 269:30 +CPU= 29.452
  02:05:36 STEP 1079 H= 269:45 +CPU= 29.100
  02:06:13 STEP 1080 H= 270:00 +CPU= 36.279
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+001080
  02:06:42 STEP 1081 H= 270:15 +CPU= 29.609
  02:07:14 STEP 1082 H= 270:30 +CPU= 31.200
  02:07:44 STEP 1083 H= 270:45 +CPU= 29.951
  02:08:14 STEP 1084 H= 271:00 +CPU= 29.376
  02:08:43 STEP 1085 H= 271:15 +CPU= 29.123
  02:09:12 STEP 1086 H= 271:30 +CPU= 28.460
  02:09:41 STEP 1087 H= 271:45 +CPU= 28.999
  02:10:10 STEP 1088 H= 272:00 +CPU= 28.559
  02:10:37 STEP 1089 H= 272:15 +CPU= 27.507
  02:11:08 STEP 1090 H= 272:30 +CPU= 30.482
  02:11:39 STEP 1091 H= 272:45 +CPU= 30.804
  02:12:16 STEP 1092 H= 273:00 +CPU= 36.344
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+001092
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+001092
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+001092
  02:12:46 STEP 1093 H= 273:15 +CPU= 30.253
  02:13:16 STEP 1094 H= 273:30 +CPU= 29.088
  02:13:47 STEP 1095 H= 273:45 +CPU= 31.073
  02:14:17 STEP 1096 H= 274:00 +CPU= 29.171
  02:14:46 STEP 1097 H= 274:15 +CPU= 29.289
  02:15:15 STEP 1098 H= 274:30 +CPU= 28.525
  02:15:43 STEP 1099 H= 274:45 +CPU= 27.550
  02:16:13 STEP 1100 H= 275:00 +CPU= 30.374
  02:16:42 STEP 1101 H= 275:15 +CPU= 28.259
  02:17:11 STEP 1102 H= 275:30 +CPU= 28.820
  02:17:40 STEP 1103 H= 275:45 +CPU= 28.960
  02:18:21 STEP 1104 H= 276:00 +CPU= 40.998
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+001104
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+001104
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+001104
  02:18:52 STEP 1105 H= 276:15 +CPU= 30.470
  02:19:22 STEP 1106 H= 276:30 +CPU= 29.965
  02:19:52 STEP 1107 H= 276:45 +CPU= 29.502
  02:20:23 STEP 1108 H= 277:00 +CPU= 30.969
  02:20:54 STEP 1109 H= 277:15 +CPU= 30.254
  02:21:23 STEP 1110 H= 277:30 +CPU= 29.101
  02:21:54 STEP 1111 H= 277:45 +CPU= 30.989
  02:22:24 STEP 1112 H= 278:00 +CPU= 29.411
  02:22:55 STEP 1113 H= 278:15 +CPU= 30.162
  02:23:26 STEP 1114 H= 278:30 +CPU= 31.135
  02:23:55 STEP 1115 H= 278:45 +CPU= 28.362
  02:24:31 STEP 1116 H= 279:00 +CPU= 36.600
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+001116
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+001116
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+001116
  02:25:01 STEP 1117 H= 279:15 +CPU= 29.119
  02:25:29 STEP 1118 H= 279:30 +CPU= 28.388
  02:26:00 STEP 1119 H= 279:45 +CPU= 30.042
  02:26:30 STEP 1120 H= 280:00 +CPU= 30.246
  02:27:03 STEP 1121 H= 280:15 +CPU= 32.529
  02:27:31 STEP 1122 H= 280:30 +CPU= 28.113
  02:28:00 STEP 1123 H= 280:45 +CPU= 28.241
  02:28:32 STEP 1124 H= 281:00 +CPU= 32.038
  02:29:02 STEP 1125 H= 281:15 +CPU= 29.470
  02:29:31 STEP 1126 H= 281:30 +CPU= 29.159
  02:30:03 STEP 1127 H= 281:45 +CPU= 31.430
  02:30:39 STEP 1128 H= 282:00 +CPU= 35.507
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+001128
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+001128
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+001128
  02:31:07 STEP 1129 H= 282:15 +CPU= 27.439
  02:31:36 STEP 1130 H= 282:30 +CPU= 28.737
  02:32:04 STEP 1131 H= 282:45 +CPU= 28.440
  02:32:35 STEP 1132 H= 283:00 +CPU= 30.300
  02:33:03 STEP 1133 H= 283:15 +CPU= 28.139
  02:33:33 STEP 1134 H= 283:30 +CPU= 30.101
  02:34:03 STEP 1135 H= 283:45 +CPU= 29.502
  02:34:35 STEP 1136 H= 284:00 +CPU= 31.266
  02:35:05 STEP 1137 H= 284:15 +CPU= 29.857
  02:35:35 STEP 1138 H= 284:30 +CPU= 29.469
  02:36:06 STEP 1139 H= 284:45 +CPU= 30.771
  02:36:44 STEP 1140 H= 285:00 +CPU= 37.156
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+001140
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+001140
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+001140
  02:37:12 STEP 1141 H= 285:15 +CPU= 28.091
  02:37:41 STEP 1142 H= 285:30 +CPU= 28.974
  02:38:10 STEP 1143 H= 285:45 +CPU= 28.570
  02:38:39 STEP 1144 H= 286:00 +CPU= 28.140
  02:39:06 STEP 1145 H= 286:15 +CPU= 27.008
  02:39:35 STEP 1146 H= 286:30 +CPU= 29.089
  02:40:06 STEP 1147 H= 286:45 +CPU= 30.531
  02:40:35 STEP 1148 H= 287:00 +CPU= 29.298
  02:41:07 STEP 1149 H= 287:15 +CPU= 31.225
  02:41:36 STEP 1150 H= 287:30 +CPU= 28.817
  02:42:03 STEP 1151 H= 287:45 +CPU= 26.646
  02:42:46 STEP 1152 H= 288:00 +CPU= 42.345
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+001140
Zipping up the intermediate file: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_a2r1_2016092300_15_991_12210352_0_r995678610_11.zip
Uploading the intermediate file: upload_file_11.zip
  02:43:14 STEP 1153 H= 288:15 +CPU= 27.955
  02:43:41 STEP 1154 H= 288:30 +CPU= 26.988
  02:44:11 STEP 1155 H= 288:45 +CPU= 29.354
  02:44:43 STEP 1156 H= 289:00 +CPU= 31.636
  02:45:12 STEP 1157 H= 289:15 +CPU= 29.342
  02:45:42 STEP 1158 H= 289:30 +CPU= 28.990
  02:46:10 STEP 1159 H= 289:45 +CPU= 28.033
  02:46:38 STEP 1160 H= 290:00 +CPU= 27.866
  02:47:07 STEP 1161 H= 290:15 +CPU= 28.517
  02:47:36 STEP 1162 H= 290:30 +CPU= 29.406
  02:48:05 STEP 1163 H= 290:45 +CPU= 27.778
  02:48:43 STEP 1164 H= 291:00 +CPU= 37.935
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+001164
  02:49:12 STEP 1165 H= 291:15 +CPU= 28.666
  02:49:39 STEP 1166 H= 291:30 +CPU= 27.368
  02:50:07 STEP 1167 H= 291:45 +CPU= 27.546
  02:50:37 STEP 1168 H= 292:00 +CPU= 29.602
  02:51:06 STEP 1169 H= 292:15 +CPU= 28.578
  02:51:33 STEP 1170 H= 292:30 +CPU= 27.565
  02:52:03 STEP 1171 H= 292:45 +CPU= 29.711
  02:52:35 STEP 1172 H= 293:00 +CPU= 31.112
  02:53:05 STEP 1173 H= 293:15 +CPU= 29.807
  02:53:34 STEP 1174 H= 293:30 +CPU= 29.449
  02:54:04 STEP 1175 H= 293:45 +CPU= 29.900
  02:54:41 STEP 1176 H= 294:00 +CPU= 36.150
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+001176
  02:55:08 STEP 1177 H= 294:15 +CPU= 26.980
  02:55:37 STEP 1178 H= 294:30 +CPU= 28.563
  02:56:09 STEP 1179 H= 294:45 +CPU= 31.230
  02:56:39 STEP 1180 H= 295:00 +CPU= 29.722
  02:57:08 STEP 1181 H= 295:15 +CPU= 29.353
  02:57:37 STEP 1182 H= 295:30 +CPU= 28.795
  02:58:05 STEP 1183 H= 295:45 +CPU= 27.467
  02:58:34 STEP 1184 H= 296:00 +CPU= 28.421
  02:59:03 STEP 1185 H= 296:15 +CPU= 29.234
  02:59:33 STEP 1186 H= 296:30 +CPU= 29.588
  03:00:02 STEP 1187 H= 296:45 +CPU= 29.043
  03:00:41 STEP 1188 H= 297:00 +CPU= 38.317
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+001188
  03:01:09 STEP 1189 H= 297:15 +CPU= 28.433
  03:01:40 STEP 1190 H= 297:30 +CPU= 30.239
  03:02:08 STEP 1191 H= 297:45 +CPU= 28.059
  03:02:39 STEP 1192 H= 298:00 +CPU= 30.045
  03:03:07 STEP 1193 H= 298:15 +CPU= 28.450
  03:03:37 STEP 1194 H= 298:30 +CPU= 29.803
  03:04:05 STEP 1195 H= 298:45 +CPU= 27.974
  03:04:37 STEP 1196 H= 299:00 +CPU= 31.728
  03:05:08 STEP 1197 H= 299:15 +CPU= 30.812
  03:05:40 STEP 1198 H= 299:30 +CPU= 31.302
  03:06:10 STEP 1199 H= 299:45 +CPU= 30.114
  03:06:52 STEP 1200 H= 300:00 +CPU= 41.246
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+001200
  03:07:22 STEP 1201 H= 300:15 +CPU= 29.547
  03:07:51 STEP 1202 H= 300:30 +CPU= 29.103
  03:08:21 STEP 1203 H= 300:45 +CPU= 30.088
  03:08:51 STEP 1204 H= 301:00 +CPU= 29.153
  03:09:19 STEP 1205 H= 301:15 +CPU= 28.078
  03:09:50 STEP 1206 H= 301:30 +CPU= 30.358
  03:10:19 STEP 1207 H= 301:45 +CPU= 29.256
  03:10:52 STEP 1208 H= 302:00 +CPU= 31.961
  03:11:22 STEP 1209 H= 302:15 +CPU= 29.998
  03:11:52 STEP 1210 H= 302:30 +CPU= 29.970
  03:12:21 STEP 1211 H= 302:45 +CPU= 28.528
  03:12:58 STEP 1212 H= 303:00 +CPU= 37.355
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+001212
  03:13:28 STEP 1213 H= 303:15 +CPU= 29.336
  03:13:56 STEP 1214 H= 303:30 +CPU= 27.723
  03:14:25 STEP 1215 H= 303:45 +CPU= 28.882
  03:14:54 STEP 1216 H= 304:00 +CPU= 28.638
  03:15:23 STEP 1217 H= 304:15 +CPU= 28.892
  03:15:53 STEP 1218 H= 304:30 +CPU= 29.390
  03:16:21 STEP 1219 H= 304:45 +CPU= 28.213
  03:16:52 STEP 1220 H= 305:00 +CPU= 31.020
  03:17:22 STEP 1221 H= 305:15 +CPU= 29.575
  03:17:52 STEP 1222 H= 305:30 +CPU= 29.331
  03:18:20 STEP 1223 H= 305:45 +CPU= 28.040
  03:18:58 STEP 1224 H= 306:00 +CPU= 38.341
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+001224
  03:19:27 STEP 1225 H= 306:15 +CPU= 28.441
  03:19:55 STEP 1226 H= 306:30 +CPU= 28.004
  03:20:25 STEP 1227 H= 306:45 +CPU= 28.973
  03:20:56 STEP 1228 H= 307:00 +CPU= 30.995
  03:21:25 STEP 1229 H= 307:15 +CPU= 28.813
  03:21:55 STEP 1230 H= 307:30 +CPU= 29.615
  03:22:25 STEP 1231 H= 307:45 +CPU= 29.962
  03:22:54 STEP 1232 H= 308:00 +CPU= 29.315
  03:23:26 STEP 1233 H= 308:15 +CPU= 31.286
  03:23:55 STEP 1234 H= 308:30 +CPU= 29.337
  03:24:26 STEP 1235 H= 308:45 +CPU= 29.839
  03:25:05 STEP 1236 H= 309:00 +CPU= 38.996
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+001236
  03:25:34 STEP 1237 H= 309:15 +CPU= 28.759
  03:26:05 STEP 1238 H= 309:30 +CPU= 30.794
  03:26:34 STEP 1239 H= 309:45 +CPU= 28.441
  03:27:05 STEP 1240 H= 310:00 +CPU= 30.891
  03:27:34 STEP 1241 H= 310:15 +CPU= 29.239
  03:28:03 STEP 1242 H= 310:30 +CPU= 29.044
  03:28:32 STEP 1243 H= 310:45 +CPU= 28.303
  03:29:03 STEP 1244 H= 311:00 +CPU= 30.643
  03:29:34 STEP 1245 H= 311:15 +CPU= 30.461
  03:30:04 STEP 1246 H= 311:30 +CPU= 29.708
  03:30:34 STEP 1247 H= 311:45 +CPU= 29.772
  03:31:18 STEP 1248 H= 312:00 +CPU= 44.190
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+001236
Zipping up the intermediate file: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_a2r1_2016092300_15_991_12210352_0_r995678610_12.zip
Uploading the intermediate file: upload_file_12.zip
  03:31:47 STEP 1249 H= 312:15 +CPU= 27.964
  03:32:16 STEP 1250 H= 312:30 +CPU= 29.371
  03:32:47 STEP 1251 H= 312:45 +CPU= 30.075
  03:33:16 STEP 1252 H= 313:00 +CPU= 29.214
  03:33:45 STEP 1253 H= 313:15 +CPU= 28.823
  03:34:15 STEP 1254 H= 313:30 +CPU= 28.924
  03:34:44 STEP 1255 H= 313:45 +CPU= 28.710
  03:35:13 STEP 1256 H= 314:00 +CPU= 29.010
  03:35:43 STEP 1257 H= 314:15 +CPU= 29.672
  03:36:12 STEP 1258 H= 314:30 +CPU= 29.370
  03:36:43 STEP 1259 H= 314:45 +CPU= 30.541
  03:37:20 STEP 1260 H= 315:00 +CPU= 36.878
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+001260
  03:37:48 STEP 1261 H= 315:15 +CPU= 28.110
  03:38:19 STEP 1262 H= 315:30 +CPU= 30.678
  03:38:48 STEP 1263 H= 315:45 +CPU= 28.542
  03:39:20 STEP 1264 H= 316:00 +CPU= 31.352
  03:39:51 STEP 1265 H= 316:15 +CPU= 30.861
  03:40:19 STEP 1266 H= 316:30 +CPU= 28.283
  03:40:48 STEP 1267 H= 316:45 +CPU= 28.477
  03:41:17 STEP 1268 H= 317:00 +CPU= 28.626
  03:41:46 STEP 1269 H= 317:15 +CPU= 29.301
  03:42:15 STEP 1270 H= 317:30 +CPU= 28.475
  03:42:45 STEP 1271 H= 317:45 +CPU= 29.692
  03:43:22 STEP 1272 H= 318:00 +CPU= 36.504
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+001272
  03:43:50 STEP 1273 H= 318:15 +CPU= 27.910
  03:44:19 STEP 1274 H= 318:30 +CPU= 28.357
  03:44:47 STEP 1275 H= 318:45 +CPU= 27.578
  03:45:18 STEP 1276 H= 319:00 +CPU= 31.204
  03:45:46 STEP 1277 H= 319:15 +CPU= 27.905
  03:46:14 STEP 1278 H= 319:30 +CPU= 27.755
  03:46:44 STEP 1279 H= 319:45 +CPU= 29.815
  03:47:15 STEP 1280 H= 320:00 +CPU= 30.248
  03:47:47 STEP 1281 H= 320:15 +CPU= 31.361
  03:48:15 STEP 1282 H= 320:30 +CPU= 28.450
  03:48:45 STEP 1283 H= 320:45 +CPU= 29.521
  03:49:21 STEP 1284 H= 321:00 +CPU= 36.127
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+001284
  03:49:51 STEP 1285 H= 321:15 +CPU= 29.201
  03:50:20 STEP 1286 H= 321:30 +CPU= 28.702
  03:50:49 STEP 1287 H= 321:45 +CPU= 29.144
  03:51:18 STEP 1288 H= 322:00 +CPU= 28.295
  03:51:46 STEP 1289 H= 322:15 +CPU= 28.226
  03:52:15 STEP 1290 H= 322:30 +CPU= 29.011
  03:52:44 STEP 1291 H= 322:45 +CPU= 28.488
  03:53:14 STEP 1292 H= 323:00 +CPU= 29.288
  03:53:44 STEP 1293 H= 323:15 +CPU= 30.448
  03:54:15 STEP 1294 H= 323:30 +CPU= 30.197
  03:54:44 STEP 1295 H= 323:45 +CPU= 29.511
  03:55:28 STEP 1296 H= 324:00 +CPU= 42.678
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+001296
  03:55:57 STEP 1297 H= 324:15 +CPU= 29.050
  03:56:29 STEP 1298 H= 324:30 +CPU= 31.803
  03:56:59 STEP 1299 H= 324:45 +CPU= 29.809
  03:57:28 STEP 1300 H= 325:00 +CPU= 28.784
  03:57:56 STEP 1301 H= 325:15 +CPU= 28.105
  03:58:24 STEP 1302 H= 325:30 +CPU= 27.212
  03:58:53 STEP 1303 H= 325:45 +CPU= 28.816
  03:59:22 STEP 1304 H= 326:00 +CPU= 29.414
  03:59:51 STEP 1305 H= 326:15 +CPU= 28.056
  04:00:19 STEP 1306 H= 326:30 +CPU= 28.613
  04:00:49 STEP 1307 H= 326:45 +CPU= 29.133
  04:01:27 STEP 1308 H= 327:00 +CPU= 37.691
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+001308
  04:01:56 STEP 1309 H= 327:15 +CPU= 28.886
  04:02:25 STEP 1310 H= 327:30 +CPU= 28.391
  04:02:53 STEP 1311 H= 327:45 +CPU= 28.239
  04:03:24 STEP 1312 H= 328:00 +CPU= 30.811
  04:03:54 STEP 1313 H= 328:15 +CPU= 29.614
  04:04:22 STEP 1314 H= 328:30 +CPU= 27.704
  04:04:52 STEP 1315 H= 328:45 +CPU= 29.920
  04:05:24 STEP 1316 H= 329:00 +CPU= 31.709
  04:05:54 STEP 1317 H= 329:15 +CPU= 29.825
  04:06:23 STEP 1318 H= 329:30 +CPU= 28.681
  04:06:54 STEP 1319 H= 329:45 +CPU= 29.976
  04:07:31 STEP 1320 H= 330:00 +CPU= 36.936
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+001320
  04:08:01 STEP 1321 H= 330:15 +CPU= 30.202
  04:08:30 STEP 1322 H= 330:30 +CPU= 28.639
  04:08:58 STEP 1323 H= 330:45 +CPU= 27.393
  04:09:28 STEP 1324 H= 331:00 +CPU= 29.583
  04:09:56 STEP 1325 H= 331:15 +CPU= 28.518
  04:10:25 STEP 1326 H= 331:30 +CPU= 28.315
  04:10:53 STEP 1327 H= 331:45 +CPU= 27.917
  04:11:24 STEP 1328 H= 332:00 +CPU= 31.094
  04:11:56 STEP 1329 H= 332:15 +CPU= 31.346
  04:12:27 STEP 1330 H= 332:30 +CPU= 30.360
  04:12:54 STEP 1331 H= 332:45 +CPU= 27.314
  04:13:32 STEP 1332 H= 333:00 +CPU= 37.843
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+001332
  04:14:03 STEP 1333 H= 333:15 +CPU= 30.017
  04:14:33 STEP 1334 H= 333:30 +CPU= 29.382
  04:15:01 STEP 1335 H= 333:45 +CPU= 27.637
  04:15:31 STEP 1336 H= 334:00 +CPU= 29.549
  04:16:00 STEP 1337 H= 334:15 +CPU= 29.453
  04:16:29 STEP 1338 H= 334:30 +CPU= 28.689
  04:16:59 STEP 1339 H= 334:45 +CPU= 29.642
  04:17:28 STEP 1340 H= 335:00 +CPU= 29.143
  04:17:56 STEP 1341 H= 335:15 +CPU= 27.420
  04:18:26 STEP 1342 H= 335:30 +CPU= 29.590
  04:18:54 STEP 1343 H= 335:45 +CPU= 28.181
  04:19:37 STEP 1344 H= 336:00 +CPU= 42.489
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+001332
Zipping up the intermediate file: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_a2r1_2016092300_15_991_12210352_0_r995678610_13.zip
Uploading the intermediate file: upload_file_13.zip
  04:20:08 STEP 1345 H= 336:15 +CPU= 29.861
  04:20:36 STEP 1346 H= 336:30 +CPU= 28.487
  04:21:04 STEP 1347 H= 336:45 +CPU= 27.842
  04:21:33 STEP 1348 H= 337:00 +CPU= 29.044
  04:22:02 STEP 1349 H= 337:15 +CPU= 28.389
  04:22:32 STEP 1350 H= 337:30 +CPU= 29.300
  04:23:02 STEP 1351 H= 337:45 +CPU= 29.491
  04:23:33 STEP 1352 H= 338:00 +CPU= 31.010
  04:24:03 STEP 1353 H= 338:15 +CPU= 30.492
  04:24:33 STEP 1354 H= 338:30 +CPU= 29.686
  04:25:03 STEP 1355 H= 338:45 +CPU= 29.025
  04:25:41 STEP 1356 H= 339:00 +CPU= 38.407
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+001356
  04:26:10 STEP 1357 H= 339:15 +CPU= 28.346
  04:26:39 STEP 1358 H= 339:30 +CPU= 29.299
  04:27:08 STEP 1359 H= 339:45 +CPU= 28.591
  04:27:38 STEP 1360 H= 340:00 +CPU= 29.122
  04:28:06 STEP 1361 H= 340:15 +CPU= 28.291
  04:28:34 STEP 1362 H= 340:30 +CPU= 27.792
  04:29:03 STEP 1363 H= 340:45 +CPU= 28.669
  04:29:32 STEP 1364 H= 341:00 +CPU= 28.991
  04:30:01 STEP 1365 H= 341:15 +CPU= 28.556
  04:30:30 STEP 1366 H= 341:30 +CPU= 28.510
  04:30:59 STEP 1367 H= 341:45 +CPU= 29.408
  04:31:38 STEP 1368 H= 342:00 +CPU= 38.173
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+001368
  04:32:08 STEP 1369 H= 342:15 +CPU= 30.198
  04:32:37 STEP 1370 H= 342:30 +CPU= 28.111
  04:33:07 STEP 1371 H= 342:45 +CPU= 30.147
  04:33:37 STEP 1372 H= 343:00 +CPU= 29.600
  04:34:07 STEP 1373 H= 343:15 +CPU= 30.086
  04:34:37 STEP 1374 H= 343:30 +CPU= 28.890
  04:35:05 STEP 1375 H= 343:45 +CPU= 27.891
  04:35:34 STEP 1376 H= 344:00 +CPU= 28.676
  04:36:02 STEP 1377 H= 344:15 +CPU= 28.030
  04:36:31 STEP 1378 H= 344:30 +CPU= 29.107
  04:37:02 STEP 1379 H= 344:45 +CPU= 30.420
  04:37:38 STEP 1380 H= 345:00 +CPU= 35.945
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+001380
  04:38:08 STEP 1381 H= 345:15 +CPU= 29.139
  04:38:35 STEP 1382 H= 345:30 +CPU= 27.586
  04:39:03 STEP 1383 H= 345:45 +CPU= 27.816
  04:39:32 STEP 1384 H= 346:00 +CPU= 27.834
  04:40:03 STEP 1385 H= 346:15 +CPU= 30.663
  04:40:33 STEP 1386 H= 346:30 +CPU= 29.768
  04:41:02 STEP 1387 H= 346:45 +CPU= 29.195
  04:41:31 STEP 1388 H= 347:00 +CPU= 29.242
  04:42:01 STEP 1389 H= 347:15 +CPU= 29.186
  04:42:30 STEP 1390 H= 347:30 +CPU= 28.533
  04:42:59 STEP 1391 H= 347:45 +CPU= 29.114
  04:43:41 STEP 1392 H= 348:00 +CPU= 41.656
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+001392
  04:44:11 STEP 1393 H= 348:15 +CPU= 29.742
  04:44:40 STEP 1394 H= 348:30 +CPU= 29.030
  04:45:10 STEP 1395 H= 348:45 +CPU= 29.644
  04:45:39 STEP 1396 H= 349:00 +CPU= 28.721
  04:46:11 STEP 1397 H= 349:15 +CPU= 31.971
  04:46:41 STEP 1398 H= 349:30 +CPU= 29.023
  04:47:11 STEP 1399 H= 349:45 +CPU= 29.690
  04:47:41 STEP 1400 H= 350:00 +CPU= 30.077
  04:48:08 STEP 1401 H= 350:15 +CPU= 26.548
  04:48:37 STEP 1402 H= 350:30 +CPU= 28.566
  04:49:05 STEP 1403 H= 350:45 +CPU= 28.443
  04:49:41 STEP 1404 H= 351:00 +CPU= 35.169
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+001404
  04:50:09 STEP 1405 H= 351:15 +CPU= 28.374
  04:50:37 STEP 1406 H= 351:30 +CPU= 28.013
  04:51:06 STEP 1407 H= 351:45 +CPU= 28.228
  04:51:34 STEP 1408 H= 352:00 +CPU= 27.935
  04:52:03 STEP 1409 H= 352:15 +CPU= 28.379
  04:52:32 STEP 1410 H= 352:30 +CPU= 29.552
  04:52:59 STEP 1411 H= 352:45 +CPU= 26.878
  04:53:28 STEP 1412 H= 353:00 +CPU= 28.798
  04:54:00 STEP 1413 H= 353:15 +CPU= 31.077
  04:54:30 STEP 1414 H= 353:30 +CPU= 30.346
  04:55:00 STEP 1415 H= 353:45 +CPU= 29.731
  04:55:38 STEP 1416 H= 354:00 +CPU= 37.142
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+001416
  04:56:07 STEP 1417 H= 354:15 +CPU= 29.034
  04:56:34 STEP 1418 H= 354:30 +CPU= 26.869
  04:57:02 STEP 1419 H= 354:45 +CPU= 28.034
  04:57:30 STEP 1420 H= 355:00 +CPU= 27.579
  04:57:59 STEP 1421 H= 355:15 +CPU= 29.281
  04:58:27 STEP 1422 H= 355:30 +CPU= 27.424
  04:58:57 STEP 1423 H= 355:45 +CPU= 29.370
  04:59:25 STEP 1424 H= 356:00 +CPU= 28.471
  04:59:53 STEP 1425 H= 356:15 +CPU= 28.081
  05:00:21 STEP 1426 H= 356:30 +CPU= 27.561
  05:00:49 STEP 1427 H= 356:45 +CPU= 27.538
  05:01:24 STEP 1428 H= 357:00 +CPU= 34.643
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+001428
  05:01:51 STEP 1429 H= 357:15 +CPU= 27.216
  05:02:20 STEP 1430 H= 357:30 +CPU= 28.596
  05:02:47 STEP 1431 H= 357:45 +CPU= 27.555
  05:03:16 STEP 1432 H= 358:00 +CPU= 28.361
  05:03:45 STEP 1433 H= 358:15 +CPU= 28.578
  05:04:13 STEP 1434 H= 358:30 +CPU= 28.643
  05:04:42 STEP 1435 H= 358:45 +CPU= 28.295
  05:05:10 STEP 1436 H= 359:00 +CPU= 28.220
  05:05:39 STEP 1437 H= 359:15 +CPU= 27.992
  05:06:08 STEP 1438 H= 359:30 +CPU= 28.949
  05:06:37 STEP 1439 H= 359:45 +CPU= 29.021
  05:07:17 STEP 1440 H= 360:00 +CPU= 39.568
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I      0.7968739791E-22      I       0.4069765104E-07      I
ICloud fractionI      0.0000000000E+00      I       0.2699734529E-01      I
I  Relat. Hum. I      0.6935278390E-01      I       0.1342366972E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.1132797667E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    303533073 BYTES IN      7 RECORDS TRANSFERRED IN    0.0006 SECONDS505888.5 Mbytes/s, TOTAL TIME=    0.0122( 4.9%)
 05:07:17 STEP 1440 H= 360:00 +CPU= 39.568
 END CNT3
 NSTEP =  1440 CNT0   000000000  26.924  26.924  27.110   0.993               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ            0/           0 WRITTEN        42886/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    758    0        0            0    42886 ************   120.7     0.0   120.7     0.0   220.4
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.99      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 1562    6328.3    6328.3     20.90      0.00
   9 SPCM     - SPECTRAL COMP.                    1440    1209.0    1209.0      3.68      0.00
  10 SCAN2M - PHYSICS                             1441   14069.0   14069.0     42.87      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                121    1407.4    1407.4      0.36      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 63      86.1      86.1      0.01      0.00
  14 SUINIF                                          1    4245.5    4245.5      0.01      0.00
  17 GRIDFPOS IN CNT4                              121      38.0      38.0      0.01      0.00
  18 SUSPECG                                         1    2161.2    2161.2      0.00      0.00
  19 SUSPEC                                          1    2168.7    2168.7      0.00      0.00
  24 SUGRIDU                                         1    1418.7    1418.7      0.00      0.00
  25 SPECRT                                          1     341.6     341.6      0.00      0.00
  26 SUGRIDF                                         1     316.4     316.4      0.00      0.00
  27 RESTART FILES - WRITING                        30    5675.7    5675.7      0.36      0.00
  28 RESTART FILES - READING                         1       0.0       0.0      0.00      0.00
  29 SU4FPOS IN CNT4                               121       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                               121    7279.3    7279.3      1.86      0.00
  31 POSDDH IN STEPO                                 7       4.5       4.5      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   1441    6407.3    6407.3     19.53      0.00
  39 SU0YOMB                                         1     395.8     395.8      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   1441      36.4      36.4      0.11      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             1440     467.9     467.9      1.43      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             1440      83.9      83.9      0.26      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 63       0.5       0.5      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     3125     501.0     501.0      3.31      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      3006     282.2     282.2      1.79      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       3006     119.3     119.3      0.76      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      3125     162.9     162.9      1.08      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      50.7      50.7      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           3125      83.6      83.6      0.55      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           3006      47.3      47.3      0.30      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           3125     140.8     140.8      0.93      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           3006      57.4      57.4      0.36      0.00
 400 GSTATS                                     167374       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                155706       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    47285.6 CPU TIME   46662.2 VECTOR TIME    46662.2


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       27.4
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc-client50005/slots/5/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client50005/slots/5/NODE.001_01
Adding to the zip: /var/lib/boinc-client50005/slots/5/ifs.stat
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_12210352/ICMSHh7zg+001368
Zipping up the final file: /var/lib/boinc-client50005/projects/climateprediction.net/oifs_43r3_bl_a2r1_2016092300_15_991_12210352_0_r995678610_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
05:10:51 (1551700): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:53:16 1537194 22310565 oifs_43r3_bl_a2r1_2016092300_15_991_12210352_0 1,295,100 46,662 0.0360
09 May 2023 16:53:02 1537194 22310565 oifs_43r3_bl_a2r1_2016092300_15_991_12210352_0 864,000 32,301 0.0374


©2024 climateprediction.net