climateprediction.net home page
Task 22308419

Task 22308419

Name oifs_43r3_bl_a14f_2016092300_15_991_12208242_0
Workunit 12208242
Created 13 Feb 2023, 14:41:35 UTC
Sent 14 Feb 2023, 5:26:28 UTC
Report deadline 15 Apr 2023, 5:26:28 UTC
Received 14 Feb 2023, 21:53:57 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1531398
Run time 12 hours 59 min 35 sec
CPU time 12 hours 49 min 33 sec
Validate state Valid
Credit 1,815.66
Device peak FLOPS 7.93 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.11
x86_64-pc-linux-gnu
Peak working set size 5,625.02 MB
Peak swap size 5,930.79 MB
Peak disk usage 1,294.87 MB
Stderr
<core_client_version>7.20.2</core_client_version>
<![CDATA[
<stderr_txt>
/var/lib/boinc/slots/12/ICMUAh7zg+000924
  13:11:17 STEP  925 H= 231:15 +CPU= 35.532
  13:11:52 STEP  926 H= 231:30 +CPU= 35.038
  13:12:28 STEP  927 H= 231:45 +CPU= 35.769
  13:13:04 STEP  928 H= 232:00 +CPU= 35.841
  13:13:42 STEP  929 H= 232:15 +CPU= 37.098
  13:14:18 STEP  930 H= 232:30 +CPU= 35.899
  13:14:54 STEP  931 H= 232:45 +CPU= 36.386
  13:15:30 STEP  932 H= 233:00 +CPU= 35.102
  13:16:05 STEP  933 H= 233:15 +CPU= 34.733
  13:16:39 STEP  934 H= 233:30 +CPU= 34.371
  13:17:15 STEP  935 H= 233:45 +CPU= 35.549
  13:18:00 STEP  936 H= 234:00 +CPU= 44.077
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+000936
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+000936
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+000936
  13:18:35 STEP  937 H= 234:15 +CPU= 35.139
  13:19:11 STEP  938 H= 234:30 +CPU= 35.661
  13:19:47 STEP  939 H= 234:45 +CPU= 35.888
  13:20:23 STEP  940 H= 235:00 +CPU= 35.426
  13:20:56 STEP  941 H= 235:15 +CPU= 33.439
  13:21:31 STEP  942 H= 235:30 +CPU= 34.758
  13:22:08 STEP  943 H= 235:45 +CPU= 35.909
  13:22:43 STEP  944 H= 236:00 +CPU= 35.440
  13:23:20 STEP  945 H= 236:15 +CPU= 36.254
  13:23:55 STEP  946 H= 236:30 +CPU= 35.156
  13:24:30 STEP  947 H= 236:45 +CPU= 34.780
  13:25:16 STEP  948 H= 237:00 +CPU= 45.327
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+000948
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+000948
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+000948
  13:25:53 STEP  949 H= 237:15 +CPU= 37.060
  13:26:27 STEP  950 H= 237:30 +CPU= 33.736
  13:27:02 STEP  951 H= 237:45 +CPU= 35.064
  13:27:40 STEP  952 H= 238:00 +CPU= 37.234
  13:28:15 STEP  953 H= 238:15 +CPU= 34.514
  13:28:49 STEP  954 H= 238:30 +CPU= 33.965
  13:29:24 STEP  955 H= 238:45 +CPU= 34.755
  13:30:00 STEP  956 H= 239:00 +CPU= 35.698
  13:30:35 STEP  957 H= 239:15 +CPU= 34.790
  13:31:09 STEP  958 H= 239:30 +CPU= 34.322
  13:31:44 STEP  959 H= 239:45 +CPU= 34.505
  13:32:32 STEP  960 H= 240:00 +CPU= 47.689
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+000960
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+000960
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+000864
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+000864
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+000876
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+000876
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+000876
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+000888
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+000888
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+000888
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+000900
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+000900
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+000900
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+000912
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+000912
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+000912
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+000924
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+000924
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+000924
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+000936
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+000936
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+000936
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+000948
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+000948
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+000948
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a14f_2016092300_15_991_12208242_0_r1733063142_9.zip
Uploading the intermediate file: upload_file_9.zip
  13:33:07 STEP  961 H= 240:15 +CPU= 34.151
Uploading trickle at timestep: 864000
  13:33:42 STEP  962 H= 240:30 +CPU= 34.982
  13:34:17 STEP  963 H= 240:45 +CPU= 34.054
  13:34:53 STEP  964 H= 241:00 +CPU= 35.090
  13:35:31 STEP  965 H= 241:15 +CPU= 37.890
  13:36:06 STEP  966 H= 241:30 +CPU= 35.519
  13:36:42 STEP  967 H= 241:45 +CPU= 35.122
  13:37:18 STEP  968 H= 242:00 +CPU= 35.912
  13:37:53 STEP  969 H= 242:15 +CPU= 35.324
  13:38:28 STEP  970 H= 242:30 +CPU= 34.636
  13:39:03 STEP  971 H= 242:45 +CPU= 33.929
  13:39:48 STEP  972 H= 243:00 +CPU= 44.603
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+000972
  13:40:23 STEP  973 H= 243:15 +CPU= 33.713
  13:40:58 STEP  974 H= 243:30 +CPU= 33.263
  13:41:33 STEP  975 H= 243:45 +CPU= 35.017
  13:42:09 STEP  976 H= 244:00 +CPU= 36.272
  13:42:45 STEP  977 H= 244:15 +CPU= 35.791
  13:43:22 STEP  978 H= 244:30 +CPU= 35.923
  13:43:56 STEP  979 H= 244:45 +CPU= 34.447
  13:44:32 STEP  980 H= 245:00 +CPU= 35.324
  13:45:08 STEP  981 H= 245:15 +CPU= 35.175
  13:45:44 STEP  982 H= 245:30 +CPU= 36.449
  13:46:19 STEP  983 H= 245:45 +CPU= 34.905
  13:47:04 STEP  984 H= 246:00 +CPU= 44.139
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+000984
  13:47:38 STEP  985 H= 246:15 +CPU= 33.982
  13:48:14 STEP  986 H= 246:30 +CPU= 35.911
  13:48:50 STEP  987 H= 246:45 +CPU= 35.726
  13:49:26 STEP  988 H= 247:00 +CPU= 35.704
  13:50:02 STEP  989 H= 247:15 +CPU= 35.119
  13:50:37 STEP  990 H= 247:30 +CPU= 34.955
  13:51:13 STEP  991 H= 247:45 +CPU= 36.067
  13:51:48 STEP  992 H= 248:00 +CPU= 34.664
  13:52:24 STEP  993 H= 248:15 +CPU= 35.862
  13:52:59 STEP  994 H= 248:30 +CPU= 34.244
  13:53:33 STEP  995 H= 248:45 +CPU= 33.584
  13:54:19 STEP  996 H= 249:00 +CPU= 45.416
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+000996
  13:54:54 STEP  997 H= 249:15 +CPU= 35.041
  13:55:30 STEP  998 H= 249:30 +CPU= 35.259
  13:56:05 STEP  999 H= 249:45 +CPU= 35.232
  13:56:42 STEP 1000 H= 250:00 +CPU= 36.360
  13:57:17 STEP 1001 H= 250:15 +CPU= 34.945
  13:57:52 STEP 1002 H= 250:30 +CPU= 34.895
  13:58:27 STEP 1003 H= 250:45 +CPU= 33.830
  13:59:03 STEP 1004 H= 251:00 +CPU= 36.235
  13:59:38 STEP 1005 H= 251:15 +CPU= 35.153
  14:00:13 STEP 1006 H= 251:30 +CPU= 34.557
  14:00:49 STEP 1007 H= 251:45 +CPU= 36.012
  14:01:36 STEP 1008 H= 252:00 +CPU= 47.064
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001008
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001008
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001008
  14:02:12 STEP 1009 H= 252:15 +CPU= 35.143
  14:02:46 STEP 1010 H= 252:30 +CPU= 34.715
  14:03:20 STEP 1011 H= 252:45 +CPU= 33.822
  14:03:57 STEP 1012 H= 253:00 +CPU= 36.413
  14:04:32 STEP 1013 H= 253:15 +CPU= 34.628
  14:05:07 STEP 1014 H= 253:30 +CPU= 35.132
  14:05:43 STEP 1015 H= 253:45 +CPU= 35.184
  14:06:22 STEP 1016 H= 254:00 +CPU= 38.389
  14:06:58 STEP 1017 H= 254:15 +CPU= 34.975
  14:07:35 STEP 1018 H= 254:30 +CPU= 36.878
  14:08:10 STEP 1019 H= 254:45 +CPU= 35.259
  14:08:55 STEP 1020 H= 255:00 +CPU= 44.617
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001020
  14:09:30 STEP 1021 H= 255:15 +CPU= 34.223
  14:10:07 STEP 1022 H= 255:30 +CPU= 37.018
  14:10:41 STEP 1023 H= 255:45 +CPU= 34.145
  14:11:17 STEP 1024 H= 256:00 +CPU= 35.134
  14:11:51 STEP 1025 H= 256:15 +CPU= 34.204
  14:12:25 STEP 1026 H= 256:30 +CPU= 33.322
  14:13:00 STEP 1027 H= 256:45 +CPU= 34.826
  14:13:36 STEP 1028 H= 257:00 +CPU= 35.861
  14:14:12 STEP 1029 H= 257:15 +CPU= 36.150
  14:14:46 STEP 1030 H= 257:30 +CPU= 33.127
  14:15:21 STEP 1031 H= 257:45 +CPU= 34.351
  14:16:05 STEP 1032 H= 258:00 +CPU= 43.523
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001032
  14:16:42 STEP 1033 H= 258:15 +CPU= 37.567
  14:17:17 STEP 1034 H= 258:30 +CPU= 34.481
  14:17:51 STEP 1035 H= 258:45 +CPU= 34.255
  14:18:29 STEP 1036 H= 259:00 +CPU= 37.127
  14:19:04 STEP 1037 H= 259:15 +CPU= 34.618
  14:19:39 STEP 1038 H= 259:30 +CPU= 35.165
  14:20:14 STEP 1039 H= 259:45 +CPU= 34.241
  14:20:49 STEP 1040 H= 260:00 +CPU= 35.031
  14:21:24 STEP 1041 H= 260:15 +CPU= 34.658
  14:21:59 STEP 1042 H= 260:30 +CPU= 34.547
  14:22:34 STEP 1043 H= 260:45 +CPU= 35.264
  14:23:17 STEP 1044 H= 261:00 +CPU= 42.568
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001044
  14:23:52 STEP 1045 H= 261:15 +CPU= 34.823
  14:24:27 STEP 1046 H= 261:30 +CPU= 35.232
  14:25:05 STEP 1047 H= 261:45 +CPU= 37.092
  14:25:41 STEP 1048 H= 262:00 +CPU= 35.901
  14:26:17 STEP 1049 H= 262:15 +CPU= 35.599
  14:26:55 STEP 1050 H= 262:30 +CPU= 37.950
  14:27:30 STEP 1051 H= 262:45 +CPU= 35.039
  14:28:05 STEP 1052 H= 263:00 +CPU= 34.678
  14:28:40 STEP 1053 H= 263:15 +CPU= 34.603
  14:29:15 STEP 1054 H= 263:30 +CPU= 34.744
  14:29:50 STEP 1055 H= 263:45 +CPU= 34.996
  14:30:38 STEP 1056 H= 264:00 +CPU= 47.006
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+001044
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a14f_2016092300_15_991_12208242_0_r1733063142_10.zip
Uploading the intermediate file: upload_file_10.zip
  14:31:12 STEP 1057 H= 264:15 +CPU= 33.826
  14:31:47 STEP 1058 H= 264:30 +CPU= 34.642
  14:32:22 STEP 1059 H= 264:45 +CPU= 34.874
  14:32:59 STEP 1060 H= 265:00 +CPU= 36.466
  14:33:34 STEP 1061 H= 265:15 +CPU= 34.080
  14:34:09 STEP 1062 H= 265:30 +CPU= 34.836
  14:34:44 STEP 1063 H= 265:45 +CPU= 35.029
  14:35:21 STEP 1064 H= 266:00 +CPU= 35.967
  14:35:57 STEP 1065 H= 266:15 +CPU= 35.845
  14:36:32 STEP 1066 H= 266:30 +CPU= 34.636
  14:37:05 STEP 1067 H= 266:45 +CPU= 33.560
  14:37:50 STEP 1068 H= 267:00 +CPU= 44.355
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001068
  14:38:25 STEP 1069 H= 267:15 +CPU= 32.598
  14:39:00 STEP 1070 H= 267:30 +CPU= 34.319
  14:39:35 STEP 1071 H= 267:45 +CPU= 34.586
  14:40:10 STEP 1072 H= 268:00 +CPU= 34.590
  14:40:45 STEP 1073 H= 268:15 +CPU= 34.857
  14:41:20 STEP 1074 H= 268:30 +CPU= 34.907
  14:41:54 STEP 1075 H= 268:45 +CPU= 34.128
  14:42:31 STEP 1076 H= 269:00 +CPU= 36.230
  14:43:05 STEP 1077 H= 269:15 +CPU= 33.580
  14:43:42 STEP 1078 H= 269:30 +CPU= 36.639
  14:44:17 STEP 1079 H= 269:45 +CPU= 34.357
  14:45:01 STEP 1080 H= 270:00 +CPU= 44.206
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001080
  14:45:39 STEP 1081 H= 270:15 +CPU= 36.476
  14:46:13 STEP 1082 H= 270:30 +CPU= 34.584
  14:46:48 STEP 1083 H= 270:45 +CPU= 34.595
  14:47:25 STEP 1084 H= 271:00 +CPU= 36.881
  14:48:01 STEP 1085 H= 271:15 +CPU= 35.083
  14:48:36 STEP 1086 H= 271:30 +CPU= 34.954
  14:49:10 STEP 1087 H= 271:45 +CPU= 34.234
  14:49:46 STEP 1088 H= 272:00 +CPU= 35.908
  14:50:22 STEP 1089 H= 272:15 +CPU= 35.174
  14:50:56 STEP 1090 H= 272:30 +CPU= 34.064
  14:51:31 STEP 1091 H= 272:45 +CPU= 33.314
  14:52:15 STEP 1092 H= 273:00 +CPU= 43.550
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001092
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001092
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001092
  14:52:51 STEP 1093 H= 273:15 +CPU= 36.124
  14:53:26 STEP 1094 H= 273:30 +CPU= 35.076
  14:54:02 STEP 1095 H= 273:45 +CPU= 35.380
  14:54:38 STEP 1096 H= 274:00 +CPU= 35.637
  14:55:13 STEP 1097 H= 274:15 +CPU= 34.879
  14:55:48 STEP 1098 H= 274:30 +CPU= 35.042
  14:56:22 STEP 1099 H= 274:45 +CPU= 33.798
  14:56:59 STEP 1100 H= 275:00 +CPU= 36.055
  14:57:33 STEP 1101 H= 275:15 +CPU= 34.553
  14:58:08 STEP 1102 H= 275:30 +CPU= 34.458
  14:58:43 STEP 1103 H= 275:45 +CPU= 35.011
  14:59:33 STEP 1104 H= 276:00 +CPU= 48.428
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001104
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001104
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001104
  15:00:09 STEP 1105 H= 276:15 +CPU= 35.582
  15:00:45 STEP 1106 H= 276:30 +CPU= 35.642
  15:01:20 STEP 1107 H= 276:45 +CPU= 34.330
  15:01:56 STEP 1108 H= 277:00 +CPU= 36.158
  15:02:32 STEP 1109 H= 277:15 +CPU= 35.777
  15:03:07 STEP 1110 H= 277:30 +CPU= 34.758
  15:03:42 STEP 1111 H= 277:45 +CPU= 34.237
  15:04:18 STEP 1112 H= 278:00 +CPU= 35.530
  15:04:53 STEP 1113 H= 278:15 +CPU= 34.667
  15:05:28 STEP 1114 H= 278:30 +CPU= 34.813
  15:06:03 STEP 1115 H= 278:45 +CPU= 34.754
  15:06:47 STEP 1116 H= 279:00 +CPU= 44.166
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001116
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001116
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001116
  15:07:23 STEP 1117 H= 279:15 +CPU= 35.388
  15:07:59 STEP 1118 H= 279:30 +CPU= 34.599
  15:08:34 STEP 1119 H= 279:45 +CPU= 35.393
  15:09:10 STEP 1120 H= 280:00 +CPU= 35.346
  15:09:46 STEP 1121 H= 280:15 +CPU= 35.608
  15:10:20 STEP 1122 H= 280:30 +CPU= 34.680
  15:10:56 STEP 1123 H= 280:45 +CPU= 34.882
  15:11:32 STEP 1124 H= 281:00 +CPU= 36.515
  15:12:08 STEP 1125 H= 281:15 +CPU= 35.259
  15:12:43 STEP 1126 H= 281:30 +CPU= 35.250
  15:13:18 STEP 1127 H= 281:45 +CPU= 34.072
  15:14:03 STEP 1128 H= 282:00 +CPU= 45.008
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001128
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001128
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001128
  15:14:37 STEP 1129 H= 282:15 +CPU= 34.127
  15:15:13 STEP 1130 H= 282:30 +CPU= 35.245
  15:15:49 STEP 1131 H= 282:45 +CPU= 35.782
  15:16:26 STEP 1132 H= 283:00 +CPU= 36.739
  15:17:01 STEP 1133 H= 283:15 +CPU= 35.131
  15:17:37 STEP 1134 H= 283:30 +CPU= 35.623
  15:18:13 STEP 1135 H= 283:45 +CPU= 36.678
  15:18:48 STEP 1136 H= 284:00 +CPU= 34.860
  15:19:23 STEP 1137 H= 284:15 +CPU= 34.760
  15:19:58 STEP 1138 H= 284:30 +CPU= 34.512
  15:20:33 STEP 1139 H= 284:45 +CPU= 34.267
  15:21:17 STEP 1140 H= 285:00 +CPU= 44.283
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001140
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001140
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001140
  15:21:52 STEP 1141 H= 285:15 +CPU= 34.912
  15:22:27 STEP 1142 H= 285:30 +CPU= 34.635
  15:23:02 STEP 1143 H= 285:45 +CPU= 34.437
  15:23:37 STEP 1144 H= 286:00 +CPU= 34.730
  15:24:13 STEP 1145 H= 286:15 +CPU= 35.396
  15:24:48 STEP 1146 H= 286:30 +CPU= 35.642
  15:25:24 STEP 1147 H= 286:45 +CPU= 35.221
  15:26:00 STEP 1148 H= 287:00 +CPU= 35.380
  15:26:35 STEP 1149 H= 287:15 +CPU= 35.098
  15:27:09 STEP 1150 H= 287:30 +CPU= 34.201
  15:27:45 STEP 1151 H= 287:45 +CPU= 35.328
  15:28:32 STEP 1152 H= 288:00 +CPU= 46.899
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+001140
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a14f_2016092300_15_991_12208242_0_r1733063142_11.zip
Uploading the intermediate file: upload_file_11.zip
  15:29:07 STEP 1153 H= 288:15 +CPU= 34.179
  15:29:42 STEP 1154 H= 288:30 +CPU= 34.508
  15:30:16 STEP 1155 H= 288:45 +CPU= 34.333
  15:30:52 STEP 1156 H= 289:00 +CPU= 34.772
  15:31:27 STEP 1157 H= 289:15 +CPU= 35.659
  15:32:03 STEP 1158 H= 289:30 +CPU= 35.176
  15:32:38 STEP 1159 H= 289:45 +CPU= 35.268
  15:33:14 STEP 1160 H= 290:00 +CPU= 34.661
  15:33:51 STEP 1161 H= 290:15 +CPU= 36.840
  15:34:26 STEP 1162 H= 290:30 +CPU= 35.008
  15:35:00 STEP 1163 H= 290:45 +CPU= 34.048
  15:35:47 STEP 1164 H= 291:00 +CPU= 45.372
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001164
  15:36:22 STEP 1165 H= 291:15 +CPU= 33.029
  15:36:57 STEP 1166 H= 291:30 +CPU= 35.538
  15:37:32 STEP 1167 H= 291:45 +CPU= 34.660
  15:38:08 STEP 1168 H= 292:00 +CPU= 35.809
  15:38:43 STEP 1169 H= 292:15 +CPU= 34.219
  15:39:18 STEP 1170 H= 292:30 +CPU= 35.003
  15:39:52 STEP 1171 H= 292:45 +CPU= 34.295
  15:40:28 STEP 1172 H= 293:00 +CPU= 35.380
  15:41:03 STEP 1173 H= 293:15 +CPU= 34.591
  15:41:38 STEP 1174 H= 293:30 +CPU= 34.879
  15:42:12 STEP 1175 H= 293:45 +CPU= 33.621
  15:42:56 STEP 1176 H= 294:00 +CPU= 43.467
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001176
  15:43:31 STEP 1177 H= 294:15 +CPU= 34.862
  15:44:06 STEP 1178 H= 294:30 +CPU= 34.189
  15:44:40 STEP 1179 H= 294:45 +CPU= 33.741
  15:45:16 STEP 1180 H= 295:00 +CPU= 35.622
  15:45:51 STEP 1181 H= 295:15 +CPU= 34.789
  15:46:27 STEP 1182 H= 295:30 +CPU= 35.436
  15:47:02 STEP 1183 H= 295:45 +CPU= 34.381
  15:47:38 STEP 1184 H= 296:00 +CPU= 35.680
  15:48:13 STEP 1185 H= 296:15 +CPU= 34.939
  15:48:48 STEP 1186 H= 296:30 +CPU= 35.182
  15:49:23 STEP 1187 H= 296:45 +CPU= 35.196
  15:50:08 STEP 1188 H= 297:00 +CPU= 42.766
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001188
  15:50:44 STEP 1189 H= 297:15 +CPU= 35.199
  15:51:18 STEP 1190 H= 297:30 +CPU= 34.664
  15:51:54 STEP 1191 H= 297:45 +CPU= 35.260
  15:52:30 STEP 1192 H= 298:00 +CPU= 35.585
  15:53:05 STEP 1193 H= 298:15 +CPU= 34.775
  15:53:40 STEP 1194 H= 298:30 +CPU= 34.398
  15:54:15 STEP 1195 H= 298:45 +CPU= 34.948
  15:54:51 STEP 1196 H= 299:00 +CPU= 36.137
  15:55:27 STEP 1197 H= 299:15 +CPU= 35.312
  15:56:02 STEP 1198 H= 299:30 +CPU= 35.179
  15:56:38 STEP 1199 H= 299:45 +CPU= 36.012
  15:57:24 STEP 1200 H= 300:00 +CPU= 45.849
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001200
  15:58:00 STEP 1201 H= 300:15 +CPU= 35.970
  15:58:35 STEP 1202 H= 300:30 +CPU= 34.806
  15:59:11 STEP 1203 H= 300:45 +CPU= 35.085
  15:59:46 STEP 1204 H= 301:00 +CPU= 35.398
  16:00:22 STEP 1205 H= 301:15 +CPU= 35.314
  16:00:57 STEP 1206 H= 301:30 +CPU= 35.221
  16:01:33 STEP 1207 H= 301:45 +CPU= 34.705
  16:02:10 STEP 1208 H= 302:00 +CPU= 36.825
  16:02:48 STEP 1209 H= 302:15 +CPU= 37.396
  16:03:23 STEP 1210 H= 302:30 +CPU= 35.530
  16:03:59 STEP 1211 H= 302:45 +CPU= 35.380
  16:04:44 STEP 1212 H= 303:00 +CPU= 43.291
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001212
  16:05:18 STEP 1213 H= 303:15 +CPU= 34.549
  16:05:53 STEP 1214 H= 303:30 +CPU= 34.506
  16:06:28 STEP 1215 H= 303:45 +CPU= 34.638
  16:07:03 STEP 1216 H= 304:00 +CPU= 35.398
  16:07:40 STEP 1217 H= 304:15 +CPU= 36.767
  16:08:16 STEP 1218 H= 304:30 +CPU= 34.937
  16:08:50 STEP 1219 H= 304:45 +CPU= 34.451
  16:09:27 STEP 1220 H= 305:00 +CPU= 36.021
  16:10:01 STEP 1221 H= 305:15 +CPU= 34.755
  16:10:37 STEP 1222 H= 305:30 +CPU= 34.787
  16:11:12 STEP 1223 H= 305:45 +CPU= 34.941
  16:11:57 STEP 1224 H= 306:00 +CPU= 43.883
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001224
  16:12:32 STEP 1225 H= 306:15 +CPU= 34.577
  16:13:07 STEP 1226 H= 306:30 +CPU= 34.692
  16:13:41 STEP 1227 H= 306:45 +CPU= 34.239
  16:14:17 STEP 1228 H= 307:00 +CPU= 36.098
  16:14:52 STEP 1229 H= 307:15 +CPU= 34.574
  16:15:28 STEP 1230 H= 307:30 +CPU= 35.197
  16:16:04 STEP 1231 H= 307:45 +CPU= 36.218
  16:16:40 STEP 1232 H= 308:00 +CPU= 35.663
  16:17:16 STEP 1233 H= 308:15 +CPU= 36.477
  16:17:54 STEP 1234 H= 308:30 +CPU= 37.355
  16:18:29 STEP 1235 H= 308:45 +CPU= 34.751
  16:19:14 STEP 1236 H= 309:00 +CPU= 44.724
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001236
  16:19:49 STEP 1237 H= 309:15 +CPU= 34.744
  16:20:24 STEP 1238 H= 309:30 +CPU= 34.848
  16:20:59 STEP 1239 H= 309:45 +CPU= 34.365
  16:21:34 STEP 1240 H= 310:00 +CPU= 34.828
  16:22:08 STEP 1241 H= 310:15 +CPU= 34.752
  16:22:44 STEP 1242 H= 310:30 +CPU= 34.905
  16:23:19 STEP 1243 H= 310:45 +CPU= 34.920
  16:23:55 STEP 1244 H= 311:00 +CPU= 36.261
  16:24:30 STEP 1245 H= 311:15 +CPU= 35.153
  16:25:06 STEP 1246 H= 311:30 +CPU= 35.772
  16:25:40 STEP 1247 H= 311:45 +CPU= 33.652
  16:26:26 STEP 1248 H= 312:00 +CPU= 45.766
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+001236
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a14f_2016092300_15_991_12208242_0_r1733063142_12.zip
Uploading the intermediate file: upload_file_12.zip
  16:27:01 STEP 1249 H= 312:15 +CPU= 34.795
  16:27:37 STEP 1250 H= 312:30 +CPU= 35.710
  16:28:13 STEP 1251 H= 312:45 +CPU= 35.097
  16:28:49 STEP 1252 H= 313:00 +CPU= 35.739
  16:29:23 STEP 1253 H= 313:15 +CPU= 34.151
  16:29:58 STEP 1254 H= 313:30 +CPU= 34.544
  16:30:32 STEP 1255 H= 313:45 +CPU= 34.554
  16:31:08 STEP 1256 H= 314:00 +CPU= 35.624
  16:31:44 STEP 1257 H= 314:15 +CPU= 35.333
  16:32:19 STEP 1258 H= 314:30 +CPU= 35.001
  16:32:55 STEP 1259 H= 314:45 +CPU= 34.647
  16:33:38 STEP 1260 H= 315:00 +CPU= 41.767
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001260
  16:34:13 STEP 1261 H= 315:15 +CPU= 33.450
  16:34:48 STEP 1262 H= 315:30 +CPU= 34.101
  16:35:22 STEP 1263 H= 315:45 +CPU= 34.279
  16:35:58 STEP 1264 H= 316:00 +CPU= 35.628
  16:36:33 STEP 1265 H= 316:15 +CPU= 35.165
  16:37:09 STEP 1266 H= 316:30 +CPU= 35.560
  16:37:43 STEP 1267 H= 316:45 +CPU= 34.118
  16:38:19 STEP 1268 H= 317:00 +CPU= 35.376
  16:38:55 STEP 1269 H= 317:15 +CPU= 35.238
  16:39:30 STEP 1270 H= 317:30 +CPU= 35.492
  16:40:05 STEP 1271 H= 317:45 +CPU= 34.541
  16:40:49 STEP 1272 H= 318:00 +CPU= 43.073
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001272
  16:41:25 STEP 1273 H= 318:15 +CPU= 36.089
  16:42:00 STEP 1274 H= 318:30 +CPU= 34.352
  16:42:36 STEP 1275 H= 318:45 +CPU= 35.237
  16:43:11 STEP 1276 H= 319:00 +CPU= 35.084
  16:43:47 STEP 1277 H= 319:15 +CPU= 34.771
  16:44:23 STEP 1278 H= 319:30 +CPU= 36.033
  16:44:58 STEP 1279 H= 319:45 +CPU= 34.637
  16:45:33 STEP 1280 H= 320:00 +CPU= 35.000
  16:46:07 STEP 1281 H= 320:15 +CPU= 34.263
  16:46:43 STEP 1282 H= 320:30 +CPU= 35.735
  16:47:18 STEP 1283 H= 320:45 +CPU= 34.145
  16:48:01 STEP 1284 H= 321:00 +CPU= 43.144
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001284
  16:48:37 STEP 1285 H= 321:15 +CPU= 34.755
  16:49:13 STEP 1286 H= 321:30 +CPU= 35.031
  16:49:48 STEP 1287 H= 321:45 +CPU= 35.191
  16:50:24 STEP 1288 H= 322:00 +CPU= 35.316
  16:51:00 STEP 1289 H= 322:15 +CPU= 35.383
  16:51:35 STEP 1290 H= 322:30 +CPU= 35.500
  16:52:12 STEP 1291 H= 322:45 +CPU= 35.860
  16:52:49 STEP 1292 H= 323:00 +CPU= 36.679
  16:53:24 STEP 1293 H= 323:15 +CPU= 35.380
  16:54:00 STEP 1294 H= 323:30 +CPU= 35.090
  16:54:35 STEP 1295 H= 323:45 +CPU= 34.938
  16:55:23 STEP 1296 H= 324:00 +CPU= 48.211
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001296
  16:55:58 STEP 1297 H= 324:15 +CPU= 35.179
  16:56:34 STEP 1298 H= 324:30 +CPU= 34.919
  16:57:08 STEP 1299 H= 324:45 +CPU= 34.722
  16:57:45 STEP 1300 H= 325:00 +CPU= 36.053
  16:58:20 STEP 1301 H= 325:15 +CPU= 35.170
  16:58:55 STEP 1302 H= 325:30 +CPU= 34.447
  16:59:30 STEP 1303 H= 325:45 +CPU= 34.940
  17:00:05 STEP 1304 H= 326:00 +CPU= 35.110
  17:00:40 STEP 1305 H= 326:15 +CPU= 34.998
  17:01:16 STEP 1306 H= 326:30 +CPU= 35.423
  17:01:52 STEP 1307 H= 326:45 +CPU= 36.313
  17:02:36 STEP 1308 H= 327:00 +CPU= 43.007
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001308
  17:03:12 STEP 1309 H= 327:15 +CPU= 35.459
  17:03:48 STEP 1310 H= 327:30 +CPU= 36.051
  17:04:24 STEP 1311 H= 327:45 +CPU= 35.921
  17:05:00 STEP 1312 H= 328:00 +CPU= 34.715
  17:05:35 STEP 1313 H= 328:15 +CPU= 34.741
  17:06:11 STEP 1314 H= 328:30 +CPU= 35.606
  17:06:47 STEP 1315 H= 328:45 +CPU= 35.724
  17:07:23 STEP 1316 H= 329:00 +CPU= 35.760
  17:08:00 STEP 1317 H= 329:15 +CPU= 36.491
  17:08:35 STEP 1318 H= 329:30 +CPU= 34.599
  17:09:11 STEP 1319 H= 329:45 +CPU= 35.638
  17:09:56 STEP 1320 H= 330:00 +CPU= 44.762
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001320
  17:10:31 STEP 1321 H= 330:15 +CPU= 34.766
  17:11:06 STEP 1322 H= 330:30 +CPU= 35.107
  17:11:42 STEP 1323 H= 330:45 +CPU= 35.586
  17:12:19 STEP 1324 H= 331:00 +CPU= 37.027
  17:12:54 STEP 1325 H= 331:15 +CPU= 34.306
  17:13:29 STEP 1326 H= 331:30 +CPU= 34.835
  17:14:04 STEP 1327 H= 331:45 +CPU= 34.994
  17:14:41 STEP 1328 H= 332:00 +CPU= 36.120
  17:15:16 STEP 1329 H= 332:15 +CPU= 34.653
  17:15:51 STEP 1330 H= 332:30 +CPU= 34.817
  17:16:25 STEP 1331 H= 332:45 +CPU= 33.989
  17:17:09 STEP 1332 H= 333:00 +CPU= 43.748
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001332
  17:17:44 STEP 1333 H= 333:15 +CPU= 35.271
  17:18:20 STEP 1334 H= 333:30 +CPU= 35.561
  17:18:55 STEP 1335 H= 333:45 +CPU= 34.484
  17:19:31 STEP 1336 H= 334:00 +CPU= 35.500
  17:20:05 STEP 1337 H= 334:15 +CPU= 34.086
  17:20:40 STEP 1338 H= 334:30 +CPU= 34.641
  17:21:16 STEP 1339 H= 334:45 +CPU= 36.236
  17:21:52 STEP 1340 H= 335:00 +CPU= 35.358
  17:22:26 STEP 1341 H= 335:15 +CPU= 34.200
  17:23:02 STEP 1342 H= 335:30 +CPU= 35.170
  17:23:38 STEP 1343 H= 335:45 +CPU= 35.893
  17:24:25 STEP 1344 H= 336:00 +CPU= 47.307
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+001332
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a14f_2016092300_15_991_12208242_0_r1733063142_13.zip
Uploading the intermediate file: upload_file_13.zip
  17:25:00 STEP 1345 H= 336:15 +CPU= 33.651
  17:25:36 STEP 1346 H= 336:30 +CPU= 36.002
  17:26:11 STEP 1347 H= 336:45 +CPU= 34.565
  17:26:47 STEP 1348 H= 337:00 +CPU= 36.028
  17:27:24 STEP 1349 H= 337:15 +CPU= 36.247
  17:27:58 STEP 1350 H= 337:30 +CPU= 34.305
  17:28:33 STEP 1351 H= 337:45 +CPU= 34.440
  17:29:08 STEP 1352 H= 338:00 +CPU= 34.990
  17:29:43 STEP 1353 H= 338:15 +CPU= 34.972
  17:30:18 STEP 1354 H= 338:30 +CPU= 34.232
  17:30:54 STEP 1355 H= 338:45 +CPU= 35.761
  17:31:39 STEP 1356 H= 339:00 +CPU= 43.450
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001356
  17:32:15 STEP 1357 H= 339:15 +CPU= 34.856
  17:32:50 STEP 1358 H= 339:30 +CPU= 34.223
  17:33:25 STEP 1359 H= 339:45 +CPU= 35.170
  17:34:00 STEP 1360 H= 340:00 +CPU= 34.872
  17:34:37 STEP 1361 H= 340:15 +CPU= 36.349
  17:35:12 STEP 1362 H= 340:30 +CPU= 34.849
  17:35:47 STEP 1363 H= 340:45 +CPU= 35.121
  17:36:23 STEP 1364 H= 341:00 +CPU= 35.546
  17:36:59 STEP 1365 H= 341:15 +CPU= 35.168
  17:37:34 STEP 1366 H= 341:30 +CPU= 35.171
  17:38:09 STEP 1367 H= 341:45 +CPU= 34.747
  17:38:53 STEP 1368 H= 342:00 +CPU= 44.033
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001368
  17:39:29 STEP 1369 H= 342:15 +CPU= 35.349
  17:40:04 STEP 1370 H= 342:30 +CPU= 35.017
  17:40:39 STEP 1371 H= 342:45 +CPU= 34.845
  17:41:15 STEP 1372 H= 343:00 +CPU= 35.455
  17:41:49 STEP 1373 H= 343:15 +CPU= 34.210
  17:42:24 STEP 1374 H= 343:30 +CPU= 34.295
  17:42:59 STEP 1375 H= 343:45 +CPU= 33.976
  17:43:35 STEP 1376 H= 344:00 +CPU= 35.004
  17:44:09 STEP 1377 H= 344:15 +CPU= 34.592
  17:44:45 STEP 1378 H= 344:30 +CPU= 35.344
  17:45:20 STEP 1379 H= 344:45 +CPU= 35.089
  17:46:03 STEP 1380 H= 345:00 +CPU= 42.850
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001380
  17:46:37 STEP 1381 H= 345:15 +CPU= 34.012
  17:47:13 STEP 1382 H= 345:30 +CPU= 34.469
  17:47:48 STEP 1383 H= 345:45 +CPU= 34.770
  17:48:24 STEP 1384 H= 346:00 +CPU= 35.508
  17:48:59 STEP 1385 H= 346:15 +CPU= 34.868
  17:49:34 STEP 1386 H= 346:30 +CPU= 34.337
  17:50:09 STEP 1387 H= 346:45 +CPU= 34.750
  17:50:46 STEP 1388 H= 347:00 +CPU= 36.869
  17:51:22 STEP 1389 H= 347:15 +CPU= 35.512
  17:51:59 STEP 1390 H= 347:30 +CPU= 37.212
  17:52:34 STEP 1391 H= 347:45 +CPU= 34.378
  17:53:20 STEP 1392 H= 348:00 +CPU= 45.944
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001392
  17:53:54 STEP 1393 H= 348:15 +CPU= 34.192
  17:54:30 STEP 1394 H= 348:30 +CPU= 35.654
  17:55:05 STEP 1395 H= 348:45 +CPU= 34.343
  17:55:42 STEP 1396 H= 349:00 +CPU= 36.472
  17:56:17 STEP 1397 H= 349:15 +CPU= 34.929
  17:56:52 STEP 1398 H= 349:30 +CPU= 35.099
  17:57:29 STEP 1399 H= 349:45 +CPU= 36.653
  17:58:04 STEP 1400 H= 350:00 +CPU= 35.027
  17:58:39 STEP 1401 H= 350:15 +CPU= 34.897
  17:59:14 STEP 1402 H= 350:30 +CPU= 34.764
  17:59:49 STEP 1403 H= 350:45 +CPU= 34.497
  18:00:34 STEP 1404 H= 351:00 +CPU= 44.063
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001404
  18:01:09 STEP 1405 H= 351:15 +CPU= 35.185
  18:01:44 STEP 1406 H= 351:30 +CPU= 34.696
  18:02:19 STEP 1407 H= 351:45 +CPU= 34.392
  18:02:55 STEP 1408 H= 352:00 +CPU= 36.152
  18:03:31 STEP 1409 H= 352:15 +CPU= 35.437
  18:04:06 STEP 1410 H= 352:30 +CPU= 35.568
  18:04:42 STEP 1411 H= 352:45 +CPU= 35.531
  18:05:18 STEP 1412 H= 353:00 +CPU= 35.705
  18:05:54 STEP 1413 H= 353:15 +CPU= 35.312
  18:06:29 STEP 1414 H= 353:30 +CPU= 34.982
  18:07:03 STEP 1415 H= 353:45 +CPU= 34.476
  18:07:47 STEP 1416 H= 354:00 +CPU= 42.467
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001416
  18:08:22 STEP 1417 H= 354:15 +CPU= 35.186
  18:08:58 STEP 1418 H= 354:30 +CPU= 35.203
  18:09:34 STEP 1419 H= 354:45 +CPU= 35.772
  18:10:10 STEP 1420 H= 355:00 +CPU= 36.470
  18:10:45 STEP 1421 H= 355:15 +CPU= 34.628
  18:11:22 STEP 1422 H= 355:30 +CPU= 36.572
  18:11:57 STEP 1423 H= 355:45 +CPU= 35.074
  18:12:34 STEP 1424 H= 356:00 +CPU= 36.832
  18:13:10 STEP 1425 H= 356:15 +CPU= 36.221
  18:13:46 STEP 1426 H= 356:30 +CPU= 35.218
  18:14:20 STEP 1427 H= 356:45 +CPU= 33.487
  18:15:04 STEP 1428 H= 357:00 +CPU= 42.955
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001428
  18:15:40 STEP 1429 H= 357:15 +CPU= 35.932
  18:16:16 STEP 1430 H= 357:30 +CPU= 35.521
  18:16:51 STEP 1431 H= 357:45 +CPU= 35.552
  18:17:26 STEP 1432 H= 358:00 +CPU= 34.934
  18:18:02 STEP 1433 H= 358:15 +CPU= 35.489
  18:18:38 STEP 1434 H= 358:30 +CPU= 35.868
  18:19:14 STEP 1435 H= 358:45 +CPU= 35.456
  18:19:50 STEP 1436 H= 359:00 +CPU= 35.633
  18:20:26 STEP 1437 H= 359:15 +CPU= 35.756
  18:21:01 STEP 1438 H= 359:30 +CPU= 35.449
  18:21:37 STEP 1439 H= 359:45 +CPU= 35.061
  18:22:20 STEP 1440 H= 360:00 +CPU= 43.408
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.11_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a14f
(argv4) batchid: 991
(argv5) wuid: 12208242
(argv6) fclen: 15
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/12
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.11
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/12/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/12/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_72492c378b3069dbd66f30e65968f835 to: /var/lib/boinc/slots/12/oifs_43r3_bl_a14f_2016092300_15_991_12208242.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/12/oifs_43r3_bl_a14f_2016092300_15_991_12208242.zip
ic_ancil_file: ic_ancil_12208242
ifsdata_file: ifsdata_12208242
climate_data_file: clim_data_12208242
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc/slots/12/ic_ancil_12208242.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/12/ic_ancil_12208242.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_ff10531c649155824d24bd854e6ab8a5 to: /var/lib/boinc/slots/12/ifsdata/ifsdata_12208242.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/12/ifsdata/ifsdata_12208242.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/12/159l_2/clim_data_12208242.zip
Unzipping the climate data zip file: /var/lib/boinc/slots/12/159l_2/clim_data_12208242.zip
Checking for progress XML file: /var/lib/boinc/slots/12/progress_file_12208242.xml
Opened progress file ok : /var/lib/boinc/slots/12/progress_file_12208242.xml
-- Model is restarting --
Adjusting last_iter, 1440, to previous model restart step.
Creating progress file: /var/lib/boinc/slots/12/progress_file_12208242.xml
last_cpu_time: 46154
upload_file_number: 14
last_iter: 1441
last_upload: 1209600
model_completed: 0
total_length_of_simulation: 1296000
result_base_name: oifs_43r3_bl_a14f_2016092300_15_991_12208242_0_r1733063142
The child process has been launched with process id: 8968
Executing the command: /var/lib/boinc/slots/12/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:tweenis:1:1:8968:8968] [20230214:205300:1676407980:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2091] fp = 0x30e4a00
[EC_DRHOOK:tweenis:1:1:8968:8968] [20230214:205300:1676407980:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:tweenis:1:1:8968:8968] [20230214:205300:1676407980:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:tweenis:1:1:8968:8968] [20230214:205300:1676407980:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:tweenis:1:1:8968:8968] [20230214:205300:1676407980:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:tweenis:1:1:8968:8968] [20230214:205300:1676407980:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:tweenis:1:1:8968:8968] [20230214:205300:1676407980:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:tweenis:1:1:8968:8968] [20230214:205300:1676407980:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:tweenis:1:1:8968:8968] [20230214:205300:1676407980:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:tweenis:1:1:8968:8968] [20230214:205300:1676407980:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:tweenis:1:1:8968:8968] [20230214:205300:1676407980:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:tweenis:1:1:8968:8968] [20230214:205300:1676407980:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:tweenis:1:1:8968:8968] [20230214:205300:1676407980:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:tweenis:1:1:8968:8968] [20230214:205300:1676407980:0.000] [ignore_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:tweenis:1:1:8968:8968] [20230214:205300:1676407980:0.000] [restore_default_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:tweenis:1:1:8968:8968] [20230214:205300:1676407980:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:tweenis:1:1:8968:8968] [20230214:205300:1676407980:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f520 (old at (nil))
[EC_DRHOOK:tweenis:1:1:8968:8968] [20230214:205300:1676407980:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:tweenis:1:1:8968:8968] [20230214:205300:1676407980:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f520 (old at (nil))
[EC_DRHOOK:tweenis:1:1:8968:8968] [20230214:205300:1676407980:0.000] [trapfpe_treatment@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:tweenis:1:1:8968:8968] [20230214:205300:1676407980:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:tweenis:1:1:8968:8968] [20230214:205300:1676407980:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:tweenis:1:1:8968:8968] [20230214:205300:1676407980:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f520 (old at (nil))
[EC_DRHOOK:tweenis:1:1:8968:8968] [20230214:205300:1676407980:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:tweenis:1:1:8968:8968] [20230214:205300:1676407980:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:tweenis:1:1:8968:8968] [20230214:205300:1676407980:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:tweenis:1:1:8968:8968] [20230214:205300:1676407980:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f520 (old at (nil))
[EC_DRHOOK:tweenis:1:1:8968:8968] [20230214:205300:1676407980:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f520 (old at (nil))
[EC_DRHOOK:tweenis:1:1:8968:8968] [20230214:205300:1676407980:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f520 (old at (nil))
[EC_DRHOOK:tweenis:1:1:8968:8968] [20230214:205300:1676407980:0.000] [catch_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  20:53:20 STEP 1440 H= 360:00 +CPU= 16.732
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

I      I Hor. Flux of PEII     -0.00000 I              I              I              I               I
I      I Vert.Flux of PEII      0.00000 I              I              I              I               I
I      I Work Pres.G.F  II              I      0.15758 I              I              I               I
I      I Conv. Ad.-Int. II     -0.15759 I              I              I              I               I
DDH--------------------------------------------------------------------------------------------------I
I DYN- Horizont. Flux   II      0.01630 I      0.00305 I      0.19535 I      0.00032 I      0.00008  I
I    I Vertical Flux    II      0.00000 I      0.00000 I      0.00000 I      0.00000 I      0.00000  I
DDH--------------------------------------------------------------------------------------------------I
  
DDH----------------------------------------------------------------------------------------------------------------------------------
  I   - Mass balance    (10**(-6)  KG/M**2) 
  
  I INITIAL      I HORIZ. FLUX  I DYN. FLUX    I DYN. FLUX    I PHYS. FLUX   I PHYS. FLUX   I CURRENT      I I I RESIDUAL     I
  I MASS         I              I TOA          I SURFACE      I TOA          I SURFACE      I MASS         I I I              I
  ---------------------------------------------------------------------------------------------------------- I ----------------
  -              -              -              -              -              -              -              - I -              -
  - 10206523039. I          -0. .           0. .           0. .           0. .           0. I 10206689564. - I -      166524. -
  -              -              -              -              -              -              -              - I -              -
  ---------------------------------------------------------------------------------------------------------- I ----------------
 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  360.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I      0.1014799607E-20      I       0.3243386575E-05      I
ICloud fractionI      0.0000000000E+00      I       0.1740352672E-01      I
I  Relat. Hum. I      0.3845845491E+00      I       0.4080256064E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.3009885509E+03      I
DDH------------------------------------------------------------------------
  
 20:53:20 STEP 1440 H= 360:00 +CPU= 16.732
 END CNT3
 NSTEP =  1440 CNT0   000000000  16.614  16.614  17.014   0.976               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           34/  1069125708 WRITTEN            0/           0
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1      3    0       34      1044068        0            0     1.2     1.2     0.0     1.7     0.0
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1   19781.2   19781.2    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1   17133.0   17133.0     86.61      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                    1    3218.3    3218.3     16.27      0.00
  10 SCAN2M - PHYSICS                                1    9052.1    9052.1     45.76      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                  1      27.9      27.9      0.14      0.00
  28 RESTART FILES - READING                         1    2348.4    2348.4     11.87      0.00
  31 POSDDH IN STEPO                                 1       0.7       0.7      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                      1    3844.0    3844.0     19.43      0.00
  39 SU0YOMB                                         1     212.0     212.0      1.07      0.00
  51 SCAN2M   - SL COMM. PART 1                      1      12.8      12.8      0.06      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                  1       0.2       0.2      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM        4     140.9     140.9      2.85      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM         4      41.9      41.9      0.85      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      31.2      31.2      0.16      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION              4      13.3      13.3      0.27      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION              4      22.9      22.9      0.46      0.00
 400 GSTATS                                       1083       0.0       0.0      0.02      0.00
 401 GSTATS HOOK                                   963       0.0       0.0      0.02      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME       19.8 CPU TIME      19.3 VECTOR TIME       19.3


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY    75643.5
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc/slots/12/NODE.001_01
Adding to the zip: /var/lib/boinc/slots/12/ifs.stat
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12208242/ICMGGh7zg+001356
Zipping up the final file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a14f_2016092300_15_991_12208242_0_r1733063142_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1296900
20:56:47 (8941): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:51:25 1531398 22308419 oifs_43r3_bl_a14f_2016092300_15_991_12208242_0 1,296,900 46,173 0.0356
09 May 2023 16:51:13 1531398 22308419 oifs_43r3_bl_a14f_2016092300_15_991_12208242_0 864,000 28,926 0.0335


©2024 climateprediction.net