climateprediction.net home page
Task 22268295

Task 22268295

Name oifs_43r3_ps_0501_1997050100_123_966_12183145_0
Workunit 12183145
Created 22 Dec 2022, 13:45:37 UTC
Sent 18 Jan 2023, 20:12:52 UTC
Report deadline 19 Mar 2023, 20:12:52 UTC
Received 21 Jan 2023, 12:31:10 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 196 (0x000000C4) EXIT_DISK_LIMIT_EXCEEDED
Computer ID 1537256
Run time 1 days 3 hours 18 min 14 sec
CPU time 23 hours 26 min 51 sec
Validate state Invalid
Credit 7,136.64
Device peak FLOPS 4.11 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,010.82 MB
Peak swap size 4,978.08 MB
Peak disk usage 7,683.44 MB
Stderr
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
0 +CPU= 43.098
  04:34:50 STEP 1113 H=1113:00 +CPU= 65.269
  04:35:35 STEP 1114 H=1114:00 +CPU= 42.905
  04:36:18 STEP 1115 H=1115:00 +CPU= 41.682
  04:37:34 STEP 1116 H=1116:00 +CPU= 72.101
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001116
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001116
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001116
  04:38:17 STEP 1117 H=1117:00 +CPU= 41.836
  04:39:02 STEP 1118 H=1118:00 +CPU= 42.984
  04:40:09 STEP 1119 H=1119:00 +CPU= 64.619
  04:40:54 STEP 1120 H=1120:00 +CPU= 42.986
  04:41:37 STEP 1121 H=1121:00 +CPU= 41.634
  04:42:45 STEP 1122 H=1122:00 +CPU= 66.006
  04:43:29 STEP 1123 H=1123:00 +CPU= 41.784
  04:44:13 STEP 1124 H=1124:00 +CPU= 42.782
  04:45:21 STEP 1125 H=1125:00 +CPU= 64.856
  04:46:05 STEP 1126 H=1126:00 +CPU= 42.691
  04:46:50 STEP 1127 H=1127:00 +CPU= 43.166
  04:48:11 STEP 1128 H=1128:00 +CPU= 77.841
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001128
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001128
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMGGhq0f+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMSHhq0f+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMUAhq0f+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMGGhq0f+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMSHhq0f+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMUAhq0f+001116
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0501_1997050100_123_966_12183145_0_r1020401603_46.zip
Uploading the intermediate file: upload_file_46.zip
  04:48:55 STEP 1129 H=1129:00 +CPU= 41.751
  04:49:39 STEP 1130 H=1130:00 +CPU= 42.610
  04:50:48 STEP 1131 H=1131:00 +CPU= 65.120
  04:51:32 STEP 1132 H=1132:00 +CPU= 42.782
  04:52:15 STEP 1133 H=1133:00 +CPU= 41.460
  04:53:24 STEP 1134 H=1134:00 +CPU= 66.552
  04:54:08 STEP 1135 H=1135:00 +CPU= 41.646
  04:54:53 STEP 1136 H=1136:00 +CPU= 42.922
  04:56:00 STEP 1137 H=1137:00 +CPU= 64.854
  04:56:45 STEP 1138 H=1138:00 +CPU= 42.833
  04:57:30 STEP 1139 H=1139:00 +CPU= 42.027
  04:58:44 STEP 1140 H=1140:00 +CPU= 71.715
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001140
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001140
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001140
  04:59:28 STEP 1141 H=1141:00 +CPU= 41.665
  05:00:13 STEP 1142 H=1142:00 +CPU= 42.897
  05:01:21 STEP 1143 H=1143:00 +CPU= 64.846
  05:02:05 STEP 1144 H=1144:00 +CPU= 42.761
  05:02:49 STEP 1145 H=1145:00 +CPU= 41.850
  05:03:58 STEP 1146 H=1146:00 +CPU= 66.097
  05:04:41 STEP 1147 H=1147:00 +CPU= 41.831
  05:05:26 STEP 1148 H=1148:00 +CPU= 42.946
  05:06:33 STEP 1149 H=1149:00 +CPU= 64.651
  05:07:17 STEP 1150 H=1150:00 +CPU= 42.558
  05:08:01 STEP 1151 H=1151:00 +CPU= 42.642
  05:09:23 STEP 1152 H=1152:00 +CPU= 77.769
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001152
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001152
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMGGhq0f+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMSHhq0f+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMUAhq0f+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMGGhq0f+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMSHhq0f+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMUAhq0f+001140
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0501_1997050100_123_966_12183145_0_r1020401603_47.zip
Uploading the intermediate file: upload_file_47.zip
  05:10:08 STEP 1153 H=1153:00 +CPU= 42.129
  05:10:52 STEP 1154 H=1154:00 +CPU= 42.797
  05:12:01 STEP 1155 H=1155:00 +CPU= 65.290
  05:12:45 STEP 1156 H=1156:00 +CPU= 42.918
  05:13:30 STEP 1157 H=1157:00 +CPU= 41.839
  05:14:38 STEP 1158 H=1158:00 +CPU= 66.306
  05:15:22 STEP 1159 H=1159:00 +CPU= 41.807
  05:16:07 STEP 1160 H=1160:00 +CPU= 42.955
  05:17:14 STEP 1161 H=1161:00 +CPU= 64.777
  05:18:00 STEP 1162 H=1162:00 +CPU= 43.016
  05:18:43 STEP 1163 H=1163:00 +CPU= 41.642
  05:19:59 STEP 1164 H=1164:00 +CPU= 72.003
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001164
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001164
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001164
  05:20:44 STEP 1165 H=1165:00 +CPU= 41.936
  05:21:28 STEP 1166 H=1166:00 +CPU= 42.982
  05:22:35 STEP 1167 H=1167:00 +CPU= 64.876
  05:23:21 STEP 1168 H=1168:00 +CPU= 42.969
  05:24:04 STEP 1169 H=1169:00 +CPU= 41.520
  05:25:12 STEP 1170 H=1170:00 +CPU= 65.998
  05:25:55 STEP 1171 H=1171:00 +CPU= 41.513
  05:26:40 STEP 1172 H=1172:00 +CPU= 42.831
  05:27:47 STEP 1173 H=1173:00 +CPU= 64.874
  05:28:31 STEP 1174 H=1174:00 +CPU= 42.723
  05:29:16 STEP 1175 H=1175:00 +CPU= 42.846
  05:30:39 STEP 1176 H=1176:00 +CPU= 78.030
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001176
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001176
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMGGhq0f+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMSHhq0f+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMUAhq0f+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMGGhq0f+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMSHhq0f+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMUAhq0f+001164
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0501_1997050100_123_966_12183145_0_r1020401603_48.zip
Uploading the intermediate file: upload_file_48.zip
Uploading trickle at timestep: 4233600
  05:31:22 STEP 1177 H=1177:00 +CPU= 41.932
  05:32:06 STEP 1178 H=1178:00 +CPU= 42.694
  05:33:15 STEP 1179 H=1179:00 +CPU= 65.080
  05:33:59 STEP 1180 H=1180:00 +CPU= 42.582
  05:34:42 STEP 1181 H=1181:00 +CPU= 41.679
  05:35:51 STEP 1182 H=1182:00 +CPU= 66.120
  05:36:35 STEP 1183 H=1183:00 +CPU= 41.664
  05:37:20 STEP 1184 H=1184:00 +CPU= 43.039
  05:38:27 STEP 1185 H=1185:00 +CPU= 64.930
  05:39:12 STEP 1186 H=1186:00 +CPU= 42.979
  05:39:57 STEP 1187 H=1187:00 +CPU= 41.889
  05:41:11 STEP 1188 H=1188:00 +CPU= 71.924
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001188
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001188
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001188
  05:41:55 STEP 1189 H=1189:00 +CPU= 41.747
  05:42:40 STEP 1190 H=1190:00 +CPU= 42.876
  05:43:48 STEP 1191 H=1191:00 +CPU= 64.954
  05:44:33 STEP 1192 H=1192:00 +CPU= 42.986
  05:45:17 STEP 1193 H=1193:00 +CPU= 41.887
  05:46:26 STEP 1194 H=1194:00 +CPU= 66.096
  05:47:10 STEP 1195 H=1195:00 +CPU= 41.848
  05:47:54 STEP 1196 H=1196:00 +CPU= 42.809
  05:49:02 STEP 1197 H=1197:00 +CPU= 64.823
  05:49:46 STEP 1198 H=1198:00 +CPU= 42.694
  05:50:30 STEP 1199 H=1199:00 +CPU= 43.023
  05:51:53 STEP 1200 H=1200:00 +CPU= 77.925
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001200
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001200
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMGGhq0f+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMSHhq0f+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMUAhq0f+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMGGhq0f+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMSHhq0f+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMUAhq0f+001188
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0501_1997050100_123_966_12183145_0_r1020401603_49.zip
Uploading the intermediate file: upload_file_49.zip
  05:52:36 STEP 1201 H=1201:00 +CPU= 41.778
  05:53:21 STEP 1202 H=1202:00 +CPU= 42.808
  05:54:29 STEP 1203 H=1203:00 +CPU= 65.450
  05:55:15 STEP 1204 H=1204:00 +CPU= 43.118
  05:55:58 STEP 1205 H=1205:00 +CPU= 41.612
  05:57:08 STEP 1206 H=1206:00 +CPU= 66.422
  05:57:52 STEP 1207 H=1207:00 +CPU= 41.840
  05:58:36 STEP 1208 H=1208:00 +CPU= 42.780
  05:59:43 STEP 1209 H=1209:00 +CPU= 64.743
  06:00:27 STEP 1210 H=1210:00 +CPU= 42.796
  06:01:10 STEP 1211 H=1211:00 +CPU= 41.541
  06:02:26 STEP 1212 H=1212:00 +CPU= 72.200
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001212
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001212
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001212
  06:03:09 STEP 1213 H=1213:00 +CPU= 41.658
  06:03:53 STEP 1214 H=1214:00 +CPU= 42.717
  06:05:01 STEP 1215 H=1215:00 +CPU= 64.910
  06:05:45 STEP 1216 H=1216:00 +CPU= 43.088
  06:06:29 STEP 1217 H=1217:00 +CPU= 41.899
  06:07:39 STEP 1218 H=1218:00 +CPU= 66.664
  06:08:22 STEP 1219 H=1219:00 +CPU= 41.821
  06:09:08 STEP 1220 H=1220:00 +CPU= 42.958
  06:10:15 STEP 1221 H=1221:00 +CPU= 64.892
  06:11:00 STEP 1222 H=1222:00 +CPU= 43.009
  06:11:45 STEP 1223 H=1223:00 +CPU= 42.727
  06:13:07 STEP 1224 H=1224:00 +CPU= 78.351
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001224
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001224
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMGGhq0f+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMSHhq0f+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMUAhq0f+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMGGhq0f+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMSHhq0f+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMUAhq0f+001212
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0501_1997050100_123_966_12183145_0_r1020401603_50.zip
Uploading the intermediate file: upload_file_50.zip
  06:13:52 STEP 1225 H=1225:00 +CPU= 42.140
  06:14:35 STEP 1226 H=1226:00 +CPU= 42.710
  06:15:43 STEP 1227 H=1227:00 +CPU= 65.075
  06:16:27 STEP 1228 H=1228:00 +CPU= 42.755
  06:17:10 STEP 1229 H=1229:00 +CPU= 41.834
  06:18:19 STEP 1230 H=1230:00 +CPU= 66.091
  06:19:03 STEP 1231 H=1231:00 +CPU= 41.802
  06:19:48 STEP 1232 H=1232:00 +CPU= 42.691
  06:20:55 STEP 1233 H=1233:00 +CPU= 64.840
  06:21:41 STEP 1234 H=1234:00 +CPU= 43.016
  06:22:24 STEP 1235 H=1235:00 +CPU= 41.717
  06:23:42 STEP 1236 H=1236:00 +CPU= 73.294
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001236
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001236
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001236
  06:24:26 STEP 1237 H=1237:00 +CPU= 42.052
  06:25:11 STEP 1238 H=1238:00 +CPU= 43.048
  06:26:19 STEP 1239 H=1239:00 +CPU= 65.240
  06:27:05 STEP 1240 H=1240:00 +CPU= 42.927
  06:27:48 STEP 1241 H=1241:00 +CPU= 41.724
  06:28:57 STEP 1242 H=1242:00 +CPU= 66.166
  06:29:40 STEP 1243 H=1243:00 +CPU= 41.725
  06:30:25 STEP 1244 H=1244:00 +CPU= 42.874
  06:31:32 STEP 1245 H=1245:00 +CPU= 64.937
  06:32:17 STEP 1246 H=1246:00 +CPU= 42.871
  06:33:02 STEP 1247 H=1247:00 +CPU= 43.050
  06:34:25 STEP 1248 H=1248:00 +CPU= 78.105
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001248
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001248
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMGGhq0f+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMSHhq0f+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMUAhq0f+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMGGhq0f+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMSHhq0f+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMUAhq0f+001236
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0501_1997050100_123_966_12183145_0_r1020401603_51.zip
Uploading the intermediate file: upload_file_51.zip
  06:35:08 STEP 1249 H=1249:00 +CPU= 41.570
  06:35:52 STEP 1250 H=1250:00 +CPU= 42.669
  06:37:00 STEP 1251 H=1251:00 +CPU= 65.026
  06:37:45 STEP 1252 H=1252:00 +CPU= 42.792
  06:38:29 STEP 1253 H=1253:00 +CPU= 41.657
  06:39:39 STEP 1254 H=1254:00 +CPU= 66.372
  06:40:23 STEP 1255 H=1255:00 +CPU= 41.716
  06:41:07 STEP 1256 H=1256:00 +CPU= 42.602
  06:42:15 STEP 1257 H=1257:00 +CPU= 64.859
  06:43:01 STEP 1258 H=1258:00 +CPU= 43.295
  06:43:44 STEP 1259 H=1259:00 +CPU= 41.693
  06:44:59 STEP 1260 H=1260:00 +CPU= 71.875
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001260
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001260
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001260
  06:45:42 STEP 1261 H=1261:00 +CPU= 41.691
  06:46:27 STEP 1262 H=1262:00 +CPU= 43.002
  06:47:35 STEP 1263 H=1263:00 +CPU= 65.033
  06:48:21 STEP 1264 H=1264:00 +CPU= 43.563
  06:49:05 STEP 1265 H=1265:00 +CPU= 41.652
  06:50:15 STEP 1266 H=1266:00 +CPU= 66.525
  06:50:59 STEP 1267 H=1267:00 +CPU= 41.580
  06:51:45 STEP 1268 H=1268:00 +CPU= 43.033
  06:52:53 STEP 1269 H=1269:00 +CPU= 64.871
  06:53:38 STEP 1270 H=1270:00 +CPU= 42.826
  06:54:23 STEP 1271 H=1271:00 +CPU= 42.806
  06:55:46 STEP 1272 H=1272:00 +CPU= 78.252
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001272
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001272
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMGGhq0f+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMSHhq0f+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMUAhq0f+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMGGhq0f+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMSHhq0f+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMUAhq0f+001260
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0501_1997050100_123_966_12183145_0_r1020401603_52.zip
Uploading the intermediate file: upload_file_52.zip
  06:56:29 STEP 1273 H=1273:00 +CPU= 41.730
  06:57:14 STEP 1274 H=1274:00 +CPU= 42.851
  06:58:21 STEP 1275 H=1275:00 +CPU= 64.833
  06:59:05 STEP 1276 H=1276:00 +CPU= 42.715
  06:59:49 STEP 1277 H=1277:00 +CPU= 41.798
  07:00:57 STEP 1278 H=1278:00 +CPU= 66.132
  07:01:41 STEP 1279 H=1279:00 +CPU= 41.661
  07:02:26 STEP 1280 H=1280:00 +CPU= 42.915
  07:03:34 STEP 1281 H=1281:00 +CPU= 65.075
  07:04:20 STEP 1282 H=1282:00 +CPU= 42.917
  07:05:03 STEP 1283 H=1283:00 +CPU= 41.424
  07:06:18 STEP 1284 H=1284:00 +CPU= 72.160
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001284
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001284
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001284
  07:07:01 STEP 1285 H=1285:00 +CPU= 41.545
  07:07:47 STEP 1286 H=1286:00 +CPU= 43.327
  07:08:55 STEP 1287 H=1287:00 +CPU= 65.046
  07:09:42 STEP 1288 H=1288:00 +CPU= 43.722
  07:10:31 STEP 1289 H=1289:00 +CPU= 43.463
  07:11:42 STEP 1290 H=1290:00 +CPU= 67.083
  07:12:25 STEP 1291 H=1291:00 +CPU= 41.562
  07:13:11 STEP 1292 H=1292:00 +CPU= 42.994
  07:14:18 STEP 1293 H=1293:00 +CPU= 64.844
  07:15:03 STEP 1294 H=1294:00 +CPU= 42.595
  07:15:48 STEP 1295 H=1295:00 +CPU= 42.944
  07:17:11 STEP 1296 H=1296:00 +CPU= 78.097
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001296
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001296
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMGGhq0f+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMSHhq0f+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMUAhq0f+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMGGhq0f+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMSHhq0f+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMUAhq0f+001284
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0501_1997050100_123_966_12183145_0_r1020401603_53.zip
Uploading the intermediate file: upload_file_53.zip
  07:17:56 STEP 1297 H=1297:00 +CPU= 42.048
  07:18:42 STEP 1298 H=1298:00 +CPU= 43.350
  07:19:52 STEP 1299 H=1299:00 +CPU= 65.845
  07:20:37 STEP 1300 H=1300:00 +CPU= 43.061
  07:21:20 STEP 1301 H=1301:00 +CPU= 41.729
  07:22:31 STEP 1302 H=1302:00 +CPU= 66.921
  07:23:14 STEP 1303 H=1303:00 +CPU= 41.517
  07:24:00 STEP 1304 H=1304:00 +CPU= 43.085
  07:25:08 STEP 1305 H=1305:00 +CPU= 65.034
  07:25:52 STEP 1306 H=1306:00 +CPU= 42.894
  07:26:36 STEP 1307 H=1307:00 +CPU= 41.831
  07:27:52 STEP 1308 H=1308:00 +CPU= 72.020
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001308
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001308
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001308
  07:28:35 STEP 1309 H=1309:00 +CPU= 41.601
  07:29:20 STEP 1310 H=1310:00 +CPU= 43.034
  07:30:28 STEP 1311 H=1311:00 +CPU= 65.038
  07:31:13 STEP 1312 H=1312:00 +CPU= 42.977
  07:31:56 STEP 1313 H=1313:00 +CPU= 41.545
  07:33:05 STEP 1314 H=1314:00 +CPU= 66.277
  07:33:49 STEP 1315 H=1315:00 +CPU= 41.755
  07:34:33 STEP 1316 H=1316:00 +CPU= 42.686
  07:35:40 STEP 1317 H=1317:00 +CPU= 64.947
  07:36:26 STEP 1318 H=1318:00 +CPU= 43.151
  07:37:11 STEP 1319 H=1319:00 +CPU= 43.127
  07:38:36 STEP 1320 H=1320:00 +CPU= 78.345
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001320
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001320
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMGGhq0f+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMSHhq0f+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMUAhq0f+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMGGhq0f+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMSHhq0f+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMUAhq0f+001308
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0501_1997050100_123_966_12183145_0_r1020401603_54.zip
Uploading the intermediate file: upload_file_54.zip
  07:39:19 STEP 1321 H=1321:00 +CPU= 41.761
  07:40:03 STEP 1322 H=1322:00 +CPU= 42.706
  07:41:11 STEP 1323 H=1323:00 +CPU= 65.101
  07:41:55 STEP 1324 H=1324:00 +CPU= 42.881
  07:42:39 STEP 1325 H=1325:00 +CPU= 41.787
  07:43:49 STEP 1326 H=1326:00 +CPU= 66.285
  07:44:32 STEP 1327 H=1327:00 +CPU= 41.621
  07:45:16 STEP 1328 H=1328:00 +CPU= 42.830
  07:46:24 STEP 1329 H=1329:00 +CPU= 64.869
  07:47:09 STEP 1330 H=1330:00 +CPU= 42.901
  07:47:52 STEP 1331 H=1331:00 +CPU= 41.462
  07:49:07 STEP 1332 H=1332:00 +CPU= 71.970
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001332
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001332
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001332
  07:49:50 STEP 1333 H=1333:00 +CPU= 41.663
  07:50:35 STEP 1334 H=1334:00 +CPU= 42.951
  07:51:43 STEP 1335 H=1335:00 +CPU= 65.072
  07:52:28 STEP 1336 H=1336:00 +CPU= 42.910
  07:53:11 STEP 1337 H=1337:00 +CPU= 41.818
  07:54:19 STEP 1338 H=1338:00 +CPU= 66.167
  07:55:02 STEP 1339 H=1339:00 +CPU= 41.549
  07:55:47 STEP 1340 H=1340:00 +CPU= 42.748
  07:56:56 STEP 1341 H=1341:00 +CPU= 64.786
  07:57:40 STEP 1342 H=1342:00 +CPU= 42.621
  07:58:24 STEP 1343 H=1343:00 +CPU= 42.692
  07:59:48 STEP 1344 H=1344:00 +CPU= 78.650
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001344
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001344
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMGGhq0f+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMSHhq0f+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMUAhq0f+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMGGhq0f+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMSHhq0f+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMUAhq0f+001332
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0501_1997050100_123_966_12183145_0_r1020401603_55.zip
Uploading the intermediate file: upload_file_55.zip
  08:00:33 STEP 1345 H=1345:00 +CPU= 41.844
  08:01:18 STEP 1346 H=1346:00 +CPU= 42.716
  08:02:26 STEP 1347 H=1347:00 +CPU= 65.014
  08:03:11 STEP 1348 H=1348:00 +CPU= 42.793
  08:03:54 STEP 1349 H=1349:00 +CPU= 41.653
  08:05:05 STEP 1350 H=1350:00 +CPU= 66.942
  08:05:49 STEP 1351 H=1351:00 +CPU= 41.982
  08:06:34 STEP 1352 H=1352:00 +CPU= 42.802
  08:07:42 STEP 1353 H=1353:00 +CPU= 65.192
  08:08:27 STEP 1354 H=1354:00 +CPU= 43.055
  08:09:12 STEP 1355 H=1355:00 +CPU= 42.001
  08:10:26 STEP 1356 H=1356:00 +CPU= 71.875
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001356
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001356
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001356
  08:11:11 STEP 1357 H=1357:00 +CPU= 42.295
  08:11:56 STEP 1358 H=1358:00 +CPU= 42.875
  08:13:04 STEP 1359 H=1359:00 +CPU= 65.150
  08:13:49 STEP 1360 H=1360:00 +CPU= 42.938
  08:14:32 STEP 1361 H=1361:00 +CPU= 41.691
  08:15:40 STEP 1362 H=1362:00 +CPU= 66.212
  08:16:23 STEP 1363 H=1363:00 +CPU= 41.591
  08:17:08 STEP 1364 H=1364:00 +CPU= 43.013
  08:18:17 STEP 1365 H=1365:00 +CPU= 64.621
  08:19:01 STEP 1366 H=1366:00 +CPU= 42.733
  08:19:45 STEP 1367 H=1367:00 +CPU= 42.741
  08:21:08 STEP 1368 H=1368:00 +CPU= 78.449
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001368
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001368
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMGGhq0f+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMSHhq0f+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMUAhq0f+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMGGhq0f+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMSHhq0f+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMUAhq0f+001356
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0501_1997050100_123_966_12183145_0_r1020401603_56.zip
Uploading the intermediate file: upload_file_56.zip
  08:21:52 STEP 1369 H=1369:00 +CPU= 41.860
  08:22:37 STEP 1370 H=1370:00 +CPU= 42.745
  08:23:45 STEP 1371 H=1371:00 +CPU= 64.873
  08:24:29 STEP 1372 H=1372:00 +CPU= 42.600
  08:25:14 STEP 1373 H=1373:00 +CPU= 41.816
  08:26:24 STEP 1374 H=1374:00 +CPU= 66.400
  08:27:08 STEP 1375 H=1375:00 +CPU= 41.764
  08:27:53 STEP 1376 H=1376:00 +CPU= 43.028
  08:29:01 STEP 1377 H=1377:00 +CPU= 64.733
  08:29:46 STEP 1378 H=1378:00 +CPU= 42.811
  08:30:30 STEP 1379 H=1379:00 +CPU= 41.621
  08:31:45 STEP 1380 H=1380:00 +CPU= 71.882
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001380
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001380
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001380
  08:32:28 STEP 1381 H=1381:00 +CPU= 42.004
  08:33:14 STEP 1382 H=1382:00 +CPU= 42.950
  08:34:23 STEP 1383 H=1383:00 +CPU= 65.330
  08:35:07 STEP 1384 H=1384:00 +CPU= 42.950
  08:35:51 STEP 1385 H=1385:00 +CPU= 41.752
  08:37:00 STEP 1386 H=1386:00 +CPU= 66.224
  08:37:44 STEP 1387 H=1387:00 +CPU= 41.953
  08:38:29 STEP 1388 H=1388:00 +CPU= 42.702
  08:39:37 STEP 1389 H=1389:00 +CPU= 64.880
  08:40:22 STEP 1390 H=1390:00 +CPU= 42.851
  08:41:07 STEP 1391 H=1391:00 +CPU= 42.922
  08:42:31 STEP 1392 H=1392:00 +CPU= 78.249
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001392
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001392
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMGGhq0f+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMSHhq0f+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMUAhq0f+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMGGhq0f+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMSHhq0f+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMUAhq0f+001380
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0501_1997050100_123_966_12183145_0_r1020401603_57.zip
Uploading the intermediate file: upload_file_57.zip
  08:43:15 STEP 1393 H=1393:00 +CPU= 41.826
  08:44:00 STEP 1394 H=1394:00 +CPU= 42.670
  08:45:07 STEP 1395 H=1395:00 +CPU= 64.663
  08:45:52 STEP 1396 H=1396:00 +CPU= 43.053
  08:46:35 STEP 1397 H=1397:00 +CPU= 41.831
  08:47:44 STEP 1398 H=1398:00 +CPU= 66.088
  08:48:27 STEP 1399 H=1399:00 +CPU= 41.834
  08:49:12 STEP 1400 H=1400:00 +CPU= 43.196
  08:50:20 STEP 1401 H=1401:00 +CPU= 64.907
  08:51:05 STEP 1402 H=1402:00 +CPU= 42.810
  08:51:48 STEP 1403 H=1403:00 +CPU= 41.623
  08:53:05 STEP 1404 H=1404:00 +CPU= 72.480
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001404
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001404
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001404
  08:53:50 STEP 1405 H=1405:00 +CPU= 41.863
  08:54:36 STEP 1406 H=1406:00 +CPU= 43.590
  08:55:45 STEP 1407 H=1407:00 +CPU= 65.118
  08:56:30 STEP 1408 H=1408:00 +CPU= 43.234
  08:57:14 STEP 1409 H=1409:00 +CPU= 41.881
  08:58:23 STEP 1410 H=1410:00 +CPU= 66.092
  08:59:07 STEP 1411 H=1411:00 +CPU= 41.607
  08:59:51 STEP 1412 H=1412:00 +CPU= 42.846
  09:01:00 STEP 1413 H=1413:00 +CPU= 65.138
  09:01:45 STEP 1414 H=1414:00 +CPU= 42.925
  09:02:30 STEP 1415 H=1415:00 +CPU= 43.004
  09:03:58 STEP 1416 H=1416:00 +CPU= 80.256
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001416
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001416
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMGGhq0f+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMSHhq0f+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMUAhq0f+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMGGhq0f+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMSHhq0f+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMUAhq0f+001404
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0501_1997050100_123_966_12183145_0_r1020401603_58.zip
Uploading the intermediate file: upload_file_58.zip
Uploading trickle at timestep: 5097600
  09:04:43 STEP 1417 H=1417:00 +CPU= 42.104
  09:05:29 STEP 1418 H=1418:00 +CPU= 42.984
  09:06:37 STEP 1419 H=1419:00 +CPU= 65.501
  09:07:23 STEP 1420 H=1420:00 +CPU= 43.253
  09:08:08 STEP 1421 H=1421:00 +CPU= 41.812
  09:09:18 STEP 1422 H=1422:00 +CPU= 66.445
  09:10:02 STEP 1423 H=1423:00 +CPU= 41.817
  09:10:47 STEP 1424 H=1424:00 +CPU= 42.884
  09:11:55 STEP 1425 H=1425:00 +CPU= 65.225
  09:12:39 STEP 1426 H=1426:00 +CPU= 42.955
  09:13:23 STEP 1427 H=1427:00 +CPU= 41.747
  09:14:39 STEP 1428 H=1428:00 +CPU= 71.984
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001428
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001428
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001428
  09:15:22 STEP 1429 H=1429:00 +CPU= 41.594
  09:16:06 STEP 1430 H=1430:00 +CPU= 42.440
  09:17:14 STEP 1431 H=1431:00 +CPU= 65.121
  09:17:59 STEP 1432 H=1432:00 +CPU= 42.879
  09:18:42 STEP 1433 H=1433:00 +CPU= 41.756
  09:19:52 STEP 1434 H=1434:00 +CPU= 66.661
  09:20:36 STEP 1435 H=1435:00 +CPU= 41.772
  09:21:21 STEP 1436 H=1436:00 +CPU= 42.888
  09:22:29 STEP 1437 H=1437:00 +CPU= 64.723
  09:23:14 STEP 1438 H=1438:00 +CPU= 43.051
  09:23:58 STEP 1439 H=1439:00 +CPU= 42.828
  09:25:22 STEP 1440 H=1440:00 +CPU= 78.523
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001440
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001440
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMGGhq0f+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMSHhq0f+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMUAhq0f+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMGGhq0f+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMSHhq0f+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMUAhq0f+001428
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0501_1997050100_123_966_12183145_0_r1020401603_59.zip
Uploading the intermediate file: upload_file_59.zip
  09:26:06 STEP 1441 H=1441:00 +CPU= 41.573
  09:26:49 STEP 1442 H=1442:00 +CPU= 42.355
  09:27:59 STEP 1443 H=1443:00 +CPU= 65.398
  09:28:44 STEP 1444 H=1444:00 +CPU= 42.807
  09:29:28 STEP 1445 H=1445:00 +CPU= 41.859
  09:30:38 STEP 1446 H=1446:00 +CPU= 66.212
  09:31:21 STEP 1447 H=1447:00 +CPU= 41.804
  09:32:07 STEP 1448 H=1448:00 +CPU= 43.081
  09:33:16 STEP 1449 H=1449:00 +CPU= 65.742
  09:34:03 STEP 1450 H=1450:00 +CPU= 43.615
  09:34:47 STEP 1451 H=1451:00 +CPU= 41.609
  09:36:02 STEP 1452 H=1452:00 +CPU= 72.241
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001452
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001452
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001452
  09:36:45 STEP 1453 H=1453:00 +CPU= 41.502
  09:37:30 STEP 1454 H=1454:00 +CPU= 43.056
  09:38:39 STEP 1455 H=1455:00 +CPU= 64.925
  09:39:25 STEP 1456 H=1456:00 +CPU= 43.095
  09:40:07 STEP 1457 H=1457:00 +CPU= 41.506
  09:41:16 STEP 1458 H=1458:00 +CPU= 66.032
  09:41:59 STEP 1459 H=1459:00 +CPU= 41.642
  09:42:44 STEP 1460 H=1460:00 +CPU= 42.934
  09:43:51 STEP 1461 H=1461:00 +CPU= 64.574
  09:44:36 STEP 1462 H=1462:00 +CPU= 42.726
  09:45:20 STEP 1463 H=1463:00 +CPU= 42.875
  09:46:43 STEP 1464 H=1464:00 +CPU= 78.300
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001464
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001464
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMGGhq0f+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMSHhq0f+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMUAhq0f+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMGGhq0f+001452
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMSHhq0f+001452
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMUAhq0f+001452
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0501_1997050100_123_966_12183145_0_r1020401603_60.zip
Uploading the intermediate file: upload_file_60.zip
  09:47:27 STEP 1465 H=1465:00 +CPU= 41.703
  09:48:10 STEP 1466 H=1466:00 +CPU= 42.385
  09:49:18 STEP 1467 H=1467:00 +CPU= 64.806
  09:50:04 STEP 1468 H=1468:00 +CPU= 43.381
  09:50:48 STEP 1469 H=1469:00 +CPU= 42.165
  09:51:58 STEP 1470 H=1470:00 +CPU= 66.496
  09:52:41 STEP 1471 H=1471:00 +CPU= 41.569
  09:53:27 STEP 1472 H=1472:00 +CPU= 43.111
  09:54:36 STEP 1473 H=1473:00 +CPU= 65.175
  09:55:20 STEP 1474 H=1474:00 +CPU= 42.849
  09:56:04 STEP 1475 H=1475:00 +CPU= 41.956
  09:57:19 STEP 1476 H=1476:00 +CPU= 71.994
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001476
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001476
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001476
  09:58:02 STEP 1477 H=1477:00 +CPU= 41.554
  09:58:47 STEP 1478 H=1478:00 +CPU= 42.876
  09:59:54 STEP 1479 H=1479:00 +CPU= 64.659
  10:00:39 STEP 1480 H=1480:00 +CPU= 42.991
  10:01:23 STEP 1481 H=1481:00 +CPU= 41.677
  10:02:31 STEP 1482 H=1482:00 +CPU= 65.884
  10:03:15 STEP 1483 H=1483:00 +CPU= 41.612
  10:03:59 STEP 1484 H=1484:00 +CPU= 42.722
  10:05:08 STEP 1485 H=1485:00 +CPU= 64.939
  10:05:52 STEP 1486 H=1486:00 +CPU= 42.793
  10:06:37 STEP 1487 H=1487:00 +CPU= 42.901
  10:08:00 STEP 1488 H=1488:00 +CPU= 78.490
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001488
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001488
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMGGhq0f+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMSHhq0f+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMUAhq0f+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMGGhq0f+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMSHhq0f+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMUAhq0f+001476
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0501_1997050100_123_966_12183145_0_r1020401603_61.zip
Uploading the intermediate file: upload_file_61.zip
  10:08:43 STEP 1489 H=1489:00 +CPU= 41.526
  10:09:28 STEP 1490 H=1490:00 +CPU= 42.919
  10:10:38 STEP 1491 H=1491:00 +CPU= 65.414
  10:11:24 STEP 1492 H=1492:00 +CPU= 43.477
  10:12:09 STEP 1493 H=1493:00 +CPU= 42.685
  10:13:19 STEP 1494 H=1494:00 +CPU= 66.451
  10:14:02 STEP 1495 H=1495:00 +CPU= 41.713
  10:14:55 STEP 1496 H=1496:00 +CPU= 45.312
  10:16:12 STEP 1497 H=1497:00 +CPU= 67.911
  10:17:03 STEP 1498 H=1498:00 +CPU= 45.064
  10:17:51 STEP 1499 H=1499:00 +CPU= 43.382
  10:19:07 STEP 1500 H=1500:00 +CPU= 72.049
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001500
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001500
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001500
  10:19:50 STEP 1501 H=1501:00 +CPU= 41.370
  10:20:36 STEP 1502 H=1502:00 +CPU= 42.872
  10:21:43 STEP 1503 H=1503:00 +CPU= 64.705
  10:22:28 STEP 1504 H=1504:00 +CPU= 43.270
  10:23:11 STEP 1505 H=1505:00 +CPU= 41.671
  10:24:22 STEP 1506 H=1506:00 +CPU= 66.784
  10:25:05 STEP 1507 H=1507:00 +CPU= 42.003
  10:25:50 STEP 1508 H=1508:00 +CPU= 43.175
  10:26:58 STEP 1509 H=1509:00 +CPU= 64.906
  10:27:42 STEP 1510 H=1510:00 +CPU= 42.770
  10:28:27 STEP 1511 H=1511:00 +CPU= 42.915
  10:29:54 STEP 1512 H=1512:00 +CPU= 78.609
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001512
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001512
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMGGhq0f+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMSHhq0f+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMUAhq0f+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMGGhq0f+001500
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMSHhq0f+001500
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMUAhq0f+001500
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0501_1997050100_123_966_12183145_0_r1020401603_62.zip
Uploading the intermediate file: upload_file_62.zip
  10:30:38 STEP 1513 H=1513:00 +CPU= 41.877
  10:31:22 STEP 1514 H=1514:00 +CPU= 42.806
  10:32:29 STEP 1515 H=1515:00 +CPU= 64.895
  10:33:14 STEP 1516 H=1516:00 +CPU= 43.354
  10:33:57 STEP 1517 H=1517:00 +CPU= 41.370
  10:35:07 STEP 1518 H=1518:00 +CPU= 66.174
  10:35:50 STEP 1519 H=1519:00 +CPU= 41.401
  10:36:34 STEP 1520 H=1520:00 +CPU= 42.711
  10:37:41 STEP 1521 H=1521:00 +CPU= 64.726
  10:38:25 STEP 1522 H=1522:00 +CPU= 42.611
  10:39:08 STEP 1523 H=1523:00 +CPU= 41.468
  10:40:23 STEP 1524 H=1524:00 +CPU= 71.741
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001524
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001524
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001524
  10:41:06 STEP 1525 H=1525:00 +CPU= 41.390
  10:41:51 STEP 1526 H=1526:00 +CPU= 42.840
  10:43:00 STEP 1527 H=1527:00 +CPU= 65.126
  10:43:44 STEP 1528 H=1528:00 +CPU= 42.700
  10:44:27 STEP 1529 H=1529:00 +CPU= 41.485
  10:45:36 STEP 1530 H=1530:00 +CPU= 66.111
  10:46:19 STEP 1531 H=1531:00 +CPU= 41.597
  10:47:04 STEP 1532 H=1532:00 +CPU= 42.992
  10:48:13 STEP 1533 H=1533:00 +CPU= 64.840
  10:48:57 STEP 1534 H=1534:00 +CPU= 42.877
  10:49:43 STEP 1535 H=1535:00 +CPU= 42.978
  10:51:05 STEP 1536 H=1536:00 +CPU= 78.084
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001536
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001536
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMGGhq0f+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMSHhq0f+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMUAhq0f+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMGGhq0f+001524
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMSHhq0f+001524
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMUAhq0f+001524
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0501_1997050100_123_966_12183145_0_r1020401603_63.zip
Uploading the intermediate file: upload_file_63.zip
  10:51:48 STEP 1537 H=1537:00 +CPU= 41.382
  10:52:32 STEP 1538 H=1538:00 +CPU= 42.817
  10:53:39 STEP 1539 H=1539:00 +CPU= 64.837
  10:54:24 STEP 1540 H=1540:00 +CPU= 42.790
  10:55:08 STEP 1541 H=1541:00 +CPU= 41.610
  10:56:18 STEP 1542 H=1542:00 +CPU= 66.425
  10:57:01 STEP 1543 H=1543:00 +CPU= 41.567
  10:57:46 STEP 1544 H=1544:00 +CPU= 42.757
  10:58:54 STEP 1545 H=1545:00 +CPU= 64.867
  10:59:40 STEP 1546 H=1546:00 +CPU= 43.003
  11:00:25 STEP 1547 H=1547:00 +CPU= 41.886
  11:01:40 STEP 1548 H=1548:00 +CPU= 71.539
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001548
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001548
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001548
  11:02:23 STEP 1549 H=1549:00 +CPU= 41.666
  11:03:09 STEP 1550 H=1550:00 +CPU= 42.939
  11:04:18 STEP 1551 H=1551:00 +CPU= 65.831
  11:05:04 STEP 1552 H=1552:00 +CPU= 43.224
  11:05:48 STEP 1553 H=1553:00 +CPU= 41.650
  11:06:57 STEP 1554 H=1554:00 +CPU= 66.407
  11:07:41 STEP 1555 H=1555:00 +CPU= 41.629
  11:08:26 STEP 1556 H=1556:00 +CPU= 42.805
  11:09:34 STEP 1557 H=1557:00 +CPU= 64.997
  11:10:21 STEP 1558 H=1558:00 +CPU= 43.189
  11:11:07 STEP 1559 H=1559:00 +CPU= 43.201
  11:12:31 STEP 1560 H=1560:00 +CPU= 78.274
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001560
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001560
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMGGhq0f+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMSHhq0f+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMUAhq0f+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMGGhq0f+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMSHhq0f+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMUAhq0f+001548
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0501_1997050100_123_966_12183145_0_r1020401603_64.zip
Uploading the intermediate file: upload_file_64.zip
  11:13:14 STEP 1561 H=1561:00 +CPU= 41.430
  11:13:59 STEP 1562 H=1562:00 +CPU= 42.699
  11:15:06 STEP 1563 H=1563:00 +CPU= 64.972
  11:15:51 STEP 1564 H=1564:00 +CPU= 42.621
  11:16:34 STEP 1565 H=1565:00 +CPU= 41.620
  11:17:43 STEP 1566 H=1566:00 +CPU= 65.995
  11:18:27 STEP 1567 H=1567:00 +CPU= 41.562
  11:19:11 STEP 1568 H=1568:00 +CPU= 42.572
  11:20:18 STEP 1569 H=1569:00 +CPU= 64.621
  11:21:02 STEP 1570 H=1570:00 +CPU= 42.741
  11:21:45 STEP 1571 H=1571:00 +CPU= 41.535
  11:22:59 STEP 1572 H=1572:00 +CPU= 71.488
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001572
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001572
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001572
  11:23:44 STEP 1573 H=1573:00 +CPU= 41.702
  11:24:28 STEP 1574 H=1574:00 +CPU= 42.759
  11:25:37 STEP 1575 H=1575:00 +CPU= 65.017
  11:26:22 STEP 1576 H=1576:00 +CPU= 42.926
  11:27:06 STEP 1577 H=1577:00 +CPU= 41.518
  11:28:16 STEP 1578 H=1578:00 +CPU= 66.965
  11:29:01 STEP 1579 H=1579:00 +CPU= 41.841
  11:29:46 STEP 1580 H=1580:00 +CPU= 43.015
  11:30:58 STEP 1581 H=1581:00 +CPU= 66.925
  11:31:44 STEP 1582 H=1582:00 +CPU= 43.079
  11:32:31 STEP 1583 H=1583:00 +CPU= 44.170
  11:33:56 STEP 1584 H=1584:00 +CPU= 78.608
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001584
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001584
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMGGhq0f+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMSHhq0f+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMUAhq0f+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMGGhq0f+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMSHhq0f+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMUAhq0f+001572
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0501_1997050100_123_966_12183145_0_r1020401603_65.zip
Uploading the intermediate file: upload_file_65.zip
  11:34:41 STEP 1585 H=1585:00 +CPU= 41.681
  11:35:25 STEP 1586 H=1586:00 +CPU= 42.692
  11:36:33 STEP 1587 H=1587:00 +CPU= 64.951
  11:37:17 STEP 1588 H=1588:00 +CPU= 42.791
  11:38:00 STEP 1589 H=1589:00 +CPU= 41.586
  11:39:11 STEP 1590 H=1590:00 +CPU= 66.918
  11:39:54 STEP 1591 H=1591:00 +CPU= 41.496
  11:40:39 STEP 1592 H=1592:00 +CPU= 43.067
  11:41:47 STEP 1593 H=1593:00 +CPU= 64.878
  11:42:31 STEP 1594 H=1594:00 +CPU= 42.679
  11:43:15 STEP 1595 H=1595:00 +CPU= 41.455
  11:44:29 STEP 1596 H=1596:00 +CPU= 71.542
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001596
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001596
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001596
  11:45:12 STEP 1597 H=1597:00 +CPU= 41.512
  11:45:57 STEP 1598 H=1598:00 +CPU= 42.814
  11:47:08 STEP 1599 H=1599:00 +CPU= 66.202
  11:47:54 STEP 1600 H=1600:00 +CPU= 43.077
  11:48:38 STEP 1601 H=1601:00 +CPU= 41.495
  11:49:47 STEP 1602 H=1602:00 +CPU= 66.106
  11:50:31 STEP 1603 H=1603:00 +CPU= 41.597
  11:51:16 STEP 1604 H=1604:00 +CPU= 43.056
  11:52:24 STEP 1605 H=1605:00 +CPU= 65.028
  11:53:09 STEP 1606 H=1606:00 +CPU= 42.911
  11:53:54 STEP 1607 H=1607:00 +CPU= 42.954
  11:55:16 STEP 1608 H=1608:00 +CPU= 77.991
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001608
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001608
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMGGhq0f+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMSHhq0f+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMUAhq0f+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMGGhq0f+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMSHhq0f+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMUAhq0f+001596
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0501_1997050100_123_966_12183145_0_r1020401603_66.zip
Uploading the intermediate file: upload_file_66.zip
  11:56:00 STEP 1609 H=1609:00 +CPU= 41.764
  11:56:45 STEP 1610 H=1610:00 +CPU= 42.730
  11:57:52 STEP 1611 H=1611:00 +CPU= 64.481
  11:58:37 STEP 1612 H=1612:00 +CPU= 42.922
  11:59:20 STEP 1613 H=1613:00 +CPU= 41.499
  12:00:30 STEP 1614 H=1614:00 +CPU= 66.546
  12:01:13 STEP 1615 H=1615:00 +CPU= 41.433
  12:01:57 STEP 1616 H=1616:00 +CPU= 42.747
  12:03:05 STEP 1617 H=1617:00 +CPU= 64.786
  12:03:49 STEP 1618 H=1618:00 +CPU= 42.577
  12:04:34 STEP 1619 H=1619:00 +CPU= 42.098
  12:05:48 STEP 1620 H=1620:00 +CPU= 71.665
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001620
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001620
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001620
  12:06:32 STEP 1621 H=1621:00 +CPU= 41.807
  12:07:18 STEP 1622 H=1622:00 +CPU= 43.077
  12:08:30 STEP 1623 H=1623:00 +CPU= 67.038
  12:09:17 STEP 1624 H=1624:00 +CPU= 44.097
  12:10:10 STEP 1625 H=1625:00 +CPU= 44.234
  12:11:24 STEP 1626 H=1626:00 +CPU= 67.863
  12:12:11 STEP 1627 H=1627:00 +CPU= 42.854
  12:12:55 STEP 1628 H=1628:00 +CPU= 42.623
  12:14:46 STEP 1629 H=1629:00 +CPU= 80.835
  12:16:11 STEP 1630 H=1630:00 +CPU= 53.759
  12:17:44 STEP 1631 H=1631:00 +CPU= 55.291
  12:21:13 STEP 1632 H=1632:00 +CPU=117.364
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001632
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001632
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMGGhq0f+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMSHhq0f+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMUAhq0f+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMGGhq0f+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMSHhq0f+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145/ICMUAhq0f+001620
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0501_1997050100_123_966_12183145_0_r1020401603_67.zip
Uploading the intermediate file: upload_file_67.zip
  12:22:47 STEP 1633 H=1633:00 +CPU= 54.104
  12:24:48 STEP 1634 H=1634:00 +CPU= 80.877
  12:27:10 STEP 1635 H=1635:00 +CPU= 93.157
  12:28:28 STEP 1636 H=1636:00 +CPU= 48.592
  12:29:26 STEP 1637 H=1637:00 +CPU= 45.141
  12:30:49 STEP 1638 H=1638:00 +CPU= 66.466
  12:32:04 STEP 1639 H=1639:00 +CPU= 47.463
  12:33:04 STEP 1640 H=1640:00 +CPU= 42.032
  12:34:28 STEP 1641 H=1641:00 +CPU= 62.564
  12:35:35 STEP 1642 H=1642:00 +CPU= 51.356
  12:36:33 STEP 1643 H=1643:00 +CPU= 45.226
  12:38:02 STEP 1644 H=1644:00 +CPU= 72.102
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001644
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001644
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001644
  12:38:51 STEP 1645 H=1645:00 +CPU= 41.889
  12:39:48 STEP 1646 H=1646:00 +CPU= 43.800
  12:41:02 STEP 1647 H=1647:00 +CPU= 60.043
  12:42:02 STEP 1648 H=1648:00 +CPU= 42.826
Quit request received from BOINC client, ending the child process
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1997050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0501
(argv4) batchid: 966
(argv5) wuid: 12183145
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/1
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12183145
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/1/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/1/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_ecc261a3c7a35f45b93a16677120d06e to: /var/lib/boinc-client/slots/1/oifs_43r3_ps_0501_1997050100_123_966_12183145.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/1/oifs_43r3_ps_0501_1997050100_123_966_12183145.zip
ic_ancil_file: ic_ancil_12183145
ifsdata_file: ifsdata_12183145
climate_data_file: clim_data_12183145
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_ddc64a27eedf50c3a7c4896df1802174 to: /var/lib/boinc-client/slots/1/ic_ancil_12183145.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/1/ic_ancil_12183145.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_655b21ca88d437c1fa46073f54aa09b7 to: /var/lib/boinc-client/slots/1/ifsdata/ifsdata_12183145.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/1/ifsdata/ifsdata_12183145.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/1/159l_2/clim_data_12183145.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/1/159l_2/clim_data_12183145.zip
Checking for progress XML file: /var/lib/boinc-client/slots/1/progress_file_12183145.xml
Opened progress file ok : /var/lib/boinc-client/slots/1/progress_file_12183145.xml
-- Model is restarting --
Adjusting last_iter, 1649, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/1/progress_file_12183145.xml
last_cpu_time: 83183
upload_file_number: 68
last_iter: 1631
last_upload: 5875200
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0501_1997050100_123_966_12183145_0_r1020401603
The child process has been launched with process id: 9364
Executing the command: /var/lib/boinc-client/slots/1/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:emanuel-librem14:1:1:9364:9364] [20230121:124336:1674301416:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:emanuel-librem14:1:1:9364:9364] [20230121:124336:1674301416:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:emanuel-librem14:1:1:9364:9364] [20230121:124336:1674301416:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:emanuel-librem14:1:1:9364:9364] [20230121:124336:1674301416:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:emanuel-librem14:1:1:9364:9364] [20230121:124336:1674301416:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:emanuel-librem14:1:1:9364:9364] [20230121:124336:1674301416:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:emanuel-librem14:1:1:9364:9364] [20230121:124336:1674301416:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:emanuel-librem14:1:1:9364:9364] [20230121:124336:1674301416:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:emanuel-librem14:1:1:9364:9364] [20230121:124336:1674301416:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:emanuel-librem14:1:1:9364:9364] [20230121:124336:1674301416:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:emanuel-librem14:1:1:9364:9364] [20230121:124336:1674301416:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:emanuel-librem14:1:1:9364:9364] [20230121:124336:1674301416:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:emanuel-librem14:1:1:9364:9364] [20230121:124336:1674301416:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:emanuel-librem14:1:1:9364:9364] [20230121:124336:1674301416:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:emanuel-librem14:1:1:9364:9364] [20230121:124336:1674301416:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:emanuel-librem14:1:1:9364:9364] [20230121:124336:1674301416:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:emanuel-librem14:1:1:9364:9364] [20230121:124336:1674301416:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:emanuel-librem14:1:1:9364:9364] [20230121:124336:1674301416:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:emanuel-librem14:1:1:9364:9364] [20230121:124336:1674301416:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:emanuel-librem14:1:1:9364:9364] [20230121:124336:1674301416:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:emanuel-librem14:1:1:9364:9364] [20230121:124336:1674301416:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:emanuel-librem14:1:1:9364:9364] [20230121:124336:1674301416:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:emanuel-librem14:1:1:9364:9364] [20230121:124336:1674301416:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:emanuel-librem14:1:1:9364:9364] [20230121:124336:1674301416:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1)
[EC_DRHOOK:emanuel-librem14:1:1:9364:9364] [20230121:124336:1674301416:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:emanuel-librem14:1:1:9364:9364] [20230121:124336:1674301416:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:emanuel-librem14:1:1:9364:9364] [20230121:124336:1674301416:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:emanuel-librem14:1:1:9364:9364] [20230121:124336:1674301416:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:emanuel-librem14:1:1:9364:9364] [20230121:124336:1674301416:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:emanuel-librem14:1:1:9364:9364] [20230121:124336:1674301416:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  12:45:19 STEP 1632 H=1632:00 +CPU= 82.422
  12:46:13 STEP 1633 H=1633:00 +CPU= 44.826
  12:46:58 STEP 1634 H=1634:00 +CPU= 40.214
  12:48:06 STEP 1635 H=1635:00 +CPU= 60.524
  12:48:54 STEP 1636 H=1636:00 +CPU= 39.391
  12:49:36 STEP 1637 H=1637:00 +CPU= 38.492
  12:50:44 STEP 1638 H=1638:00 +CPU= 56.894
  12:51:31 STEP 1639 H=1639:00 +CPU= 39.805
  12:52:09 STEP 1640 H=1640:00 +CPU= 36.731
  12:53:31 STEP 1641 H=1641:00 +CPU= 66.416
  12:54:29 STEP 1642 H=1642:00 +CPU= 46.175
  12:55:13 STEP 1643 H=1643:00 +CPU= 39.697
  12:56:29 STEP 1644 H=1644:00 +CPU= 65.672
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhq0f+001644
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhq0f+001644
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhq0f+001644
  12:57:14 STEP 1645 H=1645:00 +CPU= 40.008
  12:58:12 STEP 1646 H=1646:00 +CPU= 42.500
  12:59:29 STEP 1647 H=1647:00 +CPU= 60.449
  13:00:17 STEP 1648 H=1648:00 +CPU= 39.895
  13:01:12 STEP 1649 H=1649:00 +CPU= 41.496
  13:02:27 STEP 1650 H=1650:00 +CPU= 63.529
  13:03:25 STEP 1651 H=1651:00 +CPU= 41.632
  13:04:15 STEP 1652 H=1652:00 +CPU= 40.741
  13:05:31 STEP 1653 H=1653:00 +CPU= 61.457
  13:06:22 STEP 1654 H=1654:00 +CPU= 39.776
  13:07:11 STEP 1655 H=1655:00 +CPU= 38.143
Abort request received from BOINC client, ending the child process

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:32:45 1537256 22268295 oifs_43r3_ps_0501_1997050100_123_966_12183145_0 5,097,600 71,183 0.0140
09 May 2023 16:32:25 1537256 22268295 oifs_43r3_ps_0501_1997050100_123_966_12183145_0 4,233,600 58,962 0.0139
09 May 2023 16:32:05 1537256 22268295 oifs_43r3_ps_0501_1997050100_123_966_12183145_0 3,369,600 46,711 0.0139
09 May 2023 16:31:48 1537256 22268295 oifs_43r3_ps_0501_1997050100_123_966_12183145_0 2,505,600 34,354 0.0137


©2024 climateprediction.net