climateprediction.net home page
Task 22255303

Task 22255303

Name oifs_43r3_ps_0327_1985050100_123_954_12170971_0
Workunit 12170971
Created 21 Dec 2022, 5:43:36 UTC
Sent 21 Dec 2022, 6:00:41 UTC
Report deadline 20 Jan 2023, 6:00:41 UTC
Received 22 Dec 2022, 9:20:47 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1534896
Run time 16 hours 14 min 52 sec
CPU time 14 hours 26 min 24 sec
Validate state Invalid
Credit 8,225.28
Device peak FLOPS 3.00 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,416.91 MB
Peak swap size 4,978.14 MB
Peak disk usage 3,623.06 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
c-client/slots/3/ICMSHhq0f+001248
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMGGhq0f+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMSHhq0f+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMUAhq0f+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMGGhq0f+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMSHhq0f+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMUAhq0f+001236
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0327_1985050100_123_954_12170971_0_r607902871_51.zip
Uploading the intermediate file: upload_file_51.zip
  03:35:25 STEP 1249 H=1249:00 +CPU= 22.659
  03:35:49 STEP 1250 H=1250:00 +CPU= 23.161
  03:36:26 STEP 1251 H=1251:00 +CPU= 36.904
  03:36:46 STEP 1252 H=1252:00 +CPU= 19.010
  03:37:09 STEP 1253 H=1253:00 +CPU= 21.706
  03:37:41 STEP 1254 H=1254:00 +CPU= 31.653
  03:37:55 STEP 1255 H=1255:00 +CPU= 14.506
  03:38:11 STEP 1256 H=1256:00 +CPU= 15.180
  03:38:35 STEP 1257 H=1257:00 +CPU= 23.317
  03:38:50 STEP 1258 H=1258:00 +CPU= 15.178
  03:39:05 STEP 1259 H=1259:00 +CPU= 14.852
  03:39:31 STEP 1260 H=1260:00 +CPU= 25.211
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001260
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001260
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001260
  03:39:47 STEP 1261 H=1261:00 +CPU= 15.796
  03:40:02 STEP 1262 H=1262:00 +CPU= 14.932
  03:40:25 STEP 1263 H=1263:00 +CPU= 22.705
  03:40:40 STEP 1264 H=1264:00 +CPU= 14.778
  03:40:54 STEP 1265 H=1265:00 +CPU= 14.427
  03:41:18 STEP 1266 H=1266:00 +CPU= 23.262
  03:41:34 STEP 1267 H=1267:00 +CPU= 15.341
  03:41:50 STEP 1268 H=1268:00 +CPU= 15.475
  03:42:13 STEP 1269 H=1269:00 +CPU= 22.773
  03:42:28 STEP 1270 H=1270:00 +CPU= 14.710
  03:42:43 STEP 1271 H=1271:00 +CPU= 14.856
  03:43:12 STEP 1272 H=1272:00 +CPU= 27.404
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001272
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001272
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMGGhq0f+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMSHhq0f+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMUAhq0f+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMGGhq0f+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMSHhq0f+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMUAhq0f+001260
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0327_1985050100_123_954_12170971_0_r607902871_52.zip
Uploading the intermediate file: upload_file_52.zip
  03:43:27 STEP 1273 H=1273:00 +CPU= 14.590
  03:43:42 STEP 1274 H=1274:00 +CPU= 14.715
  03:44:11 STEP 1275 H=1275:00 +CPU= 28.611
  03:44:29 STEP 1276 H=1276:00 +CPU= 17.923
  03:44:47 STEP 1277 H=1277:00 +CPU= 18.204
  03:45:25 STEP 1278 H=1278:00 +CPU= 37.057
  03:45:50 STEP 1279 H=1279:00 +CPU= 24.252
  03:46:15 STEP 1280 H=1280:00 +CPU= 24.910
  03:46:54 STEP 1281 H=1281:00 +CPU= 37.594
  03:47:21 STEP 1282 H=1282:00 +CPU= 24.799
  03:47:46 STEP 1283 H=1283:00 +CPU= 24.075
  03:48:31 STEP 1284 H=1284:00 +CPU= 41.709
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001284
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001284
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001284
  03:48:56 STEP 1285 H=1285:00 +CPU= 24.116
  03:49:21 STEP 1286 H=1286:00 +CPU= 24.713
  03:50:00 STEP 1287 H=1287:00 +CPU= 37.595
  03:50:25 STEP 1288 H=1288:00 +CPU= 24.996
  03:50:50 STEP 1289 H=1289:00 +CPU= 24.091
  03:51:30 STEP 1290 H=1290:00 +CPU= 38.599
  03:51:55 STEP 1291 H=1291:00 +CPU= 24.009
  03:52:20 STEP 1292 H=1292:00 +CPU= 24.779
  03:52:59 STEP 1293 H=1293:00 +CPU= 37.665
  03:53:27 STEP 1294 H=1294:00 +CPU= 24.975
  03:53:52 STEP 1295 H=1295:00 +CPU= 24.998
  03:54:39 STEP 1296 H=1296:00 +CPU= 44.846
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001296
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001296
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMGGhq0f+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMSHhq0f+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMUAhq0f+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMGGhq0f+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMSHhq0f+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMUAhq0f+001284
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0327_1985050100_123_954_12170971_0_r607902871_53.zip
Uploading the intermediate file: upload_file_53.zip
  03:55:04 STEP 1297 H=1297:00 +CPU= 24.062
  03:55:31 STEP 1298 H=1298:00 +CPU= 26.600
  03:56:09 STEP 1299 H=1299:00 +CPU= 38.009
  03:56:35 STEP 1300 H=1300:00 +CPU= 24.758
  03:56:59 STEP 1301 H=1301:00 +CPU= 23.930
  03:57:38 STEP 1302 H=1302:00 +CPU= 38.613
  03:58:02 STEP 1303 H=1303:00 +CPU= 23.927
  03:58:28 STEP 1304 H=1304:00 +CPU= 24.692
  03:59:06 STEP 1305 H=1305:00 +CPU= 37.815
  03:59:32 STEP 1306 H=1306:00 +CPU= 24.817
  03:59:56 STEP 1307 H=1307:00 +CPU= 23.972
  04:00:39 STEP 1308 H=1308:00 +CPU= 42.044
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001308
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001308
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001308
  04:01:03 STEP 1309 H=1309:00 +CPU= 24.064
  04:01:29 STEP 1310 H=1310:00 +CPU= 24.851
  04:02:09 STEP 1311 H=1311:00 +CPU= 38.466
  04:02:36 STEP 1312 H=1312:00 +CPU= 24.924
  04:03:01 STEP 1313 H=1313:00 +CPU= 23.790
  04:03:41 STEP 1314 H=1314:00 +CPU= 38.492
  04:04:07 STEP 1315 H=1315:00 +CPU= 24.168
  04:04:34 STEP 1316 H=1316:00 +CPU= 24.965
  04:05:13 STEP 1317 H=1317:00 +CPU= 37.850
  04:05:39 STEP 1318 H=1318:00 +CPU= 25.045
  04:06:05 STEP 1319 H=1319:00 +CPU= 24.790
  04:06:51 STEP 1320 H=1320:00 +CPU= 44.909
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001320
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001320
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMGGhq0f+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMSHhq0f+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMUAhq0f+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMGGhq0f+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMSHhq0f+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMUAhq0f+001308
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0327_1985050100_123_954_12170971_0_r607902871_54.zip
Uploading the intermediate file: upload_file_54.zip
  04:07:17 STEP 1321 H=1321:00 +CPU= 24.596
  04:07:48 STEP 1322 H=1322:00 +CPU= 25.367
  04:08:27 STEP 1323 H=1323:00 +CPU= 37.903
  04:08:52 STEP 1324 H=1324:00 +CPU= 24.618
  04:09:18 STEP 1325 H=1325:00 +CPU= 23.919
  04:09:57 STEP 1326 H=1326:00 +CPU= 38.699
  04:10:23 STEP 1327 H=1327:00 +CPU= 24.232
  04:10:50 STEP 1328 H=1328:00 +CPU= 24.852
  04:11:30 STEP 1329 H=1329:00 +CPU= 38.251
  04:11:56 STEP 1330 H=1330:00 +CPU= 24.644
  04:12:24 STEP 1331 H=1331:00 +CPU= 24.315
  04:13:09 STEP 1332 H=1332:00 +CPU= 42.073
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001332
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001332
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001332
  04:13:35 STEP 1333 H=1333:00 +CPU= 24.130
  04:14:00 STEP 1334 H=1334:00 +CPU= 24.678
  04:14:40 STEP 1335 H=1335:00 +CPU= 37.815
  04:15:07 STEP 1336 H=1336:00 +CPU= 24.734
  04:15:32 STEP 1337 H=1337:00 +CPU= 24.358
  04:16:15 STEP 1338 H=1338:00 +CPU= 38.758
  04:16:39 STEP 1339 H=1339:00 +CPU= 23.830
  04:17:04 STEP 1340 H=1340:00 +CPU= 24.934
  04:17:43 STEP 1341 H=1341:00 +CPU= 38.061
  04:18:10 STEP 1342 H=1342:00 +CPU= 24.592
  04:18:36 STEP 1343 H=1343:00 +CPU= 24.787
  04:19:23 STEP 1344 H=1344:00 +CPU= 45.584
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001344
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001344
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMGGhq0f+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMSHhq0f+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMUAhq0f+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMGGhq0f+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMSHhq0f+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMUAhq0f+001332
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0327_1985050100_123_954_12170971_0_r607902871_55.zip
Uploading the intermediate file: upload_file_55.zip
  04:19:47 STEP 1345 H=1345:00 +CPU= 23.934
  04:20:13 STEP 1346 H=1346:00 +CPU= 24.992
  04:20:52 STEP 1347 H=1347:00 +CPU= 38.830
  04:21:18 STEP 1348 H=1348:00 +CPU= 24.621
  04:21:43 STEP 1349 H=1349:00 +CPU= 24.315
  04:22:23 STEP 1350 H=1350:00 +CPU= 38.798
  04:22:48 STEP 1351 H=1351:00 +CPU= 24.113
  04:23:14 STEP 1352 H=1352:00 +CPU= 24.801
  04:23:53 STEP 1353 H=1353:00 +CPU= 37.406
  04:24:18 STEP 1354 H=1354:00 +CPU= 25.037
  04:24:50 STEP 1355 H=1355:00 +CPU= 25.074
  04:25:37 STEP 1356 H=1356:00 +CPU= 43.452
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001356
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001356
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001356
  04:26:04 STEP 1357 H=1357:00 +CPU= 24.667
  04:26:30 STEP 1358 H=1358:00 +CPU= 25.130
  04:27:10 STEP 1359 H=1359:00 +CPU= 38.025
  04:27:36 STEP 1360 H=1360:00 +CPU= 24.988
  04:28:03 STEP 1361 H=1361:00 +CPU= 24.335
  04:28:44 STEP 1362 H=1362:00 +CPU= 38.883
  04:29:10 STEP 1363 H=1363:00 +CPU= 24.155
  04:29:36 STEP 1364 H=1364:00 +CPU= 24.811
  04:30:19 STEP 1365 H=1365:00 +CPU= 38.390
  04:30:45 STEP 1366 H=1366:00 +CPU= 24.915
  04:31:10 STEP 1367 H=1367:00 +CPU= 25.041
  04:31:58 STEP 1368 H=1368:00 +CPU= 45.945
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001368
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001368
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMGGhq0f+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMSHhq0f+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMUAhq0f+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMGGhq0f+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMSHhq0f+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMUAhq0f+001356
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0327_1985050100_123_954_12170971_0_r607902871_56.zip
Uploading the intermediate file: upload_file_56.zip
  04:32:23 STEP 1369 H=1369:00 +CPU= 24.182
  04:32:49 STEP 1370 H=1370:00 +CPU= 26.156
  04:33:28 STEP 1371 H=1371:00 +CPU= 38.006
  04:33:53 STEP 1372 H=1372:00 +CPU= 24.842
  04:34:18 STEP 1373 H=1373:00 +CPU= 24.222
  04:34:56 STEP 1374 H=1374:00 +CPU= 38.211
  04:35:21 STEP 1375 H=1375:00 +CPU= 23.979
  04:35:46 STEP 1376 H=1376:00 +CPU= 25.048
  04:36:24 STEP 1377 H=1377:00 +CPU= 38.085
  04:36:49 STEP 1378 H=1378:00 +CPU= 24.651
  04:37:14 STEP 1379 H=1379:00 +CPU= 24.701
  04:37:57 STEP 1380 H=1380:00 +CPU= 41.997
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001380
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001380
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001380
  04:38:22 STEP 1381 H=1381:00 +CPU= 24.528
  04:38:47 STEP 1382 H=1382:00 +CPU= 24.849
  04:39:25 STEP 1383 H=1383:00 +CPU= 37.717
  04:39:50 STEP 1384 H=1384:00 +CPU= 24.719
  04:40:15 STEP 1385 H=1385:00 +CPU= 24.337
  04:40:57 STEP 1386 H=1386:00 +CPU= 40.888
  04:41:22 STEP 1387 H=1387:00 +CPU= 25.469
  04:41:49 STEP 1388 H=1388:00 +CPU= 25.925
  04:42:28 STEP 1389 H=1389:00 +CPU= 39.096
  04:42:54 STEP 1390 H=1390:00 +CPU= 25.393
  04:43:22 STEP 1391 H=1391:00 +CPU= 27.643
  04:44:14 STEP 1392 H=1392:00 +CPU= 49.890
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001392
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001392
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMGGhq0f+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMSHhq0f+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMUAhq0f+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMGGhq0f+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMSHhq0f+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMUAhq0f+001380
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0327_1985050100_123_954_12170971_0_r607902871_57.zip
Uploading the intermediate file: upload_file_57.zip
Uploading trickle at timestep: 5011200
  04:44:43 STEP 1393 H=1393:00 +CPU= 26.162
  04:45:18 STEP 1394 H=1394:00 +CPU= 27.758
  04:45:59 STEP 1395 H=1395:00 +CPU= 40.527
  04:46:28 STEP 1396 H=1396:00 +CPU= 28.937
  04:46:57 STEP 1397 H=1397:00 +CPU= 28.256
  04:47:38 STEP 1398 H=1398:00 +CPU= 39.822
  04:48:03 STEP 1399 H=1399:00 +CPU= 24.602
  04:48:28 STEP 1400 H=1400:00 +CPU= 25.158
  04:49:16 STEP 1401 H=1401:00 +CPU= 46.386
  04:49:42 STEP 1402 H=1402:00 +CPU= 25.689
  04:50:07 STEP 1403 H=1403:00 +CPU= 24.587
  04:50:50 STEP 1404 H=1404:00 +CPU= 42.101
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001404
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001404
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001404
  04:51:15 STEP 1405 H=1405:00 +CPU= 24.413
  04:51:41 STEP 1406 H=1406:00 +CPU= 25.143
  04:52:19 STEP 1407 H=1407:00 +CPU= 38.059
  04:52:45 STEP 1408 H=1408:00 +CPU= 24.743
  04:53:13 STEP 1409 H=1409:00 +CPU= 24.484
  04:53:52 STEP 1410 H=1410:00 +CPU= 38.958
  04:54:17 STEP 1411 H=1411:00 +CPU= 24.204
  04:54:42 STEP 1412 H=1412:00 +CPU= 24.894
  04:55:23 STEP 1413 H=1413:00 +CPU= 38.662
  04:55:49 STEP 1414 H=1414:00 +CPU= 24.904
  04:56:19 STEP 1415 H=1415:00 +CPU= 29.256
  04:57:26 STEP 1416 H=1416:00 +CPU= 63.530
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001416
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001416
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMGGhq0f+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMSHhq0f+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMUAhq0f+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMGGhq0f+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMSHhq0f+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMUAhq0f+001404
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0327_1985050100_123_954_12170971_0_r607902871_58.zip
Uploading the intermediate file: upload_file_58.zip
  04:57:55 STEP 1417 H=1417:00 +CPU= 27.252
  04:58:22 STEP 1418 H=1418:00 +CPU= 26.523
  04:59:01 STEP 1419 H=1419:00 +CPU= 38.189
  04:59:26 STEP 1420 H=1420:00 +CPU= 24.844
  04:59:51 STEP 1421 H=1421:00 +CPU= 24.344
  05:00:33 STEP 1422 H=1422:00 +CPU= 40.862
  05:00:59 STEP 1423 H=1423:00 +CPU= 25.664
  05:01:25 STEP 1424 H=1424:00 +CPU= 26.067
  05:02:06 STEP 1425 H=1425:00 +CPU= 40.019
  05:02:32 STEP 1426 H=1426:00 +CPU= 25.463
  05:03:00 STEP 1427 H=1427:00 +CPU= 27.490
  05:03:48 STEP 1428 H=1428:00 +CPU= 45.615
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001428
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001428
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001428
  05:04:14 STEP 1429 H=1429:00 +CPU= 24.969
  05:04:40 STEP 1430 H=1430:00 +CPU= 25.742
  05:05:20 STEP 1431 H=1431:00 +CPU= 38.912
  05:05:45 STEP 1432 H=1432:00 +CPU= 24.996
  05:06:10 STEP 1433 H=1433:00 +CPU= 24.492
  05:06:50 STEP 1434 H=1434:00 +CPU= 38.828
  05:07:15 STEP 1435 H=1435:00 +CPU= 24.386
  05:07:41 STEP 1436 H=1436:00 +CPU= 25.135
  05:08:21 STEP 1437 H=1437:00 +CPU= 38.583
  05:08:46 STEP 1438 H=1438:00 +CPU= 24.763
  05:09:12 STEP 1439 H=1439:00 +CPU= 25.041
  05:10:00 STEP 1440 H=1440:00 +CPU= 46.392
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001440
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001440
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMGGhq0f+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMSHhq0f+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMUAhq0f+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMGGhq0f+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMSHhq0f+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMUAhq0f+001428
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0327_1985050100_123_954_12170971_0_r607902871_59.zip
Uploading the intermediate file: upload_file_59.zip
  05:10:25 STEP 1441 H=1441:00 +CPU= 24.281
  05:10:53 STEP 1442 H=1442:00 +CPU= 26.058
  05:11:32 STEP 1443 H=1443:00 +CPU= 38.318
  05:11:57 STEP 1444 H=1444:00 +CPU= 25.142
  05:12:22 STEP 1445 H=1445:00 +CPU= 24.433
  05:13:02 STEP 1446 H=1446:00 +CPU= 39.250
  05:13:27 STEP 1447 H=1447:00 +CPU= 24.284
  05:13:53 STEP 1448 H=1448:00 +CPU= 25.761
  05:14:32 STEP 1449 H=1449:00 +CPU= 38.216
  05:14:57 STEP 1450 H=1450:00 +CPU= 25.016
  05:15:22 STEP 1451 H=1451:00 +CPU= 24.493
  05:16:06 STEP 1452 H=1452:00 +CPU= 42.631
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001452
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001452
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001452
  05:16:45 STEP 1453 H=1453:00 +CPU= 36.963
  05:17:13 STEP 1454 H=1454:00 +CPU= 27.601
  05:18:02 STEP 1455 H=1455:00 +CPU= 46.375
  05:18:29 STEP 1456 H=1456:00 +CPU= 26.918
  05:18:54 STEP 1457 H=1457:00 +CPU= 24.289
  05:19:34 STEP 1458 H=1458:00 +CPU= 38.944
  05:19:58 STEP 1459 H=1459:00 +CPU= 24.165
  05:20:24 STEP 1460 H=1460:00 +CPU= 25.001
  05:21:03 STEP 1461 H=1461:00 +CPU= 38.450
  05:21:29 STEP 1462 H=1462:00 +CPU= 25.137
  05:21:55 STEP 1463 H=1463:00 +CPU= 25.202
  05:22:43 STEP 1464 H=1464:00 +CPU= 46.806
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001464
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001464
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMGGhq0f+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMSHhq0f+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMUAhq0f+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMGGhq0f+001452
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMSHhq0f+001452
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMUAhq0f+001452
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0327_1985050100_123_954_12170971_0_r607902871_60.zip
Uploading the intermediate file: upload_file_60.zip
  05:23:10 STEP 1465 H=1465:00 +CPU= 24.595
  05:23:38 STEP 1466 H=1466:00 +CPU= 26.507
  05:24:18 STEP 1467 H=1467:00 +CPU= 38.438
  05:24:44 STEP 1468 H=1468:00 +CPU= 24.866
  05:25:09 STEP 1469 H=1469:00 +CPU= 24.292
  05:25:49 STEP 1470 H=1470:00 +CPU= 38.763
  05:26:14 STEP 1471 H=1471:00 +CPU= 24.183
  05:26:40 STEP 1472 H=1472:00 +CPU= 24.612
  05:27:19 STEP 1473 H=1473:00 +CPU= 37.617
  05:27:45 STEP 1474 H=1474:00 +CPU= 25.082
  05:28:11 STEP 1475 H=1475:00 +CPU= 24.166
  05:28:55 STEP 1476 H=1476:00 +CPU= 42.197
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001476
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001476
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001476
  05:29:20 STEP 1477 H=1477:00 +CPU= 24.121
  05:29:47 STEP 1478 H=1478:00 +CPU= 26.283
  05:30:28 STEP 1479 H=1479:00 +CPU= 38.456
  05:30:54 STEP 1480 H=1480:00 +CPU= 25.708
  05:31:19 STEP 1481 H=1481:00 +CPU= 24.513
  05:31:59 STEP 1482 H=1482:00 +CPU= 38.577
  05:32:23 STEP 1483 H=1483:00 +CPU= 23.976
  05:32:48 STEP 1484 H=1484:00 +CPU= 24.583
  05:33:27 STEP 1485 H=1485:00 +CPU= 37.970
  05:33:52 STEP 1486 H=1486:00 +CPU= 24.816
  05:34:18 STEP 1487 H=1487:00 +CPU= 25.253
  05:35:05 STEP 1488 H=1488:00 +CPU= 45.080
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001488
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001488
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMGGhq0f+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMSHhq0f+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMUAhq0f+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMGGhq0f+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMSHhq0f+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMUAhq0f+001476
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0327_1985050100_123_954_12170971_0_r607902871_61.zip
Uploading the intermediate file: upload_file_61.zip
  05:35:31 STEP 1489 H=1489:00 +CPU= 24.076
  05:36:00 STEP 1490 H=1490:00 +CPU= 26.549
  05:36:39 STEP 1491 H=1491:00 +CPU= 37.845
  05:37:05 STEP 1492 H=1492:00 +CPU= 24.924
  05:37:30 STEP 1493 H=1493:00 +CPU= 24.089
  05:38:09 STEP 1494 H=1494:00 +CPU= 38.647
  05:38:33 STEP 1495 H=1495:00 +CPU= 24.112
  05:38:58 STEP 1496 H=1496:00 +CPU= 24.697
  05:39:37 STEP 1497 H=1497:00 +CPU= 37.711
  05:40:02 STEP 1498 H=1498:00 +CPU= 24.902
  05:40:27 STEP 1499 H=1499:00 +CPU= 24.217
  05:41:10 STEP 1500 H=1500:00 +CPU= 42.080
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001500
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001500
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001500
  05:41:34 STEP 1501 H=1501:00 +CPU= 24.070
  05:42:00 STEP 1502 H=1502:00 +CPU= 25.043
  05:42:39 STEP 1503 H=1503:00 +CPU= 37.949
  05:43:04 STEP 1504 H=1504:00 +CPU= 24.786
  05:43:30 STEP 1505 H=1505:00 +CPU= 24.999
  05:44:09 STEP 1506 H=1506:00 +CPU= 38.624
  05:44:34 STEP 1507 H=1507:00 +CPU= 24.193
  05:44:59 STEP 1508 H=1508:00 +CPU= 24.868
  05:45:38 STEP 1509 H=1509:00 +CPU= 38.113
  05:46:03 STEP 1510 H=1510:00 +CPU= 25.100
  05:46:30 STEP 1511 H=1511:00 +CPU= 25.422
  05:47:17 STEP 1512 H=1512:00 +CPU= 45.122
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001512
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001512
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMGGhq0f+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMSHhq0f+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMUAhq0f+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMGGhq0f+001500
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMSHhq0f+001500
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMUAhq0f+001500
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0327_1985050100_123_954_12170971_0_r607902871_62.zip
Uploading the intermediate file: upload_file_62.zip
  05:47:43 STEP 1513 H=1513:00 +CPU= 24.227
  05:48:09 STEP 1514 H=1514:00 +CPU= 25.884
  05:48:48 STEP 1515 H=1515:00 +CPU= 38.028
  05:49:13 STEP 1516 H=1516:00 +CPU= 25.166
  05:49:38 STEP 1517 H=1517:00 +CPU= 24.413
  05:50:19 STEP 1518 H=1518:00 +CPU= 40.282
  05:50:44 STEP 1519 H=1519:00 +CPU= 24.088
  05:51:09 STEP 1520 H=1520:00 +CPU= 25.038
  05:51:47 STEP 1521 H=1521:00 +CPU= 37.868
  05:52:14 STEP 1522 H=1522:00 +CPU= 26.037
  05:52:39 STEP 1523 H=1523:00 +CPU= 24.312
  05:53:21 STEP 1524 H=1524:00 +CPU= 42.191
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001524
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001524
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001524
  05:53:46 STEP 1525 H=1525:00 +CPU= 24.174
  05:54:12 STEP 1526 H=1526:00 +CPU= 25.131
  05:54:50 STEP 1527 H=1527:00 +CPU= 38.084
  05:55:16 STEP 1528 H=1528:00 +CPU= 25.190
  05:55:41 STEP 1529 H=1529:00 +CPU= 24.435
  05:56:22 STEP 1530 H=1530:00 +CPU= 40.338
  05:56:47 STEP 1531 H=1531:00 +CPU= 24.483
  05:57:13 STEP 1532 H=1532:00 +CPU= 25.435
  05:57:52 STEP 1533 H=1533:00 +CPU= 38.425
  05:58:25 STEP 1534 H=1534:00 +CPU= 32.860
  05:58:51 STEP 1535 H=1535:00 +CPU= 25.431
  05:59:38 STEP 1536 H=1536:00 +CPU= 45.310
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001536
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001536
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMGGhq0f+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMSHhq0f+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMUAhq0f+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMGGhq0f+001524
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMSHhq0f+001524
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMUAhq0f+001524
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0327_1985050100_123_954_12170971_0_r607902871_63.zip
Uploading the intermediate file: upload_file_63.zip
  06:00:04 STEP 1537 H=1537:00 +CPU= 24.230
  06:00:32 STEP 1538 H=1538:00 +CPU= 26.653
  06:01:10 STEP 1539 H=1539:00 +CPU= 37.901
  06:01:36 STEP 1540 H=1540:00 +CPU= 24.756
  06:02:00 STEP 1541 H=1541:00 +CPU= 24.253
  06:02:40 STEP 1542 H=1542:00 +CPU= 39.043
  06:03:07 STEP 1543 H=1543:00 +CPU= 26.408
  06:03:36 STEP 1544 H=1544:00 +CPU= 28.373
  06:04:15 STEP 1545 H=1545:00 +CPU= 38.563
  06:04:40 STEP 1546 H=1546:00 +CPU= 25.015
  06:05:05 STEP 1547 H=1547:00 +CPU= 24.319
  06:05:48 STEP 1548 H=1548:00 +CPU= 42.353
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001548
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001548
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001548
  06:06:14 STEP 1549 H=1549:00 +CPU= 24.352
  06:06:39 STEP 1550 H=1550:00 +CPU= 24.650
  06:07:18 STEP 1551 H=1551:00 +CPU= 38.031
  06:07:44 STEP 1552 H=1552:00 +CPU= 24.885
  06:08:08 STEP 1553 H=1553:00 +CPU= 24.363
  06:08:48 STEP 1554 H=1554:00 +CPU= 38.960
  06:09:18 STEP 1555 H=1555:00 +CPU= 24.529
  06:09:44 STEP 1556 H=1556:00 +CPU= 25.342
  06:10:22 STEP 1557 H=1557:00 +CPU= 37.861
  06:10:48 STEP 1558 H=1558:00 +CPU= 24.980
  06:11:14 STEP 1559 H=1559:00 +CPU= 25.944
  06:12:03 STEP 1560 H=1560:00 +CPU= 47.653
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001560
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001560
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMGGhq0f+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMSHhq0f+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMUAhq0f+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMGGhq0f+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMSHhq0f+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMUAhq0f+001548
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0327_1985050100_123_954_12170971_0_r607902871_64.zip
Uploading the intermediate file: upload_file_64.zip
  06:12:41 STEP 1561 H=1561:00 +CPU= 33.123
  06:13:06 STEP 1562 H=1562:00 +CPU= 25.086
  06:13:46 STEP 1563 H=1563:00 +CPU= 38.007
  06:14:12 STEP 1564 H=1564:00 +CPU= 25.239
  06:14:37 STEP 1565 H=1565:00 +CPU= 24.295
  06:15:16 STEP 1566 H=1566:00 +CPU= 39.133
  06:15:41 STEP 1567 H=1567:00 +CPU= 24.300
  06:16:07 STEP 1568 H=1568:00 +CPU= 25.368
  06:16:45 STEP 1569 H=1569:00 +CPU= 37.980
  06:17:11 STEP 1570 H=1570:00 +CPU= 25.132
  06:17:36 STEP 1571 H=1571:00 +CPU= 24.299
  06:18:19 STEP 1572 H=1572:00 +CPU= 42.057
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001572
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001572
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001572
  06:18:43 STEP 1573 H=1573:00 +CPU= 24.070
  06:19:09 STEP 1574 H=1574:00 +CPU= 24.859
  06:19:47 STEP 1575 H=1575:00 +CPU= 37.492
  06:20:12 STEP 1576 H=1576:00 +CPU= 24.931
  06:20:37 STEP 1577 H=1577:00 +CPU= 24.364
  06:21:18 STEP 1578 H=1578:00 +CPU= 38.417
  06:21:45 STEP 1579 H=1579:00 +CPU= 24.201
  06:22:13 STEP 1580 H=1580:00 +CPU= 24.906
  06:22:52 STEP 1581 H=1581:00 +CPU= 38.024
  06:23:19 STEP 1582 H=1582:00 +CPU= 25.218
  06:23:50 STEP 1583 H=1583:00 +CPU= 26.151
  06:24:40 STEP 1584 H=1584:00 +CPU= 45.949
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001584
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001584
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMGGhq0f+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMSHhq0f+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMUAhq0f+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMGGhq0f+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMSHhq0f+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMUAhq0f+001572
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0327_1985050100_123_954_12170971_0_r607902871_65.zip
Uploading the intermediate file: upload_file_65.zip
  06:25:22 STEP 1585 H=1585:00 +CPU= 27.407
  06:25:48 STEP 1586 H=1586:00 +CPU= 24.993
  06:26:27 STEP 1587 H=1587:00 +CPU= 38.170
  06:26:52 STEP 1588 H=1588:00 +CPU= 24.806
  06:27:21 STEP 1589 H=1589:00 +CPU= 24.172
  06:28:00 STEP 1590 H=1590:00 +CPU= 38.807
  06:28:25 STEP 1591 H=1591:00 +CPU= 24.145
  06:28:51 STEP 1592 H=1592:00 +CPU= 25.223
  06:29:29 STEP 1593 H=1593:00 +CPU= 37.759
  06:29:55 STEP 1594 H=1594:00 +CPU= 24.993
  06:30:19 STEP 1595 H=1595:00 +CPU= 24.315
  06:31:03 STEP 1596 H=1596:00 +CPU= 42.361
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001596
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001596
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001596
  06:31:27 STEP 1597 H=1597:00 +CPU= 24.257
  06:31:53 STEP 1598 H=1598:00 +CPU= 24.779
  06:32:31 STEP 1599 H=1599:00 +CPU= 37.748
  06:32:56 STEP 1600 H=1600:00 +CPU= 24.990
  06:33:21 STEP 1601 H=1601:00 +CPU= 24.212
  06:34:01 STEP 1602 H=1602:00 +CPU= 38.725
  06:34:26 STEP 1603 H=1603:00 +CPU= 24.172
  06:34:51 STEP 1604 H=1604:00 +CPU= 24.675
  06:35:30 STEP 1605 H=1605:00 +CPU= 38.104
  06:35:55 STEP 1606 H=1606:00 +CPU= 24.871
  06:36:21 STEP 1607 H=1607:00 +CPU= 25.748
  06:37:08 STEP 1608 H=1608:00 +CPU= 45.015
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001608
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001608
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMGGhq0f+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMSHhq0f+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMUAhq0f+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMGGhq0f+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMSHhq0f+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMUAhq0f+001596
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0327_1985050100_123_954_12170971_0_r607902871_66.zip
Uploading the intermediate file: upload_file_66.zip
  06:37:34 STEP 1609 H=1609:00 +CPU= 24.426
  06:38:03 STEP 1610 H=1610:00 +CPU= 26.374
  06:38:42 STEP 1611 H=1611:00 +CPU= 37.725
  06:39:07 STEP 1612 H=1612:00 +CPU= 25.002
  06:39:32 STEP 1613 H=1613:00 +CPU= 24.208
  06:40:11 STEP 1614 H=1614:00 +CPU= 38.740
  06:40:36 STEP 1615 H=1615:00 +CPU= 24.126
  06:41:01 STEP 1616 H=1616:00 +CPU= 24.852
  06:41:41 STEP 1617 H=1617:00 +CPU= 37.424
  06:42:07 STEP 1618 H=1618:00 +CPU= 24.768
  06:42:32 STEP 1619 H=1619:00 +CPU= 24.132
  06:43:15 STEP 1620 H=1620:00 +CPU= 42.092
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001620
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001620
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001620
  06:43:40 STEP 1621 H=1621:00 +CPU= 23.922
  06:44:05 STEP 1622 H=1622:00 +CPU= 24.860
  06:44:44 STEP 1623 H=1623:00 +CPU= 37.827
  06:45:09 STEP 1624 H=1624:00 +CPU= 24.567
  06:45:33 STEP 1625 H=1625:00 +CPU= 24.006
  06:46:13 STEP 1626 H=1626:00 +CPU= 38.666
  06:46:37 STEP 1627 H=1627:00 +CPU= 23.825
  06:47:02 STEP 1628 H=1628:00 +CPU= 24.849
  06:47:40 STEP 1629 H=1629:00 +CPU= 37.835
  06:48:06 STEP 1630 H=1630:00 +CPU= 24.908
  06:50:12 STEP 1631 H=1631:00 +CPU= 25.850
  06:51:05 STEP 1632 H=1632:00 +CPU= 41.138
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001632
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001632
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMGGhq0f+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMSHhq0f+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMUAhq0f+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMGGhq0f+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMSHhq0f+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMUAhq0f+001620
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0327_1985050100_123_954_12170971_0_r607902871_67.zip
Uploading the intermediate file: upload_file_67.zip
  06:51:28 STEP 1633 H=1633:00 +CPU= 21.552
Uploading trickle at timestep: 5875200
  06:51:52 STEP 1634 H=1634:00 +CPU= 23.539
  06:52:28 STEP 1635 H=1635:00 +CPU= 35.087
  06:52:50 STEP 1636 H=1636:00 +CPU= 21.716
  06:53:10 STEP 1637 H=1637:00 +CPU= 19.927
  06:53:43 STEP 1638 H=1638:00 +CPU= 32.098
  06:54:02 STEP 1639 H=1639:00 +CPU= 18.292
  06:54:21 STEP 1640 H=1640:00 +CPU= 18.476
  06:54:57 STEP 1641 H=1641:00 +CPU= 33.780
  06:55:23 STEP 1642 H=1642:00 +CPU= 23.832
  06:55:45 STEP 1643 H=1643:00 +CPU= 22.140
  06:56:25 STEP 1644 H=1644:00 +CPU= 36.416
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001644
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001644
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001644
  06:56:48 STEP 1645 H=1645:00 +CPU= 22.619
  06:57:14 STEP 1646 H=1646:00 +CPU= 23.066
  06:57:40 STEP 1647 H=1647:00 +CPU= 25.164
  06:57:55 STEP 1648 H=1648:00 +CPU= 15.316
  06:58:11 STEP 1649 H=1649:00 +CPU= 15.321
  06:58:35 STEP 1650 H=1650:00 +CPU= 23.938
  06:58:52 STEP 1651 H=1651:00 +CPU= 16.009
  06:59:14 STEP 1652 H=1652:00 +CPU= 19.417
  06:59:40 STEP 1653 H=1653:00 +CPU= 25.478
  06:59:55 STEP 1654 H=1654:00 +CPU= 15.028
  07:00:12 STEP 1655 H=1655:00 +CPU= 16.126
  07:00:50 STEP 1656 H=1656:00 +CPU= 34.849
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001656
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001656
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMGGhq0f+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMSHhq0f+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMUAhq0f+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMGGhq0f+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMSHhq0f+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMUAhq0f+001644
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0327_1985050100_123_954_12170971_0_r607902871_68.zip
Uploading the intermediate file: upload_file_68.zip
  07:01:13 STEP 1657 H=1657:00 +CPU= 22.076
  07:01:34 STEP 1658 H=1658:00 +CPU= 19.873
  07:02:02 STEP 1659 H=1659:00 +CPU= 28.457
  07:02:23 STEP 1660 H=1660:00 +CPU= 19.748
  07:02:42 STEP 1661 H=1661:00 +CPU= 19.090
  07:03:14 STEP 1662 H=1662:00 +CPU= 31.527
  07:03:37 STEP 1663 H=1663:00 +CPU= 22.383
  07:04:01 STEP 1664 H=1664:00 +CPU= 23.607
  07:04:38 STEP 1665 H=1665:00 +CPU= 36.555
  07:05:03 STEP 1666 H=1666:00 +CPU= 23.872
  07:05:26 STEP 1667 H=1667:00 +CPU= 22.975
  07:06:02 STEP 1668 H=1668:00 +CPU= 35.315
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001668
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001668
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001668
  07:06:25 STEP 1669 H=1669:00 +CPU= 22.421
  07:06:48 STEP 1670 H=1670:00 +CPU= 22.590
  07:07:14 STEP 1671 H=1671:00 +CPU= 25.336
  07:07:37 STEP 1672 H=1672:00 +CPU= 23.133
  07:07:55 STEP 1673 H=1673:00 +CPU= 17.286
  07:08:20 STEP 1674 H=1674:00 +CPU= 24.516
  07:08:35 STEP 1675 H=1675:00 +CPU= 14.933
  07:08:52 STEP 1676 H=1676:00 +CPU= 15.399
  07:09:17 STEP 1677 H=1677:00 +CPU= 24.599
  07:09:33 STEP 1678 H=1678:00 +CPU= 15.499
  07:09:49 STEP 1679 H=1679:00 +CPU= 15.833
  07:10:17 STEP 1680 H=1680:00 +CPU= 27.582
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001680
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001680
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMGGhq0f+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMSHhq0f+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMUAhq0f+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMGGhq0f+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMSHhq0f+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMUAhq0f+001668
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0327_1985050100_123_954_12170971_0_r607902871_69.zip
Uploading the intermediate file: upload_file_69.zip
  07:10:33 STEP 1681 H=1681:00 +CPU= 14.705
  07:10:49 STEP 1682 H=1682:00 +CPU= 15.702
  07:11:15 STEP 1683 H=1683:00 +CPU= 25.003
  07:11:31 STEP 1684 H=1684:00 +CPU= 15.468
  07:11:45 STEP 1685 H=1685:00 +CPU= 14.508
  07:12:09 STEP 1686 H=1686:00 +CPU= 23.620
  07:12:25 STEP 1687 H=1687:00 +CPU= 15.348
  07:12:40 STEP 1688 H=1688:00 +CPU= 14.873
  07:13:06 STEP 1689 H=1689:00 +CPU= 26.010
  07:13:26 STEP 1690 H=1690:00 +CPU= 19.661
  07:13:45 STEP 1691 H=1691:00 +CPU= 18.047
  07:14:22 STEP 1692 H=1692:00 +CPU= 36.885
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001692
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001692
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001692
  07:14:47 STEP 1693 H=1693:00 +CPU= 24.233
  07:15:12 STEP 1694 H=1694:00 +CPU= 24.878
  07:15:51 STEP 1695 H=1695:00 +CPU= 38.182
  07:16:17 STEP 1696 H=1696:00 +CPU= 25.002
  07:16:41 STEP 1697 H=1697:00 +CPU= 23.906
  07:17:21 STEP 1698 H=1698:00 +CPU= 38.803
  07:17:46 STEP 1699 H=1699:00 +CPU= 24.372
  07:18:12 STEP 1700 H=1700:00 +CPU= 24.731
  07:18:51 STEP 1701 H=1701:00 +CPU= 38.026
  07:19:32 STEP 1702 H=1702:00 +CPU= 29.894
  07:20:44 STEP 1703 H=1703:00 +CPU= 28.776
  07:21:34 STEP 1704 H=1704:00 +CPU= 46.562
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001704
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001704
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMGGhq0f+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMSHhq0f+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMUAhq0f+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMGGhq0f+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMSHhq0f+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMUAhq0f+001692
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0327_1985050100_123_954_12170971_0_r607902871_70.zip
Uploading the intermediate file: upload_file_70.zip
  07:22:01 STEP 1705 H=1705:00 +CPU= 24.859
  07:22:31 STEP 1706 H=1706:00 +CPU= 26.790
  07:23:11 STEP 1707 H=1707:00 +CPU= 38.903
  07:23:37 STEP 1708 H=1708:00 +CPU= 25.016
  07:24:04 STEP 1709 H=1709:00 +CPU= 24.631
  07:24:45 STEP 1710 H=1710:00 +CPU= 39.213
  07:26:06 STEP 1711 H=1711:00 +CPU= 25.373
  07:28:45 STEP 1712 H=1712:00 +CPU= 29.709
  07:29:28 STEP 1713 H=1713:00 +CPU= 40.665
  07:29:55 STEP 1714 H=1714:00 +CPU= 25.723
  07:30:22 STEP 1715 H=1715:00 +CPU= 26.464
  07:31:08 STEP 1716 H=1716:00 +CPU= 43.982
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001716
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001716
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001716
  07:31:33 STEP 1717 H=1717:00 +CPU= 24.304
  07:32:00 STEP 1718 H=1718:00 +CPU= 24.954
  07:32:40 STEP 1719 H=1719:00 +CPU= 39.030
  07:33:05 STEP 1720 H=1720:00 +CPU= 24.869
  07:33:30 STEP 1721 H=1721:00 +CPU= 24.168
  07:34:10 STEP 1722 H=1722:00 +CPU= 38.857
  07:34:34 STEP 1723 H=1723:00 +CPU= 23.978
  07:35:00 STEP 1724 H=1724:00 +CPU= 24.868
  07:35:39 STEP 1725 H=1725:00 +CPU= 37.829
  07:36:05 STEP 1726 H=1726:00 +CPU= 25.394
  07:36:31 STEP 1727 H=1727:00 +CPU= 25.208
  07:37:19 STEP 1728 H=1728:00 +CPU= 46.098
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001728
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001728
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMGGhq0f+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMSHhq0f+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMUAhq0f+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMGGhq0f+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMSHhq0f+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMUAhq0f+001716
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0327_1985050100_123_954_12170971_0_r607902871_71.zip
Uploading the intermediate file: upload_file_71.zip
  07:37:45 STEP 1729 H=1729:00 +CPU= 23.904
  07:38:13 STEP 1730 H=1730:00 +CPU= 26.772
  07:38:52 STEP 1731 H=1731:00 +CPU= 37.990
  07:39:17 STEP 1732 H=1732:00 +CPU= 24.712
  07:39:42 STEP 1733 H=1733:00 +CPU= 24.114
  07:40:23 STEP 1734 H=1734:00 +CPU= 40.151
  07:40:47 STEP 1735 H=1735:00 +CPU= 24.155
  07:41:13 STEP 1736 H=1736:00 +CPU= 25.561
  07:41:52 STEP 1737 H=1737:00 +CPU= 38.254
  07:42:20 STEP 1738 H=1738:00 +CPU= 26.327
  07:42:45 STEP 1739 H=1739:00 +CPU= 24.232
  07:43:28 STEP 1740 H=1740:00 +CPU= 42.283
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001740
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001740
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001740
  07:43:54 STEP 1741 H=1741:00 +CPU= 24.331
  07:45:17 STEP 1742 H=1742:00 +CPU= 26.695
  07:45:56 STEP 1743 H=1743:00 +CPU= 38.333
  07:46:22 STEP 1744 H=1744:00 +CPU= 25.756
  07:46:47 STEP 1745 H=1745:00 +CPU= 24.596
  07:47:28 STEP 1746 H=1746:00 +CPU= 39.907
  07:47:52 STEP 1747 H=1747:00 +CPU= 24.221
  07:48:19 STEP 1748 H=1748:00 +CPU= 26.391
  07:48:59 STEP 1749 H=1749:00 +CPU= 38.478
  07:49:25 STEP 1750 H=1750:00 +CPU= 26.054
  07:49:51 STEP 1751 H=1751:00 +CPU= 25.078
  07:50:41 STEP 1752 H=1752:00 +CPU= 47.377
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001752
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001752
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMGGhq0f+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMSHhq0f+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMUAhq0f+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMGGhq0f+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMSHhq0f+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMUAhq0f+001740
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0327_1985050100_123_954_12170971_0_r607902871_72.zip
Uploading the intermediate file: upload_file_72.zip
  07:51:08 STEP 1753 H=1753:00 +CPU= 25.622
  07:51:36 STEP 1754 H=1754:00 +CPU= 26.728
  07:52:17 STEP 1755 H=1755:00 +CPU= 39.579
  07:52:42 STEP 1756 H=1756:00 +CPU= 25.096
  07:53:12 STEP 1757 H=1757:00 +CPU= 24.072
  07:54:11 STEP 1758 H=1758:00 +CPU= 39.118
  07:54:36 STEP 1759 H=1759:00 +CPU= 24.522
  07:55:32 STEP 1760 H=1760:00 +CPU= 25.766
Quit request received from BOINC client, ending the child process
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1985050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0327
(argv4) batchid: 954
(argv5) wuid: 12170971
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/3
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/3/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/3/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_9112218fe5916c2a3bad5ab4032cf593 to: /var/lib/boinc-client/slots/3/oifs_43r3_ps_0327_1985050100_123_954_12170971.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/3/oifs_43r3_ps_0327_1985050100_123_954_12170971.zip
ic_ancil_file: ic_ancil_12170971
ifsdata_file: ifsdata_12170971
climate_data_file: clim_data_12170971
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_9ab1c3fa8e2b9f49e44da0f19d8759db to: /var/lib/boinc-client/slots/3/ic_ancil_12170971.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/3/ic_ancil_12170971.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_6e760f2ef4a132053374ca744dacabe6 to: /var/lib/boinc-client/slots/3/ifsdata/ifsdata_12170971.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/3/ifsdata/ifsdata_12170971.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/3/159l_2/clim_data_12170971.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/3/159l_2/clim_data_12170971.zip
Checking for progress XML file: /var/lib/boinc-client/slots/3/progress_file_12170971.xml
Opened progress file ok : /var/lib/boinc-client/slots/3/progress_file_12170971.xml
-- Model is restarting --
Adjusting last_iter, 1761, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/3/progress_file_12170971.xml
last_cpu_time: 50807
upload_file_number: 73
last_iter: 1751
last_upload: 6307200
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0327_1985050100_123_954_12170971_0_r607902871
The child process has been launched with process id: 64539
Executing the command: /var/lib/boinc-client/slots/3/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:boinc-qchempedia:1:1:64539:64539] [20221222:075657:1671695817:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:boinc-qchempedia:1:1:64539:64539] [20221222:075657:1671695817:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:boinc-qchempedia:1:1:64539:64539] [20221222:075657:1671695817:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:boinc-qchempedia:1:1:64539:64539] [20221222:075657:1671695817:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:boinc-qchempedia:1:1:64539:64539] [20221222:075657:1671695817:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:boinc-qchempedia:1:1:64539:64539] [20221222:075657:1671695817:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:boinc-qchempedia:1:1:64539:64539] [20221222:075657:1671695817:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:boinc-qchempedia:1:1:64539:64539] [20221222:075657:1671695817:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:boinc-qchempedia:1:1:64539:64539] [20221222:075657:1671695817:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:boinc-qchempedia:1:1:64539:64539] [20221222:075657:1671695817:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:boinc-qchempedia:1:1:64539:64539] [20221222:075657:1671695817:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:boinc-qchempedia:1:1:64539:64539] [20221222:075657:1671695817:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:boinc-qchempedia:1:1:64539:64539] [20221222:075657:1671695817:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:boinc-qchempedia:1:1:64539:64539] [20221222:075657:1671695817:0.001] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:boinc-qchempedia:1:1:64539:64539] [20221222:075657:1671695817:0.001] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:boinc-qchempedia:1:1:64539:64539] [20221222:075657:1671695817:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:boinc-qchempedia:1:1:64539:64539] [20221222:075657:1671695817:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:boinc-qchempedia:1:1:64539:64539] [20221222:075657:1671695817:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:boinc-qchempedia:1:1:64539:64539] [20221222:075657:1671695817:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:boinc-qchempedia:1:1:64539:64539] [20221222:075657:1671695817:0.001] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:boinc-qchempedia:1:1:64539:64539] [20221222:075657:1671695817:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:boinc-qchempedia:1:1:64539:64539] [20221222:075657:1671695817:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:boinc-qchempedia:1:1:64539:64539] [20221222:075657:1671695817:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:boinc-qchempedia:1:1:64539:64539] [20221222:075657:1671695817:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:boinc-qchempedia:1:1:64539:64539] [20221222:075657:1671695817:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:boinc-qchempedia:1:1:64539:64539] [20221222:075657:1671695817:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:boinc-qchempedia:1:1:64539:64539] [20221222:075657:1671695817:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:boinc-qchempedia:1:1:64539:64539] [20221222:075657:1671695817:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:boinc-qchempedia:1:1:64539:64539] [20221222:075657:1671695817:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:boinc-qchempedia:1:1:64539:64539] [20221222:075657:1671695817:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  07:58:12 STEP 1752 H=1752:00 +CPU= 55.323
  07:58:47 STEP 1753 H=1753:00 +CPU= 29.656
  07:59:20 STEP 1754 H=1754:00 +CPU= 30.736
  08:00:14 STEP 1755 H=1755:00 +CPU= 41.326
  08:00:42 STEP 1756 H=1756:00 +CPU= 26.532
  08:01:13 STEP 1757 H=1757:00 +CPU= 29.356
  08:02:00 STEP 1758 H=1758:00 +CPU= 44.342
  08:02:26 STEP 1759 H=1759:00 +CPU= 25.269
  08:03:12 STEP 1760 H=1760:00 +CPU= 28.017
  08:03:56 STEP 1761 H=1761:00 +CPU= 40.461
  08:04:23 STEP 1762 H=1762:00 +CPU= 26.778
  08:04:53 STEP 1763 H=1763:00 +CPU= 26.878
  08:05:40 STEP 1764 H=1764:00 +CPU= 45.102
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001764
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001764
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001764
  08:06:07 STEP 1765 H=1765:00 +CPU= 26.358
  08:06:37 STEP 1766 H=1766:00 +CPU= 28.022
  08:07:18 STEP 1767 H=1767:00 +CPU= 40.070
  08:07:45 STEP 1768 H=1768:00 +CPU= 25.956
  08:08:13 STEP 1769 H=1769:00 +CPU= 26.327
  08:08:54 STEP 1770 H=1770:00 +CPU= 40.766
  08:09:26 STEP 1771 H=1771:00 +CPU= 26.753
  08:09:55 STEP 1772 H=1772:00 +CPU= 27.452
  08:10:38 STEP 1773 H=1773:00 +CPU= 42.047
  08:11:08 STEP 1774 H=1774:00 +CPU= 28.391
  08:11:38 STEP 1775 H=1775:00 +CPU= 27.912
  08:12:38 STEP 1776 H=1776:00 +CPU= 53.930
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001776
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001776
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMGGhq0f+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMSHhq0f+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMUAhq0f+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMGGhq0f+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMSHhq0f+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12170971/ICMUAhq0f+001764
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0327_1985050100_123_954_12170971_0_r607902871_73.zip
Uploading the intermediate file: upload_file_73.zip
  08:13:07 STEP 1777 H=1777:00 +CPU= 27.269
  08:13:37 STEP 1778 H=1778:00 +CPU= 27.699
  08:14:21 STEP 1779 H=1779:00 +CPU= 42.514
  08:14:48 STEP 1780 H=1780:00 +CPU= 26.439
  08:15:16 STEP 1781 H=1781:00 +CPU= 27.305
  08:15:59 STEP 1782 H=1782:00 +CPU= 41.307
  08:16:32 STEP 1783 H=1783:00 +CPU= 25.556
  08:16:59 STEP 1784 H=1784:00 +CPU= 26.375
  08:17:42 STEP 1785 H=1785:00 +CPU= 41.220
  08:18:09 STEP 1786 H=1786:00 +CPU= 26.830
The child process terminated with status: 0
..Failed, model did not complete successfully

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 15:47:27 1534896 22255303 oifs_43r3_ps_0327_1985050100_123_954_12170971_0 5,875,200 47,404 0.0081
09 May 2023 15:47:15 1534896 22255303 oifs_43r3_ps_0327_1985050100_123_954_12170971_0 5,011,200 40,139 0.0080
09 May 2023 15:46:20 1534896 22255303 oifs_43r3_ps_0327_1985050100_123_954_12170971_0 3,974,400 31,924 0.0080
09 May 2023 15:45:55 1534896 22255303 oifs_43r3_ps_0327_1985050100_123_954_12170971_0 2,592,000 20,760 0.0080
09 May 2023 15:45:43 1534896 22255303 oifs_43r3_ps_0327_1985050100_123_954_12170971_0 1,728,000 13,413 0.0078
09 May 2023 15:45:36 1534896 22255303 oifs_43r3_ps_0327_1985050100_123_954_12170971_0 864,000 6,666 0.0077


©2024 climateprediction.net