climateprediction.net home page
Task 22315335

Task 22315335

Name oifs_43r3_00f2_2019110100_123_993_12213980_0
Workunit 12213980
Created 24 Feb 2023, 13:23:35 UTC
Sent 24 Feb 2023, 18:01:49 UTC
Report deadline 25 Apr 2023, 18:01:49 UTC
Received 25 Feb 2023, 5:33:06 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 5 (0x00000005) Unknown error code
Computer ID 1507462
Run time 11 hours 25 min
CPU time 11 hours 24 min 24 sec
Validate state Invalid
Credit 9,676.80
Device peak FLOPS 4.30 GFLOPS
Application version OpenIFS 43r3 v1.21
x86_64-pc-linux-gnu
Peak working set size 4,422.82 MB
Peak swap size 4,983.13 MB
Peak disk usage 1,308.70 MB
Stderr
<core_client_version>7.9.3</core_client_version>
<![CDATA[
<message>
process exited with code 5 (0x5, -251)</message>
<stderr_txt>
32
  01:49:33 STEP 1380 H=1380:00 +CPU= 27.329
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001380
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001380
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001380
  01:49:49 STEP 1381 H=1381:00 +CPU= 15.856
  01:50:05 STEP 1382 H=1382:00 +CPU= 16.376
  01:50:31 STEP 1383 H=1383:00 +CPU= 25.229
  01:50:47 STEP 1384 H=1384:00 +CPU= 16.314
  01:51:03 STEP 1385 H=1385:00 +CPU= 15.826
  01:51:28 STEP 1386 H=1386:00 +CPU= 25.665
  01:51:44 STEP 1387 H=1387:00 +CPU= 15.753
  01:52:00 STEP 1388 H=1388:00 +CPU= 16.242
  01:52:26 STEP 1389 H=1389:00 +CPU= 25.172
  01:52:42 STEP 1390 H=1390:00 +CPU= 16.250
  01:52:58 STEP 1391 H=1391:00 +CPU= 16.267
  01:53:27 STEP 1392 H=1392:00 +CPU= 28.993
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001392
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001392
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001380
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00f2_2019110100_123_993_12213980_0_r969406420_57.zip
Uploading the intermediate file: upload_file_57.zip
  01:53:43 STEP 1393 H=1393:00 +CPU= 16.145
  01:54:00 STEP 1394 H=1394:00 +CPU= 16.345
  01:54:25 STEP 1395 H=1395:00 +CPU= 25.204
  01:54:41 STEP 1396 H=1396:00 +CPU= 16.341
  01:54:57 STEP 1397 H=1397:00 +CPU= 15.821
  01:55:23 STEP 1398 H=1398:00 +CPU= 25.764
  01:55:39 STEP 1399 H=1399:00 +CPU= 15.879
  01:55:55 STEP 1400 H=1400:00 +CPU= 16.341
  01:56:20 STEP 1401 H=1401:00 +CPU= 25.133
  01:56:37 STEP 1402 H=1402:00 +CPU= 16.369
  01:56:52 STEP 1403 H=1403:00 +CPU= 15.859
  01:57:20 STEP 1404 H=1404:00 +CPU= 27.427
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001404
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001404
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001404
  01:57:36 STEP 1405 H=1405:00 +CPU= 15.879
  01:57:52 STEP 1406 H=1406:00 +CPU= 16.298
  01:58:17 STEP 1407 H=1407:00 +CPU= 25.197
  01:58:33 STEP 1408 H=1408:00 +CPU= 16.248
  01:58:49 STEP 1409 H=1409:00 +CPU= 15.867
  01:59:15 STEP 1410 H=1410:00 +CPU= 25.688
  01:59:31 STEP 1411 H=1411:00 +CPU= 15.821
  01:59:47 STEP 1412 H=1412:00 +CPU= 16.353
  02:00:12 STEP 1413 H=1413:00 +CPU= 25.185
  02:00:29 STEP 1414 H=1414:00 +CPU= 16.279
  02:00:45 STEP 1415 H=1415:00 +CPU= 16.231
  02:01:14 STEP 1416 H=1416:00 +CPU= 29.272
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001416
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001416
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001404
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00f2_2019110100_123_993_12213980_0_r969406420_58.zip
Uploading the intermediate file: upload_file_58.zip
  02:01:30 STEP 1417 H=1417:00 +CPU= 16.206
  02:01:47 STEP 1418 H=1418:00 +CPU= 16.260
  02:02:12 STEP 1419 H=1419:00 +CPU= 25.105
  02:02:28 STEP 1420 H=1420:00 +CPU= 16.317
  02:02:44 STEP 1421 H=1421:00 +CPU= 15.827
  02:03:10 STEP 1422 H=1422:00 +CPU= 25.625
  02:03:25 STEP 1423 H=1423:00 +CPU= 15.801
  02:03:42 STEP 1424 H=1424:00 +CPU= 16.268
  02:04:07 STEP 1425 H=1425:00 +CPU= 25.158
  02:04:23 STEP 1426 H=1426:00 +CPU= 16.272
  02:04:39 STEP 1427 H=1427:00 +CPU= 15.728
  02:05:06 STEP 1428 H=1428:00 +CPU= 27.335
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001428
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001428
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001428
  02:05:22 STEP 1429 H=1429:00 +CPU= 15.861
  02:05:38 STEP 1430 H=1430:00 +CPU= 16.256
  02:06:03 STEP 1431 H=1431:00 +CPU= 25.119
  02:06:20 STEP 1432 H=1432:00 +CPU= 16.270
  02:06:36 STEP 1433 H=1433:00 +CPU= 15.861
  02:07:01 STEP 1434 H=1434:00 +CPU= 25.682
  02:07:17 STEP 1435 H=1435:00 +CPU= 15.795
  02:07:33 STEP 1436 H=1436:00 +CPU= 16.295
  02:07:58 STEP 1437 H=1437:00 +CPU= 25.198
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=            4  MAX ETADOT VERTICAL VEL.=   1.543440627648261E-007
  LON  =    67.5000000000000       degrees
  LAT  =    42.0558239509352       degrees
  02:08:15 STEP 1438 H=1438:00 +CPU= 16.233
  02:08:31 STEP 1439 H=1439:00 +CPU= 16.163
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=            5  MAX ETADOT VERTICAL VEL.=   1.824306899272846E-007
  LON  =    66.0937500000000       degrees
  LAT  =    43.1773092288349       degrees
  02:09:00 STEP 1440 H=1440:00 +CPU= 29.001
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001440
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001440
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001428
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00f2_2019110100_123_993_12213980_0_r969406420_59.zip
Uploading the intermediate file: upload_file_59.zip
  02:09:16 STEP 1441 H=1441:00 +CPU= 15.936
Uploading trickle at timestep: 5184000
  02:09:32 STEP 1442 H=1442:00 +CPU= 16.174
  02:09:58 STEP 1443 H=1443:00 +CPU= 25.798
  02:10:19 STEP 1444 H=1444:00 +CPU= 17.188
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=            8  MAX ETADOT VERTICAL VEL.=   3.524404927626543E-007
  LON  =    61.8750000000000       degrees
  LAT  =    45.4202786265483       degrees
  02:10:35 STEP 1445 H=1445:00 +CPU= 16.734
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=            8  MAX ETADOT VERTICAL VEL.=   1.610713405927745E-006
  LON  =    61.8750000000000       degrees
  LAT  =    45.4202786265483       degrees
  02:11:03 STEP 1446 H=1446:00 +CPU= 27.208
  02:11:19 STEP 1447 H=1447:00 +CPU= 16.549
  02:11:36 STEP 1448 H=1448:00 +CPU= 17.196
  02:12:03 STEP 1449 H=1449:00 +CPU= 26.608
  02:12:20 STEP 1450 H=1450:00 +CPU= 17.031
  02:12:37 STEP 1451 H=1451:00 +CPU= 16.741
  02:13:06 STEP 1452 H=1452:00 +CPU= 28.752
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001452
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001452
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001452
  02:13:22 STEP 1453 H=1453:00 +CPU= 16.491
  02:13:39 STEP 1454 H=1454:00 +CPU= 17.322
  02:14:06 STEP 1455 H=1455:00 +CPU= 26.596
  02:14:23 STEP 1456 H=1456:00 +CPU= 17.092
  02:14:40 STEP 1457 H=1457:00 +CPU= 16.561
  02:15:07 STEP 1458 H=1458:00 +CPU= 26.954
  02:15:23 STEP 1459 H=1459:00 +CPU= 16.424
  02:15:40 STEP 1460 H=1460:00 +CPU= 17.043
  02:16:06 STEP 1461 H=1461:00 +CPU= 26.394
  02:16:23 STEP 1462 H=1462:00 +CPU= 16.839
  02:16:40 STEP 1463 H=1463:00 +CPU= 16.989
  02:17:11 STEP 1464 H=1464:00 +CPU= 30.516
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001464
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001464
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001452
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001452
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001452
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00f2_2019110100_123_993_12213980_0_r969406420_60.zip
Uploading the intermediate file: upload_file_60.zip
  02:17:27 STEP 1465 H=1465:00 +CPU= 16.549
  02:17:44 STEP 1466 H=1466:00 +CPU= 17.016
  02:18:11 STEP 1467 H=1467:00 +CPU= 26.418
  02:18:28 STEP 1468 H=1468:00 +CPU= 17.213
  02:18:45 STEP 1469 H=1469:00 +CPU= 16.988
  02:19:12 STEP 1470 H=1470:00 +CPU= 27.087
  02:19:29 STEP 1471 H=1471:00 +CPU= 16.570
  02:19:46 STEP 1472 H=1472:00 +CPU= 17.226
  02:20:13 STEP 1473 H=1473:00 +CPU= 26.647
  02:20:30 STEP 1474 H=1474:00 +CPU= 17.004
  02:20:46 STEP 1475 H=1475:00 +CPU= 16.734
  02:21:15 STEP 1476 H=1476:00 +CPU= 28.993
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001476
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001476
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001476
  02:21:32 STEP 1477 H=1477:00 +CPU= 16.598
  02:21:49 STEP 1478 H=1478:00 +CPU= 17.330
  02:22:16 STEP 1479 H=1479:00 +CPU= 26.727
  02:22:33 STEP 1480 H=1480:00 +CPU= 17.083
  02:22:50 STEP 1481 H=1481:00 +CPU= 16.743
  02:23:17 STEP 1482 H=1482:00 +CPU= 27.123
  02:23:34 STEP 1483 H=1483:00 +CPU= 16.550
  02:23:51 STEP 1484 H=1484:00 +CPU= 17.177
  02:24:17 STEP 1485 H=1485:00 +CPU= 26.674
  02:24:34 STEP 1486 H=1486:00 +CPU= 17.053
  02:24:52 STEP 1487 H=1487:00 +CPU= 17.260
  02:25:23 STEP 1488 H=1488:00 +CPU= 30.645
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001488
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001488
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001464
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001476
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001476
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00f2_2019110100_123_993_12213980_0_r969406420_61.zip
Uploading the intermediate file: upload_file_61.zip
  02:25:40 STEP 1489 H=1489:00 +CPU= 16.620
  02:25:57 STEP 1490 H=1490:00 +CPU= 17.213
  02:26:24 STEP 1491 H=1491:00 +CPU= 26.674
  02:26:41 STEP 1492 H=1492:00 +CPU= 16.909
  02:26:58 STEP 1493 H=1493:00 +CPU= 16.726
  02:27:25 STEP 1494 H=1494:00 +CPU= 26.977
  02:27:41 STEP 1495 H=1495:00 +CPU= 16.484
  02:27:58 STEP 1496 H=1496:00 +CPU= 17.305
  02:28:25 STEP 1497 H=1497:00 +CPU= 26.534
  02:28:42 STEP 1498 H=1498:00 +CPU= 16.962
  02:28:59 STEP 1499 H=1499:00 +CPU= 16.824
  02:29:28 STEP 1500 H=1500:00 +CPU= 28.856
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001500
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001500
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001500
  02:29:44 STEP 1501 H=1501:00 +CPU= 16.555
  02:30:01 STEP 1502 H=1502:00 +CPU= 17.094
  02:30:28 STEP 1503 H=1503:00 +CPU= 26.487
  02:30:45 STEP 1504 H=1504:00 +CPU= 16.957
  02:31:01 STEP 1505 H=1505:00 +CPU= 16.690
  02:31:28 STEP 1506 H=1506:00 +CPU= 26.972
  02:31:45 STEP 1507 H=1507:00 +CPU= 16.608
  02:32:02 STEP 1508 H=1508:00 +CPU= 17.268
  02:32:29 STEP 1509 H=1509:00 +CPU= 26.338
  02:32:45 STEP 1510 H=1510:00 +CPU= 16.859
  02:33:03 STEP 1511 H=1511:00 +CPU= 17.048
  02:33:33 STEP 1512 H=1512:00 +CPU= 30.411
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001512
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001512
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001488
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001500
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001500
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001500
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00f2_2019110100_123_993_12213980_0_r969406420_62.zip
Uploading the intermediate file: upload_file_62.zip
  02:33:50 STEP 1513 H=1513:00 +CPU= 16.404
  02:34:07 STEP 1514 H=1514:00 +CPU= 17.173
  02:34:34 STEP 1515 H=1515:00 +CPU= 26.602
  02:34:51 STEP 1516 H=1516:00 +CPU= 17.195
  02:35:08 STEP 1517 H=1517:00 +CPU= 17.034
  02:35:35 STEP 1518 H=1518:00 +CPU= 27.044
  02:35:51 STEP 1519 H=1519:00 +CPU= 16.561
  02:36:09 STEP 1520 H=1520:00 +CPU= 17.142
  02:36:35 STEP 1521 H=1521:00 +CPU= 26.322
  02:36:52 STEP 1522 H=1522:00 +CPU= 16.912
  02:37:09 STEP 1523 H=1523:00 +CPU= 16.790
  02:37:37 STEP 1524 H=1524:00 +CPU= 28.657
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001524
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001524
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001524
  02:37:54 STEP 1525 H=1525:00 +CPU= 16.502
  02:38:11 STEP 1526 H=1526:00 +CPU= 17.035
  02:38:37 STEP 1527 H=1527:00 +CPU= 26.428
  02:38:54 STEP 1528 H=1528:00 +CPU= 17.049
  02:39:11 STEP 1529 H=1529:00 +CPU= 16.814
  02:39:38 STEP 1530 H=1530:00 +CPU= 26.961
  02:39:55 STEP 1531 H=1531:00 +CPU= 16.569
  02:40:12 STEP 1532 H=1532:00 +CPU= 17.216
  02:40:38 STEP 1533 H=1533:00 +CPU= 26.471
  02:40:55 STEP 1534 H=1534:00 +CPU= 17.076
  02:41:13 STEP 1535 H=1535:00 +CPU= 17.293
  02:41:44 STEP 1536 H=1536:00 +CPU= 30.599
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001536
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001536
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001512
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001524
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001524
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001524
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00f2_2019110100_123_993_12213980_0_r969406420_63.zip
Uploading the intermediate file: upload_file_63.zip
  02:42:00 STEP 1537 H=1537:00 +CPU= 16.657
  02:42:18 STEP 1538 H=1538:00 +CPU= 17.174
  02:42:44 STEP 1539 H=1539:00 +CPU= 26.540
  02:43:01 STEP 1540 H=1540:00 +CPU= 16.840
  02:43:18 STEP 1541 H=1541:00 +CPU= 16.927
  02:43:45 STEP 1542 H=1542:00 +CPU= 26.971
  02:44:01 STEP 1543 H=1543:00 +CPU= 16.418
  02:44:19 STEP 1544 H=1544:00 +CPU= 17.321
  02:44:45 STEP 1545 H=1545:00 +CPU= 26.561
  02:45:02 STEP 1546 H=1546:00 +CPU= 16.863
  02:45:19 STEP 1547 H=1547:00 +CPU= 16.825
  02:45:48 STEP 1548 H=1548:00 +CPU= 28.918
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001548
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001548
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001548
  02:46:05 STEP 1549 H=1549:00 +CPU= 16.588
  02:46:22 STEP 1550 H=1550:00 +CPU= 17.165
  02:46:48 STEP 1551 H=1551:00 +CPU= 26.531
  02:47:05 STEP 1552 H=1552:00 +CPU= 17.075
  02:47:22 STEP 1553 H=1553:00 +CPU= 16.860
  02:47:49 STEP 1554 H=1554:00 +CPU= 27.148
  02:48:06 STEP 1555 H=1555:00 +CPU= 16.644
  02:48:23 STEP 1556 H=1556:00 +CPU= 17.366
  02:48:50 STEP 1557 H=1557:00 +CPU= 26.625
  02:49:07 STEP 1558 H=1558:00 +CPU= 17.119
  02:49:24 STEP 1559 H=1559:00 +CPU= 17.173
  02:49:56 STEP 1560 H=1560:00 +CPU= 30.219
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001560
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001560
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001536
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001548
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00f2_2019110100_123_993_12213980_0_r969406420_64.zip
Uploading the intermediate file: upload_file_64.zip
  02:50:12 STEP 1561 H=1561:00 +CPU= 16.614
  02:50:29 STEP 1562 H=1562:00 +CPU= 17.204
  02:50:56 STEP 1563 H=1563:00 +CPU= 26.546
  02:51:13 STEP 1564 H=1564:00 +CPU= 17.083
  02:51:30 STEP 1565 H=1565:00 +CPU= 16.764
  02:51:57 STEP 1566 H=1566:00 +CPU= 27.215
  02:52:14 STEP 1567 H=1567:00 +CPU= 16.657
  02:52:31 STEP 1568 H=1568:00 +CPU= 17.205
  02:52:58 STEP 1569 H=1569:00 +CPU= 26.528
  02:53:15 STEP 1570 H=1570:00 +CPU= 17.144
  02:53:31 STEP 1571 H=1571:00 +CPU= 16.694
  02:54:00 STEP 1572 H=1572:00 +CPU= 28.714
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001572
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001572
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001572
  02:54:17 STEP 1573 H=1573:00 +CPU= 16.677
  02:54:34 STEP 1574 H=1574:00 +CPU= 17.219
  02:55:00 STEP 1575 H=1575:00 +CPU= 26.445
  02:55:18 STEP 1576 H=1576:00 +CPU= 17.129
  02:55:34 STEP 1577 H=1577:00 +CPU= 16.683
  02:56:01 STEP 1578 H=1578:00 +CPU= 27.102
  02:56:18 STEP 1579 H=1579:00 +CPU= 16.640
  02:56:35 STEP 1580 H=1580:00 +CPU= 17.090
  02:57:01 STEP 1581 H=1581:00 +CPU= 26.327
  02:57:18 STEP 1582 H=1582:00 +CPU= 17.043
  02:57:36 STEP 1583 H=1583:00 +CPU= 17.094
  02:58:07 STEP 1584 H=1584:00 +CPU= 30.461
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001584
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001584
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001572
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00f2_2019110100_123_993_12213980_0_r969406420_65.zip
Uploading the intermediate file: upload_file_65.zip
  02:58:23 STEP 1585 H=1585:00 +CPU= 16.702
  02:58:41 STEP 1586 H=1586:00 +CPU= 17.172
  02:59:07 STEP 1587 H=1587:00 +CPU= 26.697
  02:59:25 STEP 1588 H=1588:00 +CPU= 17.523
  02:59:42 STEP 1589 H=1589:00 +CPU= 16.654
  03:00:08 STEP 1590 H=1590:00 +CPU= 26.689
  03:00:25 STEP 1591 H=1591:00 +CPU= 16.551
  03:00:42 STEP 1592 H=1592:00 +CPU= 16.848
  03:01:08 STEP 1593 H=1593:00 +CPU= 26.240
  03:01:25 STEP 1594 H=1594:00 +CPU= 17.076
  03:01:42 STEP 1595 H=1595:00 +CPU= 16.568
  03:02:10 STEP 1596 H=1596:00 +CPU= 28.549
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001596
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001596
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001596
  03:02:27 STEP 1597 H=1597:00 +CPU= 16.547
  03:02:44 STEP 1598 H=1598:00 +CPU= 16.998
  03:03:10 STEP 1599 H=1599:00 +CPU= 26.122
  03:03:27 STEP 1600 H=1600:00 +CPU= 17.044
  03:03:44 STEP 1601 H=1601:00 +CPU= 16.698
  03:04:10 STEP 1602 H=1602:00 +CPU= 26.767
  03:04:27 STEP 1603 H=1603:00 +CPU= 16.612
  03:04:44 STEP 1604 H=1604:00 +CPU= 17.017
  03:05:10 STEP 1605 H=1605:00 +CPU= 26.330
  03:05:28 STEP 1606 H=1606:00 +CPU= 17.282
  03:05:45 STEP 1607 H=1607:00 +CPU= 17.460
  03:06:17 STEP 1608 H=1608:00 +CPU= 30.422
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001608
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001608
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001596
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00f2_2019110100_123_993_12213980_0_r969406420_66.zip
Uploading the intermediate file: upload_file_66.zip
  03:06:34 STEP 1609 H=1609:00 +CPU= 16.916
  03:06:51 STEP 1610 H=1610:00 +CPU= 17.354
  03:07:18 STEP 1611 H=1611:00 +CPU= 26.865
  03:07:35 STEP 1612 H=1612:00 +CPU= 17.285
  03:07:52 STEP 1613 H=1613:00 +CPU= 16.789
  03:08:19 STEP 1614 H=1614:00 +CPU= 26.994
  03:08:36 STEP 1615 H=1615:00 +CPU= 16.923
  03:08:53 STEP 1616 H=1616:00 +CPU= 17.260
  03:09:20 STEP 1617 H=1617:00 +CPU= 26.483
  03:09:37 STEP 1618 H=1618:00 +CPU= 17.296
  03:09:54 STEP 1619 H=1619:00 +CPU= 16.760
  03:10:23 STEP 1620 H=1620:00 +CPU= 28.937
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001620
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001620
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001620
  03:10:39 STEP 1621 H=1621:00 +CPU= 16.732
  03:10:56 STEP 1622 H=1622:00 +CPU= 17.054
  03:11:23 STEP 1623 H=1623:00 +CPU= 26.555
  03:11:40 STEP 1624 H=1624:00 +CPU= 17.322
  03:11:57 STEP 1625 H=1625:00 +CPU= 16.927
  03:12:24 STEP 1626 H=1626:00 +CPU= 27.049
  03:12:41 STEP 1627 H=1627:00 +CPU= 16.916
  03:12:59 STEP 1628 H=1628:00 +CPU= 17.404
  03:13:25 STEP 1629 H=1629:00 +CPU= 26.546
  03:13:43 STEP 1630 H=1630:00 +CPU= 17.427
  03:14:00 STEP 1631 H=1631:00 +CPU= 17.454
  03:14:32 STEP 1632 H=1632:00 +CPU= 30.505
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001632
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001632
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001620
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00f2_2019110100_123_993_12213980_0_r969406420_67.zip
Uploading the intermediate file: upload_file_67.zip
  03:14:49 STEP 1633 H=1633:00 +CPU= 16.895
  03:15:06 STEP 1634 H=1634:00 +CPU= 17.323
  03:15:33 STEP 1635 H=1635:00 +CPU= 26.811
  03:15:50 STEP 1636 H=1636:00 +CPU= 17.592
  03:16:07 STEP 1637 H=1637:00 +CPU= 16.821
  03:16:35 STEP 1638 H=1638:00 +CPU= 27.332
  03:16:51 STEP 1639 H=1639:00 +CPU= 16.950
  03:17:09 STEP 1640 H=1640:00 +CPU= 17.140
  03:17:35 STEP 1641 H=1641:00 +CPU= 26.403
  03:17:52 STEP 1642 H=1642:00 +CPU= 17.039
  03:18:09 STEP 1643 H=1643:00 +CPU= 16.791
  03:18:38 STEP 1644 H=1644:00 +CPU= 28.693
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001644
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001644
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001644
  03:18:54 STEP 1645 H=1645:00 +CPU= 16.808
  03:19:12 STEP 1646 H=1646:00 +CPU= 17.153
  03:19:38 STEP 1647 H=1647:00 +CPU= 26.505
  03:19:55 STEP 1648 H=1648:00 +CPU= 16.950
  03:20:12 STEP 1649 H=1649:00 +CPU= 16.647
  03:20:39 STEP 1650 H=1650:00 +CPU= 27.139
  03:20:55 STEP 1651 H=1651:00 +CPU= 16.548
  03:21:13 STEP 1652 H=1652:00 +CPU= 17.280
  03:21:39 STEP 1653 H=1653:00 +CPU= 26.687
  03:21:56 STEP 1654 H=1654:00 +CPU= 17.057
  03:22:14 STEP 1655 H=1655:00 +CPU= 17.290
  03:22:45 STEP 1656 H=1656:00 +CPU= 30.688
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001656
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001656
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001644
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00f2_2019110100_123_993_12213980_0_r969406420_68.zip
Uploading the intermediate file: upload_file_68.zip
  03:23:02 STEP 1657 H=1657:00 +CPU= 16.704
  03:23:19 STEP 1658 H=1658:00 +CPU= 17.182
  03:23:46 STEP 1659 H=1659:00 +CPU= 26.954
  03:24:03 STEP 1660 H=1660:00 +CPU= 17.273
  03:24:20 STEP 1661 H=1661:00 +CPU= 16.963
  03:24:47 STEP 1662 H=1662:00 +CPU= 27.282
  03:25:04 STEP 1663 H=1663:00 +CPU= 16.601
  03:25:21 STEP 1664 H=1664:00 +CPU= 17.427
  03:25:48 STEP 1665 H=1665:00 +CPU= 26.977
  03:26:06 STEP 1666 H=1666:00 +CPU= 17.372
  03:26:23 STEP 1667 H=1667:00 +CPU= 17.083
  03:26:52 STEP 1668 H=1668:00 +CPU= 29.312
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001668
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001668
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001668
  03:27:09 STEP 1669 H=1669:00 +CPU= 16.867
  03:27:26 STEP 1670 H=1670:00 +CPU= 17.386
  03:27:53 STEP 1671 H=1671:00 +CPU= 26.990
  03:28:11 STEP 1672 H=1672:00 +CPU= 17.281
  03:28:28 STEP 1673 H=1673:00 +CPU= 17.029
  03:28:55 STEP 1674 H=1674:00 +CPU= 27.546
  03:29:12 STEP 1675 H=1675:00 +CPU= 16.879
  03:29:29 STEP 1676 H=1676:00 +CPU= 17.377
  03:29:56 STEP 1677 H=1677:00 +CPU= 26.976
  03:30:14 STEP 1678 H=1678:00 +CPU= 17.267
  03:30:31 STEP 1679 H=1679:00 +CPU= 17.343
  03:31:02 STEP 1680 H=1680:00 +CPU= 30.712
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001680
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001680
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001668
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00f2_2019110100_123_993_12213980_0_r969406420_69.zip
Uploading the intermediate file: upload_file_69.zip
  03:31:19 STEP 1681 H=1681:00 +CPU= 16.944
Uploading trickle at timestep: 6048000
  03:31:36 STEP 1682 H=1682:00 +CPU= 17.083
  03:32:03 STEP 1683 H=1683:00 +CPU= 26.929
  03:32:20 STEP 1684 H=1684:00 +CPU= 17.025
  03:32:37 STEP 1685 H=1685:00 +CPU= 16.780
  03:33:05 STEP 1686 H=1686:00 +CPU= 27.377
  03:33:21 STEP 1687 H=1687:00 +CPU= 16.717
  03:33:39 STEP 1688 H=1688:00 +CPU= 17.387
  03:34:05 STEP 1689 H=1689:00 +CPU= 26.809
  03:34:23 STEP 1690 H=1690:00 +CPU= 17.173
  03:34:39 STEP 1691 H=1691:00 +CPU= 16.881
  03:35:09 STEP 1692 H=1692:00 +CPU= 29.025
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001692
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001692
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001692
  03:35:25 STEP 1693 H=1693:00 +CPU= 16.923
  03:35:43 STEP 1694 H=1694:00 +CPU= 17.389
  03:36:10 STEP 1695 H=1695:00 +CPU= 26.714
  03:36:27 STEP 1696 H=1696:00 +CPU= 17.321
  03:36:44 STEP 1697 H=1697:00 +CPU= 16.969
  03:37:11 STEP 1698 H=1698:00 +CPU= 27.301
  03:37:28 STEP 1699 H=1699:00 +CPU= 16.882
  03:37:45 STEP 1700 H=1700:00 +CPU= 17.415
  03:38:12 STEP 1701 H=1701:00 +CPU= 26.715
  03:38:30 STEP 1702 H=1702:00 +CPU= 17.388
  03:38:47 STEP 1703 H=1703:00 +CPU= 17.421
  03:39:18 STEP 1704 H=1704:00 +CPU= 30.770
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001704
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001704
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001692
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00f2_2019110100_123_993_12213980_0_r969406420_70.zip
Uploading the intermediate file: upload_file_70.zip
  03:39:35 STEP 1705 H=1705:00 +CPU= 16.691
  03:39:52 STEP 1706 H=1706:00 +CPU= 17.168
  03:40:19 STEP 1707 H=1707:00 +CPU= 26.631
  03:40:36 STEP 1708 H=1708:00 +CPU= 16.940
  03:40:52 STEP 1709 H=1709:00 +CPU= 16.965
  03:41:20 STEP 1710 H=1710:00 +CPU= 27.180
  03:41:36 STEP 1711 H=1711:00 +CPU= 16.717
  03:41:54 STEP 1712 H=1712:00 +CPU= 17.311
  03:42:20 STEP 1713 H=1713:00 +CPU= 26.685
  03:42:38 STEP 1714 H=1714:00 +CPU= 17.309
  03:42:55 STEP 1715 H=1715:00 +CPU= 16.836
  03:43:24 STEP 1716 H=1716:00 +CPU= 29.048
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001716
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001716
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001716
  03:43:41 STEP 1717 H=1717:00 +CPU= 16.963
  03:43:58 STEP 1718 H=1718:00 +CPU= 17.466
  03:44:25 STEP 1719 H=1719:00 +CPU= 26.801
  03:44:42 STEP 1720 H=1720:00 +CPU= 17.308
  03:44:59 STEP 1721 H=1721:00 +CPU= 16.673
  03:45:26 STEP 1722 H=1722:00 +CPU= 27.269
  03:45:43 STEP 1723 H=1723:00 +CPU= 16.785
  03:46:00 STEP 1724 H=1724:00 +CPU= 17.353
  03:46:27 STEP 1725 H=1725:00 +CPU= 26.358
  03:46:44 STEP 1726 H=1726:00 +CPU= 17.292
  03:47:01 STEP 1727 H=1727:00 +CPU= 17.308
  03:47:33 STEP 1728 H=1728:00 +CPU= 30.706
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001728
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001728
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001716
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00f2_2019110100_123_993_12213980_0_r969406420_71.zip
Uploading the intermediate file: upload_file_71.zip
  03:47:49 STEP 1729 H=1729:00 +CPU= 16.787
  03:48:07 STEP 1730 H=1730:00 +CPU= 17.322
  03:48:33 STEP 1731 H=1731:00 +CPU= 26.617
  03:48:51 STEP 1732 H=1732:00 +CPU= 17.296
  03:49:07 STEP 1733 H=1733:00 +CPU= 16.868
  03:49:35 STEP 1734 H=1734:00 +CPU= 27.314
  03:49:52 STEP 1735 H=1735:00 +CPU= 16.917
  03:50:09 STEP 1736 H=1736:00 +CPU= 17.328
  03:50:36 STEP 1737 H=1737:00 +CPU= 26.711
  03:50:53 STEP 1738 H=1738:00 +CPU= 17.307
  03:51:10 STEP 1739 H=1739:00 +CPU= 16.914
  03:51:39 STEP 1740 H=1740:00 +CPU= 28.796
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001740
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001740
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001740
  03:51:56 STEP 1741 H=1741:00 +CPU= 16.956
  03:52:13 STEP 1742 H=1742:00 +CPU= 17.383
  03:52:40 STEP 1743 H=1743:00 +CPU= 26.647
  03:52:57 STEP 1744 H=1744:00 +CPU= 17.378
  03:53:14 STEP 1745 H=1745:00 +CPU= 16.938
  03:53:41 STEP 1746 H=1746:00 +CPU= 27.248
  03:53:58 STEP 1747 H=1747:00 +CPU= 16.890
  03:54:16 STEP 1748 H=1748:00 +CPU= 17.432
  03:54:42 STEP 1749 H=1749:00 +CPU= 26.686
  03:55:00 STEP 1750 H=1750:00 +CPU= 17.344
  03:55:17 STEP 1751 H=1751:00 +CPU= 17.364
  03:55:48 STEP 1752 H=1752:00 +CPU= 30.615
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001752
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001752
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001740
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00f2_2019110100_123_993_12213980_0_r969406420_72.zip
Uploading the intermediate file: upload_file_72.zip
  03:56:05 STEP 1753 H=1753:00 +CPU= 17.142
  03:56:22 STEP 1754 H=1754:00 +CPU= 17.278
  03:56:49 STEP 1755 H=1755:00 +CPU= 26.843
  03:57:07 STEP 1756 H=1756:00 +CPU= 17.248
  03:57:24 STEP 1757 H=1757:00 +CPU= 16.956
  03:57:51 STEP 1758 H=1758:00 +CPU= 27.042
  03:58:07 STEP 1759 H=1759:00 +CPU= 16.772
  03:58:25 STEP 1760 H=1760:00 +CPU= 17.380
  03:58:51 STEP 1761 H=1761:00 +CPU= 26.435
  03:59:09 STEP 1762 H=1762:00 +CPU= 17.348
  03:59:25 STEP 1763 H=1763:00 +CPU= 16.951
  03:59:54 STEP 1764 H=1764:00 +CPU= 28.693
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001764
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001764
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001764
  04:00:11 STEP 1765 H=1765:00 +CPU= 16.871
  04:00:28 STEP 1766 H=1766:00 +CPU= 17.194
  04:00:55 STEP 1767 H=1767:00 +CPU= 26.377
  04:01:12 STEP 1768 H=1768:00 +CPU= 17.282
  04:01:29 STEP 1769 H=1769:00 +CPU= 16.852
  04:01:56 STEP 1770 H=1770:00 +CPU= 27.159
  04:02:13 STEP 1771 H=1771:00 +CPU= 16.785
  04:02:30 STEP 1772 H=1772:00 +CPU= 17.387
  04:02:57 STEP 1773 H=1773:00 +CPU= 26.686
  04:03:14 STEP 1774 H=1774:00 +CPU= 17.132
  04:03:31 STEP 1775 H=1775:00 +CPU= 17.223
  04:04:03 STEP 1776 H=1776:00 +CPU= 30.608
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001776
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001776
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001764
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00f2_2019110100_123_993_12213980_0_r969406420_73.zip
Uploading the intermediate file: upload_file_73.zip
  04:04:20 STEP 1777 H=1777:00 +CPU= 16.904
  04:04:37 STEP 1778 H=1778:00 +CPU= 17.391
  04:05:04 STEP 1779 H=1779:00 +CPU= 26.907
  04:05:21 STEP 1780 H=1780:00 +CPU= 17.205
  04:05:38 STEP 1781 H=1781:00 +CPU= 16.900
  04:06:06 STEP 1782 H=1782:00 +CPU= 27.384
  04:06:22 STEP 1783 H=1783:00 +CPU= 16.726
  04:06:39 STEP 1784 H=1784:00 +CPU= 17.270
  04:07:06 STEP 1785 H=1785:00 +CPU= 26.652
  04:07:23 STEP 1786 H=1786:00 +CPU= 17.226
  04:07:40 STEP 1787 H=1787:00 +CPU= 16.807
  04:08:09 STEP 1788 H=1788:00 +CPU= 28.994
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001788
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001788
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001788
  04:08:26 STEP 1789 H=1789:00 +CPU= 16.694
  04:08:43 STEP 1790 H=1790:00 +CPU= 17.124
  04:09:09 STEP 1791 H=1791:00 +CPU= 26.468
  04:09:27 STEP 1792 H=1792:00 +CPU= 17.244
  04:09:44 STEP 1793 H=1793:00 +CPU= 16.760
  04:10:11 STEP 1794 H=1794:00 +CPU= 27.103
  04:10:27 STEP 1795 H=1795:00 +CPU= 16.748
  04:10:45 STEP 1796 H=1796:00 +CPU= 17.213
  04:11:11 STEP 1797 H=1797:00 +CPU= 26.595
  04:11:28 STEP 1798 H=1798:00 +CPU= 17.227
  04:11:46 STEP 1799 H=1799:00 +CPU= 17.215
  04:12:16 STEP 1800 H=1800:00 +CPU= 30.632
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001800
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001800
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001788
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00f2_2019110100_123_993_12213980_0_r969406420_74.zip
Uploading the intermediate file: upload_file_74.zip
  04:12:33 STEP 1801 H=1801:00 +CPU= 17.121
  04:12:51 STEP 1802 H=1802:00 +CPU= 17.396
  04:13:18 STEP 1803 H=1803:00 +CPU= 26.777
  04:13:35 STEP 1804 H=1804:00 +CPU= 17.331
  04:13:52 STEP 1805 H=1805:00 +CPU= 16.911
  04:14:19 STEP 1806 H=1806:00 +CPU= 27.233
  04:14:36 STEP 1807 H=1807:00 +CPU= 16.783
  04:14:53 STEP 1808 H=1808:00 +CPU= 17.402
  04:15:20 STEP 1809 H=1809:00 +CPU= 26.673
  04:15:37 STEP 1810 H=1810:00 +CPU= 17.275
  04:15:54 STEP 1811 H=1811:00 +CPU= 16.938
  04:16:23 STEP 1812 H=1812:00 +CPU= 28.979
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001812
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001812
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001812
  04:16:40 STEP 1813 H=1813:00 +CPU= 16.622
  04:16:57 STEP 1814 H=1814:00 +CPU= 17.150
  04:17:24 STEP 1815 H=1815:00 +CPU= 26.565
  04:17:41 STEP 1816 H=1816:00 +CPU= 17.005
  04:17:57 STEP 1817 H=1817:00 +CPU= 16.674
  04:18:24 STEP 1818 H=1818:00 +CPU= 27.175
  04:18:41 STEP 1819 H=1819:00 +CPU= 16.555
  04:18:58 STEP 1820 H=1820:00 +CPU= 17.267
  04:19:25 STEP 1821 H=1821:00 +CPU= 26.677
  04:19:42 STEP 1822 H=1822:00 +CPU= 17.007
  04:19:59 STEP 1823 H=1823:00 +CPU= 17.339
  04:20:31 STEP 1824 H=1824:00 +CPU= 30.909
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001824
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001824
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001812
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00f2_2019110100_123_993_12213980_0_r969406420_75.zip
Uploading the intermediate file: upload_file_75.zip
  04:20:48 STEP 1825 H=1825:00 +CPU= 16.813
  04:21:05 STEP 1826 H=1826:00 +CPU= 17.140
  04:21:32 STEP 1827 H=1827:00 +CPU= 26.938
  04:21:49 STEP 1828 H=1828:00 +CPU= 17.205
  04:22:06 STEP 1829 H=1829:00 +CPU= 16.938
  04:22:33 STEP 1830 H=1830:00 +CPU= 27.294
  04:22:50 STEP 1831 H=1831:00 +CPU= 16.789
  04:23:08 STEP 1832 H=1832:00 +CPU= 17.411
  04:23:34 STEP 1833 H=1833:00 +CPU= 26.783
  04:23:52 STEP 1834 H=1834:00 +CPU= 17.236
  04:24:09 STEP 1835 H=1835:00 +CPU= 16.911
  04:24:38 STEP 1836 H=1836:00 +CPU= 29.028
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001836
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001836
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001836
  04:24:54 STEP 1837 H=1837:00 +CPU= 16.842
  04:25:12 STEP 1838 H=1838:00 +CPU= 17.278
  04:25:38 STEP 1839 H=1839:00 +CPU= 26.614
  04:25:56 STEP 1840 H=1840:00 +CPU= 17.124
  04:26:12 STEP 1841 H=1841:00 +CPU= 16.884
  04:26:40 STEP 1842 H=1842:00 +CPU= 27.195
  04:26:56 STEP 1843 H=1843:00 +CPU= 16.733
  04:27:14 STEP 1844 H=1844:00 +CPU= 17.498
  04:27:41 STEP 1845 H=1845:00 +CPU= 26.805
  04:27:58 STEP 1846 H=1846:00 +CPU= 17.216
  04:28:15 STEP 1847 H=1847:00 +CPU= 17.529
  04:28:47 STEP 1848 H=1848:00 +CPU= 30.541
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001848
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001848
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001836
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00f2_2019110100_123_993_12213980_0_r969406420_76.zip
Uploading the intermediate file: upload_file_76.zip
  04:29:04 STEP 1849 H=1849:00 +CPU= 16.962
  04:29:21 STEP 1850 H=1850:00 +CPU= 17.418
  04:29:48 STEP 1851 H=1851:00 +CPU= 26.776
  04:30:05 STEP 1852 H=1852:00 +CPU= 17.095
  04:30:22 STEP 1853 H=1853:00 +CPU= 17.011
  04:30:50 STEP 1854 H=1854:00 +CPU= 27.562
  04:31:07 STEP 1855 H=1855:00 +CPU= 16.882
  04:31:24 STEP 1856 H=1856:00 +CPU= 17.476
  04:31:51 STEP 1857 H=1857:00 +CPU= 26.998
  04:32:09 STEP 1858 H=1858:00 +CPU= 17.304
  04:32:26 STEP 1859 H=1859:00 +CPU= 17.033
  04:32:55 STEP 1860 H=1860:00 +CPU= 29.132
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001860
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001860
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001860
  04:33:11 STEP 1861 H=1861:00 +CPU= 16.699
  04:33:29 STEP 1862 H=1862:00 +CPU= 17.413
  04:33:55 STEP 1863 H=1863:00 +CPU= 26.322
  04:34:12 STEP 1864 H=1864:00 +CPU= 17.167
  04:34:29 STEP 1865 H=1865:00 +CPU= 16.925
  04:34:56 STEP 1866 H=1866:00 +CPU= 27.162
  04:35:13 STEP 1867 H=1867:00 +CPU= 16.633
  04:35:31 STEP 1868 H=1868:00 +CPU= 17.479
  04:35:58 STEP 1869 H=1869:00 +CPU= 26.940
  04:36:15 STEP 1870 H=1870:00 +CPU= 17.350
  04:36:32 STEP 1871 H=1871:00 +CPU= 17.462
  04:37:04 STEP 1872 H=1872:00 +CPU= 30.610
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001872
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001872
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001860
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00f2_2019110100_123_993_12213980_0_r969406420_77.zip
Uploading the intermediate file: upload_file_77.zip
  04:37:21 STEP 1873 H=1873:00 +CPU= 16.670
  04:37:38 STEP 1874 H=1874:00 +CPU= 17.227
  04:38:05 STEP 1875 H=1875:00 +CPU= 27.017
  04:38:22 STEP 1876 H=1876:00 +CPU= 17.110
  04:38:39 STEP 1877 H=1877:00 +CPU= 17.011
  04:39:06 STEP 1878 H=1878:00 +CPU= 27.302
  04:39:23 STEP 1879 H=1879:00 +CPU= 16.745
  04:39:41 STEP 1880 H=1880:00 +CPU= 17.520
  04:40:08 STEP 1881 H=1881:00 +CPU= 26.874
  04:40:25 STEP 1882 H=1882:00 +CPU= 17.205
  04:40:42 STEP 1883 H=1883:00 +CPU= 17.006
  04:41:11 STEP 1884 H=1884:00 +CPU= 29.305
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001884
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001884
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001884
  04:41:28 STEP 1885 H=1885:00 +CPU= 16.873
  04:41:45 STEP 1886 H=1886:00 +CPU= 17.374
  04:42:12 STEP 1887 H=1887:00 +CPU= 27.065
  04:42:30 STEP 1888 H=1888:00 +CPU= 17.319
  04:42:47 STEP 1889 H=1889:00 +CPU= 16.988
  04:43:14 STEP 1890 H=1890:00 +CPU= 27.448
  04:43:31 STEP 1891 H=1891:00 +CPU= 16.846
  04:43:49 STEP 1892 H=1892:00 +CPU= 17.546
  04:44:16 STEP 1893 H=1893:00 +CPU= 26.931
  04:44:33 STEP 1894 H=1894:00 +CPU= 17.260
  04:44:50 STEP 1895 H=1895:00 +CPU= 17.421
  04:45:22 STEP 1896 H=1896:00 +CPU= 30.999
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001896
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001896
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001884
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00f2_2019110100_123_993_12213980_0_r969406420_78.zip
Uploading the intermediate file: upload_file_78.zip
  04:45:39 STEP 1897 H=1897:00 +CPU= 16.759
  04:45:56 STEP 1898 H=1898:00 +CPU= 17.341
  04:46:23 STEP 1899 H=1899:00 +CPU= 26.825
  04:46:40 STEP 1900 H=1900:00 +CPU= 17.324
  04:46:57 STEP 1901 H=1901:00 +CPU= 16.902
  04:47:25 STEP 1902 H=1902:00 +CPU= 27.265
  04:47:41 STEP 1903 H=1903:00 +CPU= 16.790
  04:47:59 STEP 1904 H=1904:00 +CPU= 17.348
  04:48:26 STEP 1905 H=1905:00 +CPU= 26.743
  04:48:43 STEP 1906 H=1906:00 +CPU= 17.405
  04:49:01 STEP 1907 H=1907:00 +CPU= 18.317
  04:49:31 STEP 1908 H=1908:00 +CPU= 29.729
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001908
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001908
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001908
  04:49:48 STEP 1909 H=1909:00 +CPU= 16.779
  04:50:05 STEP 1910 H=1910:00 +CPU= 17.250
  04:50:31 STEP 1911 H=1911:00 +CPU= 26.459
  04:50:49 STEP 1912 H=1912:00 +CPU= 17.281
  04:51:06 STEP 1913 H=1913:00 +CPU= 16.906
  04:51:33 STEP 1914 H=1914:00 +CPU= 27.095
  04:51:50 STEP 1915 H=1915:00 +CPU= 16.804
  04:52:07 STEP 1916 H=1916:00 +CPU= 17.352
  04:52:34 STEP 1917 H=1917:00 +CPU= 26.563
  04:52:51 STEP 1918 H=1918:00 +CPU= 17.305
  04:53:08 STEP 1919 H=1919:00 +CPU= 17.343
  04:53:40 STEP 1920 H=1920:00 +CPU= 30.736
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001920
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001920
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001908
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00f2_2019110100_123_993_12213980_0_r969406420_79.zip
Uploading the intermediate file: upload_file_79.zip
  04:53:56 STEP 1921 H=1921:00 +CPU= 16.833
Uploading trickle at timestep: 6912000
  04:54:14 STEP 1922 H=1922:00 +CPU= 17.339
  04:54:41 STEP 1923 H=1923:00 +CPU= 26.853
  04:54:58 STEP 1924 H=1924:00 +CPU= 17.404
  04:55:15 STEP 1925 H=1925:00 +CPU= 17.268
  04:55:43 STEP 1926 H=1926:00 +CPU= 27.402
  04:56:00 STEP 1927 H=1927:00 +CPU= 16.900
  04:56:17 STEP 1928 H=1928:00 +CPU= 17.435
  04:56:44 STEP 1929 H=1929:00 +CPU= 26.784
  04:57:01 STEP 1930 H=1930:00 +CPU= 17.358
  04:57:18 STEP 1931 H=1931:00 +CPU= 16.916
  04:57:47 STEP 1932 H=1932:00 +CPU= 28.971
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001932
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001932
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001932
  04:58:04 STEP 1933 H=1933:00 +CPU= 16.939
  04:58:21 STEP 1934 H=1934:00 +CPU= 17.406
  04:58:48 STEP 1935 H=1935:00 +CPU= 26.580
  04:59:05 STEP 1936 H=1936:00 +CPU= 17.347
  04:59:22 STEP 1937 H=1937:00 +CPU= 16.883
  04:59:49 STEP 1938 H=1938:00 +CPU= 27.298
  05:00:06 STEP 1939 H=1939:00 +CPU= 16.892
  05:00:24 STEP 1940 H=1940:00 +CPU= 17.288
  05:00:51 STEP 1941 H=1941:00 +CPU= 26.877
  05:01:08 STEP 1942 H=1942:00 +CPU= 17.274
  05:01:25 STEP 1943 H=1943:00 +CPU= 17.400
  05:01:56 STEP 1944 H=1944:00 +CPU= 30.541
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001944
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001944
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001932
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001932
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001932
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00f2_2019110100_123_993_12213980_0_r969406420_80.zip
Uploading the intermediate file: upload_file_80.zip
  05:02:13 STEP 1945 H=1945:00 +CPU= 16.892
  05:02:30 STEP 1946 H=1946:00 +CPU= 17.362
  05:02:57 STEP 1947 H=1947:00 +CPU= 26.803
  05:03:15 STEP 1948 H=1948:00 +CPU= 17.286
  05:03:32 STEP 1949 H=1949:00 +CPU= 16.992
  05:03:59 STEP 1950 H=1950:00 +CPU= 27.151
  05:04:16 STEP 1951 H=1951:00 +CPU= 16.765
  05:04:33 STEP 1952 H=1952:00 +CPU= 17.205
  05:04:59 STEP 1953 H=1953:00 +CPU= 26.654
  05:05:17 STEP 1954 H=1954:00 +CPU= 17.289
  05:05:34 STEP 1955 H=1955:00 +CPU= 16.863
  05:06:02 STEP 1956 H=1956:00 +CPU= 28.648
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001956
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001956
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001956
  05:06:19 STEP 1957 H=1957:00 +CPU= 16.701
  05:06:36 STEP 1958 H=1958:00 +CPU= 17.206
  05:07:03 STEP 1959 H=1959:00 +CPU= 26.626
  05:07:20 STEP 1960 H=1960:00 +CPU= 17.231
  05:07:37 STEP 1961 H=1961:00 +CPU= 16.766
  05:08:04 STEP 1962 H=1962:00 +CPU= 26.783
  05:08:20 STEP 1963 H=1963:00 +CPU= 16.457
  05:08:37 STEP 1964 H=1964:00 +CPU= 17.117
  05:09:03 STEP 1965 H=1965:00 +CPU= 26.318
  05:09:20 STEP 1966 H=1966:00 +CPU= 17.010
  05:09:38 STEP 1967 H=1967:00 +CPU= 17.027
  05:10:09 STEP 1968 H=1968:00 +CPU= 30.442
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001968
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001968
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001956
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001956
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001956
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00f2_2019110100_123_993_12213980_0_r969406420_81.zip
Uploading the intermediate file: upload_file_81.zip
  05:10:25 STEP 1969 H=1969:00 +CPU= 16.648
  05:10:42 STEP 1970 H=1970:00 +CPU= 17.070
  05:11:09 STEP 1971 H=1971:00 +CPU= 26.474
  05:11:26 STEP 1972 H=1972:00 +CPU= 16.973
  05:11:42 STEP 1973 H=1973:00 +CPU= 16.570
  05:12:09 STEP 1974 H=1974:00 +CPU= 26.813
  05:12:26 STEP 1975 H=1975:00 +CPU= 16.354
  05:12:43 STEP 1976 H=1976:00 +CPU= 17.073
  05:13:09 STEP 1977 H=1977:00 +CPU= 26.414
  05:13:26 STEP 1978 H=1978:00 +CPU= 16.883
  05:13:43 STEP 1979 H=1979:00 +CPU= 16.658
  05:14:11 STEP 1980 H=1980:00 +CPU= 28.635
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001980
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001980
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001980
  05:14:28 STEP 1981 H=1981:00 +CPU= 16.556
  05:14:45 STEP 1982 H=1982:00 +CPU= 16.929
  05:15:11 STEP 1983 H=1983:00 +CPU= 26.416
  05:15:28 STEP 1984 H=1984:00 +CPU= 16.987
  05:15:45 STEP 1985 H=1985:00 +CPU= 16.733
  05:16:12 STEP 1986 H=1986:00 +CPU= 26.878
  05:16:28 STEP 1987 H=1987:00 +CPU= 16.457
  05:16:45 STEP 1988 H=1988:00 +CPU= 17.073
  05:17:12 STEP 1989 H=1989:00 +CPU= 26.342
  05:17:28 STEP 1990 H=1990:00 +CPU= 16.870
  05:17:46 STEP 1991 H=1991:00 +CPU= 17.138
  05:18:16 STEP 1992 H=1992:00 +CPU= 30.373
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+001992
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+001992
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001980
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001980
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001980
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00f2_2019110100_123_993_12213980_0_r969406420_82.zip
Uploading the intermediate file: upload_file_82.zip
  05:18:33 STEP 1993 H=1993:00 +CPU= 16.521
  05:18:50 STEP 1994 H=1994:00 +CPU= 17.021
  05:19:16 STEP 1995 H=1995:00 +CPU= 26.419
  05:19:33 STEP 1996 H=1996:00 +CPU= 16.931
  05:19:50 STEP 1997 H=1997:00 +CPU= 16.630
  05:20:16 STEP 1998 H=1998:00 +CPU= 26.864
  05:20:33 STEP 1999 H=1999:00 +CPU= 16.375
  05:20:50 STEP 2000 H=2000:00 +CPU= 17.046
  05:21:16 STEP 2001 H=2001:00 +CPU= 26.406
  05:21:33 STEP 2002 H=2002:00 +CPU= 16.900
  05:21:50 STEP 2003 H=2003:00 +CPU= 16.801
  05:22:19 STEP 2004 H=2004:00 +CPU= 28.689
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+002004
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+002004
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+002004
  05:22:35 STEP 2005 H=2005:00 +CPU= 16.372
  05:22:52 STEP 2006 H=2006:00 +CPU= 16.973
  05:23:18 STEP 2007 H=2007:00 +CPU= 26.268
  05:23:35 STEP 2008 H=2008:00 +CPU= 16.958
  05:23:52 STEP 2009 H=2009:00 +CPU= 16.686
  05:24:19 STEP 2010 H=2010:00 +CPU= 26.899
  05:24:35 STEP 2011 H=2011:00 +CPU= 16.417
  05:24:52 STEP 2012 H=2012:00 +CPU= 17.091
  05:25:19 STEP 2013 H=2013:00 +CPU= 26.406
  05:25:36 STEP 2014 H=2014:00 +CPU= 16.892
  05:25:53 STEP 2015 H=2015:00 +CPU= 17.139
  05:26:24 STEP 2016 H=2016:00 +CPU= 30.661
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhnw4+002016
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhnw4+002016
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhnw4+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMGGhnw4+002004
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMSHhnw4+002004
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213980/ICMUAhnw4+002004
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_00f2_2019110100_123_993_12213980_0_r969406420_83.zip
Uploading the intermediate file: upload_file_83.zip
  05:26:41 STEP 2017 H=2017:00 +CPU= 16.632
  05:26:58 STEP 2018 H=2018:00 +CPU= 17.176
double free or corruption (out)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:53:15 1507462 22315335 oifs_43r3_00f2_2019110100_123_993_12213980_0 6,912,000 39,067 0.0057
09 May 2023 16:53:08 1507462 22315335 oifs_43r3_00f2_2019110100_123_993_12213980_0 6,048,000 34,124 0.0056
09 May 2023 16:53:04 1507462 22315335 oifs_43r3_00f2_2019110100_123_993_12213980_0 5,184,000 29,212 0.0056
09 May 2023 16:53:00 1507462 22315335 oifs_43r3_00f2_2019110100_123_993_12213980_0 4,320,000 24,547 0.0057
09 May 2023 16:52:56 1507462 22315335 oifs_43r3_00f2_2019110100_123_993_12213980_0 3,456,000 19,840 0.0057
09 May 2023 16:52:53 1507462 22315335 oifs_43r3_00f2_2019110100_123_993_12213980_0 2,592,000 15,005 0.0058
09 May 2023 16:52:49 1507462 22315335 oifs_43r3_00f2_2019110100_123_993_12213980_0 1,728,000 10,059 0.0058
09 May 2023 16:52:46 1507462 22315335 oifs_43r3_00f2_2019110100_123_993_12213980_0 864,000 5,244 0.0061


©2024 climateprediction.net