climateprediction.net home page
Task 22290455

Task 22290455

Name oifs_43r3_ps_0330_2018050100_123_987_12203974_0
Workunit 12203974
Created 24 Dec 2022, 20:22:03 UTC
Sent 27 Dec 2022, 19:45:42 UTC
Report deadline 26 Jan 2023, 19:45:42 UTC
Received 17 Mar 2023, 11:57:29 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1529888
Run time 23 hours 12 min 52 sec
CPU time 22 hours 57 min 35 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 5.49 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,416.18 MB
Peak swap size 4,978.07 MB
Peak disk usage 3,764.20 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<stderr_txt>
203974/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMGGhq0f+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMSHhq0f+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMUAhq0f+002412
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0330_2018050100_123_987_12203974_0_r1041509035_100.zip
Uploading the intermediate file: upload_file_100.zip
  15:40:09 STEP 2425 H=2425:00 +CPU= 19.881
  15:40:30 STEP 2426 H=2426:00 +CPU= 20.462
  15:41:01 STEP 2427 H=2427:00 +CPU= 30.971
  15:41:22 STEP 2428 H=2428:00 +CPU= 20.483
  15:41:42 STEP 2429 H=2429:00 +CPU= 19.854
  15:42:14 STEP 2430 H=2430:00 +CPU= 31.824
  15:42:34 STEP 2431 H=2431:00 +CPU= 19.865
  15:42:54 STEP 2432 H=2432:00 +CPU= 20.522
  15:43:26 STEP 2433 H=2433:00 +CPU= 30.973
  15:43:46 STEP 2434 H=2434:00 +CPU= 20.555
  15:44:06 STEP 2435 H=2435:00 +CPU= 19.767
  15:44:41 STEP 2436 H=2436:00 +CPU= 34.664
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002436
  15:45:01 STEP 2437 H=2437:00 +CPU= 19.914
  15:45:22 STEP 2438 H=2438:00 +CPU= 20.421
  15:45:53 STEP 2439 H=2439:00 +CPU= 31.145
  15:46:14 STEP 2440 H=2440:00 +CPU= 20.545
  15:46:36 STEP 2441 H=2441:00 +CPU= 20.094
  15:47:07 STEP 2442 H=2442:00 +CPU= 31.484
  15:47:27 STEP 2443 H=2443:00 +CPU= 19.673
  15:47:48 STEP 2444 H=2444:00 +CPU= 20.532
  15:48:19 STEP 2445 H=2445:00 +CPU= 31.085
  15:48:40 STEP 2446 H=2446:00 +CPU= 20.552
  15:49:00 STEP 2447 H=2447:00 +CPU= 20.352
  15:49:37 STEP 2448 H=2448:00 +CPU= 37.034
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMGGhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMSHhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMGGhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMSHhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMUAhq0f+002436
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0330_2018050100_123_987_12203974_0_r1041509035_101.zip
Uploading the intermediate file: upload_file_101.zip
  15:49:57 STEP 2449 H=2449:00 +CPU= 19.807
  15:50:18 STEP 2450 H=2450:00 +CPU= 20.604
  15:50:49 STEP 2451 H=2451:00 +CPU= 31.042
  15:51:10 STEP 2452 H=2452:00 +CPU= 20.579
  15:51:30 STEP 2453 H=2453:00 +CPU= 19.930
  15:52:02 STEP 2454 H=2454:00 +CPU= 31.822
  15:52:22 STEP 2455 H=2455:00 +CPU= 19.888
  15:52:43 STEP 2456 H=2456:00 +CPU= 20.513
  15:53:14 STEP 2457 H=2457:00 +CPU= 30.988
  15:53:35 STEP 2458 H=2458:00 +CPU= 20.514
  15:53:55 STEP 2459 H=2459:00 +CPU= 19.881
  15:54:30 STEP 2460 H=2460:00 +CPU= 34.530
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002460
  15:54:50 STEP 2461 H=2461:00 +CPU= 19.836
  15:55:11 STEP 2462 H=2462:00 +CPU= 20.476
  15:55:42 STEP 2463 H=2463:00 +CPU= 30.931
  15:56:02 STEP 2464 H=2464:00 +CPU= 20.476
  15:56:22 STEP 2465 H=2465:00 +CPU= 19.855
  15:56:54 STEP 2466 H=2466:00 +CPU= 31.738
  15:57:14 STEP 2467 H=2467:00 +CPU= 19.750
  15:57:35 STEP 2468 H=2468:00 +CPU= 20.393
  15:58:06 STEP 2469 H=2469:00 +CPU= 30.934
  15:58:27 STEP 2470 H=2470:00 +CPU= 20.604
  15:58:48 STEP 2471 H=2471:00 +CPU= 20.644
  15:59:26 STEP 2472 H=2472:00 +CPU= 37.220
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMGGhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMSHhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMGGhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMSHhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMUAhq0f+002460
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0330_2018050100_123_987_12203974_0_r1041509035_102.zip
Uploading the intermediate file: upload_file_102.zip
  15:59:46 STEP 2473 H=2473:00 +CPU= 20.002
  16:00:07 STEP 2474 H=2474:00 +CPU= 20.564
  16:00:39 STEP 2475 H=2475:00 +CPU= 31.187
  16:01:00 STEP 2476 H=2476:00 +CPU= 20.475
  16:01:20 STEP 2477 H=2477:00 +CPU= 19.781
  16:01:52 STEP 2478 H=2478:00 +CPU= 31.652
  16:02:12 STEP 2479 H=2479:00 +CPU= 19.989
  16:02:33 STEP 2480 H=2480:00 +CPU= 20.623
  16:03:04 STEP 2481 H=2481:00 +CPU= 31.223
  16:03:25 STEP 2482 H=2482:00 +CPU= 20.664
  16:03:45 STEP 2483 H=2483:00 +CPU= 19.963
  16:04:20 STEP 2484 H=2484:00 +CPU= 34.782
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002484
  16:04:40 STEP 2485 H=2485:00 +CPU= 20.083
  16:05:01 STEP 2486 H=2486:00 +CPU= 20.694
  16:05:32 STEP 2487 H=2487:00 +CPU= 31.028
  16:05:52 STEP 2488 H=2488:00 +CPU= 20.522
  16:06:12 STEP 2489 H=2489:00 +CPU= 19.833
  16:06:44 STEP 2490 H=2490:00 +CPU= 31.694
  16:07:04 STEP 2491 H=2491:00 +CPU= 19.831
  16:07:25 STEP 2492 H=2492:00 +CPU= 20.470
  16:07:57 STEP 2493 H=2493:00 +CPU= 31.148
  16:08:17 STEP 2494 H=2494:00 +CPU= 20.582
  16:08:38 STEP 2495 H=2495:00 +CPU= 20.596
  16:09:15 STEP 2496 H=2496:00 +CPU= 37.241
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMGGhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMSHhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMGGhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMSHhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMUAhq0f+002484
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0330_2018050100_123_987_12203974_0_r1041509035_103.zip
Uploading the intermediate file: upload_file_103.zip
  16:09:36 STEP 2497 H=2497:00 +CPU= 19.932
  16:09:56 STEP 2498 H=2498:00 +CPU= 20.592
  16:10:28 STEP 2499 H=2499:00 +CPU= 31.192
  16:10:48 STEP 2500 H=2500:00 +CPU= 20.592
  16:11:09 STEP 2501 H=2501:00 +CPU= 19.943
  16:11:41 STEP 2502 H=2502:00 +CPU= 31.836
  16:12:01 STEP 2503 H=2503:00 +CPU= 19.865
  16:12:21 STEP 2504 H=2504:00 +CPU= 20.524
  16:12:52 STEP 2505 H=2505:00 +CPU= 31.011
  16:13:13 STEP 2506 H=2506:00 +CPU= 20.585
  16:13:33 STEP 2507 H=2507:00 +CPU= 20.078
  16:14:09 STEP 2508 H=2508:00 +CPU= 34.841
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002508
  16:14:29 STEP 2509 H=2509:00 +CPU= 19.989
  16:14:49 STEP 2510 H=2510:00 +CPU= 20.555
  16:15:21 STEP 2511 H=2511:00 +CPU= 31.165
  16:15:41 STEP 2512 H=2512:00 +CPU= 20.623
  16:16:01 STEP 2513 H=2513:00 +CPU= 19.934
  16:16:34 STEP 2514 H=2514:00 +CPU= 32.047
  16:16:54 STEP 2515 H=2515:00 +CPU= 20.023
  16:17:15 STEP 2516 H=2516:00 +CPU= 20.602
  16:17:46 STEP 2517 H=2517:00 +CPU= 31.230
  16:18:07 STEP 2518 H=2518:00 +CPU= 20.560
  16:18:27 STEP 2519 H=2519:00 +CPU= 20.579
  16:19:05 STEP 2520 H=2520:00 +CPU= 37.231
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMGGhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMSHhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMGGhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMSHhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMUAhq0f+002508
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0330_2018050100_123_987_12203974_0_r1041509035_104.zip
Uploading the intermediate file: upload_file_104.zip
  16:19:25 STEP 2521 H=2521:00 +CPU= 19.956
  16:19:46 STEP 2522 H=2522:00 +CPU= 20.518
  16:20:17 STEP 2523 H=2523:00 +CPU= 31.102
  16:20:37 STEP 2524 H=2524:00 +CPU= 20.552
  16:20:57 STEP 2525 H=2525:00 +CPU= 19.924
  16:21:29 STEP 2526 H=2526:00 +CPU= 31.864
  16:21:49 STEP 2527 H=2527:00 +CPU= 19.734
  16:22:11 STEP 2528 H=2528:00 +CPU= 21.451
  16:22:45 STEP 2529 H=2529:00 +CPU= 33.388
  16:23:07 STEP 2530 H=2530:00 +CPU= 21.866
  16:23:27 STEP 2531 H=2531:00 +CPU= 19.941
  16:24:02 STEP 2532 H=2532:00 +CPU= 34.829
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002532
  16:24:22 STEP 2533 H=2533:00 +CPU= 20.024
  16:24:46 STEP 2534 H=2534:00 +CPU= 23.744
  16:25:25 STEP 2535 H=2535:00 +CPU= 39.617
  16:25:49 STEP 2536 H=2536:00 +CPU= 23.189
  16:26:09 STEP 2537 H=2537:00 +CPU= 19.948
  16:26:41 STEP 2538 H=2538:00 +CPU= 31.907
  16:27:01 STEP 2539 H=2539:00 +CPU= 19.918
  16:27:22 STEP 2540 H=2540:00 +CPU= 20.618
  16:27:54 STEP 2541 H=2541:00 +CPU= 31.261
  16:28:14 STEP 2542 H=2542:00 +CPU= 20.635
  16:28:35 STEP 2543 H=2543:00 +CPU= 20.627
  16:29:13 STEP 2544 H=2544:00 +CPU= 37.410
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMGGhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMSHhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMGGhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMSHhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMUAhq0f+002532
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0330_2018050100_123_987_12203974_0_r1041509035_105.zip
Uploading the intermediate file: upload_file_105.zip
  16:29:34 STEP 2545 H=2545:00 +CPU= 19.990
  16:29:55 STEP 2546 H=2546:00 +CPU= 20.678
  16:30:26 STEP 2547 H=2547:00 +CPU= 31.331
  16:30:47 STEP 2548 H=2548:00 +CPU= 20.640
  16:31:07 STEP 2549 H=2549:00 +CPU= 19.980
  16:31:40 STEP 2550 H=2550:00 +CPU= 32.037
  16:32:00 STEP 2551 H=2551:00 +CPU= 20.017
  16:32:22 STEP 2552 H=2552:00 +CPU= 22.597
  16:32:59 STEP 2553 H=2553:00 +CPU= 36.456
  16:33:20 STEP 2554 H=2554:00 +CPU= 20.721
  16:33:40 STEP 2555 H=2555:00 +CPU= 20.056
  16:34:20 STEP 2556 H=2556:00 +CPU= 39.137
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002556
  16:34:40 STEP 2557 H=2557:00 +CPU= 19.979
  16:35:01 STEP 2558 H=2558:00 +CPU= 20.669
  16:35:32 STEP 2559 H=2559:00 +CPU= 31.250
  16:35:53 STEP 2560 H=2560:00 +CPU= 20.641
  16:36:16 STEP 2561 H=2561:00 +CPU= 23.848
  16:36:57 STEP 2562 H=2562:00 +CPU= 40.490
  16:37:22 STEP 2563 H=2563:00 +CPU= 25.131
  16:37:43 STEP 2564 H=2564:00 +CPU= 20.613
  16:38:15 STEP 2565 H=2565:00 +CPU= 31.266
  16:38:35 STEP 2566 H=2566:00 +CPU= 20.612
  16:39:00 STEP 2567 H=2567:00 +CPU= 24.373
  16:39:44 STEP 2568 H=2568:00 +CPU= 43.385
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMGGhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMSHhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMGGhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMSHhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMUAhq0f+002556
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0330_2018050100_123_987_12203974_0_r1041509035_106.zip
Uploading the intermediate file: upload_file_106.zip
  16:40:07 STEP 2569 H=2569:00 +CPU= 22.641
  16:40:29 STEP 2570 H=2570:00 +CPU= 22.512
  16:41:01 STEP 2571 H=2571:00 +CPU= 31.278
  16:41:22 STEP 2572 H=2572:00 +CPU= 20.642
  16:41:42 STEP 2573 H=2573:00 +CPU= 19.985
  16:42:21 STEP 2574 H=2574:00 +CPU= 38.629
  16:42:44 STEP 2575 H=2575:00 +CPU= 23.151
  16:43:05 STEP 2576 H=2576:00 +CPU= 20.689
  16:43:37 STEP 2577 H=2577:00 +CPU= 31.872
  16:43:58 STEP 2578 H=2578:00 +CPU= 20.695
  16:44:18 STEP 2579 H=2579:00 +CPU= 20.575
  16:44:53 STEP 2580 H=2580:00 +CPU= 34.857
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002580
  16:45:14 STEP 2581 H=2581:00 +CPU= 20.095
  16:45:34 STEP 2582 H=2582:00 +CPU= 20.679
  16:46:06 STEP 2583 H=2583:00 +CPU= 31.221
  16:46:31 STEP 2584 H=2584:00 +CPU= 25.764
  16:46:53 STEP 2585 H=2585:00 +CPU= 21.609
  16:47:26 STEP 2586 H=2586:00 +CPU= 32.013
  16:47:46 STEP 2587 H=2587:00 +CPU= 20.035
  16:48:07 STEP 2588 H=2588:00 +CPU= 20.701
  16:48:47 STEP 2589 H=2589:00 +CPU= 39.389
  16:49:11 STEP 2590 H=2590:00 +CPU= 23.222
  16:49:31 STEP 2591 H=2591:00 +CPU= 20.682
  16:50:09 STEP 2592 H=2592:00 +CPU= 37.486
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMGGhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMSHhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMGGhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMSHhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMUAhq0f+002580
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0330_2018050100_123_987_12203974_0_r1041509035_107.zip
Uploading the intermediate file: upload_file_107.zip
  16:50:32 STEP 2593 H=2593:00 +CPU= 22.171
  16:50:53 STEP 2594 H=2594:00 +CPU= 20.715
  16:51:24 STEP 2595 H=2595:00 +CPU= 31.290
  16:51:45 STEP 2596 H=2596:00 +CPU= 20.704
  16:52:09 STEP 2597 H=2597:00 +CPU= 23.373
  16:52:48 STEP 2598 H=2598:00 +CPU= 39.024
  16:53:08 STEP 2599 H=2599:00 +CPU= 20.018
  16:53:30 STEP 2600 H=2600:00 +CPU= 21.778
  16:54:05 STEP 2601 H=2601:00 +CPU= 34.472
  16:54:31 STEP 2602 H=2602:00 +CPU= 26.250
  16:54:56 STEP 2603 H=2603:00 +CPU= 24.655
  16:55:31 STEP 2604 H=2604:00 +CPU= 34.872
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002604
  16:55:56 STEP 2605 H=2605:00 +CPU= 23.694
  16:56:20 STEP 2606 H=2606:00 +CPU= 24.261
  16:57:00 STEP 2607 H=2607:00 +CPU= 39.657
  16:57:24 STEP 2608 H=2608:00 +CPU= 23.934
  16:57:48 STEP 2609 H=2609:00 +CPU= 24.271
  16:58:26 STEP 2610 H=2610:00 +CPU= 38.171
  16:58:48 STEP 2611 H=2611:00 +CPU= 21.113
  16:59:09 STEP 2612 H=2612:00 +CPU= 20.770
  16:59:40 STEP 2613 H=2613:00 +CPU= 31.283
  17:00:01 STEP 2614 H=2614:00 +CPU= 20.721
  17:00:28 STEP 2615 H=2615:00 +CPU= 25.994
  17:01:09 STEP 2616 H=2616:00 +CPU= 41.646
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMGGhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMSHhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMGGhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMSHhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMUAhq0f+002604
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0330_2018050100_123_987_12203974_0_r1041509035_108.zip
Uploading the intermediate file: upload_file_108.zip
  17:01:34 STEP 2617 H=2617:00 +CPU= 24.531
  17:01:55 STEP 2618 H=2618:00 +CPU= 20.716
  17:02:26 STEP 2619 H=2619:00 +CPU= 31.252
  17:02:49 STEP 2620 H=2620:00 +CPU= 22.507
  17:03:15 STEP 2621 H=2621:00 +CPU= 25.371
  17:03:48 STEP 2622 H=2622:00 +CPU= 32.646
  17:04:08 STEP 2623 H=2623:00 +CPU= 20.101
  17:04:29 STEP 2624 H=2624:00 +CPU= 20.753
  17:05:01 STEP 2625 H=2625:00 +CPU= 31.365
  17:05:22 STEP 2626 H=2626:00 +CPU= 20.767
  17:05:42 STEP 2627 H=2627:00 +CPU= 20.125
  17:06:18 STEP 2628 H=2628:00 +CPU= 36.088
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002628
  17:06:38 STEP 2629 H=2629:00 +CPU= 20.119
  17:07:03 STEP 2630 H=2630:00 +CPU= 23.922
  17:07:42 STEP 2631 H=2631:00 +CPU= 39.484
  17:08:09 STEP 2632 H=2632:00 +CPU= 26.197
  17:08:30 STEP 2633 H=2633:00 +CPU= 21.633
  17:09:10 STEP 2634 H=2634:00 +CPU= 38.709
  17:09:32 STEP 2635 H=2635:00 +CPU= 22.020
  17:09:56 STEP 2636 H=2636:00 +CPU= 23.885
  17:10:33 STEP 2637 H=2637:00 +CPU= 36.557
  17:11:00 STEP 2638 H=2638:00 +CPU= 26.336
  17:11:26 STEP 2639 H=2639:00 +CPU= 26.337
  17:12:14 STEP 2640 H=2640:00 +CPU= 47.423
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMGGhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMSHhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMGGhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMSHhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMUAhq0f+002628
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0330_2018050100_123_987_12203974_0_r1041509035_109.zip
Uploading the intermediate file: upload_file_109.zip
Uploading trickle at timestep: 9504000
  17:12:39 STEP 2641 H=2641:00 +CPU= 25.332
  17:13:06 STEP 2642 H=2642:00 +CPU= 26.483
  17:13:46 STEP 2643 H=2643:00 +CPU= 40.020
  17:14:12 STEP 2644 H=2644:00 +CPU= 26.141
  17:14:35 STEP 2645 H=2645:00 +CPU= 21.964
  17:15:15 STEP 2646 H=2646:00 +CPU= 40.315
  17:15:38 STEP 2647 H=2647:00 +CPU= 22.539
  17:16:04 STEP 2648 H=2648:00 +CPU= 26.113
  17:16:45 STEP 2649 H=2649:00 +CPU= 39.608
  17:17:11 STEP 2650 H=2650:00 +CPU= 26.335
  17:17:33 STEP 2651 H=2651:00 +CPU= 22.089
  17:18:15 STEP 2652 H=2652:00 +CPU= 41.817
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002652
  17:18:36 STEP 2653 H=2653:00 +CPU= 20.702
  17:18:57 STEP 2654 H=2654:00 +CPU= 20.537
  17:19:37 STEP 2655 H=2655:00 +CPU= 39.505
  17:20:03 STEP 2656 H=2656:00 +CPU= 25.799
  17:20:23 STEP 2657 H=2657:00 +CPU= 19.878
  17:21:02 STEP 2658 H=2658:00 +CPU= 39.204
  17:21:24 STEP 2659 H=2659:00 +CPU= 21.013
  17:21:50 STEP 2660 H=2660:00 +CPU= 26.148
  17:22:28 STEP 2661 H=2661:00 +CPU= 37.586
  17:22:49 STEP 2662 H=2662:00 +CPU= 21.154
  17:23:12 STEP 2663 H=2663:00 +CPU= 22.554
  17:23:59 STEP 2664 H=2664:00 +CPU= 46.936
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMGGhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMSHhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMGGhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMSHhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMUAhq0f+002652
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0330_2018050100_123_987_12203974_0_r1041509035_110.zip
Uploading the intermediate file: upload_file_110.zip
  17:24:25 STEP 2665 H=2665:00 +CPU= 25.328
  17:24:49 STEP 2666 H=2666:00 +CPU= 24.003
  17:25:28 STEP 2667 H=2667:00 +CPU= 39.028
  17:25:55 STEP 2668 H=2668:00 +CPU= 26.268
  17:26:20 STEP 2669 H=2669:00 +CPU= 24.496
  17:26:55 STEP 2670 H=2670:00 +CPU= 35.283
  17:27:16 STEP 2671 H=2671:00 +CPU= 20.134
  17:27:37 STEP 2672 H=2672:00 +CPU= 20.834
  17:28:09 STEP 2673 H=2673:00 +CPU= 31.431
  17:28:34 STEP 2674 H=2674:00 +CPU= 25.223
  17:28:58 STEP 2675 H=2675:00 +CPU= 23.257
  17:29:34 STEP 2676 H=2676:00 +CPU= 35.705
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002676
  17:29:58 STEP 2677 H=2677:00 +CPU= 23.585
  17:30:19 STEP 2678 H=2678:00 +CPU= 20.650
  17:30:50 STEP 2679 H=2679:00 +CPU= 31.122
  17:31:15 STEP 2680 H=2680:00 +CPU= 24.831
  17:31:41 STEP 2681 H=2681:00 +CPU= 25.567
  17:32:22 STEP 2682 H=2682:00 +CPU= 40.684
  17:32:48 STEP 2683 H=2683:00 +CPU= 25.605
  17:33:11 STEP 2684 H=2684:00 +CPU= 22.814
  17:33:43 STEP 2685 H=2685:00 +CPU= 31.578
  17:34:04 STEP 2686 H=2686:00 +CPU= 20.933
  17:34:25 STEP 2687 H=2687:00 +CPU= 21.165
  17:35:11 STEP 2688 H=2688:00 +CPU= 45.893
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMGGhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMSHhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMGGhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMSHhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMUAhq0f+002676
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0330_2018050100_123_987_12203974_0_r1041509035_111.zip
Uploading the intermediate file: upload_file_111.zip
  17:35:37 STEP 2689 H=2689:00 +CPU= 24.431
  17:36:02 STEP 2690 H=2690:00 +CPU= 24.594
  17:36:36 STEP 2691 H=2691:00 +CPU= 34.006
  17:37:01 STEP 2692 H=2692:00 +CPU= 24.814
  17:37:25 STEP 2693 H=2693:00 +CPU= 23.880
  17:38:00 STEP 2694 H=2694:00 +CPU= 35.344
  17:38:23 STEP 2695 H=2695:00 +CPU= 22.174
  17:38:44 STEP 2696 H=2696:00 +CPU= 21.206
  17:39:24 STEP 2697 H=2697:00 +CPU= 39.406
  17:39:51 STEP 2698 H=2698:00 +CPU= 26.320
  17:40:17 STEP 2699 H=2699:00 +CPU= 25.555
  17:41:01 STEP 2700 H=2700:00 +CPU= 44.184
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002700
  17:41:24 STEP 2701 H=2701:00 +CPU= 22.848
  17:41:51 STEP 2702 H=2702:00 +CPU= 26.452
  17:42:24 STEP 2703 H=2703:00 +CPU= 32.576
  17:42:45 STEP 2704 H=2704:00 +CPU= 20.981
  17:43:06 STEP 2705 H=2705:00 +CPU= 20.312
  17:43:39 STEP 2706 H=2706:00 +CPU= 32.879
  17:44:00 STEP 2707 H=2707:00 +CPU= 20.946
  17:44:27 STEP 2708 H=2708:00 +CPU= 26.276
  17:45:05 STEP 2709 H=2709:00 +CPU= 37.825
  17:45:26 STEP 2710 H=2710:00 +CPU= 20.944
  17:45:46 STEP 2711 H=2711:00 +CPU= 20.709
  17:46:26 STEP 2712 H=2712:00 +CPU= 39.019
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMGGhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMSHhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMGGhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMSHhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMUAhq0f+002700
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0330_2018050100_123_987_12203974_0_r1041509035_112.zip
Uploading the intermediate file: upload_file_112.zip
  17:46:50 STEP 2713 H=2713:00 +CPU= 22.106
  17:47:14 STEP 2714 H=2714:00 +CPU= 23.655
  17:47:45 STEP 2715 H=2715:00 +CPU= 31.591
  17:48:07 STEP 2716 H=2716:00 +CPU= 20.923
  17:48:29 STEP 2717 H=2717:00 +CPU= 21.927
  17:49:09 STEP 2718 H=2718:00 +CPU= 40.446
  17:49:32 STEP 2719 H=2719:00 +CPU= 22.342
  17:49:54 STEP 2720 H=2720:00 +CPU= 22.699
  17:50:29 STEP 2721 H=2721:00 +CPU= 34.172
  17:50:50 STEP 2722 H=2722:00 +CPU= 21.044
  17:51:14 STEP 2723 H=2723:00 +CPU= 24.512
  17:51:56 STEP 2724 H=2724:00 +CPU= 41.169
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002724
  17:52:17 STEP 2725 H=2725:00 +CPU= 20.336
  17:52:41 STEP 2726 H=2726:00 +CPU= 24.635
  17:53:13 STEP 2727 H=2727:00 +CPU= 31.633
  17:53:38 STEP 2728 H=2728:00 +CPU= 24.754
  17:54:02 STEP 2729 H=2729:00 +CPU= 24.009
  17:54:35 STEP 2730 H=2730:00 +CPU= 32.347
  17:54:55 STEP 2731 H=2731:00 +CPU= 20.289
  17:55:20 STEP 2732 H=2732:00 +CPU= 24.713
  17:56:00 STEP 2733 H=2733:00 +CPU= 39.520
  17:56:27 STEP 2734 H=2734:00 +CPU= 26.374
  17:56:54 STEP 2735 H=2735:00 +CPU= 26.617
  17:57:42 STEP 2736 H=2736:00 +CPU= 47.830
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMGGhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMSHhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMGGhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMSHhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMUAhq0f+002724
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0330_2018050100_123_987_12203974_0_r1041509035_113.zip
Uploading the intermediate file: upload_file_113.zip
  17:58:03 STEP 2737 H=2737:00 +CPU= 20.987
  17:58:25 STEP 2738 H=2738:00 +CPU= 20.843
  17:58:56 STEP 2739 H=2739:00 +CPU= 31.566
  17:59:18 STEP 2740 H=2740:00 +CPU= 22.151
  17:59:44 STEP 2741 H=2741:00 +CPU= 25.496
  18:00:25 STEP 2742 H=2742:00 +CPU= 40.446
  18:00:50 STEP 2743 H=2743:00 +CPU= 25.449
  18:01:17 STEP 2744 H=2744:00 +CPU= 26.534
  18:01:54 STEP 2745 H=2745:00 +CPU= 37.694
  18:02:17 STEP 2746 H=2746:00 +CPU= 22.817
  18:02:42 STEP 2747 H=2747:00 +CPU= 24.528
  18:03:27 STEP 2748 H=2748:00 +CPU= 44.255
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002748
  18:03:52 STEP 2749 H=2749:00 +CPU= 25.490
  18:04:19 STEP 2750 H=2750:00 +CPU= 26.298
  18:04:58 STEP 2751 H=2751:00 +CPU= 39.658
  18:05:25 STEP 2752 H=2752:00 +CPU= 26.297
  18:05:50 STEP 2753 H=2753:00 +CPU= 25.638
  18:06:24 STEP 2754 H=2754:00 +CPU= 33.042
  18:06:45 STEP 2755 H=2755:00 +CPU= 20.174
  18:07:09 STEP 2756 H=2756:00 +CPU= 23.980
  18:07:49 STEP 2757 H=2757:00 +CPU= 38.862
  18:08:14 STEP 2758 H=2758:00 +CPU= 24.609
  18:08:41 STEP 2759 H=2759:00 +CPU= 26.432
  18:09:28 STEP 2760 H=2760:00 +CPU= 47.593
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMGGhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMSHhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMGGhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMSHhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMUAhq0f+002748
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0330_2018050100_123_987_12203974_0_r1041509035_114.zip
Uploading the intermediate file: upload_file_114.zip
  18:09:49 STEP 2761 H=2761:00 +CPU= 20.443
  18:10:11 STEP 2762 H=2762:00 +CPU= 21.822
  18:10:51 STEP 2763 H=2763:00 +CPU= 40.096
  18:11:16 STEP 2764 H=2764:00 +CPU= 24.673
  18:11:43 STEP 2765 H=2765:00 +CPU= 25.827
  18:12:22 STEP 2766 H=2766:00 +CPU= 38.885
  18:12:47 STEP 2767 H=2767:00 +CPU= 25.552
  18:13:12 STEP 2768 H=2768:00 +CPU= 24.438
  18:13:52 STEP 2769 H=2769:00 +CPU= 40.284
  18:14:19 STEP 2770 H=2770:00 +CPU= 26.224
  18:14:44 STEP 2771 H=2771:00 +CPU= 25.408
  18:15:29 STEP 2772 H=2772:00 +CPU= 44.119
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002772
  18:15:54 STEP 2773 H=2773:00 +CPU= 25.348
  18:16:21 STEP 2774 H=2774:00 +CPU= 26.150
  18:16:57 STEP 2775 H=2775:00 +CPU= 36.511
  18:17:18 STEP 2776 H=2776:00 +CPU= 20.814
  18:17:38 STEP 2777 H=2777:00 +CPU= 20.158
  18:18:16 STEP 2778 H=2778:00 +CPU= 37.720
  18:18:42 STEP 2779 H=2779:00 +CPU= 25.679
  18:19:09 STEP 2780 H=2780:00 +CPU= 26.360
  18:19:49 STEP 2781 H=2781:00 +CPU= 39.831
  18:20:16 STEP 2782 H=2782:00 +CPU= 26.335
  18:20:42 STEP 2783 H=2783:00 +CPU= 26.132
  18:21:30 STEP 2784 H=2784:00 +CPU= 48.006
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMGGhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMSHhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMGGhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMSHhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMUAhq0f+002772
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0330_2018050100_123_987_12203974_0_r1041509035_115.zip
Uploading the intermediate file: upload_file_115.zip
  18:21:56 STEP 2785 H=2785:00 +CPU= 25.417
  18:22:22 STEP 2786 H=2786:00 +CPU= 26.207
  18:23:02 STEP 2787 H=2787:00 +CPU= 39.584
  18:23:28 STEP 2788 H=2788:00 +CPU= 26.293
  18:23:54 STEP 2789 H=2789:00 +CPU= 25.560
  18:24:34 STEP 2790 H=2790:00 +CPU= 40.583
  18:25:00 STEP 2791 H=2791:00 +CPU= 25.504
  18:25:26 STEP 2792 H=2792:00 +CPU= 25.306
  18:26:06 STEP 2793 H=2793:00 +CPU= 39.760
  18:26:33 STEP 2794 H=2794:00 +CPU= 26.278
  18:26:58 STEP 2795 H=2795:00 +CPU= 25.477
  18:27:43 STEP 2796 H=2796:00 +CPU= 44.024
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002796
  18:28:08 STEP 2797 H=2797:00 +CPU= 25.646
  18:28:35 STEP 2798 H=2798:00 +CPU= 26.333
  18:29:15 STEP 2799 H=2799:00 +CPU= 40.068
  18:29:37 STEP 2800 H=2800:00 +CPU= 22.464
  18:30:02 STEP 2801 H=2801:00 +CPU= 24.419
  18:30:42 STEP 2802 H=2802:00 +CPU= 39.675
  18:31:08 STEP 2803 H=2803:00 +CPU= 25.685
  18:31:35 STEP 2804 H=2804:00 +CPU= 26.437
  18:32:15 STEP 2805 H=2805:00 +CPU= 39.881
  18:32:42 STEP 2806 H=2806:00 +CPU= 26.361
  18:33:05 STEP 2807 H=2807:00 +CPU= 22.468
  18:33:47 STEP 2808 H=2808:00 +CPU= 41.199
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMGGhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMSHhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMGGhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMSHhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMUAhq0f+002796
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0330_2018050100_123_987_12203974_0_r1041509035_116.zip
Uploading the intermediate file: upload_file_116.zip
  18:34:12 STEP 2809 H=2809:00 +CPU= 24.553
  18:34:33 STEP 2810 H=2810:00 +CPU= 20.802
  18:35:07 STEP 2811 H=2811:00 +CPU= 33.774
  18:35:33 STEP 2812 H=2812:00 +CPU= 26.364
  18:35:59 STEP 2813 H=2813:00 +CPU= 25.589
  18:36:39 STEP 2814 H=2814:00 +CPU= 40.245
  18:37:05 STEP 2815 H=2815:00 +CPU= 25.620
  18:37:32 STEP 2816 H=2816:00 +CPU= 26.738
  18:38:08 STEP 2817 H=2817:00 +CPU= 35.336
  18:38:34 STEP 2818 H=2818:00 +CPU= 25.845
  18:38:58 STEP 2819 H=2819:00 +CPU= 24.105
  18:39:43 STEP 2820 H=2820:00 +CPU= 44.244
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002820
  18:40:08 STEP 2821 H=2821:00 +CPU= 25.495
  18:40:35 STEP 2822 H=2822:00 +CPU= 26.444
  18:41:15 STEP 2823 H=2823:00 +CPU= 39.783
  18:41:42 STEP 2824 H=2824:00 +CPU= 26.318
  18:42:04 STEP 2825 H=2825:00 +CPU= 21.023
  18:42:37 STEP 2826 H=2826:00 +CPU= 33.233
  18:43:02 STEP 2827 H=2827:00 +CPU= 24.782
  18:43:25 STEP 2828 H=2828:00 +CPU= 22.988
  18:44:05 STEP 2829 H=2829:00 +CPU= 39.689
  18:44:31 STEP 2830 H=2830:00 +CPU= 25.495
  18:44:55 STEP 2831 H=2831:00 +CPU= 24.665
  18:45:43 STEP 2832 H=2832:00 +CPU= 47.349
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMGGhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMSHhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMGGhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMSHhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMUAhq0f+002820
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0330_2018050100_123_987_12203974_0_r1041509035_117.zip
Uploading the intermediate file: upload_file_117.zip
  18:46:09 STEP 2833 H=2833:00 +CPU= 25.196
  18:46:34 STEP 2834 H=2834:00 +CPU= 25.143
  18:47:14 STEP 2835 H=2835:00 +CPU= 39.523
  18:47:40 STEP 2836 H=2836:00 +CPU= 26.212
  18:48:06 STEP 2837 H=2837:00 +CPU= 25.483
  18:48:40 STEP 2838 H=2838:00 +CPU= 33.535
  18:49:00 STEP 2839 H=2839:00 +CPU= 20.239
  18:49:23 STEP 2840 H=2840:00 +CPU= 22.855
  18:50:03 STEP 2841 H=2841:00 +CPU= 39.615
  18:50:29 STEP 2842 H=2842:00 +CPU= 26.250
  18:50:55 STEP 2843 H=2843:00 +CPU= 25.568
  18:51:40 STEP 2844 H=2844:00 +CPU= 44.396
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002844
  18:52:05 STEP 2845 H=2845:00 +CPU= 25.563
  18:52:32 STEP 2846 H=2846:00 +CPU= 26.340
  18:53:12 STEP 2847 H=2847:00 +CPU= 39.787
  18:53:38 STEP 2848 H=2848:00 +CPU= 26.417
  18:54:04 STEP 2849 H=2849:00 +CPU= 25.561
  18:54:45 STEP 2850 H=2850:00 +CPU= 40.704
  18:55:11 STEP 2851 H=2851:00 +CPU= 25.621
  18:55:36 STEP 2852 H=2852:00 +CPU= 24.909
  18:56:10 STEP 2853 H=2853:00 +CPU= 33.790
  18:56:36 STEP 2854 H=2854:00 +CPU= 26.359
  18:57:03 STEP 2855 H=2855:00 +CPU= 26.443
  18:57:51 STEP 2856 H=2856:00 +CPU= 47.647
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMGGhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMSHhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMGGhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMSHhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMUAhq0f+002844
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0330_2018050100_123_987_12203974_0_r1041509035_118.zip
Uploading the intermediate file: upload_file_118.zip
  18:58:17 STEP 2857 H=2857:00 +CPU= 25.545
  18:58:43 STEP 2858 H=2858:00 +CPU= 26.551
  18:59:21 STEP 2859 H=2859:00 +CPU= 37.582
  18:59:42 STEP 2860 H=2860:00 +CPU= 20.884
  19:00:02 STEP 2861 H=2861:00 +CPU= 20.250
  19:00:35 STEP 2862 H=2862:00 +CPU= 32.215
  19:01:01 STEP 2863 H=2863:00 +CPU= 25.554
  19:01:27 STEP 2864 H=2864:00 +CPU= 26.468
  19:02:06 STEP 2865 H=2865:00 +CPU= 38.838
  19:02:33 STEP 2866 H=2866:00 +CPU= 26.265
  19:02:59 STEP 2867 H=2867:00 +CPU= 25.612
  19:03:43 STEP 2868 H=2868:00 +CPU= 44.247
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002868
  19:04:08 STEP 2869 H=2869:00 +CPU= 24.741
  19:04:34 STEP 2870 H=2870:00 +CPU= 26.272
  19:05:06 STEP 2871 H=2871:00 +CPU= 31.989
  19:05:29 STEP 2872 H=2872:00 +CPU= 22.565
  19:05:55 STEP 2873 H=2873:00 +CPU= 25.647
  19:06:36 STEP 2874 H=2874:00 +CPU= 40.416
  19:07:02 STEP 2875 H=2875:00 +CPU= 25.580
  19:07:29 STEP 2876 H=2876:00 +CPU= 26.212
  19:08:09 STEP 2877 H=2877:00 +CPU= 39.704
  19:08:36 STEP 2878 H=2878:00 +CPU= 26.377
  19:09:02 STEP 2879 H=2879:00 +CPU= 26.365
  19:09:50 STEP 2880 H=2880:00 +CPU= 47.142
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMGGhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMSHhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMGGhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMSHhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMUAhq0f+002868
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0330_2018050100_123_987_12203974_0_r1041509035_119.zip
Uploading the intermediate file: upload_file_119.zip
  19:10:16 STEP 2881 H=2881:00 +CPU= 25.609
Uploading trickle at timestep: 10368000
  19:10:43 STEP 2882 H=2882:00 +CPU= 26.655
  19:11:23 STEP 2883 H=2883:00 +CPU= 39.862
  19:11:51 STEP 2884 H=2884:00 +CPU= 27.530
  19:12:18 STEP 2885 H=2885:00 +CPU= 27.021
  19:13:01 STEP 2886 H=2886:00 +CPU= 42.255
  19:13:28 STEP 2887 H=2887:00 +CPU= 26.428
  19:13:55 STEP 2888 H=2888:00 +CPU= 25.982
  19:14:36 STEP 2889 H=2889:00 +CPU= 41.370
  19:15:03 STEP 2890 H=2890:00 +CPU= 26.343
  19:15:30 STEP 2891 H=2891:00 +CPU= 27.114
  19:16:16 STEP 2892 H=2892:00 +CPU= 45.937
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002892
  19:16:44 STEP 2893 H=2893:00 +CPU= 27.021
  19:17:12 STEP 2894 H=2894:00 +CPU= 27.782
  19:17:54 STEP 2895 H=2895:00 +CPU= 41.347
  19:18:20 STEP 2896 H=2896:00 +CPU= 26.292
  19:18:44 STEP 2897 H=2897:00 +CPU= 23.555
  19:19:19 STEP 2898 H=2898:00 +CPU= 34.333
  19:19:41 STEP 2899 H=2899:00 +CPU= 21.945
  19:20:03 STEP 2900 H=2900:00 +CPU= 22.569
  19:20:41 STEP 2901 H=2901:00 +CPU= 37.082
  19:21:07 STEP 2902 H=2902:00 +CPU= 25.661
  19:21:35 STEP 2903 H=2903:00 +CPU= 28.007
  19:22:25 STEP 2904 H=2904:00 +CPU= 49.711
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMGGhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMSHhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMGGhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMSHhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMUAhq0f+002892
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0330_2018050100_123_987_12203974_0_r1041509035_120.zip
Uploading the intermediate file: upload_file_120.zip
  19:22:50 STEP 2905 H=2905:00 +CPU= 24.601
  19:23:18 STEP 2906 H=2906:00 +CPU= 27.138
  19:24:00 STEP 2907 H=2907:00 +CPU= 41.457
  19:24:27 STEP 2908 H=2908:00 +CPU= 26.400
  19:24:49 STEP 2909 H=2909:00 +CPU= 21.474
  19:25:23 STEP 2910 H=2910:00 +CPU= 34.292
  19:25:45 STEP 2911 H=2911:00 +CPU= 21.568
  19:26:05 STEP 2912 H=2912:00 +CPU= 20.356
  19:26:47 STEP 2913 H=2913:00 +CPU= 40.760
  19:27:15 STEP 2914 H=2914:00 +CPU= 27.625
  19:27:43 STEP 2915 H=2915:00 +CPU= 26.911
  19:28:26 STEP 2916 H=2916:00 +CPU= 42.686
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002916
  19:28:50 STEP 2917 H=2917:00 +CPU= 24.891
  19:29:14 STEP 2918 H=2918:00 +CPU= 23.417
  19:29:49 STEP 2919 H=2919:00 +CPU= 34.383
  19:30:18 STEP 2920 H=2920:00 +CPU= 28.225
  19:30:45 STEP 2921 H=2921:00 +CPU= 26.917
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2018050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0330
(argv4) batchid: 987
(argv5) wuid: 12203974
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/8
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/8/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/8/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_657a7455e0dc477b15159ab6991a967b to: /var/lib/boinc-client/slots/8/oifs_43r3_ps_0330_2018050100_123_987_12203974.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/8/oifs_43r3_ps_0330_2018050100_123_987_12203974.zip
ic_ancil_file: ic_ancil_12203974
ifsdata_file: ifsdata_12203974
climate_data_file: clim_data_12203974
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_22d7e51ca4475ac6223379d60c82b0d0 to: /var/lib/boinc-client/slots/8/ic_ancil_12203974.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/8/ic_ancil_12203974.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_61dd627028147017a413184c707d7325 to: /var/lib/boinc-client/slots/8/ifsdata/ifsdata_12203974.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/8/ifsdata/ifsdata_12203974.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/8/159l_2/clim_data_12203974.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/8/159l_2/clim_data_12203974.zip
Checking for progress XML file: /var/lib/boinc-client/slots/8/progress_file_12203974.xml
Opened progress file ok : /var/lib/boinc-client/slots/8/progress_file_12203974.xml
-- Model is restarting --
Adjusting last_iter, 2922, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/8/progress_file_12203974.xml
last_cpu_time: 81216
upload_file_number: 121
last_iter: 2903
last_upload: 10454400
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0330_2018050100_123_987_12203974_0_r1041509035
The child process has been launched with process id: 206856
Executing the command: /var/lib/boinc-client/slots/8/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:Stargazer:1:1:206856:206856] [20221228:193213:1672252333:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:Stargazer:1:1:206856:206856] [20221228:193213:1672252333:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:Stargazer:1:1:206856:206856] [20221228:193213:1672252333:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:Stargazer:1:1:206856:206856] [20221228:193213:1672252333:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:Stargazer:1:1:206856:206856] [20221228:193213:1672252333:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:Stargazer:1:1:206856:206856] [20221228:193213:1672252333:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:Stargazer:1:1:206856:206856] [20221228:193213:1672252333:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:Stargazer:1:1:206856:206856] [20221228:193213:1672252333:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:Stargazer:1:1:206856:206856] [20221228:193213:1672252333:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:Stargazer:1:1:206856:206856] [20221228:193213:1672252333:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:Stargazer:1:1:206856:206856] [20221228:193213:1672252333:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:Stargazer:1:1:206856:206856] [20221228:193213:1672252333:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:Stargazer:1:1:206856:206856] [20221228:193213:1672252333:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:Stargazer:1:1:206856:206856] [20221228:193213:1672252333:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:Stargazer:1:1:206856:206856] [20221228:193213:1672252333:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:Stargazer:1:1:206856:206856] [20221228:193213:1672252333:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Stargazer:1:1:206856:206856] [20221228:193213:1672252333:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:Stargazer:1:1:206856:206856] [20221228:193213:1672252333:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Stargazer:1:1:206856:206856] [20221228:193213:1672252333:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:Stargazer:1:1:206856:206856] [20221228:193213:1672252333:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:Stargazer:1:1:206856:206856] [20221228:193213:1672252333:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Stargazer:1:1:206856:206856] [20221228:193213:1672252333:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Stargazer:1:1:206856:206856] [20221228:193213:1672252333:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:Stargazer:1:1:206856:206856] [20221228:193213:1672252333:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Stargazer:1:1:206856:206856] [20221228:193213:1672252333:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Stargazer:1:1:206856:206856] [20221228:193213:1672252333:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Stargazer:1:1:206856:206856] [20221228:193213:1672252333:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:Stargazer:1:1:206856:206856] [20221228:193213:1672252333:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:Stargazer:1:1:206856:206856] [20221228:193213:1672252333:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:Stargazer:1:1:206856:206856] [20221228:193213:1672252333:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  19:33:00 STEP 2904 H=2904:00 +CPU= 44.047
  19:33:25 STEP 2905 H=2905:00 +CPU= 25.069
  19:33:47 STEP 2906 H=2906:00 +CPU= 22.677
  19:34:25 STEP 2907 H=2907:00 +CPU= 37.642
  19:34:53 STEP 2908 H=2908:00 +CPU= 27.465
  19:35:19 STEP 2909 H=2909:00 +CPU= 26.624
  19:36:02 STEP 2910 H=2910:00 +CPU= 41.901
  19:36:29 STEP 2911 H=2911:00 +CPU= 27.372
  19:36:56 STEP 2912 H=2912:00 +CPU= 26.000
  19:37:30 STEP 2913 H=2913:00 +CPU= 33.248
  19:37:53 STEP 2914 H=2914:00 +CPU= 23.238
  19:38:21 STEP 2915 H=2915:00 +CPU= 26.933
  19:39:06 STEP 2916 H=2916:00 +CPU= 44.529
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002916
  19:39:32 STEP 2917 H=2917:00 +CPU= 25.304
  19:39:56 STEP 2918 H=2918:00 +CPU= 23.666
  19:40:38 STEP 2919 H=2919:00 +CPU= 41.592
  19:41:06 STEP 2920 H=2920:00 +CPU= 28.288
  19:41:30 STEP 2921 H=2921:00 +CPU= 23.791
  19:42:04 STEP 2922 H=2922:00 +CPU= 33.334
  19:42:19 STEP 2923 H=2923:00 +CPU= 15.219
  19:42:34 STEP 2924 H=2924:00 +CPU= 15.417
  19:42:57 STEP 2925 H=2925:00 +CPU= 22.982
  19:43:18 STEP 2926 H=2926:00 +CPU= 19.997
  19:43:40 STEP 2927 H=2927:00 +CPU= 22.235
  19:44:23 STEP 2928 H=2928:00 +CPU= 42.328
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMGGhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMSHhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMGGhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMSHhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMUAhq0f+002916
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0330_2018050100_123_987_12203974_0_r1041509035_121.zip
Uploading the intermediate file: upload_file_121.zip
  19:44:45 STEP 2929 H=2929:00 +CPU= 22.004
  19:45:12 STEP 2930 H=2930:00 +CPU= 26.742
  19:45:54 STEP 2931 H=2931:00 +CPU= 41.323
  19:46:18 STEP 2932 H=2932:00 +CPU= 24.223
  19:46:41 STEP 2933 H=2933:00 +CPU= 22.415
  19:47:25 STEP 2934 H=2934:00 +CPU= 41.614
  19:47:49 STEP 2935 H=2935:00 +CPU= 23.492
  19:48:14 STEP 2936 H=2936:00 +CPU= 25.897
  19:48:56 STEP 2937 H=2937:00 +CPU= 41.400
  19:49:23 STEP 2938 H=2938:00 +CPU= 26.893
  19:49:45 STEP 2939 H=2939:00 +CPU= 22.213
  19:50:26 STEP 2940 H=2940:00 +CPU= 40.064
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002940
  19:50:52 STEP 2941 H=2941:00 +CPU= 26.038
  19:51:20 STEP 2942 H=2942:00 +CPU= 27.421
  19:52:03 STEP 2943 H=2943:00 +CPU= 41.143
  19:52:31 STEP 2944 H=2944:00 +CPU= 27.887
  19:52:59 STEP 2945 H=2945:00 +CPU= 26.766
  19:53:33 STEP 2946 H=2946:00 +CPU= 34.467
  19:53:52 STEP 2947 H=2947:00 +CPU= 18.884
  19:54:12 STEP 2948 H=2948:00 +CPU= 19.341
  19:54:51 STEP 2949 H=2949:00 +CPU= 38.501
  19:55:17 STEP 2950 H=2950:00 +CPU= 25.055
  19:55:44 STEP 2951 H=2951:00 +CPU= 27.348
  19:56:29 STEP 2952 H=2952:00 +CPU= 44.405
The child process terminated with status: 0
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMGGhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMSHhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/8/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMUAhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMSHhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMGGhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMGGhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMGGhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMSHhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMSHhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203974/ICMUAhq0f+002952
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0330_2018050100_123_987_12203974_0_r1041509035_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
19:59:53 (206853): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:00:29 1529888 22290455 oifs_43r3_ps_0330_2018050100_123_987_12203974_0 10,623,600 82,655 0.0078
09 May 2023 16:00:25 1529888 22290455 oifs_43r3_ps_0330_2018050100_123_987_12203974_0 10,368,000 79,962 0.0077
09 May 2023 16:00:25 1529888 22290455 oifs_43r3_ps_0330_2018050100_123_987_12203974_0 10,368,000 79,962 0.0077
09 May 2023 16:00:19 1529888 22290455 oifs_43r3_ps_0330_2018050100_123_987_12203974_0 9,504,000 72,963 0.0077
09 May 2023 16:00:12 1529888 22290455 oifs_43r3_ps_0330_2018050100_123_987_12203974_0 8,640,000 66,882 0.0077
09 May 2023 16:00:09 1529888 22290455 oifs_43r3_ps_0330_2018050100_123_987_12203974_0 7,776,000 61,051 0.0079
09 May 2023 16:00:01 1529888 22290455 oifs_43r3_ps_0330_2018050100_123_987_12203974_0 6,912,000 55,154 0.0080
09 May 2023 16:00:01 1529888 22290455 oifs_43r3_ps_0330_2018050100_123_987_12203974_0 6,912,000 55,154 0.0080
09 May 2023 15:59:57 1529888 22290455 oifs_43r3_ps_0330_2018050100_123_987_12203974_0 6,048,000 48,836 0.0081
09 May 2023 15:59:48 1529888 22290455 oifs_43r3_ps_0330_2018050100_123_987_12203974_0 5,184,000 42,229 0.0081
09 May 2023 15:59:40 1529888 22290455 oifs_43r3_ps_0330_2018050100_123_987_12203974_0 4,320,000 35,259 0.0082
09 May 2023 15:59:34 1529888 22290455 oifs_43r3_ps_0330_2018050100_123_987_12203974_0 3,456,000 27,985 0.0081
09 May 2023 15:59:27 1529888 22290455 oifs_43r3_ps_0330_2018050100_123_987_12203974_0 2,592,000 20,939 0.0081
09 May 2023 15:59:21 1529888 22290455 oifs_43r3_ps_0330_2018050100_123_987_12203974_0 1,728,000 13,988 0.0081
09 May 2023 15:59:14 1529888 22290455 oifs_43r3_ps_0330_2018050100_123_987_12203974_0 864,000 6,951 0.0080
09 May 2023 15:59:14 1529888 22290455 oifs_43r3_ps_0330_2018050100_123_987_12203974_0 864,000 6,951 0.0080


©2024 climateprediction.net