climateprediction.net home page
Task 22272015

Task 22272015

Name oifs_43r3_ps_0985_2000050100_123_969_12186629_0
Workunit 12186629
Created 22 Dec 2022, 22:51:55 UTC
Sent 12 Jan 2023, 0:37:41 UTC
Report deadline 11 Feb 2023, 0:37:41 UTC
Received 15 Jan 2023, 16:41:58 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1537207
Run time 10 hours 49 min 30 sec
CPU time 10 hours 44 min 28 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 8.37 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,412.62 MB
Peak swap size 4,978.08 MB
Peak disk usage 2,071.49 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<stderr_txt>
5:06:34 STEP 2483 H=2483:00 +CPU= 10.555
  15:06:52 STEP 2484 H=2484:00 +CPU= 18.547
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002484
  15:07:03 STEP 2485 H=2485:00 +CPU= 10.786
  15:07:14 STEP 2486 H=2486:00 +CPU= 11.009
  15:07:31 STEP 2487 H=2487:00 +CPU= 16.693
  15:07:42 STEP 2488 H=2488:00 +CPU= 11.062
  15:07:53 STEP 2489 H=2489:00 +CPU= 10.687
  15:08:09 STEP 2490 H=2490:00 +CPU= 16.885
  15:08:20 STEP 2491 H=2491:00 +CPU= 10.716
  15:08:31 STEP 2492 H=2492:00 +CPU= 10.860
  15:08:48 STEP 2493 H=2493:00 +CPU= 16.700
  15:08:59 STEP 2494 H=2494:00 +CPU= 11.022
  15:09:10 STEP 2495 H=2495:00 +CPU= 10.968
  15:09:30 STEP 2496 H=2496:00 +CPU= 19.750
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMGGhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMSHhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMGGhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMSHhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMUAhq0f+002484
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0985_2000050100_123_969_12186629_0_r1418431459_103.zip
Uploading the intermediate file: upload_file_103.zip
  15:09:40 STEP 2497 H=2497:00 +CPU= 10.824
  15:09:51 STEP 2498 H=2498:00 +CPU= 10.769
  15:10:08 STEP 2499 H=2499:00 +CPU= 16.723
  15:10:19 STEP 2500 H=2500:00 +CPU= 10.829
  15:10:29 STEP 2501 H=2501:00 +CPU= 10.483
  15:10:46 STEP 2502 H=2502:00 +CPU= 16.978
  15:10:57 STEP 2503 H=2503:00 +CPU= 10.663
  15:11:08 STEP 2504 H=2504:00 +CPU= 10.805
  15:11:24 STEP 2505 H=2505:00 +CPU= 16.623
  15:11:35 STEP 2506 H=2506:00 +CPU= 10.983
  15:11:46 STEP 2507 H=2507:00 +CPU= 10.691
  15:12:05 STEP 2508 H=2508:00 +CPU= 18.512
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002508
  15:12:15 STEP 2509 H=2509:00 +CPU= 10.609
  15:12:26 STEP 2510 H=2510:00 +CPU= 10.866
  15:12:43 STEP 2511 H=2511:00 +CPU= 16.591
  15:12:54 STEP 2512 H=2512:00 +CPU= 10.840
  15:13:04 STEP 2513 H=2513:00 +CPU= 10.628
  15:13:21 STEP 2514 H=2514:00 +CPU= 17.000
  15:13:32 STEP 2515 H=2515:00 +CPU= 10.739
  15:13:43 STEP 2516 H=2516:00 +CPU= 10.861
  15:14:00 STEP 2517 H=2517:00 +CPU= 16.664
  15:14:11 STEP 2518 H=2518:00 +CPU= 11.011
  15:14:22 STEP 2519 H=2519:00 +CPU= 10.959
  15:14:42 STEP 2520 H=2520:00 +CPU= 19.947
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMGGhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMSHhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMGGhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMSHhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMUAhq0f+002508
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0985_2000050100_123_969_12186629_0_r1418431459_104.zip
Uploading the intermediate file: upload_file_104.zip
  15:14:52 STEP 2521 H=2521:00 +CPU= 10.638
  15:15:03 STEP 2522 H=2522:00 +CPU= 10.650
  15:15:20 STEP 2523 H=2523:00 +CPU= 16.699
  15:15:31 STEP 2524 H=2524:00 +CPU= 11.004
  15:15:41 STEP 2525 H=2525:00 +CPU= 10.489
  15:15:58 STEP 2526 H=2526:00 +CPU= 17.090
  15:16:09 STEP 2527 H=2527:00 +CPU= 10.712
  15:16:20 STEP 2528 H=2528:00 +CPU= 10.932
  15:16:37 STEP 2529 H=2529:00 +CPU= 16.725
  15:16:48 STEP 2530 H=2530:00 +CPU= 11.014
  15:16:58 STEP 2531 H=2531:00 +CPU= 10.648
  15:17:17 STEP 2532 H=2532:00 +CPU= 18.638
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002532
  15:17:28 STEP 2533 H=2533:00 +CPU= 10.631
  15:17:38 STEP 2534 H=2534:00 +CPU= 10.746
  15:17:55 STEP 2535 H=2535:00 +CPU= 16.858
  15:18:06 STEP 2536 H=2536:00 +CPU= 10.865
  15:18:17 STEP 2537 H=2537:00 +CPU= 10.430
  15:18:34 STEP 2538 H=2538:00 +CPU= 16.925
  15:18:44 STEP 2539 H=2539:00 +CPU= 10.657
  15:18:55 STEP 2540 H=2540:00 +CPU= 10.893
  15:19:12 STEP 2541 H=2541:00 +CPU= 16.702
  15:19:23 STEP 2542 H=2542:00 +CPU= 11.113
  15:19:34 STEP 2543 H=2543:00 +CPU= 10.865
  15:19:54 STEP 2544 H=2544:00 +CPU= 19.760
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMGGhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMSHhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMGGhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMSHhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMUAhq0f+002532
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0985_2000050100_123_969_12186629_0_r1418431459_105.zip
Uploading the intermediate file: upload_file_105.zip
  15:20:04 STEP 2545 H=2545:00 +CPU= 10.615
  15:20:15 STEP 2546 H=2546:00 +CPU= 10.811
  15:20:32 STEP 2547 H=2547:00 +CPU= 16.882
  15:20:43 STEP 2548 H=2548:00 +CPU= 10.980
  15:20:53 STEP 2549 H=2549:00 +CPU= 10.448
  15:21:10 STEP 2550 H=2550:00 +CPU= 16.934
  15:21:21 STEP 2551 H=2551:00 +CPU= 10.703
  15:21:32 STEP 2552 H=2552:00 +CPU= 10.799
  15:21:49 STEP 2553 H=2553:00 +CPU= 16.632
  15:22:00 STEP 2554 H=2554:00 +CPU= 10.971
  15:22:10 STEP 2555 H=2555:00 +CPU= 10.727
  15:22:29 STEP 2556 H=2556:00 +CPU= 18.521
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002556
  15:22:40 STEP 2557 H=2557:00 +CPU= 10.812
  15:22:51 STEP 2558 H=2558:00 +CPU= 10.971
  15:23:07 STEP 2559 H=2559:00 +CPU= 16.710
  15:23:18 STEP 2560 H=2560:00 +CPU= 10.961
  15:23:29 STEP 2561 H=2561:00 +CPU= 10.622
  15:23:46 STEP 2562 H=2562:00 +CPU= 17.068
  15:23:57 STEP 2563 H=2563:00 +CPU= 10.777
  15:24:08 STEP 2564 H=2564:00 +CPU= 10.814
  15:24:24 STEP 2565 H=2565:00 +CPU= 16.719
  15:24:35 STEP 2566 H=2566:00 +CPU= 11.048
  15:24:47 STEP 2567 H=2567:00 +CPU= 11.090
  15:25:06 STEP 2568 H=2568:00 +CPU= 19.687
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMGGhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMSHhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMGGhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMSHhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMUAhq0f+002556
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0985_2000050100_123_969_12186629_0_r1418431459_106.zip
Uploading the intermediate file: upload_file_106.zip
  15:25:17 STEP 2569 H=2569:00 +CPU= 10.635
  15:25:28 STEP 2570 H=2570:00 +CPU= 10.915
  15:25:45 STEP 2571 H=2571:00 +CPU= 16.655
  15:25:56 STEP 2572 H=2572:00 +CPU= 10.971
  15:26:06 STEP 2573 H=2573:00 +CPU= 10.544
  15:26:23 STEP 2574 H=2574:00 +CPU= 17.047
  15:26:34 STEP 2575 H=2575:00 +CPU= 10.723
  15:26:45 STEP 2576 H=2576:00 +CPU= 10.840
  15:27:01 STEP 2577 H=2577:00 +CPU= 16.727
  15:27:13 STEP 2578 H=2578:00 +CPU= 11.133
  15:27:23 STEP 2579 H=2579:00 +CPU= 10.717
  15:27:42 STEP 2580 H=2580:00 +CPU= 18.494
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002580
  15:27:53 STEP 2581 H=2581:00 +CPU= 10.695
  15:28:03 STEP 2582 H=2582:00 +CPU= 10.819
  15:28:20 STEP 2583 H=2583:00 +CPU= 16.852
  15:28:31 STEP 2584 H=2584:00 +CPU= 10.874
  15:28:42 STEP 2585 H=2585:00 +CPU= 10.481
  15:28:59 STEP 2586 H=2586:00 +CPU= 17.012
  15:29:09 STEP 2587 H=2587:00 +CPU= 10.764
  15:29:20 STEP 2588 H=2588:00 +CPU= 10.990
  15:29:37 STEP 2589 H=2589:00 +CPU= 16.641
  15:29:48 STEP 2590 H=2590:00 +CPU= 10.962
  15:29:59 STEP 2591 H=2591:00 +CPU= 10.814
  15:30:19 STEP 2592 H=2592:00 +CPU= 19.887
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMGGhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMSHhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMGGhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMSHhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMUAhq0f+002580
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0985_2000050100_123_969_12186629_0_r1418431459_107.zip
Uploading the intermediate file: upload_file_107.zip
  15:30:30 STEP 2593 H=2593:00 +CPU= 10.887
  15:30:41 STEP 2594 H=2594:00 +CPU= 10.899
Uploading trickle at timestep: 9331200
  15:30:57 STEP 2595 H=2595:00 +CPU= 16.720
  15:31:08 STEP 2596 H=2596:00 +CPU= 10.981
  15:31:19 STEP 2597 H=2597:00 +CPU= 10.515
  15:31:36 STEP 2598 H=2598:00 +CPU= 16.993
  15:31:47 STEP 2599 H=2599:00 +CPU= 10.689
  15:31:58 STEP 2600 H=2600:00 +CPU= 10.887
  15:32:14 STEP 2601 H=2601:00 +CPU= 16.726
  15:32:25 STEP 2602 H=2602:00 +CPU= 11.139
  15:32:36 STEP 2603 H=2603:00 +CPU= 10.730
  15:32:55 STEP 2604 H=2604:00 +CPU= 18.499
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002604
  15:33:06 STEP 2605 H=2605:00 +CPU= 10.887
  15:33:17 STEP 2606 H=2606:00 +CPU= 10.997
  15:33:33 STEP 2607 H=2607:00 +CPU= 16.796
  15:33:45 STEP 2608 H=2608:00 +CPU= 11.082
  15:33:55 STEP 2609 H=2609:00 +CPU= 10.632
  15:34:12 STEP 2610 H=2610:00 +CPU= 17.027
  15:34:23 STEP 2611 H=2611:00 +CPU= 10.752
  15:34:34 STEP 2612 H=2612:00 +CPU= 10.864
  15:34:51 STEP 2613 H=2613:00 +CPU= 16.611
  15:35:01 STEP 2614 H=2614:00 +CPU= 10.891
  15:35:12 STEP 2615 H=2615:00 +CPU= 10.837
  15:35:32 STEP 2616 H=2616:00 +CPU= 19.924
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMGGhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMSHhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMGGhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMSHhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMUAhq0f+002604
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0985_2000050100_123_969_12186629_0_r1418431459_108.zip
Uploading the intermediate file: upload_file_108.zip
  15:35:43 STEP 2617 H=2617:00 +CPU= 10.755
  15:35:54 STEP 2618 H=2618:00 +CPU= 10.663
  15:36:10 STEP 2619 H=2619:00 +CPU= 16.791
  15:36:21 STEP 2620 H=2620:00 +CPU= 10.930
  15:36:32 STEP 2621 H=2621:00 +CPU= 10.553
  15:36:49 STEP 2622 H=2622:00 +CPU= 16.995
  15:37:00 STEP 2623 H=2623:00 +CPU= 10.737
  15:37:11 STEP 2624 H=2624:00 +CPU= 10.930
  15:37:27 STEP 2625 H=2625:00 +CPU= 16.665
  15:37:39 STEP 2626 H=2626:00 +CPU= 11.127
  15:37:49 STEP 2627 H=2627:00 +CPU= 10.760
  15:38:08 STEP 2628 H=2628:00 +CPU= 18.584
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002628
  15:38:19 STEP 2629 H=2629:00 +CPU= 10.833
  15:38:30 STEP 2630 H=2630:00 +CPU= 10.867
  15:38:46 STEP 2631 H=2631:00 +CPU= 16.600
  15:38:57 STEP 2632 H=2632:00 +CPU= 10.993
  15:39:08 STEP 2633 H=2633:00 +CPU= 10.559
  15:39:25 STEP 2634 H=2634:00 +CPU= 16.896
  15:39:35 STEP 2635 H=2635:00 +CPU= 10.629
  15:39:46 STEP 2636 H=2636:00 +CPU= 10.805
  15:40:03 STEP 2637 H=2637:00 +CPU= 16.668
  15:40:14 STEP 2638 H=2638:00 +CPU= 10.881
  15:40:25 STEP 2639 H=2639:00 +CPU= 10.827
  15:40:44 STEP 2640 H=2640:00 +CPU= 19.823
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMGGhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMSHhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMGGhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMSHhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMUAhq0f+002628
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0985_2000050100_123_969_12186629_0_r1418431459_109.zip
Uploading the intermediate file: upload_file_109.zip
  15:40:55 STEP 2641 H=2641:00 +CPU= 10.651
  15:41:06 STEP 2642 H=2642:00 +CPU= 10.841
  15:41:23 STEP 2643 H=2643:00 +CPU= 16.694
  15:41:34 STEP 2644 H=2644:00 +CPU= 10.884
  15:41:44 STEP 2645 H=2645:00 +CPU= 10.487
  15:42:01 STEP 2646 H=2646:00 +CPU= 17.071
  15:42:12 STEP 2647 H=2647:00 +CPU= 10.697
  15:42:23 STEP 2648 H=2648:00 +CPU= 10.893
  15:42:40 STEP 2649 H=2649:00 +CPU= 16.702
  15:42:50 STEP 2650 H=2650:00 +CPU= 10.906
  15:43:01 STEP 2651 H=2651:00 +CPU= 10.631
  15:43:20 STEP 2652 H=2652:00 +CPU= 18.538
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002652
  15:43:30 STEP 2653 H=2653:00 +CPU= 10.796
  15:43:41 STEP 2654 H=2654:00 +CPU= 10.754
  15:43:58 STEP 2655 H=2655:00 +CPU= 16.784
  15:44:09 STEP 2656 H=2656:00 +CPU= 10.924
  15:44:19 STEP 2657 H=2657:00 +CPU= 10.459
  15:44:36 STEP 2658 H=2658:00 +CPU= 16.964
  15:44:47 STEP 2659 H=2659:00 +CPU= 10.609
  15:44:58 STEP 2660 H=2660:00 +CPU= 10.968
  15:45:15 STEP 2661 H=2661:00 +CPU= 16.739
  15:45:26 STEP 2662 H=2662:00 +CPU= 11.039
  15:45:37 STEP 2663 H=2663:00 +CPU= 10.978
  15:45:57 STEP 2664 H=2664:00 +CPU= 19.847
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMGGhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMSHhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMGGhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMSHhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMUAhq0f+002652
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0985_2000050100_123_969_12186629_0_r1418431459_110.zip
Uploading the intermediate file: upload_file_110.zip
  15:46:07 STEP 2665 H=2665:00 +CPU= 10.744
  15:46:18 STEP 2666 H=2666:00 +CPU= 10.669
  15:46:35 STEP 2667 H=2667:00 +CPU= 16.807
  15:46:46 STEP 2668 H=2668:00 +CPU= 10.893
  15:46:56 STEP 2669 H=2669:00 +CPU= 10.453
  15:47:13 STEP 2670 H=2670:00 +CPU= 16.983
  15:47:24 STEP 2671 H=2671:00 +CPU= 10.764
  15:47:35 STEP 2672 H=2672:00 +CPU= 10.847
  15:47:52 STEP 2673 H=2673:00 +CPU= 16.760
  15:48:03 STEP 2674 H=2674:00 +CPU= 11.114
  15:48:14 STEP 2675 H=2675:00 +CPU= 10.815
  15:48:32 STEP 2676 H=2676:00 +CPU= 18.422
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002676
  15:48:43 STEP 2677 H=2677:00 +CPU= 10.667
  15:48:54 STEP 2678 H=2678:00 +CPU= 10.773
  15:49:10 STEP 2679 H=2679:00 +CPU= 16.666
  15:49:21 STEP 2680 H=2680:00 +CPU= 11.014
  15:49:32 STEP 2681 H=2681:00 +CPU= 10.466
  15:49:49 STEP 2682 H=2682:00 +CPU= 17.106
  15:50:00 STEP 2683 H=2683:00 +CPU= 10.735
  15:50:11 STEP 2684 H=2684:00 +CPU= 10.997
  15:50:28 STEP 2685 H=2685:00 +CPU= 16.824
  15:50:39 STEP 2686 H=2686:00 +CPU= 10.983
  15:50:49 STEP 2687 H=2687:00 +CPU= 10.930
  15:51:09 STEP 2688 H=2688:00 +CPU= 19.783
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMGGhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMSHhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMGGhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMSHhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMUAhq0f+002676
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0985_2000050100_123_969_12186629_0_r1418431459_111.zip
Uploading the intermediate file: upload_file_111.zip
  15:51:20 STEP 2689 H=2689:00 +CPU= 10.677
  15:51:31 STEP 2690 H=2690:00 +CPU= 10.743
  15:51:47 STEP 2691 H=2691:00 +CPU= 16.655
  15:51:59 STEP 2692 H=2692:00 +CPU= 11.052
  15:52:09 STEP 2693 H=2693:00 +CPU= 10.574
  15:52:26 STEP 2694 H=2694:00 +CPU= 17.005
  15:52:37 STEP 2695 H=2695:00 +CPU= 10.844
  15:52:48 STEP 2696 H=2696:00 +CPU= 10.919
  15:53:05 STEP 2697 H=2697:00 +CPU= 16.888
  15:53:16 STEP 2698 H=2698:00 +CPU= 11.166
  15:53:27 STEP 2699 H=2699:00 +CPU= 10.658
  15:53:45 STEP 2700 H=2700:00 +CPU= 18.579
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002700
  15:53:56 STEP 2701 H=2701:00 +CPU= 10.748
  15:54:07 STEP 2702 H=2702:00 +CPU= 10.788
  15:54:23 STEP 2703 H=2703:00 +CPU= 16.648
  15:54:34 STEP 2704 H=2704:00 +CPU= 10.879
  15:54:45 STEP 2705 H=2705:00 +CPU= 10.454
  15:55:02 STEP 2706 H=2706:00 +CPU= 17.197
  15:55:13 STEP 2707 H=2707:00 +CPU= 10.626
  15:55:24 STEP 2708 H=2708:00 +CPU= 10.944
  15:55:40 STEP 2709 H=2709:00 +CPU= 16.742
  15:55:51 STEP 2710 H=2710:00 +CPU= 11.023
  15:56:02 STEP 2711 H=2711:00 +CPU= 10.965
  15:56:22 STEP 2712 H=2712:00 +CPU= 19.774
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMGGhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMSHhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMGGhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMSHhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMUAhq0f+002700
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0985_2000050100_123_969_12186629_0_r1418431459_112.zip
Uploading the intermediate file: upload_file_112.zip
  15:56:33 STEP 2713 H=2713:00 +CPU= 10.715
  15:56:44 STEP 2714 H=2714:00 +CPU= 10.823
  15:57:01 STEP 2715 H=2715:00 +CPU= 16.687
  15:57:12 STEP 2716 H=2716:00 +CPU= 11.089
  15:57:22 STEP 2717 H=2717:00 +CPU= 10.648
  15:57:39 STEP 2718 H=2718:00 +CPU= 17.079
  15:57:50 STEP 2719 H=2719:00 +CPU= 10.739
  15:58:01 STEP 2720 H=2720:00 +CPU= 10.836
  15:58:18 STEP 2721 H=2721:00 +CPU= 16.788
  15:58:29 STEP 2722 H=2722:00 +CPU= 10.998
  15:58:39 STEP 2723 H=2723:00 +CPU= 10.647
  15:58:58 STEP 2724 H=2724:00 +CPU= 18.501
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002724
  15:59:09 STEP 2725 H=2725:00 +CPU= 10.824
  15:59:20 STEP 2726 H=2726:00 +CPU= 10.999
  15:59:37 STEP 2727 H=2727:00 +CPU= 16.830
  15:59:48 STEP 2728 H=2728:00 +CPU= 10.988
  15:59:58 STEP 2729 H=2729:00 +CPU= 10.662
  16:00:15 STEP 2730 H=2730:00 +CPU= 17.118
  16:00:26 STEP 2731 H=2731:00 +CPU= 10.666
  16:00:37 STEP 2732 H=2732:00 +CPU= 10.949
  16:00:54 STEP 2733 H=2733:00 +CPU= 16.745
  16:01:05 STEP 2734 H=2734:00 +CPU= 10.880
  16:01:16 STEP 2735 H=2735:00 +CPU= 10.930
  16:01:36 STEP 2736 H=2736:00 +CPU= 19.893
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMGGhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMSHhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMGGhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMSHhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMUAhq0f+002724
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0985_2000050100_123_969_12186629_0_r1418431459_113.zip
Uploading the intermediate file: upload_file_113.zip
  16:01:46 STEP 2737 H=2737:00 +CPU= 10.703
  16:01:57 STEP 2738 H=2738:00 +CPU= 10.877
  16:02:14 STEP 2739 H=2739:00 +CPU= 16.682
  16:02:25 STEP 2740 H=2740:00 +CPU= 11.048
  16:02:36 STEP 2741 H=2741:00 +CPU= 10.654
  16:02:53 STEP 2742 H=2742:00 +CPU= 17.040
  16:03:04 STEP 2743 H=2743:00 +CPU= 10.814
  16:03:15 STEP 2744 H=2744:00 +CPU= 10.928
  16:03:31 STEP 2745 H=2745:00 +CPU= 16.868
  16:03:43 STEP 2746 H=2746:00 +CPU= 11.095
  16:03:53 STEP 2747 H=2747:00 +CPU= 10.813
  16:04:12 STEP 2748 H=2748:00 +CPU= 18.656
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002748
  16:04:23 STEP 2749 H=2749:00 +CPU= 10.829
  16:04:34 STEP 2750 H=2750:00 +CPU= 10.904
  16:04:51 STEP 2751 H=2751:00 +CPU= 16.745
  16:05:02 STEP 2752 H=2752:00 +CPU= 11.078
  16:05:12 STEP 2753 H=2753:00 +CPU= 10.511
  16:05:29 STEP 2754 H=2754:00 +CPU= 17.062
  16:05:40 STEP 2755 H=2755:00 +CPU= 10.720
  16:05:51 STEP 2756 H=2756:00 +CPU= 10.862
  16:06:07 STEP 2757 H=2757:00 +CPU= 16.643
  16:06:19 STEP 2758 H=2758:00 +CPU= 11.119
  16:06:30 STEP 2759 H=2759:00 +CPU= 10.915
  16:06:49 STEP 2760 H=2760:00 +CPU= 19.846
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMGGhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMSHhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMGGhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMSHhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMUAhq0f+002748
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0985_2000050100_123_969_12186629_0_r1418431459_114.zip
Uploading the intermediate file: upload_file_114.zip
  16:07:00 STEP 2761 H=2761:00 +CPU= 10.706
  16:07:11 STEP 2762 H=2762:00 +CPU= 10.813
  16:07:28 STEP 2763 H=2763:00 +CPU= 16.645
  16:07:39 STEP 2764 H=2764:00 +CPU= 10.917
  16:07:49 STEP 2765 H=2765:00 +CPU= 10.504
  16:08:06 STEP 2766 H=2766:00 +CPU= 16.963
  16:08:17 STEP 2767 H=2767:00 +CPU= 10.695
  16:08:28 STEP 2768 H=2768:00 +CPU= 10.816
  16:08:44 STEP 2769 H=2769:00 +CPU= 16.689
  16:08:55 STEP 2770 H=2770:00 +CPU= 10.935
  16:09:06 STEP 2771 H=2771:00 +CPU= 10.741
  16:09:25 STEP 2772 H=2772:00 +CPU= 18.569
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002772
  16:09:35 STEP 2773 H=2773:00 +CPU= 10.867
  16:09:46 STEP 2774 H=2774:00 +CPU= 10.913
  16:10:03 STEP 2775 H=2775:00 +CPU= 16.733
  16:10:14 STEP 2776 H=2776:00 +CPU= 11.156
  16:10:25 STEP 2777 H=2777:00 +CPU= 10.593
  16:10:42 STEP 2778 H=2778:00 +CPU= 17.004
  16:10:53 STEP 2779 H=2779:00 +CPU= 10.790
  16:11:04 STEP 2780 H=2780:00 +CPU= 11.034
  16:11:21 STEP 2781 H=2781:00 +CPU= 16.705
  16:11:32 STEP 2782 H=2782:00 +CPU= 11.185
  16:11:43 STEP 2783 H=2783:00 +CPU= 11.106
  16:12:03 STEP 2784 H=2784:00 +CPU= 19.734
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMGGhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMSHhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMGGhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMSHhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMUAhq0f+002772
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0985_2000050100_123_969_12186629_0_r1418431459_115.zip
Uploading the intermediate file: upload_file_115.zip
  16:12:14 STEP 2785 H=2785:00 +CPU= 10.698
  16:12:25 STEP 2786 H=2786:00 +CPU= 10.790
  16:12:41 STEP 2787 H=2787:00 +CPU= 16.747
  16:12:52 STEP 2788 H=2788:00 +CPU= 10.901
  16:13:03 STEP 2789 H=2789:00 +CPU= 10.546
  16:13:20 STEP 2790 H=2790:00 +CPU= 17.090
  16:13:31 STEP 2791 H=2791:00 +CPU= 10.813
  16:13:42 STEP 2792 H=2792:00 +CPU= 10.875
  16:13:59 STEP 2793 H=2793:00 +CPU= 16.798
  16:14:10 STEP 2794 H=2794:00 +CPU= 11.018
  16:14:20 STEP 2795 H=2795:00 +CPU= 10.741
  16:14:39 STEP 2796 H=2796:00 +CPU= 18.482
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002796
  16:14:49 STEP 2797 H=2797:00 +CPU= 10.680
  16:15:00 STEP 2798 H=2798:00 +CPU= 10.742
  16:15:17 STEP 2799 H=2799:00 +CPU= 16.678
  16:15:28 STEP 2800 H=2800:00 +CPU= 10.990
  16:15:39 STEP 2801 H=2801:00 +CPU= 10.608
  16:15:56 STEP 2802 H=2802:00 +CPU= 17.087
  16:16:06 STEP 2803 H=2803:00 +CPU= 10.693
  16:16:17 STEP 2804 H=2804:00 +CPU= 10.837
  16:16:34 STEP 2805 H=2805:00 +CPU= 16.744
  16:16:45 STEP 2806 H=2806:00 +CPU= 11.038
  16:16:56 STEP 2807 H=2807:00 +CPU= 10.914
  16:17:16 STEP 2808 H=2808:00 +CPU= 19.764
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMGGhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMSHhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMGGhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMSHhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMUAhq0f+002796
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0985_2000050100_123_969_12186629_0_r1418431459_116.zip
Uploading the intermediate file: upload_file_116.zip
  16:17:27 STEP 2809 H=2809:00 +CPU= 10.759
  16:17:37 STEP 2810 H=2810:00 +CPU= 10.856
  16:17:54 STEP 2811 H=2811:00 +CPU= 16.690
  16:18:05 STEP 2812 H=2812:00 +CPU= 10.982
  16:18:16 STEP 2813 H=2813:00 +CPU= 10.595
  16:18:33 STEP 2814 H=2814:00 +CPU= 16.967
  16:18:43 STEP 2815 H=2815:00 +CPU= 10.755
  16:18:54 STEP 2816 H=2816:00 +CPU= 10.870
  16:19:11 STEP 2817 H=2817:00 +CPU= 16.658
  16:19:22 STEP 2818 H=2818:00 +CPU= 11.153
  16:19:33 STEP 2819 H=2819:00 +CPU= 10.677
  16:19:52 STEP 2820 H=2820:00 +CPU= 18.630
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002820
  16:20:02 STEP 2821 H=2821:00 +CPU= 10.735
  16:20:13 STEP 2822 H=2822:00 +CPU= 10.751
  16:20:30 STEP 2823 H=2823:00 +CPU= 16.654
  16:20:41 STEP 2824 H=2824:00 +CPU= 11.023
  16:20:51 STEP 2825 H=2825:00 +CPU= 10.606
  16:21:08 STEP 2826 H=2826:00 +CPU= 16.927
  16:21:19 STEP 2827 H=2827:00 +CPU= 10.731
  16:21:30 STEP 2828 H=2828:00 +CPU= 10.910
  16:21:47 STEP 2829 H=2829:00 +CPU= 16.761
  16:21:58 STEP 2830 H=2830:00 +CPU= 10.978
  16:22:09 STEP 2831 H=2831:00 +CPU= 10.895
  16:22:28 STEP 2832 H=2832:00 +CPU= 19.706
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMGGhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMSHhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMGGhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMSHhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMUAhq0f+002820
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0985_2000050100_123_969_12186629_0_r1418431459_117.zip
Uploading the intermediate file: upload_file_117.zip
  16:22:39 STEP 2833 H=2833:00 +CPU= 10.758
  16:22:50 STEP 2834 H=2834:00 +CPU= 10.882
Uploading trickle at timestep: 10195200
  16:23:07 STEP 2835 H=2835:00 +CPU= 16.638
  16:23:18 STEP 2836 H=2836:00 +CPU= 10.873
  16:23:28 STEP 2837 H=2837:00 +CPU= 10.544
  16:23:45 STEP 2838 H=2838:00 +CPU= 17.072
  16:23:56 STEP 2839 H=2839:00 +CPU= 10.713
  16:24:07 STEP 2840 H=2840:00 +CPU= 10.910
  16:24:24 STEP 2841 H=2841:00 +CPU= 16.757
  16:24:35 STEP 2842 H=2842:00 +CPU= 11.098
  16:24:45 STEP 2843 H=2843:00 +CPU= 10.600
  16:25:04 STEP 2844 H=2844:00 +CPU= 18.646
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002844
  16:25:15 STEP 2845 H=2845:00 +CPU= 10.724
  16:25:26 STEP 2846 H=2846:00 +CPU= 10.801
  16:25:42 STEP 2847 H=2847:00 +CPU= 16.621
  16:25:53 STEP 2848 H=2848:00 +CPU= 10.981
  16:26:04 STEP 2849 H=2849:00 +CPU= 10.487
  16:26:21 STEP 2850 H=2850:00 +CPU= 17.002
  16:26:31 STEP 2851 H=2851:00 +CPU= 10.705
  16:26:42 STEP 2852 H=2852:00 +CPU= 10.967
  16:26:59 STEP 2853 H=2853:00 +CPU= 16.562
  16:27:10 STEP 2854 H=2854:00 +CPU= 10.992
  16:27:21 STEP 2855 H=2855:00 +CPU= 10.817
  16:27:41 STEP 2856 H=2856:00 +CPU= 19.905
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMGGhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMSHhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMGGhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMSHhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMUAhq0f+002844
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0985_2000050100_123_969_12186629_0_r1418431459_118.zip
Uploading the intermediate file: upload_file_118.zip
  16:27:52 STEP 2857 H=2857:00 +CPU= 10.852
  16:28:03 STEP 2858 H=2858:00 +CPU= 10.906
  16:28:19 STEP 2859 H=2859:00 +CPU= 16.738
  16:28:30 STEP 2860 H=2860:00 +CPU= 11.080
  16:28:41 STEP 2861 H=2861:00 +CPU= 10.688
  16:28:58 STEP 2862 H=2862:00 +CPU= 17.075
  16:29:09 STEP 2863 H=2863:00 +CPU= 10.850
  16:29:20 STEP 2864 H=2864:00 +CPU= 11.000
  16:29:37 STEP 2865 H=2865:00 +CPU= 16.700
  16:29:48 STEP 2866 H=2866:00 +CPU= 11.098
  16:29:59 STEP 2867 H=2867:00 +CPU= 10.687
  16:30:17 STEP 2868 H=2868:00 +CPU= 18.718
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002868
  16:30:28 STEP 2869 H=2869:00 +CPU= 10.752
  16:30:39 STEP 2870 H=2870:00 +CPU= 10.893
  16:30:56 STEP 2871 H=2871:00 +CPU= 16.692
  16:31:07 STEP 2872 H=2872:00 +CPU= 10.980
  16:31:17 STEP 2873 H=2873:00 +CPU= 10.496
  16:31:34 STEP 2874 H=2874:00 +CPU= 16.998
  16:31:45 STEP 2875 H=2875:00 +CPU= 10.627
  16:31:56 STEP 2876 H=2876:00 +CPU= 10.882
  16:32:12 STEP 2877 H=2877:00 +CPU= 16.649
  16:32:23 STEP 2878 H=2878:00 +CPU= 10.924
  16:32:34 STEP 2879 H=2879:00 +CPU= 10.913
  16:32:54 STEP 2880 H=2880:00 +CPU= 19.818
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMGGhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMSHhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMGGhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMSHhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMUAhq0f+002868
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0985_2000050100_123_969_12186629_0_r1418431459_119.zip
Uploading the intermediate file: upload_file_119.zip
  16:33:05 STEP 2881 H=2881:00 +CPU= 10.709
  16:33:16 STEP 2882 H=2882:00 +CPU= 10.858
  16:33:34 STEP 2883 H=2883:00 +CPU= 17.863
  16:33:46 STEP 2884 H=2884:00 +CPU= 12.024
  16:33:57 STEP 2885 H=2885:00 +CPU= 11.633
  16:34:16 STEP 2886 H=2886:00 +CPU= 18.741
  16:34:28 STEP 2887 H=2887:00 +CPU= 11.886
  16:34:40 STEP 2888 H=2888:00 +CPU= 12.057
  16:34:58 STEP 2889 H=2889:00 +CPU= 18.288
  16:35:10 STEP 2890 H=2890:00 +CPU= 12.051
  16:35:22 STEP 2891 H=2891:00 +CPU= 11.809
  16:35:43 STEP 2892 H=2892:00 +CPU= 20.362
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002892
  16:35:54 STEP 2893 H=2893:00 +CPU= 11.774
  16:36:07 STEP 2894 H=2894:00 +CPU= 12.084
  16:36:25 STEP 2895 H=2895:00 +CPU= 18.419
  16:36:37 STEP 2896 H=2896:00 +CPU= 11.975
  16:36:49 STEP 2897 H=2897:00 +CPU= 11.891
  16:37:08 STEP 2898 H=2898:00 +CPU= 18.832
  16:37:20 STEP 2899 H=2899:00 +CPU= 11.850
  16:37:32 STEP 2900 H=2900:00 +CPU= 12.332
  16:37:50 STEP 2901 H=2901:00 +CPU= 18.416
  16:38:02 STEP 2902 H=2902:00 +CPU= 11.900
  16:38:15 STEP 2903 H=2903:00 +CPU= 12.162
  16:38:36 STEP 2904 H=2904:00 +CPU= 21.668
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMGGhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMSHhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMGGhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMSHhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMUAhq0f+002892
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0985_2000050100_123_969_12186629_0_r1418431459_120.zip
Uploading the intermediate file: upload_file_120.zip
  16:38:48 STEP 2905 H=2905:00 +CPU= 11.776
  16:39:00 STEP 2906 H=2906:00 +CPU= 12.033
  16:39:19 STEP 2907 H=2907:00 +CPU= 18.401
  16:39:31 STEP 2908 H=2908:00 +CPU= 12.000
  16:39:42 STEP 2909 H=2909:00 +CPU= 11.927
  16:40:01 STEP 2910 H=2910:00 +CPU= 18.796
  16:40:13 STEP 2911 H=2911:00 +CPU= 11.946
  16:40:25 STEP 2912 H=2912:00 +CPU= 12.204
  16:40:44 STEP 2913 H=2913:00 +CPU= 18.393
  16:40:56 STEP 2914 H=2914:00 +CPU= 12.037
  16:41:08 STEP 2915 H=2915:00 +CPU= 11.714
  16:41:28 STEP 2916 H=2916:00 +CPU= 20.350
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002916
  16:41:40 STEP 2917 H=2917:00 +CPU= 11.754
  16:41:52 STEP 2918 H=2918:00 +CPU= 11.969
  16:42:10 STEP 2919 H=2919:00 +CPU= 18.341
  16:42:22 STEP 2920 H=2920:00 +CPU= 12.051
  16:42:34 STEP 2921 H=2921:00 +CPU= 11.825
  16:42:53 STEP 2922 H=2922:00 +CPU= 18.653
  16:43:05 STEP 2923 H=2923:00 +CPU= 11.820
  16:43:17 STEP 2924 H=2924:00 +CPU= 12.111
  16:43:35 STEP 2925 H=2925:00 +CPU= 18.328
  16:43:47 STEP 2926 H=2926:00 +CPU= 12.182
  16:43:59 STEP 2927 H=2927:00 +CPU= 12.071
  16:44:21 STEP 2928 H=2928:00 +CPU= 21.733
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMGGhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMSHhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMGGhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMSHhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMUAhq0f+002916
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0985_2000050100_123_969_12186629_0_r1418431459_121.zip
Uploading the intermediate file: upload_file_121.zip
  16:44:33 STEP 2929 H=2929:00 +CPU= 11.787
  16:44:45 STEP 2930 H=2930:00 +CPU= 12.133
  16:45:04 STEP 2931 H=2931:00 +CPU= 18.383
  16:45:16 STEP 2932 H=2932:00 +CPU= 12.301
  16:45:28 STEP 2933 H=2933:00 +CPU= 11.885
  16:45:47 STEP 2934 H=2934:00 +CPU= 18.984
  16:45:59 STEP 2935 H=2935:00 +CPU= 12.012
  16:46:11 STEP 2936 H=2936:00 +CPU= 12.199
  16:46:30 STEP 2937 H=2937:00 +CPU= 18.606
  16:46:42 STEP 2938 H=2938:00 +CPU= 12.257
[EC_DRHOOK:5600-01:1:1:2312:2312] [20230115:164710:1673797630:29583.225] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1538] Received signal#15 (SIGTERM) :: 4749MB (heap), 4418MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:5600-01:1:1:2312:2312] [20230115:164710:1673797630:29583.227] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:5600-01:1:1:2312:2312] [20230115:164710:1673797630:29583.227] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x81f3c0 (old at (nil))
[EC_DRHOOK:5600-01:1:1:2312:2312] [20230115:164710:1673797630:29583.227] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1617] Signal#15 was caused by unrecognized si_code [memaddr=0x1], nsigs = 1
[EC_DRHOOK:5600-01:1:1:2312:2312] [20230115:164710:1673797630:29583.229] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#15, nsigs = 1
[EC_DRHOOK:5600-01:1:1:2312:2312] [20230115:164710:1673797630:29583.229] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3843] 4749 MB (maxheap), 4418 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:5600-01:1:1:2312:2312] [20230115:164710:1673797630:29583.232] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :  MASTER 
[EC_DRHOOK:5600-01:1:1:2312:2312] [20230115:164710:1673797630:29583.233] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :   CNT0 
[EC_DRHOOK:5600-01:1:1:2312:2312] [20230115:164710:1673797630:29583.233] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :    CNT1 
[EC_DRHOOK:5600-01:1:1:2312:2312] [20230115:164710:1673797630:29583.233] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :     CNT2 
[EC_DRHOOK:5600-01:1:1:2312:2312] [20230115:164710:1673797630:29583.234] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :      CNT3 
[EC_DRHOOK:5600-01:1:1:2312:2312] [20230115:164710:1673797630:29583.234] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :       CNT4 
[EC_DRHOOK:5600-01:1:1:2312:2312] [20230115:164710:1673797630:29583.234] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :        STEPO 
[EC_DRHOOK:5600-01:1:1:2312:2312] [20230115:164710:1673797630:29583.234] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :         SCAN2M 
[EC_DRHOOK:5600-01:1:1:2312:2312] [20230115:164710:1673797630:29583.234] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :          GP_MODEL_HEAP 
[EC_DRHOOK:5600-01:1:1:2312:2312] [20230115:164710:1673797630:29583.234] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :           GP_MODEL 
[EC_DRHOOK:5600-01:1:1:2312:2312] [20230115:164710:1673797630:29583.234] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :            CALL_SL_HEAP 
[EC_DRHOOK:5600-01:1:1:2312:2312] [20230115:164710:1673797630:29583.234] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :             CALL_SL 
[EC_DRHOOK:5600-01:1:1:2312:2312] [20230115:164710:1673797630:29583.234] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :              >OMP-CALL_SL     2        (1005) 
[EC_DRHOOK:5600-01:1:1:2312:2312] [20230115:164710:1673797630:29583.234] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :               LAPINEB 
[EC_DRHOOK:5600-01:1:1:2312:2312] [20230115:164710:1673797630:29583.234] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :                LARCINB 
[EC_DRHOOK:5600-01:1:1:2312:2312] [20230115:164710:1673797630:29583.234] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :                 LAITLI 
[EC_DRHOOK:5600-01:1:1:2312:2312] [20230115:164711:1673797631:29584.234] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#15, nsigs = 1
[EC_DRHOOK:5600-01:1:1:2312:2312] [20230115:164711:1673797631:29584.234] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1ce8bb0 for signal#15, nsigs = 1
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
oifs_43r3_model.e  0000000001CE916B  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000081FFF1  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DC9090  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000000C1A981  laitli_                   157  laitli.F90
oifs_43r3_model.e  0000000000DC633B  larcinb_                  957  larcinb.F90
oifs_43r3_model.e  0000000000D7EBA8  lapineb_                  451  lapineb.F90
oifs_43r3_model.e  0000000000D7B935  call_sl_                  363  call_sl.F90
oifs_43r3_model.e  0000000000D784FD  call_sl_heap_              94  call_sl_heap.F90
oifs_43r3_model.e  0000000000BF9958  gp_model_                 533  gp_model.F90
oifs_43r3_model.e  00000000012E9482  gp_model_heap_             74  gp_model_heap.F90
oifs_43r3_model.e  0000000000BBC1CE  scan2m_                   535  scan2m.F90
oifs_43r3_model.e  000000000057A664  stepo_                    327  stepo.F90
oifs_43r3_model.e  000000000055DEEC  cnt4_                    1133  cnt4.F90
oifs_43r3_model.e  00000000005471C9  cnt3_                     267  cnt3.F90
oifs_43r3_model.e  0000000000546412  cnt2_                      88  cnt2.F90
oifs_43r3_model.e  0000000000545E28  cnt1_                      92  cnt1.F90
oifs_43r3_model.e  000000000040708D  cnt0_                     146  cnt0.F90
oifs_43r3_model.e  000000000040220F  MAIN__                     96  master.F90
oifs_43r3_model.e  00000000004021A2  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCA390  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000040206E  Unknown               Unknown  Unknown
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2000050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0985
(argv4) batchid: 969
(argv5) wuid: 12186629
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/0
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_a7d74a58d56e3349ce1b8ee87f7d904b to: /var/lib/boinc-client/slots/0/oifs_43r3_ps_0985_2000050100_123_969_12186629.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/0/oifs_43r3_ps_0985_2000050100_123_969_12186629.zip
ic_ancil_file: ic_ancil_12186629
ifsdata_file: ifsdata_12186629
climate_data_file: clim_data_12186629
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_13d41337ce50207ffc6b1e9860bc3556 to: /var/lib/boinc-client/slots/0/ic_ancil_12186629.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/0/ic_ancil_12186629.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_0a345fb680d14d86b1931dd5a8ef2836 to: /var/lib/boinc-client/slots/0/ifsdata/ifsdata_12186629.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/0/ifsdata/ifsdata_12186629.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/0/159l_2/clim_data_12186629.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/0/159l_2/clim_data_12186629.zip
Checking for progress XML file: /var/lib/boinc-client/slots/0/progress_file_12186629.xml
Opened progress file ok : /var/lib/boinc-client/slots/0/progress_file_12186629.xml
-- Model is restarting --
Adjusting last_iter, 2939, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/0/progress_file_12186629.xml
last_cpu_time: 38339
upload_file_number: 122
last_iter: 2927
last_upload: 10540800
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0985_2000050100_123_969_12186629_0_r1418431459
The child process has been launched with process id: 2302
Executing the command: /var/lib/boinc-client/slots/0/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:5600-01:1:1:2302:2302] [20230115:171304:1673799184:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:5600-01:1:1:2302:2302] [20230115:171304:1673799184:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:5600-01:1:1:2302:2302] [20230115:171304:1673799184:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:5600-01:1:1:2302:2302] [20230115:171304:1673799184:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:5600-01:1:1:2302:2302] [20230115:171304:1673799184:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:5600-01:1:1:2302:2302] [20230115:171304:1673799184:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:5600-01:1:1:2302:2302] [20230115:171304:1673799184:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:5600-01:1:1:2302:2302] [20230115:171304:1673799184:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:5600-01:1:1:2302:2302] [20230115:171304:1673799184:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:5600-01:1:1:2302:2302] [20230115:171304:1673799184:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:5600-01:1:1:2302:2302] [20230115:171304:1673799184:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:5600-01:1:1:2302:2302] [20230115:171304:1673799184:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:5600-01:1:1:2302:2302] [20230115:171304:1673799184:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:5600-01:1:1:2302:2302] [20230115:171304:1673799184:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:5600-01:1:1:2302:2302] [20230115:171304:1673799184:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:5600-01:1:1:2302:2302] [20230115:171304:1673799184:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:5600-01:1:1:2302:2302] [20230115:171304:1673799184:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:5600-01:1:1:2302:2302] [20230115:171304:1673799184:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:5600-01:1:1:2302:2302] [20230115:171304:1673799184:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:5600-01:1:1:2302:2302] [20230115:171304:1673799184:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:5600-01:1:1:2302:2302] [20230115:171304:1673799184:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:5600-01:1:1:2302:2302] [20230115:171304:1673799184:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:5600-01:1:1:2302:2302] [20230115:171304:1673799184:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:5600-01:1:1:2302:2302] [20230115:171304:1673799184:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:5600-01:1:1:2302:2302] [20230115:171304:1673799184:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:5600-01:1:1:2302:2302] [20230115:171304:1673799184:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:5600-01:1:1:2302:2302] [20230115:171304:1673799184:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:5600-01:1:1:2302:2302] [20230115:171304:1673799184:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:5600-01:1:1:2302:2302] [20230115:171304:1673799184:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:5600-01:1:1:2302:2302] [20230115:171304:1673799184:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  17:13:26 STEP 2928 H=2928:00 +CPU= 19.045
  17:13:36 STEP 2929 H=2929:00 +CPU= 10.894
  17:13:47 STEP 2930 H=2930:00 +CPU= 10.933
  17:14:04 STEP 2931 H=2931:00 +CPU= 16.727
  17:14:15 STEP 2932 H=2932:00 +CPU= 10.960
  17:14:26 STEP 2933 H=2933:00 +CPU= 10.619
  17:14:43 STEP 2934 H=2934:00 +CPU= 17.015
  17:14:54 STEP 2935 H=2935:00 +CPU= 10.722
  17:15:04 STEP 2936 H=2936:00 +CPU= 10.893
  17:15:21 STEP 2937 H=2937:00 +CPU= 16.601
  17:15:32 STEP 2938 H=2938:00 +CPU= 10.789
  17:15:42 STEP 2939 H=2939:00 +CPU= 10.451
  17:16:01 STEP 2940 H=2940:00 +CPU= 18.247
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002940
  17:16:11 STEP 2941 H=2941:00 +CPU= 10.633
  17:16:22 STEP 2942 H=2942:00 +CPU= 10.699
  17:16:38 STEP 2943 H=2943:00 +CPU= 16.430
  17:16:49 STEP 2944 H=2944:00 +CPU= 10.752
  17:17:00 STEP 2945 H=2945:00 +CPU= 10.404
  17:17:16 STEP 2946 H=2946:00 +CPU= 16.670
  17:17:27 STEP 2947 H=2947:00 +CPU= 10.522
  17:17:38 STEP 2948 H=2948:00 +CPU= 10.698
  17:17:54 STEP 2949 H=2949:00 +CPU= 16.425
  17:18:05 STEP 2950 H=2950:00 +CPU= 10.785
  17:18:16 STEP 2951 H=2951:00 +CPU= 10.755
  17:18:34 STEP 2952 H=2952:00 +CPU= 18.873
The child process terminated with status: 0
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMGGhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMUAhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMSHhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMGGhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMSHhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMSHhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMGGhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12186629/ICMUAhq0f+002952
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0985_2000050100_123_969_12186629_0_r1418431459_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
17:21:56 (1450): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:20:58 1537207 22272015 oifs_43r3_ps_0985_2000050100_123_969_12186629_0 10,623,600 38,668 0.0036
09 May 2023 16:20:56 1537207 22272015 oifs_43r3_ps_0985_2000050100_123_969_12186629_0 10,195,200 36,885 0.0036
09 May 2023 16:20:52 1537207 22272015 oifs_43r3_ps_0985_2000050100_123_969_12186629_0 9,331,200 33,761 0.0036
09 May 2023 16:20:48 1537207 22272015 oifs_43r3_ps_0985_2000050100_123_969_12186629_0 8,467,200 30,646 0.0036
09 May 2023 16:20:48 1537207 22272015 oifs_43r3_ps_0985_2000050100_123_969_12186629_0 7,603,200 27,552 0.0036
09 May 2023 16:20:44 1537207 22272015 oifs_43r3_ps_0985_2000050100_123_969_12186629_0 6,739,200 24,459 0.0036
09 May 2023 16:20:40 1537207 22272015 oifs_43r3_ps_0985_2000050100_123_969_12186629_0 5,875,200 21,335 0.0036
09 May 2023 16:20:35 1537207 22272015 oifs_43r3_ps_0985_2000050100_123_969_12186629_0 5,011,200 18,211 0.0036
09 May 2023 16:20:32 1537207 22272015 oifs_43r3_ps_0985_2000050100_123_969_12186629_0 4,147,200 15,077 0.0036
09 May 2023 16:20:28 1537207 22272015 oifs_43r3_ps_0985_2000050100_123_969_12186629_0 3,283,200 11,949 0.0036
09 May 2023 16:20:05 1537207 22272015 oifs_43r3_ps_0985_2000050100_123_969_12186629_0 1,728,000 6,206 0.0036
09 May 2023 16:20:01 1537207 22272015 oifs_43r3_ps_0985_2000050100_123_969_12186629_0 864,000 3,082 0.0036


©2024 climateprediction.net