climateprediction.net home page
Task 22291232

Task 22291232

Name oifs_43r3_ps_0080_2019050100_123_988_12204724_0
Workunit 12204724
Created 24 Dec 2022, 22:20:10 UTC
Sent 22 Jan 2023, 13:49:40 UTC
Report deadline 23 Mar 2023, 13:49:40 UTC
Received 26 Jan 2023, 1:40:13 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 9 (0x00000009) Unknown error code
Computer ID 1537295
Run time 23 hours 29 min 25 sec
CPU time 23 hours 22 min 52 sec
Validate state Invalid
Credit 10,886.40
Device peak FLOPS 5.16 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,400.21 MB
Peak swap size 4,974.29 MB
Peak disk usage 1,885.09 MB
Stderr
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<message>
process exited with code 9 (0x9, -247)</message>
<stderr_txt>
le: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_0080_2019050100_123_988_12204724_0_r1412895912_68.zip
Uploading the intermediate file: upload_file_68.zip
  18:33:08 STEP 1657 H=1657:00 +CPU= 29.774
  18:33:39 STEP 1658 H=1658:00 +CPU= 30.356
  18:34:22 STEP 1659 H=1659:00 +CPU= 43.178
  18:34:54 STEP 1660 H=1660:00 +CPU= 31.218
  18:35:25 STEP 1661 H=1661:00 +CPU= 30.914
  18:36:12 STEP 1662 H=1662:00 +CPU= 47.116
  18:36:43 STEP 1663 H=1663:00 +CPU= 30.722
  18:37:15 STEP 1664 H=1664:00 +CPU= 31.405
  18:38:01 STEP 1665 H=1665:00 +CPU= 46.154
  18:38:33 STEP 1666 H=1666:00 +CPU= 31.896
  18:39:04 STEP 1667 H=1667:00 +CPU= 30.985
  18:39:56 STEP 1668 H=1668:00 +CPU= 51.552
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+001668
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+001668
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+001668
  18:40:26 STEP 1669 H=1669:00 +CPU= 30.375
  18:40:58 STEP 1670 H=1670:00 +CPU= 31.441
  18:41:44 STEP 1671 H=1671:00 +CPU= 46.140
  18:42:16 STEP 1672 H=1672:00 +CPU= 31.528
  18:42:47 STEP 1673 H=1673:00 +CPU= 30.766
  18:43:34 STEP 1674 H=1674:00 +CPU= 47.311
  18:44:04 STEP 1675 H=1675:00 +CPU= 29.960
  18:44:36 STEP 1676 H=1676:00 +CPU= 31.193
  18:45:23 STEP 1677 H=1677:00 +CPU= 47.138
  18:45:54 STEP 1678 H=1678:00 +CPU= 31.241
  18:46:26 STEP 1679 H=1679:00 +CPU= 31.316
  18:47:21 STEP 1680 H=1680:00 +CPU= 55.102
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+001680
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+001680
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+001680
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+001656
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+001656
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+001656
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+001668
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+001668
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+001668
Zipping up the intermediate file: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_0080_2019050100_123_988_12204724_0_r1412895912_69.zip
Uploading the intermediate file: upload_file_69.zip
Uploading trickle at timestep: 6048000
  18:47:52 STEP 1681 H=1681:00 +CPU= 30.155
  18:48:23 STEP 1682 H=1682:00 +CPU= 30.988
  18:49:10 STEP 1683 H=1683:00 +CPU= 46.838
  18:49:41 STEP 1684 H=1684:00 +CPU= 31.439
  18:50:12 STEP 1685 H=1685:00 +CPU= 30.569
  18:50:59 STEP 1686 H=1686:00 +CPU= 46.941
  18:51:30 STEP 1687 H=1687:00 +CPU= 30.492
  18:52:01 STEP 1688 H=1688:00 +CPU= 31.302
  18:52:48 STEP 1689 H=1689:00 +CPU= 45.513
  18:53:19 STEP 1690 H=1690:00 +CPU= 31.777
  18:53:50 STEP 1691 H=1691:00 +CPU= 30.538
  18:54:40 STEP 1692 H=1692:00 +CPU= 49.812
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+001692
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+001692
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+001692
  18:55:09 STEP 1693 H=1693:00 +CPU= 28.811
  18:55:40 STEP 1694 H=1694:00 +CPU= 30.614
  18:56:27 STEP 1695 H=1695:00 +CPU= 47.416
  18:56:58 STEP 1696 H=1696:00 +CPU= 30.769
  18:57:30 STEP 1697 H=1697:00 +CPU= 31.167
  18:58:16 STEP 1698 H=1698:00 +CPU= 46.568
  18:58:47 STEP 1699 H=1699:00 +CPU= 30.783
  18:59:19 STEP 1700 H=1700:00 +CPU= 31.786
  19:00:06 STEP 1701 H=1701:00 +CPU= 47.146
  19:00:38 STEP 1702 H=1702:00 +CPU= 31.347
  19:01:09 STEP 1703 H=1703:00 +CPU= 31.176
  19:02:03 STEP 1704 H=1704:00 +CPU= 54.065
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+001704
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+001704
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+001704
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+001680
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+001680
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+001680
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+001692
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+001692
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+001692
Zipping up the intermediate file: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_0080_2019050100_123_988_12204724_0_r1412895912_70.zip
Uploading the intermediate file: upload_file_70.zip
  19:02:34 STEP 1705 H=1705:00 +CPU= 30.386
  19:03:06 STEP 1706 H=1706:00 +CPU= 31.879
  19:03:52 STEP 1707 H=1707:00 +CPU= 45.978
  19:04:24 STEP 1708 H=1708:00 +CPU= 31.263
  19:04:55 STEP 1709 H=1709:00 +CPU= 31.135
  19:05:42 STEP 1710 H=1710:00 +CPU= 47.177
  19:06:13 STEP 1711 H=1711:00 +CPU= 30.252
  19:06:44 STEP 1712 H=1712:00 +CPU= 31.232
  19:07:31 STEP 1713 H=1713:00 +CPU= 46.704
  19:08:03 STEP 1714 H=1714:00 +CPU= 31.569
  19:08:33 STEP 1715 H=1715:00 +CPU= 30.256
  19:09:25 STEP 1716 H=1716:00 +CPU= 51.440
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+001716
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+001716
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+001716
  19:09:55 STEP 1717 H=1717:00 +CPU= 30.169
  19:10:27 STEP 1718 H=1718:00 +CPU= 31.574
  19:11:14 STEP 1719 H=1719:00 +CPU= 46.920
  19:11:45 STEP 1720 H=1720:00 +CPU= 30.883
  19:12:15 STEP 1721 H=1721:00 +CPU= 29.965
  19:13:02 STEP 1722 H=1722:00 +CPU= 46.921
  19:13:33 STEP 1723 H=1723:00 +CPU= 30.350
  19:14:04 STEP 1724 H=1724:00 +CPU= 31.404
  19:14:49 STEP 1725 H=1725:00 +CPU= 44.951
  19:15:20 STEP 1726 H=1726:00 +CPU= 30.430
  19:15:50 STEP 1727 H=1727:00 +CPU= 29.890
  19:16:42 STEP 1728 H=1728:00 +CPU= 52.153
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+001728
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+001728
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+001728
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+001704
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+001704
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+001704
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+001716
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+001716
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+001716
Zipping up the intermediate file: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_0080_2019050100_123_988_12204724_0_r1412895912_71.zip
Uploading the intermediate file: upload_file_71.zip
  19:17:13 STEP 1729 H=1729:00 +CPU= 30.758
  19:17:44 STEP 1730 H=1730:00 +CPU= 31.014
  19:18:32 STEP 1731 H=1731:00 +CPU= 47.524
  19:19:04 STEP 1732 H=1732:00 +CPU= 31.414
  19:19:35 STEP 1733 H=1733:00 +CPU= 31.407
  19:20:22 STEP 1734 H=1734:00 +CPU= 46.411
  19:20:54 STEP 1735 H=1735:00 +CPU= 31.700
  19:21:27 STEP 1736 H=1736:00 +CPU= 32.703
  19:22:14 STEP 1737 H=1737:00 +CPU= 46.903
  19:22:46 STEP 1738 H=1738:00 +CPU= 32.119
  19:23:17 STEP 1739 H=1739:00 +CPU= 30.896
  19:24:10 STEP 1740 H=1740:00 +CPU= 52.113
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+001740
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+001740
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+001740
  19:24:42 STEP 1741 H=1741:00 +CPU= 32.054
  19:25:14 STEP 1742 H=1742:00 +CPU= 32.354
  19:26:01 STEP 1743 H=1743:00 +CPU= 46.948
  19:26:34 STEP 1744 H=1744:00 +CPU= 32.131
  19:27:05 STEP 1745 H=1745:00 +CPU= 31.092
  19:27:54 STEP 1746 H=1746:00 +CPU= 48.985
  19:28:26 STEP 1747 H=1747:00 +CPU= 31.502
  19:28:59 STEP 1748 H=1748:00 +CPU= 32.897
  19:29:46 STEP 1749 H=1749:00 +CPU= 46.672
  19:30:19 STEP 1750 H=1750:00 +CPU= 32.621
  19:30:51 STEP 1751 H=1751:00 +CPU= 32.213
  19:31:46 STEP 1752 H=1752:00 +CPU= 55.047
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+001752
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+001752
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+001752
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+001728
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+001728
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+001728
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+001740
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+001740
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+001740
Zipping up the intermediate file: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_0080_2019050100_123_988_12204724_0_r1412895912_72.zip
Uploading the intermediate file: upload_file_72.zip
  19:32:18 STEP 1753 H=1753:00 +CPU= 31.724
  19:32:51 STEP 1754 H=1754:00 +CPU= 32.185
  19:33:38 STEP 1755 H=1755:00 +CPU= 47.411
  19:34:11 STEP 1756 H=1756:00 +CPU= 32.340
  19:34:42 STEP 1757 H=1757:00 +CPU= 31.392
  19:35:30 STEP 1758 H=1758:00 +CPU= 47.922
  19:36:02 STEP 1759 H=1759:00 +CPU= 31.527
  19:36:33 STEP 1760 H=1760:00 +CPU= 31.229
  19:37:19 STEP 1761 H=1761:00 +CPU= 44.943
  19:37:50 STEP 1762 H=1762:00 +CPU= 31.087
  19:38:22 STEP 1763 H=1763:00 +CPU= 31.744
  19:39:14 STEP 1764 H=1764:00 +CPU= 52.138
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+001764
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+001764
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+001764
  19:39:45 STEP 1765 H=1765:00 +CPU= 30.939
  19:40:17 STEP 1766 H=1766:00 +CPU= 31.946
  19:41:05 STEP 1767 H=1767:00 +CPU= 47.668
  19:41:37 STEP 1768 H=1768:00 +CPU= 31.831
  19:42:08 STEP 1769 H=1769:00 +CPU= 31.371
  19:42:58 STEP 1770 H=1770:00 +CPU= 49.036
  19:43:28 STEP 1771 H=1771:00 +CPU= 30.003
  19:44:00 STEP 1772 H=1772:00 +CPU= 32.073
  19:44:48 STEP 1773 H=1773:00 +CPU= 47.988
  19:45:20 STEP 1774 H=1774:00 +CPU= 31.922
  19:45:53 STEP 1775 H=1775:00 +CPU= 32.688
  19:46:49 STEP 1776 H=1776:00 +CPU= 55.450
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+001776
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+001776
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+001776
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+001752
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+001752
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+001752
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+001764
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+001764
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+001764
Zipping up the intermediate file: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_0080_2019050100_123_988_12204724_0_r1412895912_73.zip
Uploading the intermediate file: upload_file_73.zip
  19:47:20 STEP 1777 H=1777:00 +CPU= 30.992
  19:47:53 STEP 1778 H=1778:00 +CPU= 32.302
  19:48:41 STEP 1779 H=1779:00 +CPU= 47.646
  19:49:14 STEP 1780 H=1780:00 +CPU= 32.728
  19:49:46 STEP 1781 H=1781:00 +CPU= 32.009
  19:50:37 STEP 1782 H=1782:00 +CPU= 50.355
  19:51:08 STEP 1783 H=1783:00 +CPU= 31.363
  19:51:41 STEP 1784 H=1784:00 +CPU= 32.454
  19:52:29 STEP 1785 H=1785:00 +CPU= 48.386
  19:53:03 STEP 1786 H=1786:00 +CPU= 32.874
  19:53:33 STEP 1787 H=1787:00 +CPU= 30.086
  19:54:26 STEP 1788 H=1788:00 +CPU= 52.317
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+001788
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+001788
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+001788
  19:54:57 STEP 1789 H=1789:00 +CPU= 31.576
  19:55:30 STEP 1790 H=1790:00 +CPU= 32.413
  19:56:19 STEP 1791 H=1791:00 +CPU= 49.282
  19:56:52 STEP 1792 H=1792:00 +CPU= 32.850
  19:57:22 STEP 1793 H=1793:00 +CPU= 29.405
  19:58:10 STEP 1794 H=1794:00 +CPU= 47.415
  19:58:40 STEP 1795 H=1795:00 +CPU= 30.123
  19:59:10 STEP 1796 H=1796:00 +CPU= 29.983
  19:59:57 STEP 1797 H=1797:00 +CPU= 47.043
  20:00:30 STEP 1798 H=1798:00 +CPU= 32.581
  20:01:03 STEP 1799 H=1799:00 +CPU= 32.748
  20:01:59 STEP 1800 H=1800:00 +CPU= 56.047
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+001800
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+001800
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+001800
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+001776
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+001776
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+001776
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+001788
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+001788
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+001788
Zipping up the intermediate file: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_0080_2019050100_123_988_12204724_0_r1412895912_74.zip
Uploading the intermediate file: upload_file_74.zip
  20:02:31 STEP 1801 H=1801:00 +CPU= 31.212
  20:03:04 STEP 1802 H=1802:00 +CPU= 33.156
  20:03:51 STEP 1803 H=1803:00 +CPU= 47.294
  20:04:25 STEP 1804 H=1804:00 +CPU= 33.053
  20:04:56 STEP 1805 H=1805:00 +CPU= 31.259
  20:05:47 STEP 1806 H=1806:00 +CPU= 50.103
  20:06:19 STEP 1807 H=1807:00 +CPU= 32.002
  20:06:52 STEP 1808 H=1808:00 +CPU= 33.251
  20:07:41 STEP 1809 H=1809:00 +CPU= 48.555
  20:08:14 STEP 1810 H=1810:00 +CPU= 32.981
  20:08:47 STEP 1811 H=1811:00 +CPU= 32.428
  20:09:40 STEP 1812 H=1812:00 +CPU= 52.911
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+001812
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+001812
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+001812
  20:10:12 STEP 1813 H=1813:00 +CPU= 32.459
  20:10:45 STEP 1814 H=1814:00 +CPU= 32.625
  20:11:32 STEP 1815 H=1815:00 +CPU= 47.014
  20:12:06 STEP 1816 H=1816:00 +CPU= 33.201
  20:12:38 STEP 1817 H=1817:00 +CPU= 31.749
  20:13:28 STEP 1818 H=1818:00 +CPU= 49.861
  20:13:59 STEP 1819 H=1819:00 +CPU= 31.585
  20:14:34 STEP 1820 H=1820:00 +CPU= 34.506
  20:15:22 STEP 1821 H=1821:00 +CPU= 47.326
  20:15:55 STEP 1822 H=1822:00 +CPU= 33.004
  20:16:27 STEP 1823 H=1823:00 +CPU= 32.171
  20:17:23 STEP 1824 H=1824:00 +CPU= 55.869
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+001824
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+001824
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+001824
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+001800
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+001800
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+001800
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+001812
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+001812
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+001812
Zipping up the intermediate file: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_0080_2019050100_123_988_12204724_0_r1412895912_75.zip
Uploading the intermediate file: upload_file_75.zip
  20:17:55 STEP 1825 H=1825:00 +CPU= 31.373
  20:18:29 STEP 1826 H=1826:00 +CPU= 33.698
  20:19:17 STEP 1827 H=1827:00 +CPU= 48.351
  20:19:50 STEP 1828 H=1828:00 +CPU= 32.894
  20:20:21 STEP 1829 H=1829:00 +CPU= 30.756
  20:21:09 STEP 1830 H=1830:00 +CPU= 47.216
  20:21:38 STEP 1831 H=1831:00 +CPU= 29.554
  20:22:12 STEP 1832 H=1832:00 +CPU= 33.001
  20:23:00 STEP 1833 H=1833:00 +CPU= 48.049
  20:23:32 STEP 1834 H=1834:00 +CPU= 32.623
  20:24:03 STEP 1835 H=1835:00 +CPU= 30.618
  20:24:59 STEP 1836 H=1836:00 +CPU= 55.077
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+001836
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+001836
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+001836
  20:25:31 STEP 1837 H=1837:00 +CPU= 31.866
  20:26:04 STEP 1838 H=1838:00 +CPU= 33.072
  20:26:53 STEP 1839 H=1839:00 +CPU= 48.424
  20:27:25 STEP 1840 H=1840:00 +CPU= 32.465
  20:27:57 STEP 1841 H=1841:00 +CPU= 31.284
  20:28:45 STEP 1842 H=1842:00 +CPU= 47.669
  20:29:16 STEP 1843 H=1843:00 +CPU= 31.832
  20:29:50 STEP 1844 H=1844:00 +CPU= 33.275
  20:30:38 STEP 1845 H=1845:00 +CPU= 47.936
  20:31:12 STEP 1846 H=1846:00 +CPU= 33.734
  20:31:45 STEP 1847 H=1847:00 +CPU= 32.690
  20:32:40 STEP 1848 H=1848:00 +CPU= 55.325
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+001848
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+001848
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+001848
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+001824
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+001824
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+001824
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+001836
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+001836
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+001836
Zipping up the intermediate file: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_0080_2019050100_123_988_12204724_0_r1412895912_76.zip
Uploading the intermediate file: upload_file_76.zip
  20:33:12 STEP 1849 H=1849:00 +CPU= 31.342
  20:33:45 STEP 1850 H=1850:00 +CPU= 32.729
  20:34:33 STEP 1851 H=1851:00 +CPU= 47.729
  20:35:06 STEP 1852 H=1852:00 +CPU= 33.341
  20:35:38 STEP 1853 H=1853:00 +CPU= 31.908
  20:36:29 STEP 1854 H=1854:00 +CPU= 50.214
  20:37:01 STEP 1855 H=1855:00 +CPU= 31.739
  20:37:34 STEP 1856 H=1856:00 +CPU= 33.081
  20:38:22 STEP 1857 H=1857:00 +CPU= 47.598
  20:38:55 STEP 1858 H=1858:00 +CPU= 32.831
  20:39:27 STEP 1859 H=1859:00 +CPU= 31.437
  20:40:22 STEP 1860 H=1860:00 +CPU= 55.032
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+001860
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+001860
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+001860
  20:40:54 STEP 1861 H=1861:00 +CPU= 31.831
  20:41:25 STEP 1862 H=1862:00 +CPU= 30.125
  20:42:14 STEP 1863 H=1863:00 +CPU= 48.649
  20:42:46 STEP 1864 H=1864:00 +CPU= 31.379
  20:43:16 STEP 1865 H=1865:00 +CPU= 30.585
  20:44:05 STEP 1866 H=1866:00 +CPU= 48.609
  20:44:38 STEP 1867 H=1867:00 +CPU= 32.453
  20:45:11 STEP 1868 H=1868:00 +CPU= 32.958
  20:46:00 STEP 1869 H=1869:00 +CPU= 49.378
  20:46:33 STEP 1870 H=1870:00 +CPU= 32.795
  20:47:06 STEP 1871 H=1871:00 +CPU= 32.748
  20:48:04 STEP 1872 H=1872:00 +CPU= 57.186
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+001872
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+001872
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+001872
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+001848
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+001848
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+001848
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+001860
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+001860
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+001860
Zipping up the intermediate file: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_0080_2019050100_123_988_12204724_0_r1412895912_77.zip
Uploading the intermediate file: upload_file_77.zip
  20:48:35 STEP 1873 H=1873:00 +CPU= 31.338
  20:49:08 STEP 1874 H=1874:00 +CPU= 32.793
  20:49:56 STEP 1875 H=1875:00 +CPU= 47.418
  20:50:30 STEP 1876 H=1876:00 +CPU= 33.394
  20:51:02 STEP 1877 H=1877:00 +CPU= 32.109
  20:51:51 STEP 1878 H=1878:00 +CPU= 48.417
  20:52:23 STEP 1879 H=1879:00 +CPU= 31.913
  20:52:57 STEP 1880 H=1880:00 +CPU= 33.062
  20:53:46 STEP 1881 H=1881:00 +CPU= 48.681
  20:54:18 STEP 1882 H=1882:00 +CPU= 32.285
  20:54:50 STEP 1883 H=1883:00 +CPU= 32.072
  20:55:45 STEP 1884 H=1884:00 +CPU= 54.302
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+001884
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+001884
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+001884
  20:56:17 STEP 1885 H=1885:00 +CPU= 32.344
  20:56:51 STEP 1886 H=1886:00 +CPU= 33.868
  20:57:41 STEP 1887 H=1887:00 +CPU= 49.028
  20:58:14 STEP 1888 H=1888:00 +CPU= 33.638
  20:58:46 STEP 1889 H=1889:00 +CPU= 31.582
  20:59:36 STEP 1890 H=1890:00 +CPU= 50.136
  21:00:08 STEP 1891 H=1891:00 +CPU= 31.765
  21:00:42 STEP 1892 H=1892:00 +CPU= 33.467
  21:01:31 STEP 1893 H=1893:00 +CPU= 48.767
  21:02:05 STEP 1894 H=1894:00 +CPU= 33.387
  21:02:38 STEP 1895 H=1895:00 +CPU= 32.944
  21:03:35 STEP 1896 H=1896:00 +CPU= 56.839
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+001896
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+001896
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+001896
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+001872
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+001872
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+001872
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+001884
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+001884
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+001884
Zipping up the intermediate file: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_0080_2019050100_123_988_12204724_0_r1412895912_78.zip
Uploading the intermediate file: upload_file_78.zip
  21:04:09 STEP 1897 H=1897:00 +CPU= 33.349
  21:04:41 STEP 1898 H=1898:00 +CPU= 31.916
  21:05:28 STEP 1899 H=1899:00 +CPU= 47.091
  21:06:00 STEP 1900 H=1900:00 +CPU= 31.917
  21:06:32 STEP 1901 H=1901:00 +CPU= 32.234
  21:07:23 STEP 1902 H=1902:00 +CPU= 50.779
  21:07:56 STEP 1903 H=1903:00 +CPU= 32.404
  21:08:29 STEP 1904 H=1904:00 +CPU= 33.441
  21:09:18 STEP 1905 H=1905:00 +CPU= 47.942
  21:09:51 STEP 1906 H=1906:00 +CPU= 33.248
  21:10:24 STEP 1907 H=1907:00 +CPU= 32.559
  21:11:18 STEP 1908 H=1908:00 +CPU= 53.582
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+001908
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+001908
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+001908
  21:11:51 STEP 1909 H=1909:00 +CPU= 32.727
  21:12:25 STEP 1910 H=1910:00 +CPU= 33.931
  21:13:15 STEP 1911 H=1911:00 +CPU= 50.431
  21:13:49 STEP 1912 H=1912:00 +CPU= 33.311
  21:14:22 STEP 1913 H=1913:00 +CPU= 33.215
  21:15:11 STEP 1914 H=1914:00 +CPU= 48.935
  21:15:44 STEP 1915 H=1915:00 +CPU= 32.276
  21:16:18 STEP 1916 H=1916:00 +CPU= 33.737
  21:17:07 STEP 1917 H=1917:00 +CPU= 48.655
  21:17:40 STEP 1918 H=1918:00 +CPU= 33.195
  21:18:14 STEP 1919 H=1919:00 +CPU= 34.236
  21:19:11 STEP 1920 H=1920:00 +CPU= 56.789
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+001920
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+001920
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+001920
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+001896
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+001896
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+001896
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+001908
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+001908
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+001908
Zipping up the intermediate file: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_0080_2019050100_123_988_12204724_0_r1412895912_79.zip
Uploading the intermediate file: upload_file_79.zip
Uploading trickle at timestep: 6912000
  21:19:44 STEP 1921 H=1921:00 +CPU= 32.968
  21:20:18 STEP 1922 H=1922:00 +CPU= 32.727
  21:21:08 STEP 1923 H=1923:00 +CPU= 49.997
  21:21:42 STEP 1924 H=1924:00 +CPU= 33.364
  21:22:13 STEP 1925 H=1925:00 +CPU= 31.679
  21:23:03 STEP 1926 H=1926:00 +CPU= 49.715
  21:23:37 STEP 1927 H=1927:00 +CPU= 33.597
  21:24:12 STEP 1928 H=1928:00 +CPU= 34.416
  21:25:00 STEP 1929 H=1929:00 +CPU= 48.075
  21:25:33 STEP 1930 H=1930:00 +CPU= 33.299
  21:26:06 STEP 1931 H=1931:00 +CPU= 32.116
  21:26:58 STEP 1932 H=1932:00 +CPU= 52.329
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+001932
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+001932
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+001932
  21:27:30 STEP 1933 H=1933:00 +CPU= 31.543
  21:28:02 STEP 1934 H=1934:00 +CPU= 31.478
  21:28:50 STEP 1935 H=1935:00 +CPU= 48.196
  21:29:23 STEP 1936 H=1936:00 +CPU= 32.938
  21:29:56 STEP 1937 H=1937:00 +CPU= 32.414
  21:30:47 STEP 1938 H=1938:00 +CPU= 51.048
  21:31:20 STEP 1939 H=1939:00 +CPU= 33.229
  21:31:54 STEP 1940 H=1940:00 +CPU= 33.351
  21:32:42 STEP 1941 H=1941:00 +CPU= 48.292
  21:33:17 STEP 1942 H=1942:00 +CPU= 34.316
  21:33:51 STEP 1943 H=1943:00 +CPU= 33.558
  21:34:49 STEP 1944 H=1944:00 +CPU= 57.525
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+001944
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+001944
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+001944
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+001920
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+001920
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+001920
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+001932
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+001932
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+001932
Zipping up the intermediate file: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_0080_2019050100_123_988_12204724_0_r1412895912_80.zip
Uploading the intermediate file: upload_file_80.zip
  21:35:21 STEP 1945 H=1945:00 +CPU= 32.685
  21:35:55 STEP 1946 H=1946:00 +CPU= 33.500
  21:36:44 STEP 1947 H=1947:00 +CPU= 48.488
  21:37:18 STEP 1948 H=1948:00 +CPU= 34.009
  21:37:50 STEP 1949 H=1949:00 +CPU= 31.925
  21:38:41 STEP 1950 H=1950:00 +CPU= 51.075
  21:39:14 STEP 1951 H=1951:00 +CPU= 32.625
  21:39:47 STEP 1952 H=1952:00 +CPU= 32.944
  21:40:38 STEP 1953 H=1953:00 +CPU= 49.978
  21:41:11 STEP 1954 H=1954:00 +CPU= 33.680
  21:41:44 STEP 1955 H=1955:00 +CPU= 32.294
  21:42:39 STEP 1956 H=1956:00 +CPU= 54.395
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+001956
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+001956
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+001956
  21:43:11 STEP 1957 H=1957:00 +CPU= 31.823
  21:43:43 STEP 1958 H=1958:00 +CPU= 32.522
  21:44:34 STEP 1959 H=1959:00 +CPU= 50.021
  21:45:07 STEP 1960 H=1960:00 +CPU= 33.069
  21:45:39 STEP 1961 H=1961:00 +CPU= 31.888
  21:46:30 STEP 1962 H=1962:00 +CPU= 50.604
  21:47:02 STEP 1963 H=1963:00 +CPU= 31.837
  21:47:34 STEP 1964 H=1964:00 +CPU= 32.613
  21:48:24 STEP 1965 H=1965:00 +CPU= 49.812
  21:48:58 STEP 1966 H=1966:00 +CPU= 33.377
  21:49:32 STEP 1967 H=1967:00 +CPU= 33.665
  21:50:27 STEP 1968 H=1968:00 +CPU= 55.394
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+001968
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+001968
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+001968
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+001944
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+001944
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+001944
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+001956
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+001956
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+001956
Zipping up the intermediate file: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_0080_2019050100_123_988_12204724_0_r1412895912_81.zip
Uploading the intermediate file: upload_file_81.zip
  21:50:58 STEP 1969 H=1969:00 +CPU= 30.376
  21:51:31 STEP 1970 H=1970:00 +CPU= 32.591
  21:52:20 STEP 1971 H=1971:00 +CPU= 49.127
  21:52:54 STEP 1972 H=1972:00 +CPU= 33.580
  21:53:26 STEP 1973 H=1973:00 +CPU= 31.754
  21:54:16 STEP 1974 H=1974:00 +CPU= 49.579
  21:54:48 STEP 1975 H=1975:00 +CPU= 32.011
  21:55:22 STEP 1976 H=1976:00 +CPU= 33.398
  21:56:12 STEP 1977 H=1977:00 +CPU= 49.684
  21:56:45 STEP 1978 H=1978:00 +CPU= 32.926
  21:57:14 STEP 1979 H=1979:00 +CPU= 28.968
  21:58:05 STEP 1980 H=1980:00 +CPU= 50.493
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+001980
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+001980
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+001980
  21:58:34 STEP 1981 H=1981:00 +CPU= 29.341
  21:59:05 STEP 1982 H=1982:00 +CPU= 30.911
  21:59:50 STEP 1983 H=1983:00 +CPU= 44.600
  22:00:20 STEP 1984 H=1984:00 +CPU= 29.794
  22:00:49 STEP 1985 H=1985:00 +CPU= 29.240
  22:01:34 STEP 1986 H=1986:00 +CPU= 44.859
  22:02:04 STEP 1987 H=1987:00 +CPU= 29.872
  22:02:35 STEP 1988 H=1988:00 +CPU= 30.217
  22:03:20 STEP 1989 H=1989:00 +CPU= 44.949
  22:03:51 STEP 1990 H=1990:00 +CPU= 30.625
  22:04:20 STEP 1991 H=1991:00 +CPU= 28.772
  22:05:13 STEP 1992 H=1992:00 +CPU= 52.915
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+001992
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+001992
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+001992
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+001968
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+001968
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+001968
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+001980
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+001980
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+001980
Zipping up the intermediate file: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_0080_2019050100_123_988_12204724_0_r1412895912_82.zip
Uploading the intermediate file: upload_file_82.zip
  22:05:42 STEP 1993 H=1993:00 +CPU= 28.943
  22:06:12 STEP 1994 H=1994:00 +CPU= 29.557
  22:06:57 STEP 1995 H=1995:00 +CPU= 45.408
  22:07:28 STEP 1996 H=1996:00 +CPU= 30.337
  22:07:58 STEP 1997 H=1997:00 +CPU= 29.568
  22:08:43 STEP 1998 H=1998:00 +CPU= 45.461
  22:09:12 STEP 1999 H=1999:00 +CPU= 29.018
  22:09:41 STEP 2000 H=2000:00 +CPU= 28.866
  22:10:26 STEP 2001 H=2001:00 +CPU= 44.081
  22:10:55 STEP 2002 H=2002:00 +CPU= 28.819
  22:11:22 STEP 2003 H=2003:00 +CPU= 27.035
  22:12:10 STEP 2004 H=2004:00 +CPU= 48.420
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+002004
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+002004
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+002004
  22:12:40 STEP 2005 H=2005:00 +CPU= 29.291
  22:13:09 STEP 2006 H=2006:00 +CPU= 29.136
  22:13:54 STEP 2007 H=2007:00 +CPU= 44.425
  22:14:24 STEP 2008 H=2008:00 +CPU= 30.478
  22:14:53 STEP 2009 H=2009:00 +CPU= 28.941
  22:15:39 STEP 2010 H=2010:00 +CPU= 45.393
  22:16:09 STEP 2011 H=2011:00 +CPU= 29.460
  22:16:39 STEP 2012 H=2012:00 +CPU= 30.595
  22:17:24 STEP 2013 H=2013:00 +CPU= 44.635
  22:17:54 STEP 2014 H=2014:00 +CPU= 30.181
  22:18:24 STEP 2015 H=2015:00 +CPU= 29.852
  22:19:18 STEP 2016 H=2016:00 +CPU= 53.068
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+002016
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+002016
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+002016
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+001992
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+001992
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+001992
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+002004
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+002004
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+002004
Zipping up the intermediate file: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_0080_2019050100_123_988_12204724_0_r1412895912_83.zip
Uploading the intermediate file: upload_file_83.zip
  22:19:47 STEP 2017 H=2017:00 +CPU= 28.917
  22:20:17 STEP 2018 H=2018:00 +CPU= 29.919
  22:21:01 STEP 2019 H=2019:00 +CPU= 43.954
  22:21:32 STEP 2020 H=2020:00 +CPU= 30.432
  22:22:01 STEP 2021 H=2021:00 +CPU= 29.168
  22:22:47 STEP 2022 H=2022:00 +CPU= 45.351
  22:23:16 STEP 2023 H=2023:00 +CPU= 29.208
  22:23:46 STEP 2024 H=2024:00 +CPU= 29.998
  22:24:31 STEP 2025 H=2025:00 +CPU= 44.568
  22:25:02 STEP 2026 H=2026:00 +CPU= 30.862
  22:25:31 STEP 2027 H=2027:00 +CPU= 29.208
  22:26:21 STEP 2028 H=2028:00 +CPU= 49.514
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+002028
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+002028
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+002028
  22:26:50 STEP 2029 H=2029:00 +CPU= 28.858
  22:27:20 STEP 2030 H=2030:00 +CPU= 30.003
  22:28:05 STEP 2031 H=2031:00 +CPU= 44.806
  22:28:35 STEP 2032 H=2032:00 +CPU= 30.102
  22:29:03 STEP 2033 H=2033:00 +CPU= 27.968
  22:29:51 STEP 2034 H=2034:00 +CPU= 47.298
  22:30:20 STEP 2035 H=2035:00 +CPU= 28.748
  22:30:49 STEP 2036 H=2036:00 +CPU= 28.992
  22:31:30 STEP 2037 H=2037:00 +CPU= 41.654
  22:31:59 STEP 2038 H=2038:00 +CPU= 28.804
  22:32:27 STEP 2039 H=2039:00 +CPU= 27.354
  22:33:15 STEP 2040 H=2040:00 +CPU= 47.844
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+002040
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+002040
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+002040
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+002016
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+002016
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+002016
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+002028
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+002028
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+002028
Zipping up the intermediate file: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_0080_2019050100_123_988_12204724_0_r1412895912_84.zip
Uploading the intermediate file: upload_file_84.zip
  22:33:41 STEP 2041 H=2041:00 +CPU= 26.110
  22:34:09 STEP 2042 H=2042:00 +CPU= 27.354
  22:34:50 STEP 2043 H=2043:00 +CPU= 41.221
  22:35:18 STEP 2044 H=2044:00 +CPU= 27.784
  22:35:45 STEP 2045 H=2045:00 +CPU= 26.571
  22:36:27 STEP 2046 H=2046:00 +CPU= 41.938
  22:36:54 STEP 2047 H=2047:00 +CPU= 26.554
  22:37:21 STEP 2048 H=2048:00 +CPU= 27.322
  22:38:03 STEP 2049 H=2049:00 +CPU= 42.094
  22:38:31 STEP 2050 H=2050:00 +CPU= 27.548
  22:38:58 STEP 2051 H=2051:00 +CPU= 26.674
  22:39:43 STEP 2052 H=2052:00 +CPU= 44.999
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+002052
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+002052
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+002052
  22:40:10 STEP 2053 H=2053:00 +CPU= 27.144
  22:40:38 STEP 2054 H=2054:00 +CPU= 27.616
  22:41:19 STEP 2055 H=2055:00 +CPU= 40.973
  22:41:46 STEP 2056 H=2056:00 +CPU= 26.884
  22:42:13 STEP 2057 H=2057:00 +CPU= 26.529
  22:42:56 STEP 2058 H=2058:00 +CPU= 43.091
  22:43:23 STEP 2059 H=2059:00 +CPU= 26.732
  22:43:51 STEP 2060 H=2060:00 +CPU= 27.759
  22:44:31 STEP 2061 H=2061:00 +CPU= 40.546
  22:45:00 STEP 2062 H=2062:00 +CPU= 28.270
  22:45:28 STEP 2063 H=2063:00 +CPU= 28.064
  22:46:15 STEP 2064 H=2064:00 +CPU= 47.341
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+002064
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+002064
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+002064
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+002040
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+002040
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+002040
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+002052
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+002052
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+002052
Zipping up the intermediate file: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_0080_2019050100_123_988_12204724_0_r1412895912_85.zip
Uploading the intermediate file: upload_file_85.zip
  22:46:43 STEP 2065 H=2065:00 +CPU= 27.279
  22:47:10 STEP 2066 H=2066:00 +CPU= 27.118
  22:47:50 STEP 2067 H=2067:00 +CPU= 39.975
  22:48:17 STEP 2068 H=2068:00 +CPU= 26.608
  22:48:43 STEP 2069 H=2069:00 +CPU= 25.996
  22:49:24 STEP 2070 H=2070:00 +CPU= 40.669
  22:49:50 STEP 2071 H=2071:00 +CPU= 25.884
  22:50:17 STEP 2072 H=2072:00 +CPU= 26.951
  22:50:59 STEP 2073 H=2073:00 +CPU= 41.622
  22:51:26 STEP 2074 H=2074:00 +CPU= 27.312
  22:51:53 STEP 2075 H=2075:00 +CPU= 26.515
  22:52:39 STEP 2076 H=2076:00 +CPU= 45.619
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+002076
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+002076
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+002076
  22:53:06 STEP 2077 H=2077:00 +CPU= 26.937
  22:53:34 STEP 2078 H=2078:00 +CPU= 27.607
  22:54:16 STEP 2079 H=2079:00 +CPU= 41.684
  22:54:44 STEP 2080 H=2080:00 +CPU= 28.115
  22:55:10 STEP 2081 H=2081:00 +CPU= 26.073
  22:55:53 STEP 2082 H=2082:00 +CPU= 42.531
  22:56:19 STEP 2083 H=2083:00 +CPU= 26.559
  22:56:46 STEP 2084 H=2084:00 +CPU= 27.110
  22:57:28 STEP 2085 H=2085:00 +CPU= 41.812
  22:57:57 STEP 2086 H=2086:00 +CPU= 28.246
  22:58:24 STEP 2087 H=2087:00 +CPU= 27.408
  22:59:13 STEP 2088 H=2088:00 +CPU= 48.205
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+002088
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+002088
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+002088
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+002064
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+002064
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+002064
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+002076
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+002076
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+002076
Zipping up the intermediate file: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_0080_2019050100_123_988_12204724_0_r1412895912_86.zip
Uploading the intermediate file: upload_file_86.zip
  22:59:40 STEP 2089 H=2089:00 +CPU= 26.559
  23:00:07 STEP 2090 H=2090:00 +CPU= 27.652
  23:00:49 STEP 2091 H=2091:00 +CPU= 41.310
  23:01:16 STEP 2092 H=2092:00 +CPU= 27.018
  23:01:40 STEP 2093 H=2093:00 +CPU= 23.740
  23:02:20 STEP 2094 H=2094:00 +CPU= 40.397
  23:02:45 STEP 2095 H=2095:00 +CPU= 24.882
  23:03:10 STEP 2096 H=2096:00 +CPU= 24.749
  23:03:49 STEP 2097 H=2097:00 +CPU= 39.343
  23:04:15 STEP 2098 H=2098:00 +CPU= 25.568
  23:04:42 STEP 2099 H=2099:00 +CPU= 26.286
  23:05:29 STEP 2100 H=2100:00 +CPU= 46.882
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+002100
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+002100
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+002100
  23:05:56 STEP 2101 H=2101:00 +CPU= 27.227
  23:06:23 STEP 2102 H=2102:00 +CPU= 26.569
  23:07:03 STEP 2103 H=2103:00 +CPU= 39.871
  23:07:30 STEP 2104 H=2104:00 +CPU= 26.956
  23:07:56 STEP 2105 H=2105:00 +CPU= 26.428
  23:08:40 STEP 2106 H=2106:00 +CPU= 43.302
  23:09:07 STEP 2107 H=2107:00 +CPU= 27.591
  23:09:35 STEP 2108 H=2108:00 +CPU= 27.872
  23:10:17 STEP 2109 H=2109:00 +CPU= 41.931
  23:10:45 STEP 2110 H=2110:00 +CPU= 27.547
  23:11:13 STEP 2111 H=2111:00 +CPU= 27.567
  23:12:03 STEP 2112 H=2112:00 +CPU= 49.796
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+002112
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+002112
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+002112
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+002088
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+002088
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+002088
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+002100
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+002100
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+002100
Zipping up the intermediate file: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_0080_2019050100_123_988_12204724_0_r1412895912_87.zip
Uploading the intermediate file: upload_file_87.zip
  23:12:30 STEP 2113 H=2113:00 +CPU= 26.693
  23:12:57 STEP 2114 H=2114:00 +CPU= 27.351
  23:13:38 STEP 2115 H=2115:00 +CPU= 40.838
  23:14:06 STEP 2116 H=2116:00 +CPU= 27.716
  23:14:33 STEP 2117 H=2117:00 +CPU= 27.004
  23:15:16 STEP 2118 H=2118:00 +CPU= 42.935
  23:15:43 STEP 2119 H=2119:00 +CPU= 26.631
  23:16:11 STEP 2120 H=2120:00 +CPU= 27.858
  23:16:53 STEP 2121 H=2121:00 +CPU= 41.650
  23:17:21 STEP 2122 H=2122:00 +CPU= 27.795
  23:17:48 STEP 2123 H=2123:00 +CPU= 26.895
  23:18:34 STEP 2124 H=2124:00 +CPU= 46.116
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+002124
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+002124
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+002124
  23:19:01 STEP 2125 H=2125:00 +CPU= 26.769
  23:19:29 STEP 2126 H=2126:00 +CPU= 28.221
  23:20:11 STEP 2127 H=2127:00 +CPU= 42.079
  23:20:40 STEP 2128 H=2128:00 +CPU= 28.400
  23:21:07 STEP 2129 H=2129:00 +CPU= 27.002
  23:21:50 STEP 2130 H=2130:00 +CPU= 42.486
  23:22:17 STEP 2131 H=2131:00 +CPU= 26.695
  23:22:44 STEP 2132 H=2132:00 +CPU= 27.621
  23:23:27 STEP 2133 H=2133:00 +CPU= 42.492
  23:23:53 STEP 2134 H=2134:00 +CPU= 26.243
  23:24:20 STEP 2135 H=2135:00 +CPU= 26.894
  23:25:08 STEP 2136 H=2136:00 +CPU= 47.522
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+002136
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+002136
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+002136
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+002112
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+002112
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+002112
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+002124
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+002124
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+002124
Zipping up the intermediate file: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_0080_2019050100_123_988_12204724_0_r1412895912_88.zip
Uploading the intermediate file: upload_file_88.zip
  23:25:34 STEP 2137 H=2137:00 +CPU= 26.060
  23:26:02 STEP 2138 H=2138:00 +CPU= 27.274
  23:26:43 STEP 2139 H=2139:00 +CPU= 41.580
  23:27:11 STEP 2140 H=2140:00 +CPU= 26.989
  23:27:38 STEP 2141 H=2141:00 +CPU= 26.983
  23:28:21 STEP 2142 H=2142:00 +CPU= 42.888
  23:28:48 STEP 2143 H=2143:00 +CPU= 27.022
  23:29:16 STEP 2144 H=2144:00 +CPU= 28.076
  23:29:57 STEP 2145 H=2145:00 +CPU= 40.890
  23:30:25 STEP 2146 H=2146:00 +CPU= 27.764
  23:30:52 STEP 2147 H=2147:00 +CPU= 26.967
  23:31:39 STEP 2148 H=2148:00 +CPU= 46.530
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+002148
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+002148
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+002148
  23:32:06 STEP 2149 H=2149:00 +CPU= 27.389
  23:32:34 STEP 2150 H=2150:00 +CPU= 27.724
  23:33:16 STEP 2151 H=2151:00 +CPU= 41.780
  23:33:44 STEP 2152 H=2152:00 +CPU= 27.904
  23:34:11 STEP 2153 H=2153:00 +CPU= 26.719
  23:34:54 STEP 2154 H=2154:00 +CPU= 42.897
  23:35:21 STEP 2155 H=2155:00 +CPU= 26.880
  23:35:49 STEP 2156 H=2156:00 +CPU= 28.030
  23:36:31 STEP 2157 H=2157:00 +CPU= 42.301
  23:37:00 STEP 2158 H=2158:00 +CPU= 28.102
  23:37:29 STEP 2159 H=2159:00 +CPU= 28.923
  23:38:18 STEP 2160 H=2160:00 +CPU= 48.990
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+002160
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+002160
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+002160
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+002136
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+002136
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+002136
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+002148
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+002148
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+002148
Zipping up the intermediate file: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_0080_2019050100_123_988_12204724_0_r1412895912_89.zip
Uploading the intermediate file: upload_file_89.zip
Uploading trickle at timestep: 7776000
  23:38:45 STEP 2161 H=2161:00 +CPU= 27.072
  23:39:14 STEP 2162 H=2162:00 +CPU= 27.398
  23:39:55 STEP 2163 H=2163:00 +CPU= 41.621
  23:40:23 STEP 2164 H=2164:00 +CPU= 27.544
  23:40:51 STEP 2165 H=2165:00 +CPU= 27.391
  23:41:33 STEP 2166 H=2166:00 +CPU= 42.505
  23:42:00 STEP 2167 H=2167:00 +CPU= 26.842
  23:42:29 STEP 2168 H=2168:00 +CPU= 28.264
  23:43:09 STEP 2169 H=2169:00 +CPU= 39.914
  23:43:35 STEP 2170 H=2170:00 +CPU= 26.669
  23:44:02 STEP 2171 H=2171:00 +CPU= 26.570
  23:44:49 STEP 2172 H=2172:00 +CPU= 46.193
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+002172
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+002172
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+002172
  23:45:16 STEP 2173 H=2173:00 +CPU= 27.265
  23:45:44 STEP 2174 H=2174:00 +CPU= 27.871
  23:46:25 STEP 2175 H=2175:00 +CPU= 41.313
  23:46:53 STEP 2176 H=2176:00 +CPU= 27.357
  23:47:20 STEP 2177 H=2177:00 +CPU= 26.837
  23:48:03 STEP 2178 H=2178:00 +CPU= 43.142
  23:48:30 STEP 2179 H=2179:00 +CPU= 27.172
  23:48:58 STEP 2180 H=2180:00 +CPU= 27.633
  23:49:39 STEP 2181 H=2181:00 +CPU= 40.626
  23:50:07 STEP 2182 H=2182:00 +CPU= 27.908
  23:50:35 STEP 2183 H=2183:00 +CPU= 27.546
  23:51:24 STEP 2184 H=2184:00 +CPU= 49.132
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+002184
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+002184
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+002184
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+002160
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+002160
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+002160
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+002172
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+002172
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+002172
Zipping up the intermediate file: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_0080_2019050100_123_988_12204724_0_r1412895912_90.zip
Uploading the intermediate file: upload_file_90.zip
  23:51:51 STEP 2185 H=2185:00 +CPU= 26.537
  23:52:18 STEP 2186 H=2186:00 +CPU= 27.799
  23:53:00 STEP 2187 H=2187:00 +CPU= 41.690
  23:53:28 STEP 2188 H=2188:00 +CPU= 28.093
  23:53:55 STEP 2189 H=2189:00 +CPU= 26.652
  23:54:39 STEP 2190 H=2190:00 +CPU= 42.896
  23:55:06 STEP 2191 H=2191:00 +CPU= 26.948
  23:55:34 STEP 2192 H=2192:00 +CPU= 27.916
  23:56:15 STEP 2193 H=2193:00 +CPU= 41.562
  23:56:43 STEP 2194 H=2194:00 +CPU= 27.465
  23:57:10 STEP 2195 H=2195:00 +CPU= 26.724
  23:57:56 STEP 2196 H=2196:00 +CPU= 45.467
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+002196
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+002196
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+002196
  23:58:23 STEP 2197 H=2197:00 +CPU= 27.000
  23:58:51 STEP 2198 H=2198:00 +CPU= 27.935
  23:59:32 STEP 2199 H=2199:00 +CPU= 41.022
  00:00:00 STEP 2200 H=2200:00 +CPU= 28.044
  00:00:26 STEP 2201 H=2201:00 +CPU= 25.529
  00:01:08 STEP 2202 H=2202:00 +CPU= 42.259
  00:01:34 STEP 2203 H=2203:00 +CPU= 25.876
  00:02:00 STEP 2204 H=2204:00 +CPU= 26.319
  00:02:42 STEP 2205 H=2205:00 +CPU= 41.318
  00:03:10 STEP 2206 H=2206:00 +CPU= 27.758
  00:03:38 STEP 2207 H=2207:00 +CPU= 28.363
  00:04:27 STEP 2208 H=2208:00 +CPU= 49.061
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+002208
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+002208
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+002208
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+002184
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+002184
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+002184
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+002196
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+002196
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+002196
Zipping up the intermediate file: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_0080_2019050100_123_988_12204724_0_r1412895912_91.zip
Uploading the intermediate file: upload_file_91.zip
  00:04:55 STEP 2209 H=2209:00 +CPU= 27.099
  00:05:22 STEP 2210 H=2210:00 +CPU= 27.520
  00:06:04 STEP 2211 H=2211:00 +CPU= 41.918
  00:06:32 STEP 2212 H=2212:00 +CPU= 27.826
  00:06:59 STEP 2213 H=2213:00 +CPU= 26.503
  00:07:42 STEP 2214 H=2214:00 +CPU= 43.010
  00:08:09 STEP 2215 H=2215:00 +CPU= 26.987
  00:08:37 STEP 2216 H=2216:00 +CPU= 27.330
  00:09:18 STEP 2217 H=2217:00 +CPU= 41.301
  00:09:46 STEP 2218 H=2218:00 +CPU= 27.556
  00:10:13 STEP 2219 H=2219:00 +CPU= 27.053
  00:11:00 STEP 2220 H=2220:00 +CPU= 46.772
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+002220
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+002220
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+002220
  00:11:27 STEP 2221 H=2221:00 +CPU= 26.880
  00:11:55 STEP 2222 H=2222:00 +CPU= 28.100
  00:12:36 STEP 2223 H=2223:00 +CPU= 40.710
  00:13:04 STEP 2224 H=2224:00 +CPU= 27.963
  00:13:30 STEP 2225 H=2225:00 +CPU= 26.093
  00:14:14 STEP 2226 H=2226:00 +CPU= 43.333
  00:14:41 STEP 2227 H=2227:00 +CPU= 27.307
  00:15:09 STEP 2228 H=2228:00 +CPU= 27.417
  00:15:50 STEP 2229 H=2229:00 +CPU= 41.272
  00:16:18 STEP 2230 H=2230:00 +CPU= 28.138
  00:16:46 STEP 2231 H=2231:00 +CPU= 27.130
  00:17:35 STEP 2232 H=2232:00 +CPU= 48.980
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+002232
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+002232
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+002232
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+002208
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+002208
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+002208
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+002220
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+002220
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+002220
Zipping up the intermediate file: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_0080_2019050100_123_988_12204724_0_r1412895912_92.zip
Uploading the intermediate file: upload_file_92.zip
  00:18:02 STEP 2233 H=2233:00 +CPU= 26.975
  00:18:30 STEP 2234 H=2234:00 +CPU= 27.806
  00:19:11 STEP 2235 H=2235:00 +CPU= 40.506
  00:19:37 STEP 2236 H=2236:00 +CPU= 26.581
  00:20:02 STEP 2237 H=2237:00 +CPU= 25.050
  00:20:44 STEP 2238 H=2238:00 +CPU= 41.009
  00:21:10 STEP 2239 H=2239:00 +CPU= 26.484
  00:21:37 STEP 2240 H=2240:00 +CPU= 26.521
  00:22:18 STEP 2241 H=2241:00 +CPU= 41.046
  00:22:45 STEP 2242 H=2242:00 +CPU= 27.384
  00:23:12 STEP 2243 H=2243:00 +CPU= 26.213
  00:23:57 STEP 2244 H=2244:00 +CPU= 44.748
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+002244
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+002244
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+002244
  00:24:24 STEP 2245 H=2245:00 +CPU= 26.797
  00:24:51 STEP 2246 H=2246:00 +CPU= 27.195
  00:25:32 STEP 2247 H=2247:00 +CPU= 40.773
  00:26:00 STEP 2248 H=2248:00 +CPU= 27.769
  00:26:26 STEP 2249 H=2249:00 +CPU= 26.348
  00:27:09 STEP 2250 H=2250:00 +CPU= 42.616
  00:27:36 STEP 2251 H=2251:00 +CPU= 26.759
  00:28:02 STEP 2252 H=2252:00 +CPU= 26.645
  00:28:43 STEP 2253 H=2253:00 +CPU= 40.568
  00:29:11 STEP 2254 H=2254:00 +CPU= 27.434
  00:29:38 STEP 2255 H=2255:00 +CPU= 26.748
  00:30:27 STEP 2256 H=2256:00 +CPU= 49.113
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+002256
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+002256
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+002256
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+002232
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+002232
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+002232
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+002244
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+002244
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+002244
Zipping up the intermediate file: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_0080_2019050100_123_988_12204724_0_r1412895912_93.zip
Uploading the intermediate file: upload_file_93.zip
  00:30:54 STEP 2257 H=2257:00 +CPU= 26.504
  00:31:22 STEP 2258 H=2258:00 +CPU= 27.709
  00:32:04 STEP 2259 H=2259:00 +CPU= 41.543
  00:32:31 STEP 2260 H=2260:00 +CPU= 27.542
  00:32:58 STEP 2261 H=2261:00 +CPU= 26.187
  00:33:40 STEP 2262 H=2262:00 +CPU= 42.456
  00:34:07 STEP 2263 H=2263:00 +CPU= 26.398
  00:34:34 STEP 2264 H=2264:00 +CPU= 26.825
  00:35:15 STEP 2265 H=2265:00 +CPU= 40.907
  00:35:43 STEP 2266 H=2266:00 +CPU= 27.589
  00:36:09 STEP 2267 H=2267:00 +CPU= 26.216
  00:36:53 STEP 2268 H=2268:00 +CPU= 43.841
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+002268
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+002268
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+002268
  00:37:20 STEP 2269 H=2269:00 +CPU= 26.613
  00:37:47 STEP 2270 H=2270:00 +CPU= 26.862
  00:38:26 STEP 2271 H=2271:00 +CPU= 39.048
  00:38:53 STEP 2272 H=2272:00 +CPU= 27.388
  00:39:20 STEP 2273 H=2273:00 +CPU= 26.635
  00:40:03 STEP 2274 H=2274:00 +CPU= 42.569
  00:40:30 STEP 2275 H=2275:00 +CPU= 26.403
  00:40:57 STEP 2276 H=2276:00 +CPU= 27.381
  00:41:39 STEP 2277 H=2277:00 +CPU= 41.774
  00:42:06 STEP 2278 H=2278:00 +CPU= 26.930
  00:42:34 STEP 2279 H=2279:00 +CPU= 27.748
  00:43:23 STEP 2280 H=2280:00 +CPU= 48.586
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMGGhq0f+002280
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMSHhq0f+002280
Moving to projects directory: /var/lib/boinc-client50001/slots/3/ICMUAhq0f+002280
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+002256
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+002256
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+002256
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMGGhq0f+002268
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMSHhq0f+002268
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_12204724/ICMUAhq0f+002268
Zipping up the intermediate file: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_ps_0080_2019050100_123_988_12204724_0_r1412895912_94.zip
Uploading the intermediate file: upload_file_94.zip
  00:43:49 STEP 2281 H=2281:00 +CPU= 25.960
  00:44:16 STEP 2282 H=2282:00 +CPU= 26.939
  00:44:56 STEP 2283 H=2283:00 +CPU= 40.367
  00:45:24 STEP 2284 H=2284:00 +CPU= 27.916
  00:45:51 STEP 2285 H=2285:00 +CPU= 26.326
  00:46:33 STEP 2286 H=2286:00 +CPU= 42.491
  00:47:00 STEP 2287 H=2287:00 +CPU= 26.572
  00:47:28 STEP 2288 H=2288:00 +CPU= 27.429
double free or corruption (out)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:41:21 1537295 22291232 oifs_43r3_ps_0080_2019050100_123_988_12204724_0 7,776,000 80,036 0.0103
09 May 2023 16:41:14 1537295 22291232 oifs_43r3_ps_0080_2019050100_123_988_12204724_0 6,912,000 71,732 0.0104
09 May 2023 16:41:05 1537295 22291232 oifs_43r3_ps_0080_2019050100_123_988_12204724_0 6,048,000 62,663 0.0104
09 May 2023 16:40:57 1537295 22291232 oifs_43r3_ps_0080_2019050100_123_988_12204724_0 5,184,000 53,872 0.0104
09 May 2023 16:40:52 1537295 22291232 oifs_43r3_ps_0080_2019050100_123_988_12204724_0 4,320,000 45,029 0.0104
09 May 2023 16:40:35 1537295 22291232 oifs_43r3_ps_0080_2019050100_123_988_12204724_0 3,456,000 35,801 0.0104
09 May 2023 16:40:26 1537295 22291232 oifs_43r3_ps_0080_2019050100_123_988_12204724_0 2,592,000 26,678 0.0103
09 May 2023 16:40:26 1537295 22291232 oifs_43r3_ps_0080_2019050100_123_988_12204724_0 2,592,000 26,678 0.0103
09 May 2023 16:40:19 1537295 22291232 oifs_43r3_ps_0080_2019050100_123_988_12204724_0 1,728,000 17,880 0.0103
09 May 2023 16:40:12 1537295 22291232 oifs_43r3_ps_0080_2019050100_123_988_12204724_0 864,000 9,040 0.0105


©2024 climateprediction.net