climateprediction.net home page
Task 22289531

Task 22289531

Name oifs_43r3_ps_0454_2017050100_123_986_12203098_0
Workunit 12203098
Created 24 Dec 2022, 18:03:28 UTC
Sent 20 Jan 2023, 14:41:55 UTC
Report deadline 21 Mar 2023, 14:41:55 UTC
Received 21 Jan 2023, 12:27:00 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 196 (0x000000C4) EXIT_DISK_LIMIT_EXCEEDED
Computer ID 1414915
Run time 11 hours 58 min 18 sec
CPU time 10 hours 25 min 49 sec
Validate state Invalid
Credit 10,160.64
Device peak FLOPS 4.73 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,417.23 MB
Peak swap size 4,978.07 MB
Peak disk usage 7,677.55 MB
Stderr
<core_client_version>7.6.31</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded
</message>
<stderr_txt>
 the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMGGhq0f+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMSHhq0f+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMUAhq0f+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMGGhq0f+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMSHhq0f+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMUAhq0f+001716
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0454_2017050100_123_986_12203098_0_r2062377656_71.zip
Uploading the intermediate file: upload_file_71.zip
  10:16:04 STEP 1729 H=1729:00 +CPU= 12.568
  10:16:18 STEP 1730 H=1730:00 +CPU= 13.216
  10:16:38 STEP 1731 H=1731:00 +CPU= 20.292
  10:16:51 STEP 1732 H=1732:00 +CPU= 12.948
  10:17:04 STEP 1733 H=1733:00 +CPU= 12.808
  10:17:24 STEP 1734 H=1734:00 +CPU= 20.520
  10:17:37 STEP 1735 H=1735:00 +CPU= 12.544
  10:17:50 STEP 1736 H=1736:00 +CPU= 13.160
  10:18:10 STEP 1737 H=1737:00 +CPU= 20.088
  10:18:23 STEP 1738 H=1738:00 +CPU= 12.912
  10:18:36 STEP 1739 H=1739:00 +CPU= 12.760
  10:18:58 STEP 1740 H=1740:00 +CPU= 22.232
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001740
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001740
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001740
  10:19:10 STEP 1741 H=1741:00 +CPU= 12.520
  10:19:24 STEP 1742 H=1742:00 +CPU= 13.156
  10:19:44 STEP 1743 H=1743:00 +CPU= 20.184
  10:19:57 STEP 1744 H=1744:00 +CPU= 12.916
  10:20:10 STEP 1745 H=1745:00 +CPU= 12.976
  10:20:30 STEP 1746 H=1746:00 +CPU= 20.700
  10:20:43 STEP 1747 H=1747:00 +CPU= 12.572
  10:20:56 STEP 1748 H=1748:00 +CPU= 13.136
  10:21:16 STEP 1749 H=1749:00 +CPU= 20.156
  10:21:29 STEP 1750 H=1750:00 +CPU= 12.948
  10:21:42 STEP 1751 H=1751:00 +CPU= 13.168
  10:22:06 STEP 1752 H=1752:00 +CPU= 23.696
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001752
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001752
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMGGhq0f+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMSHhq0f+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMUAhq0f+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMGGhq0f+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMSHhq0f+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMUAhq0f+001740
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0454_2017050100_123_986_12203098_0_r2062377656_72.zip
Uploading the intermediate file: upload_file_72.zip
  10:22:19 STEP 1753 H=1753:00 +CPU= 12.512
  10:22:32 STEP 1754 H=1754:00 +CPU= 13.248
  10:22:52 STEP 1755 H=1755:00 +CPU= 20.140
  10:23:05 STEP 1756 H=1756:00 +CPU= 12.896
  10:23:18 STEP 1757 H=1757:00 +CPU= 12.764
  10:23:38 STEP 1758 H=1758:00 +CPU= 20.520
  10:23:51 STEP 1759 H=1759:00 +CPU= 12.528
  10:24:04 STEP 1760 H=1760:00 +CPU= 13.172
  10:24:24 STEP 1761 H=1761:00 +CPU= 20.104
  10:24:37 STEP 1762 H=1762:00 +CPU= 12.980
  10:24:50 STEP 1763 H=1763:00 +CPU= 12.756
  10:25:12 STEP 1764 H=1764:00 +CPU= 22.380
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001764
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001764
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001764
  10:25:25 STEP 1765 H=1765:00 +CPU= 12.616
  10:25:38 STEP 1766 H=1766:00 +CPU= 13.148
  10:25:58 STEP 1767 H=1767:00 +CPU= 20.104
  10:26:11 STEP 1768 H=1768:00 +CPU= 12.976
  10:26:24 STEP 1769 H=1769:00 +CPU= 12.772
  10:26:44 STEP 1770 H=1770:00 +CPU= 20.480
  10:26:57 STEP 1771 H=1771:00 +CPU= 12.592
  10:27:10 STEP 1772 H=1772:00 +CPU= 13.112
  10:27:30 STEP 1773 H=1773:00 +CPU= 20.032
  10:27:43 STEP 1774 H=1774:00 +CPU= 12.920
  10:27:56 STEP 1775 H=1775:00 +CPU= 13.120
  10:28:20 STEP 1776 H=1776:00 +CPU= 23.648
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001776
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001776
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMGGhq0f+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMSHhq0f+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMUAhq0f+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMGGhq0f+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMSHhq0f+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMUAhq0f+001764
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0454_2017050100_123_986_12203098_0_r2062377656_73.zip
Uploading the intermediate file: upload_file_73.zip
  10:28:32 STEP 1777 H=1777:00 +CPU= 12.524
Uploading trickle at timestep: 6393600
  10:28:45 STEP 1778 H=1778:00 +CPU= 13.212
  10:29:06 STEP 1779 H=1779:00 +CPU= 20.272
  10:29:19 STEP 1780 H=1780:00 +CPU= 12.908
  10:29:31 STEP 1781 H=1781:00 +CPU= 12.876
  10:29:52 STEP 1782 H=1782:00 +CPU= 20.736
  10:30:05 STEP 1783 H=1783:00 +CPU= 13.056
  10:30:19 STEP 1784 H=1784:00 +CPU= 13.324
  10:30:39 STEP 1785 H=1785:00 +CPU= 20.036
  10:30:52 STEP 1786 H=1786:00 +CPU= 13.156
  10:31:05 STEP 1787 H=1787:00 +CPU= 12.948
  10:31:27 STEP 1788 H=1788:00 +CPU= 22.772
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001788
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001788
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001788
  10:31:40 STEP 1789 H=1789:00 +CPU= 12.488
  10:31:53 STEP 1790 H=1790:00 +CPU= 13.180
  10:32:13 STEP 1791 H=1791:00 +CPU= 20.152
  10:32:26 STEP 1792 H=1792:00 +CPU= 12.976
  10:32:39 STEP 1793 H=1793:00 +CPU= 12.940
  10:33:00 STEP 1794 H=1794:00 +CPU= 20.648
  10:33:12 STEP 1795 H=1795:00 +CPU= 12.460
  10:33:25 STEP 1796 H=1796:00 +CPU= 13.148
  10:33:46 STEP 1797 H=1797:00 +CPU= 20.124
  10:33:58 STEP 1798 H=1798:00 +CPU= 12.824
  10:34:12 STEP 1799 H=1799:00 +CPU= 13.272
  10:34:35 STEP 1800 H=1800:00 +CPU= 23.620
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001800
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001800
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMGGhq0f+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMSHhq0f+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMUAhq0f+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMGGhq0f+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMSHhq0f+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMUAhq0f+001788
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0454_2017050100_123_986_12203098_0_r2062377656_74.zip
Uploading the intermediate file: upload_file_74.zip
  10:34:48 STEP 1801 H=1801:00 +CPU= 12.568
  10:35:01 STEP 1802 H=1802:00 +CPU= 13.176
  10:35:22 STEP 1803 H=1803:00 +CPU= 20.644
  10:35:35 STEP 1804 H=1804:00 +CPU= 13.100
  10:35:48 STEP 1805 H=1805:00 +CPU= 12.832
  10:36:08 STEP 1806 H=1806:00 +CPU= 20.644
  10:36:21 STEP 1807 H=1807:00 +CPU= 12.768
  10:36:34 STEP 1808 H=1808:00 +CPU= 13.124
  10:36:54 STEP 1809 H=1809:00 +CPU= 20.192
  10:37:07 STEP 1810 H=1810:00 +CPU= 12.988
  10:37:20 STEP 1811 H=1811:00 +CPU= 12.772
  10:37:42 STEP 1812 H=1812:00 +CPU= 22.168
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001812
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001812
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001812
  10:37:55 STEP 1813 H=1813:00 +CPU= 12.448
  10:38:08 STEP 1814 H=1814:00 +CPU= 13.204
  10:38:28 STEP 1815 H=1815:00 +CPU= 20.136
  10:38:41 STEP 1816 H=1816:00 +CPU= 12.980
  10:38:54 STEP 1817 H=1817:00 +CPU= 12.780
  10:39:14 STEP 1818 H=1818:00 +CPU= 20.592
  10:39:27 STEP 1819 H=1819:00 +CPU= 12.712
  10:39:40 STEP 1820 H=1820:00 +CPU= 13.156
  10:40:01 STEP 1821 H=1821:00 +CPU= 20.456
  10:40:14 STEP 1822 H=1822:00 +CPU= 13.220
  10:40:27 STEP 1823 H=1823:00 +CPU= 13.504
  10:40:51 STEP 1824 H=1824:00 +CPU= 23.676
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001824
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001824
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMGGhq0f+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMSHhq0f+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMUAhq0f+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMGGhq0f+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMSHhq0f+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMUAhq0f+001812
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0454_2017050100_123_986_12203098_0_r2062377656_75.zip
Uploading the intermediate file: upload_file_75.zip
  10:41:04 STEP 1825 H=1825:00 +CPU= 12.492
  10:41:17 STEP 1826 H=1826:00 +CPU= 13.164
  10:41:37 STEP 1827 H=1827:00 +CPU= 20.088
  10:41:50 STEP 1828 H=1828:00 +CPU= 13.148
  10:42:03 STEP 1829 H=1829:00 +CPU= 12.708
  10:42:23 STEP 1830 H=1830:00 +CPU= 20.528
  10:42:36 STEP 1831 H=1831:00 +CPU= 12.560
  10:42:49 STEP 1832 H=1832:00 +CPU= 13.076
  10:43:09 STEP 1833 H=1833:00 +CPU= 20.072
  10:43:22 STEP 1834 H=1834:00 +CPU= 12.936
  10:43:35 STEP 1835 H=1835:00 +CPU= 12.704
  10:43:57 STEP 1836 H=1836:00 +CPU= 22.296
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001836
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001836
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001836
  10:44:10 STEP 1837 H=1837:00 +CPU= 12.668
  10:44:23 STEP 1838 H=1838:00 +CPU= 13.120
  10:44:43 STEP 1839 H=1839:00 +CPU= 20.088
  10:44:56 STEP 1840 H=1840:00 +CPU= 12.928
  10:45:09 STEP 1841 H=1841:00 +CPU= 13.048
  10:45:30 STEP 1842 H=1842:00 +CPU= 20.884
  10:45:42 STEP 1843 H=1843:00 +CPU= 12.752
  10:45:56 STEP 1844 H=1844:00 +CPU= 13.304
  10:46:16 STEP 1845 H=1845:00 +CPU= 20.044
  10:46:29 STEP 1846 H=1846:00 +CPU= 13.088
  10:46:42 STEP 1847 H=1847:00 +CPU= 13.328
  10:47:06 STEP 1848 H=1848:00 +CPU= 23.704
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001848
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001848
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMGGhq0f+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMSHhq0f+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMUAhq0f+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMGGhq0f+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMSHhq0f+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMUAhq0f+001836
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0454_2017050100_123_986_12203098_0_r2062377656_76.zip
Uploading the intermediate file: upload_file_76.zip
  10:47:19 STEP 1849 H=1849:00 +CPU= 12.648
  10:47:32 STEP 1850 H=1850:00 +CPU= 13.244
  10:47:52 STEP 1851 H=1851:00 +CPU= 20.208
  10:48:05 STEP 1852 H=1852:00 +CPU= 12.988
  10:48:18 STEP 1853 H=1853:00 +CPU= 12.960
  10:48:39 STEP 1854 H=1854:00 +CPU= 20.652
  10:48:52 STEP 1855 H=1855:00 +CPU= 12.888
  10:49:05 STEP 1856 H=1856:00 +CPU= 13.280
  10:49:25 STEP 1857 H=1857:00 +CPU= 20.016
  10:49:38 STEP 1858 H=1858:00 +CPU= 13.176
  10:49:51 STEP 1859 H=1859:00 +CPU= 12.836
  10:50:13 STEP 1860 H=1860:00 +CPU= 22.284
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001860
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001860
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001860
  10:50:26 STEP 1861 H=1861:00 +CPU= 13.032
  10:50:39 STEP 1862 H=1862:00 +CPU= 13.232
  10:51:00 STEP 1863 H=1863:00 +CPU= 20.128
  10:51:13 STEP 1864 H=1864:00 +CPU= 12.992
  10:51:25 STEP 1865 H=1865:00 +CPU= 12.816
  10:51:46 STEP 1866 H=1866:00 +CPU= 20.408
  10:51:59 STEP 1867 H=1867:00 +CPU= 12.764
  10:52:12 STEP 1868 H=1868:00 +CPU= 13.340
  10:52:32 STEP 1869 H=1869:00 +CPU= 20.216
  10:52:45 STEP 1870 H=1870:00 +CPU= 13.084
  10:52:59 STEP 1871 H=1871:00 +CPU= 13.348
  10:53:23 STEP 1872 H=1872:00 +CPU= 23.996
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001872
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001872
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMGGhq0f+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMSHhq0f+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMUAhq0f+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMGGhq0f+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMSHhq0f+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMUAhq0f+001860
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0454_2017050100_123_986_12203098_0_r2062377656_77.zip
Uploading the intermediate file: upload_file_77.zip
  10:53:35 STEP 1873 H=1873:00 +CPU= 12.756
  10:53:49 STEP 1874 H=1874:00 +CPU= 13.236
  10:54:09 STEP 1875 H=1875:00 +CPU= 20.420
  10:54:22 STEP 1876 H=1876:00 +CPU= 12.904
  10:54:35 STEP 1877 H=1877:00 +CPU= 12.852
  10:54:55 STEP 1878 H=1878:00 +CPU= 20.412
  10:55:08 STEP 1879 H=1879:00 +CPU= 13.024
  10:55:22 STEP 1880 H=1880:00 +CPU= 13.348
  10:55:42 STEP 1881 H=1881:00 +CPU= 20.036
  10:55:55 STEP 1882 H=1882:00 +CPU= 13.064
  10:56:07 STEP 1883 H=1883:00 +CPU= 12.780
  10:56:30 STEP 1884 H=1884:00 +CPU= 22.152
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001884
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001884
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001884
  10:56:42 STEP 1885 H=1885:00 +CPU= 12.744
  10:56:56 STEP 1886 H=1886:00 +CPU= 13.204
  10:57:16 STEP 1887 H=1887:00 +CPU= 20.104
  10:57:29 STEP 1888 H=1888:00 +CPU= 13.088
  10:57:42 STEP 1889 H=1889:00 +CPU= 12.828
  10:58:02 STEP 1890 H=1890:00 +CPU= 20.420
  10:58:15 STEP 1891 H=1891:00 +CPU= 12.772
  10:58:28 STEP 1892 H=1892:00 +CPU= 13.096
  10:58:48 STEP 1893 H=1893:00 +CPU= 19.964
  10:59:01 STEP 1894 H=1894:00 +CPU= 13.052
  10:59:14 STEP 1895 H=1895:00 +CPU= 13.080
  10:59:38 STEP 1896 H=1896:00 +CPU= 23.768
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001896
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001896
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMGGhq0f+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMSHhq0f+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMUAhq0f+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMGGhq0f+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMSHhq0f+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMUAhq0f+001884
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0454_2017050100_123_986_12203098_0_r2062377656_78.zip
Uploading the intermediate file: upload_file_78.zip
  10:59:50 STEP 1897 H=1897:00 +CPU= 12.632
  11:00:04 STEP 1898 H=1898:00 +CPU= 13.632
  11:00:24 STEP 1899 H=1899:00 +CPU= 20.412
  11:00:37 STEP 1900 H=1900:00 +CPU= 13.008
  11:00:50 STEP 1901 H=1901:00 +CPU= 12.736
  11:01:11 STEP 1902 H=1902:00 +CPU= 20.508
  11:01:23 STEP 1903 H=1903:00 +CPU= 12.744
  11:01:37 STEP 1904 H=1904:00 +CPU= 13.148
  11:01:57 STEP 1905 H=1905:00 +CPU= 20.100
  11:02:10 STEP 1906 H=1906:00 +CPU= 13.140
  11:02:23 STEP 1907 H=1907:00 +CPU= 12.944
  11:02:45 STEP 1908 H=1908:00 +CPU= 22.240
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001908
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001908
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001908
  11:02:58 STEP 1909 H=1909:00 +CPU= 12.832
  11:03:11 STEP 1910 H=1910:00 +CPU= 13.332
  11:03:31 STEP 1911 H=1911:00 +CPU= 20.108
  11:03:44 STEP 1912 H=1912:00 +CPU= 13.100
  11:03:57 STEP 1913 H=1913:00 +CPU= 12.740
  11:04:18 STEP 1914 H=1914:00 +CPU= 20.484
  11:04:30 STEP 1915 H=1915:00 +CPU= 12.736
  11:04:44 STEP 1916 H=1916:00 +CPU= 13.144
  11:05:04 STEP 1917 H=1917:00 +CPU= 20.272
  11:05:17 STEP 1918 H=1918:00 +CPU= 13.504
  11:05:31 STEP 1919 H=1919:00 +CPU= 13.276
  11:05:56 STEP 1920 H=1920:00 +CPU= 24.960
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001920
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001920
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMGGhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMSHhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMUAhq0f+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMGGhq0f+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMSHhq0f+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMUAhq0f+001908
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0454_2017050100_123_986_12203098_0_r2062377656_79.zip
Uploading the intermediate file: upload_file_79.zip
  11:06:09 STEP 1921 H=1921:00 +CPU= 13.348
  11:06:22 STEP 1922 H=1922:00 +CPU= 13.108
  11:06:42 STEP 1923 H=1923:00 +CPU= 20.372
  11:06:55 STEP 1924 H=1924:00 +CPU= 12.956
  11:07:08 STEP 1925 H=1925:00 +CPU= 12.880
  11:07:29 STEP 1926 H=1926:00 +CPU= 20.492
  11:07:41 STEP 1927 H=1927:00 +CPU= 12.768
  11:07:55 STEP 1928 H=1928:00 +CPU= 13.188
  11:08:15 STEP 1929 H=1929:00 +CPU= 20.100
  11:08:28 STEP 1930 H=1930:00 +CPU= 13.132
  11:08:41 STEP 1931 H=1931:00 +CPU= 12.816
  11:09:03 STEP 1932 H=1932:00 +CPU= 22.164
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001932
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001932
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001932
  11:09:15 STEP 1933 H=1933:00 +CPU= 12.620
  11:09:29 STEP 1934 H=1934:00 +CPU= 13.168
  11:09:49 STEP 1935 H=1935:00 +CPU= 20.092
  11:10:02 STEP 1936 H=1936:00 +CPU= 13.128
  11:10:15 STEP 1937 H=1937:00 +CPU= 13.024
  11:10:36 STEP 1938 H=1938:00 +CPU= 20.644
  11:10:48 STEP 1939 H=1939:00 +CPU= 12.788
  11:11:01 STEP 1940 H=1940:00 +CPU= 13.180
  11:11:22 STEP 1941 H=1941:00 +CPU= 20.168
  11:11:35 STEP 1942 H=1942:00 +CPU= 13.208
  11:11:48 STEP 1943 H=1943:00 +CPU= 13.208
  11:12:12 STEP 1944 H=1944:00 +CPU= 23.772
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001944
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001944
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMGGhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMSHhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMUAhq0f+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMGGhq0f+001932
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMSHhq0f+001932
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMUAhq0f+001932
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0454_2017050100_123_986_12203098_0_r2062377656_80.zip
Uploading the intermediate file: upload_file_80.zip
  11:12:25 STEP 1945 H=1945:00 +CPU= 12.840
  11:12:38 STEP 1946 H=1946:00 +CPU= 13.268
  11:12:58 STEP 1947 H=1947:00 +CPU= 20.016
  11:13:11 STEP 1948 H=1948:00 +CPU= 13.136
  11:13:24 STEP 1949 H=1949:00 +CPU= 12.812
  11:13:45 STEP 1950 H=1950:00 +CPU= 20.664
  11:13:57 STEP 1951 H=1951:00 +CPU= 12.772
  11:14:11 STEP 1952 H=1952:00 +CPU= 13.212
  11:14:31 STEP 1953 H=1953:00 +CPU= 20.272
  11:14:44 STEP 1954 H=1954:00 +CPU= 13.276
  11:14:57 STEP 1955 H=1955:00 +CPU= 13.048
  11:15:20 STEP 1956 H=1956:00 +CPU= 22.596
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001956
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001956
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001956
  11:15:32 STEP 1957 H=1957:00 +CPU= 12.612
  11:15:46 STEP 1958 H=1958:00 +CPU= 13.140
  11:16:06 STEP 1959 H=1959:00 +CPU= 20.068
  11:16:19 STEP 1960 H=1960:00 +CPU= 13.008
  11:16:31 STEP 1961 H=1961:00 +CPU= 12.816
  11:16:52 STEP 1962 H=1962:00 +CPU= 20.420
  11:17:05 STEP 1963 H=1963:00 +CPU= 12.764
  11:17:18 STEP 1964 H=1964:00 +CPU= 13.124
  11:17:38 STEP 1965 H=1965:00 +CPU= 19.972
  11:17:51 STEP 1966 H=1966:00 +CPU= 13.036
  11:18:04 STEP 1967 H=1967:00 +CPU= 13.164
  11:18:27 STEP 1968 H=1968:00 +CPU= 23.616
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001968
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001968
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMGGhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMSHhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMUAhq0f+001944
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMGGhq0f+001956
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMSHhq0f+001956
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMUAhq0f+001956
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0454_2017050100_123_986_12203098_0_r2062377656_81.zip
Uploading the intermediate file: upload_file_81.zip
  11:18:40 STEP 1969 H=1969:00 +CPU= 12.568
  11:18:53 STEP 1970 H=1970:00 +CPU= 13.116
  11:19:13 STEP 1971 H=1971:00 +CPU= 20.088
  11:19:26 STEP 1972 H=1972:00 +CPU= 12.972
  11:19:39 STEP 1973 H=1973:00 +CPU= 12.716
  11:19:59 STEP 1974 H=1974:00 +CPU= 20.472
  11:20:12 STEP 1975 H=1975:00 +CPU= 12.948
  11:20:26 STEP 1976 H=1976:00 +CPU= 13.216
  11:20:46 STEP 1977 H=1977:00 +CPU= 20.032
  11:20:59 STEP 1978 H=1978:00 +CPU= 13.092
  11:21:11 STEP 1979 H=1979:00 +CPU= 12.760
  11:21:34 STEP 1980 H=1980:00 +CPU= 22.168
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001980
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001980
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001980
  11:21:46 STEP 1981 H=1981:00 +CPU= 12.768
  11:22:00 STEP 1982 H=1982:00 +CPU= 13.196
  11:22:20 STEP 1983 H=1983:00 +CPU= 20.088
  11:22:33 STEP 1984 H=1984:00 +CPU= 13.120
  11:22:46 STEP 1985 H=1985:00 +CPU= 12.912
  11:23:06 STEP 1986 H=1986:00 +CPU= 20.560
  11:23:19 STEP 1987 H=1987:00 +CPU= 12.780
  11:23:32 STEP 1988 H=1988:00 +CPU= 13.204
  11:23:52 STEP 1989 H=1989:00 +CPU= 20.104
  11:24:06 STEP 1990 H=1990:00 +CPU= 13.196
  11:24:19 STEP 1991 H=1991:00 +CPU= 13.188
  11:24:42 STEP 1992 H=1992:00 +CPU= 23.656
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+001992
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+001992
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMGGhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMSHhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMUAhq0f+001968
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMGGhq0f+001980
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMSHhq0f+001980
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMUAhq0f+001980
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0454_2017050100_123_986_12203098_0_r2062377656_82.zip
Uploading the intermediate file: upload_file_82.zip
  11:24:55 STEP 1993 H=1993:00 +CPU= 12.716
  11:25:08 STEP 1994 H=1994:00 +CPU= 13.268
  11:25:29 STEP 1995 H=1995:00 +CPU= 20.300
  11:25:42 STEP 1996 H=1996:00 +CPU= 13.120
  11:25:55 STEP 1997 H=1997:00 +CPU= 12.848
  11:26:16 STEP 1998 H=1998:00 +CPU= 20.816
  11:26:28 STEP 1999 H=1999:00 +CPU= 12.876
  11:26:42 STEP 2000 H=2000:00 +CPU= 13.292
  11:27:02 STEP 2001 H=2001:00 +CPU= 20.160
  11:27:15 STEP 2002 H=2002:00 +CPU= 13.244
  11:27:28 STEP 2003 H=2003:00 +CPU= 12.808
  11:27:50 STEP 2004 H=2004:00 +CPU= 22.120
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002004
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002004
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002004
  11:28:03 STEP 2005 H=2005:00 +CPU= 12.816
  11:28:16 STEP 2006 H=2006:00 +CPU= 13.232
  11:28:36 STEP 2007 H=2007:00 +CPU= 20.148
  11:28:50 STEP 2008 H=2008:00 +CPU= 13.272
  11:29:02 STEP 2009 H=2009:00 +CPU= 12.760
  11:29:23 STEP 2010 H=2010:00 +CPU= 20.612
  11:29:36 STEP 2011 H=2011:00 +CPU= 12.764
  11:29:49 STEP 2012 H=2012:00 +CPU= 13.356
  11:30:10 STEP 2013 H=2013:00 +CPU= 20.528
  11:30:23 STEP 2014 H=2014:00 +CPU= 13.280
  11:30:36 STEP 2015 H=2015:00 +CPU= 13.152
  11:31:00 STEP 2016 H=2016:00 +CPU= 23.688
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002016
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002016
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMGGhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMSHhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMUAhq0f+001992
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMGGhq0f+002004
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMSHhq0f+002004
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMUAhq0f+002004
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0454_2017050100_123_986_12203098_0_r2062377656_83.zip
Uploading the intermediate file: upload_file_83.zip
  11:31:13 STEP 2017 H=2017:00 +CPU= 13.020
Uploading trickle at timestep: 7257600
  11:31:26 STEP 2018 H=2018:00 +CPU= 13.108
  11:31:46 STEP 2019 H=2019:00 +CPU= 20.020
  11:31:59 STEP 2020 H=2020:00 +CPU= 12.976
  11:32:12 STEP 2021 H=2021:00 +CPU= 12.756
  11:32:32 STEP 2022 H=2022:00 +CPU= 20.556
  11:32:45 STEP 2023 H=2023:00 +CPU= 12.708
  11:32:58 STEP 2024 H=2024:00 +CPU= 13.076
  11:33:18 STEP 2025 H=2025:00 +CPU= 20.004
  11:33:31 STEP 2026 H=2026:00 +CPU= 13.076
  11:33:44 STEP 2027 H=2027:00 +CPU= 12.728
  11:34:06 STEP 2028 H=2028:00 +CPU= 22.104
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002028
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002028
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002028
  11:34:19 STEP 2029 H=2029:00 +CPU= 12.784
  11:34:32 STEP 2030 H=2030:00 +CPU= 13.260
  11:34:52 STEP 2031 H=2031:00 +CPU= 20.060
  11:35:05 STEP 2032 H=2032:00 +CPU= 13.252
  11:35:18 STEP 2033 H=2033:00 +CPU= 13.008
  11:35:39 STEP 2034 H=2034:00 +CPU= 20.580
  11:35:52 STEP 2035 H=2035:00 +CPU= 12.780
  11:36:05 STEP 2036 H=2036:00 +CPU= 13.220
  11:36:25 STEP 2037 H=2037:00 +CPU= 20.076
  11:36:38 STEP 2038 H=2038:00 +CPU= 13.124
  11:36:51 STEP 2039 H=2039:00 +CPU= 13.208
  11:37:15 STEP 2040 H=2040:00 +CPU= 23.824
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002040
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002040
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMGGhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMSHhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMUAhq0f+002016
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMGGhq0f+002028
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMSHhq0f+002028
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMUAhq0f+002028
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0454_2017050100_123_986_12203098_0_r2062377656_84.zip
Uploading the intermediate file: upload_file_84.zip
  11:37:28 STEP 2041 H=2041:00 +CPU= 12.648
  11:37:41 STEP 2042 H=2042:00 +CPU= 13.140
  11:38:02 STEP 2043 H=2043:00 +CPU= 20.524
  11:38:15 STEP 2044 H=2044:00 +CPU= 13.020
  11:38:28 STEP 2045 H=2045:00 +CPU= 13.012
  11:38:48 STEP 2046 H=2046:00 +CPU= 20.584
  11:39:01 STEP 2047 H=2047:00 +CPU= 12.796
  11:39:14 STEP 2048 H=2048:00 +CPU= 13.248
  11:39:34 STEP 2049 H=2049:00 +CPU= 20.164
  11:39:48 STEP 2050 H=2050:00 +CPU= 13.160
  11:40:00 STEP 2051 H=2051:00 +CPU= 12.908
  11:40:23 STEP 2052 H=2052:00 +CPU= 22.296
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002052
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002052
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002052
  11:40:35 STEP 2053 H=2053:00 +CPU= 12.760
  11:40:49 STEP 2054 H=2054:00 +CPU= 13.136
  11:41:09 STEP 2055 H=2055:00 +CPU= 20.016
  11:41:22 STEP 2056 H=2056:00 +CPU= 13.292
  11:41:35 STEP 2057 H=2057:00 +CPU= 12.852
  11:41:55 STEP 2058 H=2058:00 +CPU= 20.504
  11:42:08 STEP 2059 H=2059:00 +CPU= 12.768
  11:42:21 STEP 2060 H=2060:00 +CPU= 13.080
  11:42:41 STEP 2061 H=2061:00 +CPU= 20.096
  11:42:54 STEP 2062 H=2062:00 +CPU= 13.096
  11:43:07 STEP 2063 H=2063:00 +CPU= 13.092
  11:43:31 STEP 2064 H=2064:00 +CPU= 23.652
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002064
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002064
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMGGhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMSHhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMUAhq0f+002040
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMGGhq0f+002052
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMSHhq0f+002052
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMUAhq0f+002052
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0454_2017050100_123_986_12203098_0_r2062377656_85.zip
Uploading the intermediate file: upload_file_85.zip
  11:43:44 STEP 2065 H=2065:00 +CPU= 12.740
  11:43:57 STEP 2066 H=2066:00 +CPU= 13.208
  11:44:17 STEP 2067 H=2067:00 +CPU= 20.084
  11:44:30 STEP 2068 H=2068:00 +CPU= 13.160
  11:44:43 STEP 2069 H=2069:00 +CPU= 12.672
  11:45:03 STEP 2070 H=2070:00 +CPU= 20.572
  11:45:16 STEP 2071 H=2071:00 +CPU= 12.972
  11:45:30 STEP 2072 H=2072:00 +CPU= 13.072
  11:45:50 STEP 2073 H=2073:00 +CPU= 20.048
  11:46:03 STEP 2074 H=2074:00 +CPU= 13.172
  11:46:16 STEP 2075 H=2075:00 +CPU= 13.168
  11:46:38 STEP 2076 H=2076:00 +CPU= 22.312
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002076
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002076
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002076
  11:46:51 STEP 2077 H=2077:00 +CPU= 12.760
  11:47:04 STEP 2078 H=2078:00 +CPU= 13.180
  11:47:24 STEP 2079 H=2079:00 +CPU= 20.236
  11:47:38 STEP 2080 H=2080:00 +CPU= 13.096
  11:47:50 STEP 2081 H=2081:00 +CPU= 12.696
  11:48:11 STEP 2082 H=2082:00 +CPU= 20.604
  11:48:24 STEP 2083 H=2083:00 +CPU= 12.676
  11:48:36 STEP 2084 H=2084:00 +CPU= 12.980
  11:48:57 STEP 2085 H=2085:00 +CPU= 20.004
  11:49:10 STEP 2086 H=2086:00 +CPU= 13.076
  11:49:23 STEP 2087 H=2087:00 +CPU= 13.016
  11:49:46 STEP 2088 H=2088:00 +CPU= 23.572
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002088
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002088
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMGGhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMSHhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMUAhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMGGhq0f+002076
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMSHhq0f+002076
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMUAhq0f+002076
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0454_2017050100_123_986_12203098_0_r2062377656_86.zip
Uploading the intermediate file: upload_file_86.zip
  11:49:59 STEP 2089 H=2089:00 +CPU= 12.816
  11:50:12 STEP 2090 H=2090:00 +CPU= 13.368
  11:50:32 STEP 2091 H=2091:00 +CPU= 20.092
  11:50:46 STEP 2092 H=2092:00 +CPU= 13.096
  11:50:58 STEP 2093 H=2093:00 +CPU= 12.488
  11:51:19 STEP 2094 H=2094:00 +CPU= 20.604
  11:51:31 STEP 2095 H=2095:00 +CPU= 12.752
  11:51:44 STEP 2096 H=2096:00 +CPU= 12.872
  11:52:04 STEP 2097 H=2097:00 +CPU= 20.192
  11:52:18 STEP 2098 H=2098:00 +CPU= 13.132
  11:52:30 STEP 2099 H=2099:00 +CPU= 12.488
  11:52:52 STEP 2100 H=2100:00 +CPU= 22.200
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002100
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002100
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002100
  11:53:05 STEP 2101 H=2101:00 +CPU= 12.724
  11:53:18 STEP 2102 H=2102:00 +CPU= 13.028
  11:53:38 STEP 2103 H=2103:00 +CPU= 20.052
  11:53:51 STEP 2104 H=2104:00 +CPU= 13.116
  11:54:04 STEP 2105 H=2105:00 +CPU= 12.496
  11:54:24 STEP 2106 H=2106:00 +CPU= 20.560
  11:54:37 STEP 2107 H=2107:00 +CPU= 12.852
  11:54:50 STEP 2108 H=2108:00 +CPU= 12.860
  11:55:10 STEP 2109 H=2109:00 +CPU= 20.240
  11:55:24 STEP 2110 H=2110:00 +CPU= 13.312
  11:55:36 STEP 2111 H=2111:00 +CPU= 12.928
  11:56:00 STEP 2112 H=2112:00 +CPU= 23.688
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002112
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002112
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMGGhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMSHhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMUAhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMGGhq0f+002100
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMSHhq0f+002100
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMUAhq0f+002100
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0454_2017050100_123_986_12203098_0_r2062377656_87.zip
Uploading the intermediate file: upload_file_87.zip
  11:56:13 STEP 2113 H=2113:00 +CPU= 12.772
  11:56:26 STEP 2114 H=2114:00 +CPU= 13.088
  11:56:46 STEP 2115 H=2115:00 +CPU= 20.128
  11:57:00 STEP 2116 H=2116:00 +CPU= 13.332
  11:57:12 STEP 2117 H=2117:00 +CPU= 12.456
  11:57:33 STEP 2118 H=2118:00 +CPU= 20.632
  11:57:45 STEP 2119 H=2119:00 +CPU= 12.804
  11:57:58 STEP 2120 H=2120:00 +CPU= 12.824
  11:58:18 STEP 2121 H=2121:00 +CPU= 20.184
  11:58:32 STEP 2122 H=2122:00 +CPU= 13.188
  11:58:44 STEP 2123 H=2123:00 +CPU= 12.456
  11:59:06 STEP 2124 H=2124:00 +CPU= 22.216
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002124
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002124
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002124
  11:59:19 STEP 2125 H=2125:00 +CPU= 12.772
  11:59:32 STEP 2126 H=2126:00 +CPU= 12.932
  11:59:52 STEP 2127 H=2127:00 +CPU= 20.188
  12:00:06 STEP 2128 H=2128:00 +CPU= 13.636
  12:00:19 STEP 2129 H=2129:00 +CPU= 12.648
  12:00:39 STEP 2130 H=2130:00 +CPU= 20.556
  12:00:52 STEP 2131 H=2131:00 +CPU= 12.824
  12:01:05 STEP 2132 H=2132:00 +CPU= 12.844
  12:01:25 STEP 2133 H=2133:00 +CPU= 20.104
  12:01:38 STEP 2134 H=2134:00 +CPU= 13.128
  12:01:51 STEP 2135 H=2135:00 +CPU= 12.844
  12:02:15 STEP 2136 H=2136:00 +CPU= 23.752
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002136
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002136
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMGGhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMSHhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMUAhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMGGhq0f+002124
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMSHhq0f+002124
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMUAhq0f+002124
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0454_2017050100_123_986_12203098_0_r2062377656_88.zip
Uploading the intermediate file: upload_file_88.zip
  12:02:27 STEP 2137 H=2137:00 +CPU= 12.716
  12:02:40 STEP 2138 H=2138:00 +CPU= 13.008
  12:03:01 STEP 2139 H=2139:00 +CPU= 20.212
  12:03:14 STEP 2140 H=2140:00 +CPU= 13.244
  12:03:26 STEP 2141 H=2141:00 +CPU= 12.456
  12:03:47 STEP 2142 H=2142:00 +CPU= 20.576
  12:04:00 STEP 2143 H=2143:00 +CPU= 12.796
  12:04:13 STEP 2144 H=2144:00 +CPU= 12.980
  12:04:33 STEP 2145 H=2145:00 +CPU= 20.116
  12:04:46 STEP 2146 H=2146:00 +CPU= 13.096
  12:04:58 STEP 2147 H=2147:00 +CPU= 12.520
  12:05:21 STEP 2148 H=2148:00 +CPU= 22.724
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002148
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002148
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002148
  12:05:34 STEP 2149 H=2149:00 +CPU= 12.824
  12:05:47 STEP 2150 H=2150:00 +CPU= 13.004
  12:06:07 STEP 2151 H=2151:00 +CPU= 20.164
  12:06:20 STEP 2152 H=2152:00 +CPU= 13.124
  12:06:33 STEP 2153 H=2153:00 +CPU= 12.644
  12:06:53 STEP 2154 H=2154:00 +CPU= 20.704
  12:07:07 STEP 2155 H=2155:00 +CPU= 13.056
  12:07:20 STEP 2156 H=2156:00 +CPU= 13.020
  12:07:40 STEP 2157 H=2157:00 +CPU= 20.280
  12:07:53 STEP 2158 H=2158:00 +CPU= 13.644
  12:08:07 STEP 2159 H=2159:00 +CPU= 13.192
  12:08:30 STEP 2160 H=2160:00 +CPU= 23.732
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002160
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002160
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMGGhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMSHhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMUAhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMGGhq0f+002148
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMSHhq0f+002148
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMUAhq0f+002148
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0454_2017050100_123_986_12203098_0_r2062377656_89.zip
  12:08:43 STEP 2161 H=2161:00 +CPU= 12.760
Uploading the intermediate file: upload_file_89.zip
  12:08:56 STEP 2162 H=2162:00 +CPU= 12.824
  12:09:16 STEP 2163 H=2163:00 +CPU= 20.308
  12:09:29 STEP 2164 H=2164:00 +CPU= 13.172
  12:09:42 STEP 2165 H=2165:00 +CPU= 12.868
  12:10:03 STEP 2166 H=2166:00 +CPU= 20.672
  12:10:16 STEP 2167 H=2167:00 +CPU= 13.272
  12:10:29 STEP 2168 H=2168:00 +CPU= 13.140
  12:10:50 STEP 2169 H=2169:00 +CPU= 20.344
  12:11:03 STEP 2170 H=2170:00 +CPU= 13.364
  12:11:16 STEP 2171 H=2171:00 +CPU= 12.684
  12:11:38 STEP 2172 H=2172:00 +CPU= 22.228
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002172
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002172
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002172
  12:11:51 STEP 2173 H=2173:00 +CPU= 12.744
  12:12:04 STEP 2174 H=2174:00 +CPU= 12.920
  12:12:24 STEP 2175 H=2175:00 +CPU= 20.140
  12:12:37 STEP 2176 H=2176:00 +CPU= 13.056
  12:12:50 STEP 2177 H=2177:00 +CPU= 12.692
  12:13:10 STEP 2178 H=2178:00 +CPU= 20.768
  12:13:23 STEP 2179 H=2179:00 +CPU= 13.012
  12:13:36 STEP 2180 H=2180:00 +CPU= 13.004
  12:13:57 STEP 2181 H=2181:00 +CPU= 20.364
  12:14:10 STEP 2182 H=2182:00 +CPU= 13.440
  12:14:23 STEP 2183 H=2183:00 +CPU= 13.036
  12:14:47 STEP 2184 H=2184:00 +CPU= 23.728
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002184
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002184
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMGGhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMSHhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMUAhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMGGhq0f+002172
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMSHhq0f+002172
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMUAhq0f+002172
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0454_2017050100_123_986_12203098_0_r2062377656_90.zip
Uploading the intermediate file: upload_file_90.zip
  12:15:00 STEP 2185 H=2185:00 +CPU= 12.836
  12:15:13 STEP 2186 H=2186:00 +CPU= 13.348
  12:15:33 STEP 2187 H=2187:00 +CPU= 20.220
  12:15:46 STEP 2188 H=2188:00 +CPU= 13.160
  12:15:59 STEP 2189 H=2189:00 +CPU= 12.652
  12:16:20 STEP 2190 H=2190:00 +CPU= 20.500
  12:16:33 STEP 2191 H=2191:00 +CPU= 12.920
  12:16:46 STEP 2192 H=2192:00 +CPU= 13.020
  12:17:06 STEP 2193 H=2193:00 +CPU= 20.168
  12:17:19 STEP 2194 H=2194:00 +CPU= 13.240
  12:17:32 STEP 2195 H=2195:00 +CPU= 12.656
  12:17:54 STEP 2196 H=2196:00 +CPU= 22.160
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002196
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002196
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002196
  12:18:07 STEP 2197 H=2197:00 +CPU= 12.720
  12:18:19 STEP 2198 H=2198:00 +CPU= 12.976
  12:18:40 STEP 2199 H=2199:00 +CPU= 20.232
  12:18:53 STEP 2200 H=2200:00 +CPU= 13.132
  12:19:06 STEP 2201 H=2201:00 +CPU= 12.660
  12:19:26 STEP 2202 H=2202:00 +CPU= 20.552
  12:19:39 STEP 2203 H=2203:00 +CPU= 12.932
  12:19:52 STEP 2204 H=2204:00 +CPU= 13.000
  12:20:13 STEP 2205 H=2205:00 +CPU= 20.528
  12:20:26 STEP 2206 H=2206:00 +CPU= 13.404
  12:20:39 STEP 2207 H=2207:00 +CPU= 13.412
  12:21:03 STEP 2208 H=2208:00 +CPU= 23.700
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002208
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002208
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMGGhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMSHhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMUAhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMGGhq0f+002196
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMSHhq0f+002196
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMUAhq0f+002196
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0454_2017050100_123_986_12203098_0_r2062377656_91.zip
Uploading the intermediate file: upload_file_91.zip
  12:21:16 STEP 2209 H=2209:00 +CPU= 12.740
  12:21:29 STEP 2210 H=2210:00 +CPU= 12.828
  12:21:49 STEP 2211 H=2211:00 +CPU= 20.172
  12:22:02 STEP 2212 H=2212:00 +CPU= 13.176
  12:22:15 STEP 2213 H=2213:00 +CPU= 12.640
  12:22:35 STEP 2214 H=2214:00 +CPU= 20.552
  12:22:48 STEP 2215 H=2215:00 +CPU= 12.952
  12:23:01 STEP 2216 H=2216:00 +CPU= 13.000
  12:23:21 STEP 2217 H=2217:00 +CPU= 20.196
  12:23:34 STEP 2218 H=2218:00 +CPU= 13.200
  12:23:47 STEP 2219 H=2219:00 +CPU= 12.604
  12:24:09 STEP 2220 H=2220:00 +CPU= 22.244
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002220
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002220
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002220
  12:24:22 STEP 2221 H=2221:00 +CPU= 12.756
  12:24:35 STEP 2222 H=2222:00 +CPU= 13.064
  12:24:55 STEP 2223 H=2223:00 +CPU= 20.104
  12:25:08 STEP 2224 H=2224:00 +CPU= 12.896
  12:25:21 STEP 2225 H=2225:00 +CPU= 12.656
  12:25:40 STEP 2226 H=2226:00 +CPU= 19.480
  12:25:52 STEP 2227 H=2227:00 +CPU= 12.088
  12:26:05 STEP 2228 H=2228:00 +CPU= 12.560
  12:26:25 STEP 2229 H=2229:00 +CPU= 20.176
  12:26:39 STEP 2230 H=2230:00 +CPU= 13.160
  12:26:52 STEP 2231 H=2231:00 +CPU= 13.092
  12:27:15 STEP 2232 H=2232:00 +CPU= 23.644
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002232
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002232
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMGGhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMSHhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMUAhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMGGhq0f+002220
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMSHhq0f+002220
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMUAhq0f+002220
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0454_2017050100_123_986_12203098_0_r2062377656_92.zip
Uploading the intermediate file: upload_file_92.zip
  12:27:28 STEP 2233 H=2233:00 +CPU= 12.872
  12:27:41 STEP 2234 H=2234:00 +CPU= 13.136
  12:28:01 STEP 2235 H=2235:00 +CPU= 19.992
  12:28:14 STEP 2236 H=2236:00 +CPU= 13.104
  12:28:27 STEP 2237 H=2237:00 +CPU= 12.748
  12:28:48 STEP 2238 H=2238:00 +CPU= 20.436
  12:29:00 STEP 2239 H=2239:00 +CPU= 12.748
  12:29:13 STEP 2240 H=2240:00 +CPU= 13.092
  12:29:34 STEP 2241 H=2241:00 +CPU= 20.224
  12:29:47 STEP 2242 H=2242:00 +CPU= 13.256
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 2017050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0454
(argv4) batchid: 986
(argv5) wuid: 12203098
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/3
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/3/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/3/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_f76ad3c0d6dd012f71ebb91ee31d73df to: /var/lib/boinc-client/slots/3/oifs_43r3_ps_0454_2017050100_123_986_12203098.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/3/oifs_43r3_ps_0454_2017050100_123_986_12203098.zip
ic_ancil_file: ic_ancil_12203098
ifsdata_file: ifsdata_12203098
climate_data_file: clim_data_12203098
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_a011e140957ae61a2a2cd5decb5e4c96 to: /var/lib/boinc-client/slots/3/ic_ancil_12203098.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/3/ic_ancil_12203098.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_43e280894d6e9d9d341ac9e1c609097e to: /var/lib/boinc-client/slots/3/ifsdata/ifsdata_12203098.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/3/ifsdata/ifsdata_12203098.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/3/159l_2/clim_data_12203098.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/3/159l_2/clim_data_12203098.zip
Checking for progress XML file: /var/lib/boinc-client/slots/3/progress_file_12203098.xml
Opened progress file ok : /var/lib/boinc-client/slots/3/progress_file_12203098.xml
-- Model is restarting --
Adjusting last_iter, 2242, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/3/progress_file_12203098.xml
last_cpu_time: 36918
upload_file_number: 93
last_iter: 2231
last_upload: 8035200
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0454_2017050100_123_986_12203098_0_r2062377656
The child process has been launched with process id: 16747
Executing the command: /var/lib/boinc-client/slots/3/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:atlas:1:1:16747:16747] [20230121:123054:1674300654:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:atlas:1:1:16747:16747] [20230121:123054:1674300654:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:atlas:1:1:16747:16747] [20230121:123054:1674300654:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:atlas:1:1:16747:16747] [20230121:123054:1674300654:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:atlas:1:1:16747:16747] [20230121:123054:1674300654:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:atlas:1:1:16747:16747] [20230121:123054:1674300654:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:atlas:1:1:16747:16747] [20230121:123054:1674300654:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:atlas:1:1:16747:16747] [20230121:123054:1674300654:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:atlas:1:1:16747:16747] [20230121:123054:1674300654:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:atlas:1:1:16747:16747] [20230121:123054:1674300654:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:atlas:1:1:16747:16747] [20230121:123054:1674300654:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:atlas:1:1:16747:16747] [20230121:123054:1674300654:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:atlas:1:1:16747:16747] [20230121:123054:1674300654:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:atlas:1:1:16747:16747] [20230121:123054:1674300654:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:atlas:1:1:16747:16747] [20230121:123054:1674300654:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:atlas:1:1:16747:16747] [20230121:123054:1674300654:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:atlas:1:1:16747:16747] [20230121:123054:1674300654:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:atlas:1:1:16747:16747] [20230121:123054:1674300654:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:atlas:1:1:16747:16747] [20230121:123054:1674300654:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:atlas:1:1:16747:16747] [20230121:123054:1674300654:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:atlas:1:1:16747:16747] [20230121:123054:1674300654:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:atlas:1:1:16747:16747] [20230121:123054:1674300654:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:atlas:1:1:16747:16747] [20230121:123054:1674300654:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:atlas:1:1:16747:16747] [20230121:123054:1674300654:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:atlas:1:1:16747:16747] [20230121:123054:1674300654:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:atlas:1:1:16747:16747] [20230121:123054:1674300654:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:atlas:1:1:16747:16747] [20230121:123054:1674300654:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:atlas:1:1:16747:16747] [20230121:123054:1674300654:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:atlas:1:1:16747:16747] [20230121:123054:1674300654:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:atlas:1:1:16747:16747] [20230121:123054:1674300654:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  12:31:19 STEP 2232 H=2232:00 +CPU= 22.872
  12:31:32 STEP 2233 H=2233:00 +CPU= 12.736
  12:31:45 STEP 2234 H=2234:00 +CPU= 12.916
  12:32:05 STEP 2235 H=2235:00 +CPU= 20.100
  12:32:18 STEP 2236 H=2236:00 +CPU= 13.208
  12:32:31 STEP 2237 H=2237:00 +CPU= 12.736
  12:32:51 STEP 2238 H=2238:00 +CPU= 20.468
  12:33:04 STEP 2239 H=2239:00 +CPU= 12.912
  12:33:17 STEP 2240 H=2240:00 +CPU= 13.084
  12:33:37 STEP 2241 H=2241:00 +CPU= 20.116
  12:33:50 STEP 2242 H=2242:00 +CPU= 13.248
  12:34:04 STEP 2243 H=2243:00 +CPU= 13.324
  12:34:27 STEP 2244 H=2244:00 +CPU= 23.148
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002244
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002244
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002244
  12:34:40 STEP 2245 H=2245:00 +CPU= 12.748
  12:34:53 STEP 2246 H=2246:00 +CPU= 13.076
  12:35:13 STEP 2247 H=2247:00 +CPU= 20.284
  12:35:26 STEP 2248 H=2248:00 +CPU= 13.252
  12:35:39 STEP 2249 H=2249:00 +CPU= 12.560
  12:35:59 STEP 2250 H=2250:00 +CPU= 20.432
  12:36:12 STEP 2251 H=2251:00 +CPU= 12.760
  12:36:25 STEP 2252 H=2252:00 +CPU= 12.940
  12:36:45 STEP 2253 H=2253:00 +CPU= 19.976
  12:36:58 STEP 2254 H=2254:00 +CPU= 13.156
  12:37:11 STEP 2255 H=2255:00 +CPU= 12.984
  12:37:35 STEP 2256 H=2256:00 +CPU= 23.492
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002256
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002256
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMGGhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMSHhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMUAhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMGGhq0f+002244
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMSHhq0f+002244
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12203098/ICMUAhq0f+002244
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0454_2017050100_123_986_12203098_0_r2062377656_93.zip
Uploading the intermediate file: upload_file_93.zip
  12:37:47 STEP 2257 H=2257:00 +CPU= 12.692
  12:38:04 STEP 2258 H=2258:00 +CPU= 12.872
  12:38:24 STEP 2259 H=2259:00 +CPU= 20.104
  12:38:37 STEP 2260 H=2260:00 +CPU= 13.100
  12:38:49 STEP 2261 H=2261:00 +CPU= 12.536
  12:39:10 STEP 2262 H=2262:00 +CPU= 20.620
  12:39:23 STEP 2263 H=2263:00 +CPU= 12.812
  12:39:36 STEP 2264 H=2264:00 +CPU= 13.092
  12:39:56 STEP 2265 H=2265:00 +CPU= 20.384
  12:40:10 STEP 2266 H=2266:00 +CPU= 13.352
  12:40:22 STEP 2267 H=2267:00 +CPU= 12.796
  12:40:44 STEP 2268 H=2268:00 +CPU= 22.148
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGhq0f+002268
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHhq0f+002268
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAhq0f+002268
  12:40:57 STEP 2269 H=2269:00 +CPU= 12.832
  12:41:10 STEP 2270 H=2270:00 +CPU= 12.832
Abort request received from BOINC client, ending the child process

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:33:04 1414915 22289531 oifs_43r3_ps_0454_2017050100_123_986_12203098_0 7,257,600 33,394 0.0046
09 May 2023 16:32:58 1414915 22289531 oifs_43r3_ps_0454_2017050100_123_986_12203098_0 6,393,600 29,635 0.0046
09 May 2023 16:32:46 1414915 22289531 oifs_43r3_ps_0454_2017050100_123_986_12203098_0 5,529,600 25,524 0.0046


©2024 climateprediction.net