<core_client_version>7.20.2</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
rc/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tweenis:1:1:7016:7016] [20221223:122632:1671798392:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:tweenis:1:1:7016:7016] [20221223:122632:1671798392:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tweenis:1:1:7016:7016] [20221223:122632:1671798392:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:tweenis:1:1:7016:7016] [20221223:122632:1671798392:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:tweenis:1:1:7016:7016] [20221223:122632:1671798392:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tweenis:1:1:7016:7016] [20221223:122632:1671798392:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tweenis:1:1:7016:7016] [20221223:122632:1671798392:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:tweenis:1:1:7016:7016] [20221223:122632:1671798392:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tweenis:1:1:7016:7016] [20221223:122632:1671798392:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tweenis:1:1:7016:7016] [20221223:122632:1671798392:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tweenis:1:1:7016:7016] [20221223:122632:1671798392:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:tweenis:1:1:7016:7016] [20221223:122632:1671798392:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:tweenis:1:1:7016:7016] [20221223:122632:1671798392:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:tweenis:1:1:7016:7016] [20221223:122632:1671798392:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
12:27:18 STEP 2016 H=2016:00 +CPU= 40.963
12:27:40 STEP 2017 H=2017:00 +CPU= 21.998
12:28:00 STEP 2018 H=2018:00 +CPU= 19.964
12:28:30 STEP 2019 H=2019:00 +CPU= 29.274
12:28:52 STEP 2020 H=2020:00 +CPU= 19.773
12:29:13 STEP 2021 H=2021:00 +CPU= 19.635
12:29:45 STEP 2022 H=2022:00 +CPU= 31.413
12:30:05 STEP 2023 H=2023:00 +CPU= 19.773
12:30:27 STEP 2024 H=2024:00 +CPU= 21.156
12:30:58 STEP 2025 H=2025:00 +CPU= 30.453
12:31:19 STEP 2026 H=2026:00 +CPU= 21.267
12:31:42 STEP 2027 H=2027:00 +CPU= 21.362
12:32:27 STEP 2028 H=2028:00 +CPU= 38.744
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGhq0f+002028
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHhq0f+002028
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAhq0f+002028
12:32:55 STEP 2029 H=2029:00 +CPU= 24.071
12:33:27 STEP 2030 H=2030:00 +CPU= 24.922
12:34:09 STEP 2031 H=2031:00 +CPU= 35.719
12:34:38 STEP 2032 H=2032:00 +CPU= 25.379
12:35:05 STEP 2033 H=2033:00 +CPU= 23.621
12:35:50 STEP 2034 H=2034:00 +CPU= 35.151
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:36:34 STEP 2035 H=2035:00 +CPU= 23.932
12:37:06 STEP 2036 H=2036:00 +CPU= 24.736
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:38:16 STEP 2037 H=2037:00 +CPU= 34.523
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:39:11 STEP 2038 H=2038:00 +CPU= 24.094
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:39:54 STEP 2039 H=2039:00 +CPU= 25.429
12:40:42 STEP 2040 H=2040:00 +CPU= 40.682
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGhq0f+002040
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHhq0f+002040
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAhq0f+002040
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMGGhq0f+002016
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMSHhq0f+002016
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMUAhq0f+002016
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMGGhq0f+002028
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMSHhq0f+002028
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMUAhq0f+002028
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0078_1991050100_123_960_12176722_0_r750676233_84.zip
Uploading the intermediate file: upload_file_84.zip
12:41:06 STEP 2041 H=2041:00 +CPU= 21.264
12:41:35 STEP 2042 H=2042:00 +CPU= 23.715
12:42:13 STEP 2043 H=2043:00 +CPU= 32.648
12:42:42 STEP 2044 H=2044:00 +CPU= 23.850
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:43:23 STEP 2045 H=2045:00 +CPU= 22.270
12:44:06 STEP 2046 H=2046:00 +CPU= 34.354
12:44:35 STEP 2047 H=2047:00 +CPU= 23.396
12:45:04 STEP 2048 H=2048:00 +CPU= 23.839
12:45:43 STEP 2049 H=2049:00 +CPU= 33.183
12:46:12 STEP 2050 H=2050:00 +CPU= 23.925
12:46:39 STEP 2051 H=2051:00 +CPU= 22.751
12:47:18 STEP 2052 H=2052:00 +CPU= 34.085
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGhq0f+002052
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHhq0f+002052
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAhq0f+002052
12:47:41 STEP 2053 H=2053:00 +CPU= 19.428
12:48:07 STEP 2054 H=2054:00 +CPU= 20.840
12:48:43 STEP 2055 H=2055:00 +CPU= 29.169
12:49:06 STEP 2056 H=2056:00 +CPU= 19.568
12:49:30 STEP 2057 H=2057:00 +CPU= 19.243
12:50:05 STEP 2058 H=2058:00 +CPU= 29.251
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:50:46 STEP 2059 H=2059:00 +CPU= 21.771
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:51:38 STEP 2060 H=2060:00 +CPU= 22.595
12:52:18 STEP 2061 H=2061:00 +CPU= 33.681
12:52:48 STEP 2062 H=2062:00 +CPU= 24.033
12:53:17 STEP 2063 H=2063:00 +CPU= 24.309
12:54:07 STEP 2064 H=2064:00 +CPU= 40.394
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGhq0f+002064
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHhq0f+002064
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAhq0f+002064
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMGGhq0f+002040
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMSHhq0f+002040
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMUAhq0f+002040
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMGGhq0f+002052
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMSHhq0f+002052
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMUAhq0f+002052
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0078_1991050100_123_960_12176722_0_r750676233_85.zip
Uploading the intermediate file: upload_file_85.zip
12:54:36 STEP 2065 H=2065:00 +CPU= 23.531
12:55:06 STEP 2066 H=2066:00 +CPU= 24.040
12:55:47 STEP 2067 H=2067:00 +CPU= 33.955
12:56:16 STEP 2068 H=2068:00 +CPU= 24.142
12:56:45 STEP 2069 H=2069:00 +CPU= 23.091
12:57:26 STEP 2070 H=2070:00 +CPU= 34.586
12:57:54 STEP 2071 H=2071:00 +CPU= 22.935
12:58:23 STEP 2072 H=2072:00 +CPU= 23.635
12:59:04 STEP 2073 H=2073:00 +CPU= 33.528
12:59:31 STEP 2074 H=2074:00 +CPU= 23.362
12:59:55 STEP 2075 H=2075:00 +CPU= 20.272
13:00:36 STEP 2076 H=2076:00 +CPU= 34.698
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGhq0f+002076
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHhq0f+002076
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAhq0f+002076
13:01:02 STEP 2077 H=2077:00 +CPU= 21.565
13:01:28 STEP 2078 H=2078:00 +CPU= 21.946
13:02:01 STEP 2079 H=2079:00 +CPU= 29.175
13:02:25 STEP 2080 H=2080:00 +CPU= 20.774
13:02:49 STEP 2081 H=2081:00 +CPU= 20.774
13:03:24 STEP 2082 H=2082:00 +CPU= 31.155
13:03:48 STEP 2083 H=2083:00 +CPU= 20.268
13:04:15 STEP 2084 H=2084:00 +CPU= 22.543
13:04:55 STEP 2085 H=2085:00 +CPU= 33.759
13:05:21 STEP 2086 H=2086:00 +CPU= 21.595
13:05:48 STEP 2087 H=2087:00 +CPU= 22.849
13:06:35 STEP 2088 H=2088:00 +CPU= 38.796
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGhq0f+002088
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHhq0f+002088
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAhq0f+002088
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMGGhq0f+002064
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMSHhq0f+002064
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMUAhq0f+002064
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMGGhq0f+002076
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMSHhq0f+002076
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMUAhq0f+002076
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0078_1991050100_123_960_12176722_0_r750676233_86.zip
Uploading the intermediate file: upload_file_86.zip
13:06:59 STEP 2089 H=2089:00 +CPU= 20.537
13:07:26 STEP 2090 H=2090:00 +CPU= 22.787
13:08:06 STEP 2091 H=2091:00 +CPU= 33.866
13:08:31 STEP 2092 H=2092:00 +CPU= 20.669
13:08:57 STEP 2093 H=2093:00 +CPU= 22.126
13:09:38 STEP 2094 H=2094:00 +CPU= 34.348
13:10:00 STEP 2095 H=2095:00 +CPU= 19.810
13:10:23 STEP 2096 H=2096:00 +CPU= 20.081
13:11:01 STEP 2097 H=2097:00 +CPU= 32.045
13:11:25 STEP 2098 H=2098:00 +CPU= 20.118
13:11:49 STEP 2099 H=2099:00 +CPU= 20.777
13:12:34 STEP 2100 H=2100:00 +CPU= 37.745
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGhq0f+002100
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHhq0f+002100
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAhq0f+002100
13:12:59 STEP 2101 H=2101:00 +CPU= 20.759
13:13:24 STEP 2102 H=2102:00 +CPU= 21.731
13:14:02 STEP 2103 H=2103:00 +CPU= 32.691
13:14:25 STEP 2104 H=2104:00 +CPU= 20.735
13:14:52 STEP 2105 H=2105:00 +CPU= 22.591
13:15:32 STEP 2106 H=2106:00 +CPU= 34.787
13:15:55 STEP 2107 H=2107:00 +CPU= 20.413
13:16:24 STEP 2108 H=2108:00 +CPU= 24.446
13:17:03 STEP 2109 H=2109:00 +CPU= 33.881
13:17:30 STEP 2110 H=2110:00 +CPU= 22.585
13:17:57 STEP 2111 H=2111:00 +CPU= 23.106
13:18:45 STEP 2112 H=2112:00 +CPU= 40.219
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGhq0f+002112
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHhq0f+002112
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAhq0f+002112
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMGGhq0f+002088
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMSHhq0f+002088
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMUAhq0f+002088
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMGGhq0f+002100
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMSHhq0f+002100
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMUAhq0f+002100
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0078_1991050100_123_960_12176722_0_r750676233_87.zip
Uploading the intermediate file: upload_file_87.zip
13:19:10 STEP 2113 H=2113:00 +CPU= 21.368
13:19:39 STEP 2114 H=2114:00 +CPU= 23.910
13:20:22 STEP 2115 H=2115:00 +CPU= 35.793
13:20:51 STEP 2116 H=2116:00 +CPU= 23.904
13:21:20 STEP 2117 H=2117:00 +CPU= 23.756
13:22:01 STEP 2118 H=2118:00 +CPU= 35.012
13:22:28 STEP 2119 H=2119:00 +CPU= 22.489
13:22:56 STEP 2120 H=2120:00 +CPU= 23.683
13:23:40 STEP 2121 H=2121:00 +CPU= 37.146
13:24:07 STEP 2122 H=2122:00 +CPU= 23.590
13:24:35 STEP 2123 H=2123:00 +CPU= 23.853
13:25:25 STEP 2124 H=2124:00 +CPU= 41.727
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGhq0f+002124
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHhq0f+002124
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAhq0f+002124
13:25:53 STEP 2125 H=2125:00 +CPU= 23.950
13:26:23 STEP 2126 H=2126:00 +CPU= 25.454
13:27:12 STEP 2127 H=2127:00 +CPU= 39.375
13:27:46 STEP 2128 H=2128:00 +CPU= 26.943
13:28:19 STEP 2129 H=2129:00 +CPU= 26.021
13:29:12 STEP 2130 H=2130:00 +CPU= 42.022
13:29:45 STEP 2131 H=2131:00 +CPU= 26.566
13:30:18 STEP 2132 H=2132:00 +CPU= 26.890
13:31:09 STEP 2133 H=2133:00 +CPU= 41.328
13:31:42 STEP 2134 H=2134:00 +CPU= 26.976
13:32:14 STEP 2135 H=2135:00 +CPU= 27.146
13:33:11 STEP 2136 H=2136:00 +CPU= 47.428
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGhq0f+002136
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHhq0f+002136
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAhq0f+002136
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMGGhq0f+002112
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMSHhq0f+002112
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMUAhq0f+002112
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMGGhq0f+002124
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMSHhq0f+002124
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMUAhq0f+002124
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0078_1991050100_123_960_12176722_0_r750676233_88.zip
Uploading the intermediate file: upload_file_88.zip
13:33:45 STEP 2137 H=2137:00 +CPU= 27.753
13:34:17 STEP 2138 H=2138:00 +CPU= 26.571
13:35:06 STEP 2139 H=2139:00 +CPU= 41.009
13:35:40 STEP 2140 H=2140:00 +CPU= 27.991
13:36:12 STEP 2141 H=2141:00 +CPU= 26.186
13:37:04 STEP 2142 H=2142:00 +CPU= 42.267
13:37:37 STEP 2143 H=2143:00 +CPU= 27.258
13:38:06 STEP 2144 H=2144:00 +CPU= 25.286
13:38:55 STEP 2145 H=2145:00 +CPU= 40.231
13:39:28 STEP 2146 H=2146:00 +CPU= 26.732
13:40:01 STEP 2147 H=2147:00 +CPU= 26.330
13:40:57 STEP 2148 H=2148:00 +CPU= 45.170
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGhq0f+002148
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHhq0f+002148
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAhq0f+002148
13:41:31 STEP 2149 H=2149:00 +CPU= 27.514
13:42:05 STEP 2150 H=2150:00 +CPU= 26.991
13:42:54 STEP 2151 H=2151:00 +CPU= 41.024
13:43:28 STEP 2152 H=2152:00 +CPU= 28.022
13:44:00 STEP 2153 H=2153:00 +CPU= 26.774
13:44:51 STEP 2154 H=2154:00 +CPU= 42.030
13:45:25 STEP 2155 H=2155:00 +CPU= 27.536
13:45:57 STEP 2156 H=2156:00 +CPU= 26.996
13:46:45 STEP 2157 H=2157:00 +CPU= 40.250
13:47:20 STEP 2158 H=2158:00 +CPU= 27.745
13:47:53 STEP 2159 H=2159:00 +CPU= 27.234
13:48:51 STEP 2160 H=2160:00 +CPU= 47.835
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGhq0f+002160
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHhq0f+002160
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAhq0f+002160
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMGGhq0f+002136
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMSHhq0f+002136
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMUAhq0f+002136
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMGGhq0f+002148
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMSHhq0f+002148
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMUAhq0f+002148
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0078_1991050100_123_960_12176722_0_r750676233_89.zip
Uploading the intermediate file: upload_file_89.zip
13:49:26 STEP 2161 H=2161:00 +CPU= 28.328
13:49:58 STEP 2162 H=2162:00 +CPU= 27.316
13:50:47 STEP 2163 H=2163:00 +CPU= 40.460
13:51:21 STEP 2164 H=2164:00 +CPU= 28.269
13:51:52 STEP 2165 H=2165:00 +CPU= 26.346
13:52:42 STEP 2166 H=2166:00 +CPU= 41.376
13:53:16 STEP 2167 H=2167:00 +CPU= 27.109
13:53:47 STEP 2168 H=2168:00 +CPU= 26.239
13:54:34 STEP 2169 H=2169:00 +CPU= 39.810
13:55:07 STEP 2170 H=2170:00 +CPU= 27.891
13:55:39 STEP 2171 H=2171:00 +CPU= 26.664
13:56:32 STEP 2172 H=2172:00 +CPU= 44.859
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGhq0f+002172
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHhq0f+002172
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAhq0f+002172
13:57:05 STEP 2173 H=2173:00 +CPU= 27.078
13:57:38 STEP 2174 H=2174:00 +CPU= 27.365
13:58:24 STEP 2175 H=2175:00 +CPU= 39.253
13:58:54 STEP 2176 H=2176:00 +CPU= 25.420
13:59:22 STEP 2177 H=2177:00 +CPU= 24.284
14:00:06 STEP 2178 H=2178:00 +CPU= 37.004
14:00:35 STEP 2179 H=2179:00 +CPU= 24.783
14:01:04 STEP 2180 H=2180:00 +CPU= 24.575
14:01:44 STEP 2181 H=2181:00 +CPU= 35.782
14:02:13 STEP 2182 H=2182:00 +CPU= 24.984
14:02:43 STEP 2183 H=2183:00 +CPU= 25.074
14:03:33 STEP 2184 H=2184:00 +CPU= 41.959
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGhq0f+002184
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHhq0f+002184
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAhq0f+002184
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMGGhq0f+002160
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMSHhq0f+002160
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMUAhq0f+002160
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMGGhq0f+002172
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMSHhq0f+002172
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMUAhq0f+002172
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0078_1991050100_123_960_12176722_0_r750676233_90.zip
Uploading the intermediate file: upload_file_90.zip
14:04:02 STEP 2185 H=2185:00 +CPU= 24.645
14:04:32 STEP 2186 H=2186:00 +CPU= 24.432
14:05:16 STEP 2187 H=2187:00 +CPU= 35.956
14:05:46 STEP 2188 H=2188:00 +CPU= 24.944
14:06:14 STEP 2189 H=2189:00 +CPU= 23.982
14:06:58 STEP 2190 H=2190:00 +CPU= 36.775
14:07:27 STEP 2191 H=2191:00 +CPU= 24.242
14:07:56 STEP 2192 H=2192:00 +CPU= 24.585
14:08:38 STEP 2193 H=2193:00 +CPU= 36.318
14:09:06 STEP 2194 H=2194:00 +CPU= 24.413
14:09:35 STEP 2195 H=2195:00 +CPU= 24.309
14:10:23 STEP 2196 H=2196:00 +CPU= 40.583
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGhq0f+002196
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHhq0f+002196
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAhq0f+002196
14:10:51 STEP 2197 H=2197:00 +CPU= 23.754
14:11:21 STEP 2198 H=2198:00 +CPU= 24.832
14:12:04 STEP 2199 H=2199:00 +CPU= 36.117
14:12:33 STEP 2200 H=2200:00 +CPU= 24.408
14:13:02 STEP 2201 H=2201:00 +CPU= 24.248
14:13:46 STEP 2202 H=2202:00 +CPU= 36.706
14:14:15 STEP 2203 H=2203:00 +CPU= 24.458
14:14:44 STEP 2204 H=2204:00 +CPU= 25.191
14:15:24 STEP 2205 H=2205:00 +CPU= 35.760
14:15:51 STEP 2206 H=2206:00 +CPU= 24.783
14:16:19 STEP 2207 H=2207:00 +CPU= 25.057
14:17:07 STEP 2208 H=2208:00 +CPU= 42.061
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGhq0f+002208
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHhq0f+002208
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAhq0f+002208
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMGGhq0f+002184
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMSHhq0f+002184
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMUAhq0f+002184
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMGGhq0f+002196
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMSHhq0f+002196
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMUAhq0f+002196
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0078_1991050100_123_960_12176722_0_r750676233_91.zip
Uploading the intermediate file: upload_file_91.zip
14:17:33 STEP 2209 H=2209:00 +CPU= 23.811
14:18:01 STEP 2210 H=2210:00 +CPU= 24.954
14:18:41 STEP 2211 H=2211:00 +CPU= 36.100
14:19:10 STEP 2212 H=2212:00 +CPU= 24.951
14:19:38 STEP 2213 H=2213:00 +CPU= 24.348
14:20:17 STEP 2214 H=2214:00 +CPU= 36.428
14:20:41 STEP 2215 H=2215:00 +CPU= 23.197
14:21:06 STEP 2216 H=2216:00 +CPU= 24.080
14:21:45 STEP 2217 H=2217:00 +CPU= 35.982
14:22:10 STEP 2218 H=2218:00 +CPU= 23.613
14:22:34 STEP 2219 H=2219:00 +CPU= 23.281
14:23:20 STEP 2220 H=2220:00 +CPU= 40.671
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGhq0f+002220
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHhq0f+002220
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAhq0f+002220
14:23:47 STEP 2221 H=2221:00 +CPU= 23.919
14:24:16 STEP 2222 H=2222:00 +CPU= 24.973
14:24:56 STEP 2223 H=2223:00 +CPU= 36.323
14:25:25 STEP 2224 H=2224:00 +CPU= 24.916
14:25:52 STEP 2225 H=2225:00 +CPU= 23.691
14:26:36 STEP 2226 H=2226:00 +CPU= 37.058
14:27:03 STEP 2227 H=2227:00 +CPU= 23.494
14:27:30 STEP 2228 H=2228:00 +CPU= 24.071
14:28:14 STEP 2229 H=2229:00 +CPU= 36.338
14:28:42 STEP 2230 H=2230:00 +CPU= 24.543
14:29:13 STEP 2231 H=2231:00 +CPU= 25.131
14:30:05 STEP 2232 H=2232:00 +CPU= 42.578
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGhq0f+002232
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHhq0f+002232
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAhq0f+002232
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMGGhq0f+002208
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMSHhq0f+002208
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMUAhq0f+002208
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMGGhq0f+002220
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMSHhq0f+002220
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMUAhq0f+002220
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0078_1991050100_123_960_12176722_0_r750676233_92.zip
Uploading the intermediate file: upload_file_92.zip
14:30:32 STEP 2233 H=2233:00 +CPU= 23.188
14:31:03 STEP 2234 H=2234:00 +CPU= 24.415
14:31:49 STEP 2235 H=2235:00 +CPU= 36.632
14:32:19 STEP 2236 H=2236:00 +CPU= 23.996
14:32:48 STEP 2237 H=2237:00 +CPU= 23.686
14:33:33 STEP 2238 H=2238:00 +CPU= 36.887
14:34:02 STEP 2239 H=2239:00 +CPU= 23.662
14:34:32 STEP 2240 H=2240:00 +CPU= 24.575
14:35:16 STEP 2241 H=2241:00 +CPU= 36.390
14:35:46 STEP 2242 H=2242:00 +CPU= 24.490
14:36:15 STEP 2243 H=2243:00 +CPU= 23.599
14:37:03 STEP 2244 H=2244:00 +CPU= 40.074
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGhq0f+002244
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHhq0f+002244
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAhq0f+002244
14:37:33 STEP 2245 H=2245:00 +CPU= 24.137
14:38:02 STEP 2246 H=2246:00 +CPU= 24.456
14:38:41 STEP 2247 H=2247:00 +CPU= 34.602
14:39:06 STEP 2248 H=2248:00 +CPU= 23.689
14:39:31 STEP 2249 H=2249:00 +CPU= 23.192
14:40:11 STEP 2250 H=2250:00 +CPU= 36.358
14:40:40 STEP 2251 H=2251:00 +CPU= 23.808
14:41:08 STEP 2252 H=2252:00 +CPU= 23.830
14:41:50 STEP 2253 H=2253:00 +CPU= 35.738
14:42:22 STEP 2254 H=2254:00 +CPU= 25.698
14:42:56 STEP 2255 H=2255:00 +CPU= 26.792
14:43:53 STEP 2256 H=2256:00 +CPU= 45.005
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGhq0f+002256
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHhq0f+002256
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAhq0f+002256
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMGGhq0f+002232
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMSHhq0f+002232
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMUAhq0f+002232
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMGGhq0f+002244
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMSHhq0f+002244
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMUAhq0f+002244
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0078_1991050100_123_960_12176722_0_r750676233_93.zip
Uploading the intermediate file: upload_file_93.zip
Uploading trickle at timestep: 8121600
14:44:26 STEP 2257 H=2257:00 +CPU= 25.849
14:44:59 STEP 2258 H=2258:00 +CPU= 26.269
14:45:47 STEP 2259 H=2259:00 +CPU= 38.145
14:46:22 STEP 2260 H=2260:00 +CPU= 26.722
14:46:56 STEP 2261 H=2261:00 +CPU= 25.626
14:47:47 STEP 2262 H=2262:00 +CPU= 39.701
14:48:16 STEP 2263 H=2263:00 +CPU= 23.920
14:48:46 STEP 2264 H=2264:00 +CPU= 24.499
14:49:31 STEP 2265 H=2265:00 +CPU= 36.674
14:50:01 STEP 2266 H=2266:00 +CPU= 24.652
14:50:30 STEP 2267 H=2267:00 +CPU= 23.668
14:51:21 STEP 2268 H=2268:00 +CPU= 40.436
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGhq0f+002268
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHhq0f+002268
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAhq0f+002268
14:51:50 STEP 2269 H=2269:00 +CPU= 24.166
14:52:19 STEP 2270 H=2270:00 +CPU= 24.144
14:53:03 STEP 2271 H=2271:00 +CPU= 36.947
14:53:32 STEP 2272 H=2272:00 +CPU= 24.004
14:54:02 STEP 2273 H=2273:00 +CPU= 21.959
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1991050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0078
(argv4) batchid: 960
(argv5) wuid: 12176722
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/2
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/2/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/2/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_2fa16d2cee5ba101aaaef2150ab97c98 to: /var/lib/boinc/slots/2/oifs_43r3_ps_0078_1991050100_123_960_12176722.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/2/oifs_43r3_ps_0078_1991050100_123_960_12176722.zip
ic_ancil_file: ic_ancil_12176722
ifsdata_file: ifsdata_12176722
climate_data_file: clim_data_12176722
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_9abadf5fbdd8a93dab5f2e9d629f1620 to: /var/lib/boinc/slots/2/ic_ancil_12176722.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/2/ic_ancil_12176722.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_01b3e83fc04f42957632500255cabe6d to: /var/lib/boinc/slots/2/ifsdata/ifsdata_12176722.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/2/ifsdata/ifsdata_12176722.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/2/159l_2/clim_data_12176722.zip
Unzipping the climate data zip file: /var/lib/boinc/slots/2/159l_2/clim_data_12176722.zip
Checking for progress XML file: /var/lib/boinc/slots/2/progress_file_12176722.xml
Opened progress file ok : /var/lib/boinc/slots/2/progress_file_12176722.xml
-- Model is restarting --
Adjusting last_iter, 2274, to previous model restart step.
Creating progress file: /var/lib/boinc/slots/2/progress_file_12176722.xml
last_cpu_time: 64607
upload_file_number: 94
last_iter: 2255
last_upload: 8121600
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0078_1991050100_123_960_12176722_0_r750676233
The child process has been launched with process id: 3789
Executing the command: /var/lib/boinc/slots/2/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:tweenis:1:1:3789:3789] [20221223:183811:1671820691:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:tweenis:1:1:3789:3789] [20221223:183811:1671820691:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:tweenis:1:1:3789:3789] [20221223:183811:1671820691:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:tweenis:1:1:3789:3789] [20221223:183811:1671820691:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:tweenis:1:1:3789:3789] [20221223:183811:1671820691:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:tweenis:1:1:3789:3789] [20221223:183811:1671820691:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:tweenis:1:1:3789:3789] [20221223:183811:1671820691:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:tweenis:1:1:3789:3789] [20221223:183811:1671820691:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:tweenis:1:1:3789:3789] [20221223:183811:1671820691:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:tweenis:1:1:3789:3789] [20221223:183811:1671820691:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:tweenis:1:1:3789:3789] [20221223:183811:1671820691:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:tweenis:1:1:3789:3789] [20221223:183811:1671820691:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:tweenis:1:1:3789:3789] [20221223:183811:1671820691:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:tweenis:1:1:3789:3789] [20221223:183811:1671820691:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:tweenis:1:1:3789:3789] [20221223:183811:1671820691:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:tweenis:1:1:3789:3789] [20221223:183811:1671820691:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tweenis:1:1:3789:3789] [20221223:183811:1671820691:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:tweenis:1:1:3789:3789] [20221223:183811:1671820691:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tweenis:1:1:3789:3789] [20221223:183811:1671820691:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:tweenis:1:1:3789:3789] [20221223:183811:1671820691:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:tweenis:1:1:3789:3789] [20221223:183811:1671820691:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tweenis:1:1:3789:3789] [20221223:183811:1671820691:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tweenis:1:1:3789:3789] [20221223:183811:1671820691:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:tweenis:1:1:3789:3789] [20221223:183811:1671820691:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tweenis:1:1:3789:3789] [20221223:183811:1671820691:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tweenis:1:1:3789:3789] [20221223:183811:1671820691:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tweenis:1:1:3789:3789] [20221223:183811:1671820691:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:tweenis:1:1:3789:3789] [20221223:183811:1671820691:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:tweenis:1:1:3789:3789] [20221223:183811:1671820691:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:tweenis:1:1:3789:3789] [20221223:183811:1671820691:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
18:39:00 STEP 2256 H=2256:00 +CPU= 40.152
18:39:27 STEP 2257 H=2257:00 +CPU= 25.133
18:39:54 STEP 2258 H=2258:00 +CPU= 24.994
18:40:29 STEP 2259 H=2259:00 +CPU= 33.888
18:40:55 STEP 2260 H=2260:00 +CPU= 23.924
18:41:20 STEP 2261 H=2261:00 +CPU= 23.478
18:41:56 STEP 2262 H=2262:00 +CPU= 33.752
18:42:22 STEP 2263 H=2263:00 +CPU= 24.138
18:42:48 STEP 2264 H=2264:00 +CPU= 24.226
18:43:23 STEP 2265 H=2265:00 +CPU= 33.466
18:43:49 STEP 2266 H=2266:00 +CPU= 24.290
18:44:14 STEP 2267 H=2267:00 +CPU= 23.801
18:44:54 STEP 2268 H=2268:00 +CPU= 38.124
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGhq0f+002268
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHhq0f+002268
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAhq0f+002268
18:45:19 STEP 2269 H=2269:00 +CPU= 24.287
18:45:45 STEP 2270 H=2270:00 +CPU= 24.625
18:46:21 STEP 2271 H=2271:00 +CPU= 33.493
18:46:46 STEP 2272 H=2272:00 +CPU= 24.278
18:47:12 STEP 2273 H=2273:00 +CPU= 24.010
18:47:48 STEP 2274 H=2274:00 +CPU= 34.570
18:48:13 STEP 2275 H=2275:00 +CPU= 23.906
18:48:39 STEP 2276 H=2276:00 +CPU= 24.299
18:49:15 STEP 2277 H=2277:00 +CPU= 34.533
18:49:41 STEP 2278 H=2278:00 +CPU= 24.628
18:50:08 STEP 2279 H=2279:00 +CPU= 25.237
18:50:54 STEP 2280 H=2280:00 +CPU= 41.638
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGhq0f+002280
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHhq0f+002280
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAhq0f+002280
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMGGhq0f+002256
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMSHhq0f+002256
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMUAhq0f+002256
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMGGhq0f+002268
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMSHhq0f+002268
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMUAhq0f+002268
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0078_1991050100_123_960_12176722_0_r750676233_94.zip
Uploading the intermediate file: upload_file_94.zip
18:51:20 STEP 2281 H=2281:00 +CPU= 24.622
18:51:46 STEP 2282 H=2282:00 +CPU= 23.986
18:52:15 STEP 2283 H=2283:00 +CPU= 28.298
18:52:31 STEP 2284 H=2284:00 +CPU= 15.972
18:52:47 STEP 2285 H=2285:00 +CPU= 15.588
18:53:15 STEP 2286 H=2286:00 +CPU= 26.181
18:53:33 STEP 2287 H=2287:00 +CPU= 17.739
18:53:51 STEP 2288 H=2288:00 +CPU= 17.515
18:54:18 STEP 2289 H=2289:00 +CPU= 26.040
18:54:37 STEP 2290 H=2290:00 +CPU= 17.887
18:54:54 STEP 2291 H=2291:00 +CPU= 16.981
18:55:24 STEP 2292 H=2292:00 +CPU= 28.634
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGhq0f+002292
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHhq0f+002292
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAhq0f+002292
18:55:42 STEP 2293 H=2293:00 +CPU= 17.323
18:56:00 STEP 2294 H=2294:00 +CPU= 17.436
18:56:27 STEP 2295 H=2295:00 +CPU= 25.765
18:56:45 STEP 2296 H=2296:00 +CPU= 17.601
18:57:03 STEP 2297 H=2297:00 +CPU= 16.975
18:57:30 STEP 2298 H=2298:00 +CPU= 26.281
18:57:48 STEP 2299 H=2299:00 +CPU= 17.114
18:58:06 STEP 2300 H=2300:00 +CPU= 17.629
18:58:33 STEP 2301 H=2301:00 +CPU= 26.013
18:58:51 STEP 2302 H=2302:00 +CPU= 18.085
18:59:10 STEP 2303 H=2303:00 +CPU= 17.914
18:59:41 STEP 2304 H=2304:00 +CPU= 29.991
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGhq0f+002304
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHhq0f+002304
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAhq0f+002304
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMGGhq0f+002280
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMSHhq0f+002280
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMUAhq0f+002280
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMGGhq0f+002292
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMSHhq0f+002292
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMUAhq0f+002292
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0078_1991050100_123_960_12176722_0_r750676233_95.zip
Uploading the intermediate file: upload_file_95.zip
18:59:59 STEP 2305 H=2305:00 +CPU= 17.265
19:00:18 STEP 2306 H=2306:00 +CPU= 17.973
19:00:44 STEP 2307 H=2307:00 +CPU= 25.381
19:01:02 STEP 2308 H=2308:00 +CPU= 17.552
19:01:20 STEP 2309 H=2309:00 +CPU= 17.138
19:01:48 STEP 2310 H=2310:00 +CPU= 26.489
19:02:06 STEP 2311 H=2311:00 +CPU= 17.234
19:02:24 STEP 2312 H=2312:00 +CPU= 17.756
19:02:51 STEP 2313 H=2313:00 +CPU= 25.963
19:03:10 STEP 2314 H=2314:00 +CPU= 18.053
19:03:28 STEP 2315 H=2315:00 +CPU= 17.434
19:03:57 STEP 2316 H=2316:00 +CPU= 28.554
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGhq0f+002316
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHhq0f+002316
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAhq0f+002316
19:04:16 STEP 2317 H=2317:00 +CPU= 17.742
19:04:34 STEP 2318 H=2318:00 +CPU= 17.557
19:05:01 STEP 2319 H=2319:00 +CPU= 25.846
19:05:19 STEP 2320 H=2320:00 +CPU= 17.695
19:05:37 STEP 2321 H=2321:00 +CPU= 17.118
19:06:04 STEP 2322 H=2322:00 +CPU= 26.483
19:06:23 STEP 2323 H=2323:00 +CPU= 17.781
19:06:41 STEP 2324 H=2324:00 +CPU= 17.506
19:07:09 STEP 2325 H=2325:00 +CPU= 26.467
19:07:27 STEP 2326 H=2326:00 +CPU= 18.149
19:07:46 STEP 2327 H=2327:00 +CPU= 17.788
19:08:18 STEP 2328 H=2328:00 +CPU= 30.864
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGhq0f+002328
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHhq0f+002328
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAhq0f+002328
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMGGhq0f+002304
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMSHhq0f+002304
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMUAhq0f+002304
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMGGhq0f+002316
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMSHhq0f+002316
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMUAhq0f+002316
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0078_1991050100_123_960_12176722_0_r750676233_96.zip
Uploading the intermediate file: upload_file_96.zip
19:08:36 STEP 2329 H=2329:00 +CPU= 17.341
19:08:55 STEP 2330 H=2330:00 +CPU= 17.780
19:09:21 STEP 2331 H=2331:00 +CPU= 25.998
19:09:40 STEP 2332 H=2332:00 +CPU= 17.865
19:09:58 STEP 2333 H=2333:00 +CPU= 17.348
19:10:26 STEP 2334 H=2334:00 +CPU= 26.625
19:10:44 STEP 2335 H=2335:00 +CPU= 17.690
19:11:03 STEP 2336 H=2336:00 +CPU= 17.619
19:11:30 STEP 2337 H=2337:00 +CPU= 26.123
19:11:48 STEP 2338 H=2338:00 +CPU= 17.742
19:12:06 STEP 2339 H=2339:00 +CPU= 17.261
19:12:36 STEP 2340 H=2340:00 +CPU= 29.332
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGhq0f+002340
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHhq0f+002340
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAhq0f+002340
19:12:55 STEP 2341 H=2341:00 +CPU= 17.594
19:13:13 STEP 2342 H=2342:00 +CPU= 17.693
19:13:40 STEP 2343 H=2343:00 +CPU= 25.918
19:13:59 STEP 2344 H=2344:00 +CPU= 18.239
19:14:17 STEP 2345 H=2345:00 +CPU= 17.552
19:14:45 STEP 2346 H=2346:00 +CPU= 26.870
19:15:03 STEP 2347 H=2347:00 +CPU= 17.557
19:15:22 STEP 2348 H=2348:00 +CPU= 17.935
19:15:49 STEP 2349 H=2349:00 +CPU= 26.085
19:16:07 STEP 2350 H=2350:00 +CPU= 17.667
19:16:26 STEP 2351 H=2351:00 +CPU= 17.998
19:16:59 STEP 2352 H=2352:00 +CPU= 30.762
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGhq0f+002352
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHhq0f+002352
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAhq0f+002352
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMGGhq0f+002328
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMSHhq0f+002328
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMUAhq0f+002328
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMGGhq0f+002340
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMSHhq0f+002340
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMUAhq0f+002340
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0078_1991050100_123_960_12176722_0_r750676233_97.zip
Uploading the intermediate file: upload_file_97.zip
19:17:17 STEP 2353 H=2353:00 +CPU= 17.483
19:17:34 STEP 2354 H=2354:00 +CPU= 15.877
19:17:58 STEP 2355 H=2355:00 +CPU= 23.199
19:18:14 STEP 2356 H=2356:00 +CPU= 15.613
19:18:30 STEP 2357 H=2357:00 +CPU= 14.827
19:18:54 STEP 2358 H=2358:00 +CPU= 24.049
19:19:10 STEP 2359 H=2359:00 +CPU= 15.246
19:19:26 STEP 2360 H=2360:00 +CPU= 15.317
19:19:50 STEP 2361 H=2361:00 +CPU= 23.551
19:20:06 STEP 2362 H=2362:00 +CPU= 15.425
19:20:22 STEP 2363 H=2363:00 +CPU= 15.036
19:20:49 STEP 2364 H=2364:00 +CPU= 26.106
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGhq0f+002364
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHhq0f+002364
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAhq0f+002364
19:21:04 STEP 2365 H=2365:00 +CPU= 15.037
19:21:20 STEP 2366 H=2366:00 +CPU= 15.331
19:21:44 STEP 2367 H=2367:00 +CPU= 23.115
19:22:00 STEP 2368 H=2368:00 +CPU= 15.732
19:22:15 STEP 2369 H=2369:00 +CPU= 14.886
19:22:40 STEP 2370 H=2370:00 +CPU= 23.873
19:22:55 STEP 2371 H=2371:00 +CPU= 15.116
19:23:11 STEP 2372 H=2372:00 +CPU= 15.331
19:23:35 STEP 2373 H=2373:00 +CPU= 23.426
19:23:51 STEP 2374 H=2374:00 +CPU= 15.584
19:24:07 STEP 2375 H=2375:00 +CPU= 15.694
19:24:36 STEP 2376 H=2376:00 +CPU= 27.240
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGhq0f+002376
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHhq0f+002376
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAhq0f+002376
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMGGhq0f+002352
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMSHhq0f+002352
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMUAhq0f+002352
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMGGhq0f+002364
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMSHhq0f+002364
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMUAhq0f+002364
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0078_1991050100_123_960_12176722_0_r750676233_98.zip
Uploading the intermediate file: upload_file_98.zip
19:24:52 STEP 2377 H=2377:00 +CPU= 15.208
19:25:08 STEP 2378 H=2378:00 +CPU= 15.469
19:25:32 STEP 2379 H=2379:00 +CPU= 23.404
19:25:48 STEP 2380 H=2380:00 +CPU= 15.626
19:26:03 STEP 2381 H=2381:00 +CPU= 14.975
19:26:29 STEP 2382 H=2382:00 +CPU= 24.245
19:26:44 STEP 2383 H=2383:00 +CPU= 15.009
19:27:00 STEP 2384 H=2384:00 +CPU= 15.258
19:27:24 STEP 2385 H=2385:00 +CPU= 23.439
19:27:40 STEP 2386 H=2386:00 +CPU= 15.487
19:27:55 STEP 2387 H=2387:00 +CPU= 14.804
19:28:22 STEP 2388 H=2388:00 +CPU= 25.906
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGhq0f+002388
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHhq0f+002388
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAhq0f+002388
19:28:38 STEP 2389 H=2389:00 +CPU= 15.173
19:28:53 STEP 2390 H=2390:00 +CPU= 15.263
19:29:18 STEP 2391 H=2391:00 +CPU= 23.678
19:29:34 STEP 2392 H=2392:00 +CPU= 15.337
19:29:49 STEP 2393 H=2393:00 +CPU= 15.056
19:30:13 STEP 2394 H=2394:00 +CPU= 23.541
19:30:29 STEP 2395 H=2395:00 +CPU= 15.100
19:30:45 STEP 2396 H=2396:00 +CPU= 15.261
19:31:09 STEP 2397 H=2397:00 +CPU= 23.117
19:31:25 STEP 2398 H=2398:00 +CPU= 15.468
19:31:41 STEP 2399 H=2399:00 +CPU= 15.550
19:32:09 STEP 2400 H=2400:00 +CPU= 27.333
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGhq0f+002400
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHhq0f+002400
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMGGhq0f+002376
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMSHhq0f+002376
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMUAhq0f+002376
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMGGhq0f+002388
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMSHhq0f+002388
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMUAhq0f+002388
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0078_1991050100_123_960_12176722_0_r750676233_99.zip
Uploading the intermediate file: upload_file_99.zip
19:32:24 STEP 2401 H=2401:00 +CPU= 14.073
19:32:38 STEP 2402 H=2402:00 +CPU= 14.276
19:33:01 STEP 2403 H=2403:00 +CPU= 21.892
19:33:16 STEP 2404 H=2404:00 +CPU= 14.625
19:33:30 STEP 2405 H=2405:00 +CPU= 14.246
19:33:54 STEP 2406 H=2406:00 +CPU= 22.884
19:34:09 STEP 2407 H=2407:00 +CPU= 14.317
19:34:25 STEP 2408 H=2408:00 +CPU= 14.825
Quit request received from BOINC client, ending the child process
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1991050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0078
(argv4) batchid: 960
(argv5) wuid: 12176722
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/2
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/2/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/2/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_2fa16d2cee5ba101aaaef2150ab97c98 to: /var/lib/boinc/slots/2/oifs_43r3_ps_0078_1991050100_123_960_12176722.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/2/oifs_43r3_ps_0078_1991050100_123_960_12176722.zip
ic_ancil_file: ic_ancil_12176722
ifsdata_file: ifsdata_12176722
climate_data_file: clim_data_12176722
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_9abadf5fbdd8a93dab5f2e9d629f1620 to: /var/lib/boinc/slots/2/ic_ancil_12176722.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/2/ic_ancil_12176722.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_01b3e83fc04f42957632500255cabe6d to: /var/lib/boinc/slots/2/ifsdata/ifsdata_12176722.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/2/ifsdata/ifsdata_12176722.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/2/159l_2/clim_data_12176722.zip
Unzipping the climate data zip file: /var/lib/boinc/slots/2/159l_2/clim_data_12176722.zip
Checking for progress XML file: /var/lib/boinc/slots/2/progress_file_12176722.xml
Opened progress file ok : /var/lib/boinc/slots/2/progress_file_12176722.xml
-- Model is restarting --
Adjusting last_iter, 2409, to previous model restart step.
Creating progress file: /var/lib/boinc/slots/2/progress_file_12176722.xml
last_cpu_time: 67857
upload_file_number: 100
last_iter: 2399
last_upload: 8640000
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0078_1991050100_123_960_12176722_0_r750676233
The child process has been launched with process id: 5103
Executing the command: /var/lib/boinc/slots/2/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:tweenis:1:1:5103:5103] [20221223:195720:1671825440:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:tweenis:1:1:5103:5103] [20221223:195720:1671825440:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:tweenis:1:1:5103:5103] [20221223:195720:1671825440:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:tweenis:1:1:5103:5103] [20221223:195720:1671825440:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:tweenis:1:1:5103:5103] [20221223:195720:1671825440:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:tweenis:1:1:5103:5103] [20221223:195720:1671825440:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:tweenis:1:1:5103:5103] [20221223:195720:1671825440:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:tweenis:1:1:5103:5103] [20221223:195720:1671825440:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:tweenis:1:1:5103:5103] [20221223:195720:1671825440:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:tweenis:1:1:5103:5103] [20221223:195720:1671825440:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:tweenis:1:1:5103:5103] [20221223:195720:1671825440:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:tweenis:1:1:5103:5103] [20221223:195720:1671825440:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:tweenis:1:1:5103:5103] [20221223:195720:1671825440:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:tweenis:1:1:5103:5103] [20221223:195720:1671825440:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:tweenis:1:1:5103:5103] [20221223:195720:1671825440:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:tweenis:1:1:5103:5103] [20221223:195720:1671825440:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tweenis:1:1:5103:5103] [20221223:195720:1671825440:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:tweenis:1:1:5103:5103] [20221223:195720:1671825440:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tweenis:1:1:5103:5103] [20221223:195720:1671825440:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:tweenis:1:1:5103:5103] [20221223:195720:1671825440:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:tweenis:1:1:5103:5103] [20221223:195720:1671825440:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tweenis:1:1:5103:5103] [20221223:195720:1671825440:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tweenis:1:1:5103:5103] [20221223:195720:1671825440:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:tweenis:1:1:5103:5103] [20221223:195720:1671825440:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tweenis:1:1:5103:5103] [20221223:195720:1671825440:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tweenis:1:1:5103:5103] [20221223:195720:1671825440:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:tweenis:1:1:5103:5103] [20221223:195720:1671825440:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:tweenis:1:1:5103:5103] [20221223:195720:1671825440:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:tweenis:1:1:5103:5103] [20221223:195720:1671825440:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:tweenis:1:1:5103:5103] [20221223:195720:1671825440:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
19:57:48 STEP 2400 H=2400:00 +CPU= 25.330
19:58:03 STEP 2401 H=2401:00 +CPU= 14.716
19:58:19 STEP 2402 H=2402:00 +CPU= 15.078
19:58:42 STEP 2403 H=2403:00 +CPU= 22.556
19:58:58 STEP 2404 H=2404:00 +CPU= 15.146
19:59:13 STEP 2405 H=2405:00 +CPU= 14.715
19:59:37 STEP 2406 H=2406:00 +CPU= 23.389
19:59:52 STEP 2407 H=2407:00 +CPU= 14.990
20:00:08 STEP 2408 H=2408:00 +CPU= 15.305
20:00:31 STEP 2409 H=2409:00 +CPU= 22.301
20:00:46 STEP 2410 H=2410:00 +CPU= 14.924
20:01:01 STEP 2411 H=2411:00 +CPU= 14.444
20:01:27 STEP 2412 H=2412:00 +CPU= 24.894
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGhq0f+002412
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHhq0f+002412
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAhq0f+002412
20:01:42 STEP 2413 H=2413:00 +CPU= 14.630
20:01:58 STEP 2414 H=2414:00 +CPU= 15.319
20:02:21 STEP 2415 H=2415:00 +CPU= 22.676
20:02:36 STEP 2416 H=2416:00 +CPU= 14.959
20:02:51 STEP 2417 H=2417:00 +CPU= 14.384
20:03:15 STEP 2418 H=2418:00 +CPU= 23.033
20:03:30 STEP 2419 H=2419:00 +CPU= 14.692
20:03:45 STEP 2420 H=2420:00 +CPU= 15.104
20:04:09 STEP 2421 H=2421:00 +CPU= 22.644
20:04:24 STEP 2422 H=2422:00 +CPU= 14.952
20:04:40 STEP 2423 H=2423:00 +CPU= 15.034
20:05:07 STEP 2424 H=2424:00 +CPU= 26.585
Moving to projects directory: /var/lib/boinc/slots/2/ICMGGhq0f+002424
Moving to projects directory: /var/lib/boinc/slots/2/ICMSHhq0f+002424
Moving to projects directory: /var/lib/boinc/slots/2/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMGGhq0f+002400
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMSHhq0f+002400
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMGGhq0f+002412
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMSHhq0f+002412
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_12176722/ICMUAhq0f+002412
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_ps_0078_1991050100_123_960_12176722_0_r750676233_100.zip
Uploading the intermediate file: upload_file_100.zip
20:05:22 STEP 2425 H=2425:00 +CPU= 14.465
20:05:38 STEP 2426 H=2426:00 +CPU= 15.369
20:06:02 STEP 2427 H=2427:00 +CPU= 22.753
20:06:17 STEP 2428 H=2428:00 +CPU= 15.217
20:06:33 STEP 2429 H=2429:00 +CPU= 14.818
20:06:57 STEP 2430 H=2430:00 +CPU= 23.340
20:07:12 STEP 2431 H=2431:00 +CPU= 14.660
Abort request received from BOINC client, ending the child process
..Failed, model did not complete successfully
</stderr_txt>
]]>
