climateprediction.net home page
Task 22263015

Task 22263015

Name oifs_43r3_ps_0524_1992050100_123_961_12178168_0
Workunit 12178168
Created 22 Dec 2022, 0:41:58 UTC
Sent 22 Dec 2022, 0:58:55 UTC
Report deadline 21 Jan 2023, 0:58:55 UTC
Received 23 Dec 2022, 2:00:11 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1545852
Run time 10 hours 53 min 14 sec
CPU time 10 hours 50 min 27 sec
Validate state Invalid
Credit 3,024.00
Device peak FLOPS 7.29 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,379.05 MB
Peak swap size 4,978.07 MB
Peak disk usage 3,357.04 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
projects/climateprediction.net/oifs_43r3_ps_12178168/ICMSHhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMUAhq0f+002064
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMGGhq0f+002076
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMSHhq0f+002076
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMUAhq0f+002076
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0524_1992050100_123_961_12178168_0_r674883618_86.zip
Uploading the intermediate file: upload_file_86.zip
  22:01:17 STEP 2089 H=2089:00 +CPU= 11.741
  22:01:29 STEP 2090 H=2090:00 +CPU= 11.706
  22:01:47 STEP 2091 H=2091:00 +CPU= 18.361
  22:01:59 STEP 2092 H=2092:00 +CPU= 11.693
  22:02:10 STEP 2093 H=2093:00 +CPU= 11.389
  22:02:29 STEP 2094 H=2094:00 +CPU= 18.559
  22:02:40 STEP 2095 H=2095:00 +CPU= 11.142
  22:02:51 STEP 2096 H=2096:00 +CPU= 11.519
  22:03:09 STEP 2097 H=2097:00 +CPU= 18.288
  22:03:21 STEP 2098 H=2098:00 +CPU= 11.644
  22:03:33 STEP 2099 H=2099:00 +CPU= 11.573
  22:03:53 STEP 2100 H=2100:00 +CPU= 20.378
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+002100
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+002100
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+002100
  22:04:05 STEP 2101 H=2101:00 +CPU= 11.417
  22:04:16 STEP 2102 H=2102:00 +CPU= 11.848
  22:04:35 STEP 2103 H=2103:00 +CPU= 18.326
  22:04:46 STEP 2104 H=2104:00 +CPU= 11.720
  22:04:58 STEP 2105 H=2105:00 +CPU= 11.390
  22:05:16 STEP 2106 H=2106:00 +CPU= 18.404
  22:05:27 STEP 2107 H=2107:00 +CPU= 11.236
  22:05:39 STEP 2108 H=2108:00 +CPU= 11.717
  22:05:57 STEP 2109 H=2109:00 +CPU= 18.233
  22:06:09 STEP 2110 H=2110:00 +CPU= 11.624
  22:06:21 STEP 2111 H=2111:00 +CPU= 11.844
  22:06:44 STEP 2112 H=2112:00 +CPU= 22.764
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+002112
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+002112
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMGGhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMSHhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMUAhq0f+002088
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMGGhq0f+002100
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMSHhq0f+002100
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMUAhq0f+002100
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0524_1992050100_123_961_12178168_0_r674883618_87.zip
Uploading the intermediate file: upload_file_87.zip
  22:06:55 STEP 2113 H=2113:00 +CPU= 11.461
  22:07:07 STEP 2114 H=2114:00 +CPU= 11.640
  22:07:25 STEP 2115 H=2115:00 +CPU= 18.003
  22:07:36 STEP 2116 H=2116:00 +CPU= 11.676
  22:07:48 STEP 2117 H=2117:00 +CPU= 11.457
  22:08:07 STEP 2118 H=2118:00 +CPU= 18.831
  22:08:18 STEP 2119 H=2119:00 +CPU= 11.496
  22:08:30 STEP 2120 H=2120:00 +CPU= 11.631
  22:08:48 STEP 2121 H=2121:00 +CPU= 18.252
  22:09:00 STEP 2122 H=2122:00 +CPU= 11.717
  22:09:11 STEP 2123 H=2123:00 +CPU= 11.504
  22:09:32 STEP 2124 H=2124:00 +CPU= 20.263
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+002124
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+002124
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+002124
  22:09:43 STEP 2125 H=2125:00 +CPU= 11.427
  22:09:55 STEP 2126 H=2126:00 +CPU= 11.798
  22:10:14 STEP 2127 H=2127:00 +CPU= 18.831
  22:10:26 STEP 2128 H=2128:00 +CPU= 11.810
  22:10:37 STEP 2129 H=2129:00 +CPU= 11.734
  22:10:56 STEP 2130 H=2130:00 +CPU= 18.681
  22:11:08 STEP 2131 H=2131:00 +CPU= 11.646
  22:11:19 STEP 2132 H=2132:00 +CPU= 11.731
  22:11:38 STEP 2133 H=2133:00 +CPU= 18.370
  22:11:49 STEP 2134 H=2134:00 +CPU= 11.637
  22:12:01 STEP 2135 H=2135:00 +CPU= 11.785
  22:12:24 STEP 2136 H=2136:00 +CPU= 23.152
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+002136
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+002136
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMGGhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMSHhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMUAhq0f+002112
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMGGhq0f+002124
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMSHhq0f+002124
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMUAhq0f+002124
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0524_1992050100_123_961_12178168_0_r674883618_88.zip
Uploading the intermediate file: upload_file_88.zip
  22:12:36 STEP 2137 H=2137:00 +CPU= 11.808
  22:12:48 STEP 2138 H=2138:00 +CPU= 11.776
  22:13:06 STEP 2139 H=2139:00 +CPU= 18.600
  22:13:18 STEP 2140 H=2140:00 +CPU= 11.942
  22:13:30 STEP 2141 H=2141:00 +CPU= 11.368
  22:13:48 STEP 2142 H=2142:00 +CPU= 18.655
  22:14:00 STEP 2143 H=2143:00 +CPU= 11.328
  22:14:11 STEP 2144 H=2144:00 +CPU= 11.590
  22:14:30 STEP 2145 H=2145:00 +CPU= 18.209
  22:14:41 STEP 2146 H=2146:00 +CPU= 11.743
  22:14:53 STEP 2147 H=2147:00 +CPU= 11.415
  22:15:13 STEP 2148 H=2148:00 +CPU= 20.409
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+002148
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+002148
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+002148
  22:15:25 STEP 2149 H=2149:00 +CPU= 11.588
  22:15:37 STEP 2150 H=2150:00 +CPU= 11.847
  22:15:55 STEP 2151 H=2151:00 +CPU= 18.280
  22:16:07 STEP 2152 H=2152:00 +CPU= 11.830
  22:16:18 STEP 2153 H=2153:00 +CPU= 11.680
  22:16:37 STEP 2154 H=2154:00 +CPU= 18.774
  22:16:49 STEP 2155 H=2155:00 +CPU= 11.623
  22:17:01 STEP 2156 H=2156:00 +CPU= 11.936
  22:17:19 STEP 2157 H=2157:00 +CPU= 18.335
  22:17:31 STEP 2158 H=2158:00 +CPU= 11.816
  22:17:43 STEP 2159 H=2159:00 +CPU= 11.639
  22:18:06 STEP 2160 H=2160:00 +CPU= 23.058
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+002160
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+002160
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMGGhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMSHhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMUAhq0f+002136
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMGGhq0f+002148
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMSHhq0f+002148
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMUAhq0f+002148
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0524_1992050100_123_961_12178168_0_r674883618_89.zip
Uploading the intermediate file: upload_file_89.zip
  22:18:18 STEP 2161 H=2161:00 +CPU= 11.908
  22:18:29 STEP 2162 H=2162:00 +CPU= 11.694
  22:18:48 STEP 2163 H=2163:00 +CPU= 18.500
  22:19:00 STEP 2164 H=2164:00 +CPU= 11.935
  22:19:11 STEP 2165 H=2165:00 +CPU= 11.496
  22:19:30 STEP 2166 H=2166:00 +CPU= 18.698
  22:19:42 STEP 2167 H=2167:00 +CPU= 11.715
  22:19:53 STEP 2168 H=2168:00 +CPU= 11.763
  22:20:12 STEP 2169 H=2169:00 +CPU= 18.587
  22:20:24 STEP 2170 H=2170:00 +CPU= 11.813
  22:20:35 STEP 2171 H=2171:00 +CPU= 11.713
  22:20:56 STEP 2172 H=2172:00 +CPU= 20.774
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+002172
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+002172
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+002172
  22:21:08 STEP 2173 H=2173:00 +CPU= 11.553
  22:21:19 STEP 2174 H=2174:00 +CPU= 11.667
  22:21:38 STEP 2175 H=2175:00 +CPU= 18.214
  22:21:50 STEP 2176 H=2176:00 +CPU= 12.161
  22:22:02 STEP 2177 H=2177:00 +CPU= 11.739
  22:22:20 STEP 2178 H=2178:00 +CPU= 18.788
  22:22:32 STEP 2179 H=2179:00 +CPU= 11.523
  22:22:44 STEP 2180 H=2180:00 +CPU= 12.055
  22:23:02 STEP 2181 H=2181:00 +CPU= 18.125
  22:23:14 STEP 2182 H=2182:00 +CPU= 11.714
  22:23:26 STEP 2183 H=2183:00 +CPU= 11.727
  22:23:49 STEP 2184 H=2184:00 +CPU= 23.125
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+002184
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+002184
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMGGhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMSHhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMUAhq0f+002160
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMGGhq0f+002172
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMSHhq0f+002172
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMUAhq0f+002172
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0524_1992050100_123_961_12178168_0_r674883618_90.zip
Uploading the intermediate file: upload_file_90.zip
  22:24:01 STEP 2185 H=2185:00 +CPU= 11.925
  22:24:12 STEP 2186 H=2186:00 +CPU= 11.817
  22:24:31 STEP 2187 H=2187:00 +CPU= 18.474
  22:24:43 STEP 2188 H=2188:00 +CPU= 11.624
  22:24:54 STEP 2189 H=2189:00 +CPU= 11.748
  22:25:13 STEP 2190 H=2190:00 +CPU= 18.714
  22:25:24 STEP 2191 H=2191:00 +CPU= 11.372
  22:25:37 STEP 2192 H=2192:00 +CPU= 12.120
  22:25:55 STEP 2193 H=2193:00 +CPU= 18.511
  22:26:07 STEP 2194 H=2194:00 +CPU= 11.692
  22:26:18 STEP 2195 H=2195:00 +CPU= 11.572
  22:26:39 STEP 2196 H=2196:00 +CPU= 20.429
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+002196
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+002196
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+002196
  22:26:50 STEP 2197 H=2197:00 +CPU= 11.346
  22:27:02 STEP 2198 H=2198:00 +CPU= 12.073
  22:27:20 STEP 2199 H=2199:00 +CPU= 18.226
  22:27:32 STEP 2200 H=2200:00 +CPU= 11.521
  22:27:43 STEP 2201 H=2201:00 +CPU= 11.435
  22:28:02 STEP 2202 H=2202:00 +CPU= 19.022
  22:28:14 STEP 2203 H=2203:00 +CPU= 11.451
  22:28:26 STEP 2204 H=2204:00 +CPU= 12.031
  22:28:44 STEP 2205 H=2205:00 +CPU= 18.094
  22:28:56 STEP 2206 H=2206:00 +CPU= 11.585
  22:29:08 STEP 2207 H=2207:00 +CPU= 12.164
  22:29:31 STEP 2208 H=2208:00 +CPU= 23.536
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+002208
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+002208
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMGGhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMSHhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMUAhq0f+002184
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMGGhq0f+002196
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMSHhq0f+002196
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMUAhq0f+002196
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0524_1992050100_123_961_12178168_0_r674883618_91.zip
Uploading the intermediate file: upload_file_91.zip
  22:29:43 STEP 2209 H=2209:00 +CPU= 11.759
  22:29:55 STEP 2210 H=2210:00 +CPU= 11.796
  22:30:13 STEP 2211 H=2211:00 +CPU= 18.246
  22:30:25 STEP 2212 H=2212:00 +CPU= 11.598
  22:30:36 STEP 2213 H=2213:00 +CPU= 11.423
  22:30:55 STEP 2214 H=2214:00 +CPU= 18.641
  22:31:06 STEP 2215 H=2215:00 +CPU= 11.400
  22:31:18 STEP 2216 H=2216:00 +CPU= 11.989
  22:31:36 STEP 2217 H=2217:00 +CPU= 18.209
  22:31:48 STEP 2218 H=2218:00 +CPU= 11.653
  22:32:00 STEP 2219 H=2219:00 +CPU= 11.520
  22:32:20 STEP 2220 H=2220:00 +CPU= 20.583
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+002220
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+002220
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+002220
  22:32:31 STEP 2221 H=2221:00 +CPU= 11.288
  22:32:43 STEP 2222 H=2222:00 +CPU= 12.024
  22:33:02 STEP 2223 H=2223:00 +CPU= 18.365
  22:33:14 STEP 2224 H=2224:00 +CPU= 11.842
  22:33:25 STEP 2225 H=2225:00 +CPU= 11.705
  22:33:44 STEP 2226 H=2226:00 +CPU= 18.497
  22:33:55 STEP 2227 H=2227:00 +CPU= 11.514
  22:34:07 STEP 2228 H=2228:00 +CPU= 11.904
  22:34:26 STEP 2229 H=2229:00 +CPU= 18.450
  22:34:38 STEP 2230 H=2230:00 +CPU= 11.771
  22:34:50 STEP 2231 H=2231:00 +CPU= 11.986
  22:35:14 STEP 2232 H=2232:00 +CPU= 23.915
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+002232
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+002232
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMGGhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMSHhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMUAhq0f+002208
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMGGhq0f+002220
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMSHhq0f+002220
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMUAhq0f+002220
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0524_1992050100_123_961_12178168_0_r674883618_92.zip
Uploading the intermediate file: upload_file_92.zip
  22:35:25 STEP 2233 H=2233:00 +CPU= 11.827
  22:35:37 STEP 2234 H=2234:00 +CPU= 11.873
  22:35:55 STEP 2235 H=2235:00 +CPU= 18.028
  22:36:07 STEP 2236 H=2236:00 +CPU= 11.770
  22:36:19 STEP 2237 H=2237:00 +CPU= 11.796
  22:36:37 STEP 2238 H=2238:00 +CPU= 18.463
  22:36:49 STEP 2239 H=2239:00 +CPU= 11.431
  22:37:01 STEP 2240 H=2240:00 +CPU= 12.126
  22:37:19 STEP 2241 H=2241:00 +CPU= 18.226
  22:37:31 STEP 2242 H=2242:00 +CPU= 11.924
  22:37:43 STEP 2243 H=2243:00 +CPU= 11.870
  22:38:04 STEP 2244 H=2244:00 +CPU= 20.597
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+002244
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+002244
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+002244
  22:38:15 STEP 2245 H=2245:00 +CPU= 11.714
  22:38:27 STEP 2246 H=2246:00 +CPU= 11.859
  22:38:45 STEP 2247 H=2247:00 +CPU= 18.303
  22:38:57 STEP 2248 H=2248:00 +CPU= 12.062
  22:39:09 STEP 2249 H=2249:00 +CPU= 11.718
  22:39:28 STEP 2250 H=2250:00 +CPU= 18.379
  22:39:39 STEP 2251 H=2251:00 +CPU= 11.407
  22:39:51 STEP 2252 H=2252:00 +CPU= 12.039
  22:40:09 STEP 2253 H=2253:00 +CPU= 18.339
  22:40:21 STEP 2254 H=2254:00 +CPU= 11.927
  22:40:33 STEP 2255 H=2255:00 +CPU= 12.036
  22:40:57 STEP 2256 H=2256:00 +CPU= 23.701
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+002256
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+002256
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMGGhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMSHhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMUAhq0f+002232
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMGGhq0f+002244
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMSHhq0f+002244
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMUAhq0f+002244
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0524_1992050100_123_961_12178168_0_r674883618_93.zip
Uploading the intermediate file: upload_file_93.zip
  22:41:09 STEP 2257 H=2257:00 +CPU= 11.572
  22:41:21 STEP 2258 H=2258:00 +CPU= 12.124
  22:41:39 STEP 2259 H=2259:00 +CPU= 18.288
  22:41:51 STEP 2260 H=2260:00 +CPU= 11.686
  22:42:02 STEP 2261 H=2261:00 +CPU= 11.494
  22:42:21 STEP 2262 H=2262:00 +CPU= 18.610
  22:42:33 STEP 2263 H=2263:00 +CPU= 11.831
  22:42:45 STEP 2264 H=2264:00 +CPU= 12.009
  22:43:03 STEP 2265 H=2265:00 +CPU= 17.993
  22:43:15 STEP 2266 H=2266:00 +CPU= 11.792
  22:43:26 STEP 2267 H=2267:00 +CPU= 11.919
  22:43:47 STEP 2268 H=2268:00 +CPU= 20.431
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+002268
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+002268
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+002268
  22:43:59 STEP 2269 H=2269:00 +CPU= 11.626
  22:44:11 STEP 2270 H=2270:00 +CPU= 12.153
  22:44:29 STEP 2271 H=2271:00 +CPU= 18.434
  22:44:41 STEP 2272 H=2272:00 +CPU= 11.919
  22:44:53 STEP 2273 H=2273:00 +CPU= 11.771
  22:45:12 STEP 2274 H=2274:00 +CPU= 18.910
  22:45:23 STEP 2275 H=2275:00 +CPU= 11.635
  22:45:35 STEP 2276 H=2276:00 +CPU= 11.770
  22:45:54 STEP 2277 H=2277:00 +CPU= 18.597
  22:46:05 STEP 2278 H=2278:00 +CPU= 11.675
  22:46:18 STEP 2279 H=2279:00 +CPU= 12.243
  22:46:40 STEP 2280 H=2280:00 +CPU= 22.671
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+002280
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+002280
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMGGhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMSHhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMUAhq0f+002256
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMGGhq0f+002268
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMSHhq0f+002268
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMUAhq0f+002268
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0524_1992050100_123_961_12178168_0_r674883618_94.zip
Uploading the intermediate file: upload_file_94.zip
  22:46:52 STEP 2281 H=2281:00 +CPU= 11.820
  22:47:04 STEP 2282 H=2282:00 +CPU= 11.820
Uploading trickle at timestep: 8208000
  22:47:23 STEP 2283 H=2283:00 +CPU= 18.476
  22:47:34 STEP 2284 H=2284:00 +CPU= 11.912
  22:47:46 STEP 2285 H=2285:00 +CPU= 11.738
  22:48:05 STEP 2286 H=2286:00 +CPU= 18.618
  22:48:16 STEP 2287 H=2287:00 +CPU= 11.510
  22:48:28 STEP 2288 H=2288:00 +CPU= 11.762
  22:48:46 STEP 2289 H=2289:00 +CPU= 18.356
  22:48:58 STEP 2290 H=2290:00 +CPU= 11.906
  22:49:10 STEP 2291 H=2291:00 +CPU= 11.801
  22:49:30 STEP 2292 H=2292:00 +CPU= 20.150
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+002292
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+002292
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+002292
  22:49:42 STEP 2293 H=2293:00 +CPU= 11.543
  22:49:54 STEP 2294 H=2294:00 +CPU= 11.940
  22:50:12 STEP 2295 H=2295:00 +CPU= 18.311
  22:50:24 STEP 2296 H=2296:00 +CPU= 11.888
  22:50:36 STEP 2297 H=2297:00 +CPU= 11.759
  22:50:54 STEP 2298 H=2298:00 +CPU= 18.582
  22:51:06 STEP 2299 H=2299:00 +CPU= 11.487
  22:51:18 STEP 2300 H=2300:00 +CPU= 11.893
  22:51:36 STEP 2301 H=2301:00 +CPU= 18.093
  22:51:48 STEP 2302 H=2302:00 +CPU= 12.153
  22:52:01 STEP 2303 H=2303:00 +CPU= 12.492
  22:52:24 STEP 2304 H=2304:00 +CPU= 23.178
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+002304
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+002304
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMGGhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMSHhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMUAhq0f+002280
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMGGhq0f+002292
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMSHhq0f+002292
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMUAhq0f+002292
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0524_1992050100_123_961_12178168_0_r674883618_95.zip
Uploading the intermediate file: upload_file_95.zip
  22:52:36 STEP 2305 H=2305:00 +CPU= 11.826
  22:52:48 STEP 2306 H=2306:00 +CPU= 12.146
  22:53:06 STEP 2307 H=2307:00 +CPU= 18.580
  22:53:18 STEP 2308 H=2308:00 +CPU= 11.915
  22:53:30 STEP 2309 H=2309:00 +CPU= 11.929
  22:53:49 STEP 2310 H=2310:00 +CPU= 18.563
  22:54:01 STEP 2311 H=2311:00 +CPU= 11.975
  22:54:13 STEP 2312 H=2312:00 +CPU= 11.923
  22:54:31 STEP 2313 H=2313:00 +CPU= 18.119
  22:54:43 STEP 2314 H=2314:00 +CPU= 11.759
  22:54:54 STEP 2315 H=2315:00 +CPU= 11.636
  22:55:14 STEP 2316 H=2316:00 +CPU= 20.327
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+002316
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+002316
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+002316
  22:55:26 STEP 2317 H=2317:00 +CPU= 11.728
  22:55:38 STEP 2318 H=2318:00 +CPU= 12.118
  22:55:57 STEP 2319 H=2319:00 +CPU= 18.221
  22:56:09 STEP 2320 H=2320:00 +CPU= 12.080
  22:56:20 STEP 2321 H=2321:00 +CPU= 11.489
  22:56:39 STEP 2322 H=2322:00 +CPU= 18.576
  22:56:50 STEP 2323 H=2323:00 +CPU= 11.590
  22:57:02 STEP 2324 H=2324:00 +CPU= 12.046
  22:57:21 STEP 2325 H=2325:00 +CPU= 18.481
  22:57:33 STEP 2326 H=2326:00 +CPU= 12.140
  22:57:45 STEP 2327 H=2327:00 +CPU= 12.270
  22:58:08 STEP 2328 H=2328:00 +CPU= 22.627
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+002328
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+002328
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMGGhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMSHhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMUAhq0f+002304
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMGGhq0f+002316
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMSHhq0f+002316
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMUAhq0f+002316
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0524_1992050100_123_961_12178168_0_r674883618_96.zip
Uploading the intermediate file: upload_file_96.zip
  22:58:19 STEP 2329 H=2329:00 +CPU= 11.516
  22:58:31 STEP 2330 H=2330:00 +CPU= 11.979
  22:58:50 STEP 2331 H=2331:00 +CPU= 18.408
  22:59:02 STEP 2332 H=2332:00 +CPU= 11.907
  22:59:13 STEP 2333 H=2333:00 +CPU= 11.726
  22:59:32 STEP 2334 H=2334:00 +CPU= 18.823
  22:59:44 STEP 2335 H=2335:00 +CPU= 12.124
  22:59:56 STEP 2336 H=2336:00 +CPU= 11.821
  23:00:14 STEP 2337 H=2337:00 +CPU= 18.224
  23:00:27 STEP 2338 H=2338:00 +CPU= 12.206
  23:00:38 STEP 2339 H=2339:00 +CPU= 11.395
  23:00:58 STEP 2340 H=2340:00 +CPU= 20.222
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+002340
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+002340
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+002340
  23:01:10 STEP 2341 H=2341:00 +CPU= 11.584
  23:01:22 STEP 2342 H=2342:00 +CPU= 12.103
  23:01:41 STEP 2343 H=2343:00 +CPU= 18.718
  23:01:52 STEP 2344 H=2344:00 +CPU= 11.728
  23:02:04 STEP 2345 H=2345:00 +CPU= 11.668
  23:02:23 STEP 2346 H=2346:00 +CPU= 18.862
  23:02:35 STEP 2347 H=2347:00 +CPU= 11.646
  23:02:47 STEP 2348 H=2348:00 +CPU= 12.032
  23:03:05 STEP 2349 H=2349:00 +CPU= 17.958
  23:03:16 STEP 2350 H=2350:00 +CPU= 11.828
  23:03:29 STEP 2351 H=2351:00 +CPU= 12.489
  23:03:53 STEP 2352 H=2352:00 +CPU= 23.514
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+002352
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+002352
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMGGhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMSHhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMUAhq0f+002328
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMGGhq0f+002340
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMSHhq0f+002340
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMUAhq0f+002340
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0524_1992050100_123_961_12178168_0_r674883618_97.zip
Uploading the intermediate file: upload_file_97.zip
  23:04:04 STEP 2353 H=2353:00 +CPU= 11.631
  23:04:16 STEP 2354 H=2354:00 +CPU= 11.959
  23:04:35 STEP 2355 H=2355:00 +CPU= 18.629
  23:04:47 STEP 2356 H=2356:00 +CPU= 11.797
  23:04:58 STEP 2357 H=2357:00 +CPU= 11.836
  23:05:17 STEP 2358 H=2358:00 +CPU= 18.916
  23:05:29 STEP 2359 H=2359:00 +CPU= 11.828
  23:05:41 STEP 2360 H=2360:00 +CPU= 12.045
  23:05:59 STEP 2361 H=2361:00 +CPU= 18.206
  23:06:12 STEP 2362 H=2362:00 +CPU= 12.135
  23:06:23 STEP 2363 H=2363:00 +CPU= 11.367
  23:06:43 STEP 2364 H=2364:00 +CPU= 19.971
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+002364
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+002364
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+002364
  23:06:54 STEP 2365 H=2365:00 +CPU= 11.587
  23:07:06 STEP 2366 H=2366:00 +CPU= 11.948
  23:07:25 STEP 2367 H=2367:00 +CPU= 18.282
  23:07:37 STEP 2368 H=2368:00 +CPU= 11.886
  23:07:48 STEP 2369 H=2369:00 +CPU= 11.506
  23:08:07 STEP 2370 H=2370:00 +CPU= 18.655
  23:08:18 STEP 2371 H=2371:00 +CPU= 11.667
  23:08:30 STEP 2372 H=2372:00 +CPU= 12.001
  23:08:49 STEP 2373 H=2373:00 +CPU= 18.243
  23:09:01 STEP 2374 H=2374:00 +CPU= 11.840
  23:09:13 STEP 2375 H=2375:00 +CPU= 12.414
  23:09:36 STEP 2376 H=2376:00 +CPU= 22.854
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+002376
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+002376
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMGGhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMSHhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMUAhq0f+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMGGhq0f+002364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMSHhq0f+002364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMUAhq0f+002364
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0524_1992050100_123_961_12178168_0_r674883618_98.zip
Uploading the intermediate file: upload_file_98.zip
  23:09:47 STEP 2377 H=2377:00 +CPU= 11.664
  23:10:00 STEP 2378 H=2378:00 +CPU= 12.086
  23:10:18 STEP 2379 H=2379:00 +CPU= 18.633
  23:10:30 STEP 2380 H=2380:00 +CPU= 12.022
  23:10:42 STEP 2381 H=2381:00 +CPU= 11.548
  23:11:00 STEP 2382 H=2382:00 +CPU= 18.626
  23:11:12 STEP 2383 H=2383:00 +CPU= 11.668
  23:11:24 STEP 2384 H=2384:00 +CPU= 11.902
  23:11:42 STEP 2385 H=2385:00 +CPU= 18.105
  23:11:54 STEP 2386 H=2386:00 +CPU= 11.876
  23:12:06 STEP 2387 H=2387:00 +CPU= 11.567
  23:12:26 STEP 2388 H=2388:00 +CPU= 20.102
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+002388
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+002388
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+002388
  23:12:37 STEP 2389 H=2389:00 +CPU= 11.659
  23:12:49 STEP 2390 H=2390:00 +CPU= 12.024
  23:13:07 STEP 2391 H=2391:00 +CPU= 17.905
  23:13:19 STEP 2392 H=2392:00 +CPU= 11.789
  23:13:31 STEP 2393 H=2393:00 +CPU= 11.523
  23:13:49 STEP 2394 H=2394:00 +CPU= 18.563
  23:14:01 STEP 2395 H=2395:00 +CPU= 11.677
  23:14:13 STEP 2396 H=2396:00 +CPU= 11.987
  23:14:32 STEP 2397 H=2397:00 +CPU= 18.843
  23:14:43 STEP 2398 H=2398:00 +CPU= 11.774
  23:14:56 STEP 2399 H=2399:00 +CPU= 12.185
  23:15:19 STEP 2400 H=2400:00 +CPU= 22.973
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+002400
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+002400
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMGGhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMSHhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMUAhq0f+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMGGhq0f+002388
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMSHhq0f+002388
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMUAhq0f+002388
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0524_1992050100_123_961_12178168_0_r674883618_99.zip
Uploading the intermediate file: upload_file_99.zip
  23:15:30 STEP 2401 H=2401:00 +CPU= 11.742
  23:15:42 STEP 2402 H=2402:00 +CPU= 11.785
  23:16:00 STEP 2403 H=2403:00 +CPU= 18.178
  23:16:12 STEP 2404 H=2404:00 +CPU= 12.038
  23:16:24 STEP 2405 H=2405:00 +CPU= 11.659
  23:16:43 STEP 2406 H=2406:00 +CPU= 18.429
  23:16:54 STEP 2407 H=2407:00 +CPU= 11.841
  23:17:06 STEP 2408 H=2408:00 +CPU= 11.854
  23:17:24 STEP 2409 H=2409:00 +CPU= 18.065
  23:17:36 STEP 2410 H=2410:00 +CPU= 12.043
  23:17:48 STEP 2411 H=2411:00 +CPU= 11.515
  23:18:08 STEP 2412 H=2412:00 +CPU= 20.225
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+002412
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+002412
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+002412
  23:18:20 STEP 2413 H=2413:00 +CPU= 11.559
  23:18:32 STEP 2414 H=2414:00 +CPU= 11.981
  23:18:50 STEP 2415 H=2415:00 +CPU= 18.039
  23:19:02 STEP 2416 H=2416:00 +CPU= 11.852
  23:19:13 STEP 2417 H=2417:00 +CPU= 11.633
  23:19:32 STEP 2418 H=2418:00 +CPU= 18.321
  23:19:43 STEP 2419 H=2419:00 +CPU= 11.534
  23:19:55 STEP 2420 H=2420:00 +CPU= 12.023
  23:20:13 STEP 2421 H=2421:00 +CPU= 18.030
  23:20:25 STEP 2422 H=2422:00 +CPU= 11.823
  23:20:37 STEP 2423 H=2423:00 +CPU= 12.091
  23:21:00 STEP 2424 H=2424:00 +CPU= 23.086
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+002424
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+002424
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMGGhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMSHhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMUAhq0f+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMGGhq0f+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMSHhq0f+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMUAhq0f+002412
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0524_1992050100_123_961_12178168_0_r674883618_100.zip
Uploading the intermediate file: upload_file_100.zip
  23:21:12 STEP 2425 H=2425:00 +CPU= 11.647
  23:21:24 STEP 2426 H=2426:00 +CPU= 12.001
  23:21:42 STEP 2427 H=2427:00 +CPU= 18.146
  23:21:54 STEP 2428 H=2428:00 +CPU= 11.691
  23:22:05 STEP 2429 H=2429:00 +CPU= 11.731
  23:22:24 STEP 2430 H=2430:00 +CPU= 18.400
  23:22:35 STEP 2431 H=2431:00 +CPU= 11.448
  23:22:47 STEP 2432 H=2432:00 +CPU= 12.206
  23:23:06 STEP 2433 H=2433:00 +CPU= 18.820
  23:23:19 STEP 2434 H=2434:00 +CPU= 12.235
  23:23:30 STEP 2435 H=2435:00 +CPU= 11.577
  23:23:50 STEP 2436 H=2436:00 +CPU= 20.172
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+002436
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+002436
  23:24:02 STEP 2437 H=2437:00 +CPU= 11.681
  23:24:14 STEP 2438 H=2438:00 +CPU= 11.999
  23:24:32 STEP 2439 H=2439:00 +CPU= 18.217
  23:24:44 STEP 2440 H=2440:00 +CPU= 12.087
  23:24:56 STEP 2441 H=2441:00 +CPU= 11.641
  23:25:14 STEP 2442 H=2442:00 +CPU= 18.416
  23:25:26 STEP 2443 H=2443:00 +CPU= 11.449
  23:25:38 STEP 2444 H=2444:00 +CPU= 11.961
  23:25:56 STEP 2445 H=2445:00 +CPU= 18.051
  23:26:08 STEP 2446 H=2446:00 +CPU= 12.019
  23:26:20 STEP 2447 H=2447:00 +CPU= 12.164
  23:26:43 STEP 2448 H=2448:00 +CPU= 22.744
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+002448
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMGGhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMSHhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMUAhq0f+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMGGhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMSHhq0f+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMUAhq0f+002436
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0524_1992050100_123_961_12178168_0_r674883618_101.zip
Uploading the intermediate file: upload_file_101.zip
  23:26:55 STEP 2449 H=2449:00 +CPU= 11.980
  23:27:07 STEP 2450 H=2450:00 +CPU= 11.944
  23:27:25 STEP 2451 H=2451:00 +CPU= 18.128
  23:27:37 STEP 2452 H=2452:00 +CPU= 11.900
  23:27:49 STEP 2453 H=2453:00 +CPU= 11.940
  23:28:08 STEP 2454 H=2454:00 +CPU= 18.816
  23:28:20 STEP 2455 H=2455:00 +CPU= 11.761
  23:28:32 STEP 2456 H=2456:00 +CPU= 12.349
  23:28:50 STEP 2457 H=2457:00 +CPU= 18.301
  23:29:02 STEP 2458 H=2458:00 +CPU= 11.905
  23:29:14 STEP 2459 H=2459:00 +CPU= 11.881
  23:29:35 STEP 2460 H=2460:00 +CPU= 20.512
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+002460
  23:29:46 STEP 2461 H=2461:00 +CPU= 11.835
  23:29:59 STEP 2462 H=2462:00 +CPU= 12.213
  23:30:17 STEP 2463 H=2463:00 +CPU= 18.499
  23:30:29 STEP 2464 H=2464:00 +CPU= 12.249
  23:30:41 STEP 2465 H=2465:00 +CPU= 11.542
  23:31:00 STEP 2466 H=2466:00 +CPU= 18.652
  23:31:11 STEP 2467 H=2467:00 +CPU= 11.547
  23:31:23 STEP 2468 H=2468:00 +CPU= 11.854
  23:31:41 STEP 2469 H=2469:00 +CPU= 18.364
  23:31:53 STEP 2470 H=2470:00 +CPU= 12.046
  23:32:06 STEP 2471 H=2471:00 +CPU= 12.303
  23:32:29 STEP 2472 H=2472:00 +CPU= 22.757
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMGGhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMSHhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMGGhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMSHhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMUAhq0f+002460
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0524_1992050100_123_961_12178168_0_r674883618_102.zip
Uploading the intermediate file: upload_file_102.zip
  23:32:40 STEP 2473 H=2473:00 +CPU= 11.490
  23:32:52 STEP 2474 H=2474:00 +CPU= 12.154
  23:33:11 STEP 2475 H=2475:00 +CPU= 18.342
  23:33:22 STEP 2476 H=2476:00 +CPU= 11.932
  23:33:34 STEP 2477 H=2477:00 +CPU= 11.522
  23:33:53 STEP 2478 H=2478:00 +CPU= 18.772
  23:34:04 STEP 2479 H=2479:00 +CPU= 11.621
  23:34:16 STEP 2480 H=2480:00 +CPU= 12.109
  23:34:35 STEP 2481 H=2481:00 +CPU= 18.382
  23:34:47 STEP 2482 H=2482:00 +CPU= 11.876
  23:34:59 STEP 2483 H=2483:00 +CPU= 11.824
  23:35:19 STEP 2484 H=2484:00 +CPU= 20.610
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+002484
  23:35:31 STEP 2485 H=2485:00 +CPU= 11.534
  23:35:43 STEP 2486 H=2486:00 +CPU= 12.086
  23:36:01 STEP 2487 H=2487:00 +CPU= 18.160
  23:36:13 STEP 2488 H=2488:00 +CPU= 11.859
  23:36:25 STEP 2489 H=2489:00 +CPU= 11.775
  23:36:43 STEP 2490 H=2490:00 +CPU= 18.580
  23:36:55 STEP 2491 H=2491:00 +CPU= 11.467
  23:37:07 STEP 2492 H=2492:00 +CPU= 11.994
  23:37:25 STEP 2493 H=2493:00 +CPU= 18.319
  23:37:37 STEP 2494 H=2494:00 +CPU= 12.073
  23:37:50 STEP 2495 H=2495:00 +CPU= 12.613
  23:38:13 STEP 2496 H=2496:00 +CPU= 22.980
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMGGhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMSHhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMGGhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMSHhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMUAhq0f+002484
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0524_1992050100_123_961_12178168_0_r674883618_103.zip
Uploading the intermediate file: upload_file_103.zip
  23:38:24 STEP 2497 H=2497:00 +CPU= 11.506
  23:38:36 STEP 2498 H=2498:00 +CPU= 11.960
  23:38:54 STEP 2499 H=2499:00 +CPU= 18.128
  23:39:06 STEP 2500 H=2500:00 +CPU= 12.028
  23:39:18 STEP 2501 H=2501:00 +CPU= 11.841
  23:39:37 STEP 2502 H=2502:00 +CPU= 18.519
  23:39:48 STEP 2503 H=2503:00 +CPU= 11.633
  23:40:00 STEP 2504 H=2504:00 +CPU= 12.013
  23:40:19 STEP 2505 H=2505:00 +CPU= 18.445
  23:40:31 STEP 2506 H=2506:00 +CPU= 11.992
  23:40:43 STEP 2507 H=2507:00 +CPU= 11.648
  23:41:03 STEP 2508 H=2508:00 +CPU= 20.301
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+002508
  23:41:14 STEP 2509 H=2509:00 +CPU= 11.600
  23:41:27 STEP 2510 H=2510:00 +CPU= 12.146
  23:41:45 STEP 2511 H=2511:00 +CPU= 18.038
  23:41:57 STEP 2512 H=2512:00 +CPU= 12.005
  23:42:08 STEP 2513 H=2513:00 +CPU= 11.667
  23:42:27 STEP 2514 H=2514:00 +CPU= 18.642
  23:42:39 STEP 2515 H=2515:00 +CPU= 11.624
  23:42:51 STEP 2516 H=2516:00 +CPU= 12.103
  23:43:09 STEP 2517 H=2517:00 +CPU= 18.388
  23:43:21 STEP 2518 H=2518:00 +CPU= 11.916
  23:43:34 STEP 2519 H=2519:00 +CPU= 12.646
  23:43:57 STEP 2520 H=2520:00 +CPU= 23.350
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMGGhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMSHhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMGGhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMSHhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMUAhq0f+002508
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0524_1992050100_123_961_12178168_0_r674883618_104.zip
Uploading the intermediate file: upload_file_104.zip
  23:44:09 STEP 2521 H=2521:00 +CPU= 11.720
  23:44:21 STEP 2522 H=2522:00 +CPU= 11.929
Uploading trickle at timestep: 9072000
  23:44:39 STEP 2523 H=2523:00 +CPU= 18.496
  23:44:51 STEP 2524 H=2524:00 +CPU= 11.932
  23:45:03 STEP 2525 H=2525:00 +CPU= 11.813
  23:45:22 STEP 2526 H=2526:00 +CPU= 18.653
  23:45:33 STEP 2527 H=2527:00 +CPU= 11.643
  23:45:45 STEP 2528 H=2528:00 +CPU= 12.091
  23:46:04 STEP 2529 H=2529:00 +CPU= 18.209
  23:46:16 STEP 2530 H=2530:00 +CPU= 12.113
  23:46:28 STEP 2531 H=2531:00 +CPU= 11.838
  23:46:48 STEP 2532 H=2532:00 +CPU= 20.764
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+002532
  23:47:00 STEP 2533 H=2533:00 +CPU= 11.734
  23:47:12 STEP 2534 H=2534:00 +CPU= 12.134
  23:47:31 STEP 2535 H=2535:00 +CPU= 18.445
  23:47:43 STEP 2536 H=2536:00 +CPU= 11.907
  23:47:54 STEP 2537 H=2537:00 +CPU= 11.596
  23:48:13 STEP 2538 H=2538:00 +CPU= 18.747
  23:48:25 STEP 2539 H=2539:00 +CPU= 11.682
  23:48:37 STEP 2540 H=2540:00 +CPU= 11.917
  23:48:55 STEP 2541 H=2541:00 +CPU= 18.290
  23:49:07 STEP 2542 H=2542:00 +CPU= 11.846
  23:49:19 STEP 2543 H=2543:00 +CPU= 12.055
  23:49:42 STEP 2544 H=2544:00 +CPU= 23.083
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMGGhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMSHhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMGGhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMSHhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMUAhq0f+002532
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0524_1992050100_123_961_12178168_0_r674883618_105.zip
Uploading the intermediate file: upload_file_105.zip
  23:49:54 STEP 2545 H=2545:00 +CPU= 11.986
  23:50:06 STEP 2546 H=2546:00 +CPU= 11.927
  23:50:24 STEP 2547 H=2547:00 +CPU= 18.228
  23:50:36 STEP 2548 H=2548:00 +CPU= 12.351
  23:50:48 STEP 2549 H=2549:00 +CPU= 11.711
  23:51:07 STEP 2550 H=2550:00 +CPU= 18.727
  23:51:18 STEP 2551 H=2551:00 +CPU= 11.673
  23:51:30 STEP 2552 H=2552:00 +CPU= 11.979
  23:51:49 STEP 2553 H=2553:00 +CPU= 18.440
  23:52:01 STEP 2554 H=2554:00 +CPU= 12.042
  23:52:12 STEP 2555 H=2555:00 +CPU= 11.465
  23:52:32 STEP 2556 H=2556:00 +CPU= 19.998
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+002556
  23:52:44 STEP 2557 H=2557:00 +CPU= 11.643
  23:52:56 STEP 2558 H=2558:00 +CPU= 11.799
  23:53:14 STEP 2559 H=2559:00 +CPU= 18.267
  23:53:26 STEP 2560 H=2560:00 +CPU= 11.812
  23:53:38 STEP 2561 H=2561:00 +CPU= 11.590
  23:53:56 STEP 2562 H=2562:00 +CPU= 18.887
  23:54:08 STEP 2563 H=2563:00 +CPU= 11.647
  23:54:20 STEP 2564 H=2564:00 +CPU= 11.960
  23:54:38 STEP 2565 H=2565:00 +CPU= 18.341
  23:54:50 STEP 2566 H=2566:00 +CPU= 11.830
  23:55:03 STEP 2567 H=2567:00 +CPU= 12.271
  23:55:25 STEP 2568 H=2568:00 +CPU= 22.874
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMGGhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMSHhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMGGhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMSHhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMUAhq0f+002556
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0524_1992050100_123_961_12178168_0_r674883618_106.zip
Uploading the intermediate file: upload_file_106.zip
  23:55:37 STEP 2569 H=2569:00 +CPU= 12.047
  23:55:50 STEP 2570 H=2570:00 +CPU= 12.022
  23:56:08 STEP 2571 H=2571:00 +CPU= 18.325
  23:56:20 STEP 2572 H=2572:00 +CPU= 12.136
  23:56:32 STEP 2573 H=2573:00 +CPU= 11.510
  23:56:50 STEP 2574 H=2574:00 +CPU= 18.509
  23:57:02 STEP 2575 H=2575:00 +CPU= 11.560
  23:57:13 STEP 2576 H=2576:00 +CPU= 11.821
  23:57:32 STEP 2577 H=2577:00 +CPU= 18.128
  23:57:44 STEP 2578 H=2578:00 +CPU= 11.973
  23:57:55 STEP 2579 H=2579:00 +CPU= 11.949
  23:58:16 STEP 2580 H=2580:00 +CPU= 20.222
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+002580
  23:58:27 STEP 2581 H=2581:00 +CPU= 11.639
  23:58:39 STEP 2582 H=2582:00 +CPU= 11.960
  23:58:57 STEP 2583 H=2583:00 +CPU= 18.097
  23:59:09 STEP 2584 H=2584:00 +CPU= 11.983
  23:59:21 STEP 2585 H=2585:00 +CPU= 11.766
  23:59:40 STEP 2586 H=2586:00 +CPU= 18.716
  23:59:52 STEP 2587 H=2587:00 +CPU= 11.763
  00:00:04 STEP 2588 H=2588:00 +CPU= 12.031
  00:00:22 STEP 2589 H=2589:00 +CPU= 18.451
  00:00:34 STEP 2590 H=2590:00 +CPU= 12.011
  00:00:47 STEP 2591 H=2591:00 +CPU= 12.366
  00:01:09 STEP 2592 H=2592:00 +CPU= 22.803
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMGGhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMSHhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMGGhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMSHhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMUAhq0f+002580
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0524_1992050100_123_961_12178168_0_r674883618_107.zip
Uploading the intermediate file: upload_file_107.zip
  00:01:21 STEP 2593 H=2593:00 +CPU= 11.648
  00:01:33 STEP 2594 H=2594:00 +CPU= 11.879
  00:01:51 STEP 2595 H=2595:00 +CPU= 18.459
  00:02:03 STEP 2596 H=2596:00 +CPU= 12.065
  00:02:15 STEP 2597 H=2597:00 +CPU= 11.601
  00:02:34 STEP 2598 H=2598:00 +CPU= 18.751
  00:02:46 STEP 2599 H=2599:00 +CPU= 11.723
  00:02:57 STEP 2600 H=2600:00 +CPU= 11.735
  00:03:16 STEP 2601 H=2601:00 +CPU= 18.590
  00:03:28 STEP 2602 H=2602:00 +CPU= 11.804
  00:03:39 STEP 2603 H=2603:00 +CPU= 11.481
  00:04:00 STEP 2604 H=2604:00 +CPU= 20.715
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+002604
  00:04:11 STEP 2605 H=2605:00 +CPU= 11.582
  00:04:23 STEP 2606 H=2606:00 +CPU= 11.863
  00:04:42 STEP 2607 H=2607:00 +CPU= 18.388
  00:04:54 STEP 2608 H=2608:00 +CPU= 11.856
  00:05:05 STEP 2609 H=2609:00 +CPU= 11.597
  00:05:24 STEP 2610 H=2610:00 +CPU= 19.276
  00:05:36 STEP 2611 H=2611:00 +CPU= 11.655
  00:05:48 STEP 2612 H=2612:00 +CPU= 11.870
  00:06:07 STEP 2613 H=2613:00 +CPU= 18.597
  00:06:18 STEP 2614 H=2614:00 +CPU= 11.881
  00:06:31 STEP 2615 H=2615:00 +CPU= 12.530
  00:06:54 STEP 2616 H=2616:00 +CPU= 22.607
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMGGhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMSHhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMGGhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMSHhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168/ICMUAhq0f+002604
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0524_1992050100_123_961_12178168_0_r674883618_108.zip
Uploading the intermediate file: upload_file_108.zip
  00:07:05 STEP 2617 H=2617:00 +CPU= 11.832
  00:07:17 STEP 2618 H=2618:00 +CPU= 11.830
  00:07:36 STEP 2619 H=2619:00 +CPU= 18.368
  00:07:48 STEP 2620 H=2620:00 +CPU= 11.871
  00:07:59 STEP 2621 H=2621:00 +CPU= 11.710
  00:08:18 STEP 2622 H=2622:00 +CPU= 18.845
  00:08:30 STEP 2623 H=2623:00 +CPU= 11.780
  00:08:42 STEP 2624 H=2624:00 +CPU= 12.084
  00:09:00 STEP 2625 H=2625:00 +CPU= 18.267
  00:09:12 STEP 2626 H=2626:00 +CPU= 11.837
  00:09:24 STEP 2627 H=2627:00 +CPU= 11.684
  00:09:44 STEP 2628 H=2628:00 +CPU= 20.277
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMGGhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMSHhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/11/ICMUAhq0f+002628
  00:09:56 STEP 2629 H=2629:00 +CPU= 11.771
  00:10:08 STEP 2630 H=2630:00 +CPU= 11.932
  00:10:26 STEP 2631 H=2631:00 +CPU= 18.577
  00:10:38 STEP 2632 H=2632:00 +CPU= 11.841
  00:10:50 STEP 2633 H=2633:00 +CPU= 11.873
  00:11:10 STEP 2634 H=2634:00 +CPU= 19.805
  00:11:22 STEP 2635 H=2635:00 +CPU= 12.117
  00:11:36 STEP 2636 H=2636:00 +CPU= 13.632
Quit request received from BOINC client, ending the child process
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1992050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0524
(argv4) batchid: 961
(argv5) wuid: 12178168
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/11
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12178168
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/11/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/11/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_97c8ca23829876272c4e8eb363ab1ff1 to: /var/lib/boinc-client/slots/11/oifs_43r3_ps_0524_1992050100_123_961_12178168.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/11/oifs_43r3_ps_0524_1992050100_123_961_12178168.zip
ic_ancil_file: ic_ancil_12178168
ifsdata_file: ifsdata_12178168
climate_data_file: clim_data_12178168
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_af1a3f680026f70d41b57793183d0cf8 to: /var/lib/boinc-client/slots/11/ic_ancil_12178168.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/11/ic_ancil_12178168.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_4391aec1c11487512dc519f41e17053f to: /var/lib/boinc-client/slots/11/ifsdata/ifsdata_12178168.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/11/ifsdata/ifsdata_12178168.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/11/159l_2/clim_data_12178168.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/11/159l_2/clim_data_12178168.zip
Checking for progress XML file: /var/lib/boinc-client/slots/11/progress_file_12178168.xml
Opened progress file ok : /var/lib/boinc-client/slots/11/progress_file_12178168.xml
-- Model is restarting --
Adjusting last_iter, 2637, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/11/progress_file_12178168.xml
last_cpu_time: 38980
upload_file_number: 109
last_iter: 2615
last_upload: 9417600
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0524_1992050100_123_961_12178168_0_r674883618
The child process has been launched with process id: 508776
Executing the command: /var/lib/boinc-client/slots/11/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:Boinc:1:1:508776:508776] [20221223:001508:1671754508:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:Boinc:1:1:508776:508776] [20221223:001508:1671754508:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:Boinc:1:1:508776:508776] [20221223:001508:1671754508:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:Boinc:1:1:508776:508776] [20221223:001508:1671754508:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:Boinc:1:1:508776:508776] [20221223:001508:1671754508:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:Boinc:1:1:508776:508776] [20221223:001508:1671754508:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:Boinc:1:1:508776:508776] [20221223:001508:1671754508:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:Boinc:1:1:508776:508776] [20221223:001508:1671754508:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:Boinc:1:1:508776:508776] [20221223:001508:1671754508:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:Boinc:1:1:508776:508776] [20221223:001508:1671754508:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:Boinc:1:1:508776:508776] [20221223:001508:1671754508:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:Boinc:1:1:508776:508776] [20221223:001508:1671754508:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:Boinc:1:1:508776:508776] [20221223:001508:1671754508:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:Boinc:1:1:508776:508776] [20221223:001508:1671754508:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:Boinc:1:1:508776:508776] [20221223:001508:1671754508:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:Boinc:1:1:508776:508776] [20221223:001508:1671754508:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Boinc:1:1:508776:508776] [20221223:001508:1671754508:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:Boinc:1:1:508776:508776] [20221223:001508:1671754508:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Boinc:1:1:508776:508776] [20221223:001508:1671754508:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:Boinc:1:1:508776:508776] [20221223:001508:1671754508:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:Boinc:1:1:508776:508776] [20221223:001508:1671754508:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Boinc:1:1:508776:508776] [20221223:001508:1671754508:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Boinc:1:1:508776:508776] [20221223:001508:1671754508:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:Boinc:1:1:508776:508776] [20221223:001508:1671754508:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Boinc:1:1:508776:508776] [20221223:001508:1671754508:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Boinc:1:1:508776:508776] [20221223:001508:1671754508:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Boinc:1:1:508776:508776] [20221223:001508:1671754508:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:Boinc:1:1:508776:508776] [20221223:001508:1671754508:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:Boinc:1:1:508776:508776] [20221223:001508:1671754508:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:Boinc:1:1:508776:508776] [20221223:001508:1671754508:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  00:15:36 STEP 2616 H=2616:00 +CPU= 24.992
  00:15:54 STEP 2617 H=2617:00 +CPU= 15.545
The child process terminated with status: 0
..Failed, model did not complete successfully

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 15:49:02 1534294 22263015 oifs_43r3_ps_0524_1992050100_123_961_12178168_0 9,072,000 37,315 0.0041
09 May 2023 15:49:02 1534294 22263015 oifs_43r3_ps_0524_1992050100_123_961_12178168_0 8,208,000 33,886 0.0041
09 May 2023 15:49:02 1534294 22263015 oifs_43r3_ps_0524_1992050100_123_961_12178168_0 7,344,000 30,466 0.0041
09 May 2023 15:49:02 1534294 22263015 oifs_43r3_ps_0524_1992050100_123_961_12178168_0 6,480,000 27,037 0.0042
09 May 2023 15:49:02 1534294 22263015 oifs_43r3_ps_0524_1992050100_123_961_12178168_0 5,616,000 23,618 0.0042
09 May 2023 15:49:02 1534294 22263015 oifs_43r3_ps_0524_1992050100_123_961_12178168_0 4,752,000 20,200 0.0043
09 May 2023 15:49:02 1534294 22263015 oifs_43r3_ps_0524_1992050100_123_961_12178168_0 3,888,000 16,752 0.0043
09 May 2023 15:49:02 1534294 22263015 oifs_43r3_ps_0524_1992050100_123_961_12178168_0 3,024,000 13,314 0.0044
09 May 2023 15:49:02 1534294 22263015 oifs_43r3_ps_0524_1992050100_123_961_12178168_0 2,160,000 9,757 0.0045
09 May 2023 15:47:05 1534294 22263015 oifs_43r3_ps_0524_1992050100_123_961_12178168_0 864,000 3,982 0.0046


©2024 climateprediction.net