Name | oifs_43r3_ps_0770_1994050100_123_963_12180414_0 |
Workunit | 12180414 |
Created | 22 Dec 2022, 6:36:34 UTC |
Sent | 5 Jan 2023, 3:22:44 UTC |
Report deadline | 4 Feb 2023, 3:22:44 UTC |
Received | 5 Jan 2023, 16:38:40 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 196 (0x000000C4) EXIT_DISK_LIMIT_EXCEEDED |
Computer ID | 1414915 |
Run time | 12 hours 5 min 51 sec |
CPU time | 12 hours 4 min 6 sec |
Validate state | Invalid |
Credit | 13,426.56 |
Device peak FLOPS | 4.73 GFLOPS |
Application version | OpenIFS 43r3 Perturbed Surface v1.05 x86_64-pc-linux-gnu |
Peak working set size | 4,417.87 MB |
Peak swap size | 4,978.07 MB |
Peak disk usage | 7,572.78 MB |
Stderr | <core_client_version>7.6.31</core_client_version> <![CDATA[ <message> Disk usage limit exceeded </message> <stderr_txt> ects/climateprediction.net/oifs_43r3_ps_12180414/ICMUAhq0f+002232 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMGGhq0f+002244 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMSHhq0f+002244 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMUAhq0f+002244 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0770_1994050100_123_963_12180414_0_r601889875_93.zip Uploading the intermediate file: upload_file_93.zip 14:30:13 STEP 2257 H=2257:00 +CPU= 13.400 14:30:26 STEP 2258 H=2258:00 +CPU= 13.624 14:30:47 STEP 2259 H=2259:00 +CPU= 20.992 14:31:01 STEP 2260 H=2260:00 +CPU= 13.316 14:31:13 STEP 2261 H=2261:00 +CPU= 12.532 14:31:34 STEP 2262 H=2262:00 +CPU= 20.748 14:31:47 STEP 2263 H=2263:00 +CPU= 13.324 14:32:01 STEP 2264 H=2264:00 +CPU= 13.540 14:32:21 STEP 2265 H=2265:00 +CPU= 20.324 14:32:35 STEP 2266 H=2266:00 +CPU= 13.276 14:32:47 STEP 2267 H=2267:00 +CPU= 12.948 14:33:11 STEP 2268 H=2268:00 +CPU= 23.120 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002268 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002268 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002268 14:33:24 STEP 2269 H=2269:00 +CPU= 13.040 14:33:37 STEP 2270 H=2270:00 +CPU= 12.892 14:33:59 STEP 2271 H=2271:00 +CPU= 22.056 14:34:15 STEP 2272 H=2272:00 +CPU= 15.604 14:34:28 STEP 2273 H=2273:00 +CPU= 13.316 14:34:50 STEP 2274 H=2274:00 +CPU= 22.352 14:35:05 STEP 2275 H=2275:00 +CPU= 14.580 14:35:19 STEP 2276 H=2276:00 +CPU= 13.936 14:35:40 STEP 2277 H=2277:00 +CPU= 20.684 14:35:53 STEP 2278 H=2278:00 +CPU= 13.124 14:36:06 STEP 2279 H=2279:00 +CPU= 13.196 14:36:30 STEP 2280 H=2280:00 +CPU= 24.524 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002280 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002280 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002280 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMGGhq0f+002256 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMSHhq0f+002256 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMUAhq0f+002256 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMGGhq0f+002268 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMSHhq0f+002268 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMUAhq0f+002268 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0770_1994050100_123_963_12180414_0_r601889875_94.zip Uploading the intermediate file: upload_file_94.zip 14:36:44 STEP 2281 H=2281:00 +CPU= 13.440 14:36:57 STEP 2282 H=2282:00 +CPU= 13.380 14:37:17 STEP 2283 H=2283:00 +CPU= 20.268 14:37:31 STEP 2284 H=2284:00 +CPU= 13.360 14:37:44 STEP 2285 H=2285:00 +CPU= 13.368 14:38:06 STEP 2286 H=2286:00 +CPU= 21.024 14:38:19 STEP 2287 H=2287:00 +CPU= 12.728 14:38:32 STEP 2288 H=2288:00 +CPU= 13.240 14:38:52 STEP 2289 H=2289:00 +CPU= 20.660 14:39:06 STEP 2290 H=2290:00 +CPU= 13.984 14:39:20 STEP 2291 H=2291:00 +CPU= 13.708 Suspend request received from the BOINC client, suspending the child process Resuming the child process 14:40:08 STEP 2292 H=2292:00 +CPU= 26.568 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002292 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002292 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002292 14:40:26 STEP 2293 H=2293:00 +CPU= 17.860 14:40:41 STEP 2294 H=2294:00 +CPU= 15.220 Suspend request received from the BOINC client, suspending the child process Resuming the child process 14:41:15 STEP 2295 H=2295:00 +CPU= 22.156 14:41:30 STEP 2296 H=2296:00 +CPU= 15.172 14:41:44 STEP 2297 H=2297:00 +CPU= 13.952 14:42:06 STEP 2298 H=2298:00 +CPU= 22.124 14:42:20 STEP 2299 H=2299:00 +CPU= 14.208 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 14:43:00 STEP 2300 H=2300:00 +CPU= 17.140 Suspend request received from the BOINC client, suspending the child process Resuming the child process 14:43:35 STEP 2301 H=2301:00 +CPU= 23.088 14:43:49 STEP 2302 H=2302:00 +CPU= 14.100 14:44:05 STEP 2303 H=2303:00 +CPU= 15.616 14:44:31 STEP 2304 H=2304:00 +CPU= 25.528 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002304 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002304 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002304 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMGGhq0f+002280 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMSHhq0f+002280 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMUAhq0f+002280 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMGGhq0f+002292 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMSHhq0f+002292 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMUAhq0f+002292 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0770_1994050100_123_963_12180414_0_r601889875_95.zip Uploading the intermediate file: upload_file_95.zip 14:44:44 STEP 2305 H=2305:00 +CPU= 13.220 14:44:57 STEP 2306 H=2306:00 +CPU= 13.360 14:45:19 STEP 2307 H=2307:00 +CPU= 21.264 14:45:33 STEP 2308 H=2308:00 +CPU= 13.920 14:45:46 STEP 2309 H=2309:00 +CPU= 13.436 14:46:07 STEP 2310 H=2310:00 +CPU= 20.704 14:46:20 STEP 2311 H=2311:00 +CPU= 12.876 14:46:33 STEP 2312 H=2312:00 +CPU= 13.548 14:46:54 STEP 2313 H=2313:00 +CPU= 20.812 14:47:07 STEP 2314 H=2314:00 +CPU= 13.436 14:47:20 STEP 2315 H=2315:00 +CPU= 12.852 14:47:43 STEP 2316 H=2316:00 +CPU= 22.376 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002316 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002316 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002316 14:47:56 STEP 2317 H=2317:00 +CPU= 13.260 14:48:10 STEP 2318 H=2318:00 +CPU= 13.860 14:48:30 STEP 2319 H=2319:00 +CPU= 20.100 14:48:43 STEP 2320 H=2320:00 +CPU= 13.244 14:48:57 STEP 2321 H=2321:00 +CPU= 13.312 14:49:17 STEP 2322 H=2322:00 +CPU= 20.952 14:49:31 STEP 2323 H=2323:00 +CPU= 13.312 14:49:44 STEP 2324 H=2324:00 +CPU= 13.264 14:50:05 STEP 2325 H=2325:00 +CPU= 20.500 14:50:18 STEP 2326 H=2326:00 +CPU= 13.796 14:50:32 STEP 2327 H=2327:00 +CPU= 13.508 14:50:56 STEP 2328 H=2328:00 +CPU= 23.928 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002328 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002328 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002328 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMGGhq0f+002304 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMSHhq0f+002304 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMUAhq0f+002304 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMGGhq0f+002316 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMSHhq0f+002316 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMUAhq0f+002316 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0770_1994050100_123_963_12180414_0_r601889875_96.zip Uploading the intermediate file: upload_file_96.zip 14:51:09 STEP 2329 H=2329:00 +CPU= 12.848 14:51:23 STEP 2330 H=2330:00 +CPU= 13.752 14:51:43 STEP 2331 H=2331:00 +CPU= 20.100 14:51:57 STEP 2332 H=2332:00 +CPU= 14.136 14:52:10 STEP 2333 H=2333:00 +CPU= 13.148 14:52:31 STEP 2334 H=2334:00 +CPU= 20.956 14:52:44 STEP 2335 H=2335:00 +CPU= 12.944 14:52:58 STEP 2336 H=2336:00 +CPU= 13.196 14:53:18 STEP 2337 H=2337:00 +CPU= 20.572 14:53:31 STEP 2338 H=2338:00 +CPU= 13.216 14:53:45 STEP 2339 H=2339:00 +CPU= 13.428 14:54:08 STEP 2340 H=2340:00 +CPU= 22.144 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002340 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002340 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002340 14:54:21 STEP 2341 H=2341:00 +CPU= 13.320 14:54:34 STEP 2342 H=2342:00 +CPU= 13.324 14:54:55 STEP 2343 H=2343:00 +CPU= 20.516 14:55:08 STEP 2344 H=2344:00 +CPU= 13.348 14:55:21 STEP 2345 H=2345:00 +CPU= 12.984 14:55:42 STEP 2346 H=2346:00 +CPU= 21.056 14:55:56 STEP 2347 H=2347:00 +CPU= 13.464 14:56:10 STEP 2348 H=2348:00 +CPU= 14.120 14:56:30 STEP 2349 H=2349:00 +CPU= 20.064 14:56:43 STEP 2350 H=2350:00 +CPU= 13.700 14:56:57 STEP 2351 H=2351:00 +CPU= 13.244 14:57:21 STEP 2352 H=2352:00 +CPU= 24.264 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002352 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002352 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002352 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMGGhq0f+002328 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMSHhq0f+002328 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMUAhq0f+002328 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMGGhq0f+002340 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMSHhq0f+002340 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMUAhq0f+002340 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0770_1994050100_123_963_12180414_0_r601889875_97.zip Uploading the intermediate file: upload_file_97.zip 14:57:34 STEP 2353 H=2353:00 +CPU= 12.804 14:57:47 STEP 2354 H=2354:00 +CPU= 13.160 14:58:08 STEP 2355 H=2355:00 +CPU= 20.912 14:58:21 STEP 2356 H=2356:00 +CPU= 13.184 14:58:35 STEP 2357 H=2357:00 +CPU= 13.492 14:58:56 STEP 2358 H=2358:00 +CPU= 20.744 14:59:08 STEP 2359 H=2359:00 +CPU= 12.804 14:59:22 STEP 2360 H=2360:00 +CPU= 13.932 14:59:43 STEP 2361 H=2361:00 +CPU= 20.888 14:59:56 STEP 2362 H=2362:00 +CPU= 13.276 15:00:10 STEP 2363 H=2363:00 +CPU= 13.276 15:00:32 STEP 2364 H=2364:00 +CPU= 22.332 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002364 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002364 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002364 15:00:46 STEP 2365 H=2365:00 +CPU= 13.680 15:00:59 STEP 2366 H=2366:00 +CPU= 13.440 15:01:19 STEP 2367 H=2367:00 +CPU= 20.052 15:01:32 STEP 2368 H=2368:00 +CPU= 13.164 15:01:45 STEP 2369 H=2369:00 +CPU= 13.036 15:02:07 STEP 2370 H=2370:00 +CPU= 21.384 15:02:20 STEP 2371 H=2371:00 +CPU= 12.896 15:02:33 STEP 2372 H=2372:00 +CPU= 13.216 15:02:53 STEP 2373 H=2373:00 +CPU= 20.192 15:03:07 STEP 2374 H=2374:00 +CPU= 14.052 15:03:21 STEP 2375 H=2375:00 +CPU= 13.628 15:03:44 STEP 2376 H=2376:00 +CPU= 23.608 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002376 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002376 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002376 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMGGhq0f+002352 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMSHhq0f+002352 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMUAhq0f+002352 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMGGhq0f+002364 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMSHhq0f+002364 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMUAhq0f+002364 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0770_1994050100_123_963_12180414_0_r601889875_98.zip Uploading the intermediate file: upload_file_98.zip 15:03:57 STEP 2377 H=2377:00 +CPU= 12.808 15:04:11 STEP 2378 H=2378:00 +CPU= 13.668 15:04:31 STEP 2379 H=2379:00 +CPU= 20.404 15:04:45 STEP 2380 H=2380:00 +CPU= 13.392 15:04:58 STEP 2381 H=2381:00 +CPU= 12.828 15:05:19 STEP 2382 H=2382:00 +CPU= 21.408 15:05:34 STEP 2383 H=2383:00 +CPU= 14.720 15:05:47 STEP 2384 H=2384:00 +CPU= 13.264 15:06:07 STEP 2385 H=2385:00 +CPU= 20.196 15:06:21 STEP 2386 H=2386:00 +CPU= 13.608 15:06:35 STEP 2387 H=2387:00 +CPU= 14.140 15:06:58 STEP 2388 H=2388:00 +CPU= 22.620 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002388 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002388 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002388 15:07:10 STEP 2389 H=2389:00 +CPU= 12.852 15:07:24 STEP 2390 H=2390:00 +CPU= 13.188 15:07:44 STEP 2391 H=2391:00 +CPU= 20.316 15:07:58 STEP 2392 H=2392:00 +CPU= 13.876 15:08:11 STEP 2393 H=2393:00 +CPU= 12.824 15:08:31 STEP 2394 H=2394:00 +CPU= 20.508 15:08:44 STEP 2395 H=2395:00 +CPU= 12.828 15:08:58 STEP 2396 H=2396:00 +CPU= 13.708 15:09:18 STEP 2397 H=2397:00 +CPU= 20.524 15:09:31 STEP 2398 H=2398:00 +CPU= 13.208 15:09:45 STEP 2399 H=2399:00 +CPU= 13.188 15:10:10 STEP 2400 H=2400:00 +CPU= 24.148 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002400 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002400 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002400 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMGGhq0f+002376 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMSHhq0f+002376 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMUAhq0f+002376 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMGGhq0f+002388 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMSHhq0f+002388 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMUAhq0f+002388 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0770_1994050100_123_963_12180414_0_r601889875_99.zip Uploading the intermediate file: upload_file_99.zip 15:10:24 STEP 2401 H=2401:00 +CPU= 13.860 15:10:37 STEP 2402 H=2402:00 +CPU= 13.160 15:10:57 STEP 2403 H=2403:00 +CPU= 20.288 15:11:11 STEP 2404 H=2404:00 +CPU= 13.160 15:11:25 STEP 2405 H=2405:00 +CPU= 14.364 15:11:46 STEP 2406 H=2406:00 +CPU= 21.124 15:11:59 STEP 2407 H=2407:00 +CPU= 12.836 15:12:12 STEP 2408 H=2408:00 +CPU= 13.148 15:12:33 STEP 2409 H=2409:00 +CPU= 20.448 15:12:46 STEP 2410 H=2410:00 +CPU= 13.948 15:13:00 STEP 2411 H=2411:00 +CPU= 13.248 15:13:22 STEP 2412 H=2412:00 +CPU= 22.188 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002412 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002412 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002412 15:13:35 STEP 2413 H=2413:00 +CPU= 12.848 15:13:49 STEP 2414 H=2414:00 +CPU= 13.796 15:14:10 STEP 2415 H=2415:00 +CPU= 20.840 15:14:23 STEP 2416 H=2416:00 +CPU= 13.220 15:14:36 STEP 2417 H=2417:00 +CPU= 13.020 15:14:57 STEP 2418 H=2418:00 +CPU= 21.232 15:15:11 STEP 2419 H=2419:00 +CPU= 13.568 15:15:24 STEP 2420 H=2420:00 +CPU= 13.848 15:15:44 STEP 2421 H=2421:00 +CPU= 20.036 15:15:58 STEP 2422 H=2422:00 +CPU= 13.180 15:16:12 STEP 2423 H=2423:00 +CPU= 13.936 15:16:36 STEP 2424 H=2424:00 +CPU= 23.860 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002424 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002424 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002424 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMGGhq0f+002400 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMSHhq0f+002400 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMUAhq0f+002400 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMGGhq0f+002412 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMSHhq0f+002412 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMUAhq0f+002412 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0770_1994050100_123_963_12180414_0_r601889875_100.zip Uploading the intermediate file: upload_file_100.zip 15:16:49 STEP 2425 H=2425:00 +CPU= 12.788 15:17:03 STEP 2426 H=2426:00 +CPU= 13.284 15:17:23 STEP 2427 H=2427:00 +CPU= 20.384 15:17:37 STEP 2428 H=2428:00 +CPU= 14.384 15:17:51 STEP 2429 H=2429:00 +CPU= 13.380 15:18:11 STEP 2430 H=2430:00 +CPU= 20.488 15:18:28 STEP 2431 H=2431:00 +CPU= 16.844 15:18:44 STEP 2432 H=2432:00 +CPU= 15.304 15:19:04 STEP 2433 H=2433:00 +CPU= 20.736 15:19:18 STEP 2434 H=2434:00 +CPU= 13.284 15:19:31 STEP 2435 H=2435:00 +CPU= 13.008 15:19:53 STEP 2436 H=2436:00 +CPU= 22.784 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002436 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002436 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002436 15:20:07 STEP 2437 H=2437:00 +CPU= 13.548 15:20:21 STEP 2438 H=2438:00 +CPU= 14.464 15:20:41 STEP 2439 H=2439:00 +CPU= 20.088 15:20:56 STEP 2440 H=2440:00 +CPU= 14.192 15:21:09 STEP 2441 H=2441:00 +CPU= 13.420 15:21:30 STEP 2442 H=2442:00 +CPU= 21.284 15:21:44 STEP 2443 H=2443:00 +CPU= 13.288 15:21:57 STEP 2444 H=2444:00 +CPU= 13.192 15:22:18 STEP 2445 H=2445:00 +CPU= 20.756 15:22:31 STEP 2446 H=2446:00 +CPU= 13.132 15:22:44 STEP 2447 H=2447:00 +CPU= 13.260 Quit request received from BOINC client, ending the child process (argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu (argv1) start_date: 1994050100 (argv2) exptid: hq0f (argv3) unique_member_id: 0770 (argv4) batchid: 963 (argv5) wuid: 12180414 (argv6) fclen: 123 (argv7) app_name: oifs_43r3_ps (argv8) nthreads: 1 Working directory is: /var/lib/boinc-client/slots/0 Project directory is: /var/lib/boinc-client/projects/climateprediction.net/ app name: oifs_43r3_ps version: 1.05 Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414 ..mkdir for temp folder for results failed Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip Unzipping the app zip file: /var/lib/boinc-client/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip Copying the namelist files from: ../../projects/climateprediction.net/jf_dc52beb3e379bbfe986cae914f1070aa to: /var/lib/boinc-client/slots/0/oifs_43r3_ps_0770_1994050100_123_963_12180414.zip Unzipping the namelist zip file: /var/lib/boinc-client/slots/0/oifs_43r3_ps_0770_1994050100_123_963_12180414.zip ic_ancil_file: ic_ancil_12180414 ifsdata_file: ifsdata_12180414 climate_data_file: clim_data_12180414 horiz_resolution: 159 vert_resolution: 60 grid_type: l_2 upload_interval: 24 utstep: 3600 nfrres: restart dump frequency (steps) 24 Copying IC ancils from: ../../projects/climateprediction.net/jf_81b059026d2f0374e3ea8af0fbf15b56 to: /var/lib/boinc-client/slots/0/ic_ancil_12180414.zip Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/0/ic_ancil_12180414.zip ..mkdir for ifsdata folder failed Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_fba7b6994d911e13a6ee24e493f481f4 to: /var/lib/boinc-client/slots/0/ifsdata/ifsdata_12180414.zip Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/0/ifsdata/ifsdata_12180414.zip ..mkdir for the climate data folder failed Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/0/159l_2/clim_data_12180414.zip Unzipping the climate data zip file: /var/lib/boinc-client/slots/0/159l_2/clim_data_12180414.zip Checking for progress XML file: /var/lib/boinc-client/slots/0/progress_file_12180414.xml Opened progress file ok : /var/lib/boinc-client/slots/0/progress_file_12180414.xml -- Model is restarting -- Adjusting last_iter, 2448, to previous model restart step. Creating progress file: /var/lib/boinc-client/slots/0/progress_file_12180414.xml last_cpu_time: 39210 upload_file_number: 101 last_iter: 2447 last_upload: 8726400 model_completed: 0 total_length_of_simulation: 10627200 result_base_name: oifs_43r3_ps_0770_1994050100_123_963_12180414_0_r601889875 The child process has been launched with process id: 17485 Executing the command: /var/lib/boinc-client/slots/0/oifs_43r3_model.exe [EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1 [EC_DRHOOK:atlas:1:1:17485:17485] [20230105:152355:1672928635:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0 [EC_DRHOOK:atlas:1:1:17485:17485] [20230105:152355:1672928635:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1 [EC_DRHOOK:atlas:1:1:17485:17485] [20230105:152355:1672928635:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0) [EC_DRHOOK:atlas:1:1:17485:17485] [20230105:152355:1672928635:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1 [EC_DRHOOK:atlas:1:1:17485:17485] [20230105:152355:1672928635:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000 [EC_DRHOOK:atlas:1:1:17485:17485] [20230105:152355:1672928635:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647) [EC_DRHOOK:atlas:1:1:17485:17485] [20230105:152355:1672928635:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16 [EC_DRHOOK:atlas:1:1:17485:17485] [20230105:152355:1672928635:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0 [EC_DRHOOK:atlas:1:1:17485:17485] [20230105:152355:1672928635:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500 [EC_DRHOOK:atlas:1:1:17485:17485] [20230105:152355:1672928635:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1 [EC_DRHOOK:atlas:1:1:17485:17485] [20230105:152355:1672928635:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1 [EC_DRHOOK:atlas:1:1:17485:17485] [20230105:152355:1672928635:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1 [EC_DRHOOK:atlas:1:1:17485:17485] [20230105:152355:1672928635:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1 [EC_DRHOOK:atlas:1:1:17485:17485] [20230105:152355:1672928635:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef> [EC_DRHOOK:atlas:1:1:17485:17485] [20230105:152355:1672928635:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef> [EC_DRHOOK:atlas:1:1:17485:17485] [20230105:152355:1672928635:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:atlas:1:1:17485:17485] [20230105:152355:1672928635:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil)) [EC_DRHOOK:atlas:1:1:17485:17485] [20230105:152355:1672928635:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:atlas:1:1:17485:17485] [20230105:152355:1672928635:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil)) [EC_DRHOOK:atlas:1:1:17485:17485] [20230105:152355:1672928635:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1 [EC_DRHOOK:atlas:1:1:17485:17485] [20230105:152355:1672928635:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:atlas:1:1:17485:17485] [20230105:152355:1672928635:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:atlas:1:1:17485:17485] [20230105:152355:1672928635:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil)) [EC_DRHOOK:atlas:1:1:17485:17485] [20230105:152355:1672928635:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:atlas:1:1:17485:17485] [20230105:152355:1672928635:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:atlas:1:1:17485:17485] [20230105:152355:1672928635:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:atlas:1:1:17485:17485] [20230105:152355:1672928635:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil)) [EC_DRHOOK:atlas:1:1:17485:17485] [20230105:152355:1672928635:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil)) [EC_DRHOOK:atlas:1:1:17485:17485] [20230105:152355:1672928635:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil)) [EC_DRHOOK:atlas:1:1:17485:17485] [20230105:152355:1672928635:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> 15:24:20 STEP 2448 H=2448:00 +CPU= 23.300 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002448 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002448 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002448 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMGGhq0f+002424 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMSHhq0f+002424 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMUAhq0f+002424 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMGGhq0f+002436 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMSHhq0f+002436 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMUAhq0f+002436 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0770_1994050100_123_963_12180414_0_r601889875_101.zip Uploading the intermediate file: upload_file_101.zip 15:24:33 STEP 2449 H=2449:00 +CPU= 12.764 15:24:47 STEP 2450 H=2450:00 +CPU= 13.780 15:25:08 STEP 2451 H=2451:00 +CPU= 20.668 15:25:22 STEP 2452 H=2452:00 +CPU= 14.416 15:25:35 STEP 2453 H=2453:00 +CPU= 12.856 15:25:55 STEP 2454 H=2454:00 +CPU= 20.388 15:26:09 STEP 2455 H=2455:00 +CPU= 13.592 15:26:23 STEP 2456 H=2456:00 +CPU= 14.080 15:26:43 STEP 2457 H=2457:00 +CPU= 20.240 15:26:57 STEP 2458 H=2458:00 +CPU= 13.280 15:27:09 STEP 2459 H=2459:00 +CPU= 12.880 15:27:32 STEP 2460 H=2460:00 +CPU= 22.660 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002460 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002460 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002460 15:27:46 STEP 2461 H=2461:00 +CPU= 13.332 15:27:59 STEP 2462 H=2462:00 +CPU= 13.212 15:28:19 STEP 2463 H=2463:00 +CPU= 20.068 15:28:32 STEP 2464 H=2464:00 +CPU= 13.412 15:28:46 STEP 2465 H=2465:00 +CPU= 13.856 15:29:07 STEP 2466 H=2466:00 +CPU= 20.488 15:29:20 STEP 2467 H=2467:00 +CPU= 13.284 15:29:33 STEP 2468 H=2468:00 +CPU= 13.424 15:29:54 STEP 2469 H=2469:00 +CPU= 20.908 15:30:09 STEP 2470 H=2470:00 +CPU= 14.776 15:30:23 STEP 2471 H=2471:00 +CPU= 14.448 15:30:47 STEP 2472 H=2472:00 +CPU= 23.388 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002472 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002472 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002472 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMGGhq0f+002448 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMSHhq0f+002448 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMUAhq0f+002448 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMGGhq0f+002460 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMSHhq0f+002460 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMUAhq0f+002460 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0770_1994050100_123_963_12180414_0_r601889875_102.zip Uploading the intermediate file: upload_file_102.zip 15:31:00 STEP 2473 H=2473:00 +CPU= 13.420 15:31:13 STEP 2474 H=2474:00 +CPU= 13.276 15:31:34 STEP 2475 H=2475:00 +CPU= 20.388 15:31:47 STEP 2476 H=2476:00 +CPU= 13.224 15:32:00 STEP 2477 H=2477:00 +CPU= 12.876 15:32:21 STEP 2478 H=2478:00 +CPU= 20.896 15:32:34 STEP 2479 H=2479:00 +CPU= 12.900 15:32:48 STEP 2480 H=2480:00 +CPU= 14.000 15:33:08 STEP 2481 H=2481:00 +CPU= 20.264 15:33:22 STEP 2482 H=2482:00 +CPU= 13.832 15:33:35 STEP 2483 H=2483:00 +CPU= 12.904 15:33:57 STEP 2484 H=2484:00 +CPU= 22.328 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002484 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002484 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002484 15:34:11 STEP 2485 H=2485:00 +CPU= 13.400 15:34:24 STEP 2486 H=2486:00 +CPU= 13.228 15:34:45 STEP 2487 H=2487:00 +CPU= 20.548 15:34:58 STEP 2488 H=2488:00 +CPU= 13.236 15:35:11 STEP 2489 H=2489:00 +CPU= 13.384 15:35:32 STEP 2490 H=2490:00 +CPU= 20.840 15:35:46 STEP 2491 H=2491:00 +CPU= 13.412 15:35:59 STEP 2492 H=2492:00 +CPU= 13.300 15:36:19 STEP 2493 H=2493:00 +CPU= 20.104 15:36:33 STEP 2494 H=2494:00 +CPU= 13.596 15:36:46 STEP 2495 H=2495:00 +CPU= 13.224 15:37:11 STEP 2496 H=2496:00 +CPU= 24.560 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002496 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002496 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002496 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMGGhq0f+002472 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMSHhq0f+002472 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMUAhq0f+002472 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMGGhq0f+002484 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMSHhq0f+002484 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMUAhq0f+002484 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0770_1994050100_123_963_12180414_0_r601889875_103.zip Uploading the intermediate file: upload_file_103.zip 15:37:24 STEP 2497 H=2497:00 +CPU= 12.860 15:37:38 STEP 2498 H=2498:00 +CPU= 13.688 15:37:58 STEP 2499 H=2499:00 +CPU= 20.040 15:38:11 STEP 2500 H=2500:00 +CPU= 13.328 15:38:25 STEP 2501 H=2501:00 +CPU= 13.736 15:38:46 STEP 2502 H=2502:00 +CPU= 21.088 15:38:59 STEP 2503 H=2503:00 +CPU= 13.128 15:39:13 STEP 2504 H=2504:00 +CPU= 13.312 15:39:33 STEP 2505 H=2505:00 +CPU= 20.164 15:39:47 STEP 2506 H=2506:00 +CPU= 13.792 15:40:00 STEP 2507 H=2507:00 +CPU= 13.448 15:40:23 STEP 2508 H=2508:00 +CPU= 22.516 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002508 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002508 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002508 15:40:36 STEP 2509 H=2509:00 +CPU= 12.972 15:40:49 STEP 2510 H=2510:00 +CPU= 13.572 15:41:10 STEP 2511 H=2511:00 +CPU= 20.576 15:41:23 STEP 2512 H=2512:00 +CPU= 13.284 15:41:36 STEP 2513 H=2513:00 +CPU= 12.856 15:41:57 STEP 2514 H=2514:00 +CPU= 20.720 15:42:10 STEP 2515 H=2515:00 +CPU= 13.416 15:42:24 STEP 2516 H=2516:00 +CPU= 13.768 15:42:44 STEP 2517 H=2517:00 +CPU= 20.064 15:42:57 STEP 2518 H=2518:00 +CPU= 13.272 15:43:11 STEP 2519 H=2519:00 +CPU= 13.692 15:43:35 STEP 2520 H=2520:00 +CPU= 24.048 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002520 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002520 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002520 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMGGhq0f+002496 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMSHhq0f+002496 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMUAhq0f+002496 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMGGhq0f+002508 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMSHhq0f+002508 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMUAhq0f+002508 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0770_1994050100_123_963_12180414_0_r601889875_104.zip Uploading the intermediate file: upload_file_104.zip 15:43:48 STEP 2521 H=2521:00 +CPU= 12.828 15:44:01 STEP 2522 H=2522:00 +CPU= 13.228 15:44:22 STEP 2523 H=2523:00 +CPU= 20.360 15:44:35 STEP 2524 H=2524:00 +CPU= 13.460 15:44:49 STEP 2525 H=2525:00 +CPU= 13.488 15:45:09 STEP 2526 H=2526:00 +CPU= 20.752 15:45:23 STEP 2527 H=2527:00 +CPU= 13.316 15:45:37 STEP 2528 H=2528:00 +CPU= 13.800 15:45:57 STEP 2529 H=2529:00 +CPU= 20.768 15:46:11 STEP 2530 H=2530:00 +CPU= 13.712 15:46:24 STEP 2531 H=2531:00 +CPU= 12.844 15:46:46 STEP 2532 H=2532:00 +CPU= 22.484 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002532 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002532 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002532 15:46:59 STEP 2533 H=2533:00 +CPU= 12.880 15:47:13 STEP 2534 H=2534:00 +CPU= 13.304 15:47:33 STEP 2535 H=2535:00 +CPU= 20.312 15:47:46 STEP 2536 H=2536:00 +CPU= 13.216 15:48:00 STEP 2537 H=2537:00 +CPU= 13.392 15:48:20 STEP 2538 H=2538:00 +CPU= 20.416 15:48:34 STEP 2539 H=2539:00 +CPU= 13.464 15:48:47 STEP 2540 H=2540:00 +CPU= 13.184 15:49:07 STEP 2541 H=2541:00 +CPU= 20.240 15:49:20 STEP 2542 H=2542:00 +CPU= 13.464 15:49:34 STEP 2543 H=2543:00 +CPU= 13.292 15:49:58 STEP 2544 H=2544:00 +CPU= 24.492 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002544 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002544 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002544 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMGGhq0f+002520 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMSHhq0f+002520 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMUAhq0f+002520 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMGGhq0f+002532 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMSHhq0f+002532 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMUAhq0f+002532 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0770_1994050100_123_963_12180414_0_r601889875_105.zip Uploading the intermediate file: upload_file_105.zip 15:50:11 STEP 2545 H=2545:00 +CPU= 13.136 15:50:26 STEP 2546 H=2546:00 +CPU= 14.188 15:50:46 STEP 2547 H=2547:00 +CPU= 20.288 15:51:00 STEP 2548 H=2548:00 +CPU= 13.984 15:51:13 STEP 2549 H=2549:00 +CPU= 13.116 15:51:34 STEP 2550 H=2550:00 +CPU= 20.780 15:51:47 STEP 2551 H=2551:00 +CPU= 12.852 15:52:00 STEP 2552 H=2552:00 +CPU= 13.208 15:52:20 STEP 2553 H=2553:00 +CPU= 20.396 15:52:34 STEP 2554 H=2554:00 +CPU= 13.220 15:52:47 STEP 2555 H=2555:00 +CPU= 13.400 15:53:09 STEP 2556 H=2556:00 +CPU= 22.024 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002556 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002556 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002556 15:53:22 STEP 2557 H=2557:00 +CPU= 13.292 15:53:36 STEP 2558 H=2558:00 +CPU= 13.400 15:53:56 STEP 2559 H=2559:00 +CPU= 20.672 15:54:10 STEP 2560 H=2560:00 +CPU= 13.568 15:54:23 STEP 2561 H=2561:00 +CPU= 12.872 15:54:43 STEP 2562 H=2562:00 +CPU= 20.704 15:54:56 STEP 2563 H=2563:00 +CPU= 12.884 15:55:10 STEP 2564 H=2564:00 +CPU= 13.380 15:55:32 STEP 2565 H=2565:00 +CPU= 21.768 15:55:45 STEP 2566 H=2566:00 +CPU= 13.716 15:55:59 STEP 2567 H=2567:00 +CPU= 13.392 15:56:22 STEP 2568 H=2568:00 +CPU= 23.512 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002568 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002568 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002568 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMGGhq0f+002544 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMSHhq0f+002544 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMUAhq0f+002544 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMGGhq0f+002556 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMSHhq0f+002556 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMUAhq0f+002556 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0770_1994050100_123_963_12180414_0_r601889875_106.zip Uploading the intermediate file: upload_file_106.zip 15:56:35 STEP 2569 H=2569:00 +CPU= 13.320 15:56:49 STEP 2570 H=2570:00 +CPU= 13.372 15:57:09 STEP 2571 H=2571:00 +CPU= 20.432 15:57:22 STEP 2572 H=2572:00 +CPU= 13.196 15:57:35 STEP 2573 H=2573:00 +CPU= 12.876 15:57:56 STEP 2574 H=2574:00 +CPU= 20.788 15:58:10 STEP 2575 H=2575:00 +CPU= 13.392 15:58:23 STEP 2576 H=2576:00 +CPU= 13.316 15:58:43 STEP 2577 H=2577:00 +CPU= 20.208 15:58:56 STEP 2578 H=2578:00 +CPU= 13.452 15:59:10 STEP 2579 H=2579:00 +CPU= 13.284 15:59:32 STEP 2580 H=2580:00 +CPU= 22.560 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002580 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002580 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002580 15:59:45 STEP 2581 H=2581:00 +CPU= 12.908 15:59:59 STEP 2582 H=2582:00 +CPU= 13.348 16:00:20 STEP 2583 H=2583:00 +CPU= 21.008 16:00:33 STEP 2584 H=2584:00 +CPU= 13.744 16:00:46 STEP 2585 H=2585:00 +CPU= 12.888 16:01:07 STEP 2586 H=2586:00 +CPU= 20.436 16:01:20 STEP 2587 H=2587:00 +CPU= 13.200 16:01:33 STEP 2588 H=2588:00 +CPU= 13.436 16:01:54 STEP 2589 H=2589:00 +CPU= 20.868 16:02:07 STEP 2590 H=2590:00 +CPU= 13.284 16:02:21 STEP 2591 H=2591:00 +CPU= 13.272 16:02:45 STEP 2592 H=2592:00 +CPU= 24.124 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002592 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002592 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002592 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMGGhq0f+002568 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMSHhq0f+002568 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMUAhq0f+002568 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMGGhq0f+002580 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMSHhq0f+002580 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMUAhq0f+002580 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0770_1994050100_123_963_12180414_0_r601889875_107.zip Uploading the intermediate file: upload_file_107.zip 16:02:58 STEP 2593 H=2593:00 +CPU= 12.932 16:03:12 STEP 2594 H=2594:00 +CPU= 13.812 16:03:32 STEP 2595 H=2595:00 +CPU= 20.188 16:03:46 STEP 2596 H=2596:00 +CPU= 13.684 16:03:59 STEP 2597 H=2597:00 +CPU= 12.880 16:04:19 STEP 2598 H=2598:00 +CPU= 20.852 16:04:32 STEP 2599 H=2599:00 +CPU= 12.872 16:04:46 STEP 2600 H=2600:00 +CPU= 13.316 16:05:07 STEP 2601 H=2601:00 +CPU= 20.852 16:05:20 STEP 2602 H=2602:00 +CPU= 13.576 16:05:34 STEP 2603 H=2603:00 +CPU= 13.696 16:05:56 STEP 2604 H=2604:00 +CPU= 22.172 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002604 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002604 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002604 16:06:09 STEP 2605 H=2605:00 +CPU= 13.420 16:06:23 STEP 2606 H=2606:00 +CPU= 13.248 16:06:43 STEP 2607 H=2607:00 +CPU= 20.184 16:06:56 STEP 2608 H=2608:00 +CPU= 13.652 16:07:09 STEP 2609 H=2609:00 +CPU= 12.916 16:07:30 STEP 2610 H=2610:00 +CPU= 20.900 16:07:43 STEP 2611 H=2611:00 +CPU= 12.888 16:07:57 STEP 2612 H=2612:00 +CPU= 13.904 16:08:18 STEP 2613 H=2613:00 +CPU= 20.336 16:08:31 STEP 2614 H=2614:00 +CPU= 13.732 16:08:45 STEP 2615 H=2615:00 +CPU= 13.252 16:09:09 STEP 2616 H=2616:00 +CPU= 24.060 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002616 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002616 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002616 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMGGhq0f+002592 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMSHhq0f+002592 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMUAhq0f+002592 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMGGhq0f+002604 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMSHhq0f+002604 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMUAhq0f+002604 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0770_1994050100_123_963_12180414_0_r601889875_108.zip Uploading the intermediate file: upload_file_108.zip 16:09:22 STEP 2617 H=2617:00 +CPU= 12.988 16:09:35 STEP 2618 H=2618:00 +CPU= 13.268 16:09:56 STEP 2619 H=2619:00 +CPU= 20.660 16:10:09 STEP 2620 H=2620:00 +CPU= 13.372 16:10:23 STEP 2621 H=2621:00 +CPU= 13.576 16:10:43 STEP 2622 H=2622:00 +CPU= 20.416 16:10:56 STEP 2623 H=2623:00 +CPU= 12.880 16:11:10 STEP 2624 H=2624:00 +CPU= 14.076 16:11:31 STEP 2625 H=2625:00 +CPU= 20.824 16:11:45 STEP 2626 H=2626:00 +CPU= 13.896 16:11:58 STEP 2627 H=2627:00 +CPU= 13.172 16:12:21 STEP 2628 H=2628:00 +CPU= 23.528 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002628 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002628 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002628 16:12:35 STEP 2629 H=2629:00 +CPU= 13.204 16:12:49 STEP 2630 H=2630:00 +CPU= 14.104 16:13:09 STEP 2631 H=2631:00 +CPU= 20.436 16:13:23 STEP 2632 H=2632:00 +CPU= 13.832 16:13:37 STEP 2633 H=2633:00 +CPU= 13.292 16:13:58 STEP 2634 H=2634:00 +CPU= 21.016 16:14:11 STEP 2635 H=2635:00 +CPU= 13.340 16:14:24 STEP 2636 H=2636:00 +CPU= 13.360 16:14:45 STEP 2637 H=2637:00 +CPU= 20.464 16:14:58 STEP 2638 H=2638:00 +CPU= 13.524 16:15:12 STEP 2639 H=2639:00 +CPU= 13.704 16:15:37 STEP 2640 H=2640:00 +CPU= 24.752 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002640 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002640 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002640 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMGGhq0f+002616 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMSHhq0f+002616 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMUAhq0f+002616 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMGGhq0f+002628 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMSHhq0f+002628 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMUAhq0f+002628 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0770_1994050100_123_963_12180414_0_r601889875_109.zip Uploading the intermediate file: upload_file_109.zip 16:15:51 STEP 2641 H=2641:00 +CPU= 13.300 16:16:04 STEP 2642 H=2642:00 +CPU= 13.392 16:16:25 STEP 2643 H=2643:00 +CPU= 20.548 16:16:39 STEP 2644 H=2644:00 +CPU= 14.204 16:16:52 STEP 2645 H=2645:00 +CPU= 12.976 16:17:13 STEP 2646 H=2646:00 +CPU= 21.036 16:17:26 STEP 2647 H=2647:00 +CPU= 13.164 16:17:39 STEP 2648 H=2648:00 +CPU= 13.520 16:18:00 STEP 2649 H=2649:00 +CPU= 20.500 16:18:14 STEP 2650 H=2650:00 +CPU= 13.808 16:18:27 STEP 2651 H=2651:00 +CPU= 13.468 16:18:50 STEP 2652 H=2652:00 +CPU= 22.544 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002652 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002652 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002652 16:19:04 STEP 2653 H=2653:00 +CPU= 13.720 16:19:17 STEP 2654 H=2654:00 +CPU= 13.520 16:19:38 STEP 2655 H=2655:00 +CPU= 20.648 16:19:52 STEP 2656 H=2656:00 +CPU= 13.880 16:20:05 STEP 2657 H=2657:00 +CPU= 13.420 16:20:27 STEP 2658 H=2658:00 +CPU= 21.580 16:20:40 STEP 2659 H=2659:00 +CPU= 13.288 16:20:54 STEP 2660 H=2660:00 +CPU= 13.688 16:21:14 STEP 2661 H=2661:00 +CPU= 20.400 16:21:28 STEP 2662 H=2662:00 +CPU= 13.948 16:21:42 STEP 2663 H=2663:00 +CPU= 13.824 16:22:06 STEP 2664 H=2664:00 +CPU= 24.432 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002664 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002664 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002664 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMGGhq0f+002640 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMSHhq0f+002640 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMUAhq0f+002640 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMGGhq0f+002652 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMSHhq0f+002652 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMUAhq0f+002652 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0770_1994050100_123_963_12180414_0_r601889875_110.zip Uploading the intermediate file: upload_file_110.zip 16:22:20 STEP 2665 H=2665:00 +CPU= 13.656 Uploading trickle at timestep: 9590400 16:22:34 STEP 2666 H=2666:00 +CPU= 13.632 16:22:55 STEP 2667 H=2667:00 +CPU= 20.916 16:23:08 STEP 2668 H=2668:00 +CPU= 13.392 16:23:21 STEP 2669 H=2669:00 +CPU= 13.348 16:23:42 STEP 2670 H=2670:00 +CPU= 20.408 16:23:55 STEP 2671 H=2671:00 +CPU= 13.092 16:24:09 STEP 2672 H=2672:00 +CPU= 14.160 Quit request received from BOINC client, ending the child process (argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu (argv1) start_date: 1994050100 (argv2) exptid: hq0f (argv3) unique_member_id: 0770 (argv4) batchid: 963 (argv5) wuid: 12180414 (argv6) fclen: 123 (argv7) app_name: oifs_43r3_ps (argv8) nthreads: 1 Working directory is: /var/lib/boinc-client/slots/0 Project directory is: /var/lib/boinc-client/projects/climateprediction.net/ app name: oifs_43r3_ps version: 1.05 Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414 ..mkdir for temp folder for results failed Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip Unzipping the app zip file: /var/lib/boinc-client/slots/0/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip Copying the namelist files from: ../../projects/climateprediction.net/jf_dc52beb3e379bbfe986cae914f1070aa to: /var/lib/boinc-client/slots/0/oifs_43r3_ps_0770_1994050100_123_963_12180414.zip Unzipping the namelist zip file: /var/lib/boinc-client/slots/0/oifs_43r3_ps_0770_1994050100_123_963_12180414.zip ic_ancil_file: ic_ancil_12180414 ifsdata_file: ifsdata_12180414 climate_data_file: clim_data_12180414 horiz_resolution: 159 vert_resolution: 60 grid_type: l_2 upload_interval: 24 utstep: 3600 nfrres: restart dump frequency (steps) 24 Copying IC ancils from: ../../projects/climateprediction.net/jf_81b059026d2f0374e3ea8af0fbf15b56 to: /var/lib/boinc-client/slots/0/ic_ancil_12180414.zip Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/0/ic_ancil_12180414.zip ..mkdir for ifsdata folder failed Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_fba7b6994d911e13a6ee24e493f481f4 to: /var/lib/boinc-client/slots/0/ifsdata/ifsdata_12180414.zip Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/0/ifsdata/ifsdata_12180414.zip ..mkdir for the climate data folder failed Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/0/159l_2/clim_data_12180414.zip Unzipping the climate data zip file: /var/lib/boinc-client/slots/0/159l_2/clim_data_12180414.zip Checking for progress XML file: /var/lib/boinc-client/slots/0/progress_file_12180414.xml Opened progress file ok : /var/lib/boinc-client/slots/0/progress_file_12180414.xml -- Model is restarting -- Adjusting last_iter, 2672, to previous model restart step. Creating progress file: /var/lib/boinc-client/slots/0/progress_file_12180414.xml last_cpu_time: 42818 upload_file_number: 111 last_iter: 2663 last_upload: 9590400 model_completed: 0 total_length_of_simulation: 10627200 result_base_name: oifs_43r3_ps_0770_1994050100_123_963_12180414_0_r601889875 The child process has been launched with process id: 910 Executing the command: /var/lib/boinc-client/slots/0/oifs_43r3_model.exe [EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1 [EC_DRHOOK:atlas:1:1:910:910] [20230105:162515:1672932315:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0 [EC_DRHOOK:atlas:1:1:910:910] [20230105:162515:1672932315:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1 [EC_DRHOOK:atlas:1:1:910:910] [20230105:162515:1672932315:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0) [EC_DRHOOK:atlas:1:1:910:910] [20230105:162515:1672932315:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1 [EC_DRHOOK:atlas:1:1:910:910] [20230105:162515:1672932315:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000 [EC_DRHOOK:atlas:1:1:910:910] [20230105:162515:1672932315:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647) [EC_DRHOOK:atlas:1:1:910:910] [20230105:162515:1672932315:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16 [EC_DRHOOK:atlas:1:1:910:910] [20230105:162515:1672932315:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0 [EC_DRHOOK:atlas:1:1:910:910] [20230105:162515:1672932315:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500 [EC_DRHOOK:atlas:1:1:910:910] [20230105:162515:1672932315:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1 [EC_DRHOOK:atlas:1:1:910:910] [20230105:162515:1672932315:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1 [EC_DRHOOK:atlas:1:1:910:910] [20230105:162515:1672932315:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1 [EC_DRHOOK:atlas:1:1:910:910] [20230105:162515:1672932315:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1 [EC_DRHOOK:atlas:1:1:910:910] [20230105:162515:1672932315:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef> [EC_DRHOOK:atlas:1:1:910:910] [20230105:162515:1672932315:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef> [EC_DRHOOK:atlas:1:1:910:910] [20230105:162515:1672932315:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:atlas:1:1:910:910] [20230105:162515:1672932315:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil)) [EC_DRHOOK:atlas:1:1:910:910] [20230105:162515:1672932315:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:atlas:1:1:910:910] [20230105:162515:1672932315:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil)) [EC_DRHOOK:atlas:1:1:910:910] [20230105:162515:1672932315:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1 [EC_DRHOOK:atlas:1:1:910:910] [20230105:162515:1672932315:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:atlas:1:1:910:910] [20230105:162515:1672932315:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:atlas:1:1:910:910] [20230105:162515:1672932315:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil)) [EC_DRHOOK:atlas:1:1:910:910] [20230105:162515:1672932315:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:atlas:1:1:910:910] [20230105:162515:1672932315:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:atlas:1:1:910:910] [20230105:162515:1672932315:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:atlas:1:1:910:910] [20230105:162515:1672932315:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil)) [EC_DRHOOK:atlas:1:1:910:910] [20230105:162515:1672932315:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil)) [EC_DRHOOK:atlas:1:1:910:910] [20230105:162515:1672932315:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil)) [EC_DRHOOK:atlas:1:1:910:910] [20230105:162515:1672932315:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> 16:25:40 STEP 2664 H=2664:00 +CPU= 23.784 16:25:54 STEP 2665 H=2665:00 +CPU= 13.588 16:26:08 STEP 2666 H=2666:00 +CPU= 13.552 16:26:28 STEP 2667 H=2667:00 +CPU= 19.968 16:26:42 STEP 2668 H=2668:00 +CPU= 14.012 16:26:55 STEP 2669 H=2669:00 +CPU= 12.984 16:27:15 STEP 2670 H=2670:00 +CPU= 20.832 16:27:29 STEP 2671 H=2671:00 +CPU= 13.288 16:27:42 STEP 2672 H=2672:00 +CPU= 13.192 16:28:02 STEP 2673 H=2673:00 +CPU= 20.376 16:28:15 STEP 2674 H=2674:00 +CPU= 13.248 16:28:29 STEP 2675 H=2675:00 +CPU= 13.036 16:28:51 STEP 2676 H=2676:00 +CPU= 22.700 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002676 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002676 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002676 16:29:04 STEP 2677 H=2677:00 +CPU= 13.268 16:29:18 STEP 2678 H=2678:00 +CPU= 13.592 16:29:38 STEP 2679 H=2679:00 +CPU= 19.992 16:29:52 STEP 2680 H=2680:00 +CPU= 13.744 16:30:05 STEP 2681 H=2681:00 +CPU= 13.352 16:30:26 STEP 2682 H=2682:00 +CPU= 21.268 16:30:40 STEP 2683 H=2683:00 +CPU= 13.224 16:30:53 STEP 2684 H=2684:00 +CPU= 13.316 16:31:15 STEP 2685 H=2685:00 +CPU= 21.288 16:31:29 STEP 2686 H=2686:00 +CPU= 14.204 Suspend request received from the BOINC client, suspending the child process Resuming the child process 16:31:56 STEP 2687 H=2687:00 +CPU= 16.476 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 16:32:48 STEP 2688 H=2688:00 +CPU= 28.176 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGhq0f+002688 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHhq0f+002688 Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAhq0f+002688 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMGGhq0f+002664 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMSHhq0f+002664 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMUAhq0f+002664 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMGGhq0f+002676 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMSHhq0f+002676 Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12180414/ICMUAhq0f+002676 Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0770_1994050100_123_963_12180414_0_r601889875_111.zip Uploading the intermediate file: upload_file_111.zip 16:33:03 STEP 2689 H=2689:00 +CPU= 15.624 16:33:21 STEP 2690 H=2690:00 +CPU= 17.844 16:33:52 STEP 2691 H=2691:00 +CPU= 29.964 16:34:07 STEP 2692 H=2692:00 +CPU= 15.072 16:34:20 STEP 2693 H=2693:00 +CPU= 13.120 16:34:41 STEP 2694 H=2694:00 +CPU= 21.164 16:34:55 STEP 2695 H=2695:00 +CPU= 14.364 16:35:11 STEP 2696 H=2696:00 +CPU= 14.416 16:35:31 STEP 2697 H=2697:00 +CPU= 20.488 16:35:45 STEP 2698 H=2698:00 +CPU= 13.248 16:35:58 STEP 2699 H=2699:00 +CPU= 13.392 Abort request received from BOINC client, ending the child process </stderr_txt> ]]> |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
09 May 2023 16:09:08 | 1414915 | 22265375 | oifs_43r3_ps_0770_1994050100_123_963_12180414_0 | 9,590,400 | 42,697 | 0.0045 |
09 May 2023 16:08:51 | 1414915 | 22265375 | oifs_43r3_ps_0770_1994050100_123_963_12180414_0 | 5,702,400 | 24,761 | 0.0043 |
09 May 2023 16:08:47 | 1414915 | 22265375 | oifs_43r3_ps_0770_1994050100_123_963_12180414_0 | 4,838,400 | 20,991 | 0.0043 |
09 May 2023 16:08:44 | 1414915 | 22265375 | oifs_43r3_ps_0770_1994050100_123_963_12180414_0 | 3,974,400 | 17,222 | 0.0043 |
09 May 2023 16:08:40 | 1414915 | 22265375 | oifs_43r3_ps_0770_1994050100_123_963_12180414_0 | 3,110,400 | 13,452 | 0.0043 |
09 May 2023 16:08:37 | 1414915 | 22265375 | oifs_43r3_ps_0770_1994050100_123_963_12180414_0 | 2,246,400 | 9,693 | 0.0043 |
09 May 2023 16:08:31 | 1414915 | 22265375 | oifs_43r3_ps_0770_1994050100_123_963_12180414_0 | 864,000 | 3,597 | 0.0042 |
©2024 climateprediction.net