climateprediction.net home page
Task 22306701

Task 22306701

Name oifs_43r3_ps_0705_1983050100_123_952_12169349_2
Workunit 12169349
Created 8 Feb 2023, 7:31:37 UTC
Sent 8 Feb 2023, 7:32:55 UTC
Report deadline 9 Apr 2023, 7:32:55 UTC
Received 9 Feb 2023, 10:39:43 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1504164
Run time 23 hours 16 min 18 sec
CPU time 19 hours 58 min
Validate state Valid
Credit 14,873.04
Device peak FLOPS 1.00 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,062.00 MB
Peak swap size 4,978.05 MB
Peak disk usage 2,476.85 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<stderr_txt>
to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002244
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002244
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002244
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_0705_1983050100_123_952_12169349_2_r1121249860_93.zip
Uploading the intermediate file: upload_file_93.zip
  04:12:56 STEP 2257 H=2257:00 +CPU= 17.996
  04:13:16 STEP 2258 H=2258:00 +CPU= 18.812
  04:13:45 STEP 2259 H=2259:00 +CPU= 28.012
  04:14:05 STEP 2260 H=2260:00 +CPU= 19.340
  04:14:24 STEP 2261 H=2261:00 +CPU= 18.376
  04:14:54 STEP 2262 H=2262:00 +CPU= 28.778
  04:15:15 STEP 2263 H=2263:00 +CPU= 18.697
  04:15:33 STEP 2264 H=2264:00 +CPU= 18.303
  04:16:03 STEP 2265 H=2265:00 +CPU= 28.669
  04:16:24 STEP 2266 H=2266:00 +CPU= 18.533
  04:16:43 STEP 2267 H=2267:00 +CPU= 18.371
  04:17:18 STEP 2268 H=2268:00 +CPU= 32.518
Moving to projects directory: /data/slots/3/ICMGGhq0f+002268
Moving to projects directory: /data/slots/3/ICMSHhq0f+002268
Moving to projects directory: /data/slots/3/ICMUAhq0f+002268
  04:17:38 STEP 2269 H=2269:00 +CPU= 18.947
  04:17:58 STEP 2270 H=2270:00 +CPU= 19.488
  04:18:29 STEP 2271 H=2271:00 +CPU= 28.520
  04:18:58 STEP 2272 H=2272:00 +CPU= 18.891
  04:19:21 STEP 2273 H=2273:00 +CPU= 18.554
  04:19:53 STEP 2274 H=2274:00 +CPU= 28.796
  04:20:12 STEP 2275 H=2275:00 +CPU= 17.930
  04:20:33 STEP 2276 H=2276:00 +CPU= 19.675
  04:21:05 STEP 2277 H=2277:00 +CPU= 29.061
  04:21:24 STEP 2278 H=2278:00 +CPU= 18.739
  04:21:44 STEP 2279 H=2279:00 +CPU= 18.589
  04:22:21 STEP 2280 H=2280:00 +CPU= 34.323
Moving to projects directory: /data/slots/3/ICMGGhq0f+002280
Moving to projects directory: /data/slots/3/ICMSHhq0f+002280
Moving to projects directory: /data/slots/3/ICMUAhq0f+002280
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002256
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002256
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002256
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002268
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002268
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002268
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_0705_1983050100_123_952_12169349_2_r1121249860_94.zip
Uploading the intermediate file: upload_file_94.zip
  04:22:41 STEP 2281 H=2281:00 +CPU= 18.120
  04:23:01 STEP 2282 H=2282:00 +CPU= 18.451
  04:23:31 STEP 2283 H=2283:00 +CPU= 28.384
  04:23:50 STEP 2284 H=2284:00 +CPU= 18.511
  04:24:11 STEP 2285 H=2285:00 +CPU= 18.619
  04:24:41 STEP 2286 H=2286:00 +CPU= 28.753
  04:25:00 STEP 2287 H=2287:00 +CPU= 17.925
  04:25:20 STEP 2288 H=2288:00 +CPU= 19.331
  04:25:49 STEP 2289 H=2289:00 +CPU= 28.642
  04:26:09 STEP 2290 H=2290:00 +CPU= 18.952
  04:26:28 STEP 2291 H=2291:00 +CPU= 17.975
  04:26:59 STEP 2292 H=2292:00 +CPU= 30.962
Moving to projects directory: /data/slots/3/ICMGGhq0f+002292
Moving to projects directory: /data/slots/3/ICMSHhq0f+002292
Moving to projects directory: /data/slots/3/ICMUAhq0f+002292
  04:27:19 STEP 2293 H=2293:00 +CPU= 18.971
  04:27:39 STEP 2294 H=2294:00 +CPU= 18.678
  04:28:08 STEP 2295 H=2295:00 +CPU= 28.653
  04:28:27 STEP 2296 H=2296:00 +CPU= 18.344
  04:28:46 STEP 2297 H=2297:00 +CPU= 18.481
  04:29:16 STEP 2298 H=2298:00 +CPU= 29.402
  04:29:35 STEP 2299 H=2299:00 +CPU= 18.049
  04:29:53 STEP 2300 H=2300:00 +CPU= 18.253
  04:30:41 STEP 2301 H=2301:00 +CPU= 29.317
  04:31:17 STEP 2302 H=2302:00 +CPU= 19.805
  04:31:55 STEP 2303 H=2303:00 +CPU= 19.997
  04:33:08 STEP 2304 H=2304:00 +CPU= 36.183
Moving to projects directory: /data/slots/3/ICMGGhq0f+002304
Moving to projects directory: /data/slots/3/ICMSHhq0f+002304
Moving to projects directory: /data/slots/3/ICMUAhq0f+002304
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002280
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002280
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002280
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002292
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002292
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002292
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_0705_1983050100_123_952_12169349_2_r1121249860_95.zip
Uploading the intermediate file: upload_file_95.zip
Uploading trickle at timestep: 8294400
  04:33:44 STEP 2305 H=2305:00 +CPU= 19.251
  04:34:21 STEP 2306 H=2306:00 +CPU= 19.783
  04:34:53 STEP 2307 H=2307:00 +CPU= 28.776
  04:35:12 STEP 2308 H=2308:00 +CPU= 18.558
  04:35:32 STEP 2309 H=2309:00 +CPU= 18.462
  04:36:01 STEP 2310 H=2310:00 +CPU= 28.656
  04:36:20 STEP 2311 H=2311:00 +CPU= 17.962
  04:36:40 STEP 2312 H=2312:00 +CPU= 19.414
  04:37:10 STEP 2313 H=2313:00 +CPU= 29.294
  04:37:28 STEP 2314 H=2314:00 +CPU= 18.388
  04:37:48 STEP 2315 H=2315:00 +CPU= 18.241
  04:38:20 STEP 2316 H=2316:00 +CPU= 31.745
Moving to projects directory: /data/slots/3/ICMGGhq0f+002316
Moving to projects directory: /data/slots/3/ICMSHhq0f+002316
Moving to projects directory: /data/slots/3/ICMUAhq0f+002316
  04:38:39 STEP 2317 H=2317:00 +CPU= 17.891
  04:38:59 STEP 2318 H=2318:00 +CPU= 19.338
  04:39:28 STEP 2319 H=2319:00 +CPU= 29.177
  04:39:49 STEP 2320 H=2320:00 +CPU= 19.433
  04:40:08 STEP 2321 H=2321:00 +CPU= 18.266
  04:40:37 STEP 2322 H=2322:00 +CPU= 28.932
  04:40:58 STEP 2323 H=2323:00 +CPU= 19.741
  04:41:17 STEP 2324 H=2324:00 +CPU= 18.741
  04:41:47 STEP 2325 H=2325:00 +CPU= 29.611
  04:42:08 STEP 2326 H=2326:00 +CPU= 19.886
  04:42:27 STEP 2327 H=2327:00 +CPU= 18.682
  04:43:03 STEP 2328 H=2328:00 +CPU= 34.266
Moving to projects directory: /data/slots/3/ICMGGhq0f+002328
Moving to projects directory: /data/slots/3/ICMSHhq0f+002328
Moving to projects directory: /data/slots/3/ICMUAhq0f+002328
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002304
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002304
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002304
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002316
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002316
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002316
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_0705_1983050100_123_952_12169349_2_r1121249860_96.zip
Uploading the intermediate file: upload_file_96.zip
  04:43:23 STEP 2329 H=2329:00 +CPU= 18.613
  04:43:42 STEP 2330 H=2330:00 +CPU= 18.372
  04:44:12 STEP 2331 H=2331:00 +CPU= 28.952
  04:44:31 STEP 2332 H=2332:00 +CPU= 18.360
  04:44:52 STEP 2333 H=2333:00 +CPU= 18.972
  04:45:22 STEP 2334 H=2334:00 +CPU= 29.047
  04:45:42 STEP 2335 H=2335:00 +CPU= 20.034
  04:46:03 STEP 2336 H=2336:00 +CPU= 19.013
  04:46:32 STEP 2337 H=2337:00 +CPU= 28.478
  04:46:53 STEP 2338 H=2338:00 +CPU= 19.093
  04:47:11 STEP 2339 H=2339:00 +CPU= 18.098
  04:47:43 STEP 2340 H=2340:00 +CPU= 30.868
Moving to projects directory: /data/slots/3/ICMGGhq0f+002340
Moving to projects directory: /data/slots/3/ICMSHhq0f+002340
Moving to projects directory: /data/slots/3/ICMUAhq0f+002340
  04:48:03 STEP 2341 H=2341:00 +CPU= 18.654
  04:48:22 STEP 2342 H=2342:00 +CPU= 18.456
  04:48:52 STEP 2343 H=2343:00 +CPU= 28.490
  04:49:12 STEP 2344 H=2344:00 +CPU= 19.211
  04:49:30 STEP 2345 H=2345:00 +CPU= 18.018
  04:50:00 STEP 2346 H=2346:00 +CPU= 29.027
  04:50:19 STEP 2347 H=2347:00 +CPU= 18.592
  04:50:38 STEP 2348 H=2348:00 +CPU= 18.422
  04:51:09 STEP 2349 H=2349:00 +CPU= 29.070
  04:51:28 STEP 2350 H=2350:00 +CPU= 18.373
  04:51:48 STEP 2351 H=2351:00 +CPU= 19.289
  04:52:30 STEP 2352 H=2352:00 +CPU= 34.534
Moving to projects directory: /data/slots/3/ICMGGhq0f+002352
Moving to projects directory: /data/slots/3/ICMSHhq0f+002352
Moving to projects directory: /data/slots/3/ICMUAhq0f+002352
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002328
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002328
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002328
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002340
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002340
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002340
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_0705_1983050100_123_952_12169349_2_r1121249860_97.zip
Uploading the intermediate file: upload_file_97.zip
  04:52:50 STEP 2353 H=2353:00 +CPU= 18.648
  04:53:11 STEP 2354 H=2354:00 +CPU= 18.467
  04:53:41 STEP 2355 H=2355:00 +CPU= 28.578
  04:54:01 STEP 2356 H=2356:00 +CPU= 19.259
  04:54:21 STEP 2357 H=2357:00 +CPU= 18.994
  04:54:51 STEP 2358 H=2358:00 +CPU= 29.374
  04:55:10 STEP 2359 H=2359:00 +CPU= 18.299
  04:55:30 STEP 2360 H=2360:00 +CPU= 18.392
  04:55:59 STEP 2361 H=2361:00 +CPU= 28.188
  04:56:19 STEP 2362 H=2362:00 +CPU= 18.958
  04:56:38 STEP 2363 H=2363:00 +CPU= 17.916
  04:57:12 STEP 2364 H=2364:00 +CPU= 31.241
Moving to projects directory: /data/slots/3/ICMGGhq0f+002364
Moving to projects directory: /data/slots/3/ICMSHhq0f+002364
Moving to projects directory: /data/slots/3/ICMUAhq0f+002364
  04:57:31 STEP 2365 H=2365:00 +CPU= 18.635
  04:57:50 STEP 2366 H=2366:00 +CPU= 18.452
  04:58:20 STEP 2367 H=2367:00 +CPU= 28.674
  04:58:39 STEP 2368 H=2368:00 +CPU= 18.329
  04:58:59 STEP 2369 H=2369:00 +CPU= 18.873
  04:59:30 STEP 2370 H=2370:00 +CPU= 29.830
  04:59:49 STEP 2371 H=2371:00 +CPU= 18.444
  05:00:17 STEP 2372 H=2372:00 +CPU= 19.432
  05:01:13 STEP 2373 H=2373:00 +CPU= 29.810
  05:01:50 STEP 2374 H=2374:00 +CPU= 19.710
  05:02:27 STEP 2375 H=2375:00 +CPU= 20.326
  05:03:39 STEP 2376 H=2376:00 +CPU= 36.665
Moving to projects directory: /data/slots/3/ICMGGhq0f+002376
Moving to projects directory: /data/slots/3/ICMSHhq0f+002376
Moving to projects directory: /data/slots/3/ICMUAhq0f+002376
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002352
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002352
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002352
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002364
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002364
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002364
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_0705_1983050100_123_952_12169349_2_r1121249860_98.zip
Uploading the intermediate file: upload_file_98.zip
  05:04:18 STEP 2377 H=2377:00 +CPU= 19.534
  05:04:43 STEP 2378 H=2378:00 +CPU= 19.418
  05:05:13 STEP 2379 H=2379:00 +CPU= 29.381
  05:05:33 STEP 2380 H=2380:00 +CPU= 18.942
  05:05:51 STEP 2381 H=2381:00 +CPU= 17.889
  05:06:22 STEP 2382 H=2382:00 +CPU= 29.067
  05:06:42 STEP 2383 H=2383:00 +CPU= 18.118
  05:07:02 STEP 2384 H=2384:00 +CPU= 18.449
  05:07:32 STEP 2385 H=2385:00 +CPU= 28.471
  05:07:52 STEP 2386 H=2386:00 +CPU= 18.327
  05:08:11 STEP 2387 H=2387:00 +CPU= 19.092
  05:08:44 STEP 2388 H=2388:00 +CPU= 31.355
Moving to projects directory: /data/slots/3/ICMGGhq0f+002388
Moving to projects directory: /data/slots/3/ICMSHhq0f+002388
Moving to projects directory: /data/slots/3/ICMUAhq0f+002388
  05:09:05 STEP 2389 H=2389:00 +CPU= 18.642
  05:09:24 STEP 2390 H=2390:00 +CPU= 18.479
  05:09:54 STEP 2391 H=2391:00 +CPU= 28.685
  05:10:13 STEP 2392 H=2392:00 +CPU= 18.461
  05:10:33 STEP 2393 H=2393:00 +CPU= 18.525
  05:11:03 STEP 2394 H=2394:00 +CPU= 29.164
  05:11:22 STEP 2395 H=2395:00 +CPU= 18.077
  05:11:42 STEP 2396 H=2396:00 +CPU= 19.036
  05:12:12 STEP 2397 H=2397:00 +CPU= 28.857
  05:12:32 STEP 2398 H=2398:00 +CPU= 18.935
  05:12:51 STEP 2399 H=2399:00 +CPU= 18.329
  05:13:29 STEP 2400 H=2400:00 +CPU= 34.627
Moving to projects directory: /data/slots/3/ICMGGhq0f+002400
Moving to projects directory: /data/slots/3/ICMSHhq0f+002400
Moving to projects directory: /data/slots/3/ICMUAhq0f+002400
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002376
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002376
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002376
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002388
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002388
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002388
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_0705_1983050100_123_952_12169349_2_r1121249860_99.zip
Uploading the intermediate file: upload_file_99.zip
  05:13:47 STEP 2401 H=2401:00 +CPU= 17.809
  05:14:07 STEP 2402 H=2402:00 +CPU= 18.774
  05:14:37 STEP 2403 H=2403:00 +CPU= 28.517
  05:14:55 STEP 2404 H=2404:00 +CPU= 18.315
  05:15:15 STEP 2405 H=2405:00 +CPU= 19.053
  05:15:45 STEP 2406 H=2406:00 +CPU= 29.098
  05:16:04 STEP 2407 H=2407:00 +CPU= 18.947
  05:16:24 STEP 2408 H=2408:00 +CPU= 19.086
  05:16:54 STEP 2409 H=2409:00 +CPU= 28.363
  05:17:15 STEP 2410 H=2410:00 +CPU= 21.041
  05:17:35 STEP 2411 H=2411:00 +CPU= 18.311
  05:18:07 STEP 2412 H=2412:00 +CPU= 31.712
Moving to projects directory: /data/slots/3/ICMGGhq0f+002412
Moving to projects directory: /data/slots/3/ICMSHhq0f+002412
Moving to projects directory: /data/slots/3/ICMUAhq0f+002412
  05:18:26 STEP 2413 H=2413:00 +CPU= 18.587
  05:18:46 STEP 2414 H=2414:00 +CPU= 18.494
  05:19:15 STEP 2415 H=2415:00 +CPU= 28.401
  05:19:36 STEP 2416 H=2416:00 +CPU= 19.267
  05:19:54 STEP 2417 H=2417:00 +CPU= 18.112
  05:20:24 STEP 2418 H=2418:00 +CPU= 29.221
  05:20:43 STEP 2419 H=2419:00 +CPU= 18.350
  05:21:03 STEP 2420 H=2420:00 +CPU= 19.145
  05:21:32 STEP 2421 H=2421:00 +CPU= 28.380
  05:21:53 STEP 2422 H=2422:00 +CPU= 19.291
  05:22:12 STEP 2423 H=2423:00 +CPU= 18.616
  05:22:48 STEP 2424 H=2424:00 +CPU= 34.065
Moving to projects directory: /data/slots/3/ICMGGhq0f+002424
Moving to projects directory: /data/slots/3/ICMSHhq0f+002424
Moving to projects directory: /data/slots/3/ICMUAhq0f+002424
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002400
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002400
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002400
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002412
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002412
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002412
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_0705_1983050100_123_952_12169349_2_r1121249860_100.zip
Uploading the intermediate file: upload_file_100.zip
  05:23:07 STEP 2425 H=2425:00 +CPU= 18.096
  05:23:28 STEP 2426 H=2426:00 +CPU= 19.165
  05:23:59 STEP 2427 H=2427:00 +CPU= 28.673
  05:24:20 STEP 2428 H=2428:00 +CPU= 19.390
  05:24:40 STEP 2429 H=2429:00 +CPU= 18.911
  05:25:09 STEP 2430 H=2430:00 +CPU= 29.099
  05:25:28 STEP 2431 H=2431:00 +CPU= 17.949
  05:25:48 STEP 2432 H=2432:00 +CPU= 18.534
  05:26:17 STEP 2433 H=2433:00 +CPU= 28.281
  05:26:36 STEP 2434 H=2434:00 +CPU= 18.981
  05:26:56 STEP 2435 H=2435:00 +CPU= 18.000
  05:27:28 STEP 2436 H=2436:00 +CPU= 31.354
Moving to projects directory: /data/slots/3/ICMGGhq0f+002436
Moving to projects directory: /data/slots/3/ICMSHhq0f+002436
Moving to projects directory: /data/slots/3/ICMUAhq0f+002436
  05:27:49 STEP 2437 H=2437:00 +CPU= 19.043
  05:28:08 STEP 2438 H=2438:00 +CPU= 18.719
  05:28:37 STEP 2439 H=2439:00 +CPU= 27.990
  05:28:58 STEP 2440 H=2440:00 +CPU= 19.001
  05:29:18 STEP 2441 H=2441:00 +CPU= 18.764
  05:29:49 STEP 2442 H=2442:00 +CPU= 28.877
  05:30:15 STEP 2443 H=2443:00 +CPU= 18.177
  05:30:53 STEP 2444 H=2444:00 +CPU= 19.700
  05:31:50 STEP 2445 H=2445:00 +CPU= 29.537
  05:32:26 STEP 2446 H=2446:00 +CPU= 19.698
  05:33:04 STEP 2447 H=2447:00 +CPU= 20.257
  05:34:17 STEP 2448 H=2448:00 +CPU= 35.521
Moving to projects directory: /data/slots/3/ICMGGhq0f+002448
Moving to projects directory: /data/slots/3/ICMSHhq0f+002448
Moving to projects directory: /data/slots/3/ICMUAhq0f+002448
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002424
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002424
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002424
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002436
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002436
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002436
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_0705_1983050100_123_952_12169349_2_r1121249860_101.zip
Uploading the intermediate file: upload_file_101.zip
  05:34:38 STEP 2449 H=2449:00 +CPU= 18.236
  05:34:58 STEP 2450 H=2450:00 +CPU= 19.528
  05:35:28 STEP 2451 H=2451:00 +CPU= 29.196
  05:35:48 STEP 2452 H=2452:00 +CPU= 19.357
  05:36:07 STEP 2453 H=2453:00 +CPU= 18.219
  05:36:36 STEP 2454 H=2454:00 +CPU= 28.811
  05:36:56 STEP 2455 H=2455:00 +CPU= 18.644
  05:37:15 STEP 2456 H=2456:00 +CPU= 18.658
  05:37:44 STEP 2457 H=2457:00 +CPU= 28.748
  05:38:05 STEP 2458 H=2458:00 +CPU= 19.801
  05:38:24 STEP 2459 H=2459:00 +CPU= 18.425
  05:38:56 STEP 2460 H=2460:00 +CPU= 31.248
Moving to projects directory: /data/slots/3/ICMGGhq0f+002460
Moving to projects directory: /data/slots/3/ICMSHhq0f+002460
Moving to projects directory: /data/slots/3/ICMUAhq0f+002460
  05:39:16 STEP 2461 H=2461:00 +CPU= 18.779
  05:39:35 STEP 2462 H=2462:00 +CPU= 18.450
  05:40:04 STEP 2463 H=2463:00 +CPU= 28.460
  05:40:23 STEP 2464 H=2464:00 +CPU= 18.691
  05:40:43 STEP 2465 H=2465:00 +CPU= 18.828
  05:41:13 STEP 2466 H=2466:00 +CPU= 29.008
  05:41:32 STEP 2467 H=2467:00 +CPU= 18.740
  05:41:51 STEP 2468 H=2468:00 +CPU= 18.293
  05:42:24 STEP 2469 H=2469:00 +CPU= 29.096
  05:42:44 STEP 2470 H=2470:00 +CPU= 19.037
  05:43:03 STEP 2471 H=2471:00 +CPU= 18.533
  05:43:40 STEP 2472 H=2472:00 +CPU= 34.854
Moving to projects directory: /data/slots/3/ICMGGhq0f+002472
Moving to projects directory: /data/slots/3/ICMSHhq0f+002472
Moving to projects directory: /data/slots/3/ICMUAhq0f+002472
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002448
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002448
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002448
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002460
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002460
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002460
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_0705_1983050100_123_952_12169349_2_r1121249860_102.zip
Uploading the intermediate file: upload_file_102.zip
  05:43:59 STEP 2473 H=2473:00 +CPU= 18.167
  05:44:20 STEP 2474 H=2474:00 +CPU= 19.399
  05:44:49 STEP 2475 H=2475:00 +CPU= 28.194
  05:45:09 STEP 2476 H=2476:00 +CPU= 18.709
  05:45:28 STEP 2477 H=2477:00 +CPU= 17.915
  05:45:58 STEP 2478 H=2478:00 +CPU= 29.107
  05:46:18 STEP 2479 H=2479:00 +CPU= 18.472
  05:46:37 STEP 2480 H=2480:00 +CPU= 18.319
  05:47:08 STEP 2481 H=2481:00 +CPU= 28.694
  05:47:27 STEP 2482 H=2482:00 +CPU= 18.990
  05:47:51 STEP 2483 H=2483:00 +CPU= 18.016
  05:48:26 STEP 2484 H=2484:00 +CPU= 31.646
Moving to projects directory: /data/slots/3/ICMGGhq0f+002484
Moving to projects directory: /data/slots/3/ICMSHhq0f+002484
Moving to projects directory: /data/slots/3/ICMUAhq0f+002484
  05:48:47 STEP 2485 H=2485:00 +CPU= 18.976
  05:49:06 STEP 2486 H=2486:00 +CPU= 18.484
  05:49:38 STEP 2487 H=2487:00 +CPU= 28.675
  05:49:58 STEP 2488 H=2488:00 +CPU= 18.388
  05:50:18 STEP 2489 H=2489:00 +CPU= 19.004
  05:50:48 STEP 2490 H=2490:00 +CPU= 29.210
  05:51:06 STEP 2491 H=2491:00 +CPU= 17.997
  05:51:27 STEP 2492 H=2492:00 +CPU= 19.228
  05:51:58 STEP 2493 H=2493:00 +CPU= 28.788
  05:52:19 STEP 2494 H=2494:00 +CPU= 18.950
  05:52:41 STEP 2495 H=2495:00 +CPU= 19.202
  05:53:17 STEP 2496 H=2496:00 +CPU= 33.731
Moving to projects directory: /data/slots/3/ICMGGhq0f+002496
Moving to projects directory: /data/slots/3/ICMSHhq0f+002496
Moving to projects directory: /data/slots/3/ICMUAhq0f+002496
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002472
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002472
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002472
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002484
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002484
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002484
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_0705_1983050100_123_952_12169349_2_r1121249860_103.zip
Uploading the intermediate file: upload_file_103.zip
  05:53:38 STEP 2497 H=2497:00 +CPU= 18.774
  05:53:58 STEP 2498 H=2498:00 +CPU= 18.761
  05:54:29 STEP 2499 H=2499:00 +CPU= 28.097
  05:54:49 STEP 2500 H=2500:00 +CPU= 18.461
  05:55:08 STEP 2501 H=2501:00 +CPU= 18.734
  05:55:39 STEP 2502 H=2502:00 +CPU= 29.258
  05:55:58 STEP 2503 H=2503:00 +CPU= 18.144
  05:56:19 STEP 2504 H=2504:00 +CPU= 19.228
  05:56:49 STEP 2505 H=2505:00 +CPU= 28.607
  05:57:08 STEP 2506 H=2506:00 +CPU= 18.648
  05:57:28 STEP 2507 H=2507:00 +CPU= 17.919
  05:58:01 STEP 2508 H=2508:00 +CPU= 30.790
Moving to projects directory: /data/slots/3/ICMGGhq0f+002508
Moving to projects directory: /data/slots/3/ICMSHhq0f+002508
Moving to projects directory: /data/slots/3/ICMUAhq0f+002508
  05:58:21 STEP 2509 H=2509:00 +CPU= 18.891
  05:58:41 STEP 2510 H=2510:00 +CPU= 19.418
  05:59:11 STEP 2511 H=2511:00 +CPU= 28.420
  05:59:31 STEP 2512 H=2512:00 +CPU= 18.472
  05:59:51 STEP 2513 H=2513:00 +CPU= 18.729
  06:00:41 STEP 2514 H=2514:00 +CPU= 29.790
  06:01:15 STEP 2515 H=2515:00 +CPU= 19.405
  06:01:50 STEP 2516 H=2516:00 +CPU= 19.391
  06:02:45 STEP 2517 H=2517:00 +CPU= 29.701
  06:03:21 STEP 2518 H=2518:00 +CPU= 19.596
  06:03:58 STEP 2519 H=2519:00 +CPU= 19.934
  06:04:45 STEP 2520 H=2520:00 +CPU= 34.718
Moving to projects directory: /data/slots/3/ICMGGhq0f+002520
Moving to projects directory: /data/slots/3/ICMSHhq0f+002520
Moving to projects directory: /data/slots/3/ICMUAhq0f+002520
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002496
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002496
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002496
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002508
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002508
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002508
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_0705_1983050100_123_952_12169349_2_r1121249860_104.zip
Uploading the intermediate file: upload_file_104.zip
  06:05:04 STEP 2521 H=2521:00 +CPU= 17.985
  06:05:28 STEP 2522 H=2522:00 +CPU= 19.399
  06:06:01 STEP 2523 H=2523:00 +CPU= 28.644
  06:06:21 STEP 2524 H=2524:00 +CPU= 18.857
  06:06:41 STEP 2525 H=2525:00 +CPU= 17.952
  06:07:20 STEP 2526 H=2526:00 +CPU= 29.131
  06:07:40 STEP 2527 H=2527:00 +CPU= 18.745
  06:08:01 STEP 2528 H=2528:00 +CPU= 18.701
  06:08:32 STEP 2529 H=2529:00 +CPU= 28.456
  06:08:52 STEP 2530 H=2530:00 +CPU= 18.621
  06:09:13 STEP 2531 H=2531:00 +CPU= 18.118
  06:09:53 STEP 2532 H=2532:00 +CPU= 31.412
Moving to projects directory: /data/slots/3/ICMGGhq0f+002532
Moving to projects directory: /data/slots/3/ICMSHhq0f+002532
Moving to projects directory: /data/slots/3/ICMUAhq0f+002532
  06:10:12 STEP 2533 H=2533:00 +CPU= 18.196
  06:10:32 STEP 2534 H=2534:00 +CPU= 18.497
  06:11:04 STEP 2535 H=2535:00 +CPU= 28.250
  06:11:25 STEP 2536 H=2536:00 +CPU= 19.163
  06:11:47 STEP 2537 H=2537:00 +CPU= 18.525
  06:12:20 STEP 2538 H=2538:00 +CPU= 29.285
  06:12:41 STEP 2539 H=2539:00 +CPU= 18.695
  06:13:01 STEP 2540 H=2540:00 +CPU= 18.541
  06:13:33 STEP 2541 H=2541:00 +CPU= 28.487
  06:13:54 STEP 2542 H=2542:00 +CPU= 19.028
  06:14:13 STEP 2543 H=2543:00 +CPU= 18.495
  06:15:04 STEP 2544 H=2544:00 +CPU= 34.948
Moving to projects directory: /data/slots/3/ICMGGhq0f+002544
Moving to projects directory: /data/slots/3/ICMSHhq0f+002544
Moving to projects directory: /data/slots/3/ICMUAhq0f+002544
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002520
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002520
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002520
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002532
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002532
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002532
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_0705_1983050100_123_952_12169349_2_r1121249860_105.zip
Uploading the intermediate file: upload_file_105.zip
  06:15:23 STEP 2545 H=2545:00 +CPU= 17.920
Uploading trickle at timestep: 9158400
  06:15:48 STEP 2546 H=2546:00 +CPU= 18.558
  06:16:20 STEP 2547 H=2547:00 +CPU= 28.442
  06:16:39 STEP 2548 H=2548:00 +CPU= 18.344
  06:16:59 STEP 2549 H=2549:00 +CPU= 18.687
  06:17:32 STEP 2550 H=2550:00 +CPU= 30.705
  06:17:53 STEP 2551 H=2551:00 +CPU= 19.369
  06:18:13 STEP 2552 H=2552:00 +CPU= 18.614
  06:18:45 STEP 2553 H=2553:00 +CPU= 28.466
  06:19:06 STEP 2554 H=2554:00 +CPU= 18.724
  06:19:25 STEP 2555 H=2555:00 +CPU= 17.922
  06:19:58 STEP 2556 H=2556:00 +CPU= 30.799
Moving to projects directory: /data/slots/3/ICMGGhq0f+002556
Moving to projects directory: /data/slots/3/ICMSHhq0f+002556
Moving to projects directory: /data/slots/3/ICMUAhq0f+002556
  06:20:17 STEP 2557 H=2557:00 +CPU= 17.971
  06:20:37 STEP 2558 H=2558:00 +CPU= 19.252
  06:21:07 STEP 2559 H=2559:00 +CPU= 28.739
  06:21:27 STEP 2560 H=2560:00 +CPU= 18.830
  06:21:45 STEP 2561 H=2561:00 +CPU= 17.974
  06:22:15 STEP 2562 H=2562:00 +CPU= 28.658
  06:22:33 STEP 2563 H=2563:00 +CPU= 17.826
  06:22:53 STEP 2564 H=2564:00 +CPU= 19.159
  06:23:24 STEP 2565 H=2565:00 +CPU= 28.600
  06:23:46 STEP 2566 H=2566:00 +CPU= 18.355
  06:24:12 STEP 2567 H=2567:00 +CPU= 19.518
  06:24:48 STEP 2568 H=2568:00 +CPU= 33.927
Moving to projects directory: /data/slots/3/ICMGGhq0f+002568
Moving to projects directory: /data/slots/3/ICMSHhq0f+002568
Moving to projects directory: /data/slots/3/ICMUAhq0f+002568
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002544
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002544
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002544
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002556
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002556
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002556
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_0705_1983050100_123_952_12169349_2_r1121249860_106.zip
Uploading the intermediate file: upload_file_106.zip
  06:25:09 STEP 2569 H=2569:00 +CPU= 18.631
  06:25:29 STEP 2570 H=2570:00 +CPU= 18.385
  06:26:01 STEP 2571 H=2571:00 +CPU= 28.661
  06:26:21 STEP 2572 H=2572:00 +CPU= 18.689
  06:26:40 STEP 2573 H=2573:00 +CPU= 17.865
  06:27:11 STEP 2574 H=2574:00 +CPU= 28.704
  06:27:30 STEP 2575 H=2575:00 +CPU= 18.002
  06:27:50 STEP 2576 H=2576:00 +CPU= 18.487
  06:28:21 STEP 2577 H=2577:00 +CPU= 28.778
  06:28:41 STEP 2578 H=2578:00 +CPU= 18.343
  06:29:01 STEP 2579 H=2579:00 +CPU= 19.060
  06:29:33 STEP 2580 H=2580:00 +CPU= 31.540
Moving to projects directory: /data/slots/3/ICMGGhq0f+002580
Moving to projects directory: /data/slots/3/ICMSHhq0f+002580
Moving to projects directory: /data/slots/3/ICMUAhq0f+002580
  06:29:52 STEP 2581 H=2581:00 +CPU= 17.865
  06:30:22 STEP 2582 H=2582:00 +CPU= 19.716
  06:31:18 STEP 2583 H=2583:00 +CPU= 29.637
  06:31:54 STEP 2584 H=2584:00 +CPU= 19.437
  06:32:29 STEP 2585 H=2585:00 +CPU= 19.400
  06:33:26 STEP 2586 H=2586:00 +CPU= 31.028
  06:34:01 STEP 2587 H=2587:00 +CPU= 19.413
  06:34:31 STEP 2588 H=2588:00 +CPU= 19.433
  06:35:00 STEP 2589 H=2589:00 +CPU= 28.148
  06:35:20 STEP 2590 H=2590:00 +CPU= 19.565
  06:35:39 STEP 2591 H=2591:00 +CPU= 18.503
  06:36:29 STEP 2592 H=2592:00 +CPU= 34.257
Moving to projects directory: /data/slots/3/ICMGGhq0f+002592
Moving to projects directory: /data/slots/3/ICMSHhq0f+002592
Moving to projects directory: /data/slots/3/ICMUAhq0f+002592
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002568
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002568
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002568
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002580
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002580
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002580
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_0705_1983050100_123_952_12169349_2_r1121249860_107.zip
Uploading the intermediate file: upload_file_107.zip
  06:36:48 STEP 2593 H=2593:00 +CPU= 18.048
  06:37:09 STEP 2594 H=2594:00 +CPU= 18.920
  06:37:39 STEP 2595 H=2595:00 +CPU= 28.237
  06:38:00 STEP 2596 H=2596:00 +CPU= 19.168
  06:38:20 STEP 2597 H=2597:00 +CPU= 19.106
  06:38:51 STEP 2598 H=2598:00 +CPU= 28.812
  06:39:11 STEP 2599 H=2599:00 +CPU= 18.540
  06:39:32 STEP 2600 H=2600:00 +CPU= 19.103
  06:40:03 STEP 2601 H=2601:00 +CPU= 28.868
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  06:55:17 STEP 2602 H=2602:00 +CPU= 18.563
  06:55:36 STEP 2603 H=2603:00 +CPU= 17.966
  06:56:09 STEP 2604 H=2604:00 +CPU= 32.859
Moving to projects directory: /data/slots/3/ICMGGhq0f+002604
Moving to projects directory: /data/slots/3/ICMSHhq0f+002604
Moving to projects directory: /data/slots/3/ICMUAhq0f+002604
  06:56:29 STEP 2605 H=2605:00 +CPU= 18.656
  06:56:48 STEP 2606 H=2606:00 +CPU= 18.384
  06:57:17 STEP 2607 H=2607:00 +CPU= 28.636
  06:57:37 STEP 2608 H=2608:00 +CPU= 19.003
  06:57:55 STEP 2609 H=2609:00 +CPU= 17.929
  06:58:25 STEP 2610 H=2610:00 +CPU= 29.366
  06:58:44 STEP 2611 H=2611:00 +CPU= 17.901
  06:59:04 STEP 2612 H=2612:00 +CPU= 19.286
  06:59:34 STEP 2613 H=2613:00 +CPU= 28.845
  06:59:53 STEP 2614 H=2614:00 +CPU= 19.328
  07:00:25 STEP 2615 H=2615:00 +CPU= 19.571
  07:01:49 STEP 2616 H=2616:00 +CPU= 36.159
Moving to projects directory: /data/slots/3/ICMGGhq0f+002616
Moving to projects directory: /data/slots/3/ICMSHhq0f+002616
Moving to projects directory: /data/slots/3/ICMUAhq0f+002616
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002592
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002592
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002592
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002604
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002604
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002604
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_0705_1983050100_123_952_12169349_2_r1121249860_108.zip
Uploading the intermediate file: upload_file_108.zip
  07:02:25 STEP 2617 H=2617:00 +CPU= 19.253
  07:03:03 STEP 2618 H=2618:00 +CPU= 20.030
  07:03:59 STEP 2619 H=2619:00 +CPU= 29.645
  07:04:27 STEP 2620 H=2620:00 +CPU= 19.471
  07:04:46 STEP 2621 H=2621:00 +CPU= 18.289
  07:05:16 STEP 2622 H=2622:00 +CPU= 29.211
  07:05:36 STEP 2623 H=2623:00 +CPU= 18.619
  07:05:57 STEP 2624 H=2624:00 +CPU= 19.532
  07:06:28 STEP 2625 H=2625:00 +CPU= 28.561
  07:06:47 STEP 2626 H=2626:00 +CPU= 18.717
  07:07:06 STEP 2627 H=2627:00 +CPU= 18.060
  07:07:39 STEP 2628 H=2628:00 +CPU= 31.688
Moving to projects directory: /data/slots/3/ICMGGhq0f+002628
Moving to projects directory: /data/slots/3/ICMSHhq0f+002628
Moving to projects directory: /data/slots/3/ICMUAhq0f+002628
  07:07:58 STEP 2629 H=2629:00 +CPU= 18.164
  07:08:18 STEP 2630 H=2630:00 +CPU= 18.855
  07:08:48 STEP 2631 H=2631:00 +CPU= 28.152
  07:09:08 STEP 2632 H=2632:00 +CPU= 18.592
  07:09:27 STEP 2633 H=2633:00 +CPU= 18.392
  07:09:58 STEP 2634 H=2634:00 +CPU= 29.420
  07:10:16 STEP 2635 H=2635:00 +CPU= 18.446
  07:10:35 STEP 2636 H=2636:00 +CPU= 18.429
  07:11:05 STEP 2637 H=2637:00 +CPU= 28.534
  07:11:23 STEP 2638 H=2638:00 +CPU= 18.366
  07:11:43 STEP 2639 H=2639:00 +CPU= 19.175
  07:12:24 STEP 2640 H=2640:00 +CPU= 34.560
Moving to projects directory: /data/slots/3/ICMGGhq0f+002640
Moving to projects directory: /data/slots/3/ICMSHhq0f+002640
Moving to projects directory: /data/slots/3/ICMUAhq0f+002640
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002616
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002616
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002616
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002628
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002628
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002628
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_0705_1983050100_123_952_12169349_2_r1121249860_109.zip
Uploading the intermediate file: upload_file_109.zip
  07:12:44 STEP 2641 H=2641:00 +CPU= 18.969
  07:13:04 STEP 2642 H=2642:00 +CPU= 19.199
  07:13:33 STEP 2643 H=2643:00 +CPU= 28.440
  07:13:53 STEP 2644 H=2644:00 +CPU= 18.626
  07:14:11 STEP 2645 H=2645:00 +CPU= 17.897
  07:14:41 STEP 2646 H=2646:00 +CPU= 28.980
  07:15:00 STEP 2647 H=2647:00 +CPU= 18.357
  07:15:19 STEP 2648 H=2648:00 +CPU= 18.351
  07:15:50 STEP 2649 H=2649:00 +CPU= 28.483
  07:16:09 STEP 2650 H=2650:00 +CPU= 18.487
  07:16:27 STEP 2651 H=2651:00 +CPU= 17.818
  07:17:01 STEP 2652 H=2652:00 +CPU= 31.069
Moving to projects directory: /data/slots/3/ICMGGhq0f+002652
Moving to projects directory: /data/slots/3/ICMSHhq0f+002652
Moving to projects directory: /data/slots/3/ICMUAhq0f+002652
  07:17:23 STEP 2653 H=2653:00 +CPU= 20.903
  07:17:41 STEP 2654 H=2654:00 +CPU= 18.295
  07:18:12 STEP 2655 H=2655:00 +CPU= 29.027
  07:18:32 STEP 2656 H=2656:00 +CPU= 19.034
  07:18:51 STEP 2657 H=2657:00 +CPU= 17.868
  07:19:26 STEP 2658 H=2658:00 +CPU= 29.012
  07:19:45 STEP 2659 H=2659:00 +CPU= 18.441
  07:20:05 STEP 2660 H=2660:00 +CPU= 18.761
  07:20:35 STEP 2661 H=2661:00 +CPU= 28.562
  07:20:57 STEP 2662 H=2662:00 +CPU= 19.113
  07:21:17 STEP 2663 H=2663:00 +CPU= 18.734
  07:21:52 STEP 2664 H=2664:00 +CPU= 33.619
Moving to projects directory: /data/slots/3/ICMGGhq0f+002664
Moving to projects directory: /data/slots/3/ICMSHhq0f+002664
Moving to projects directory: /data/slots/3/ICMUAhq0f+002664
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002640
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002640
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002640
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002652
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002652
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002652
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_0705_1983050100_123_952_12169349_2_r1121249860_110.zip
Uploading the intermediate file: upload_file_110.zip
  07:22:13 STEP 2665 H=2665:00 +CPU= 19.077
  07:22:33 STEP 2666 H=2666:00 +CPU= 19.495
  07:23:03 STEP 2667 H=2667:00 +CPU= 28.024
  07:23:22 STEP 2668 H=2668:00 +CPU= 18.481
  07:23:42 STEP 2669 H=2669:00 +CPU= 19.635
  07:24:12 STEP 2670 H=2670:00 +CPU= 29.124
  07:24:33 STEP 2671 H=2671:00 +CPU= 19.555
  07:24:53 STEP 2672 H=2672:00 +CPU= 18.877
  07:25:27 STEP 2673 H=2673:00 +CPU= 28.512
  07:25:47 STEP 2674 H=2674:00 +CPU= 19.230
  07:26:07 STEP 2675 H=2675:00 +CPU= 18.055
  07:26:40 STEP 2676 H=2676:00 +CPU= 31.494
Moving to projects directory: /data/slots/3/ICMGGhq0f+002676
Moving to projects directory: /data/slots/3/ICMSHhq0f+002676
Moving to projects directory: /data/slots/3/ICMUAhq0f+002676
  07:26:59 STEP 2677 H=2677:00 +CPU= 18.025
  07:27:20 STEP 2678 H=2678:00 +CPU= 19.648
  07:27:50 STEP 2679 H=2679:00 +CPU= 28.286
  07:28:11 STEP 2680 H=2680:00 +CPU= 19.102
  07:28:32 STEP 2681 H=2681:00 +CPU= 18.353
  07:29:03 STEP 2682 H=2682:00 +CPU= 29.138
  07:29:22 STEP 2683 H=2683:00 +CPU= 18.003
  07:29:42 STEP 2684 H=2684:00 +CPU= 18.337
  07:30:24 STEP 2685 H=2685:00 +CPU= 29.064
  07:31:04 STEP 2686 H=2686:00 +CPU= 19.630
  07:31:42 STEP 2687 H=2687:00 +CPU= 19.635
  07:32:47 STEP 2688 H=2688:00 +CPU= 35.973
Moving to projects directory: /data/slots/3/ICMGGhq0f+002688
Moving to projects directory: /data/slots/3/ICMSHhq0f+002688
Moving to projects directory: /data/slots/3/ICMUAhq0f+002688
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002664
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002664
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002664
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002676
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002676
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002676
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_0705_1983050100_123_952_12169349_2_r1121249860_111.zip
Uploading the intermediate file: upload_file_111.zip
  07:33:25 STEP 2689 H=2689:00 +CPU= 19.527
  07:34:00 STEP 2690 H=2690:00 +CPU= 20.078
  07:34:40 STEP 2691 H=2691:00 +CPU= 29.664
  07:34:59 STEP 2692 H=2692:00 +CPU= 18.436
  07:35:18 STEP 2693 H=2693:00 +CPU= 18.208
  07:35:48 STEP 2694 H=2694:00 +CPU= 28.655
  07:36:07 STEP 2695 H=2695:00 +CPU= 18.032
  07:36:27 STEP 2696 H=2696:00 +CPU= 18.309
  07:36:57 STEP 2697 H=2697:00 +CPU= 28.555
  07:37:20 STEP 2698 H=2698:00 +CPU= 19.853
  07:37:39 STEP 2699 H=2699:00 +CPU= 18.281
  07:38:13 STEP 2700 H=2700:00 +CPU= 31.596
Moving to projects directory: /data/slots/3/ICMGGhq0f+002700
Moving to projects directory: /data/slots/3/ICMSHhq0f+002700
Moving to projects directory: /data/slots/3/ICMUAhq0f+002700
  07:38:32 STEP 2701 H=2701:00 +CPU= 18.615
  07:38:51 STEP 2702 H=2702:00 +CPU= 19.586
  07:39:22 STEP 2703 H=2703:00 +CPU= 29.050
  07:39:40 STEP 2704 H=2704:00 +CPU= 18.296
  07:39:59 STEP 2705 H=2705:00 +CPU= 18.066
  07:40:31 STEP 2706 H=2706:00 +CPU= 30.002
  07:40:50 STEP 2707 H=2707:00 +CPU= 18.587
  07:41:10 STEP 2708 H=2708:00 +CPU= 18.470
  07:41:40 STEP 2709 H=2709:00 +CPU= 28.151
  07:41:59 STEP 2710 H=2710:00 +CPU= 19.149
  07:42:19 STEP 2711 H=2711:00 +CPU= 18.962
  07:42:55 STEP 2712 H=2712:00 +CPU= 34.140
Moving to projects directory: /data/slots/3/ICMGGhq0f+002712
Moving to projects directory: /data/slots/3/ICMSHhq0f+002712
Moving to projects directory: /data/slots/3/ICMUAhq0f+002712
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002688
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002688
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002688
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002700
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002700
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002700
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_0705_1983050100_123_952_12169349_2_r1121249860_112.zip
Uploading the intermediate file: upload_file_112.zip
  07:43:18 STEP 2713 H=2713:00 +CPU= 18.316
  07:43:37 STEP 2714 H=2714:00 +CPU= 19.085
  07:44:07 STEP 2715 H=2715:00 +CPU= 28.638
  07:44:26 STEP 2716 H=2716:00 +CPU= 18.443
  07:44:44 STEP 2717 H=2717:00 +CPU= 17.839
  07:45:14 STEP 2718 H=2718:00 +CPU= 29.146
  07:45:50 STEP 2719 H=2719:00 +CPU= 18.541
  07:46:08 STEP 2720 H=2720:00 +CPU= 18.537
  07:46:38 STEP 2721 H=2721:00 +CPU= 28.228
  07:46:58 STEP 2722 H=2722:00 +CPU= 18.819
  07:47:16 STEP 2723 H=2723:00 +CPU= 18.109
  07:47:49 STEP 2724 H=2724:00 +CPU= 30.818
Moving to projects directory: /data/slots/3/ICMGGhq0f+002724
Moving to projects directory: /data/slots/3/ICMSHhq0f+002724
Moving to projects directory: /data/slots/3/ICMUAhq0f+002724
  07:48:08 STEP 2725 H=2725:00 +CPU= 18.174
  07:48:28 STEP 2726 H=2726:00 +CPU= 18.370
  07:48:58 STEP 2727 H=2727:00 +CPU= 28.508
  07:49:17 STEP 2728 H=2728:00 +CPU= 18.402
  07:49:36 STEP 2729 H=2729:00 +CPU= 18.668
  07:50:06 STEP 2730 H=2730:00 +CPU= 29.354
  07:50:26 STEP 2731 H=2731:00 +CPU= 18.806
  07:50:46 STEP 2732 H=2732:00 +CPU= 19.074
  07:51:15 STEP 2733 H=2733:00 +CPU= 28.191
  07:51:35 STEP 2734 H=2734:00 +CPU= 19.081
  07:51:55 STEP 2735 H=2735:00 +CPU= 19.172
  07:52:33 STEP 2736 H=2736:00 +CPU= 33.742
Moving to projects directory: /data/slots/3/ICMGGhq0f+002736
Moving to projects directory: /data/slots/3/ICMSHhq0f+002736
Moving to projects directory: /data/slots/3/ICMUAhq0f+002736
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002712
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002712
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002712
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002724
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002724
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002724
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_0705_1983050100_123_952_12169349_2_r1121249860_113.zip
Uploading the intermediate file: upload_file_113.zip
  07:52:53 STEP 2737 H=2737:00 +CPU= 18.508
  07:53:12 STEP 2738 H=2738:00 +CPU= 18.607
  07:53:42 STEP 2739 H=2739:00 +CPU= 28.377
  07:54:01 STEP 2740 H=2740:00 +CPU= 18.350
  07:54:22 STEP 2741 H=2741:00 +CPU= 18.813
  07:54:55 STEP 2742 H=2742:00 +CPU= 29.503
  07:55:15 STEP 2743 H=2743:00 +CPU= 18.106
  07:55:34 STEP 2744 H=2744:00 +CPU= 18.686
  07:56:06 STEP 2745 H=2745:00 +CPU= 28.179
  07:56:26 STEP 2746 H=2746:00 +CPU= 19.128
  07:56:46 STEP 2747 H=2747:00 +CPU= 17.909
  07:57:21 STEP 2748 H=2748:00 +CPU= 31.145
Moving to projects directory: /data/slots/3/ICMGGhq0f+002748
Moving to projects directory: /data/slots/3/ICMSHhq0f+002748
Moving to projects directory: /data/slots/3/ICMUAhq0f+002748
  07:57:43 STEP 2749 H=2749:00 +CPU= 18.159
  07:58:02 STEP 2750 H=2750:00 +CPU= 18.682
  07:58:31 STEP 2751 H=2751:00 +CPU= 28.495
  07:58:51 STEP 2752 H=2752:00 +CPU= 18.630
  07:59:10 STEP 2753 H=2753:00 +CPU= 17.971
  07:59:40 STEP 2754 H=2754:00 +CPU= 29.050
  08:00:01 STEP 2755 H=2755:00 +CPU= 18.454
  08:00:40 STEP 2756 H=2756:00 +CPU= 19.278
  08:01:40 STEP 2757 H=2757:00 +CPU= 29.720
  08:02:18 STEP 2758 H=2758:00 +CPU= 19.613
  08:02:56 STEP 2759 H=2759:00 +CPU= 19.913
  08:04:09 STEP 2760 H=2760:00 +CPU= 36.720
Moving to projects directory: /data/slots/3/ICMGGhq0f+002760
Moving to projects directory: /data/slots/3/ICMSHhq0f+002760
Moving to projects directory: /data/slots/3/ICMUAhq0f+002760
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002736
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002736
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002736
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002748
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002748
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002748
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_0705_1983050100_123_952_12169349_2_r1121249860_114.zip
Uploading the intermediate file: upload_file_114.zip
  08:04:32 STEP 2761 H=2761:00 +CPU= 18.984
  08:04:52 STEP 2762 H=2762:00 +CPU= 19.167
  08:05:22 STEP 2763 H=2763:00 +CPU= 28.754
  08:05:40 STEP 2764 H=2764:00 +CPU= 18.382
  08:06:00 STEP 2765 H=2765:00 +CPU= 18.823
  08:06:30 STEP 2766 H=2766:00 +CPU= 29.340
  08:06:50 STEP 2767 H=2767:00 +CPU= 18.568
  08:07:09 STEP 2768 H=2768:00 +CPU= 18.474
  08:07:38 STEP 2769 H=2769:00 +CPU= 28.810
  08:07:58 STEP 2770 H=2770:00 +CPU= 18.655
  08:08:16 STEP 2771 H=2771:00 +CPU= 17.940
  08:08:48 STEP 2772 H=2772:00 +CPU= 31.339
Moving to projects directory: /data/slots/3/ICMGGhq0f+002772
Moving to projects directory: /data/slots/3/ICMSHhq0f+002772
Moving to projects directory: /data/slots/3/ICMUAhq0f+002772
  08:09:09 STEP 2773 H=2773:00 +CPU= 18.799
  08:09:30 STEP 2774 H=2774:00 +CPU= 18.975
  08:10:04 STEP 2775 H=2775:00 +CPU= 29.409
  08:10:24 STEP 2776 H=2776:00 +CPU= 18.974
  08:10:44 STEP 2777 H=2777:00 +CPU= 18.106
  08:11:17 STEP 2778 H=2778:00 +CPU= 29.511
  08:11:36 STEP 2779 H=2779:00 +CPU= 18.154
  08:11:56 STEP 2780 H=2780:00 +CPU= 18.431
  08:12:26 STEP 2781 H=2781:00 +CPU= 28.774
  08:12:46 STEP 2782 H=2782:00 +CPU= 19.098
  08:13:07 STEP 2783 H=2783:00 +CPU= 19.064
  08:13:43 STEP 2784 H=2784:00 +CPU= 33.843
Moving to projects directory: /data/slots/3/ICMGGhq0f+002784
Moving to projects directory: /data/slots/3/ICMSHhq0f+002784
Moving to projects directory: /data/slots/3/ICMUAhq0f+002784
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002760
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002760
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002760
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002772
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002772
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002772
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_0705_1983050100_123_952_12169349_2_r1121249860_115.zip
Uploading the intermediate file: upload_file_115.zip
  08:14:04 STEP 2785 H=2785:00 +CPU= 18.474
Uploading trickle at timestep: 10022400
  08:14:24 STEP 2786 H=2786:00 +CPU= 18.399
  08:14:53 STEP 2787 H=2787:00 +CPU= 28.381
  08:15:13 STEP 2788 H=2788:00 +CPU= 19.403
  08:15:31 STEP 2789 H=2789:00 +CPU= 17.823
  08:16:02 STEP 2790 H=2790:00 +CPU= 29.554
  08:16:22 STEP 2791 H=2791:00 +CPU= 17.905
  08:16:41 STEP 2792 H=2792:00 +CPU= 18.186
  08:17:13 STEP 2793 H=2793:00 +CPU= 29.957
  08:17:32 STEP 2794 H=2794:00 +CPU= 18.315
  08:17:52 STEP 2795 H=2795:00 +CPU= 18.545
  08:18:25 STEP 2796 H=2796:00 +CPU= 31.925
Moving to projects directory: /data/slots/3/ICMGGhq0f+002796
Moving to projects directory: /data/slots/3/ICMSHhq0f+002796
Moving to projects directory: /data/slots/3/ICMUAhq0f+002796
  08:18:45 STEP 2797 H=2797:00 +CPU= 18.623
  08:19:07 STEP 2798 H=2798:00 +CPU= 18.623
  08:19:40 STEP 2799 H=2799:00 +CPU= 28.627
  08:20:03 STEP 2800 H=2800:00 +CPU= 18.582
  08:20:22 STEP 2801 H=2801:00 +CPU= 18.181
  08:20:52 STEP 2802 H=2802:00 +CPU= 29.771
  08:21:12 STEP 2803 H=2803:00 +CPU= 18.157
  08:21:32 STEP 2804 H=2804:00 +CPU= 18.679
  08:22:03 STEP 2805 H=2805:00 +CPU= 28.823
  08:22:26 STEP 2806 H=2806:00 +CPU= 19.170
  08:22:46 STEP 2807 H=2807:00 +CPU= 18.858
  08:23:25 STEP 2808 H=2808:00 +CPU= 33.835
Moving to projects directory: /data/slots/3/ICMGGhq0f+002808
Moving to projects directory: /data/slots/3/ICMSHhq0f+002808
Moving to projects directory: /data/slots/3/ICMUAhq0f+002808
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002784
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002784
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002784
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002796
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002796
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002796
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_0705_1983050100_123_952_12169349_2_r1121249860_116.zip
Uploading the intermediate file: upload_file_116.zip
  08:23:43 STEP 2809 H=2809:00 +CPU= 17.887
  08:24:04 STEP 2810 H=2810:00 +CPU= 19.543
  08:24:34 STEP 2811 H=2811:00 +CPU= 29.246
  08:24:54 STEP 2812 H=2812:00 +CPU= 19.372
  08:25:13 STEP 2813 H=2813:00 +CPU= 18.368
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  08:35:45 STEP 2814 H=2814:00 +CPU= 29.154
  08:36:03 STEP 2815 H=2815:00 +CPU= 18.272
  08:36:23 STEP 2816 H=2816:00 +CPU= 18.375
  08:36:52 STEP 2817 H=2817:00 +CPU= 28.432
  08:37:10 STEP 2818 H=2818:00 +CPU= 18.487
  08:37:30 STEP 2819 H=2819:00 +CPU= 18.424
  08:38:02 STEP 2820 H=2820:00 +CPU= 31.301
Moving to projects directory: /data/slots/3/ICMGGhq0f+002820
Moving to projects directory: /data/slots/3/ICMSHhq0f+002820
Moving to projects directory: /data/slots/3/ICMUAhq0f+002820
  08:38:22 STEP 2821 H=2821:00 +CPU= 18.191
  08:38:40 STEP 2822 H=2822:00 +CPU= 18.270
  08:39:09 STEP 2823 H=2823:00 +CPU= 28.788
  08:39:29 STEP 2824 H=2824:00 +CPU= 18.445
  08:39:47 STEP 2825 H=2825:00 +CPU= 17.938
  08:40:19 STEP 2826 H=2826:00 +CPU= 29.311
  08:40:40 STEP 2827 H=2827:00 +CPU= 18.788
  08:41:01 STEP 2828 H=2828:00 +CPU= 18.853
  08:41:31 STEP 2829 H=2829:00 +CPU= 28.809
  08:41:50 STEP 2830 H=2830:00 +CPU= 18.786
  08:42:09 STEP 2831 H=2831:00 +CPU= 18.630
  08:42:46 STEP 2832 H=2832:00 +CPU= 34.576
Moving to projects directory: /data/slots/3/ICMGGhq0f+002832
Moving to projects directory: /data/slots/3/ICMSHhq0f+002832
Moving to projects directory: /data/slots/3/ICMUAhq0f+002832
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002808
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002808
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002808
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002820
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002820
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002820
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_0705_1983050100_123_952_12169349_2_r1121249860_117.zip
Uploading the intermediate file: upload_file_117.zip
  08:43:05 STEP 2833 H=2833:00 +CPU= 18.114
  08:43:25 STEP 2834 H=2834:00 +CPU= 18.493
  08:43:54 STEP 2835 H=2835:00 +CPU= 28.220
  08:44:12 STEP 2836 H=2836:00 +CPU= 18.454
  08:44:31 STEP 2837 H=2837:00 +CPU= 17.962
  08:45:01 STEP 2838 H=2838:00 +CPU= 29.581
  08:45:20 STEP 2839 H=2839:00 +CPU= 18.287
  08:45:39 STEP 2840 H=2840:00 +CPU= 18.426
  08:46:09 STEP 2841 H=2841:00 +CPU= 28.737
  08:46:28 STEP 2842 H=2842:00 +CPU= 18.337
  08:46:47 STEP 2843 H=2843:00 +CPU= 18.698
  08:47:31 STEP 2844 H=2844:00 +CPU= 31.494
Moving to projects directory: /data/slots/3/ICMGGhq0f+002844
Moving to projects directory: /data/slots/3/ICMSHhq0f+002844
Moving to projects directory: /data/slots/3/ICMUAhq0f+002844
  08:47:59 STEP 2845 H=2845:00 +CPU= 18.498
  08:48:34 STEP 2846 H=2846:00 +CPU= 18.855
  08:49:07 STEP 2847 H=2847:00 +CPU= 28.874
  08:49:29 STEP 2848 H=2848:00 +CPU= 18.984
  08:49:50 STEP 2849 H=2849:00 +CPU= 18.544
  08:50:21 STEP 2850 H=2850:00 +CPU= 28.877
  08:50:43 STEP 2851 H=2851:00 +CPU= 18.672
  08:51:03 STEP 2852 H=2852:00 +CPU= 18.397
  08:51:35 STEP 2853 H=2853:00 +CPU= 28.910
  08:52:12 STEP 2854 H=2854:00 +CPU= 18.984
  08:52:45 STEP 2855 H=2855:00 +CPU= 19.151
  08:53:21 STEP 2856 H=2856:00 +CPU= 34.148
Moving to projects directory: /data/slots/3/ICMGGhq0f+002856
Moving to projects directory: /data/slots/3/ICMSHhq0f+002856
Moving to projects directory: /data/slots/3/ICMUAhq0f+002856
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002832
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002832
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002832
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002844
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002844
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002844
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_0705_1983050100_123_952_12169349_2_r1121249860_118.zip
Uploading the intermediate file: upload_file_118.zip
  08:53:41 STEP 2857 H=2857:00 +CPU= 18.898
  08:54:00 STEP 2858 H=2858:00 +CPU= 18.415
  08:54:29 STEP 2859 H=2859:00 +CPU= 28.350
  08:54:49 STEP 2860 H=2860:00 +CPU= 19.100
  08:55:08 STEP 2861 H=2861:00 +CPU= 18.011
  08:55:39 STEP 2862 H=2862:00 +CPU= 29.404
  08:55:58 STEP 2863 H=2863:00 +CPU= 18.163
  08:56:17 STEP 2864 H=2864:00 +CPU= 18.451
  08:56:48 STEP 2865 H=2865:00 +CPU= 28.337
  08:57:08 STEP 2866 H=2866:00 +CPU= 19.112
  08:57:27 STEP 2867 H=2867:00 +CPU= 17.868
  08:58:00 STEP 2868 H=2868:00 +CPU= 30.923
Moving to projects directory: /data/slots/3/ICMGGhq0f+002868
Moving to projects directory: /data/slots/3/ICMSHhq0f+002868
Moving to projects directory: /data/slots/3/ICMUAhq0f+002868
  08:58:19 STEP 2869 H=2869:00 +CPU= 18.756
  08:58:39 STEP 2870 H=2870:00 +CPU= 19.048
  08:59:11 STEP 2871 H=2871:00 +CPU= 28.645
  08:59:31 STEP 2872 H=2872:00 +CPU= 18.728
  08:59:51 STEP 2873 H=2873:00 +CPU= 18.366
  09:00:38 STEP 2874 H=2874:00 +CPU= 29.658
  09:01:20 STEP 2875 H=2875:00 +CPU= 20.552
  09:01:58 STEP 2876 H=2876:00 +CPU= 19.701
  09:02:56 STEP 2877 H=2877:00 +CPU= 29.970
  09:03:33 STEP 2878 H=2878:00 +CPU= 19.733
  09:04:11 STEP 2879 H=2879:00 +CPU= 19.970
  09:04:51 STEP 2880 H=2880:00 +CPU= 34.685
Moving to projects directory: /data/slots/3/ICMGGhq0f+002880
Moving to projects directory: /data/slots/3/ICMSHhq0f+002880
Moving to projects directory: /data/slots/3/ICMUAhq0f+002880
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002856
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002856
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002856
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002868
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002868
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002868
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_0705_1983050100_123_952_12169349_2_r1121249860_119.zip
Uploading the intermediate file: upload_file_119.zip
  09:05:10 STEP 2881 H=2881:00 +CPU= 17.992
  09:05:30 STEP 2882 H=2882:00 +CPU= 19.179
  09:05:59 STEP 2883 H=2883:00 +CPU= 28.473
  09:06:19 STEP 2884 H=2884:00 +CPU= 18.595
  09:06:38 STEP 2885 H=2885:00 +CPU= 18.922
  09:07:09 STEP 2886 H=2886:00 +CPU= 29.948
  09:07:29 STEP 2887 H=2887:00 +CPU= 18.731
  09:07:49 STEP 2888 H=2888:00 +CPU= 19.160
  09:08:20 STEP 2889 H=2889:00 +CPU= 28.763
  09:08:41 STEP 2890 H=2890:00 +CPU= 18.871
  09:09:00 STEP 2891 H=2891:00 +CPU= 18.260
  09:09:32 STEP 2892 H=2892:00 +CPU= 31.177
Moving to projects directory: /data/slots/3/ICMGGhq0f+002892
Moving to projects directory: /data/slots/3/ICMSHhq0f+002892
Moving to projects directory: /data/slots/3/ICMUAhq0f+002892
  09:09:50 STEP 2893 H=2893:00 +CPU= 18.038
  09:10:12 STEP 2894 H=2894:00 +CPU= 19.381
  09:10:42 STEP 2895 H=2895:00 +CPU= 28.455
  09:11:01 STEP 2896 H=2896:00 +CPU= 18.455
  09:11:21 STEP 2897 H=2897:00 +CPU= 18.653
  09:11:52 STEP 2898 H=2898:00 +CPU= 28.735
  09:12:14 STEP 2899 H=2899:00 +CPU= 19.533
  09:12:33 STEP 2900 H=2900:00 +CPU= 18.433
  09:13:04 STEP 2901 H=2901:00 +CPU= 28.767
  09:13:23 STEP 2902 H=2902:00 +CPU= 18.643
  09:13:43 STEP 2903 H=2903:00 +CPU= 19.490
  09:14:19 STEP 2904 H=2904:00 +CPU= 34.178
Moving to projects directory: /data/slots/3/ICMGGhq0f+002904
Moving to projects directory: /data/slots/3/ICMSHhq0f+002904
Moving to projects directory: /data/slots/3/ICMUAhq0f+002904
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002880
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002880
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002880
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002892
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002892
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002892
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_0705_1983050100_123_952_12169349_2_r1121249860_120.zip
Uploading the intermediate file: upload_file_120.zip
  09:14:39 STEP 2905 H=2905:00 +CPU= 18.430
  09:14:58 STEP 2906 H=2906:00 +CPU= 18.344
  09:15:28 STEP 2907 H=2907:00 +CPU= 28.916
  09:15:47 STEP 2908 H=2908:00 +CPU= 18.368
  09:16:06 STEP 2909 H=2909:00 +CPU= 18.043
  09:16:36 STEP 2910 H=2910:00 +CPU= 29.119
  09:16:55 STEP 2911 H=2911:00 +CPU= 17.991
  09:17:17 STEP 2912 H=2912:00 +CPU= 19.830
  09:17:47 STEP 2913 H=2913:00 +CPU= 28.018
  09:18:08 STEP 2914 H=2914:00 +CPU= 19.264
  09:18:27 STEP 2915 H=2915:00 +CPU= 18.151
  09:18:58 STEP 2916 H=2916:00 +CPU= 30.933
Moving to projects directory: /data/slots/3/ICMGGhq0f+002916
Moving to projects directory: /data/slots/3/ICMSHhq0f+002916
Moving to projects directory: /data/slots/3/ICMUAhq0f+002916
  09:19:18 STEP 2917 H=2917:00 +CPU= 19.013
  09:19:38 STEP 2918 H=2918:00 +CPU= 19.117
  09:20:07 STEP 2919 H=2919:00 +CPU= 28.254
  09:20:27 STEP 2920 H=2920:00 +CPU= 19.261
  09:20:46 STEP 2921 H=2921:00 +CPU= 18.809
  09:21:17 STEP 2922 H=2922:00 +CPU= 29.540
  09:21:36 STEP 2923 H=2923:00 +CPU= 18.199
  09:21:54 STEP 2924 H=2924:00 +CPU= 18.355
  09:22:25 STEP 2925 H=2925:00 +CPU= 28.401
  09:22:45 STEP 2926 H=2926:00 +CPU= 18.792
  09:23:05 STEP 2927 H=2927:00 +CPU= 18.931
  09:23:57 STEP 2928 H=2928:00 +CPU= 34.930
Moving to projects directory: /data/slots/3/ICMGGhq0f+002928
Moving to projects directory: /data/slots/3/ICMSHhq0f+002928
Moving to projects directory: /data/slots/3/ICMUAhq0f+002928
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002904
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002904
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002904
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002916
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002916
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002916
Zipping up the intermediate file: /data/projects/climateprediction.net/oifs_43r3_ps_0705_1983050100_123_952_12169349_2_r1121249860_121.zip
Uploading the intermediate file: upload_file_121.zip
  09:24:16 STEP 2929 H=2929:00 +CPU= 18.263
  09:24:37 STEP 2930 H=2930:00 +CPU= 18.478
  09:25:07 STEP 2931 H=2931:00 +CPU= 28.751
  09:25:29 STEP 2932 H=2932:00 +CPU= 19.447
  09:25:48 STEP 2933 H=2933:00 +CPU= 17.918
  09:26:20 STEP 2934 H=2934:00 +CPU= 29.248
  09:26:41 STEP 2935 H=2935:00 +CPU= 18.330
  09:27:02 STEP 2936 H=2936:00 +CPU= 18.439
  09:27:35 STEP 2937 H=2937:00 +CPU= 28.670
  09:27:56 STEP 2938 H=2938:00 +CPU= 19.085
  09:28:16 STEP 2939 H=2939:00 +CPU= 18.861
  09:28:52 STEP 2940 H=2940:00 +CPU= 31.274
Moving to projects directory: /data/slots/3/ICMGGhq0f+002940
Moving to projects directory: /data/slots/3/ICMSHhq0f+002940
Moving to projects directory: /data/slots/3/ICMUAhq0f+002940
  09:29:13 STEP 2941 H=2941:00 +CPU= 18.911
  09:29:32 STEP 2942 H=2942:00 +CPU= 18.491
  09:30:03 STEP 2943 H=2943:00 +CPU= 28.711
  09:30:43 STEP 2944 H=2944:00 +CPU= 19.643
  09:31:19 STEP 2945 H=2945:00 +CPU= 19.236
  09:32:16 STEP 2946 H=2946:00 +CPU= 30.229
  09:32:52 STEP 2947 H=2947:00 +CPU= 19.077
  09:33:33 STEP 2948 H=2948:00 +CPU= 21.792
  09:34:31 STEP 2949 H=2949:00 +CPU= 31.943
  09:34:53 STEP 2950 H=2950:00 +CPU= 20.429
  09:35:12 STEP 2951 H=2951:00 +CPU= 19.151
  09:35:47 STEP 2952 H=2952:00 +CPU= 32.899
The child process terminated with status: 0
Moving to projects directory: /data/slots/3/ICMGGhq0f+002952
Moving to projects directory: /data/slots/3/ICMSHhq0f+002952
Moving to projects directory: /data/slots/3/ICMUAhq0f+002952
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002928
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002940
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMSHhq0f+002952
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002952
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002940
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002952
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002928
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMUAhq0f+002928
Adding to the zip: /data/projects/climateprediction.net/oifs_43r3_ps_12169349/ICMGGhq0f+002940
Zipping up the final file: /data/projects/climateprediction.net/oifs_43r3_ps_0705_1983050100_123_952_12169349_2_r1121249860_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
09:39:11 (116): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:50:07 1504164 22306701 oifs_43r3_ps_0705_1983050100_123_952_12169349_2 10,623,600 71,880 0.0068
09 May 2023 16:50:06 1504164 22306701 oifs_43r3_ps_0705_1983050100_123_952_12169349_2 10,022,400 68,110 0.0068
09 May 2023 16:50:05 1504164 22306701 oifs_43r3_ps_0705_1983050100_123_952_12169349_2 9,158,400 62,718 0.0068
09 May 2023 16:50:03 1504164 22306701 oifs_43r3_ps_0705_1983050100_123_952_12169349_2 8,294,400 57,321 0.0069
09 May 2023 16:50:02 1504164 22306701 oifs_43r3_ps_0705_1983050100_123_952_12169349_2 7,430,400 51,930 0.0070
09 May 2023 16:50:00 1504164 22306701 oifs_43r3_ps_0705_1983050100_123_952_12169349_2 6,566,400 46,437 0.0071
09 May 2023 16:49:58 1504164 22306701 oifs_43r3_ps_0705_1983050100_123_952_12169349_2 5,702,400 40,387 0.0071
09 May 2023 16:49:57 1504164 22306701 oifs_43r3_ps_0705_1983050100_123_952_12169349_2 4,838,400 34,799 0.0072
09 May 2023 16:49:52 1504164 22306701 oifs_43r3_ps_0705_1983050100_123_952_12169349_2 3,456,000 24,876 0.0072
09 May 2023 16:49:49 1504164 22306701 oifs_43r3_ps_0705_1983050100_123_952_12169349_2 2,592,000 16,765 0.0065
09 May 2023 16:49:46 1504164 22306701 oifs_43r3_ps_0705_1983050100_123_952_12169349_2 1,728,000 11,225 0.0065
09 May 2023 16:49:44 1504164 22306701 oifs_43r3_ps_0705_1983050100_123_952_12169349_2 864,000 5,665 0.0066


©2024 climateprediction.net