climateprediction.net home page
Task 22294482

Task 22294482

Name oifs_43r3_ps_0984_2011050100_123_980_12197628_1
Workunit 12197628
Created 30 Dec 2022, 6:29:59 UTC
Sent 12 Jan 2023, 11:38:34 UTC
Report deadline 11 Feb 2023, 11:38:34 UTC
Received 18 Jan 2023, 2:26:56 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1538515
Run time 10 hours 47 min 10 sec
CPU time 10 hours 42 min 57 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 9.06 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,393.42 MB
Peak swap size 4,974.26 MB
Peak disk usage 1,232.60 MB
Stderr
<core_client_version>7.20.2</core_client_version>
<![CDATA[
<stderr_txt>
e zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002268
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0984_2011050100_123_980_12197628_1_r1095360468_94.zip
Uploading the intermediate file: upload_file_94.zip
  00:50:53 STEP 2281 H=2281:00 +CPU= 11.009
  00:51:05 STEP 2282 H=2282:00 +CPU= 11.052
  00:51:21 STEP 2283 H=2283:00 +CPU= 16.561
  00:51:32 STEP 2284 H=2284:00 +CPU= 11.236
  00:51:43 STEP 2285 H=2285:00 +CPU= 10.879
  00:52:00 STEP 2286 H=2286:00 +CPU= 16.992
  00:52:11 STEP 2287 H=2287:00 +CPU= 10.773
  00:52:22 STEP 2288 H=2288:00 +CPU= 10.949
  00:52:39 STEP 2289 H=2289:00 +CPU= 16.508
  00:52:50 STEP 2290 H=2290:00 +CPU= 11.176
  00:53:01 STEP 2291 H=2291:00 +CPU= 10.928
  00:53:20 STEP 2292 H=2292:00 +CPU= 18.953
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002292
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002292
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002292
  00:53:31 STEP 2293 H=2293:00 +CPU= 11.198
  00:53:42 STEP 2294 H=2294:00 +CPU= 11.120
  00:53:58 STEP 2295 H=2295:00 +CPU= 16.481
  00:54:09 STEP 2296 H=2296:00 +CPU= 10.831
  00:54:20 STEP 2297 H=2297:00 +CPU= 11.069
  00:54:38 STEP 2298 H=2298:00 +CPU= 17.354
  00:54:48 STEP 2299 H=2299:00 +CPU= 10.661
  00:55:00 STEP 2300 H=2300:00 +CPU= 11.049
  00:55:16 STEP 2301 H=2301:00 +CPU= 16.676
  00:55:27 STEP 2302 H=2302:00 +CPU= 10.995
  00:55:38 STEP 2303 H=2303:00 +CPU= 10.890
  00:55:58 STEP 2304 H=2304:00 +CPU= 19.795
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002304
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002304
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002304
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002280
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002280
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002280
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002292
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002292
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002292
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0984_2011050100_123_980_12197628_1_r1095360468_95.zip
Uploading the intermediate file: upload_file_95.zip
  00:56:09 STEP 2305 H=2305:00 +CPU= 10.824
  00:56:20 STEP 2306 H=2306:00 +CPU= 10.973
  00:56:36 STEP 2307 H=2307:00 +CPU= 16.582
  00:56:47 STEP 2308 H=2308:00 +CPU= 10.907
  00:56:58 STEP 2309 H=2309:00 +CPU= 10.530
  00:57:14 STEP 2310 H=2310:00 +CPU= 16.657
  00:57:25 STEP 2311 H=2311:00 +CPU= 10.832
  00:57:36 STEP 2312 H=2312:00 +CPU= 11.073
  00:57:53 STEP 2313 H=2313:00 +CPU= 16.492
  00:58:04 STEP 2314 H=2314:00 +CPU= 10.931
  00:58:15 STEP 2315 H=2315:00 +CPU= 10.777
  00:58:33 STEP 2316 H=2316:00 +CPU= 18.498
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002316
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002316
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002316
  00:58:44 STEP 2317 H=2317:00 +CPU= 10.761
  00:58:55 STEP 2318 H=2318:00 +CPU= 11.220
  00:59:12 STEP 2319 H=2319:00 +CPU= 16.822
  00:59:23 STEP 2320 H=2320:00 +CPU= 10.992
  00:59:34 STEP 2321 H=2321:00 +CPU= 10.952
  00:59:51 STEP 2322 H=2322:00 +CPU= 16.995
  01:00:02 STEP 2323 H=2323:00 +CPU= 10.793
  01:00:13 STEP 2324 H=2324:00 +CPU= 11.129
  01:00:30 STEP 2325 H=2325:00 +CPU= 16.786
  01:00:41 STEP 2326 H=2326:00 +CPU= 10.955
  01:00:52 STEP 2327 H=2327:00 +CPU= 11.016
  01:01:12 STEP 2328 H=2328:00 +CPU= 20.010
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002328
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002328
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002328
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002304
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002304
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002304
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002316
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002316
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002316
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0984_2011050100_123_980_12197628_1_r1095360468_96.zip
Uploading the intermediate file: upload_file_96.zip
  01:01:22 STEP 2329 H=2329:00 +CPU= 10.787
  01:01:34 STEP 2330 H=2330:00 +CPU= 11.205
  01:01:50 STEP 2331 H=2331:00 +CPU= 16.715
  01:02:02 STEP 2332 H=2332:00 +CPU= 11.236
  01:02:12 STEP 2333 H=2333:00 +CPU= 10.794
  01:02:29 STEP 2334 H=2334:00 +CPU= 16.889
  01:02:40 STEP 2335 H=2335:00 +CPU= 10.699
  01:02:51 STEP 2336 H=2336:00 +CPU= 11.037
  01:03:08 STEP 2337 H=2337:00 +CPU= 16.438
  01:03:19 STEP 2338 H=2338:00 +CPU= 11.201
  01:03:30 STEP 2339 H=2339:00 +CPU= 10.824
  01:03:48 STEP 2340 H=2340:00 +CPU= 18.586
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002340
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002340
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002340
  01:03:59 STEP 2341 H=2341:00 +CPU= 10.757
  01:04:10 STEP 2342 H=2342:00 +CPU= 11.114
  01:04:27 STEP 2343 H=2343:00 +CPU= 16.666
  01:04:38 STEP 2344 H=2344:00 +CPU= 11.046
  01:04:49 STEP 2345 H=2345:00 +CPU= 10.808
  01:05:06 STEP 2346 H=2346:00 +CPU= 17.239
  01:05:17 STEP 2347 H=2347:00 +CPU= 10.953
  01:05:28 STEP 2348 H=2348:00 +CPU= 11.491
  01:05:45 STEP 2349 H=2349:00 +CPU= 16.783
  01:05:56 STEP 2350 H=2350:00 +CPU= 10.849
  01:06:07 STEP 2351 H=2351:00 +CPU= 11.236
  01:06:27 STEP 2352 H=2352:00 +CPU= 20.195
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002352
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002352
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002352
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002328
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002328
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002328
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002340
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002340
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002340
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0984_2011050100_123_980_12197628_1_r1095360468_97.zip
Uploading the intermediate file: upload_file_97.zip
  01:06:39 STEP 2353 H=2353:00 +CPU= 11.064
  01:06:50 STEP 2354 H=2354:00 +CPU= 11.127
  01:07:06 STEP 2355 H=2355:00 +CPU= 16.491
  01:07:17 STEP 2356 H=2356:00 +CPU= 11.036
  01:07:28 STEP 2357 H=2357:00 +CPU= 11.046
  01:07:45 STEP 2358 H=2358:00 +CPU= 16.664
  01:07:56 STEP 2359 H=2359:00 +CPU= 10.828
  01:08:07 STEP 2360 H=2360:00 +CPU= 11.193
  01:08:23 STEP 2361 H=2361:00 +CPU= 16.480
  01:08:35 STEP 2362 H=2362:00 +CPU= 11.336
  01:08:46 STEP 2363 H=2363:00 +CPU= 10.860
  01:09:04 STEP 2364 H=2364:00 +CPU= 18.597
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002364
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002364
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002364
  01:09:15 STEP 2365 H=2365:00 +CPU= 10.992
  01:09:26 STEP 2366 H=2366:00 +CPU= 11.146
  01:09:43 STEP 2367 H=2367:00 +CPU= 16.512
  01:09:54 STEP 2368 H=2368:00 +CPU= 11.217
  01:10:05 STEP 2369 H=2369:00 +CPU= 10.773
  01:10:22 STEP 2370 H=2370:00 +CPU= 17.057
  01:10:33 STEP 2371 H=2371:00 +CPU= 10.696
  01:10:44 STEP 2372 H=2372:00 +CPU= 11.285
  01:11:01 STEP 2373 H=2373:00 +CPU= 16.544
  01:11:12 STEP 2374 H=2374:00 +CPU= 11.142
  01:11:23 STEP 2375 H=2375:00 +CPU= 11.342
  01:11:43 STEP 2376 H=2376:00 +CPU= 19.930
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002376
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002376
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002376
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002352
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002352
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002352
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002364
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002364
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002364
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0984_2011050100_123_980_12197628_1_r1095360468_98.zip
Uploading the intermediate file: upload_file_98.zip
  01:11:54 STEP 2377 H=2377:00 +CPU= 10.702
  01:12:05 STEP 2378 H=2378:00 +CPU= 10.973
  01:12:21 STEP 2379 H=2379:00 +CPU= 16.394
  01:12:32 STEP 2380 H=2380:00 +CPU= 11.155
  01:12:43 STEP 2381 H=2381:00 +CPU= 10.649
  01:13:00 STEP 2382 H=2382:00 +CPU= 17.087
  01:13:11 STEP 2383 H=2383:00 +CPU= 10.838
  01:13:22 STEP 2384 H=2384:00 +CPU= 11.088
  01:13:39 STEP 2385 H=2385:00 +CPU= 16.778
  01:13:50 STEP 2386 H=2386:00 +CPU= 11.412
  01:14:01 STEP 2387 H=2387:00 +CPU= 11.065
  01:14:20 STEP 2388 H=2388:00 +CPU= 18.398
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002388
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002388
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002388
  01:14:31 STEP 2389 H=2389:00 +CPU= 10.715
  01:14:42 STEP 2390 H=2390:00 +CPU= 11.147
  01:14:58 STEP 2391 H=2391:00 +CPU= 16.278
  01:15:09 STEP 2392 H=2392:00 +CPU= 11.063
  01:15:20 STEP 2393 H=2393:00 +CPU= 10.875
  01:15:37 STEP 2394 H=2394:00 +CPU= 16.847
  01:15:48 STEP 2395 H=2395:00 +CPU= 10.751
  01:15:59 STEP 2396 H=2396:00 +CPU= 11.176
  01:16:15 STEP 2397 H=2397:00 +CPU= 16.642
  01:16:26 STEP 2398 H=2398:00 +CPU= 11.025
  01:16:38 STEP 2399 H=2399:00 +CPU= 11.170
  01:16:58 STEP 2400 H=2400:00 +CPU= 20.176
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002400
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002400
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002400
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002376
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002376
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002376
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002388
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002388
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002388
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0984_2011050100_123_980_12197628_1_r1095360468_99.zip
Uploading the intermediate file: upload_file_99.zip
  01:17:08 STEP 2401 H=2401:00 +CPU= 10.701
  01:17:20 STEP 2402 H=2402:00 +CPU= 11.235
Uploading trickle at timestep: 8640000
  01:17:37 STEP 2403 H=2403:00 +CPU= 16.774
  01:17:48 STEP 2404 H=2404:00 +CPU= 11.237
  01:17:58 STEP 2405 H=2405:00 +CPU= 10.654
  01:18:15 STEP 2406 H=2406:00 +CPU= 16.813
  01:18:26 STEP 2407 H=2407:00 +CPU= 10.656
  01:18:37 STEP 2408 H=2408:00 +CPU= 11.258
  01:18:54 STEP 2409 H=2409:00 +CPU= 16.532
  01:19:05 STEP 2410 H=2410:00 +CPU= 11.005
  01:19:16 STEP 2411 H=2411:00 +CPU= 11.021
  01:19:35 STEP 2412 H=2412:00 +CPU= 18.811
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002412
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002412
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002412
  01:19:45 STEP 2413 H=2413:00 +CPU= 10.905
  01:19:56 STEP 2414 H=2414:00 +CPU= 10.893
  01:20:13 STEP 2415 H=2415:00 +CPU= 16.526
  01:20:24 STEP 2416 H=2416:00 +CPU= 11.010
  01:20:34 STEP 2417 H=2417:00 +CPU= 10.479
  01:20:51 STEP 2418 H=2418:00 +CPU= 16.776
  01:21:02 STEP 2419 H=2419:00 +CPU= 10.634
  01:21:13 STEP 2420 H=2420:00 +CPU= 11.073
  01:21:30 STEP 2421 H=2421:00 +CPU= 16.856
  01:21:41 STEP 2422 H=2422:00 +CPU= 11.127
  01:21:52 STEP 2423 H=2423:00 +CPU= 11.415
  01:22:13 STEP 2424 H=2424:00 +CPU= 20.329
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002424
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002424
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002424
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002400
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002400
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002400
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002412
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002412
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002412
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0984_2011050100_123_980_12197628_1_r1095360468_100.zip
Uploading the intermediate file: upload_file_100.zip
  01:22:23 STEP 2425 H=2425:00 +CPU= 10.736
  01:22:34 STEP 2426 H=2426:00 +CPU= 10.958
  01:22:51 STEP 2427 H=2427:00 +CPU= 16.498
  01:23:02 STEP 2428 H=2428:00 +CPU= 11.008
  01:23:13 STEP 2429 H=2429:00 +CPU= 10.702
  01:23:30 STEP 2430 H=2430:00 +CPU= 16.817
  01:23:40 STEP 2431 H=2431:00 +CPU= 10.751
  01:23:51 STEP 2432 H=2432:00 +CPU= 11.179
  01:24:08 STEP 2433 H=2433:00 +CPU= 16.189
  01:24:19 STEP 2434 H=2434:00 +CPU= 11.158
  01:24:30 STEP 2435 H=2435:00 +CPU= 10.899
  01:24:48 STEP 2436 H=2436:00 +CPU= 18.644
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002436
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002436
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002436
  01:24:59 STEP 2437 H=2437:00 +CPU= 10.772
  01:25:11 STEP 2438 H=2438:00 +CPU= 11.375
  01:25:27 STEP 2439 H=2439:00 +CPU= 16.625
  01:25:38 STEP 2440 H=2440:00 +CPU= 10.934
  01:25:49 STEP 2441 H=2441:00 +CPU= 11.223
  01:26:07 STEP 2442 H=2442:00 +CPU= 17.199
  01:26:18 STEP 2443 H=2443:00 +CPU= 10.913
  01:26:29 STEP 2444 H=2444:00 +CPU= 11.803
  01:26:46 STEP 2445 H=2445:00 +CPU= 16.901
  01:26:58 STEP 2446 H=2446:00 +CPU= 11.391
  01:27:09 STEP 2447 H=2447:00 +CPU= 11.202
  01:27:29 STEP 2448 H=2448:00 +CPU= 20.158
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002448
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002448
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002448
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002424
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002424
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002424
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002436
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002436
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002436
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0984_2011050100_123_980_12197628_1_r1095360468_101.zip
Uploading the intermediate file: upload_file_101.zip
  01:27:40 STEP 2449 H=2449:00 +CPU= 10.711
  01:27:51 STEP 2450 H=2450:00 +CPU= 11.029
  01:28:07 STEP 2451 H=2451:00 +CPU= 16.549
  01:28:18 STEP 2452 H=2452:00 +CPU= 10.787
  01:28:29 STEP 2453 H=2453:00 +CPU= 10.641
  01:28:46 STEP 2454 H=2454:00 +CPU= 16.986
  01:28:57 STEP 2455 H=2455:00 +CPU= 10.844
  01:29:08 STEP 2456 H=2456:00 +CPU= 11.236
  01:29:25 STEP 2457 H=2457:00 +CPU= 16.572
  01:29:36 STEP 2458 H=2458:00 +CPU= 11.139
  01:29:47 STEP 2459 H=2459:00 +CPU= 10.878
  01:30:06 STEP 2460 H=2460:00 +CPU= 19.119
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002460
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002460
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002460
  01:30:17 STEP 2461 H=2461:00 +CPU= 10.833
  01:30:28 STEP 2462 H=2462:00 +CPU= 11.158
  01:30:44 STEP 2463 H=2463:00 +CPU= 16.541
  01:30:55 STEP 2464 H=2464:00 +CPU= 11.088
  01:31:06 STEP 2465 H=2465:00 +CPU= 10.802
  01:31:23 STEP 2466 H=2466:00 +CPU= 17.084
  01:31:34 STEP 2467 H=2467:00 +CPU= 10.633
  01:31:45 STEP 2468 H=2468:00 +CPU= 11.065
  01:32:02 STEP 2469 H=2469:00 +CPU= 16.833
  01:32:13 STEP 2470 H=2470:00 +CPU= 11.136
  01:32:24 STEP 2471 H=2471:00 +CPU= 11.224
  01:32:44 STEP 2472 H=2472:00 +CPU= 20.077
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002472
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002472
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002472
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002448
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002448
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002448
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002460
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002460
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002460
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0984_2011050100_123_980_12197628_1_r1095360468_102.zip
Uploading the intermediate file: upload_file_102.zip
  01:32:55 STEP 2473 H=2473:00 +CPU= 10.770
  01:33:06 STEP 2474 H=2474:00 +CPU= 10.843
  01:33:22 STEP 2475 H=2475:00 +CPU= 16.519
  01:33:33 STEP 2476 H=2476:00 +CPU= 10.693
  01:33:44 STEP 2477 H=2477:00 +CPU= 10.918
  01:34:01 STEP 2478 H=2478:00 +CPU= 16.847
  01:34:12 STEP 2479 H=2479:00 +CPU= 10.602
  01:34:23 STEP 2480 H=2480:00 +CPU= 11.212
  01:34:39 STEP 2481 H=2481:00 +CPU= 16.364
  01:34:50 STEP 2482 H=2482:00 +CPU= 10.865
  01:35:01 STEP 2483 H=2483:00 +CPU= 10.900
  01:35:19 STEP 2484 H=2484:00 +CPU= 18.357
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002484
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002484
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002484
  01:35:30 STEP 2485 H=2485:00 +CPU= 10.923
  01:35:42 STEP 2486 H=2486:00 +CPU= 11.341
  01:35:58 STEP 2487 H=2487:00 +CPU= 16.485
  01:36:09 STEP 2488 H=2488:00 +CPU= 11.026
  01:36:20 STEP 2489 H=2489:00 +CPU= 11.027
  01:36:37 STEP 2490 H=2490:00 +CPU= 16.903
  01:36:48 STEP 2491 H=2491:00 +CPU= 10.833
  01:36:59 STEP 2492 H=2492:00 +CPU= 11.238
  01:37:16 STEP 2493 H=2493:00 +CPU= 16.788
  01:37:27 STEP 2494 H=2494:00 +CPU= 10.709
  01:37:38 STEP 2495 H=2495:00 +CPU= 11.060
  01:37:58 STEP 2496 H=2496:00 +CPU= 19.719
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002496
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002496
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002496
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002472
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002472
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002472
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002484
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002484
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002484
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0984_2011050100_123_980_12197628_1_r1095360468_103.zip
Uploading the intermediate file: upload_file_103.zip
  01:38:08 STEP 2497 H=2497:00 +CPU= 10.593
  01:38:19 STEP 2498 H=2498:00 +CPU= 11.247
  01:38:36 STEP 2499 H=2499:00 +CPU= 16.614
  01:38:48 STEP 2500 H=2500:00 +CPU= 11.230
  01:38:58 STEP 2501 H=2501:00 +CPU= 10.770
  01:39:15 STEP 2502 H=2502:00 +CPU= 16.510
  01:39:26 STEP 2503 H=2503:00 +CPU= 10.820
  01:39:37 STEP 2504 H=2504:00 +CPU= 10.970
  01:39:53 STEP 2505 H=2505:00 +CPU= 16.330
  01:40:04 STEP 2506 H=2506:00 +CPU= 10.657
  01:40:14 STEP 2507 H=2507:00 +CPU= 10.432
  01:40:32 STEP 2508 H=2508:00 +CPU= 18.058
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002508
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002508
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002508
  01:40:43 STEP 2509 H=2509:00 +CPU= 10.575
  01:40:54 STEP 2510 H=2510:00 +CPU= 10.903
  01:41:10 STEP 2511 H=2511:00 +CPU= 16.192
  01:41:20 STEP 2512 H=2512:00 +CPU= 10.580
  01:41:31 STEP 2513 H=2513:00 +CPU= 10.567
  01:41:48 STEP 2514 H=2514:00 +CPU= 16.642
  01:41:58 STEP 2515 H=2515:00 +CPU= 10.576
  01:42:09 STEP 2516 H=2516:00 +CPU= 10.751
  01:42:25 STEP 2517 H=2517:00 +CPU= 16.422
  01:42:36 STEP 2518 H=2518:00 +CPU= 10.700
  01:42:47 STEP 2519 H=2519:00 +CPU= 11.057
  01:43:07 STEP 2520 H=2520:00 +CPU= 19.679
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002520
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002520
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002520
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002496
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002496
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002496
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002508
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002508
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002508
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0984_2011050100_123_980_12197628_1_r1095360468_104.zip
Uploading the intermediate file: upload_file_104.zip
  01:43:18 STEP 2521 H=2521:00 +CPU= 10.665
  01:43:29 STEP 2522 H=2522:00 +CPU= 10.537
  01:43:45 STEP 2523 H=2523:00 +CPU= 16.427
  01:43:56 STEP 2524 H=2524:00 +CPU= 10.833
  01:44:06 STEP 2525 H=2525:00 +CPU= 10.394
  01:44:23 STEP 2526 H=2526:00 +CPU= 16.930
  01:44:34 STEP 2527 H=2527:00 +CPU= 10.791
  01:44:45 STEP 2528 H=2528:00 +CPU= 10.939
  01:45:02 STEP 2529 H=2529:00 +CPU= 16.590
  01:45:13 STEP 2530 H=2530:00 +CPU= 10.931
  01:45:23 STEP 2531 H=2531:00 +CPU= 10.803
  01:45:42 STEP 2532 H=2532:00 +CPU= 18.462
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002532
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002532
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002532
  01:45:53 STEP 2533 H=2533:00 +CPU= 10.721
  01:46:04 STEP 2534 H=2534:00 +CPU= 10.978
  01:46:20 STEP 2535 H=2535:00 +CPU= 16.664
  01:46:31 STEP 2536 H=2536:00 +CPU= 10.939
  01:46:42 STEP 2537 H=2537:00 +CPU= 10.975
  01:46:59 STEP 2538 H=2538:00 +CPU= 16.683
  01:47:10 STEP 2539 H=2539:00 +CPU= 10.737
  01:47:21 STEP 2540 H=2540:00 +CPU= 11.149
  01:47:38 STEP 2541 H=2541:00 +CPU= 16.782
  01:47:48 STEP 2542 H=2542:00 +CPU= 10.627
  01:48:00 STEP 2543 H=2543:00 +CPU= 11.248
  01:48:19 STEP 2544 H=2544:00 +CPU= 19.320
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002544
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002544
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002544
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002520
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002520
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002520
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002532
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002532
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002532
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0984_2011050100_123_980_12197628_1_r1095360468_105.zip
Uploading the intermediate file: upload_file_105.zip
  01:48:30 STEP 2545 H=2545:00 +CPU= 10.612
  01:48:41 STEP 2546 H=2546:00 +CPU= 10.937
  01:48:57 STEP 2547 H=2547:00 +CPU= 16.788
  01:49:08 STEP 2548 H=2548:00 +CPU= 10.783
  01:49:19 STEP 2549 H=2549:00 +CPU= 10.605
  01:49:36 STEP 2550 H=2550:00 +CPU= 16.855
  01:49:46 STEP 2551 H=2551:00 +CPU= 10.288
  01:49:57 STEP 2552 H=2552:00 +CPU= 11.062
  01:50:14 STEP 2553 H=2553:00 +CPU= 16.645
  01:50:24 STEP 2554 H=2554:00 +CPU= 10.575
  01:50:35 STEP 2555 H=2555:00 +CPU= 11.047
  01:50:54 STEP 2556 H=2556:00 +CPU= 18.330
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002556
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002556
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002556
  01:51:04 STEP 2557 H=2557:00 +CPU= 10.406
  01:51:15 STEP 2558 H=2558:00 +CPU= 10.864
  01:51:32 STEP 2559 H=2559:00 +CPU= 16.827
  01:51:42 STEP 2560 H=2560:00 +CPU= 10.361
  01:51:53 STEP 2561 H=2561:00 +CPU= 10.805
  01:52:10 STEP 2562 H=2562:00 +CPU= 17.267
  01:52:20 STEP 2563 H=2563:00 +CPU= 10.158
  01:52:32 STEP 2564 H=2564:00 +CPU= 11.186
  01:52:49 STEP 2565 H=2565:00 +CPU= 17.131
  01:52:59 STEP 2566 H=2566:00 +CPU= 10.123
  01:53:10 STEP 2567 H=2567:00 +CPU= 11.040
  01:53:30 STEP 2568 H=2568:00 +CPU= 19.932
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002568
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002568
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002568
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002544
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002544
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002544
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002556
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002556
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002556
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0984_2011050100_123_980_12197628_1_r1095360468_106.zip
Uploading the intermediate file: upload_file_106.zip
  01:53:40 STEP 2569 H=2569:00 +CPU= 10.496
  01:53:52 STEP 2570 H=2570:00 +CPU= 11.159
  01:54:09 STEP 2571 H=2571:00 +CPU= 17.084
  01:54:19 STEP 2572 H=2572:00 +CPU= 10.551
  01:54:30 STEP 2573 H=2573:00 +CPU= 10.771
  01:54:47 STEP 2574 H=2574:00 +CPU= 17.352
  01:54:58 STEP 2575 H=2575:00 +CPU= 10.298
  01:55:09 STEP 2576 H=2576:00 +CPU= 11.188
  01:55:26 STEP 2577 H=2577:00 +CPU= 17.082
  01:55:36 STEP 2578 H=2578:00 +CPU= 10.161
  01:55:47 STEP 2579 H=2579:00 +CPU= 10.788
  01:56:06 STEP 2580 H=2580:00 +CPU= 18.679
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002580
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002580
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002580
  01:56:16 STEP 2581 H=2581:00 +CPU= 10.025
  01:56:27 STEP 2582 H=2582:00 +CPU= 11.073
  01:56:44 STEP 2583 H=2583:00 +CPU= 17.173
  01:56:54 STEP 2584 H=2584:00 +CPU= 10.109
  01:57:05 STEP 2585 H=2585:00 +CPU= 10.791
  01:57:22 STEP 2586 H=2586:00 +CPU= 17.490
  01:57:32 STEP 2587 H=2587:00 +CPU=  9.930
  01:57:43 STEP 2588 H=2588:00 +CPU= 11.073
  01:58:01 STEP 2589 H=2589:00 +CPU= 17.254
  01:58:11 STEP 2590 H=2590:00 +CPU= 10.087
  01:58:22 STEP 2591 H=2591:00 +CPU= 10.883
  01:58:42 STEP 2592 H=2592:00 +CPU= 20.135
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002592
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002592
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002592
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002568
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002568
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002568
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002580
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002580
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002580
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0984_2011050100_123_980_12197628_1_r1095360468_107.zip
Uploading the intermediate file: upload_file_107.zip
  01:58:52 STEP 2593 H=2593:00 +CPU=  9.986
  01:59:03 STEP 2594 H=2594:00 +CPU= 11.093
  01:59:20 STEP 2595 H=2595:00 +CPU= 17.279
  01:59:30 STEP 2596 H=2596:00 +CPU= 10.133
  01:59:41 STEP 2597 H=2597:00 +CPU= 10.877
  01:59:58 STEP 2598 H=2598:00 +CPU= 17.362
  02:00:09 STEP 2599 H=2599:00 +CPU= 10.144
  02:00:20 STEP 2600 H=2600:00 +CPU= 11.085
  02:00:37 STEP 2601 H=2601:00 +CPU= 17.128
  02:00:47 STEP 2602 H=2602:00 +CPU= 10.279
  02:00:58 STEP 2603 H=2603:00 +CPU= 10.606
  02:01:17 STEP 2604 H=2604:00 +CPU= 18.707
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002604
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002604
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002604
  02:01:27 STEP 2605 H=2605:00 +CPU= 10.102
  02:01:38 STEP 2606 H=2606:00 +CPU= 11.076
  02:01:55 STEP 2607 H=2607:00 +CPU= 16.842
  02:02:05 STEP 2608 H=2608:00 +CPU= 10.461
  02:02:16 STEP 2609 H=2609:00 +CPU= 10.729
  02:02:33 STEP 2610 H=2610:00 +CPU= 17.034
  02:02:43 STEP 2611 H=2611:00 +CPU= 10.102
  02:02:54 STEP 2612 H=2612:00 +CPU= 10.669
  02:03:10 STEP 2613 H=2613:00 +CPU= 16.563
  02:03:21 STEP 2614 H=2614:00 +CPU= 11.107
  02:03:32 STEP 2615 H=2615:00 +CPU= 10.954
  02:03:52 STEP 2616 H=2616:00 +CPU= 20.114
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002616
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002616
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002616
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002592
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002592
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002592
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002604
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002604
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002604
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0984_2011050100_123_980_12197628_1_r1095360468_108.zip
  02:04:03 STEP 2617 H=2617:00 +CPU= 10.314
Uploading the intermediate file: upload_file_108.zip
  02:04:14 STEP 2618 H=2618:00 +CPU= 11.084
  02:04:31 STEP 2619 H=2619:00 +CPU= 17.014
  02:04:42 STEP 2620 H=2620:00 +CPU= 10.569
  02:04:52 STEP 2621 H=2621:00 +CPU= 10.623
  02:05:10 STEP 2622 H=2622:00 +CPU= 17.467
  02:05:20 STEP 2623 H=2623:00 +CPU= 10.300
  02:05:31 STEP 2624 H=2624:00 +CPU= 10.837
  02:05:47 STEP 2625 H=2625:00 +CPU= 16.613
  02:05:58 STEP 2626 H=2626:00 +CPU= 10.839
  02:06:09 STEP 2627 H=2627:00 +CPU= 10.562
  02:06:27 STEP 2628 H=2628:00 +CPU= 18.248
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002628
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002628
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002628
  02:06:37 STEP 2629 H=2629:00 +CPU= 10.403
  02:06:48 STEP 2630 H=2630:00 +CPU= 10.845
  02:07:05 STEP 2631 H=2631:00 +CPU= 16.478
  02:07:16 STEP 2632 H=2632:00 +CPU= 10.823
  02:07:26 STEP 2633 H=2633:00 +CPU= 10.632
  02:07:43 STEP 2634 H=2634:00 +CPU= 17.007
  02:07:54 STEP 2635 H=2635:00 +CPU= 10.841
  02:08:05 STEP 2636 H=2636:00 +CPU= 11.029
  02:08:22 STEP 2637 H=2637:00 +CPU= 16.755
  02:08:33 STEP 2638 H=2638:00 +CPU= 11.048
  02:08:44 STEP 2639 H=2639:00 +CPU= 10.951
  02:09:04 STEP 2640 H=2640:00 +CPU= 19.958
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002640
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002640
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002640
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002616
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002616
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002616
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002628
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002628
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002628
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0984_2011050100_123_980_12197628_1_r1095360468_109.zip
Uploading the intermediate file: upload_file_109.zip
  02:09:14 STEP 2641 H=2641:00 +CPU= 10.477
Uploading trickle at timestep: 9504000
  02:09:25 STEP 2642 H=2642:00 +CPU= 10.758
  02:09:42 STEP 2643 H=2643:00 +CPU= 16.933
  02:09:53 STEP 2644 H=2644:00 +CPU= 11.084
  02:10:04 STEP 2645 H=2645:00 +CPU= 10.684
  02:10:21 STEP 2646 H=2646:00 +CPU= 17.066
  02:10:32 STEP 2647 H=2647:00 +CPU= 10.985
  02:10:43 STEP 2648 H=2648:00 +CPU= 11.026
  02:11:00 STEP 2649 H=2649:00 +CPU= 16.898
  02:11:11 STEP 2650 H=2650:00 +CPU= 11.261
  02:11:22 STEP 2651 H=2651:00 +CPU= 10.767
  02:11:40 STEP 2652 H=2652:00 +CPU= 18.318
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002652
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002652
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002652
  02:11:51 STEP 2653 H=2653:00 +CPU= 10.322
  02:12:01 STEP 2654 H=2654:00 +CPU= 10.765
  02:12:18 STEP 2655 H=2655:00 +CPU= 16.746
  02:12:29 STEP 2656 H=2656:00 +CPU= 11.059
  02:12:40 STEP 2657 H=2657:00 +CPU= 10.667
  02:12:57 STEP 2658 H=2658:00 +CPU= 17.068
  02:13:08 STEP 2659 H=2659:00 +CPU= 10.838
  02:13:19 STEP 2660 H=2660:00 +CPU= 11.051
  02:13:36 STEP 2661 H=2661:00 +CPU= 16.782
  02:13:47 STEP 2662 H=2662:00 +CPU= 11.081
  02:13:57 STEP 2663 H=2663:00 +CPU= 10.647
  02:14:18 STEP 2664 H=2664:00 +CPU= 20.038
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002664
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002664
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002664
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002640
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002640
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002640
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002652
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002652
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002652
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0984_2011050100_123_980_12197628_1_r1095360468_110.zip
Uploading the intermediate file: upload_file_110.zip
  02:14:28 STEP 2665 H=2665:00 +CPU= 10.727
  02:14:39 STEP 2666 H=2666:00 +CPU= 10.883
  02:14:56 STEP 2667 H=2667:00 +CPU= 16.746
  02:15:07 STEP 2668 H=2668:00 +CPU= 11.407
  02:15:18 STEP 2669 H=2669:00 +CPU= 10.637
  02:15:35 STEP 2670 H=2670:00 +CPU= 16.950
  02:15:46 STEP 2671 H=2671:00 +CPU= 10.833
  02:15:57 STEP 2672 H=2672:00 +CPU= 11.046
  02:16:14 STEP 2673 H=2673:00 +CPU= 17.075
  02:16:25 STEP 2674 H=2674:00 +CPU= 10.950
  02:16:36 STEP 2675 H=2675:00 +CPU= 10.791
  02:16:54 STEP 2676 H=2676:00 +CPU= 18.743
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002676
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002676
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002676
  02:17:06 STEP 2677 H=2677:00 +CPU= 11.114
  02:17:17 STEP 2678 H=2678:00 +CPU= 10.925
  02:17:33 STEP 2679 H=2679:00 +CPU= 16.852
  02:17:44 STEP 2680 H=2680:00 +CPU= 10.744
  02:17:55 STEP 2681 H=2681:00 +CPU= 10.735
  02:18:12 STEP 2682 H=2682:00 +CPU= 17.181
  02:18:23 STEP 2683 H=2683:00 +CPU= 11.025
  02:18:34 STEP 2684 H=2684:00 +CPU= 10.928
  02:18:51 STEP 2685 H=2685:00 +CPU= 16.741
  02:19:02 STEP 2686 H=2686:00 +CPU= 11.035
  02:19:13 STEP 2687 H=2687:00 +CPU= 10.854
  02:19:33 STEP 2688 H=2688:00 +CPU= 20.118
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002688
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002688
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002688
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002664
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002664
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002664
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002676
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002676
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002676
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0984_2011050100_123_980_12197628_1_r1095360468_111.zip
Uploading the intermediate file: upload_file_111.zip
  02:19:43 STEP 2689 H=2689:00 +CPU= 10.568
  02:19:54 STEP 2690 H=2690:00 +CPU= 10.738
  02:20:11 STEP 2691 H=2691:00 +CPU= 16.671
  02:20:22 STEP 2692 H=2692:00 +CPU= 11.025
  02:20:33 STEP 2693 H=2693:00 +CPU= 10.695
  02:20:50 STEP 2694 H=2694:00 +CPU= 17.080
  02:21:01 STEP 2695 H=2695:00 +CPU= 10.814
  02:21:12 STEP 2696 H=2696:00 +CPU= 11.114
  02:21:28 STEP 2697 H=2697:00 +CPU= 16.717
  02:21:39 STEP 2698 H=2698:00 +CPU= 10.853
  02:21:50 STEP 2699 H=2699:00 +CPU= 10.475
  02:22:08 STEP 2700 H=2700:00 +CPU= 18.626
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002700
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002700
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002700
  02:22:19 STEP 2701 H=2701:00 +CPU= 10.777
  02:22:30 STEP 2702 H=2702:00 +CPU= 11.037
  02:22:47 STEP 2703 H=2703:00 +CPU= 16.791
  02:22:58 STEP 2704 H=2704:00 +CPU= 11.174
  02:23:09 STEP 2705 H=2705:00 +CPU= 10.807
  02:23:26 STEP 2706 H=2706:00 +CPU= 17.252
  02:23:37 STEP 2707 H=2707:00 +CPU= 10.427
  02:23:47 STEP 2708 H=2708:00 +CPU= 10.736
  02:24:04 STEP 2709 H=2709:00 +CPU= 16.852
  02:24:15 STEP 2710 H=2710:00 +CPU= 10.987
  02:24:26 STEP 2711 H=2711:00 +CPU= 10.561
  02:24:46 STEP 2712 H=2712:00 +CPU= 20.036
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002712
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002712
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002712
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002688
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002688
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002688
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002700
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002700
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002700
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0984_2011050100_123_980_12197628_1_r1095360468_112.zip
Uploading the intermediate file: upload_file_112.zip
  02:24:56 STEP 2713 H=2713:00 +CPU= 10.428
  02:25:07 STEP 2714 H=2714:00 +CPU= 10.813
  02:25:24 STEP 2715 H=2715:00 +CPU= 16.757
  02:25:35 STEP 2716 H=2716:00 +CPU= 11.166
  02:25:46 STEP 2717 H=2717:00 +CPU= 10.916
  02:26:03 STEP 2718 H=2718:00 +CPU= 17.108
  02:26:14 STEP 2719 H=2719:00 +CPU= 10.483
  02:26:25 STEP 2720 H=2720:00 +CPU= 10.860
  02:26:42 STEP 2721 H=2721:00 +CPU= 17.125
  02:26:53 STEP 2722 H=2722:00 +CPU= 10.802
  02:27:03 STEP 2723 H=2723:00 +CPU= 10.416
  02:27:22 STEP 2724 H=2724:00 +CPU= 19.267
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002724
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002724
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002724
  02:27:33 STEP 2725 H=2725:00 +CPU= 10.647
  02:27:44 STEP 2726 H=2726:00 +CPU= 10.818
  02:28:01 STEP 2727 H=2727:00 +CPU= 16.989
  02:28:11 STEP 2728 H=2728:00 +CPU= 10.748
  02:28:22 STEP 2729 H=2729:00 +CPU= 10.326
  02:28:39 STEP 2730 H=2730:00 +CPU= 17.498
  02:28:50 STEP 2731 H=2731:00 +CPU= 10.226
  02:29:00 STEP 2732 H=2732:00 +CPU= 10.264
  02:29:17 STEP 2733 H=2733:00 +CPU= 17.474
  02:29:28 STEP 2734 H=2734:00 +CPU= 10.487
  02:29:38 STEP 2735 H=2735:00 +CPU= 10.047
  02:29:59 STEP 2736 H=2736:00 +CPU= 20.901
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002736
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002736
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002736
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002712
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002712
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002712
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002724
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002724
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002724
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0984_2011050100_123_980_12197628_1_r1095360468_113.zip
Uploading the intermediate file: upload_file_113.zip
  02:30:09 STEP 2737 H=2737:00 +CPU= 10.592
  02:30:20 STEP 2738 H=2738:00 +CPU= 10.463
  02:30:37 STEP 2739 H=2739:00 +CPU= 17.212
  02:30:48 STEP 2740 H=2740:00 +CPU= 10.860
  02:30:58 STEP 2741 H=2741:00 +CPU=  9.959
  02:31:16 STEP 2742 H=2742:00 +CPU= 17.665
  02:31:26 STEP 2743 H=2743:00 +CPU= 10.650
  02:31:37 STEP 2744 H=2744:00 +CPU= 10.160
  02:31:54 STEP 2745 H=2745:00 +CPU= 17.538
  02:32:05 STEP 2746 H=2746:00 +CPU= 10.787
  02:32:15 STEP 2747 H=2747:00 +CPU= 10.060
  02:32:34 STEP 2748 H=2748:00 +CPU= 19.154
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002748
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002748
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002748
  02:32:45 STEP 2749 H=2749:00 +CPU= 10.597
  02:32:55 STEP 2750 H=2750:00 +CPU= 10.235
  02:33:13 STEP 2751 H=2751:00 +CPU= 17.448
  02:33:23 STEP 2752 H=2752:00 +CPU= 10.798
  02:33:33 STEP 2753 H=2753:00 +CPU=  9.952
  02:33:51 STEP 2754 H=2754:00 +CPU= 17.486
  02:34:01 STEP 2755 H=2755:00 +CPU= 10.570
  02:34:11 STEP 2756 H=2756:00 +CPU= 10.042
  02:34:29 STEP 2757 H=2757:00 +CPU= 17.075
  02:34:40 STEP 2758 H=2758:00 +CPU= 11.169
  02:34:50 STEP 2759 H=2759:00 +CPU= 10.580
  02:35:12 STEP 2760 H=2760:00 +CPU= 20.350
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002760
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002760
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002760
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002736
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002736
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002736
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002748
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002748
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002748
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0984_2011050100_123_980_12197628_1_r1095360468_114.zip
Uploading the intermediate file: upload_file_114.zip
  02:35:23 STEP 2761 H=2761:00 +CPU= 10.647
  02:35:33 STEP 2762 H=2762:00 +CPU= 10.009
  02:35:51 STEP 2763 H=2763:00 +CPU= 17.492
  02:36:02 STEP 2764 H=2764:00 +CPU= 10.829
  02:36:12 STEP 2765 H=2765:00 +CPU=  9.996
  02:36:29 STEP 2766 H=2766:00 +CPU= 17.542
  02:36:40 STEP 2767 H=2767:00 +CPU= 10.641
  02:36:50 STEP 2768 H=2768:00 +CPU= 10.229
  02:37:07 STEP 2769 H=2769:00 +CPU= 17.164
  02:37:18 STEP 2770 H=2770:00 +CPU= 11.191
  02:37:29 STEP 2771 H=2771:00 +CPU= 10.166
  02:37:47 STEP 2772 H=2772:00 +CPU= 18.891
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002772
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002772
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002772
  02:37:58 STEP 2773 H=2773:00 +CPU= 10.713
  02:38:08 STEP 2774 H=2774:00 +CPU= 10.096
  02:38:25 STEP 2775 H=2775:00 +CPU= 16.903
  02:38:36 STEP 2776 H=2776:00 +CPU= 11.037
  02:38:47 STEP 2777 H=2777:00 +CPU= 10.299
  02:39:04 STEP 2778 H=2778:00 +CPU= 17.071
  02:39:15 STEP 2779 H=2779:00 +CPU= 10.902
  02:39:25 STEP 2780 H=2780:00 +CPU= 10.805
  02:39:42 STEP 2781 H=2781:00 +CPU= 16.804
  02:39:53 STEP 2782 H=2782:00 +CPU= 11.019
  02:40:04 STEP 2783 H=2783:00 +CPU= 10.811
  02:40:24 STEP 2784 H=2784:00 +CPU= 20.021
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002784
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002784
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002784
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002760
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002760
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002760
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002772
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002772
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002772
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0984_2011050100_123_980_12197628_1_r1095360468_115.zip
Uploading the intermediate file: upload_file_115.zip
  02:40:35 STEP 2785 H=2785:00 +CPU= 10.665
  02:40:45 STEP 2786 H=2786:00 +CPU= 10.445
  02:41:03 STEP 2787 H=2787:00 +CPU= 17.292
  02:41:14 STEP 2788 H=2788:00 +CPU= 11.436
  02:41:24 STEP 2789 H=2789:00 +CPU= 10.396
  02:41:42 STEP 2790 H=2790:00 +CPU= 17.564
  02:41:53 STEP 2791 H=2791:00 +CPU= 10.859
  02:42:04 STEP 2792 H=2792:00 +CPU= 10.921
  02:42:21 STEP 2793 H=2793:00 +CPU= 16.759
  02:42:32 STEP 2794 H=2794:00 +CPU= 11.005
  02:42:42 STEP 2795 H=2795:00 +CPU= 10.581
  02:43:01 STEP 2796 H=2796:00 +CPU= 18.476
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002796
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002796
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002796
  02:43:12 STEP 2797 H=2797:00 +CPU= 10.910
  02:43:22 STEP 2798 H=2798:00 +CPU= 10.764
  02:43:39 STEP 2799 H=2799:00 +CPU= 16.982
  02:43:51 STEP 2800 H=2800:00 +CPU= 11.400
  02:44:01 STEP 2801 H=2801:00 +CPU= 10.653
  02:44:19 STEP 2802 H=2802:00 +CPU= 17.281
  02:44:30 STEP 2803 H=2803:00 +CPU= 10.919
  02:44:41 STEP 2804 H=2804:00 +CPU= 10.951
  02:44:58 STEP 2805 H=2805:00 +CPU= 16.948
  02:45:09 STEP 2806 H=2806:00 +CPU= 11.100
  02:45:20 STEP 2807 H=2807:00 +CPU= 11.171
  02:45:40 STEP 2808 H=2808:00 +CPU= 20.344
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002808
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002808
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002808
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002784
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002784
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002784
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002796
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002796
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002796
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0984_2011050100_123_980_12197628_1_r1095360468_116.zip
Uploading the intermediate file: upload_file_116.zip
  02:45:51 STEP 2809 H=2809:00 +CPU= 11.029
  02:46:02 STEP 2810 H=2810:00 +CPU= 10.326
  02:46:19 STEP 2811 H=2811:00 +CPU= 16.990
  02:46:30 STEP 2812 H=2812:00 +CPU= 11.445
  02:46:41 STEP 2813 H=2813:00 +CPU= 10.313
  02:46:58 STEP 2814 H=2814:00 +CPU= 17.175
  02:47:09 STEP 2815 H=2815:00 +CPU= 10.840
  02:47:19 STEP 2816 H=2816:00 +CPU= 10.666
  02:47:36 STEP 2817 H=2817:00 +CPU= 16.746
  02:47:47 STEP 2818 H=2818:00 +CPU= 11.238
  02:47:58 STEP 2819 H=2819:00 +CPU= 10.899
  02:48:17 STEP 2820 H=2820:00 +CPU= 18.830
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002820
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002820
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002820
  02:48:28 STEP 2821 H=2821:00 +CPU= 11.119
  02:48:39 STEP 2822 H=2822:00 +CPU= 10.891
  02:48:56 STEP 2823 H=2823:00 +CPU= 16.922
  02:49:07 STEP 2824 H=2824:00 +CPU= 10.977
  02:49:18 STEP 2825 H=2825:00 +CPU= 10.623
  02:49:35 STEP 2826 H=2826:00 +CPU= 17.177
  02:49:46 STEP 2827 H=2827:00 +CPU= 10.960
  02:49:57 STEP 2828 H=2828:00 +CPU= 11.109
  02:50:14 STEP 2829 H=2829:00 +CPU= 17.085
  02:50:25 STEP 2830 H=2830:00 +CPU= 11.274
  02:50:36 STEP 2831 H=2831:00 +CPU= 10.960
  02:50:57 STEP 2832 H=2832:00 +CPU= 20.451
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002832
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002832
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002832
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002808
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002808
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002808
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002820
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002820
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002820
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0984_2011050100_123_980_12197628_1_r1095360468_117.zip
Uploading the intermediate file: upload_file_117.zip
  02:51:08 STEP 2833 H=2833:00 +CPU= 11.105
  02:51:18 STEP 2834 H=2834:00 +CPU= 10.457
  02:51:35 STEP 2835 H=2835:00 +CPU= 16.832
  02:51:46 STEP 2836 H=2836:00 +CPU= 10.981
  02:51:58 STEP 2837 H=2837:00 +CPU= 10.410
  02:52:15 STEP 2838 H=2838:00 +CPU= 17.380
  02:52:26 STEP 2839 H=2839:00 +CPU= 10.731
  02:52:37 STEP 2840 H=2840:00 +CPU= 10.676
  02:52:54 STEP 2841 H=2841:00 +CPU= 17.075
  02:53:05 STEP 2842 H=2842:00 +CPU= 11.230
  02:53:15 STEP 2843 H=2843:00 +CPU= 10.510
  02:53:34 STEP 2844 H=2844:00 +CPU= 18.653
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002844
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002844
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002844
  02:53:45 STEP 2845 H=2845:00 +CPU= 11.036
  02:53:56 STEP 2846 H=2846:00 +CPU= 10.489
  02:54:13 STEP 2847 H=2847:00 +CPU= 17.099
  02:54:24 STEP 2848 H=2848:00 +CPU= 11.293
  02:54:35 STEP 2849 H=2849:00 +CPU= 10.406
  02:54:52 STEP 2850 H=2850:00 +CPU= 17.126
  02:55:02 STEP 2851 H=2851:00 +CPU= 10.725
  02:55:13 STEP 2852 H=2852:00 +CPU= 10.653
  02:55:30 STEP 2853 H=2853:00 +CPU= 16.621
  02:55:41 STEP 2854 H=2854:00 +CPU= 11.300
  02:55:52 STEP 2855 H=2855:00 +CPU= 11.111
  02:56:13 STEP 2856 H=2856:00 +CPU= 20.519
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002856
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002856
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002856
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002832
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002832
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002832
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002844
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002844
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002844
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0984_2011050100_123_980_12197628_1_r1095360468_118.zip
Uploading the intermediate file: upload_file_118.zip
  02:56:24 STEP 2857 H=2857:00 +CPU= 11.118
  02:56:34 STEP 2858 H=2858:00 +CPU= 10.515
  02:56:51 STEP 2859 H=2859:00 +CPU= 16.943
  02:57:02 STEP 2860 H=2860:00 +CPU= 10.885
  02:57:13 STEP 2861 H=2861:00 +CPU= 10.374
  02:57:30 STEP 2862 H=2862:00 +CPU= 17.568
  02:57:41 STEP 2863 H=2863:00 +CPU= 10.822
  02:57:52 STEP 2864 H=2864:00 +CPU= 10.781
  02:58:09 STEP 2865 H=2865:00 +CPU= 16.806
  02:58:20 STEP 2866 H=2866:00 +CPU= 11.153
  02:58:31 STEP 2867 H=2867:00 +CPU= 10.609
  02:58:49 STEP 2868 H=2868:00 +CPU= 18.672
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002868
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002868
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002868
  02:59:00 STEP 2869 H=2869:00 +CPU= 11.033
  02:59:11 STEP 2870 H=2870:00 +CPU= 10.636
  02:59:28 STEP 2871 H=2871:00 +CPU= 16.867
  02:59:39 STEP 2872 H=2872:00 +CPU= 10.984
  02:59:49 STEP 2873 H=2873:00 +CPU= 10.573
  03:00:07 STEP 2874 H=2874:00 +CPU= 17.136
  03:00:17 STEP 2875 H=2875:00 +CPU= 10.848
  03:00:29 STEP 2876 H=2876:00 +CPU= 11.008
  03:00:45 STEP 2877 H=2877:00 +CPU= 16.751
  03:00:57 STEP 2878 H=2878:00 +CPU= 11.356
  03:01:08 STEP 2879 H=2879:00 +CPU= 11.234
  03:01:28 STEP 2880 H=2880:00 +CPU= 20.032
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002880
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002880
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002880
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002856
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002856
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002856
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002868
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002868
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002868
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0984_2011050100_123_980_12197628_1_r1095360468_119.zip
Uploading the intermediate file: upload_file_119.zip
  03:01:39 STEP 2881 H=2881:00 +CPU= 10.753
  03:01:50 STEP 2882 H=2882:00 +CPU= 10.373
Uploading trickle at timestep: 10368000
  03:02:06 STEP 2883 H=2883:00 +CPU= 16.814
  03:02:17 STEP 2884 H=2884:00 +CPU= 10.987
  03:02:28 STEP 2885 H=2885:00 +CPU= 10.429
  03:02:45 STEP 2886 H=2886:00 +CPU= 17.064
  03:02:56 STEP 2887 H=2887:00 +CPU= 10.779
  03:03:07 STEP 2888 H=2888:00 +CPU= 10.897
  03:03:24 STEP 2889 H=2889:00 +CPU= 16.928
  03:03:35 STEP 2890 H=2890:00 +CPU= 11.217
  03:03:46 STEP 2891 H=2891:00 +CPU= 10.744
  03:04:04 STEP 2892 H=2892:00 +CPU= 18.871
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002892
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002892
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002892
  03:04:15 STEP 2893 H=2893:00 +CPU= 10.901
  03:04:26 STEP 2894 H=2894:00 +CPU= 10.623
  03:04:43 STEP 2895 H=2895:00 +CPU= 16.811
  03:04:55 STEP 2896 H=2896:00 +CPU= 11.291
  03:05:06 STEP 2897 H=2897:00 +CPU= 10.598
  03:05:23 STEP 2898 H=2898:00 +CPU= 17.355
  03:05:34 STEP 2899 H=2899:00 +CPU= 10.858
  03:05:45 STEP 2900 H=2900:00 +CPU= 10.917
  03:06:02 STEP 2901 H=2901:00 +CPU= 16.868
  03:06:13 STEP 2902 H=2902:00 +CPU= 11.284
  03:06:24 STEP 2903 H=2903:00 +CPU= 11.183
  03:06:45 STEP 2904 H=2904:00 +CPU= 20.145
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002904
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002904
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002904
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002880
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002880
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002880
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002892
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002892
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002892
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0984_2011050100_123_980_12197628_1_r1095360468_120.zip
Uploading the intermediate file: upload_file_120.zip
  03:06:55 STEP 2905 H=2905:00 +CPU= 10.810
  03:07:06 STEP 2906 H=2906:00 +CPU= 10.177
  03:07:23 STEP 2907 H=2907:00 +CPU= 16.949
  03:07:34 STEP 2908 H=2908:00 +CPU= 11.333
  03:07:44 STEP 2909 H=2909:00 +CPU= 10.377
  03:08:01 STEP 2910 H=2910:00 +CPU= 16.797
  03:08:12 STEP 2911 H=2911:00 +CPU= 10.288
  03:08:22 STEP 2912 H=2912:00 +CPU= 10.564
  03:08:38 STEP 2913 H=2913:00 +CPU= 16.122
  03:08:49 STEP 2914 H=2914:00 +CPU= 10.808
  03:08:59 STEP 2915 H=2915:00 +CPU= 10.132
  03:09:17 STEP 2916 H=2916:00 +CPU= 17.700
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002916
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002916
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002916
  03:09:27 STEP 2917 H=2917:00 +CPU= 10.518
  03:09:38 STEP 2918 H=2918:00 +CPU= 10.293
  03:09:53 STEP 2919 H=2919:00 +CPU= 15.737
  03:10:04 STEP 2920 H=2920:00 +CPU= 10.190
  03:10:14 STEP 2921 H=2921:00 +CPU=  9.849
  03:10:29 STEP 2922 H=2922:00 +CPU= 15.837
  03:10:40 STEP 2923 H=2923:00 +CPU= 10.174
  03:10:50 STEP 2924 H=2924:00 +CPU= 10.249
  03:11:06 STEP 2925 H=2925:00 +CPU= 15.771
  03:11:16 STEP 2926 H=2926:00 +CPU= 10.457
  03:11:27 STEP 2927 H=2927:00 +CPU= 10.622
  03:11:46 STEP 2928 H=2928:00 +CPU= 19.063
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002928
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002928
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002928
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002904
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002904
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002904
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002916
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002916
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002916
Zipping up the intermediate file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0984_2011050100_123_980_12197628_1_r1095360468_121.zip
Uploading the intermediate file: upload_file_121.zip
  03:11:56 STEP 2929 H=2929:00 +CPU= 10.358
  03:12:06 STEP 2930 H=2930:00 +CPU= 10.238
  03:12:23 STEP 2931 H=2931:00 +CPU= 16.240
  03:12:33 STEP 2932 H=2932:00 +CPU= 10.553
  03:12:43 STEP 2933 H=2933:00 +CPU=  9.965
  03:12:59 STEP 2934 H=2934:00 +CPU= 16.307
  03:13:10 STEP 2935 H=2935:00 +CPU= 10.368
  03:13:21 STEP 2936 H=2936:00 +CPU= 10.770
  03:13:37 STEP 2937 H=2937:00 +CPU= 16.377
  03:13:48 STEP 2938 H=2938:00 +CPU= 10.636
  03:13:58 STEP 2939 H=2939:00 +CPU= 10.366
  03:14:16 STEP 2940 H=2940:00 +CPU= 17.658
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002940
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002940
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002940
  03:14:26 STEP 2941 H=2941:00 +CPU= 10.348
  03:14:36 STEP 2942 H=2942:00 +CPU= 10.252
  03:14:52 STEP 2943 H=2943:00 +CPU= 15.807
  03:15:03 STEP 2944 H=2944:00 +CPU= 10.513
  03:15:13 STEP 2945 H=2945:00 +CPU= 10.302
  03:15:29 STEP 2946 H=2946:00 +CPU= 15.878
  03:15:39 STEP 2947 H=2947:00 +CPU= 10.136
  03:15:49 STEP 2948 H=2948:00 +CPU= 10.212
  03:16:05 STEP 2949 H=2949:00 +CPU= 15.524
  03:16:15 STEP 2950 H=2950:00 +CPU= 10.259
  03:16:25 STEP 2951 H=2951:00 +CPU= 10.261
  03:16:43 STEP 2952 H=2952:00 +CPU= 17.413
The child process terminated with status: 0
Moving to projects directory: /home/fritzb/slots/3/ICMGGhq0f+002952
Moving to projects directory: /home/fritzb/slots/3/ICMSHhq0f+002952
Moving to projects directory: /home/fritzb/slots/3/ICMUAhq0f+002952
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002952
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002940
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002928
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002952
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002952
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMUAhq0f+002928
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002940
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMSHhq0f+002940
Adding to the zip: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_12197628/ICMGGhq0f+002928
Zipping up the final file: /home/fritzb/projects/climateprediction.net/oifs_43r3_ps_0984_2011050100_123_980_12197628_1_r1095360468_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
03:20:06 (20507): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:25:22 1537731 22294482 oifs_43r3_ps_0984_2011050100_123_980_12197628_1 10,623,600 38,577 0.0036
09 May 2023 16:25:22 1537731 22294482 oifs_43r3_ps_0984_2011050100_123_980_12197628_1 10,368,000 37,674 0.0036
09 May 2023 16:25:17 1537731 22294482 oifs_43r3_ps_0984_2011050100_123_980_12197628_1 9,504,000 34,527 0.0036
09 May 2023 16:25:11 1537731 22294482 oifs_43r3_ps_0984_2011050100_123_980_12197628_1 8,640,000 31,413 0.0036
09 May 2023 16:25:05 1537731 22294482 oifs_43r3_ps_0984_2011050100_123_980_12197628_1 7,776,000 28,262 0.0036
09 May 2023 16:25:05 1537731 22294482 oifs_43r3_ps_0984_2011050100_123_980_12197628_1 6,912,000 25,123 0.0036
09 May 2023 16:25:00 1537731 22294482 oifs_43r3_ps_0984_2011050100_123_980_12197628_1 6,048,000 21,983 0.0036
09 May 2023 16:24:54 1537731 22294482 oifs_43r3_ps_0984_2011050100_123_980_12197628_1 5,184,000 18,844 0.0036
09 May 2023 16:24:49 1537731 22294482 oifs_43r3_ps_0984_2011050100_123_980_12197628_1 4,320,000 15,703 0.0036
09 May 2023 16:24:44 1537731 22294482 oifs_43r3_ps_0984_2011050100_123_980_12197628_1 3,456,000 12,573 0.0036
09 May 2023 16:24:39 1537731 22294482 oifs_43r3_ps_0984_2011050100_123_980_12197628_1 2,592,000 9,426 0.0036
09 May 2023 16:24:34 1537731 22294482 oifs_43r3_ps_0984_2011050100_123_980_12197628_1 1,728,000 6,289 0.0036
09 May 2023 16:24:34 1537731 22294482 oifs_43r3_ps_0984_2011050100_123_980_12197628_1 864,000 3,153 0.0036


©2024 climateprediction.net