climateprediction.net home page
Task 22275677

Task 22275677

Name oifs_43r3_ps_0461_2004050100_123_973_12190105_0
Workunit 12190105
Created 23 Dec 2022, 8:01:36 UTC
Sent 23 Dec 2022, 8:22:40 UTC
Report deadline 22 Jan 2023, 8:22:40 UTC
Received 24 Dec 2022, 8:42:07 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1517859
Run time 16 hours 40 min 52 sec
CPU time 16 hours 25 min 51 sec
Validate state Valid
Credit 14,515.20
Device peak FLOPS 6.98 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,796.36 MB
Peak swap size 4,974.25 MB
Peak disk usage 1,485.66 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<stderr_txt>
/ICMSHhq0f+002268
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002268
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0461_2004050100_123_973_12190105_0_r889454443_94.zip
Uploading the intermediate file: upload_file_94.zip
  23:20:34 STEP 2281 H=2281:00 +CPU= 15.980
  23:20:51 STEP 2282 H=2282:00 +CPU= 16.100
  23:21:16 STEP 2283 H=2283:00 +CPU= 24.568
  23:21:33 STEP 2284 H=2284:00 +CPU= 16.929
  23:21:49 STEP 2285 H=2285:00 +CPU= 15.480
  23:22:16 STEP 2286 H=2286:00 +CPU= 25.981
  23:22:32 STEP 2287 H=2287:00 +CPU= 16.461
  23:22:48 STEP 2288 H=2288:00 +CPU= 15.740
  23:23:14 STEP 2289 H=2289:00 +CPU= 24.972
  23:23:30 STEP 2290 H=2290:00 +CPU= 15.869
  23:23:46 STEP 2291 H=2291:00 +CPU= 16.311
  23:24:15 STEP 2292 H=2292:00 +CPU= 28.182
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002292
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002292
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002292
  23:24:31 STEP 2293 H=2293:00 +CPU= 15.176
  23:24:47 STEP 2294 H=2294:00 +CPU= 15.927
  23:25:12 STEP 2295 H=2295:00 +CPU= 24.834
  23:25:28 STEP 2296 H=2296:00 +CPU= 15.799
  23:25:43 STEP 2297 H=2297:00 +CPU= 15.165
  23:26:09 STEP 2298 H=2298:00 +CPU= 25.524
  23:26:25 STEP 2299 H=2299:00 +CPU= 15.437
  23:26:42 STEP 2300 H=2300:00 +CPU= 16.460
  23:27:09 STEP 2301 H=2301:00 +CPU= 26.719
  23:27:26 STEP 2302 H=2302:00 +CPU= 16.621
  23:27:43 STEP 2303 H=2303:00 +CPU= 16.405
  23:28:12 STEP 2304 H=2304:00 +CPU= 28.793
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002304
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002304
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002304
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002280
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002280
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002280
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002292
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002292
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002292
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0461_2004050100_123_973_12190105_0_r889454443_95.zip
Uploading the intermediate file: upload_file_95.zip
  23:28:28 STEP 2305 H=2305:00 +CPU= 15.525
  23:28:44 STEP 2306 H=2306:00 +CPU= 16.183
  23:29:08 STEP 2307 H=2307:00 +CPU= 23.640
  23:29:25 STEP 2308 H=2308:00 +CPU= 16.232
  23:29:41 STEP 2309 H=2309:00 +CPU= 15.808
  23:30:06 STEP 2310 H=2310:00 +CPU= 24.953
  23:30:23 STEP 2311 H=2311:00 +CPU= 16.577
  23:30:39 STEP 2312 H=2312:00 +CPU= 16.368
  23:31:04 STEP 2313 H=2313:00 +CPU= 24.858
  23:31:21 STEP 2314 H=2314:00 +CPU= 16.142
  23:31:36 STEP 2315 H=2315:00 +CPU= 15.133
  23:32:04 STEP 2316 H=2316:00 +CPU= 27.752
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002316
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002316
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002316
  23:32:21 STEP 2317 H=2317:00 +CPU= 15.741
  23:32:37 STEP 2318 H=2318:00 +CPU= 16.026
  23:33:03 STEP 2319 H=2319:00 +CPU= 25.561
  23:33:19 STEP 2320 H=2320:00 +CPU= 15.878
  23:33:35 STEP 2321 H=2321:00 +CPU= 15.345
  23:34:02 STEP 2322 H=2322:00 +CPU= 26.285
  23:34:17 STEP 2323 H=2323:00 +CPU= 15.673
  23:34:34 STEP 2324 H=2324:00 +CPU= 16.756
  23:35:00 STEP 2325 H=2325:00 +CPU= 24.828
  23:35:16 STEP 2326 H=2326:00 +CPU= 16.182
  23:35:32 STEP 2327 H=2327:00 +CPU= 15.930
  23:36:05 STEP 2328 H=2328:00 +CPU= 31.990
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002328
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002328
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002328
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002304
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002304
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002304
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002316
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002316
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002316
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0461_2004050100_123_973_12190105_0_r889454443_96.zip
Uploading the intermediate file: upload_file_96.zip
  23:36:27 STEP 2329 H=2329:00 +CPU= 21.661
  23:36:43 STEP 2330 H=2330:00 +CPU= 15.920
  23:37:10 STEP 2331 H=2331:00 +CPU= 25.816
  23:37:26 STEP 2332 H=2332:00 +CPU= 15.894
  23:37:41 STEP 2333 H=2333:00 +CPU= 15.349
  23:38:07 STEP 2334 H=2334:00 +CPU= 24.649
  23:38:22 STEP 2335 H=2335:00 +CPU= 15.494
  23:38:38 STEP 2336 H=2336:00 +CPU= 15.605
  23:39:03 STEP 2337 H=2337:00 +CPU= 24.401
  23:39:19 STEP 2338 H=2338:00 +CPU= 16.279
  23:39:35 STEP 2339 H=2339:00 +CPU= 15.112
  23:40:04 STEP 2340 H=2340:00 +CPU= 28.706
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002340
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002340
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002340
  23:40:21 STEP 2341 H=2341:00 +CPU= 16.436
  23:40:37 STEP 2342 H=2342:00 +CPU= 16.407
  23:41:03 STEP 2343 H=2343:00 +CPU= 25.399
  23:41:20 STEP 2344 H=2344:00 +CPU= 16.311
  23:41:44 STEP 2345 H=2345:00 +CPU= 23.592
  23:42:10 STEP 2346 H=2346:00 +CPU= 25.764
  23:42:28 STEP 2347 H=2347:00 +CPU= 17.987
  23:42:46 STEP 2348 H=2348:00 +CPU= 17.030
  23:43:13 STEP 2349 H=2349:00 +CPU= 27.001
  23:43:30 STEP 2350 H=2350:00 +CPU= 16.819
  23:43:47 STEP 2351 H=2351:00 +CPU= 16.817
  23:44:18 STEP 2352 H=2352:00 +CPU= 30.340
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002352
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002352
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002352
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002328
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002328
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002328
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002340
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002340
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002340
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0461_2004050100_123_973_12190105_0_r889454443_97.zip
Uploading the intermediate file: upload_file_97.zip
  23:44:42 STEP 2353 H=2353:00 +CPU= 23.672
  23:44:59 STEP 2354 H=2354:00 +CPU= 16.297
  23:45:25 STEP 2355 H=2355:00 +CPU= 25.805
  23:45:41 STEP 2356 H=2356:00 +CPU= 15.356
  23:45:56 STEP 2357 H=2357:00 +CPU= 15.570
  23:46:22 STEP 2358 H=2358:00 +CPU= 25.186
  23:46:37 STEP 2359 H=2359:00 +CPU= 15.361
  23:46:55 STEP 2360 H=2360:00 +CPU= 16.745
  23:47:20 STEP 2361 H=2361:00 +CPU= 25.244
  23:47:37 STEP 2362 H=2362:00 +CPU= 16.882
  23:47:55 STEP 2363 H=2363:00 +CPU= 17.214
  23:48:23 STEP 2364 H=2364:00 +CPU= 28.136
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002364
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002364
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002364
  23:48:39 STEP 2365 H=2365:00 +CPU= 15.026
  23:48:57 STEP 2366 H=2366:00 +CPU= 16.095
  23:49:22 STEP 2367 H=2367:00 +CPU= 25.301
  23:49:39 STEP 2368 H=2368:00 +CPU= 16.186
  23:49:56 STEP 2369 H=2369:00 +CPU= 16.022
  23:50:21 STEP 2370 H=2370:00 +CPU= 24.735
  23:50:37 STEP 2371 H=2371:00 +CPU= 15.846
  23:50:53 STEP 2372 H=2372:00 +CPU= 16.228
  23:51:18 STEP 2373 H=2373:00 +CPU= 24.625
  23:51:35 STEP 2374 H=2374:00 +CPU= 16.568
  23:51:50 STEP 2375 H=2375:00 +CPU= 15.267
  23:52:20 STEP 2376 H=2376:00 +CPU= 29.617
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002376
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002376
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002376
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002352
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002352
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002352
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002364
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002364
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002364
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0461_2004050100_123_973_12190105_0_r889454443_98.zip
Uploading the intermediate file: upload_file_98.zip
  23:52:37 STEP 2377 H=2377:00 +CPU= 15.802
  23:52:53 STEP 2378 H=2378:00 +CPU= 15.653
  23:53:18 STEP 2379 H=2379:00 +CPU= 25.184
  23:53:35 STEP 2380 H=2380:00 +CPU= 16.480
  23:53:52 STEP 2381 H=2381:00 +CPU= 16.500
  23:54:17 STEP 2382 H=2382:00 +CPU= 25.219
  23:54:34 STEP 2383 H=2383:00 +CPU= 16.240
  23:54:50 STEP 2384 H=2384:00 +CPU= 16.106
  23:55:16 STEP 2385 H=2385:00 +CPU= 25.857
  23:55:33 STEP 2386 H=2386:00 +CPU= 16.662
  23:55:50 STEP 2387 H=2387:00 +CPU= 16.575
  23:56:19 STEP 2388 H=2388:00 +CPU= 27.662
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002388
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002388
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002388
  23:56:35 STEP 2389 H=2389:00 +CPU= 16.455
  23:56:51 STEP 2390 H=2390:00 +CPU= 15.511
  23:57:18 STEP 2391 H=2391:00 +CPU= 26.912
  23:57:35 STEP 2392 H=2392:00 +CPU= 15.785
  23:57:51 STEP 2393 H=2393:00 +CPU= 16.148
  23:58:17 STEP 2394 H=2394:00 +CPU= 25.190
  23:58:32 STEP 2395 H=2395:00 +CPU= 15.289
  23:58:48 STEP 2396 H=2396:00 +CPU= 15.713
  23:59:14 STEP 2397 H=2397:00 +CPU= 25.225
  23:59:30 STEP 2398 H=2398:00 +CPU= 15.839
  23:59:46 STEP 2399 H=2399:00 +CPU= 15.706
  00:00:15 STEP 2400 H=2400:00 +CPU= 28.796
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002400
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002400
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002400
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002376
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002376
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002376
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002388
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002388
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002388
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0461_2004050100_123_973_12190105_0_r889454443_99.zip
Uploading the intermediate file: upload_file_99.zip
  00:00:31 STEP 2401 H=2401:00 +CPU= 15.113
Uploading trickle at timestep: 8640000
  00:00:47 STEP 2402 H=2402:00 +CPU= 16.266
  00:01:12 STEP 2403 H=2403:00 +CPU= 23.975
  00:01:28 STEP 2404 H=2404:00 +CPU= 15.626
  00:01:42 STEP 2405 H=2405:00 +CPU= 14.761
  00:02:08 STEP 2406 H=2406:00 +CPU= 24.871
  00:02:23 STEP 2407 H=2407:00 +CPU= 14.931
  00:02:39 STEP 2408 H=2408:00 +CPU= 15.761
  00:03:03 STEP 2409 H=2409:00 +CPU= 24.038
  00:03:20 STEP 2410 H=2410:00 +CPU= 16.411
  00:03:36 STEP 2411 H=2411:00 +CPU= 15.953
  00:04:05 STEP 2412 H=2412:00 +CPU= 27.412
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002412
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002412
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002412
  00:04:21 STEP 2413 H=2413:00 +CPU= 16.561
  00:04:37 STEP 2414 H=2414:00 +CPU= 15.403
  00:05:02 STEP 2415 H=2415:00 +CPU= 24.353
  00:05:18 STEP 2416 H=2416:00 +CPU= 15.366
  00:05:33 STEP 2417 H=2417:00 +CPU= 15.163
  00:05:59 STEP 2418 H=2418:00 +CPU= 25.445
  00:06:15 STEP 2419 H=2419:00 +CPU= 15.698
  00:06:31 STEP 2420 H=2420:00 +CPU= 15.766
  00:06:55 STEP 2421 H=2421:00 +CPU= 23.892
  00:07:11 STEP 2422 H=2422:00 +CPU= 15.628
  00:07:27 STEP 2423 H=2423:00 +CPU= 15.685
  00:07:57 STEP 2424 H=2424:00 +CPU= 29.341
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002424
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002424
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002424
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002400
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002400
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002400
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002412
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002412
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002412
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0461_2004050100_123_973_12190105_0_r889454443_100.zip
Uploading the intermediate file: upload_file_100.zip
  00:08:13 STEP 2425 H=2425:00 +CPU= 15.374
  00:08:29 STEP 2426 H=2426:00 +CPU= 16.095
  00:08:55 STEP 2427 H=2427:00 +CPU= 25.716
  00:09:12 STEP 2428 H=2428:00 +CPU= 16.709
  00:09:28 STEP 2429 H=2429:00 +CPU= 15.475
  00:09:53 STEP 2430 H=2430:00 +CPU= 25.280
  00:10:09 STEP 2431 H=2431:00 +CPU= 15.148
  00:10:25 STEP 2432 H=2432:00 +CPU= 16.438
  00:10:50 STEP 2433 H=2433:00 +CPU= 24.130
  00:11:06 STEP 2434 H=2434:00 +CPU= 15.489
  00:11:21 STEP 2435 H=2435:00 +CPU= 15.450
  00:11:52 STEP 2436 H=2436:00 +CPU= 27.278
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002436
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002436
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002436
  00:12:08 STEP 2437 H=2437:00 +CPU= 15.044
  00:12:25 STEP 2438 H=2438:00 +CPU= 17.234
  00:12:50 STEP 2439 H=2439:00 +CPU= 24.764
  00:13:07 STEP 2440 H=2440:00 +CPU= 16.213
  00:13:23 STEP 2441 H=2441:00 +CPU= 15.745
  00:13:48 STEP 2442 H=2442:00 +CPU= 24.534
  00:14:05 STEP 2443 H=2443:00 +CPU= 17.144
  00:14:22 STEP 2444 H=2444:00 +CPU= 15.926
  00:14:47 STEP 2445 H=2445:00 +CPU= 24.653
  00:15:04 STEP 2446 H=2446:00 +CPU= 16.372
  00:15:20 STEP 2447 H=2447:00 +CPU= 15.904
  00:15:49 STEP 2448 H=2448:00 +CPU= 28.389
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002448
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002448
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002448
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002424
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002424
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002424
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002436
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002436
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002436
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0461_2004050100_123_973_12190105_0_r889454443_101.zip
Uploading the intermediate file: upload_file_101.zip
  00:16:05 STEP 2449 H=2449:00 +CPU= 16.286
  00:16:21 STEP 2450 H=2450:00 +CPU= 15.545
  00:16:47 STEP 2451 H=2451:00 +CPU= 25.454
  00:17:03 STEP 2452 H=2452:00 +CPU= 16.039
  00:17:19 STEP 2453 H=2453:00 +CPU= 14.790
  00:17:44 STEP 2454 H=2454:00 +CPU= 25.117
  00:17:59 STEP 2455 H=2455:00 +CPU= 15.075
  00:18:15 STEP 2456 H=2456:00 +CPU= 16.001
  00:18:41 STEP 2457 H=2457:00 +CPU= 25.162
  00:18:56 STEP 2458 H=2458:00 +CPU= 15.349
  00:19:12 STEP 2459 H=2459:00 +CPU= 15.487
  00:19:40 STEP 2460 H=2460:00 +CPU= 27.117
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002460
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002460
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002460
  00:19:55 STEP 2461 H=2461:00 +CPU= 15.145
  00:20:12 STEP 2462 H=2462:00 +CPU= 16.518
  00:20:37 STEP 2463 H=2463:00 +CPU= 24.345
  00:20:53 STEP 2464 H=2464:00 +CPU= 15.761
  00:21:08 STEP 2465 H=2465:00 +CPU= 15.109
  00:21:34 STEP 2466 H=2466:00 +CPU= 25.477
  00:21:49 STEP 2467 H=2467:00 +CPU= 15.017
  00:22:06 STEP 2468 H=2468:00 +CPU= 16.634
  00:22:32 STEP 2469 H=2469:00 +CPU= 25.376
  00:22:47 STEP 2470 H=2470:00 +CPU= 14.733
  00:23:03 STEP 2471 H=2471:00 +CPU= 15.885
  00:23:33 STEP 2472 H=2472:00 +CPU= 29.020
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002472
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002472
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002472
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002448
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002448
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002448
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002460
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002460
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002460
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0461_2004050100_123_973_12190105_0_r889454443_102.zip
Uploading the intermediate file: upload_file_102.zip
  00:23:48 STEP 2473 H=2473:00 +CPU= 15.227
  00:24:06 STEP 2474 H=2474:00 +CPU= 16.974
  00:24:31 STEP 2475 H=2475:00 +CPU= 24.856
  00:24:47 STEP 2476 H=2476:00 +CPU= 15.514
  00:25:03 STEP 2477 H=2477:00 +CPU= 15.890
  00:25:28 STEP 2478 H=2478:00 +CPU= 24.498
  00:25:45 STEP 2479 H=2479:00 +CPU= 16.866
  00:26:01 STEP 2480 H=2480:00 +CPU= 15.774
  00:26:28 STEP 2481 H=2481:00 +CPU= 25.862
  00:26:45 STEP 2482 H=2482:00 +CPU= 17.031
  00:27:01 STEP 2483 H=2483:00 +CPU= 16.025
  00:27:31 STEP 2484 H=2484:00 +CPU= 29.052
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002484
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002484
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002484
  00:27:47 STEP 2485 H=2485:00 +CPU= 15.876
  00:28:04 STEP 2486 H=2486:00 +CPU= 16.512
  00:28:29 STEP 2487 H=2487:00 +CPU= 24.474
  00:28:47 STEP 2488 H=2488:00 +CPU= 17.602
  00:29:03 STEP 2489 H=2489:00 +CPU= 16.302
  00:29:29 STEP 2490 H=2490:00 +CPU= 24.882
  00:29:44 STEP 2491 H=2491:00 +CPU= 15.264
  00:30:01 STEP 2492 H=2492:00 +CPU= 17.161
  00:30:27 STEP 2493 H=2493:00 +CPU= 24.553
  00:30:42 STEP 2494 H=2494:00 +CPU= 15.731
  00:30:59 STEP 2495 H=2495:00 +CPU= 16.255
  00:31:29 STEP 2496 H=2496:00 +CPU= 29.061
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002496
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002496
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002496
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002472
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002472
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002472
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002484
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002484
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002484
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0461_2004050100_123_973_12190105_0_r889454443_103.zip
Uploading the intermediate file: upload_file_103.zip
  00:31:45 STEP 2497 H=2497:00 +CPU= 16.187
  00:32:02 STEP 2498 H=2498:00 +CPU= 16.073
  00:32:26 STEP 2499 H=2499:00 +CPU= 24.168
  00:32:42 STEP 2500 H=2500:00 +CPU= 15.337
  00:32:58 STEP 2501 H=2501:00 +CPU= 16.235
  00:33:25 STEP 2502 H=2502:00 +CPU= 26.310
  00:33:41 STEP 2503 H=2503:00 +CPU= 16.383
  00:33:58 STEP 2504 H=2504:00 +CPU= 16.645
  00:34:26 STEP 2505 H=2505:00 +CPU= 27.469
  00:34:42 STEP 2506 H=2506:00 +CPU= 15.238
  00:34:58 STEP 2507 H=2507:00 +CPU= 16.525
  00:35:26 STEP 2508 H=2508:00 +CPU= 27.125
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002508
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002508
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002508
  00:35:41 STEP 2509 H=2509:00 +CPU= 14.768
  00:35:58 STEP 2510 H=2510:00 +CPU= 16.282
  00:36:22 STEP 2511 H=2511:00 +CPU= 24.317
  00:36:39 STEP 2512 H=2512:00 +CPU= 16.523
  00:36:55 STEP 2513 H=2513:00 +CPU= 15.535
  00:37:21 STEP 2514 H=2514:00 +CPU= 25.337
  00:37:36 STEP 2515 H=2515:00 +CPU= 15.327
  00:37:52 STEP 2516 H=2516:00 +CPU= 15.516
  00:38:17 STEP 2517 H=2517:00 +CPU= 24.858
  00:38:34 STEP 2518 H=2518:00 +CPU= 16.153
  00:38:50 STEP 2519 H=2519:00 +CPU= 16.275
  00:39:19 STEP 2520 H=2520:00 +CPU= 28.296
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002520
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002520
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002520
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002496
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002496
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002496
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002508
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002508
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002508
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0461_2004050100_123_973_12190105_0_r889454443_104.zip
Uploading the intermediate file: upload_file_104.zip
  00:39:35 STEP 2521 H=2521:00 +CPU= 15.777
  00:39:51 STEP 2522 H=2522:00 +CPU= 15.690
  00:40:16 STEP 2523 H=2523:00 +CPU= 24.575
  00:40:33 STEP 2524 H=2524:00 +CPU= 16.268
  00:40:49 STEP 2525 H=2525:00 +CPU= 15.438
  00:41:14 STEP 2526 H=2526:00 +CPU= 24.486
  00:41:30 STEP 2527 H=2527:00 +CPU= 15.685
  00:41:46 STEP 2528 H=2528:00 +CPU= 16.207
  00:42:12 STEP 2529 H=2529:00 +CPU= 25.494
  00:42:29 STEP 2530 H=2530:00 +CPU= 17.342
  00:42:45 STEP 2531 H=2531:00 +CPU= 15.282
  00:43:11 STEP 2532 H=2532:00 +CPU= 25.980
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002532
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002532
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002532
  00:43:27 STEP 2533 H=2533:00 +CPU= 15.594
  00:43:51 STEP 2534 H=2534:00 +CPU= 23.298
  00:44:15 STEP 2535 H=2535:00 +CPU= 24.109
  00:44:32 STEP 2536 H=2536:00 +CPU= 16.088
  00:44:47 STEP 2537 H=2537:00 +CPU= 15.547
  00:45:19 STEP 2538 H=2538:00 +CPU= 30.901
  00:45:35 STEP 2539 H=2539:00 +CPU= 16.540
  00:45:51 STEP 2540 H=2540:00 +CPU= 15.683
  00:46:17 STEP 2541 H=2541:00 +CPU= 24.823
  00:46:33 STEP 2542 H=2542:00 +CPU= 16.426
  00:46:50 STEP 2543 H=2543:00 +CPU= 16.687
  00:47:18 STEP 2544 H=2544:00 +CPU= 27.793
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002544
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002544
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002544
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002520
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002520
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002520
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002532
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002532
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002532
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0461_2004050100_123_973_12190105_0_r889454443_105.zip
Uploading the intermediate file: upload_file_105.zip
  00:47:35 STEP 2545 H=2545:00 +CPU= 16.013
  00:47:51 STEP 2546 H=2546:00 +CPU= 16.411
  00:48:16 STEP 2547 H=2547:00 +CPU= 24.506
  00:48:33 STEP 2548 H=2548:00 +CPU= 16.560
  00:48:49 STEP 2549 H=2549:00 +CPU= 15.318
  00:49:14 STEP 2550 H=2550:00 +CPU= 25.412
  00:49:30 STEP 2551 H=2551:00 +CPU= 15.807
  00:49:46 STEP 2552 H=2552:00 +CPU= 15.566
  00:50:11 STEP 2553 H=2553:00 +CPU= 25.032
  00:50:28 STEP 2554 H=2554:00 +CPU= 16.665
  00:50:44 STEP 2555 H=2555:00 +CPU= 15.112
  00:51:12 STEP 2556 H=2556:00 +CPU= 27.577
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002556
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002556
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002556
  00:51:28 STEP 2557 H=2557:00 +CPU= 15.928
  00:51:46 STEP 2558 H=2558:00 +CPU= 17.374
  00:52:13 STEP 2559 H=2559:00 +CPU= 26.467
  00:52:30 STEP 2560 H=2560:00 +CPU= 16.647
  00:52:46 STEP 2561 H=2561:00 +CPU= 15.939
  00:53:12 STEP 2562 H=2562:00 +CPU= 25.351
  00:53:29 STEP 2563 H=2563:00 +CPU= 16.314
  00:53:45 STEP 2564 H=2564:00 +CPU= 15.758
  00:54:10 STEP 2565 H=2565:00 +CPU= 24.930
  00:54:27 STEP 2566 H=2566:00 +CPU= 16.488
  00:54:43 STEP 2567 H=2567:00 +CPU= 16.517
  00:55:13 STEP 2568 H=2568:00 +CPU= 29.064
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002568
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002568
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002568
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002544
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002544
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002544
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002556
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002556
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002556
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0461_2004050100_123_973_12190105_0_r889454443_106.zip
Uploading the intermediate file: upload_file_106.zip
  00:55:30 STEP 2569 H=2569:00 +CPU= 16.641
  00:55:46 STEP 2570 H=2570:00 +CPU= 15.861
  00:56:11 STEP 2571 H=2571:00 +CPU= 24.839
  00:56:28 STEP 2572 H=2572:00 +CPU= 16.694
  00:56:45 STEP 2573 H=2573:00 +CPU= 16.044
  00:57:11 STEP 2574 H=2574:00 +CPU= 25.668
  00:57:28 STEP 2575 H=2575:00 +CPU= 16.732
  00:57:46 STEP 2576 H=2576:00 +CPU= 17.787
  00:58:12 STEP 2577 H=2577:00 +CPU= 26.159
  00:58:30 STEP 2578 H=2578:00 +CPU= 17.006
  00:58:45 STEP 2579 H=2579:00 +CPU= 15.232
  00:59:13 STEP 2580 H=2580:00 +CPU= 27.772
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002580
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002580
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002580
  00:59:33 STEP 2581 H=2581:00 +CPU= 19.429
  00:59:49 STEP 2582 H=2582:00 +CPU= 15.963
  01:00:16 STEP 2583 H=2583:00 +CPU= 25.725
  01:00:32 STEP 2584 H=2584:00 +CPU= 16.067
  01:00:47 STEP 2585 H=2585:00 +CPU= 15.067
  01:01:13 STEP 2586 H=2586:00 +CPU= 25.117
  01:01:29 STEP 2587 H=2587:00 +CPU= 15.935
  01:01:45 STEP 2588 H=2588:00 +CPU= 15.137
  01:02:11 STEP 2589 H=2589:00 +CPU= 25.594
  01:02:27 STEP 2590 H=2590:00 +CPU= 15.792
  01:02:44 STEP 2591 H=2591:00 +CPU= 16.951
  01:03:13 STEP 2592 H=2592:00 +CPU= 28.235
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002592
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002592
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002592
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002568
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002568
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002568
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002580
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002580
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002580
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0461_2004050100_123_973_12190105_0_r889454443_107.zip
Uploading the intermediate file: upload_file_107.zip
  01:03:28 STEP 2593 H=2593:00 +CPU= 15.353
  01:03:45 STEP 2594 H=2594:00 +CPU= 16.281
  01:04:11 STEP 2595 H=2595:00 +CPU= 25.236
  01:04:27 STEP 2596 H=2596:00 +CPU= 16.436
  01:04:54 STEP 2597 H=2597:00 +CPU= 26.087
  01:05:21 STEP 2598 H=2598:00 +CPU= 26.099
  01:05:36 STEP 2599 H=2599:00 +CPU= 15.547
  01:05:54 STEP 2600 H=2600:00 +CPU= 16.980
  01:06:19 STEP 2601 H=2601:00 +CPU= 25.175
  01:06:36 STEP 2602 H=2602:00 +CPU= 16.245
  01:06:57 STEP 2603 H=2603:00 +CPU= 21.084
  01:07:35 STEP 2604 H=2604:00 +CPU= 37.060
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002604
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002604
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002604
  01:07:51 STEP 2605 H=2605:00 +CPU= 15.161
  01:08:07 STEP 2606 H=2606:00 +CPU= 16.391
  01:08:40 STEP 2607 H=2607:00 +CPU= 32.096
  01:08:56 STEP 2608 H=2608:00 +CPU= 15.916
  01:09:12 STEP 2609 H=2609:00 +CPU= 15.615
  01:09:37 STEP 2610 H=2610:00 +CPU= 24.915
  01:09:53 STEP 2611 H=2611:00 +CPU= 14.911
  01:10:09 STEP 2612 H=2612:00 +CPU= 16.592
  01:10:34 STEP 2613 H=2613:00 +CPU= 24.426
  01:10:51 STEP 2614 H=2614:00 +CPU= 16.022
  01:11:06 STEP 2615 H=2615:00 +CPU= 15.589
  01:11:38 STEP 2616 H=2616:00 +CPU= 31.351
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002616
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002616
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002616
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002592
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002592
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002592
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002604
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002604
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002604
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0461_2004050100_123_973_12190105_0_r889454443_108.zip
Uploading the intermediate file: upload_file_108.zip
  01:11:55 STEP 2617 H=2617:00 +CPU= 16.099
  01:12:13 STEP 2618 H=2618:00 +CPU= 17.840
  01:12:40 STEP 2619 H=2619:00 +CPU= 26.011
  01:12:56 STEP 2620 H=2620:00 +CPU= 16.017
  01:13:12 STEP 2621 H=2621:00 +CPU= 16.276
  01:13:39 STEP 2622 H=2622:00 +CPU= 26.510
  01:13:55 STEP 2623 H=2623:00 +CPU= 15.892
  01:14:13 STEP 2624 H=2624:00 +CPU= 16.855
  01:14:39 STEP 2625 H=2625:00 +CPU= 25.496
  01:14:55 STEP 2626 H=2626:00 +CPU= 15.704
  01:15:11 STEP 2627 H=2627:00 +CPU= 16.087
  01:15:40 STEP 2628 H=2628:00 +CPU= 27.964
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002628
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002628
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002628
  01:15:55 STEP 2629 H=2629:00 +CPU= 15.245
  01:16:12 STEP 2630 H=2630:00 +CPU= 16.709
  01:16:37 STEP 2631 H=2631:00 +CPU= 24.146
  01:16:53 STEP 2632 H=2632:00 +CPU= 15.659
  01:17:09 STEP 2633 H=2633:00 +CPU= 15.818
  01:17:34 STEP 2634 H=2634:00 +CPU= 25.008
  01:17:50 STEP 2635 H=2635:00 +CPU= 15.136
  01:18:06 STEP 2636 H=2636:00 +CPU= 16.268
  01:18:32 STEP 2637 H=2637:00 +CPU= 25.756
  01:18:50 STEP 2638 H=2638:00 +CPU= 17.137
  01:19:06 STEP 2639 H=2639:00 +CPU= 16.263
  01:19:39 STEP 2640 H=2640:00 +CPU= 32.135
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002640
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002640
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002640
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002616
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002616
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002616
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002628
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002628
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002628
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0461_2004050100_123_973_12190105_0_r889454443_109.zip
Uploading the intermediate file: upload_file_109.zip
  01:19:57 STEP 2641 H=2641:00 +CPU= 17.896
Uploading trickle at timestep: 9504000
  01:20:15 STEP 2642 H=2642:00 +CPU= 17.927
  01:20:41 STEP 2643 H=2643:00 +CPU= 25.425
  01:20:57 STEP 2644 H=2644:00 +CPU= 15.835
  01:21:14 STEP 2645 H=2645:00 +CPU= 16.682
  01:21:41 STEP 2646 H=2646:00 +CPU= 26.737
  01:21:58 STEP 2647 H=2647:00 +CPU= 16.920
  01:22:19 STEP 2648 H=2648:00 +CPU= 20.634
  01:22:47 STEP 2649 H=2649:00 +CPU= 27.466
  01:23:06 STEP 2650 H=2650:00 +CPU= 18.511
  01:23:30 STEP 2651 H=2651:00 +CPU= 23.989
  01:24:02 STEP 2652 H=2652:00 +CPU= 31.728
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002652
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002652
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002652
  01:24:21 STEP 2653 H=2653:00 +CPU= 17.922
  01:24:38 STEP 2654 H=2654:00 +CPU= 17.400
  01:25:06 STEP 2655 H=2655:00 +CPU= 27.365
  01:25:23 STEP 2656 H=2656:00 +CPU= 16.176
  01:25:38 STEP 2657 H=2657:00 +CPU= 15.343
  01:26:06 STEP 2658 H=2658:00 +CPU= 26.739
  01:26:22 STEP 2659 H=2659:00 +CPU= 16.178
  01:26:38 STEP 2660 H=2660:00 +CPU= 16.204
  01:27:03 STEP 2661 H=2661:00 +CPU= 24.525
  01:27:23 STEP 2662 H=2662:00 +CPU= 19.714
  01:27:40 STEP 2663 H=2663:00 +CPU= 16.825
  01:28:12 STEP 2664 H=2664:00 +CPU= 30.706
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002664
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002664
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002664
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002640
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002640
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002640
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002652
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002652
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002652
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0461_2004050100_123_973_12190105_0_r889454443_110.zip
Uploading the intermediate file: upload_file_110.zip
  01:28:30 STEP 2665 H=2665:00 +CPU= 18.223
  01:28:46 STEP 2666 H=2666:00 +CPU= 15.422
  01:29:12 STEP 2667 H=2667:00 +CPU= 25.370
  01:29:28 STEP 2668 H=2668:00 +CPU= 16.472
  01:29:44 STEP 2669 H=2669:00 +CPU= 15.451
  01:30:10 STEP 2670 H=2670:00 +CPU= 25.582
  01:30:26 STEP 2671 H=2671:00 +CPU= 15.681
  01:30:43 STEP 2672 H=2672:00 +CPU= 16.302
  01:31:09 STEP 2673 H=2673:00 +CPU= 26.230
  01:31:26 STEP 2674 H=2674:00 +CPU= 16.284
  01:31:42 STEP 2675 H=2675:00 +CPU= 15.695
  01:32:09 STEP 2676 H=2676:00 +CPU= 27.112
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002676
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002676
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002676
  01:32:26 STEP 2677 H=2677:00 +CPU= 15.943
  01:32:42 STEP 2678 H=2678:00 +CPU= 16.003
  01:33:07 STEP 2679 H=2679:00 +CPU= 24.756
  01:33:24 STEP 2680 H=2680:00 +CPU= 16.138
  01:33:39 STEP 2681 H=2681:00 +CPU= 15.470
  01:34:05 STEP 2682 H=2682:00 +CPU= 25.427
  01:34:21 STEP 2683 H=2683:00 +CPU= 15.997
  01:34:38 STEP 2684 H=2684:00 +CPU= 16.474
  01:35:03 STEP 2685 H=2685:00 +CPU= 24.820
  01:35:19 STEP 2686 H=2686:00 +CPU= 15.774
  01:35:35 STEP 2687 H=2687:00 +CPU= 15.619
  01:36:04 STEP 2688 H=2688:00 +CPU= 28.508
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002688
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002688
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002688
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002664
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002664
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002664
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002676
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002676
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002676
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0461_2004050100_123_973_12190105_0_r889454443_111.zip
Uploading the intermediate file: upload_file_111.zip
  01:36:20 STEP 2689 H=2689:00 +CPU= 15.889
  01:36:37 STEP 2690 H=2690:00 +CPU= 15.963
  01:37:02 STEP 2691 H=2691:00 +CPU= 25.067
  01:37:18 STEP 2692 H=2692:00 +CPU= 16.161
  01:37:36 STEP 2693 H=2693:00 +CPU= 17.058
  01:38:01 STEP 2694 H=2694:00 +CPU= 24.707
  01:38:18 STEP 2695 H=2695:00 +CPU= 16.673
  01:38:33 STEP 2696 H=2696:00 +CPU= 15.568
  01:38:58 STEP 2697 H=2697:00 +CPU= 23.913
  01:39:13 STEP 2698 H=2698:00 +CPU= 15.466
  01:39:29 STEP 2699 H=2699:00 +CPU= 15.590
  01:39:57 STEP 2700 H=2700:00 +CPU= 26.473
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002700
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002700
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002700
  01:40:13 STEP 2701 H=2701:00 +CPU= 15.725
  01:40:32 STEP 2702 H=2702:00 +CPU= 18.568
  01:40:57 STEP 2703 H=2703:00 +CPU= 24.235
  01:41:14 STEP 2704 H=2704:00 +CPU= 16.217
  01:41:29 STEP 2705 H=2705:00 +CPU= 15.366
  01:41:55 STEP 2706 H=2706:00 +CPU= 25.225
  01:42:13 STEP 2707 H=2707:00 +CPU= 17.498
  01:42:29 STEP 2708 H=2708:00 +CPU= 15.790
  01:42:54 STEP 2709 H=2709:00 +CPU= 24.503
  01:43:10 STEP 2710 H=2710:00 +CPU= 15.809
  01:43:26 STEP 2711 H=2711:00 +CPU= 15.511
  01:43:55 STEP 2712 H=2712:00 +CPU= 28.980
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002712
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002712
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002712
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002688
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002688
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002688
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002700
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002700
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002700
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0461_2004050100_123_973_12190105_0_r889454443_112.zip
Uploading the intermediate file: upload_file_112.zip
  01:44:11 STEP 2713 H=2713:00 +CPU= 15.368
  01:44:27 STEP 2714 H=2714:00 +CPU= 15.799
  01:44:53 STEP 2715 H=2715:00 +CPU= 25.750
  01:45:09 STEP 2716 H=2716:00 +CPU= 15.653
  01:45:25 STEP 2717 H=2717:00 +CPU= 15.278
  01:45:51 STEP 2718 H=2718:00 +CPU= 25.481
  01:46:07 STEP 2719 H=2719:00 +CPU= 16.143
  01:46:23 STEP 2720 H=2720:00 +CPU= 15.762
  01:46:47 STEP 2721 H=2721:00 +CPU= 24.001
  01:47:03 STEP 2722 H=2722:00 +CPU= 15.680
  01:47:18 STEP 2723 H=2723:00 +CPU= 15.132
  01:47:46 STEP 2724 H=2724:00 +CPU= 26.725
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002724
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002724
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002724
  01:48:02 STEP 2725 H=2725:00 +CPU= 15.856
  01:48:18 STEP 2726 H=2726:00 +CPU= 15.666
  01:48:43 STEP 2727 H=2727:00 +CPU= 24.427
  01:49:00 STEP 2728 H=2728:00 +CPU= 16.587
  01:49:16 STEP 2729 H=2729:00 +CPU= 15.654
  01:49:42 STEP 2730 H=2730:00 +CPU= 25.560
  01:49:57 STEP 2731 H=2731:00 +CPU= 14.939
  01:50:14 STEP 2732 H=2732:00 +CPU= 16.301
  01:50:38 STEP 2733 H=2733:00 +CPU= 23.857
  01:50:55 STEP 2734 H=2734:00 +CPU= 16.345
  01:51:11 STEP 2735 H=2735:00 +CPU= 16.161
  01:51:40 STEP 2736 H=2736:00 +CPU= 28.210
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002736
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002736
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002736
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002712
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002712
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002712
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002724
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002724
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002724
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0461_2004050100_123_973_12190105_0_r889454443_113.zip
Uploading the intermediate file: upload_file_113.zip
  01:51:56 STEP 2737 H=2737:00 +CPU= 15.558
  01:52:12 STEP 2738 H=2738:00 +CPU= 16.158
  01:52:37 STEP 2739 H=2739:00 +CPU= 24.575
  01:52:53 STEP 2740 H=2740:00 +CPU= 15.478
  01:53:10 STEP 2741 H=2741:00 +CPU= 16.233
  01:53:35 STEP 2742 H=2742:00 +CPU= 25.107
  01:53:51 STEP 2743 H=2743:00 +CPU= 16.124
  01:54:08 STEP 2744 H=2744:00 +CPU= 16.049
  01:54:33 STEP 2745 H=2745:00 +CPU= 24.822
  01:54:49 STEP 2746 H=2746:00 +CPU= 15.908
  01:55:05 STEP 2747 H=2747:00 +CPU= 15.449
  01:55:32 STEP 2748 H=2748:00 +CPU= 27.287
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002748
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002748
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002748
  01:55:49 STEP 2749 H=2749:00 +CPU= 16.161
  01:56:05 STEP 2750 H=2750:00 +CPU= 15.715
  01:56:30 STEP 2751 H=2751:00 +CPU= 24.647
  01:56:48 STEP 2752 H=2752:00 +CPU= 17.246
  01:57:05 STEP 2753 H=2753:00 +CPU= 16.592
  01:57:31 STEP 2754 H=2754:00 +CPU= 24.348
  01:57:47 STEP 2755 H=2755:00 +CPU= 15.878
  01:58:04 STEP 2756 H=2756:00 +CPU= 16.265
  01:58:30 STEP 2757 H=2757:00 +CPU= 25.190
  01:58:47 STEP 2758 H=2758:00 +CPU= 16.686
  01:59:03 STEP 2759 H=2759:00 +CPU= 16.017
  01:59:41 STEP 2760 H=2760:00 +CPU= 38.442
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002760
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002760
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002760
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002736
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002736
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002736
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002748
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002748
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002748
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0461_2004050100_123_973_12190105_0_r889454443_114.zip
Uploading the intermediate file: upload_file_114.zip
  01:59:59 STEP 2761 H=2761:00 +CPU= 16.786
  02:00:16 STEP 2762 H=2762:00 +CPU= 16.752
  02:00:41 STEP 2763 H=2763:00 +CPU= 24.888
  02:00:58 STEP 2764 H=2764:00 +CPU= 16.208
  02:01:13 STEP 2765 H=2765:00 +CPU= 15.420
  02:01:39 STEP 2766 H=2766:00 +CPU= 25.081
  02:01:55 STEP 2767 H=2767:00 +CPU= 15.991
  02:02:11 STEP 2768 H=2768:00 +CPU= 15.951
  02:02:37 STEP 2769 H=2769:00 +CPU= 25.378
  02:02:54 STEP 2770 H=2770:00 +CPU= 16.882
  02:03:11 STEP 2771 H=2771:00 +CPU= 16.621
  02:03:39 STEP 2772 H=2772:00 +CPU= 27.793
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002772
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002772
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002772
  02:04:02 STEP 2773 H=2773:00 +CPU= 22.478
  02:04:18 STEP 2774 H=2774:00 +CPU= 15.594
  02:04:44 STEP 2775 H=2775:00 +CPU= 24.817
  02:05:00 STEP 2776 H=2776:00 +CPU= 15.801
  02:05:15 STEP 2777 H=2777:00 +CPU= 15.093
  02:05:40 STEP 2778 H=2778:00 +CPU= 24.217
  02:05:56 STEP 2779 H=2779:00 +CPU= 15.455
  02:06:12 STEP 2780 H=2780:00 +CPU= 16.255
  02:06:37 STEP 2781 H=2781:00 +CPU= 25.021
  02:06:56 STEP 2782 H=2782:00 +CPU= 15.716
  02:07:13 STEP 2783 H=2783:00 +CPU= 16.304
  02:07:46 STEP 2784 H=2784:00 +CPU= 32.268
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002784
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002784
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002784
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002760
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002760
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002760
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002772
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002772
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002772
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0461_2004050100_123_973_12190105_0_r889454443_115.zip
Uploading the intermediate file: upload_file_115.zip
  02:08:03 STEP 2785 H=2785:00 +CPU= 17.288
  02:08:19 STEP 2786 H=2786:00 +CPU= 15.727
  02:08:44 STEP 2787 H=2787:00 +CPU= 24.293
  02:09:00 STEP 2788 H=2788:00 +CPU= 15.961
  02:09:16 STEP 2789 H=2789:00 +CPU= 15.092
  02:09:42 STEP 2790 H=2790:00 +CPU= 26.047
  02:09:57 STEP 2791 H=2791:00 +CPU= 14.995
  02:10:14 STEP 2792 H=2792:00 +CPU= 16.609
  02:10:40 STEP 2793 H=2793:00 +CPU= 25.417
  02:10:56 STEP 2794 H=2794:00 +CPU= 15.898
  02:11:12 STEP 2795 H=2795:00 +CPU= 15.501
  02:11:39 STEP 2796 H=2796:00 +CPU= 27.085
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002796
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002796
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002796
  02:11:55 STEP 2797 H=2797:00 +CPU= 14.957
  02:12:15 STEP 2798 H=2798:00 +CPU= 19.656
  02:12:41 STEP 2799 H=2799:00 +CPU= 25.398
  02:12:57 STEP 2800 H=2800:00 +CPU= 16.144
  02:13:14 STEP 2801 H=2801:00 +CPU= 16.391
  02:13:40 STEP 2802 H=2802:00 +CPU= 25.315
  02:13:55 STEP 2803 H=2803:00 +CPU= 15.208
  02:14:12 STEP 2804 H=2804:00 +CPU= 16.466
  02:14:36 STEP 2805 H=2805:00 +CPU= 24.087
  02:14:52 STEP 2806 H=2806:00 +CPU= 15.382
  02:15:08 STEP 2807 H=2807:00 +CPU= 16.132
  02:15:37 STEP 2808 H=2808:00 +CPU= 28.171
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002808
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002808
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002808
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002784
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002784
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002784
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002796
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002796
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002796
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0461_2004050100_123_973_12190105_0_r889454443_116.zip
Uploading the intermediate file: upload_file_116.zip
  02:15:52 STEP 2809 H=2809:00 +CPU= 14.566
  02:16:09 STEP 2810 H=2810:00 +CPU= 16.544
  02:16:33 STEP 2811 H=2811:00 +CPU= 24.284
  02:16:50 STEP 2812 H=2812:00 +CPU= 16.157
  02:17:05 STEP 2813 H=2813:00 +CPU= 15.439
  02:17:31 STEP 2814 H=2814:00 +CPU= 24.966
  02:17:46 STEP 2815 H=2815:00 +CPU= 14.961
  02:18:02 STEP 2816 H=2816:00 +CPU= 15.741
  02:18:28 STEP 2817 H=2817:00 +CPU= 25.642
  02:18:44 STEP 2818 H=2818:00 +CPU= 16.143
  02:19:00 STEP 2819 H=2819:00 +CPU= 15.761
  02:19:29 STEP 2820 H=2820:00 +CPU= 27.842
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002820
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002820
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002820
  02:19:45 STEP 2821 H=2821:00 +CPU= 15.767
  02:20:02 STEP 2822 H=2822:00 +CPU= 16.553
  02:20:30 STEP 2823 H=2823:00 +CPU= 28.243
  02:20:46 STEP 2824 H=2824:00 +CPU= 15.881
  02:21:03 STEP 2825 H=2825:00 +CPU= 16.334
  02:21:37 STEP 2826 H=2826:00 +CPU= 33.544
  02:21:54 STEP 2827 H=2827:00 +CPU= 16.414
  02:22:11 STEP 2828 H=2828:00 +CPU= 16.292
  02:22:37 STEP 2829 H=2829:00 +CPU= 25.890
  02:22:54 STEP 2830 H=2830:00 +CPU= 16.861
  02:23:11 STEP 2831 H=2831:00 +CPU= 16.210
  02:24:00 STEP 2832 H=2832:00 +CPU= 48.565
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002832
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002832
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002832
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002808
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002808
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002808
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002820
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002820
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002820
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0461_2004050100_123_973_12190105_0_r889454443_117.zip
Uploading the intermediate file: upload_file_117.zip
  02:24:17 STEP 2833 H=2833:00 +CPU= 16.486
  02:24:33 STEP 2834 H=2834:00 +CPU= 16.386
  02:25:02 STEP 2835 H=2835:00 +CPU= 27.788
  02:25:19 STEP 2836 H=2836:00 +CPU= 17.060
  02:25:37 STEP 2837 H=2837:00 +CPU= 17.226
  02:26:03 STEP 2838 H=2838:00 +CPU= 25.956
  02:26:18 STEP 2839 H=2839:00 +CPU= 15.231
  02:26:37 STEP 2840 H=2840:00 +CPU= 17.935
  02:27:07 STEP 2841 H=2841:00 +CPU= 29.921
  02:27:25 STEP 2842 H=2842:00 +CPU= 17.218
  02:27:41 STEP 2843 H=2843:00 +CPU= 15.958
  02:28:10 STEP 2844 H=2844:00 +CPU= 28.999
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002844
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002844
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002844
  02:28:27 STEP 2845 H=2845:00 +CPU= 16.464
  02:28:44 STEP 2846 H=2846:00 +CPU= 16.765
  02:29:11 STEP 2847 H=2847:00 +CPU= 26.004
  02:29:27 STEP 2848 H=2848:00 +CPU= 15.845
  02:29:44 STEP 2849 H=2849:00 +CPU= 16.855
  02:30:12 STEP 2850 H=2850:00 +CPU= 26.946
  02:30:28 STEP 2851 H=2851:00 +CPU= 16.138
  02:30:45 STEP 2852 H=2852:00 +CPU= 16.618
  02:31:12 STEP 2853 H=2853:00 +CPU= 26.418
  02:31:28 STEP 2854 H=2854:00 +CPU= 15.521
  02:31:45 STEP 2855 H=2855:00 +CPU= 16.973
  02:32:15 STEP 2856 H=2856:00 +CPU= 29.445
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002856
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002856
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002856
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002832
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002832
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002832
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002844
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002844
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002844
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0461_2004050100_123_973_12190105_0_r889454443_118.zip
Uploading the intermediate file: upload_file_118.zip
  02:32:31 STEP 2857 H=2857:00 +CPU= 15.650
  02:32:57 STEP 2858 H=2858:00 +CPU= 25.673
  02:33:22 STEP 2859 H=2859:00 +CPU= 24.996
  02:33:39 STEP 2860 H=2860:00 +CPU= 16.317
  02:33:58 STEP 2861 H=2861:00 +CPU= 18.323
  02:34:23 STEP 2862 H=2862:00 +CPU= 25.197
  02:34:39 STEP 2863 H=2863:00 +CPU= 15.874
  02:34:56 STEP 2864 H=2864:00 +CPU= 16.220
  02:35:22 STEP 2865 H=2865:00 +CPU= 25.277
  02:35:38 STEP 2866 H=2866:00 +CPU= 16.625
  02:36:03 STEP 2867 H=2867:00 +CPU= 23.985
  02:36:32 STEP 2868 H=2868:00 +CPU= 29.009
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002868
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002868
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002868
  02:36:47 STEP 2869 H=2869:00 +CPU= 14.880
  02:37:20 STEP 2870 H=2870:00 +CPU= 31.780
  02:37:46 STEP 2871 H=2871:00 +CPU= 25.723
  02:38:02 STEP 2872 H=2872:00 +CPU= 15.735
  02:38:19 STEP 2873 H=2873:00 +CPU= 16.694
  02:38:55 STEP 2874 H=2874:00 +CPU= 35.078
  02:39:14 STEP 2875 H=2875:00 +CPU= 18.620
  02:39:31 STEP 2876 H=2876:00 +CPU= 17.455
  02:39:57 STEP 2877 H=2877:00 +CPU= 24.804
  02:40:14 STEP 2878 H=2878:00 +CPU= 17.108
  02:40:30 STEP 2879 H=2879:00 +CPU= 15.730
  02:41:02 STEP 2880 H=2880:00 +CPU= 31.861
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002880
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002880
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002880
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002856
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002856
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002856
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002868
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002868
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002868
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0461_2004050100_123_973_12190105_0_r889454443_119.zip
Uploading the intermediate file: upload_file_119.zip
  02:41:19 STEP 2881 H=2881:00 +CPU= 16.555
Uploading trickle at timestep: 10368000
  02:41:43 STEP 2882 H=2882:00 +CPU= 22.806
  02:42:11 STEP 2883 H=2883:00 +CPU= 27.658
  02:42:28 STEP 2884 H=2884:00 +CPU= 16.463
  02:42:51 STEP 2885 H=2885:00 +CPU= 22.777
  02:43:30 STEP 2886 H=2886:00 +CPU= 38.590
  02:43:48 STEP 2887 H=2887:00 +CPU= 17.300
  02:44:06 STEP 2888 H=2888:00 +CPU= 18.575
  02:44:35 STEP 2889 H=2889:00 +CPU= 27.693
  02:44:51 STEP 2890 H=2890:00 +CPU= 16.174
  02:45:08 STEP 2891 H=2891:00 +CPU= 16.966
  02:45:37 STEP 2892 H=2892:00 +CPU= 28.180
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002892
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002892
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002892
  02:45:55 STEP 2893 H=2893:00 +CPU= 18.008
  02:46:13 STEP 2894 H=2894:00 +CPU= 16.759
  02:46:39 STEP 2895 H=2895:00 +CPU= 25.512
  02:47:01 STEP 2896 H=2896:00 +CPU= 21.395
  02:47:18 STEP 2897 H=2897:00 +CPU= 17.395
  02:47:44 STEP 2898 H=2898:00 +CPU= 25.140
  02:47:59 STEP 2899 H=2899:00 +CPU= 15.353
  02:48:16 STEP 2900 H=2900:00 +CPU= 16.470
  02:48:41 STEP 2901 H=2901:00 +CPU= 24.879
  02:48:58 STEP 2902 H=2902:00 +CPU= 16.619
  02:49:15 STEP 2903 H=2903:00 +CPU= 16.253
  02:49:46 STEP 2904 H=2904:00 +CPU= 31.149
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002904
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002904
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002904
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002880
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002880
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002880
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002892
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002892
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002892
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0461_2004050100_123_973_12190105_0_r889454443_120.zip
Uploading the intermediate file: upload_file_120.zip
  02:50:18 STEP 2905 H=2905:00 +CPU= 31.639
  02:50:35 STEP 2906 H=2906:00 +CPU= 16.750
  02:51:02 STEP 2907 H=2907:00 +CPU= 25.844
  02:51:18 STEP 2908 H=2908:00 +CPU= 16.357
  02:51:34 STEP 2909 H=2909:00 +CPU= 15.767
  02:52:00 STEP 2910 H=2910:00 +CPU= 25.392
  02:52:16 STEP 2911 H=2911:00 +CPU= 15.612
  02:52:33 STEP 2912 H=2912:00 +CPU= 16.960
  02:52:58 STEP 2913 H=2913:00 +CPU= 24.803
  02:53:15 STEP 2914 H=2914:00 +CPU= 16.281
  02:53:31 STEP 2915 H=2915:00 +CPU= 16.124
  02:54:07 STEP 2916 H=2916:00 +CPU= 35.518
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002916
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002916
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002916
  02:54:24 STEP 2917 H=2917:00 +CPU= 15.843
  02:54:40 STEP 2918 H=2918:00 +CPU= 16.043
  02:55:07 STEP 2919 H=2919:00 +CPU= 26.069
  02:55:23 STEP 2920 H=2920:00 +CPU= 16.226
  02:55:39 STEP 2921 H=2921:00 +CPU= 15.142
  02:56:05 STEP 2922 H=2922:00 +CPU= 25.829
  02:56:21 STEP 2923 H=2923:00 +CPU= 15.663
  02:56:40 STEP 2924 H=2924:00 +CPU= 18.611
  02:57:09 STEP 2925 H=2925:00 +CPU= 28.594
  02:57:26 STEP 2926 H=2926:00 +CPU= 16.843
  02:57:43 STEP 2927 H=2927:00 +CPU= 16.539
  02:58:14 STEP 2928 H=2928:00 +CPU= 30.389
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002928
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002928
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002928
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002904
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002904
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002904
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002916
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002916
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002916
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0461_2004050100_123_973_12190105_0_r889454443_121.zip
Uploading the intermediate file: upload_file_121.zip
  02:58:31 STEP 2929 H=2929:00 +CPU= 16.957
  02:58:48 STEP 2930 H=2930:00 +CPU= 16.726
  02:59:14 STEP 2931 H=2931:00 +CPU= 25.184
  02:59:31 STEP 2932 H=2932:00 +CPU= 16.369
  02:59:46 STEP 2933 H=2933:00 +CPU= 15.175
  03:00:24 STEP 2934 H=2934:00 +CPU= 37.714
  03:00:48 STEP 2935 H=2935:00 +CPU= 23.593
  03:01:07 STEP 2936 H=2936:00 +CPU= 19.114
  03:01:33 STEP 2937 H=2937:00 +CPU= 25.353
  03:01:49 STEP 2938 H=2938:00 +CPU= 16.134
  03:02:06 STEP 2939 H=2939:00 +CPU= 15.878
  03:02:36 STEP 2940 H=2940:00 +CPU= 29.362
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002940
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002940
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002940
  03:02:53 STEP 2941 H=2941:00 +CPU= 16.527
  03:03:10 STEP 2942 H=2942:00 +CPU= 16.977
  03:03:42 STEP 2943 H=2943:00 +CPU= 31.745
  03:03:58 STEP 2944 H=2944:00 +CPU= 15.924
  03:04:16 STEP 2945 H=2945:00 +CPU= 16.976
  03:04:43 STEP 2946 H=2946:00 +CPU= 26.217
  03:04:59 STEP 2947 H=2947:00 +CPU= 16.304
  03:05:24 STEP 2948 H=2948:00 +CPU= 24.738
  03:05:50 STEP 2949 H=2949:00 +CPU= 25.151
  03:06:07 STEP 2950 H=2950:00 +CPU= 16.804
  03:06:33 STEP 2951 H=2951:00 +CPU= 25.704
  03:07:04 STEP 2952 H=2952:00 +CPU= 29.694
The child process terminated with status: 0
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002952
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002952
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002952
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002952
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002940
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002928
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002952
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002940
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMUAhq0f+002928
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMGGhq0f+002952
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002940
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12190105/ICMSHhq0f+002928
Zipping up the final file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0461_2004050100_123_973_12190105_0_r889454443_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
03:10:27 (1807): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 15:51:58 1517859 22275677 oifs_43r3_ps_0461_2004050100_123_973_12190105_0 10,623,600 59,151 0.0056
09 May 2023 15:51:58 1517859 22275677 oifs_43r3_ps_0461_2004050100_123_973_12190105_0 10,368,000 57,624 0.0056
09 May 2023 15:51:48 1517859 22275677 oifs_43r3_ps_0461_2004050100_123_973_12190105_0 9,504,000 52,822 0.0056
09 May 2023 15:51:43 1517859 22275677 oifs_43r3_ps_0461_2004050100_123_973_12190105_0 8,640,000 48,142 0.0056
09 May 2023 15:51:37 1517859 22275677 oifs_43r3_ps_0461_2004050100_123_973_12190105_0 7,776,000 43,443 0.0056
09 May 2023 15:51:26 1517859 22275677 oifs_43r3_ps_0461_2004050100_123_973_12190105_0 6,912,000 38,651 0.0056
09 May 2023 15:51:21 1517859 22275677 oifs_43r3_ps_0461_2004050100_123_973_12190105_0 6,048,000 33,775 0.0056
09 May 2023 15:51:11 1517859 22275677 oifs_43r3_ps_0461_2004050100_123_973_12190105_0 5,184,000 28,886 0.0056
09 May 2023 15:51:05 1517859 22275677 oifs_43r3_ps_0461_2004050100_123_973_12190105_0 4,320,000 24,061 0.0056
09 May 2023 15:51:00 1517859 22275677 oifs_43r3_ps_0461_2004050100_123_973_12190105_0 3,456,000 19,515 0.0056
09 May 2023 15:50:54 1517859 22275677 oifs_43r3_ps_0461_2004050100_123_973_12190105_0 2,592,000 14,694 0.0057
09 May 2023 15:50:43 1517859 22275677 oifs_43r3_ps_0461_2004050100_123_973_12190105_0 1,728,000 9,892 0.0057
09 May 2023 15:50:37 1517859 22275677 oifs_43r3_ps_0461_2004050100_123_973_12190105_0 864,000 5,014 0.0058


©2024 climateprediction.net