climateprediction.net home page
Task 22304173

Task 22304173

Name oifs_43r3_ps_0003_2019050100_123_988_12204647_1
Workunit 12204647
Created 27 Jan 2023, 1:32:30 UTC
Sent 27 Jan 2023, 1:33:01 UTC
Report deadline 28 Mar 2023, 1:33:01 UTC
Received 27 Jan 2023, 18:47:49 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1517859
Run time 16 hours 56 min 11 sec
CPU time 16 hours 38 min 19 sec
Validate state Valid
Credit 14,515.20
Device peak FLOPS 7.57 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,798.57 MB
Peak swap size 4,974.25 MB
Peak disk usage 1,225.56 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<stderr_txt>
he zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002268
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0003_2019050100_123_988_12204647_1_r1050634236_94.zip
Uploading the intermediate file: upload_file_94.zip
  09:37:16 STEP 2281 H=2281:00 +CPU= 16.451
  09:37:33 STEP 2282 H=2282:00 +CPU= 16.620
  09:38:00 STEP 2283 H=2283:00 +CPU= 26.365
  09:38:18 STEP 2284 H=2284:00 +CPU= 17.474
  09:38:35 STEP 2285 H=2285:00 +CPU= 17.197
  09:39:03 STEP 2286 H=2286:00 +CPU= 27.614
  09:39:21 STEP 2287 H=2287:00 +CPU= 17.119
  09:39:38 STEP 2288 H=2288:00 +CPU= 17.633
  09:40:06 STEP 2289 H=2289:00 +CPU= 27.134
  09:40:23 STEP 2290 H=2290:00 +CPU= 17.353
  09:40:40 STEP 2291 H=2291:00 +CPU= 16.129
  09:41:08 STEP 2292 H=2292:00 +CPU= 27.695
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002292
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002292
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002292
  09:41:25 STEP 2293 H=2293:00 +CPU= 16.052
  09:41:42 STEP 2294 H=2294:00 +CPU= 16.710
  09:42:09 STEP 2295 H=2295:00 +CPU= 26.053
  09:42:27 STEP 2296 H=2296:00 +CPU= 17.687
  09:42:44 STEP 2297 H=2297:00 +CPU= 16.937
  09:43:11 STEP 2298 H=2298:00 +CPU= 26.524
  09:43:29 STEP 2299 H=2299:00 +CPU= 17.793
  09:43:46 STEP 2300 H=2300:00 +CPU= 16.683
  09:44:12 STEP 2301 H=2301:00 +CPU= 26.069
  09:44:32 STEP 2302 H=2302:00 +CPU= 18.827
  09:44:49 STEP 2303 H=2303:00 +CPU= 16.613
  09:45:23 STEP 2304 H=2304:00 +CPU= 33.924
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002304
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002304
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002304
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002280
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002280
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002280
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002292
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002292
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002292
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0003_2019050100_123_988_12204647_1_r1050634236_95.zip
Uploading the intermediate file: upload_file_95.zip
  09:45:40 STEP 2305 H=2305:00 +CPU= 15.862
  09:45:57 STEP 2306 H=2306:00 +CPU= 16.849
  09:46:22 STEP 2307 H=2307:00 +CPU= 24.792
  09:46:39 STEP 2308 H=2308:00 +CPU= 16.998
  09:46:56 STEP 2309 H=2309:00 +CPU= 16.412
  09:47:22 STEP 2310 H=2310:00 +CPU= 25.616
  09:47:39 STEP 2311 H=2311:00 +CPU= 16.722
  09:47:56 STEP 2312 H=2312:00 +CPU= 16.652
  09:48:22 STEP 2313 H=2313:00 +CPU= 25.599
  09:48:40 STEP 2314 H=2314:00 +CPU= 17.313
  09:48:57 STEP 2315 H=2315:00 +CPU= 16.886
  09:49:25 STEP 2316 H=2316:00 +CPU= 27.934
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002316
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002316
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002316
  09:49:42 STEP 2317 H=2317:00 +CPU= 16.636
  09:50:00 STEP 2318 H=2318:00 +CPU= 17.091
  09:50:27 STEP 2319 H=2319:00 +CPU= 26.490
  09:50:44 STEP 2320 H=2320:00 +CPU= 17.064
  09:51:01 STEP 2321 H=2321:00 +CPU= 15.901
  09:51:27 STEP 2322 H=2322:00 +CPU= 26.245
  09:51:44 STEP 2323 H=2323:00 +CPU= 16.178
  09:52:02 STEP 2324 H=2324:00 +CPU= 17.658
  09:52:28 STEP 2325 H=2325:00 +CPU= 26.495
  09:52:46 STEP 2326 H=2326:00 +CPU= 16.891
  09:53:03 STEP 2327 H=2327:00 +CPU= 17.492
  09:53:34 STEP 2328 H=2328:00 +CPU= 30.539
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002328
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002328
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002328
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002304
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002304
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002304
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002316
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002316
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002316
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0003_2019050100_123_988_12204647_1_r1050634236_96.zip
Uploading the intermediate file: upload_file_96.zip
  09:53:52 STEP 2329 H=2329:00 +CPU= 16.701
  09:54:08 STEP 2330 H=2330:00 +CPU= 15.597
  09:54:34 STEP 2331 H=2331:00 +CPU= 25.758
  09:54:51 STEP 2332 H=2332:00 +CPU= 16.660
  09:55:08 STEP 2333 H=2333:00 +CPU= 16.376
  09:55:35 STEP 2334 H=2334:00 +CPU= 27.444
  09:55:52 STEP 2335 H=2335:00 +CPU= 16.118
  09:56:08 STEP 2336 H=2336:00 +CPU= 16.018
  09:56:34 STEP 2337 H=2337:00 +CPU= 26.041
  09:56:52 STEP 2338 H=2338:00 +CPU= 16.858
  09:57:08 STEP 2339 H=2339:00 +CPU= 16.352
  09:57:38 STEP 2340 H=2340:00 +CPU= 28.628
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002340
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002340
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002340
  09:57:55 STEP 2341 H=2341:00 +CPU= 17.399
  09:58:12 STEP 2342 H=2342:00 +CPU= 16.109
  09:58:38 STEP 2343 H=2343:00 +CPU= 26.279
  09:58:57 STEP 2344 H=2344:00 +CPU= 18.000
  09:59:14 STEP 2345 H=2345:00 +CPU= 16.807
  09:59:40 STEP 2346 H=2346:00 +CPU= 25.321
  09:59:56 STEP 2347 H=2347:00 +CPU= 16.290
  10:00:14 STEP 2348 H=2348:00 +CPU= 17.168
  10:00:40 STEP 2349 H=2349:00 +CPU= 26.286
  10:00:59 STEP 2350 H=2350:00 +CPU= 18.449
  10:01:16 STEP 2351 H=2351:00 +CPU= 16.327
  10:01:48 STEP 2352 H=2352:00 +CPU= 30.113
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002352
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002352
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002352
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002328
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002328
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002328
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002340
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002340
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002340
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0003_2019050100_123_988_12204647_1_r1050634236_97.zip
Uploading the intermediate file: upload_file_97.zip
  10:02:05 STEP 2353 H=2353:00 +CPU= 16.800
  10:02:22 STEP 2354 H=2354:00 +CPU= 16.779
  10:02:48 STEP 2355 H=2355:00 +CPU= 25.536
  10:03:10 STEP 2356 H=2356:00 +CPU= 21.553
  10:03:27 STEP 2357 H=2357:00 +CPU= 16.808
  10:03:55 STEP 2358 H=2358:00 +CPU= 27.687
  10:04:12 STEP 2359 H=2359:00 +CPU= 16.876
  10:04:31 STEP 2360 H=2360:00 +CPU= 18.275
  10:04:58 STEP 2361 H=2361:00 +CPU= 26.839
  10:05:17 STEP 2362 H=2362:00 +CPU= 18.081
  10:05:34 STEP 2363 H=2363:00 +CPU= 17.001
  10:06:10 STEP 2364 H=2364:00 +CPU= 35.692
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002364
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002364
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002364
  10:06:28 STEP 2365 H=2365:00 +CPU= 17.250
  10:06:44 STEP 2366 H=2366:00 +CPU= 16.466
  10:07:11 STEP 2367 H=2367:00 +CPU= 26.312
  10:07:28 STEP 2368 H=2368:00 +CPU= 16.067
  10:07:43 STEP 2369 H=2369:00 +CPU= 15.310
  10:08:09 STEP 2370 H=2370:00 +CPU= 25.829
  10:08:25 STEP 2371 H=2371:00 +CPU= 15.860
  10:08:42 STEP 2372 H=2372:00 +CPU= 16.627
  10:09:09 STEP 2373 H=2373:00 +CPU= 25.923
  10:09:25 STEP 2374 H=2374:00 +CPU= 16.406
  10:09:42 STEP 2375 H=2375:00 +CPU= 16.693
  10:10:13 STEP 2376 H=2376:00 +CPU= 30.214
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002376
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002376
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002376
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002352
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002352
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002352
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002364
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002364
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002364
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0003_2019050100_123_988_12204647_1_r1050634236_98.zip
Uploading the intermediate file: upload_file_98.zip
  10:10:30 STEP 2377 H=2377:00 +CPU= 15.730
  10:10:47 STEP 2378 H=2378:00 +CPU= 16.401
  10:11:14 STEP 2379 H=2379:00 +CPU= 26.643
  10:11:32 STEP 2380 H=2380:00 +CPU= 17.576
  10:11:47 STEP 2381 H=2381:00 +CPU= 15.291
  10:12:15 STEP 2382 H=2382:00 +CPU= 27.072
  10:12:31 STEP 2383 H=2383:00 +CPU= 16.040
  10:12:48 STEP 2384 H=2384:00 +CPU= 16.563
  10:13:15 STEP 2385 H=2385:00 +CPU= 26.353
  10:13:33 STEP 2386 H=2386:00 +CPU= 17.754
  10:13:49 STEP 2387 H=2387:00 +CPU= 15.474
  10:14:19 STEP 2388 H=2388:00 +CPU= 29.985
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002388
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002388
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002388
  10:14:37 STEP 2389 H=2389:00 +CPU= 16.857
  10:14:54 STEP 2390 H=2390:00 +CPU= 16.901
  10:15:20 STEP 2391 H=2391:00 +CPU= 25.915
  10:15:38 STEP 2392 H=2392:00 +CPU= 17.154
  10:15:54 STEP 2393 H=2393:00 +CPU= 15.922
  10:16:21 STEP 2394 H=2394:00 +CPU= 25.790
  10:16:37 STEP 2395 H=2395:00 +CPU= 16.509
  10:16:54 STEP 2396 H=2396:00 +CPU= 16.328
  10:17:20 STEP 2397 H=2397:00 +CPU= 25.633
  10:17:37 STEP 2398 H=2398:00 +CPU= 17.384
  10:17:56 STEP 2399 H=2399:00 +CPU= 18.056
  10:18:29 STEP 2400 H=2400:00 +CPU= 32.205
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002400
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002400
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002400
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002376
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002376
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002376
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002388
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002388
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002388
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0003_2019050100_123_988_12204647_1_r1050634236_99.zip
Uploading the intermediate file: upload_file_99.zip
  10:18:45 STEP 2401 H=2401:00 +CPU= 15.818
Uploading trickle at timestep: 8640000
  10:19:02 STEP 2402 H=2402:00 +CPU= 16.475
  10:19:29 STEP 2403 H=2403:00 +CPU= 26.997
  10:19:46 STEP 2404 H=2404:00 +CPU= 16.489
  10:20:02 STEP 2405 H=2405:00 +CPU= 16.342
  10:20:29 STEP 2406 H=2406:00 +CPU= 26.020
  10:20:45 STEP 2407 H=2407:00 +CPU= 15.823
  10:21:02 STEP 2408 H=2408:00 +CPU= 16.580
  10:21:27 STEP 2409 H=2409:00 +CPU= 24.721
  10:21:44 STEP 2410 H=2410:00 +CPU= 16.826
  10:22:00 STEP 2411 H=2411:00 +CPU= 16.466
  10:22:29 STEP 2412 H=2412:00 +CPU= 28.261
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002412
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002412
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002412
  10:22:45 STEP 2413 H=2413:00 +CPU= 15.495
  10:23:02 STEP 2414 H=2414:00 +CPU= 16.230
  10:23:29 STEP 2415 H=2415:00 +CPU= 26.483
  10:23:45 STEP 2416 H=2416:00 +CPU= 16.067
  10:24:02 STEP 2417 H=2417:00 +CPU= 16.802
  10:24:30 STEP 2418 H=2418:00 +CPU= 27.963
  10:24:51 STEP 2419 H=2419:00 +CPU= 20.457
  10:25:09 STEP 2420 H=2420:00 +CPU= 17.381
  10:25:35 STEP 2421 H=2421:00 +CPU= 25.836
  10:25:53 STEP 2422 H=2422:00 +CPU= 17.464
  10:26:10 STEP 2423 H=2423:00 +CPU= 16.797
  10:26:42 STEP 2424 H=2424:00 +CPU= 31.394
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002424
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002424
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002424
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002400
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002400
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002400
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002412
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002412
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002412
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0003_2019050100_123_988_12204647_1_r1050634236_100.zip
Uploading the intermediate file: upload_file_100.zip
  10:26:59 STEP 2425 H=2425:00 +CPU= 16.570
  10:27:16 STEP 2426 H=2426:00 +CPU= 16.689
  10:27:41 STEP 2427 H=2427:00 +CPU= 25.085
  10:27:58 STEP 2428 H=2428:00 +CPU= 16.530
  10:28:15 STEP 2429 H=2429:00 +CPU= 16.268
  10:28:42 STEP 2430 H=2430:00 +CPU= 27.153
  10:28:59 STEP 2431 H=2431:00 +CPU= 16.900
  10:29:16 STEP 2432 H=2432:00 +CPU= 16.294
  10:29:44 STEP 2433 H=2433:00 +CPU= 27.292
  10:30:02 STEP 2434 H=2434:00 +CPU= 17.649
  10:30:19 STEP 2435 H=2435:00 +CPU= 16.890
  10:30:50 STEP 2436 H=2436:00 +CPU= 29.839
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002436
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002436
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002436
  10:31:07 STEP 2437 H=2437:00 +CPU= 16.692
  10:31:24 STEP 2438 H=2438:00 +CPU= 17.116
  10:31:52 STEP 2439 H=2439:00 +CPU= 26.885
  10:32:12 STEP 2440 H=2440:00 +CPU= 20.253
  10:32:28 STEP 2441 H=2441:00 +CPU= 15.620
  10:32:53 STEP 2442 H=2442:00 +CPU= 24.294
  10:33:10 STEP 2443 H=2443:00 +CPU= 16.213
  10:33:27 STEP 2444 H=2444:00 +CPU= 16.999
  10:33:52 STEP 2445 H=2445:00 +CPU= 24.854
  10:34:09 STEP 2446 H=2446:00 +CPU= 17.008
  10:34:26 STEP 2447 H=2447:00 +CPU= 16.382
  10:34:56 STEP 2448 H=2448:00 +CPU= 29.828
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002448
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002448
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002448
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002424
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002424
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002424
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002436
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002436
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002436
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0003_2019050100_123_988_12204647_1_r1050634236_101.zip
Uploading the intermediate file: upload_file_101.zip
  10:35:13 STEP 2449 H=2449:00 +CPU= 15.904
  10:35:29 STEP 2450 H=2450:00 +CPU= 15.947
  10:35:55 STEP 2451 H=2451:00 +CPU= 25.806
  10:36:13 STEP 2452 H=2452:00 +CPU= 16.756
  10:36:28 STEP 2453 H=2453:00 +CPU= 15.265
  10:36:57 STEP 2454 H=2454:00 +CPU= 27.849
  10:37:13 STEP 2455 H=2455:00 +CPU= 16.485
  10:37:30 STEP 2456 H=2456:00 +CPU= 16.153
  10:37:57 STEP 2457 H=2457:00 +CPU= 26.084
  10:38:15 STEP 2458 H=2458:00 +CPU= 18.101
  10:38:30 STEP 2459 H=2459:00 +CPU= 15.057
  10:39:00 STEP 2460 H=2460:00 +CPU= 29.089
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002460
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002460
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002460
  10:39:16 STEP 2461 H=2461:00 +CPU= 16.078
  10:39:33 STEP 2462 H=2462:00 +CPU= 15.966
  10:39:58 STEP 2463 H=2463:00 +CPU= 25.327
  10:40:16 STEP 2464 H=2464:00 +CPU= 17.130
  10:40:32 STEP 2465 H=2465:00 +CPU= 15.548
  10:40:58 STEP 2466 H=2466:00 +CPU= 26.459
  10:41:14 STEP 2467 H=2467:00 +CPU= 15.909
  10:41:31 STEP 2468 H=2468:00 +CPU= 16.091
  10:41:58 STEP 2469 H=2469:00 +CPU= 26.419
  10:42:15 STEP 2470 H=2470:00 +CPU= 17.303
  10:42:31 STEP 2471 H=2471:00 +CPU= 15.990
  10:43:05 STEP 2472 H=2472:00 +CPU= 32.397
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002472
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002472
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002472
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002448
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002448
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002448
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002460
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002460
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002460
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0003_2019050100_123_988_12204647_1_r1050634236_102.zip
Uploading the intermediate file: upload_file_102.zip
  10:43:25 STEP 2473 H=2473:00 +CPU= 20.349
  10:43:42 STEP 2474 H=2474:00 +CPU= 16.630
  10:44:09 STEP 2475 H=2475:00 +CPU= 26.515
  10:44:27 STEP 2476 H=2476:00 +CPU= 17.503
  10:44:43 STEP 2477 H=2477:00 +CPU= 15.380
  10:45:09 STEP 2478 H=2478:00 +CPU= 25.921
  10:45:26 STEP 2479 H=2479:00 +CPU= 16.576
  10:45:43 STEP 2480 H=2480:00 +CPU= 16.418
  10:46:10 STEP 2481 H=2481:00 +CPU= 26.284
  10:46:28 STEP 2482 H=2482:00 +CPU= 17.941
  10:46:45 STEP 2483 H=2483:00 +CPU= 16.334
  10:47:14 STEP 2484 H=2484:00 +CPU= 28.293
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002484
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002484
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002484
  10:47:30 STEP 2485 H=2485:00 +CPU= 16.349
  10:47:47 STEP 2486 H=2486:00 +CPU= 16.195
  10:48:15 STEP 2487 H=2487:00 +CPU= 27.834
  10:48:34 STEP 2488 H=2488:00 +CPU= 18.130
  10:48:55 STEP 2489 H=2489:00 +CPU= 21.104
  10:49:23 STEP 2490 H=2490:00 +CPU= 27.629
  10:49:41 STEP 2491 H=2491:00 +CPU= 17.309
  10:49:58 STEP 2492 H=2492:00 +CPU= 16.827
  10:50:24 STEP 2493 H=2493:00 +CPU= 26.209
  10:50:44 STEP 2494 H=2494:00 +CPU= 18.687
  10:51:01 STEP 2495 H=2495:00 +CPU= 17.497
  10:51:38 STEP 2496 H=2496:00 +CPU= 35.392
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002496
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002496
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002496
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002472
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002472
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002472
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002484
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002484
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002484
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0003_2019050100_123_988_12204647_1_r1050634236_103.zip
Uploading the intermediate file: upload_file_103.zip
  10:51:56 STEP 2497 H=2497:00 +CPU= 17.541
  10:52:15 STEP 2498 H=2498:00 +CPU= 18.159
  10:52:42 STEP 2499 H=2499:00 +CPU= 26.804
  10:53:00 STEP 2500 H=2500:00 +CPU= 17.839
  10:53:15 STEP 2501 H=2501:00 +CPU= 15.424
  10:53:49 STEP 2502 H=2502:00 +CPU= 33.250
  10:54:06 STEP 2503 H=2503:00 +CPU= 16.664
  10:54:24 STEP 2504 H=2504:00 +CPU= 17.565
  10:54:50 STEP 2505 H=2505:00 +CPU= 25.976
  10:55:06 STEP 2506 H=2506:00 +CPU= 15.951
  10:55:28 STEP 2507 H=2507:00 +CPU= 21.642
  10:55:59 STEP 2508 H=2508:00 +CPU= 29.963
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002508
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002508
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002508
  10:56:20 STEP 2509 H=2509:00 +CPU= 20.097
  10:56:37 STEP 2510 H=2510:00 +CPU= 16.413
  10:57:04 STEP 2511 H=2511:00 +CPU= 26.900
  10:57:21 STEP 2512 H=2512:00 +CPU= 16.840
  10:57:39 STEP 2513 H=2513:00 +CPU= 17.804
  10:58:07 STEP 2514 H=2514:00 +CPU= 27.603
  10:58:24 STEP 2515 H=2515:00 +CPU= 16.083
  10:58:40 STEP 2516 H=2516:00 +CPU= 16.596
  10:59:07 STEP 2517 H=2517:00 +CPU= 26.263
  10:59:24 STEP 2518 H=2518:00 +CPU= 16.770
  10:59:42 STEP 2519 H=2519:00 +CPU= 16.825
  11:00:14 STEP 2520 H=2520:00 +CPU= 31.976
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002520
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002520
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002520
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002496
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002496
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002496
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002508
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002508
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002508
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0003_2019050100_123_988_12204647_1_r1050634236_104.zip
Uploading the intermediate file: upload_file_104.zip
  11:00:30 STEP 2521 H=2521:00 +CPU= 15.977
  11:00:47 STEP 2522 H=2522:00 +CPU= 16.859
  11:01:14 STEP 2523 H=2523:00 +CPU= 25.894
  11:01:31 STEP 2524 H=2524:00 +CPU= 17.286
  11:01:48 STEP 2525 H=2525:00 +CPU= 16.143
  11:02:15 STEP 2526 H=2526:00 +CPU= 26.843
  11:02:32 STEP 2527 H=2527:00 +CPU= 16.918
  11:02:49 STEP 2528 H=2528:00 +CPU= 16.407
  11:03:14 STEP 2529 H=2529:00 +CPU= 24.579
  11:03:30 STEP 2530 H=2530:00 +CPU= 16.221
  11:03:47 STEP 2531 H=2531:00 +CPU= 16.584
  11:04:17 STEP 2532 H=2532:00 +CPU= 29.481
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002532
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002532
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002532
  11:04:34 STEP 2533 H=2533:00 +CPU= 16.011
  11:04:56 STEP 2534 H=2534:00 +CPU= 22.494
  11:05:30 STEP 2535 H=2535:00 +CPU= 33.021
  11:05:46 STEP 2536 H=2536:00 +CPU= 16.047
  11:06:03 STEP 2537 H=2537:00 +CPU= 16.465
  11:06:39 STEP 2538 H=2538:00 +CPU= 35.781
  11:06:56 STEP 2539 H=2539:00 +CPU= 16.349
  11:07:15 STEP 2540 H=2540:00 +CPU= 18.342
  11:07:41 STEP 2541 H=2541:00 +CPU= 26.395
  11:07:58 STEP 2542 H=2542:00 +CPU= 16.754
  11:08:32 STEP 2543 H=2543:00 +CPU= 32.986
  11:09:04 STEP 2544 H=2544:00 +CPU= 32.165
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002544
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002544
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002544
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002520
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002520
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002520
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002532
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002532
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002532
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0003_2019050100_123_988_12204647_1_r1050634236_105.zip
Uploading the intermediate file: upload_file_105.zip
  11:09:22 STEP 2545 H=2545:00 +CPU= 17.381
  11:09:41 STEP 2546 H=2546:00 +CPU= 18.114
  11:10:08 STEP 2547 H=2547:00 +CPU= 27.363
  11:10:26 STEP 2548 H=2548:00 +CPU= 17.683
  11:10:44 STEP 2549 H=2549:00 +CPU= 17.746
  11:11:13 STEP 2550 H=2550:00 +CPU= 28.165
  11:11:32 STEP 2551 H=2551:00 +CPU= 18.144
  11:11:49 STEP 2552 H=2552:00 +CPU= 16.829
  11:12:24 STEP 2553 H=2553:00 +CPU= 34.820
  11:12:42 STEP 2554 H=2554:00 +CPU= 17.345
  11:12:58 STEP 2555 H=2555:00 +CPU= 16.445
  11:13:29 STEP 2556 H=2556:00 +CPU= 29.764
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002556
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002556
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002556
  11:13:45 STEP 2557 H=2557:00 +CPU= 16.417
  11:14:04 STEP 2558 H=2558:00 +CPU= 18.399
  11:14:32 STEP 2559 H=2559:00 +CPU= 27.184
  11:14:49 STEP 2560 H=2560:00 +CPU= 17.026
  11:15:06 STEP 2561 H=2561:00 +CPU= 16.352
  11:15:56 STEP 2562 H=2562:00 +CPU= 49.758
  11:16:13 STEP 2563 H=2563:00 +CPU= 16.376
  11:16:30 STEP 2564 H=2564:00 +CPU= 17.074
  11:17:00 STEP 2565 H=2565:00 +CPU= 28.917
  11:17:17 STEP 2566 H=2566:00 +CPU= 17.173
  11:17:35 STEP 2567 H=2567:00 +CPU= 17.381
  11:18:05 STEP 2568 H=2568:00 +CPU= 29.696
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002568
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002568
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002568
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002544
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002544
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002544
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002556
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002556
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002556
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0003_2019050100_123_988_12204647_1_r1050634236_106.zip
Uploading the intermediate file: upload_file_106.zip
  11:18:22 STEP 2569 H=2569:00 +CPU= 15.769
  11:18:39 STEP 2570 H=2570:00 +CPU= 17.387
  11:19:08 STEP 2571 H=2571:00 +CPU= 27.900
  11:19:25 STEP 2572 H=2572:00 +CPU= 17.049
  11:19:42 STEP 2573 H=2573:00 +CPU= 16.438
  11:20:09 STEP 2574 H=2574:00 +CPU= 27.179
  11:20:27 STEP 2575 H=2575:00 +CPU= 17.253
  11:20:44 STEP 2576 H=2576:00 +CPU= 17.277
  11:21:24 STEP 2577 H=2577:00 +CPU= 39.173
  11:21:41 STEP 2578 H=2578:00 +CPU= 16.417
  11:21:56 STEP 2579 H=2579:00 +CPU= 15.041
  11:22:24 STEP 2580 H=2580:00 +CPU= 27.456
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002580
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002580
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002580
  11:22:39 STEP 2581 H=2581:00 +CPU= 15.051
  11:22:56 STEP 2582 H=2582:00 +CPU= 16.140
  11:23:21 STEP 2583 H=2583:00 +CPU= 24.745
  11:23:38 STEP 2584 H=2584:00 +CPU= 16.063
  11:23:53 STEP 2585 H=2585:00 +CPU= 15.419
  11:24:18 STEP 2586 H=2586:00 +CPU= 24.374
  11:24:34 STEP 2587 H=2587:00 +CPU= 15.283
  11:24:50 STEP 2588 H=2588:00 +CPU= 16.049
  11:25:16 STEP 2589 H=2589:00 +CPU= 24.602
  11:25:33 STEP 2590 H=2590:00 +CPU= 17.368
  11:25:50 STEP 2591 H=2591:00 +CPU= 16.812
  11:26:22 STEP 2592 H=2592:00 +CPU= 30.770
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002592
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002592
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002592
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002568
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002568
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002568
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002580
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002580
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002580
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0003_2019050100_123_988_12204647_1_r1050634236_107.zip
Uploading the intermediate file: upload_file_107.zip
  11:26:38 STEP 2593 H=2593:00 +CPU= 15.831
  11:26:55 STEP 2594 H=2594:00 +CPU= 16.136
  11:27:20 STEP 2595 H=2595:00 +CPU= 25.007
  11:27:37 STEP 2596 H=2596:00 +CPU= 16.465
  11:27:54 STEP 2597 H=2597:00 +CPU= 16.525
  11:28:21 STEP 2598 H=2598:00 +CPU= 26.259
  11:28:38 STEP 2599 H=2599:00 +CPU= 16.819
  11:28:54 STEP 2600 H=2600:00 +CPU= 16.361
  11:29:20 STEP 2601 H=2601:00 +CPU= 25.412
  11:29:42 STEP 2602 H=2602:00 +CPU= 21.666
  11:29:58 STEP 2603 H=2603:00 +CPU= 16.081
  11:30:28 STEP 2604 H=2604:00 +CPU= 29.097
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002604
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002604
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002604
  11:30:54 STEP 2605 H=2605:00 +CPU= 26.061
  11:31:12 STEP 2606 H=2606:00 +CPU= 17.608
  11:31:39 STEP 2607 H=2607:00 +CPU= 26.409
  11:32:05 STEP 2608 H=2608:00 +CPU= 16.954
  11:32:24 STEP 2609 H=2609:00 +CPU= 17.837
  11:32:50 STEP 2610 H=2610:00 +CPU= 26.162
  11:33:07 STEP 2611 H=2611:00 +CPU= 16.700
  11:33:25 STEP 2612 H=2612:00 +CPU= 16.842
  11:33:54 STEP 2613 H=2613:00 +CPU= 29.258
  11:34:12 STEP 2614 H=2614:00 +CPU= 17.528
  11:34:30 STEP 2615 H=2615:00 +CPU= 17.128
  11:35:01 STEP 2616 H=2616:00 +CPU= 31.337
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002616
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002616
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002616
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002592
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002592
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002592
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002604
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002604
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002604
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0003_2019050100_123_988_12204647_1_r1050634236_108.zip
Uploading the intermediate file: upload_file_108.zip
  11:35:19 STEP 2617 H=2617:00 +CPU= 17.093
  11:35:36 STEP 2618 H=2618:00 +CPU= 16.870
  11:36:02 STEP 2619 H=2619:00 +CPU= 25.684
  11:36:19 STEP 2620 H=2620:00 +CPU= 16.623
  11:36:36 STEP 2621 H=2621:00 +CPU= 16.302
  11:37:02 STEP 2622 H=2622:00 +CPU= 25.883
  11:37:17 STEP 2623 H=2623:00 +CPU= 15.360
  11:37:35 STEP 2624 H=2624:00 +CPU= 16.868
  11:38:01 STEP 2625 H=2625:00 +CPU= 25.934
  11:38:19 STEP 2626 H=2626:00 +CPU= 17.410
  11:38:35 STEP 2627 H=2627:00 +CPU= 16.499
  11:39:03 STEP 2628 H=2628:00 +CPU= 27.495
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002628
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002628
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002628
  11:39:20 STEP 2629 H=2629:00 +CPU= 16.239
  11:39:37 STEP 2630 H=2630:00 +CPU= 16.959
  11:40:03 STEP 2631 H=2631:00 +CPU= 25.733
  11:40:21 STEP 2632 H=2632:00 +CPU= 16.962
  11:40:37 STEP 2633 H=2633:00 +CPU= 15.889
  11:41:03 STEP 2634 H=2634:00 +CPU= 26.021
  11:41:20 STEP 2635 H=2635:00 +CPU= 16.633
  11:41:38 STEP 2636 H=2636:00 +CPU= 17.160
  11:42:05 STEP 2637 H=2637:00 +CPU= 27.024
  11:42:22 STEP 2638 H=2638:00 +CPU= 16.491
  11:42:38 STEP 2639 H=2639:00 +CPU= 16.055
  11:43:09 STEP 2640 H=2640:00 +CPU= 29.903
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002640
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002640
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002640
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002616
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002616
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002616
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002628
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002628
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002628
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0003_2019050100_123_988_12204647_1_r1050634236_109.zip
Uploading the intermediate file: upload_file_109.zip
  11:43:25 STEP 2641 H=2641:00 +CPU= 15.970
Uploading trickle at timestep: 9504000
  11:43:41 STEP 2642 H=2642:00 +CPU= 15.913
  11:44:06 STEP 2643 H=2643:00 +CPU= 24.560
  11:44:23 STEP 2644 H=2644:00 +CPU= 16.774
  11:44:40 STEP 2645 H=2645:00 +CPU= 16.409
  11:45:06 STEP 2646 H=2646:00 +CPU= 25.680
  11:45:23 STEP 2647 H=2647:00 +CPU= 16.844
  11:45:40 STEP 2648 H=2648:00 +CPU= 16.217
  11:46:05 STEP 2649 H=2649:00 +CPU= 25.033
  11:46:22 STEP 2650 H=2650:00 +CPU= 16.656
  11:46:38 STEP 2651 H=2651:00 +CPU= 15.365
  11:47:07 STEP 2652 H=2652:00 +CPU= 27.954
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002652
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002652
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002652
  11:47:22 STEP 2653 H=2653:00 +CPU= 15.544
  11:47:39 STEP 2654 H=2654:00 +CPU= 16.718
  11:48:05 STEP 2655 H=2655:00 +CPU= 24.693
  11:48:21 STEP 2656 H=2656:00 +CPU= 16.040
  11:48:38 STEP 2657 H=2657:00 +CPU= 16.525
  11:49:05 STEP 2658 H=2658:00 +CPU= 26.617
  11:49:21 STEP 2659 H=2659:00 +CPU= 16.014
  11:49:38 STEP 2660 H=2660:00 +CPU= 16.477
  11:50:04 STEP 2661 H=2661:00 +CPU= 25.732
  11:50:22 STEP 2662 H=2662:00 +CPU= 17.034
  11:50:39 STEP 2663 H=2663:00 +CPU= 16.710
  11:51:10 STEP 2664 H=2664:00 +CPU= 30.408
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002664
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002664
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002664
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002640
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002640
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002640
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002652
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002652
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002652
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0003_2019050100_123_988_12204647_1_r1050634236_110.zip
Uploading the intermediate file: upload_file_110.zip
  11:51:26 STEP 2665 H=2665:00 +CPU= 16.132
  11:51:44 STEP 2666 H=2666:00 +CPU= 17.034
  11:52:09 STEP 2667 H=2667:00 +CPU= 25.210
  11:52:26 STEP 2668 H=2668:00 +CPU= 16.839
  11:52:43 STEP 2669 H=2669:00 +CPU= 16.007
  11:53:09 STEP 2670 H=2670:00 +CPU= 25.676
  11:53:25 STEP 2671 H=2671:00 +CPU= 16.304
  11:53:42 STEP 2672 H=2672:00 +CPU= 16.270
  11:54:07 STEP 2673 H=2673:00 +CPU= 25.248
  11:54:24 STEP 2674 H=2674:00 +CPU= 16.012
  11:54:41 STEP 2675 H=2675:00 +CPU= 16.462
  11:55:09 STEP 2676 H=2676:00 +CPU= 28.285
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002676
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002676
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002676
  11:55:27 STEP 2677 H=2677:00 +CPU= 17.871
  11:55:45 STEP 2678 H=2678:00 +CPU= 17.619
  11:56:12 STEP 2679 H=2679:00 +CPU= 25.999
  11:56:30 STEP 2680 H=2680:00 +CPU= 17.236
  11:56:46 STEP 2681 H=2681:00 +CPU= 15.872
  11:57:11 STEP 2682 H=2682:00 +CPU= 25.377
  11:57:28 STEP 2683 H=2683:00 +CPU= 16.183
  11:57:45 STEP 2684 H=2684:00 +CPU= 16.422
  11:58:10 STEP 2685 H=2685:00 +CPU= 25.130
  11:58:28 STEP 2686 H=2686:00 +CPU= 17.214
  11:58:46 STEP 2687 H=2687:00 +CPU= 17.555
  11:59:17 STEP 2688 H=2688:00 +CPU= 30.543
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002688
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002688
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002688
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002664
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002664
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002664
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002676
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002676
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002676
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0003_2019050100_123_988_12204647_1_r1050634236_111.zip
Uploading the intermediate file: upload_file_111.zip
  11:59:34 STEP 2689 H=2689:00 +CPU= 16.633
  11:59:53 STEP 2690 H=2690:00 +CPU= 17.732
  12:00:18 STEP 2691 H=2691:00 +CPU= 25.502
  12:00:35 STEP 2692 H=2692:00 +CPU= 16.714
  12:00:52 STEP 2693 H=2693:00 +CPU= 16.372
  12:01:17 STEP 2694 H=2694:00 +CPU= 25.117
  12:01:34 STEP 2695 H=2695:00 +CPU= 16.473
  12:01:51 STEP 2696 H=2696:00 +CPU= 16.225
  12:02:17 STEP 2697 H=2697:00 +CPU= 25.577
  12:02:34 STEP 2698 H=2698:00 +CPU= 17.217
  12:02:50 STEP 2699 H=2699:00 +CPU= 15.394
  12:03:19 STEP 2700 H=2700:00 +CPU= 28.387
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002700
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002700
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002700
  12:03:35 STEP 2701 H=2701:00 +CPU= 16.193
  12:03:53 STEP 2702 H=2702:00 +CPU= 17.591
  12:04:19 STEP 2703 H=2703:00 +CPU= 25.502
  12:04:36 STEP 2704 H=2704:00 +CPU= 16.749
  12:04:53 STEP 2705 H=2705:00 +CPU= 16.654
  12:05:20 STEP 2706 H=2706:00 +CPU= 26.918
  12:05:37 STEP 2707 H=2707:00 +CPU= 16.362
  12:05:55 STEP 2708 H=2708:00 +CPU= 17.874
  12:06:21 STEP 2709 H=2709:00 +CPU= 25.187
  12:06:38 STEP 2710 H=2710:00 +CPU= 16.705
  12:06:55 STEP 2711 H=2711:00 +CPU= 16.903
  12:07:30 STEP 2712 H=2712:00 +CPU= 33.771
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002712
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002712
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002712
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002688
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002688
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002688
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002700
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002700
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002700
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0003_2019050100_123_988_12204647_1_r1050634236_112.zip
Uploading the intermediate file: upload_file_112.zip
  12:07:46 STEP 2713 H=2713:00 +CPU= 16.037
  12:08:04 STEP 2714 H=2714:00 +CPU= 17.434
  12:08:30 STEP 2715 H=2715:00 +CPU= 26.187
  12:08:48 STEP 2716 H=2716:00 +CPU= 17.274
  12:09:04 STEP 2717 H=2717:00 +CPU= 15.766
  12:09:30 STEP 2718 H=2718:00 +CPU= 25.508
  12:09:45 STEP 2719 H=2719:00 +CPU= 15.751
  12:10:03 STEP 2720 H=2720:00 +CPU= 17.492
  12:10:29 STEP 2721 H=2721:00 +CPU= 25.677
  12:10:47 STEP 2722 H=2722:00 +CPU= 17.357
  12:11:04 STEP 2723 H=2723:00 +CPU= 15.986
  12:11:34 STEP 2724 H=2724:00 +CPU= 30.138
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002724
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002724
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002724
  12:11:51 STEP 2725 H=2725:00 +CPU= 16.120
  12:12:09 STEP 2726 H=2726:00 +CPU= 17.744
  12:12:35 STEP 2727 H=2727:00 +CPU= 26.069
  12:13:04 STEP 2728 H=2728:00 +CPU= 28.542
  12:13:20 STEP 2729 H=2729:00 +CPU= 15.726
  12:13:51 STEP 2730 H=2730:00 +CPU= 29.860
  12:14:08 STEP 2731 H=2731:00 +CPU= 17.417
  12:14:26 STEP 2732 H=2732:00 +CPU= 17.839
  12:14:53 STEP 2733 H=2733:00 +CPU= 25.799
  12:15:11 STEP 2734 H=2734:00 +CPU= 17.607
  12:15:28 STEP 2735 H=2735:00 +CPU= 17.257
  12:16:00 STEP 2736 H=2736:00 +CPU= 30.864
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002736
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002736
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002736
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002712
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002712
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002712
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002724
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002724
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002724
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0003_2019050100_123_988_12204647_1_r1050634236_113.zip
Uploading the intermediate file: upload_file_113.zip
  12:16:16 STEP 2737 H=2737:00 +CPU= 16.195
  12:16:34 STEP 2738 H=2738:00 +CPU= 17.108
  12:16:59 STEP 2739 H=2739:00 +CPU= 25.049
  12:17:17 STEP 2740 H=2740:00 +CPU= 17.365
  12:17:33 STEP 2741 H=2741:00 +CPU= 16.101
  12:18:00 STEP 2742 H=2742:00 +CPU= 26.150
  12:18:17 STEP 2743 H=2743:00 +CPU= 16.522
  12:18:35 STEP 2744 H=2744:00 +CPU= 17.815
  12:19:00 STEP 2745 H=2745:00 +CPU= 25.196
  12:19:18 STEP 2746 H=2746:00 +CPU= 17.479
  12:19:36 STEP 2747 H=2747:00 +CPU= 16.922
  12:20:06 STEP 2748 H=2748:00 +CPU= 29.127
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002748
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002748
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002748
  12:20:23 STEP 2749 H=2749:00 +CPU= 17.002
  12:20:40 STEP 2750 H=2750:00 +CPU= 16.284
  12:21:05 STEP 2751 H=2751:00 +CPU= 24.737
  12:21:22 STEP 2752 H=2752:00 +CPU= 17.181
  12:21:39 STEP 2753 H=2753:00 +CPU= 16.648
  12:22:06 STEP 2754 H=2754:00 +CPU= 26.325
  12:22:23 STEP 2755 H=2755:00 +CPU= 16.212
  12:22:39 STEP 2756 H=2756:00 +CPU= 16.549
  12:23:05 STEP 2757 H=2757:00 +CPU= 25.231
  12:23:26 STEP 2758 H=2758:00 +CPU= 20.136
  12:23:43 STEP 2759 H=2759:00 +CPU= 16.670
  12:24:12 STEP 2760 H=2760:00 +CPU= 28.782
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002760
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002760
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002760
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002736
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002736
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002736
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002748
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002748
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002748
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0003_2019050100_123_988_12204647_1_r1050634236_114.zip
Uploading the intermediate file: upload_file_114.zip
  12:24:28 STEP 2761 H=2761:00 +CPU= 15.682
  12:24:45 STEP 2762 H=2762:00 +CPU= 16.609
  12:25:11 STEP 2763 H=2763:00 +CPU= 25.673
  12:25:28 STEP 2764 H=2764:00 +CPU= 16.843
  12:25:45 STEP 2765 H=2765:00 +CPU= 16.094
  12:26:10 STEP 2766 H=2766:00 +CPU= 25.095
  12:26:27 STEP 2767 H=2767:00 +CPU= 16.362
  12:26:43 STEP 2768 H=2768:00 +CPU= 16.153
  12:27:09 STEP 2769 H=2769:00 +CPU= 25.285
  12:27:26 STEP 2770 H=2770:00 +CPU= 16.352
  12:27:42 STEP 2771 H=2771:00 +CPU= 15.935
  12:28:11 STEP 2772 H=2772:00 +CPU= 28.366
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002772
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002772
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002772
  12:28:28 STEP 2773 H=2773:00 +CPU= 16.449
  12:28:43 STEP 2774 H=2774:00 +CPU= 15.484
  12:29:08 STEP 2775 H=2775:00 +CPU= 24.582
  12:29:25 STEP 2776 H=2776:00 +CPU= 16.064
  12:29:41 STEP 2777 H=2777:00 +CPU= 15.706
  12:30:06 STEP 2778 H=2778:00 +CPU= 25.476
  12:30:23 STEP 2779 H=2779:00 +CPU= 16.366
  12:30:39 STEP 2780 H=2780:00 +CPU= 15.871
  12:31:04 STEP 2781 H=2781:00 +CPU= 24.675
  12:31:21 STEP 2782 H=2782:00 +CPU= 16.953
  12:31:37 STEP 2783 H=2783:00 +CPU= 15.938
  12:32:07 STEP 2784 H=2784:00 +CPU= 29.538
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002784
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002784
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002784
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002760
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002760
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002760
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002772
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002772
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002772
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0003_2019050100_123_988_12204647_1_r1050634236_115.zip
Uploading the intermediate file: upload_file_115.zip
  12:32:24 STEP 2785 H=2785:00 +CPU= 15.991
  12:32:40 STEP 2786 H=2786:00 +CPU= 16.100
  12:33:07 STEP 2787 H=2787:00 +CPU= 26.090
  12:33:24 STEP 2788 H=2788:00 +CPU= 16.981
  12:33:40 STEP 2789 H=2789:00 +CPU= 15.587
  12:34:06 STEP 2790 H=2790:00 +CPU= 25.988
  12:34:23 STEP 2791 H=2791:00 +CPU= 16.460
  12:34:39 STEP 2792 H=2792:00 +CPU= 15.971
  12:35:05 STEP 2793 H=2793:00 +CPU= 25.356
  12:35:23 STEP 2794 H=2794:00 +CPU= 17.255
  12:35:39 STEP 2795 H=2795:00 +CPU= 16.072
  12:36:08 STEP 2796 H=2796:00 +CPU= 28.383
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002796
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002796
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002796
  12:36:25 STEP 2797 H=2797:00 +CPU= 16.286
  12:36:41 STEP 2798 H=2798:00 +CPU= 16.160
  12:37:07 STEP 2799 H=2799:00 +CPU= 25.153
  12:37:23 STEP 2800 H=2800:00 +CPU= 16.062
  12:37:39 STEP 2801 H=2801:00 +CPU= 15.436
  12:38:06 STEP 2802 H=2802:00 +CPU= 26.869
  12:38:23 STEP 2803 H=2803:00 +CPU= 16.168
  12:38:39 STEP 2804 H=2804:00 +CPU= 16.253
  12:39:06 STEP 2805 H=2805:00 +CPU= 25.675
  12:39:23 STEP 2806 H=2806:00 +CPU= 16.866
  12:39:39 STEP 2807 H=2807:00 +CPU= 16.364
  12:40:28 STEP 2808 H=2808:00 +CPU= 48.082
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002808
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002808
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002808
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002784
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002784
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002784
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002796
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002796
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002796
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0003_2019050100_123_988_12204647_1_r1050634236_116.zip
Uploading the intermediate file: upload_file_116.zip
  12:40:47 STEP 2809 H=2809:00 +CPU= 18.717
  12:41:04 STEP 2810 H=2810:00 +CPU= 16.725
  12:41:29 STEP 2811 H=2811:00 +CPU= 24.401
  12:41:46 STEP 2812 H=2812:00 +CPU= 16.539
  12:42:02 STEP 2813 H=2813:00 +CPU= 15.777
  12:42:28 STEP 2814 H=2814:00 +CPU= 26.015
  12:42:45 STEP 2815 H=2815:00 +CPU= 15.908
  12:43:01 STEP 2816 H=2816:00 +CPU= 15.716
  12:43:35 STEP 2817 H=2817:00 +CPU= 34.045
  12:43:53 STEP 2818 H=2818:00 +CPU= 17.036
  12:44:09 STEP 2819 H=2819:00 +CPU= 15.833
  12:44:37 STEP 2820 H=2820:00 +CPU= 27.423
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002820
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002820
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002820
  12:44:52 STEP 2821 H=2821:00 +CPU= 15.729
  12:45:08 STEP 2822 H=2822:00 +CPU= 15.488
  12:45:35 STEP 2823 H=2823:00 +CPU= 25.798
  12:45:52 STEP 2824 H=2824:00 +CPU= 16.850
  12:46:07 STEP 2825 H=2825:00 +CPU= 15.324
  12:46:33 STEP 2826 H=2826:00 +CPU= 25.758
  12:46:49 STEP 2827 H=2827:00 +CPU= 15.936
  12:47:06 STEP 2828 H=2828:00 +CPU= 15.841
  12:47:31 STEP 2829 H=2829:00 +CPU= 24.527
  12:47:46 STEP 2830 H=2830:00 +CPU= 15.431
  12:48:02 STEP 2831 H=2831:00 +CPU= 15.742
  12:48:33 STEP 2832 H=2832:00 +CPU= 29.859
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002832
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002832
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002832
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002808
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002808
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002808
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002820
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002820
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002820
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0003_2019050100_123_988_12204647_1_r1050634236_117.zip
Uploading the intermediate file: upload_file_117.zip
  12:48:50 STEP 2833 H=2833:00 +CPU= 16.698
  12:49:07 STEP 2834 H=2834:00 +CPU= 16.643
  12:49:35 STEP 2835 H=2835:00 +CPU= 26.626
  12:49:52 STEP 2836 H=2836:00 +CPU= 17.444
  12:50:08 STEP 2837 H=2837:00 +CPU= 15.795
  12:50:36 STEP 2838 H=2838:00 +CPU= 27.299
  12:50:54 STEP 2839 H=2839:00 +CPU= 17.229
  12:51:12 STEP 2840 H=2840:00 +CPU= 17.453
  12:51:38 STEP 2841 H=2841:00 +CPU= 26.468
  12:51:56 STEP 2842 H=2842:00 +CPU= 16.628
  12:52:13 STEP 2843 H=2843:00 +CPU= 16.809
  12:52:43 STEP 2844 H=2844:00 +CPU= 29.733
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002844
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002844
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002844
  12:53:00 STEP 2845 H=2845:00 +CPU= 16.666
  12:53:17 STEP 2846 H=2846:00 +CPU= 17.207
  12:53:44 STEP 2847 H=2847:00 +CPU= 25.815
  12:54:01 STEP 2848 H=2848:00 +CPU= 17.427
  12:54:19 STEP 2849 H=2849:00 +CPU= 17.070
  12:54:45 STEP 2850 H=2850:00 +CPU= 26.042
  12:55:02 STEP 2851 H=2851:00 +CPU= 17.020
  12:55:19 STEP 2852 H=2852:00 +CPU= 16.812
  12:55:47 STEP 2853 H=2853:00 +CPU= 26.623
  12:56:04 STEP 2854 H=2854:00 +CPU= 16.909
  12:56:21 STEP 2855 H=2855:00 +CPU= 16.941
  12:56:52 STEP 2856 H=2856:00 +CPU= 30.772
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002856
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002856
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002856
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002832
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002832
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002832
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002844
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002844
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002844
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0003_2019050100_123_988_12204647_1_r1050634236_118.zip
Uploading the intermediate file: upload_file_118.zip
  12:57:09 STEP 2857 H=2857:00 +CPU= 16.508
  12:57:25 STEP 2858 H=2858:00 +CPU= 15.580
  12:57:52 STEP 2859 H=2859:00 +CPU= 25.989
  12:58:09 STEP 2860 H=2860:00 +CPU= 16.584
  12:58:26 STEP 2861 H=2861:00 +CPU= 16.908
  12:58:53 STEP 2862 H=2862:00 +CPU= 26.606
  12:59:09 STEP 2863 H=2863:00 +CPU= 16.396
  12:59:26 STEP 2864 H=2864:00 +CPU= 16.786
  12:59:54 STEP 2865 H=2865:00 +CPU= 27.371
  13:00:11 STEP 2866 H=2866:00 +CPU= 16.582
  13:00:28 STEP 2867 H=2867:00 +CPU= 16.360
  13:00:57 STEP 2868 H=2868:00 +CPU= 28.269
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002868
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002868
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002868
  13:01:14 STEP 2869 H=2869:00 +CPU= 17.073
  13:01:31 STEP 2870 H=2870:00 +CPU= 16.026
  13:01:56 STEP 2871 H=2871:00 +CPU= 25.303
  13:02:15 STEP 2872 H=2872:00 +CPU= 17.739
  13:02:30 STEP 2873 H=2873:00 +CPU= 15.257
  13:02:56 STEP 2874 H=2874:00 +CPU= 25.515
  13:03:13 STEP 2875 H=2875:00 +CPU= 16.829
  13:03:30 STEP 2876 H=2876:00 +CPU= 16.100
  13:03:55 STEP 2877 H=2877:00 +CPU= 24.706
  13:04:12 STEP 2878 H=2878:00 +CPU= 16.978
  13:04:29 STEP 2879 H=2879:00 +CPU= 16.540
  13:05:00 STEP 2880 H=2880:00 +CPU= 30.173
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002880
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002880
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002880
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002856
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002856
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002856
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002868
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002868
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002868
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0003_2019050100_123_988_12204647_1_r1050634236_119.zip
Uploading the intermediate file: upload_file_119.zip
  13:05:17 STEP 2881 H=2881:00 +CPU= 16.559
Uploading trickle at timestep: 10368000
  13:05:33 STEP 2882 H=2882:00 +CPU= 16.333
  13:05:59 STEP 2883 H=2883:00 +CPU= 25.493
  13:06:16 STEP 2884 H=2884:00 +CPU= 16.786
  13:06:32 STEP 2885 H=2885:00 +CPU= 15.762
  13:06:59 STEP 2886 H=2886:00 +CPU= 26.745
  13:07:17 STEP 2887 H=2887:00 +CPU= 17.041
  13:07:34 STEP 2888 H=2888:00 +CPU= 16.994
  13:08:00 STEP 2889 H=2889:00 +CPU= 25.475
  13:08:17 STEP 2890 H=2890:00 +CPU= 16.916
  13:08:33 STEP 2891 H=2891:00 +CPU= 15.767
  13:09:02 STEP 2892 H=2892:00 +CPU= 28.574
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002892
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002892
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002892
  13:09:19 STEP 2893 H=2893:00 +CPU= 16.605
  13:09:37 STEP 2894 H=2894:00 +CPU= 17.223
  13:10:05 STEP 2895 H=2895:00 +CPU= 26.815
  13:10:22 STEP 2896 H=2896:00 +CPU= 17.251
  13:10:39 STEP 2897 H=2897:00 +CPU= 15.998
  13:11:06 STEP 2898 H=2898:00 +CPU= 26.565
  13:11:23 STEP 2899 H=2899:00 +CPU= 16.821
  13:11:39 STEP 2900 H=2900:00 +CPU= 16.145
  13:12:08 STEP 2901 H=2901:00 +CPU= 28.366
  13:12:26 STEP 2902 H=2902:00 +CPU= 17.676
  13:12:42 STEP 2903 H=2903:00 +CPU= 16.312
  13:13:21 STEP 2904 H=2904:00 +CPU= 38.537
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002904
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002904
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002904
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002880
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002880
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002880
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002892
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002892
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002892
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0003_2019050100_123_988_12204647_1_r1050634236_120.zip
Uploading the intermediate file: upload_file_120.zip
  13:13:38 STEP 2905 H=2905:00 +CPU= 16.505
  13:13:55 STEP 2906 H=2906:00 +CPU= 16.330
  13:14:21 STEP 2907 H=2907:00 +CPU= 25.455
  13:14:37 STEP 2908 H=2908:00 +CPU= 16.033
  13:14:53 STEP 2909 H=2909:00 +CPU= 15.809
  13:15:19 STEP 2910 H=2910:00 +CPU= 25.582
  13:15:36 STEP 2911 H=2911:00 +CPU= 16.048
  13:15:52 STEP 2912 H=2912:00 +CPU= 16.323
  13:16:33 STEP 2913 H=2913:00 +CPU= 40.642
  13:16:50 STEP 2914 H=2914:00 +CPU= 16.291
  13:17:06 STEP 2915 H=2915:00 +CPU= 16.052
  13:17:36 STEP 2916 H=2916:00 +CPU= 28.889
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002916
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002916
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002916
  13:17:52 STEP 2917 H=2917:00 +CPU= 16.278
  13:18:10 STEP 2918 H=2918:00 +CPU= 17.586
  13:18:37 STEP 2919 H=2919:00 +CPU= 25.709
  13:18:54 STEP 2920 H=2920:00 +CPU= 16.966
  13:19:10 STEP 2921 H=2921:00 +CPU= 16.115
  13:19:37 STEP 2922 H=2922:00 +CPU= 26.240
  13:19:53 STEP 2923 H=2923:00 +CPU= 15.488
  13:20:10 STEP 2924 H=2924:00 +CPU= 16.630
  13:20:46 STEP 2925 H=2925:00 +CPU= 35.908
  13:21:07 STEP 2926 H=2926:00 +CPU= 21.199
  13:21:24 STEP 2927 H=2927:00 +CPU= 16.622
  13:21:56 STEP 2928 H=2928:00 +CPU= 30.795
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002928
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002928
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002928
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002904
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002904
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002904
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002916
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002916
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002916
Zipping up the intermediate file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0003_2019050100_123_988_12204647_1_r1050634236_121.zip
Uploading the intermediate file: upload_file_121.zip
  13:22:13 STEP 2929 H=2929:00 +CPU= 16.082
  13:22:29 STEP 2930 H=2930:00 +CPU= 15.821
  13:22:55 STEP 2931 H=2931:00 +CPU= 25.267
  13:23:11 STEP 2932 H=2932:00 +CPU= 16.050
  13:23:27 STEP 2933 H=2933:00 +CPU= 15.613
  13:23:53 STEP 2934 H=2934:00 +CPU= 25.720
  13:24:09 STEP 2935 H=2935:00 +CPU= 15.942
  13:24:25 STEP 2936 H=2936:00 +CPU= 15.544
  13:24:52 STEP 2937 H=2937:00 +CPU= 25.921
  13:25:09 STEP 2938 H=2938:00 +CPU= 16.936
  13:25:25 STEP 2939 H=2939:00 +CPU= 15.286
  13:25:54 STEP 2940 H=2940:00 +CPU= 28.124
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002940
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002940
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002940
  13:26:11 STEP 2941 H=2941:00 +CPU= 16.682
  13:26:27 STEP 2942 H=2942:00 +CPU= 16.183
  13:26:54 STEP 2943 H=2943:00 +CPU= 25.792
  13:27:15 STEP 2944 H=2944:00 +CPU= 21.315
  13:27:31 STEP 2945 H=2945:00 +CPU= 15.280
  13:27:57 STEP 2946 H=2946:00 +CPU= 26.064
  13:28:14 STEP 2947 H=2947:00 +CPU= 16.127
  13:28:29 STEP 2948 H=2948:00 +CPU= 15.674
  13:28:53 STEP 2949 H=2949:00 +CPU= 23.730
  13:29:09 STEP 2950 H=2950:00 +CPU= 15.929
  13:29:24 STEP 2951 H=2951:00 +CPU= 14.912
  13:29:51 STEP 2952 H=2952:00 +CPU= 26.755
The child process terminated with status: 0
Moving to projects directory: /home/roland/slots/1/ICMGGhq0f+002952
Moving to projects directory: /home/roland/slots/1/ICMSHhq0f+002952
Moving to projects directory: /home/roland/slots/1/ICMUAhq0f+002952
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002952
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002940
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002928
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002952
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002940
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMUAhq0f+002928
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMGGhq0f+002952
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002940
Adding to the zip: /home/roland/projects/climateprediction.net/oifs_43r3_ps_12204647/ICMSHhq0f+002928
Zipping up the final file: /home/roland/projects/climateprediction.net/oifs_43r3_ps_0003_2019050100_123_988_12204647_1_r1050634236_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
13:33:15 (2764): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:43:33 1517859 22304173 oifs_43r3_ps_0003_2019050100_123_988_12204647_1 10,623,600 59,899 0.0056
09 May 2023 16:43:33 1517859 22304173 oifs_43r3_ps_0003_2019050100_123_988_12204647_1 10,368,000 58,437 0.0056
09 May 2023 16:43:28 1517859 22304173 oifs_43r3_ps_0003_2019050100_123_988_12204647_1 9,504,000 53,618 0.0056
09 May 2023 16:43:25 1517859 22304173 oifs_43r3_ps_0003_2019050100_123_988_12204647_1 8,640,000 48,635 0.0056
09 May 2023 16:43:22 1517859 22304173 oifs_43r3_ps_0003_2019050100_123_988_12204647_1 7,776,000 43,779 0.0056
09 May 2023 16:43:16 1517859 22304173 oifs_43r3_ps_0003_2019050100_123_988_12204647_1 6,912,000 38,938 0.0056
09 May 2023 16:43:14 1517859 22304173 oifs_43r3_ps_0003_2019050100_123_988_12204647_1 6,048,000 34,006 0.0056
09 May 2023 16:43:11 1517859 22304173 oifs_43r3_ps_0003_2019050100_123_988_12204647_1 5,184,000 29,225 0.0056
09 May 2023 16:43:05 1517859 22304173 oifs_43r3_ps_0003_2019050100_123_988_12204647_1 4,320,000 24,454 0.0057
09 May 2023 16:43:03 1517859 22304173 oifs_43r3_ps_0003_2019050100_123_988_12204647_1 3,456,000 19,466 0.0056
09 May 2023 16:42:59 1517859 22304173 oifs_43r3_ps_0003_2019050100_123_988_12204647_1 2,592,000 14,481 0.0056
09 May 2023 16:42:50 1517859 22304173 oifs_43r3_ps_0003_2019050100_123_988_12204647_1 1,728,000 9,406 0.0054
09 May 2023 16:42:48 1517859 22304173 oifs_43r3_ps_0003_2019050100_123_988_12204647_1 864,000 4,435 0.0051


©2024 climateprediction.net