climateprediction.net home page
Task 22316783

Task 22316783

Name oifs_43r3_01hq_2019110100_123_993_12215372_0
Workunit 12215372
Created 24 Feb 2023, 18:21:08 UTC
Sent 24 Feb 2023, 20:17:29 UTC
Report deadline 25 Apr 2023, 20:17:29 UTC
Received 25 Feb 2023, 17:40:50 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1377895
Run time 12 hours 49 min 43 sec
CPU time 12 hours 42 min 24 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 7.89 GFLOPS
Application version OpenIFS 43r3 v1.21
x86_64-pc-linux-gnu
Peak working set size 4,806.57 MB
Peak swap size 4,983.85 MB
Peak disk usage 1,264.63 MB
Stderr
<core_client_version>7.20.2</core_client_version>
<![CDATA[
<stderr_txt>
EP 2344 H=2344:00 +CPU= 13.100
  08:14:32 STEP 2345 H=2345:00 +CPU= 12.266
  08:14:53 STEP 2346 H=2346:00 +CPU= 20.706
  08:15:06 STEP 2347 H=2347:00 +CPU= 12.766
  08:15:19 STEP 2348 H=2348:00 +CPU= 13.037
  08:15:39 STEP 2349 H=2349:00 +CPU= 20.099
  08:15:52 STEP 2350 H=2350:00 +CPU= 12.830
  08:16:06 STEP 2351 H=2351:00 +CPU= 13.236
  08:16:29 STEP 2352 H=2352:00 +CPU= 23.419
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002352
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002352
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002352
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002328
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002328
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002328
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002340
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002340
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002340
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_01hq_2019110100_123_993_12215372_0_r749707729_97.zip
Uploading the intermediate file: upload_file_97.zip
  08:16:42 STEP 2353 H=2353:00 +CPU= 12.757
  08:16:56 STEP 2354 H=2354:00 +CPU= 13.343
  08:17:16 STEP 2355 H=2355:00 +CPU= 20.543
  08:17:30 STEP 2356 H=2356:00 +CPU= 13.166
  08:17:43 STEP 2357 H=2357:00 +CPU= 12.714
  08:18:04 STEP 2358 H=2358:00 +CPU= 20.652
  08:18:16 STEP 2359 H=2359:00 +CPU= 12.598
  08:18:29 STEP 2360 H=2360:00 +CPU= 12.886
  08:18:50 STEP 2361 H=2361:00 +CPU= 20.205
  08:19:03 STEP 2362 H=2362:00 +CPU= 13.206
  08:19:16 STEP 2363 H=2363:00 +CPU= 12.574
  08:19:39 STEP 2364 H=2364:00 +CPU= 22.440
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002364
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002364
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002364
  08:19:51 STEP 2365 H=2365:00 +CPU= 12.485
  08:20:04 STEP 2366 H=2366:00 +CPU= 13.005
  08:20:25 STEP 2367 H=2367:00 +CPU= 20.634
  08:20:39 STEP 2368 H=2368:00 +CPU= 13.216
  08:20:51 STEP 2369 H=2369:00 +CPU= 12.769
  08:21:12 STEP 2370 H=2370:00 +CPU= 20.562
  08:21:25 STEP 2371 H=2371:00 +CPU= 12.857
  08:21:39 STEP 2372 H=2372:00 +CPU= 13.149
  08:21:59 STEP 2373 H=2373:00 +CPU= 20.280
  08:22:13 STEP 2374 H=2374:00 +CPU= 13.309
  08:22:26 STEP 2375 H=2375:00 +CPU= 13.147
  08:22:50 STEP 2376 H=2376:00 +CPU= 23.660
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002376
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002376
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002376
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002352
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002352
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002352
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002364
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002364
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002364
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_01hq_2019110100_123_993_12215372_0_r749707729_98.zip
Uploading the intermediate file: upload_file_98.zip
  08:23:03 STEP 2377 H=2377:00 +CPU= 12.969
  08:23:16 STEP 2378 H=2378:00 +CPU= 13.278
  08:23:37 STEP 2379 H=2379:00 +CPU= 20.261
  08:23:50 STEP 2380 H=2380:00 +CPU= 12.820
  08:24:03 STEP 2381 H=2381:00 +CPU= 12.751
  08:24:24 STEP 2382 H=2382:00 +CPU= 21.005
  08:24:37 STEP 2383 H=2383:00 +CPU= 12.747
  08:24:50 STEP 2384 H=2384:00 +CPU= 13.204
  08:25:10 STEP 2385 H=2385:00 +CPU= 19.778
  08:25:23 STEP 2386 H=2386:00 +CPU= 13.121
  08:25:36 STEP 2387 H=2387:00 +CPU= 12.727
  08:25:59 STEP 2388 H=2388:00 +CPU= 22.311
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002388
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002388
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002388
  08:26:12 STEP 2389 H=2389:00 +CPU= 12.731
  08:26:25 STEP 2390 H=2390:00 +CPU= 13.135
  08:26:46 STEP 2391 H=2391:00 +CPU= 20.236
  08:26:59 STEP 2392 H=2392:00 +CPU= 13.140
  08:27:12 STEP 2393 H=2393:00 +CPU= 12.877
  08:27:33 STEP 2394 H=2394:00 +CPU= 20.817
  08:27:46 STEP 2395 H=2395:00 +CPU= 12.737
  08:27:59 STEP 2396 H=2396:00 +CPU= 12.907
  08:28:19 STEP 2397 H=2397:00 +CPU= 20.486
  08:28:33 STEP 2398 H=2398:00 +CPU= 13.290
  08:28:46 STEP 2399 H=2399:00 +CPU= 12.756
  08:29:09 STEP 2400 H=2400:00 +CPU= 22.845
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002400
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002400
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002400
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002376
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002376
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002376
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002388
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002388
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002388
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_01hq_2019110100_123_993_12215372_0_r749707729_99.zip
Uploading the intermediate file: upload_file_99.zip
  08:29:22 STEP 2401 H=2401:00 +CPU= 12.602
  08:29:35 STEP 2402 H=2402:00 +CPU= 12.915
  08:29:56 STEP 2403 H=2403:00 +CPU= 20.646
  08:30:09 STEP 2404 H=2404:00 +CPU= 13.108
  08:30:22 STEP 2405 H=2405:00 +CPU= 12.680
  08:30:43 STEP 2406 H=2406:00 +CPU= 20.852
  08:30:55 STEP 2407 H=2407:00 +CPU= 12.652
  08:31:09 STEP 2408 H=2408:00 +CPU= 13.171
  08:31:29 STEP 2409 H=2409:00 +CPU= 20.093
  08:31:43 STEP 2410 H=2410:00 +CPU= 13.562
  08:31:56 STEP 2411 H=2411:00 +CPU= 12.740
  08:32:18 STEP 2412 H=2412:00 +CPU= 22.107
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002412
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002412
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002412
  08:32:31 STEP 2413 H=2413:00 +CPU= 12.557
  08:32:44 STEP 2414 H=2414:00 +CPU= 13.028
  08:33:05 STEP 2415 H=2415:00 +CPU= 20.480
  08:33:18 STEP 2416 H=2416:00 +CPU= 13.226
  08:33:31 STEP 2417 H=2417:00 +CPU= 12.687
  08:33:52 STEP 2418 H=2418:00 +CPU= 20.735
  08:34:05 STEP 2419 H=2419:00 +CPU= 12.724
  08:34:18 STEP 2420 H=2420:00 +CPU= 13.345
  08:34:39 STEP 2421 H=2421:00 +CPU= 20.452
  08:34:52 STEP 2422 H=2422:00 +CPU= 12.857
  08:35:05 STEP 2423 H=2423:00 +CPU= 13.159
  08:35:29 STEP 2424 H=2424:00 +CPU= 23.444
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002424
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002424
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002424
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002400
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002400
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002400
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002412
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002412
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002412
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_01hq_2019110100_123_993_12215372_0_r749707729_100.zip
Uploading the intermediate file: upload_file_100.zip
  08:35:42 STEP 2425 H=2425:00 +CPU= 12.850
  08:35:55 STEP 2426 H=2426:00 +CPU= 13.020
Uploading trickle at timestep: 8726400
  08:36:16 STEP 2427 H=2427:00 +CPU= 20.508
  08:36:29 STEP 2428 H=2428:00 +CPU= 12.963
  08:36:42 STEP 2429 H=2429:00 +CPU= 12.404
  08:37:03 STEP 2430 H=2430:00 +CPU= 20.826
  08:37:15 STEP 2431 H=2431:00 +CPU= 12.514
  08:37:28 STEP 2432 H=2432:00 +CPU= 12.938
  08:37:49 STEP 2433 H=2433:00 +CPU= 20.315
  08:38:02 STEP 2434 H=2434:00 +CPU= 13.084
  08:38:15 STEP 2435 H=2435:00 +CPU= 12.602
  08:38:38 STEP 2436 H=2436:00 +CPU= 22.039
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002436
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002436
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002436
  08:38:50 STEP 2437 H=2437:00 +CPU= 12.464
  08:39:03 STEP 2438 H=2438:00 +CPU= 12.956
  08:39:23 STEP 2439 H=2439:00 +CPU= 19.856
  08:39:37 STEP 2440 H=2440:00 +CPU= 13.167
  08:39:50 STEP 2441 H=2441:00 +CPU= 12.694
  08:40:10 STEP 2442 H=2442:00 +CPU= 20.368
  08:40:22 STEP 2443 H=2443:00 +CPU= 12.026
  08:40:35 STEP 2444 H=2444:00 +CPU= 12.682
  08:40:54 STEP 2445 H=2445:00 +CPU= 19.231
  08:41:07 STEP 2446 H=2446:00 +CPU= 12.044
  08:41:19 STEP 2447 H=2447:00 +CPU= 12.654
  08:41:44 STEP 2448 H=2448:00 +CPU= 23.945
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002448
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002448
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002448
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002424
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002424
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002424
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002436
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002436
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002436
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_01hq_2019110100_123_993_12215372_0_r749707729_101.zip
Uploading the intermediate file: upload_file_101.zip
  08:41:57 STEP 2449 H=2449:00 +CPU= 12.783
  08:42:10 STEP 2450 H=2450:00 +CPU= 13.240
  08:42:31 STEP 2451 H=2451:00 +CPU= 20.745
  08:42:44 STEP 2452 H=2452:00 +CPU= 12.956
  08:42:57 STEP 2453 H=2453:00 +CPU= 12.841
  08:43:19 STEP 2454 H=2454:00 +CPU= 21.090
  08:43:32 STEP 2455 H=2455:00 +CPU= 12.855
  08:43:45 STEP 2456 H=2456:00 +CPU= 13.237
  08:44:06 STEP 2457 H=2457:00 +CPU= 20.447
  08:44:19 STEP 2458 H=2458:00 +CPU= 13.350
  08:44:32 STEP 2459 H=2459:00 +CPU= 12.982
  08:44:55 STEP 2460 H=2460:00 +CPU= 22.517
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002460
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002460
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002460
  08:45:08 STEP 2461 H=2461:00 +CPU= 12.947
  08:45:21 STEP 2462 H=2462:00 +CPU= 13.408
  08:45:42 STEP 2463 H=2463:00 +CPU= 20.538
  08:45:56 STEP 2464 H=2464:00 +CPU= 13.201
  08:46:09 STEP 2465 H=2465:00 +CPU= 12.885
  08:46:30 STEP 2466 H=2466:00 +CPU= 21.154
  08:46:43 STEP 2467 H=2467:00 +CPU= 12.886
  08:46:57 STEP 2468 H=2468:00 +CPU= 13.287
  08:47:17 STEP 2469 H=2469:00 +CPU= 20.463
  08:47:31 STEP 2470 H=2470:00 +CPU= 13.420
  08:47:44 STEP 2471 H=2471:00 +CPU= 13.340
  08:48:08 STEP 2472 H=2472:00 +CPU= 23.446
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002472
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002472
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002448
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002448
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002448
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002460
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002460
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002460
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_01hq_2019110100_123_993_12215372_0_r749707729_102.zip
Uploading the intermediate file: upload_file_102.zip
  08:48:21 STEP 2473 H=2473:00 +CPU= 13.143
  08:48:35 STEP 2474 H=2474:00 +CPU= 13.296
  08:48:56 STEP 2475 H=2475:00 +CPU= 20.472
  08:49:13 STEP 2476 H=2476:00 +CPU= 13.143
  08:49:26 STEP 2477 H=2477:00 +CPU= 12.741
  08:49:47 STEP 2478 H=2478:00 +CPU= 21.061
  08:50:00 STEP 2479 H=2479:00 +CPU= 12.878
  08:50:14 STEP 2480 H=2480:00 +CPU= 13.269
  08:50:35 STEP 2481 H=2481:00 +CPU= 20.830
  08:50:48 STEP 2482 H=2482:00 +CPU= 13.267
  08:51:01 STEP 2483 H=2483:00 +CPU= 12.995
  08:51:24 STEP 2484 H=2484:00 +CPU= 22.543
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002484
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002484
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002484
  08:51:37 STEP 2485 H=2485:00 +CPU= 12.991
  08:51:51 STEP 2486 H=2486:00 +CPU= 13.519
  08:52:12 STEP 2487 H=2487:00 +CPU= 20.561
  08:52:25 STEP 2488 H=2488:00 +CPU= 13.194
  08:52:38 STEP 2489 H=2489:00 +CPU= 12.891
  08:52:59 STEP 2490 H=2490:00 +CPU= 20.605
  08:53:12 STEP 2491 H=2491:00 +CPU= 12.772
  08:53:26 STEP 2492 H=2492:00 +CPU= 13.474
  08:53:47 STEP 2493 H=2493:00 +CPU= 20.546
  08:54:00 STEP 2494 H=2494:00 +CPU= 13.351
  08:54:14 STEP 2495 H=2495:00 +CPU= 13.161
  08:54:38 STEP 2496 H=2496:00 +CPU= 23.923
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002496
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002496
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002472
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002484
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002484
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002484
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_01hq_2019110100_123_993_12215372_0_r749707729_103.zip
Uploading the intermediate file: upload_file_103.zip
  08:54:50 STEP 2497 H=2497:00 +CPU= 12.302
  08:55:03 STEP 2498 H=2498:00 +CPU= 12.481
  08:55:23 STEP 2499 H=2499:00 +CPU= 20.497
  08:55:37 STEP 2500 H=2500:00 +CPU= 13.614
  08:55:51 STEP 2501 H=2501:00 +CPU= 13.254
  08:56:12 STEP 2502 H=2502:00 +CPU= 20.731
  08:56:25 STEP 2503 H=2503:00 +CPU= 13.096
  08:56:39 STEP 2504 H=2504:00 +CPU= 13.414
  08:57:00 STEP 2505 H=2505:00 +CPU= 20.696
  08:57:13 STEP 2506 H=2506:00 +CPU= 13.231
  08:57:26 STEP 2507 H=2507:00 +CPU= 12.710
  08:57:49 STEP 2508 H=2508:00 +CPU= 22.720
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002508
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002508
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002508
  08:58:02 STEP 2509 H=2509:00 +CPU= 12.982
  08:58:16 STEP 2510 H=2510:00 +CPU= 13.347
  08:58:36 STEP 2511 H=2511:00 +CPU= 20.240
  08:58:49 STEP 2512 H=2512:00 +CPU= 13.214
  08:59:02 STEP 2513 H=2513:00 +CPU= 12.833
  08:59:23 STEP 2514 H=2514:00 +CPU= 20.625
  08:59:36 STEP 2515 H=2515:00 +CPU= 12.294
  08:59:49 STEP 2516 H=2516:00 +CPU= 13.341
  09:00:10 STEP 2517 H=2517:00 +CPU= 20.368
  09:00:23 STEP 2518 H=2518:00 +CPU= 13.248
  09:00:37 STEP 2519 H=2519:00 +CPU= 13.199
  09:01:00 STEP 2520 H=2520:00 +CPU= 23.507
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002520
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002520
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002496
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002508
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002508
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002508
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_01hq_2019110100_123_993_12215372_0_r749707729_104.zip
Uploading the intermediate file: upload_file_104.zip
  09:01:13 STEP 2521 H=2521:00 +CPU= 12.660
  09:01:26 STEP 2522 H=2522:00 +CPU= 13.037
  09:01:47 STEP 2523 H=2523:00 +CPU= 19.978
  09:02:00 STEP 2524 H=2524:00 +CPU= 13.146
  09:02:13 STEP 2525 H=2525:00 +CPU= 13.007
  09:02:35 STEP 2526 H=2526:00 +CPU= 21.164
  09:02:48 STEP 2527 H=2527:00 +CPU= 12.862
  09:03:01 STEP 2528 H=2528:00 +CPU= 13.542
  09:03:22 STEP 2529 H=2529:00 +CPU= 20.494
  09:03:35 STEP 2530 H=2530:00 +CPU= 13.246
  09:03:48 STEP 2531 H=2531:00 +CPU= 12.793
  09:04:10 STEP 2532 H=2532:00 +CPU= 21.273
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002532
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002532
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002532
  09:04:23 STEP 2533 H=2533:00 +CPU= 12.807
  09:04:37 STEP 2534 H=2534:00 +CPU= 13.423
  09:04:57 STEP 2535 H=2535:00 +CPU= 20.514
  09:05:11 STEP 2536 H=2536:00 +CPU= 13.616
  09:05:24 STEP 2537 H=2537:00 +CPU= 12.833
  09:05:45 STEP 2538 H=2538:00 +CPU= 20.841
  09:05:58 STEP 2539 H=2539:00 +CPU= 12.967
  09:06:12 STEP 2540 H=2540:00 +CPU= 13.031
  09:06:32 STEP 2541 H=2541:00 +CPU= 20.492
  09:06:46 STEP 2542 H=2542:00 +CPU= 13.428
  09:06:59 STEP 2543 H=2543:00 +CPU= 13.337
  09:07:23 STEP 2544 H=2544:00 +CPU= 23.678
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002544
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002544
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002520
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002532
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002532
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002532
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_01hq_2019110100_123_993_12215372_0_r749707729_105.zip
Uploading the intermediate file: upload_file_105.zip
  09:07:36 STEP 2545 H=2545:00 +CPU= 12.547
  09:07:50 STEP 2546 H=2546:00 +CPU= 13.656
  09:08:10 STEP 2547 H=2547:00 +CPU= 20.115
  09:08:23 STEP 2548 H=2548:00 +CPU= 12.898
  09:08:36 STEP 2549 H=2549:00 +CPU= 12.926
  09:08:58 STEP 2550 H=2550:00 +CPU= 20.964
  09:09:11 STEP 2551 H=2551:00 +CPU= 12.939
  09:09:24 STEP 2552 H=2552:00 +CPU= 13.521
  09:09:45 STEP 2553 H=2553:00 +CPU= 20.149
  09:09:58 STEP 2554 H=2554:00 +CPU= 13.161
  09:10:11 STEP 2555 H=2555:00 +CPU= 12.768
  09:10:34 STEP 2556 H=2556:00 +CPU= 22.690
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002556
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002556
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002556
  09:10:47 STEP 2557 H=2557:00 +CPU= 12.849
  09:11:00 STEP 2558 H=2558:00 +CPU= 13.207
  09:11:21 STEP 2559 H=2559:00 +CPU= 20.284
  09:11:34 STEP 2560 H=2560:00 +CPU= 13.478
  09:11:48 STEP 2561 H=2561:00 +CPU= 12.964
  09:12:09 STEP 2562 H=2562:00 +CPU= 21.034
  09:12:21 STEP 2563 H=2563:00 +CPU= 12.496
  09:12:35 STEP 2564 H=2564:00 +CPU= 13.268
  09:12:56 STEP 2565 H=2565:00 +CPU= 20.653
  09:13:08 STEP 2566 H=2566:00 +CPU= 12.469
  09:13:22 STEP 2567 H=2567:00 +CPU= 13.198
  09:13:46 STEP 2568 H=2568:00 +CPU= 23.861
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002568
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002568
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002544
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002556
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002556
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002556
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_01hq_2019110100_123_993_12215372_0_r749707729_106.zip
Uploading the intermediate file: upload_file_106.zip
  09:13:58 STEP 2569 H=2569:00 +CPU= 12.240
  09:14:11 STEP 2570 H=2570:00 +CPU= 13.138
  09:14:32 STEP 2571 H=2571:00 +CPU= 20.483
  09:14:46 STEP 2572 H=2572:00 +CPU= 13.283
  09:14:59 STEP 2573 H=2573:00 +CPU= 12.768
  09:15:20 STEP 2574 H=2574:00 +CPU= 21.355
  09:15:34 STEP 2575 H=2575:00 +CPU= 12.947
  09:15:47 STEP 2576 H=2576:00 +CPU= 13.290
  09:16:08 STEP 2577 H=2577:00 +CPU= 20.635
  09:16:21 STEP 2578 H=2578:00 +CPU= 13.100
  09:16:34 STEP 2579 H=2579:00 +CPU= 12.734
  09:16:57 STEP 2580 H=2580:00 +CPU= 22.440
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002580
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002580
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002580
  09:17:09 STEP 2581 H=2581:00 +CPU= 12.480
  09:17:23 STEP 2582 H=2582:00 +CPU= 13.686
  09:17:44 STEP 2583 H=2583:00 +CPU= 20.230
  09:17:57 STEP 2584 H=2584:00 +CPU= 12.724
  09:18:09 STEP 2585 H=2585:00 +CPU= 12.840
  09:18:31 STEP 2586 H=2586:00 +CPU= 20.967
  09:18:44 STEP 2587 H=2587:00 +CPU= 13.071
  09:18:57 STEP 2588 H=2588:00 +CPU= 13.080
  09:19:17 STEP 2589 H=2589:00 +CPU= 20.151
  09:19:31 STEP 2590 H=2590:00 +CPU= 13.118
  09:19:44 STEP 2591 H=2591:00 +CPU= 13.050
  09:20:08 STEP 2592 H=2592:00 +CPU= 23.815
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002592
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002592
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002568
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002580
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002580
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002580
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_01hq_2019110100_123_993_12215372_0_r749707729_107.zip
Uploading the intermediate file: upload_file_107.zip
  09:20:21 STEP 2593 H=2593:00 +CPU= 12.693
  09:20:34 STEP 2594 H=2594:00 +CPU= 13.240
  09:20:55 STEP 2595 H=2595:00 +CPU= 20.454
  09:21:08 STEP 2596 H=2596:00 +CPU= 13.341
  09:21:21 STEP 2597 H=2597:00 +CPU= 12.532
  09:21:42 STEP 2598 H=2598:00 +CPU= 21.008
  09:21:55 STEP 2599 H=2599:00 +CPU= 12.900
  09:22:09 STEP 2600 H=2600:00 +CPU= 13.132
  09:22:29 STEP 2601 H=2601:00 +CPU= 19.958
  09:22:43 STEP 2602 H=2602:00 +CPU= 13.578
  09:22:55 STEP 2603 H=2603:00 +CPU= 12.670
  09:23:18 STEP 2604 H=2604:00 +CPU= 22.672
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002604
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002604
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002604
  09:23:31 STEP 2605 H=2605:00 +CPU= 12.817
  09:23:45 STEP 2606 H=2606:00 +CPU= 13.255
  09:24:06 STEP 2607 H=2607:00 +CPU= 20.877
  09:24:19 STEP 2608 H=2608:00 +CPU= 13.193
  09:24:32 STEP 2609 H=2609:00 +CPU= 12.760
  09:24:53 STEP 2610 H=2610:00 +CPU= 20.723
  09:25:06 STEP 2611 H=2611:00 +CPU= 12.650
  09:25:19 STEP 2612 H=2612:00 +CPU= 13.202
  09:25:40 STEP 2613 H=2613:00 +CPU= 20.262
  09:25:53 STEP 2614 H=2614:00 +CPU= 13.270
  09:26:06 STEP 2615 H=2615:00 +CPU= 13.368
  09:26:30 STEP 2616 H=2616:00 +CPU= 23.464
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002616
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002616
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002592
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002604
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002604
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002604
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_01hq_2019110100_123_993_12215372_0_r749707729_108.zip
Uploading the intermediate file: upload_file_108.zip
  09:26:43 STEP 2617 H=2617:00 +CPU= 12.756
  09:26:56 STEP 2618 H=2618:00 +CPU= 13.061
  09:27:17 STEP 2619 H=2619:00 +CPU= 20.478
  09:27:30 STEP 2620 H=2620:00 +CPU= 13.385
  09:27:43 STEP 2621 H=2621:00 +CPU= 12.854
  09:28:05 STEP 2622 H=2622:00 +CPU= 21.416
  09:28:18 STEP 2623 H=2623:00 +CPU= 12.939
  09:28:31 STEP 2624 H=2624:00 +CPU= 13.077
  09:28:52 STEP 2625 H=2625:00 +CPU= 20.688
  09:29:06 STEP 2626 H=2626:00 +CPU= 13.814
  09:29:19 STEP 2627 H=2627:00 +CPU= 12.620
  09:29:42 STEP 2628 H=2628:00 +CPU= 23.009
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002628
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002628
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002628
  09:29:56 STEP 2629 H=2629:00 +CPU= 13.227
  09:30:09 STEP 2630 H=2630:00 +CPU= 13.342
  09:30:30 STEP 2631 H=2631:00 +CPU= 20.783
  09:30:44 STEP 2632 H=2632:00 +CPU= 13.544
  09:30:57 STEP 2633 H=2633:00 +CPU= 12.939
  09:31:18 STEP 2634 H=2634:00 +CPU= 20.952
  09:31:31 STEP 2635 H=2635:00 +CPU= 12.779
  09:31:43 STEP 2636 H=2636:00 +CPU= 12.146
  09:32:04 STEP 2637 H=2637:00 +CPU= 20.060
  09:32:17 STEP 2638 H=2638:00 +CPU= 13.464
  09:32:31 STEP 2639 H=2639:00 +CPU= 13.238
  09:32:55 STEP 2640 H=2640:00 +CPU= 24.019
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002640
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002640
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002640
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002616
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002628
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002628
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002628
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_01hq_2019110100_123_993_12215372_0_r749707729_109.zip
Uploading the intermediate file: upload_file_109.zip
  09:33:08 STEP 2641 H=2641:00 +CPU= 12.774
  09:33:22 STEP 2642 H=2642:00 +CPU= 13.611
  09:33:43 STEP 2643 H=2643:00 +CPU= 20.802
  09:33:56 STEP 2644 H=2644:00 +CPU= 13.239
  09:34:09 STEP 2645 H=2645:00 +CPU= 13.022
  09:34:31 STEP 2646 H=2646:00 +CPU= 21.171
  09:34:44 STEP 2647 H=2647:00 +CPU= 12.917
  09:34:58 STEP 2648 H=2648:00 +CPU= 13.463
  09:35:19 STEP 2649 H=2649:00 +CPU= 20.819
  09:35:32 STEP 2650 H=2650:00 +CPU= 13.174
  09:35:45 STEP 2651 H=2651:00 +CPU= 12.833
  09:36:07 STEP 2652 H=2652:00 +CPU= 22.066
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002652
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002652
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002652
  09:36:20 STEP 2653 H=2653:00 +CPU= 12.525
  09:36:33 STEP 2654 H=2654:00 +CPU= 13.219
  09:36:54 STEP 2655 H=2655:00 +CPU= 20.595
  09:37:08 STEP 2656 H=2656:00 +CPU= 13.414
  09:37:21 STEP 2657 H=2657:00 +CPU= 12.960
  09:37:42 STEP 2658 H=2658:00 +CPU= 21.172
  09:37:56 STEP 2659 H=2659:00 +CPU= 12.957
  09:38:09 STEP 2660 H=2660:00 +CPU= 13.621
  09:38:30 STEP 2661 H=2661:00 +CPU= 20.570
  09:38:44 STEP 2662 H=2662:00 +CPU= 13.309
  09:38:57 STEP 2663 H=2663:00 +CPU= 13.334
  09:39:22 STEP 2664 H=2664:00 +CPU= 24.093
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002664
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002664
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002664
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002640
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002640
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002640
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002652
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002652
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002652
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_01hq_2019110100_123_993_12215372_0_r749707729_110.zip
Uploading the intermediate file: upload_file_110.zip
  09:39:35 STEP 2665 H=2665:00 +CPU= 12.843
Uploading trickle at timestep: 9590400
  09:39:48 STEP 2666 H=2666:00 +CPU= 13.289
  09:40:09 STEP 2667 H=2667:00 +CPU= 20.494
  09:40:23 STEP 2668 H=2668:00 +CPU= 13.617
  09:40:35 STEP 2669 H=2669:00 +CPU= 12.414
  09:40:56 STEP 2670 H=2670:00 +CPU= 20.448
  09:41:09 STEP 2671 H=2671:00 +CPU= 12.962
  09:41:23 STEP 2672 H=2672:00 +CPU= 13.567
  09:41:44 STEP 2673 H=2673:00 +CPU= 20.460
  09:41:57 STEP 2674 H=2674:00 +CPU= 13.121
  09:42:10 STEP 2675 H=2675:00 +CPU= 12.955
  09:42:36 STEP 2676 H=2676:00 +CPU= 25.700
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002676
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002676
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002676
  09:42:51 STEP 2677 H=2677:00 +CPU= 14.860
  09:43:06 STEP 2678 H=2678:00 +CPU= 14.927
  09:43:28 STEP 2679 H=2679:00 +CPU= 21.694
  09:43:41 STEP 2680 H=2680:00 +CPU= 13.094
  09:43:54 STEP 2681 H=2681:00 +CPU= 12.906
  09:44:16 STEP 2682 H=2682:00 +CPU= 20.874
  09:44:29 STEP 2683 H=2683:00 +CPU= 12.967
  09:44:42 STEP 2684 H=2684:00 +CPU= 13.597
  09:45:03 STEP 2685 H=2685:00 +CPU= 20.546
  09:45:17 STEP 2686 H=2686:00 +CPU= 13.317
  09:45:30 STEP 2687 H=2687:00 +CPU= 12.913
  09:45:53 STEP 2688 H=2688:00 +CPU= 22.740
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002688
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002688
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002688
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002664
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002664
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002664
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002676
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002676
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002676
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_01hq_2019110100_123_993_12215372_0_r749707729_111.zip
Uploading the intermediate file: upload_file_111.zip
  09:46:06 STEP 2689 H=2689:00 +CPU= 12.900
  09:46:19 STEP 2690 H=2690:00 +CPU= 13.215
  09:46:40 STEP 2691 H=2691:00 +CPU= 20.578
  09:46:53 STEP 2692 H=2692:00 +CPU= 13.274
  09:47:06 STEP 2693 H=2693:00 +CPU= 12.761
  09:47:28 STEP 2694 H=2694:00 +CPU= 21.154
  09:47:41 STEP 2695 H=2695:00 +CPU= 12.907
  09:47:54 STEP 2696 H=2696:00 +CPU= 13.519
  09:48:15 STEP 2697 H=2697:00 +CPU= 20.588
  09:48:29 STEP 2698 H=2698:00 +CPU= 13.503
  09:48:42 STEP 2699 H=2699:00 +CPU= 12.981
  09:49:05 STEP 2700 H=2700:00 +CPU= 22.439
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002700
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002700
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002700
  09:49:18 STEP 2701 H=2701:00 +CPU= 12.922
  09:49:31 STEP 2702 H=2702:00 +CPU= 13.306
  09:49:52 STEP 2703 H=2703:00 +CPU= 20.522
  09:50:05 STEP 2704 H=2704:00 +CPU= 12.960
  09:50:17 STEP 2705 H=2705:00 +CPU= 11.944
  09:50:37 STEP 2706 H=2706:00 +CPU= 20.197
  09:50:50 STEP 2707 H=2707:00 +CPU= 12.777
  09:51:04 STEP 2708 H=2708:00 +CPU= 13.623
  09:51:25 STEP 2709 H=2709:00 +CPU= 20.842
  09:51:39 STEP 2710 H=2710:00 +CPU= 13.557
  09:51:52 STEP 2711 H=2711:00 +CPU= 13.146
  09:52:17 STEP 2712 H=2712:00 +CPU= 24.168
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002712
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002712
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002712
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002688
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002688
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002688
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002700
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002700
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002700
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_01hq_2019110100_123_993_12215372_0_r749707729_112.zip
Uploading the intermediate file: upload_file_112.zip
  09:52:29 STEP 2713 H=2713:00 +CPU= 12.619
  09:52:43 STEP 2714 H=2714:00 +CPU= 13.256
  09:53:04 STEP 2715 H=2715:00 +CPU= 20.516
  09:53:17 STEP 2716 H=2716:00 +CPU= 13.226
  09:53:30 STEP 2717 H=2717:00 +CPU= 12.911
  09:53:51 STEP 2718 H=2718:00 +CPU= 20.970
  09:54:04 STEP 2719 H=2719:00 +CPU= 12.708
  09:54:18 STEP 2720 H=2720:00 +CPU= 13.503
  09:54:38 STEP 2721 H=2721:00 +CPU= 20.296
  09:54:51 STEP 2722 H=2722:00 +CPU= 12.414
  09:55:04 STEP 2723 H=2723:00 +CPU= 12.684
  09:55:27 STEP 2724 H=2724:00 +CPU= 22.658
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002724
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002724
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002724
  09:55:40 STEP 2725 H=2725:00 +CPU= 12.887
  09:55:53 STEP 2726 H=2726:00 +CPU= 13.149
  09:56:14 STEP 2727 H=2727:00 +CPU= 20.596
  09:56:27 STEP 2728 H=2728:00 +CPU= 13.248
  09:56:40 STEP 2729 H=2729:00 +CPU= 12.909
  09:57:02 STEP 2730 H=2730:00 +CPU= 20.992
  09:57:15 STEP 2731 H=2731:00 +CPU= 13.434
  09:57:29 STEP 2732 H=2732:00 +CPU= 13.573
  09:57:49 STEP 2733 H=2733:00 +CPU= 20.425
  09:58:02 STEP 2734 H=2734:00 +CPU= 12.981
  09:58:16 STEP 2735 H=2735:00 +CPU= 13.215
  09:58:40 STEP 2736 H=2736:00 +CPU= 23.641
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002736
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002736
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002736
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002712
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002712
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002712
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002724
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002724
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002724
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_01hq_2019110100_123_993_12215372_0_r749707729_113.zip
Uploading the intermediate file: upload_file_113.zip
  09:58:53 STEP 2737 H=2737:00 +CPU= 12.703
  09:59:05 STEP 2738 H=2738:00 +CPU= 12.676
  09:59:26 STEP 2739 H=2739:00 +CPU= 19.851
  09:59:38 STEP 2740 H=2740:00 +CPU= 12.630
  09:59:52 STEP 2741 H=2741:00 +CPU= 13.263
  10:00:13 STEP 2742 H=2742:00 +CPU= 20.993
  10:00:26 STEP 2743 H=2743:00 +CPU= 12.827
  10:00:40 STEP 2744 H=2744:00 +CPU= 13.460
  10:01:00 STEP 2745 H=2745:00 +CPU= 20.704
  10:01:14 STEP 2746 H=2746:00 +CPU= 13.576
  10:01:27 STEP 2747 H=2747:00 +CPU= 12.955
  10:01:50 STEP 2748 H=2748:00 +CPU= 22.787
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002748
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002748
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002748
  10:02:03 STEP 2749 H=2749:00 +CPU= 12.980
  10:02:17 STEP 2750 H=2750:00 +CPU= 13.334
  10:02:38 STEP 2751 H=2751:00 +CPU= 20.540
  10:02:51 STEP 2752 H=2752:00 +CPU= 13.217
  10:03:04 STEP 2753 H=2753:00 +CPU= 12.953
  10:03:26 STEP 2754 H=2754:00 +CPU= 21.422
  10:03:39 STEP 2755 H=2755:00 +CPU= 12.978
  10:03:52 STEP 2756 H=2756:00 +CPU= 13.447
  10:04:13 STEP 2757 H=2757:00 +CPU= 20.005
  10:04:25 STEP 2758 H=2758:00 +CPU= 12.533
  10:04:39 STEP 2759 H=2759:00 +CPU= 13.728
  10:05:03 STEP 2760 H=2760:00 +CPU= 23.865
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002760
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002760
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002760
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002736
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002736
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002736
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002748
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002748
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002748
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_01hq_2019110100_123_993_12215372_0_r749707729_114.zip
Uploading the intermediate file: upload_file_114.zip
  10:05:16 STEP 2761 H=2761:00 +CPU= 12.879
  10:05:29 STEP 2762 H=2762:00 +CPU= 13.045
  10:05:50 STEP 2763 H=2763:00 +CPU= 20.500
  10:06:04 STEP 2764 H=2764:00 +CPU= 13.273
  10:06:17 STEP 2765 H=2765:00 +CPU= 12.850
  10:06:38 STEP 2766 H=2766:00 +CPU= 21.367
  10:06:52 STEP 2767 H=2767:00 +CPU= 13.182
  10:07:05 STEP 2768 H=2768:00 +CPU= 13.722
  10:07:26 STEP 2769 H=2769:00 +CPU= 20.351
  10:07:40 STEP 2770 H=2770:00 +CPU= 13.364
  10:07:53 STEP 2771 H=2771:00 +CPU= 13.111
  10:08:16 STEP 2772 H=2772:00 +CPU= 22.776
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002772
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002772
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002772
  10:08:29 STEP 2773 H=2773:00 +CPU= 12.940
  10:08:42 STEP 2774 H=2774:00 +CPU= 13.379
  10:09:02 STEP 2775 H=2775:00 +CPU= 19.255
  10:09:15 STEP 2776 H=2776:00 +CPU= 13.292
  10:09:28 STEP 2777 H=2777:00 +CPU= 13.027
  10:09:49 STEP 2778 H=2778:00 +CPU= 20.831
  10:10:02 STEP 2779 H=2779:00 +CPU= 12.911
  10:10:16 STEP 2780 H=2780:00 +CPU= 13.397
  10:10:37 STEP 2781 H=2781:00 +CPU= 20.399
  10:10:50 STEP 2782 H=2782:00 +CPU= 13.341
  10:11:04 STEP 2783 H=2783:00 +CPU= 13.359
  10:11:28 STEP 2784 H=2784:00 +CPU= 24.350
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002784
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002784
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002784
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002760
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002760
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002760
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002772
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002772
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002772
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_01hq_2019110100_123_993_12215372_0_r749707729_115.zip
Uploading the intermediate file: upload_file_115.zip
  10:11:41 STEP 2785 H=2785:00 +CPU= 13.261
  10:11:55 STEP 2786 H=2786:00 +CPU= 13.277
  10:12:16 STEP 2787 H=2787:00 +CPU= 20.981
  10:12:30 STEP 2788 H=2788:00 +CPU= 13.420
  10:12:43 STEP 2789 H=2789:00 +CPU= 13.009
  10:13:04 STEP 2790 H=2790:00 +CPU= 21.292
  10:13:18 STEP 2791 H=2791:00 +CPU= 13.019
  10:13:31 STEP 2792 H=2792:00 +CPU= 13.100
  10:13:51 STEP 2793 H=2793:00 +CPU= 19.700
  10:14:04 STEP 2794 H=2794:00 +CPU= 13.520
  10:14:18 STEP 2795 H=2795:00 +CPU= 12.972
  10:14:41 STEP 2796 H=2796:00 +CPU= 22.997
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002796
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002796
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002796
  10:14:54 STEP 2797 H=2797:00 +CPU= 12.795
  10:15:07 STEP 2798 H=2798:00 +CPU= 13.397
  10:15:28 STEP 2799 H=2799:00 +CPU= 20.497
  10:15:41 STEP 2800 H=2800:00 +CPU= 13.303
  10:15:54 STEP 2801 H=2801:00 +CPU= 12.810
  10:16:16 STEP 2802 H=2802:00 +CPU= 21.210
  10:16:29 STEP 2803 H=2803:00 +CPU= 12.796
  10:16:42 STEP 2804 H=2804:00 +CPU= 13.292
  10:17:02 STEP 2805 H=2805:00 +CPU= 20.178
  10:17:16 STEP 2806 H=2806:00 +CPU= 13.185
  10:17:29 STEP 2807 H=2807:00 +CPU= 13.097
  10:17:53 STEP 2808 H=2808:00 +CPU= 23.721
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002808
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002808
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002808
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002784
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002784
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002784
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002796
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002796
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002796
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_01hq_2019110100_123_993_12215372_0_r749707729_116.zip
Uploading the intermediate file: upload_file_116.zip
  10:18:06 STEP 2809 H=2809:00 +CPU= 12.845
  10:18:19 STEP 2810 H=2810:00 +CPU= 12.764
  10:18:39 STEP 2811 H=2811:00 +CPU= 20.212
  10:18:52 STEP 2812 H=2812:00 +CPU= 12.799
  10:19:04 STEP 2813 H=2813:00 +CPU= 12.044
  10:19:25 STEP 2814 H=2814:00 +CPU= 19.951
  10:19:37 STEP 2815 H=2815:00 +CPU= 12.203
  10:19:50 STEP 2816 H=2816:00 +CPU= 12.929
  10:20:10 STEP 2817 H=2817:00 +CPU= 20.088
  10:20:24 STEP 2818 H=2818:00 +CPU= 13.204
  10:20:37 STEP 2819 H=2819:00 +CPU= 12.786
  10:20:59 STEP 2820 H=2820:00 +CPU= 21.901
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002820
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002820
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002820
  10:21:11 STEP 2821 H=2821:00 +CPU= 12.496
  10:21:25 STEP 2822 H=2822:00 +CPU= 13.123
  10:21:47 STEP 2823 H=2823:00 +CPU= 21.633
  10:22:00 STEP 2824 H=2824:00 +CPU= 13.148
  10:22:12 STEP 2825 H=2825:00 +CPU= 12.396
  10:22:33 STEP 2826 H=2826:00 +CPU= 20.584
  10:22:45 STEP 2827 H=2827:00 +CPU= 12.049
  10:22:58 STEP 2828 H=2828:00 +CPU= 12.492
  10:23:18 STEP 2829 H=2829:00 +CPU= 19.629
  10:23:31 STEP 2830 H=2830:00 +CPU= 12.850
  10:23:44 STEP 2831 H=2831:00 +CPU= 13.225
  10:24:08 STEP 2832 H=2832:00 +CPU= 23.051
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002832
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002832
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002832
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002808
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002808
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002808
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002820
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002820
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002820
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_01hq_2019110100_123_993_12215372_0_r749707729_117.zip
Uploading the intermediate file: upload_file_117.zip
  10:24:20 STEP 2833 H=2833:00 +CPU= 12.464
  10:24:33 STEP 2834 H=2834:00 +CPU= 13.104
  10:24:54 STEP 2835 H=2835:00 +CPU= 20.224
  10:25:07 STEP 2836 H=2836:00 +CPU= 12.809
  10:25:19 STEP 2837 H=2837:00 +CPU= 12.521
  10:25:41 STEP 2838 H=2838:00 +CPU= 20.996
  10:25:54 STEP 2839 H=2839:00 +CPU= 12.918
  10:26:07 STEP 2840 H=2840:00 +CPU= 13.147
  10:26:28 STEP 2841 H=2841:00 +CPU= 20.300
  10:26:41 STEP 2842 H=2842:00 +CPU= 13.242
  10:26:54 STEP 2843 H=2843:00 +CPU= 12.515
  10:27:16 STEP 2844 H=2844:00 +CPU= 22.464
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002844
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002844
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002844
  10:27:29 STEP 2845 H=2845:00 +CPU= 12.353
  10:27:41 STEP 2846 H=2846:00 +CPU= 11.862
  10:28:01 STEP 2847 H=2847:00 +CPU= 19.604
  10:28:14 STEP 2848 H=2848:00 +CPU= 12.750
  10:28:26 STEP 2849 H=2849:00 +CPU= 12.528
  10:28:47 STEP 2850 H=2850:00 +CPU= 20.703
  10:29:00 STEP 2851 H=2851:00 +CPU= 12.397
  10:29:13 STEP 2852 H=2852:00 +CPU= 12.899
  10:29:33 STEP 2853 H=2853:00 +CPU= 19.978
  10:29:46 STEP 2854 H=2854:00 +CPU= 12.966
  10:29:59 STEP 2855 H=2855:00 +CPU= 12.969
  10:30:24 STEP 2856 H=2856:00 +CPU= 23.775
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002856
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002856
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002856
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002832
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002832
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002832
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002844
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002844
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002844
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_01hq_2019110100_123_993_12215372_0_r749707729_118.zip
Uploading the intermediate file: upload_file_118.zip
  10:30:37 STEP 2857 H=2857:00 +CPU= 12.952
  10:30:50 STEP 2858 H=2858:00 +CPU= 13.232
  10:31:11 STEP 2859 H=2859:00 +CPU= 20.594
  10:31:24 STEP 2860 H=2860:00 +CPU= 12.965
  10:31:37 STEP 2861 H=2861:00 +CPU= 12.738
  10:31:58 STEP 2862 H=2862:00 +CPU= 20.840
  10:32:11 STEP 2863 H=2863:00 +CPU= 12.429
  10:32:24 STEP 2864 H=2864:00 +CPU= 12.837
  10:32:44 STEP 2865 H=2865:00 +CPU= 20.098
  10:32:57 STEP 2866 H=2866:00 +CPU= 13.113
  10:33:10 STEP 2867 H=2867:00 +CPU= 12.916
  10:33:33 STEP 2868 H=2868:00 +CPU= 22.464
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002868
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002868
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002868
  10:33:46 STEP 2869 H=2869:00 +CPU= 12.630
  10:33:59 STEP 2870 H=2870:00 +CPU= 13.381
  10:34:20 STEP 2871 H=2871:00 +CPU= 20.280
  10:34:33 STEP 2872 H=2872:00 +CPU= 12.918
  10:34:46 STEP 2873 H=2873:00 +CPU= 12.791
  10:35:07 STEP 2874 H=2874:00 +CPU= 20.445
  10:35:19 STEP 2875 H=2875:00 +CPU= 12.685
  10:35:32 STEP 2876 H=2876:00 +CPU= 12.911
  10:35:53 STEP 2877 H=2877:00 +CPU= 20.113
  10:36:06 STEP 2878 H=2878:00 +CPU= 13.229
  10:36:19 STEP 2879 H=2879:00 +CPU= 12.880
  10:36:43 STEP 2880 H=2880:00 +CPU= 23.070
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002880
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002880
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002880
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002856
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002856
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002856
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002868
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002868
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002868
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_01hq_2019110100_123_993_12215372_0_r749707729_119.zip
Uploading the intermediate file: upload_file_119.zip
  10:36:55 STEP 2881 H=2881:00 +CPU= 12.180
  10:37:08 STEP 2882 H=2882:00 +CPU= 12.697
  10:37:28 STEP 2883 H=2883:00 +CPU= 20.170
  10:37:41 STEP 2884 H=2884:00 +CPU= 12.634
  10:37:54 STEP 2885 H=2885:00 +CPU= 12.566
  10:38:14 STEP 2886 H=2886:00 +CPU= 20.364
  10:38:27 STEP 2887 H=2887:00 +CPU= 12.595
  10:38:40 STEP 2888 H=2888:00 +CPU= 13.131
  10:39:01 STEP 2889 H=2889:00 +CPU= 20.267
  10:39:14 STEP 2890 H=2890:00 +CPU= 13.037
  10:39:26 STEP 2891 H=2891:00 +CPU= 12.439
  10:39:49 STEP 2892 H=2892:00 +CPU= 22.032
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002892
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002892
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002892
  10:40:01 STEP 2893 H=2893:00 +CPU= 12.191
  10:40:14 STEP 2894 H=2894:00 +CPU= 13.254
  10:40:35 STEP 2895 H=2895:00 +CPU= 20.128
  10:40:48 STEP 2896 H=2896:00 +CPU= 13.082
  10:41:00 STEP 2897 H=2897:00 +CPU= 12.502
  10:41:21 STEP 2898 H=2898:00 +CPU= 20.291
  10:41:33 STEP 2899 H=2899:00 +CPU= 11.814
  10:41:46 STEP 2900 H=2900:00 +CPU= 12.736
  10:42:06 STEP 2901 H=2901:00 +CPU= 20.143
  10:42:19 STEP 2902 H=2902:00 +CPU= 12.976
  10:42:32 STEP 2903 H=2903:00 +CPU= 13.024
  10:42:56 STEP 2904 H=2904:00 +CPU= 23.155
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002904
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002904
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002904
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002880
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002880
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002880
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002892
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002892
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002892
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_01hq_2019110100_123_993_12215372_0_r749707729_120.zip
Uploading the intermediate file: upload_file_120.zip
  10:43:08 STEP 2905 H=2905:00 +CPU= 12.317
Uploading trickle at timestep: 10454400
  10:43:21 STEP 2906 H=2906:00 +CPU= 13.162
  10:43:42 STEP 2907 H=2907:00 +CPU= 20.110
  10:43:55 STEP 2908 H=2908:00 +CPU= 12.971
  10:44:08 STEP 2909 H=2909:00 +CPU= 12.499
  10:44:29 STEP 2910 H=2910:00 +CPU= 20.850
  10:44:41 STEP 2911 H=2911:00 +CPU= 12.492
  10:44:54 STEP 2912 H=2912:00 +CPU= 12.835
  10:45:15 STEP 2913 H=2913:00 +CPU= 20.273
  10:45:28 STEP 2914 H=2914:00 +CPU= 13.096
  10:45:41 STEP 2915 H=2915:00 +CPU= 12.665
  10:46:04 STEP 2916 H=2916:00 +CPU= 22.605
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002916
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002916
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002916
  10:46:16 STEP 2917 H=2917:00 +CPU= 12.046
  10:46:28 STEP 2918 H=2918:00 +CPU= 12.119
  10:46:48 STEP 2919 H=2919:00 +CPU= 20.272
  10:47:02 STEP 2920 H=2920:00 +CPU= 13.037
  10:47:14 STEP 2921 H=2921:00 +CPU= 12.379
  10:47:35 STEP 2922 H=2922:00 +CPU= 20.549
  10:47:48 STEP 2923 H=2923:00 +CPU= 12.658
  10:48:00 STEP 2924 H=2924:00 +CPU= 12.662
  10:48:20 STEP 2925 H=2925:00 +CPU= 19.643
  10:48:33 STEP 2926 H=2926:00 +CPU= 12.962
  10:48:47 STEP 2927 H=2927:00 +CPU= 13.052
  10:49:10 STEP 2928 H=2928:00 +CPU= 23.237
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002928
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002928
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002928
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002904
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002904
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002904
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002916
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002916
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002916
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_01hq_2019110100_123_993_12215372_0_r749707729_121.zip
Uploading the intermediate file: upload_file_121.zip
  10:49:23 STEP 2929 H=2929:00 +CPU= 12.611
  10:49:36 STEP 2930 H=2930:00 +CPU= 13.194
  10:49:57 STEP 2931 H=2931:00 +CPU= 20.138
  10:50:10 STEP 2932 H=2932:00 +CPU= 12.914
  10:50:23 STEP 2933 H=2933:00 +CPU= 12.641
  10:50:43 STEP 2934 H=2934:00 +CPU= 20.549
  10:50:56 STEP 2935 H=2935:00 +CPU= 12.340
  10:51:09 STEP 2936 H=2936:00 +CPU= 12.843
  10:51:29 STEP 2937 H=2937:00 +CPU= 20.376
  10:51:42 STEP 2938 H=2938:00 +CPU= 12.918
  10:51:55 STEP 2939 H=2939:00 +CPU= 12.942
  10:52:18 STEP 2940 H=2940:00 +CPU= 22.335
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002940
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002940
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002940
  10:52:31 STEP 2941 H=2941:00 +CPU= 12.525
  10:52:44 STEP 2942 H=2942:00 +CPU= 12.948
  10:53:04 STEP 2943 H=2943:00 +CPU= 20.069
  10:53:17 STEP 2944 H=2944:00 +CPU= 12.866
  10:53:30 STEP 2945 H=2945:00 +CPU= 12.773
  10:53:51 STEP 2946 H=2946:00 +CPU= 20.514
  10:54:03 STEP 2947 H=2947:00 +CPU= 12.820
  10:54:16 STEP 2948 H=2948:00 +CPU= 12.614
  10:54:37 STEP 2949 H=2949:00 +CPU= 20.449
  10:54:50 STEP 2950 H=2950:00 +CPU= 12.882
  10:55:03 STEP 2951 H=2951:00 +CPU= 13.071
  10:55:25 STEP 2952 H=2952:00 +CPU= 21.765
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 STEPO, YSPSDT_AR1     (  1,...), SP NORMS 2D: 4.865283731608E-01 1.865286143845E-01 6.362598939121E-02
 STEPO, YSPSDT_AR1     (SUM,...), SP NORMS 2D: 5.260318722649E-01
 STEPO, YGPSDT         (  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  3.48989191816039E-02 -1.72994898449055E+00  1.89761310057317E+00
 STEPO, YGPSDT[clipped](  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  3.19925486346338E-02 -1.00000000000000E+00  1.00000000000000E+00
  MAXGPFV : MAX. VALUE =    1.17346031058280     
  MAXGPFV : MAX. VALUE =   0.744071495136801     
 NSTEP =  2952 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGhnw4+002952 MODE=a
 IO-STREAM CLOSED - ICMGGhnw4+002952
 MPI-TASK:   1 -    283891578 BYTES IN      8 RECORDS TRANSFERRED IN    0.0002 SECONDS******** Mbytes/s, TOTAL TIME=    0.0064( 3.1%)
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302231500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302233000  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302234500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200303000000  !!!!!!!!!!!! 
 10:55:25 STEP 2952 H=2952:00 +CPU= 21.765
 END CNT3
 NSTEP =  2952 CNT0   000000000  19.216  19.216  19.365   0.992               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           35/   804992476 WRITTEN        15666/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    381    0       35       786125    15666 ************    80.4    42.1    38.3    42.3    55.9
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.74      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 1093    1094.8    1094.8      7.23      0.00
   9 SPCM     - SPECTRAL COMP.                    1008     157.3     157.3      0.96      0.00
  10 SCAN2M - PHYSICS                             1009    7816.2    7816.2     47.67      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                 84     606.7     606.7      0.31      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 43       9.6       9.6      0.00      0.00
  13 SCAN2M - RADIATION CALC.                      337    7564.3    7564.3     15.41      0.00
  17 GRIDFPOS IN CNT4                               84      27.2      27.2      0.01      0.00
  27 RESTART FILES - WRITING                        42    1213.3    1213.3      0.31      0.00
  28 RESTART FILES - READING                         1   42730.8   42730.8      0.26      0.00
  29 SU4FPOS IN CNT4                                84       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                                84    1394.0    1394.0      0.71      0.00
  31 POSDDH IN STEPO                                 4       0.5       0.5      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   1009    1926.5    1926.5     11.75      0.00
  38 WAM      - TOTAL COST OF WAVE MODEL          1009    1741.9    1741.9     10.62      0.00
  39 SU0YOMB                                         1     152.3     152.3      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   1009       5.3       5.3      0.03      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             1008      51.0      51.0      0.31      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             1008      10.9      10.9      0.07      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 43       0.1       0.1      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     3450      92.9      92.9      1.94      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      2100      91.5      91.5      1.16      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       2100      30.4      30.4      0.39      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      3450      31.3      31.3      0.65      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            2      11.3      11.3      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           3450       6.2       6.2      0.13      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           2100       6.4       6.4      0.08      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           3450      10.8      10.8      0.22      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           2100       9.3       9.3      0.12      0.00
 400 GSTATS                                     201620       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                193055       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    16544.5 CPU TIME   15852.4 VECTOR TIME    15852.4


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY      644.0
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc/slots/49/ICMGGhnw4+002952
Moving to projects directory: /var/lib/boinc/slots/49/ICMSHhnw4+002952
Moving to projects directory: /var/lib/boinc/slots/49/ICMUAhnw4+002952
Adding to the zip: /var/lib/boinc/slots/49/NODE.001_01
Adding to the zip: /var/lib/boinc/slots/49/ifs.stat
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002952
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002952
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002940
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002928
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002928
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002940
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMSHhnw4+002928
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMGGhnw4+002952
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12215372/ICMUAhnw4+002940
Zipping up the final file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_01hq_2019110100_123_993_12215372_0_r749707729_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
10:58:47 (17314): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:53:51 1377895 22316783 oifs_43r3_01hq_2019110100_123_993_12215372_0 10,623,600 45,744 0.0043
09 May 2023 16:53:51 1377895 22316783 oifs_43r3_01hq_2019110100_123_993_12215372_0 10,454,400 45,005 0.0043
09 May 2023 16:53:49 1377895 22316783 oifs_43r3_01hq_2019110100_123_993_12215372_0 9,590,400 41,233 0.0043
09 May 2023 16:53:43 1377895 22316783 oifs_43r3_01hq_2019110100_123_993_12215372_0 8,726,400 37,454 0.0043
09 May 2023 16:53:40 1377895 22316783 oifs_43r3_01hq_2019110100_123_993_12215372_0 7,862,400 33,682 0.0043
09 May 2023 16:53:30 1377895 22316783 oifs_43r3_01hq_2019110100_123_993_12215372_0 6,652,800 28,082 0.0042
09 May 2023 16:53:27 1377895 22316783 oifs_43r3_01hq_2019110100_123_993_12215372_0 5,788,800 24,323 0.0042
09 May 2023 16:53:24 1377895 22316783 oifs_43r3_01hq_2019110100_123_993_12215372_0 4,924,800 20,567 0.0042
09 May 2023 16:53:21 1377895 22316783 oifs_43r3_01hq_2019110100_123_993_12215372_0 4,060,800 16,828 0.0041
09 May 2023 16:53:03 1377895 22316783 oifs_43r3_01hq_2019110100_123_993_12215372_0 2,592,000 10,359 0.0040
09 May 2023 16:53:00 1377895 22316783 oifs_43r3_01hq_2019110100_123_993_12215372_0 1,728,000 6,922 0.0040
09 May 2023 16:52:57 1377895 22316783 oifs_43r3_01hq_2019110100_123_993_12215372_0 864,000 3,502 0.0041


©2024 climateprediction.net