climateprediction.net home page
Task 22316251

Task 22316251

Name oifs_43r3_013n_2019110100_123_993_12214865_0
Workunit 12214865
Created 24 Feb 2023, 16:32:46 UTC
Sent 24 Feb 2023, 22:03:47 UTC
Report deadline 25 Apr 2023, 22:03:47 UTC
Received 1 Mar 2023, 3:02:56 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 9 (0x00000009) Unknown error code
Computer ID 1538124
Run time 21 hours 39 min 39 sec
CPU time 21 hours 32 min 15 sec
Validate state Invalid
Credit 14,873.04
Device peak FLOPS 5.47 GFLOPS
Application version OpenIFS 43r3 v1.21
x86_64-pc-linux-gnu
Peak working set size 4,424.94 MB
Peak swap size 4,983.13 MB
Peak disk usage 1,271.77 MB
Stderr
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<message>
process exited with code 9 (0x9, -247)</message>
<stderr_txt>
STEP 2369 H=2369:00 +CPU= 21.269
  23:23:37 STEP 2370 H=2370:00 +CPU= 35.183
  23:23:58 STEP 2371 H=2371:00 +CPU= 20.998
  23:24:19 STEP 2372 H=2372:00 +CPU= 21.858
  23:24:54 STEP 2373 H=2373:00 +CPU= 34.569
  23:25:15 STEP 2374 H=2374:00 +CPU= 21.310
  23:25:37 STEP 2375 H=2375:00 +CPU= 21.985
  23:26:17 STEP 2376 H=2376:00 +CPU= 39.937
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002376
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002376
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002364
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_013n_2019110100_123_993_12214865_0_r1705977416_98.zip
Uploading the intermediate file: upload_file_98.zip
  23:26:39 STEP 2377 H=2377:00 +CPU= 21.147
  23:27:01 STEP 2378 H=2378:00 +CPU= 21.963
  23:27:35 STEP 2379 H=2379:00 +CPU= 34.361
  23:27:57 STEP 2380 H=2380:00 +CPU= 21.645
  23:28:18 STEP 2381 H=2381:00 +CPU= 21.235
  23:28:53 STEP 2382 H=2382:00 +CPU= 35.020
  23:29:14 STEP 2383 H=2383:00 +CPU= 21.048
  23:29:36 STEP 2384 H=2384:00 +CPU= 21.804
  23:30:11 STEP 2385 H=2385:00 +CPU= 34.559
  23:30:32 STEP 2386 H=2386:00 +CPU= 21.414
  23:30:54 STEP 2387 H=2387:00 +CPU= 21.362
  23:31:32 STEP 2388 H=2388:00 +CPU= 38.069
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002388
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002388
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002388
  23:31:53 STEP 2389 H=2389:00 +CPU= 20.912
  23:32:15 STEP 2390 H=2390:00 +CPU= 21.816
  23:32:49 STEP 2391 H=2391:00 +CPU= 34.558
  23:33:11 STEP 2392 H=2392:00 +CPU= 21.515
  23:33:32 STEP 2393 H=2393:00 +CPU= 21.238
  23:34:08 STEP 2394 H=2394:00 +CPU= 35.229
  23:34:28 STEP 2395 H=2395:00 +CPU= 20.917
  23:34:50 STEP 2396 H=2396:00 +CPU= 21.648
  23:35:25 STEP 2397 H=2397:00 +CPU= 34.682
  23:35:46 STEP 2398 H=2398:00 +CPU= 21.297
  23:36:08 STEP 2399 H=2399:00 +CPU= 21.963
  23:36:48 STEP 2400 H=2400:00 +CPU= 39.970
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002400
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002400
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002388
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002388
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002388
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_013n_2019110100_123_993_12214865_0_r1705977416_99.zip
Uploading the intermediate file: upload_file_99.zip
  23:37:10 STEP 2401 H=2401:00 +CPU= 21.328
Uploading trickle at timestep: 8640000
  23:37:32 STEP 2402 H=2402:00 +CPU= 22.009
  23:38:06 STEP 2403 H=2403:00 +CPU= 34.399
  23:38:28 STEP 2404 H=2404:00 +CPU= 21.687
  23:38:50 STEP 2405 H=2405:00 +CPU= 21.307
  23:39:25 STEP 2406 H=2406:00 +CPU= 34.969
  23:39:46 STEP 2407 H=2407:00 +CPU= 21.134
  23:40:08 STEP 2408 H=2408:00 +CPU= 21.924
  23:40:42 STEP 2409 H=2409:00 +CPU= 34.657
  23:41:04 STEP 2410 H=2410:00 +CPU= 21.430
  23:41:26 STEP 2411 H=2411:00 +CPU= 21.416
  23:42:04 STEP 2412 H=2412:00 +CPU= 38.079
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002412
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002412
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002412
  23:42:25 STEP 2413 H=2413:00 +CPU= 21.073
  23:42:47 STEP 2414 H=2414:00 +CPU= 21.912
  23:43:22 STEP 2415 H=2415:00 +CPU= 34.626
  23:43:43 STEP 2416 H=2416:00 +CPU= 21.593
  23:44:05 STEP 2417 H=2417:00 +CPU= 21.297
  23:44:40 STEP 2418 H=2418:00 +CPU= 35.284
  23:45:01 STEP 2419 H=2419:00 +CPU= 21.038
  23:45:23 STEP 2420 H=2420:00 +CPU= 21.920
  23:45:58 STEP 2421 H=2421:00 +CPU= 34.677
  23:46:19 STEP 2422 H=2422:00 +CPU= 21.370
  23:46:41 STEP 2423 H=2423:00 +CPU= 22.112
  23:47:21 STEP 2424 H=2424:00 +CPU= 40.019
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002424
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002424
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002412
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_013n_2019110100_123_993_12214865_0_r1705977416_100.zip
Uploading the intermediate file: upload_file_100.zip
  23:47:43 STEP 2425 H=2425:00 +CPU= 21.136
  23:48:05 STEP 2426 H=2426:00 +CPU= 22.080
  23:48:39 STEP 2427 H=2427:00 +CPU= 34.287
  23:49:01 STEP 2428 H=2428:00 +CPU= 21.745
  23:49:22 STEP 2429 H=2429:00 +CPU= 21.229
  23:49:57 STEP 2430 H=2430:00 +CPU= 35.054
  23:50:19 STEP 2431 H=2431:00 +CPU= 21.198
  23:50:40 STEP 2432 H=2432:00 +CPU= 21.902
  23:51:15 STEP 2433 H=2433:00 +CPU= 34.594
  23:51:37 STEP 2434 H=2434:00 +CPU= 21.525
  23:51:58 STEP 2435 H=2435:00 +CPU= 21.363
  23:52:37 STEP 2436 H=2436:00 +CPU= 37.987
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002436
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002436
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002436
  23:52:58 STEP 2437 H=2437:00 +CPU= 21.202
  23:53:20 STEP 2438 H=2438:00 +CPU= 22.008
  23:53:54 STEP 2439 H=2439:00 +CPU= 34.354
  23:54:16 STEP 2440 H=2440:00 +CPU= 21.784
  23:54:38 STEP 2441 H=2441:00 +CPU= 21.450
  23:55:13 STEP 2442 H=2442:00 +CPU= 35.177
  23:55:34 STEP 2443 H=2443:00 +CPU= 21.123
  23:55:56 STEP 2444 H=2444:00 +CPU= 22.145
  23:56:31 STEP 2445 H=2445:00 +CPU= 34.588
  23:56:52 STEP 2446 H=2446:00 +CPU= 21.520
  23:57:14 STEP 2447 H=2447:00 +CPU= 22.000
  23:57:54 STEP 2448 H=2448:00 +CPU= 39.636
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002448
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002448
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002436
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_013n_2019110100_123_993_12214865_0_r1705977416_101.zip
Uploading the intermediate file: upload_file_101.zip
  23:58:16 STEP 2449 H=2449:00 +CPU= 21.320
  23:58:38 STEP 2450 H=2450:00 +CPU= 22.002
  23:59:13 STEP 2451 H=2451:00 +CPU= 34.360
  23:59:34 STEP 2452 H=2452:00 +CPU= 21.826
  23:59:56 STEP 2453 H=2453:00 +CPU= 21.239
  00:00:31 STEP 2454 H=2454:00 +CPU= 34.972
  00:00:52 STEP 2455 H=2455:00 +CPU= 21.258
  00:01:14 STEP 2456 H=2456:00 +CPU= 21.839
  00:01:48 STEP 2457 H=2457:00 +CPU= 34.461
  00:02:10 STEP 2458 H=2458:00 +CPU= 21.707
  00:02:32 STEP 2459 H=2459:00 +CPU= 21.478
  00:03:10 STEP 2460 H=2460:00 +CPU= 37.811
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002460
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002460
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002460
  00:03:31 STEP 2461 H=2461:00 +CPU= 21.277
  00:03:53 STEP 2462 H=2462:00 +CPU= 21.944
  00:04:28 STEP 2463 H=2463:00 +CPU= 34.462
  00:04:50 STEP 2464 H=2464:00 +CPU= 21.786
  00:05:11 STEP 2465 H=2465:00 +CPU= 21.284
  00:05:46 STEP 2466 H=2466:00 +CPU= 35.131
  00:06:07 STEP 2467 H=2467:00 +CPU= 21.164
  00:06:29 STEP 2468 H=2468:00 +CPU= 21.859
  00:07:04 STEP 2469 H=2469:00 +CPU= 34.541
  00:07:26 STEP 2470 H=2470:00 +CPU= 21.672
  00:07:48 STEP 2471 H=2471:00 +CPU= 22.103
  00:08:27 STEP 2472 H=2472:00 +CPU= 39.741
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002472
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002472
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002460
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_013n_2019110100_123_993_12214865_0_r1705977416_102.zip
Uploading the intermediate file: upload_file_102.zip
  00:08:49 STEP 2473 H=2473:00 +CPU= 21.299
  00:09:11 STEP 2474 H=2474:00 +CPU= 22.092
  00:09:46 STEP 2475 H=2475:00 +CPU= 34.380
  00:10:08 STEP 2476 H=2476:00 +CPU= 21.809
  00:10:29 STEP 2477 H=2477:00 +CPU= 21.220
  00:11:04 STEP 2478 H=2478:00 +CPU= 35.008
  00:11:25 STEP 2479 H=2479:00 +CPU= 21.233
  00:11:47 STEP 2480 H=2480:00 +CPU= 21.839
  00:12:21 STEP 2481 H=2481:00 +CPU= 34.342
  00:12:43 STEP 2482 H=2482:00 +CPU= 21.837
  00:13:05 STEP 2483 H=2483:00 +CPU= 21.500
  00:13:43 STEP 2484 H=2484:00 +CPU= 37.826
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002484
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002484
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002484
  00:14:05 STEP 2485 H=2485:00 +CPU= 21.266
  00:14:26 STEP 2486 H=2486:00 +CPU= 21.921
  00:15:01 STEP 2487 H=2487:00 +CPU= 34.400
  00:15:23 STEP 2488 H=2488:00 +CPU= 21.881
  00:15:44 STEP 2489 H=2489:00 +CPU= 21.266
  00:16:19 STEP 2490 H=2490:00 +CPU= 34.828
  00:16:40 STEP 2491 H=2491:00 +CPU= 21.285
  00:17:02 STEP 2492 H=2492:00 +CPU= 21.862
  00:17:37 STEP 2493 H=2493:00 +CPU= 34.376
  00:17:58 STEP 2494 H=2494:00 +CPU= 21.711
  00:18:21 STEP 2495 H=2495:00 +CPU= 22.169
  00:19:00 STEP 2496 H=2496:00 +CPU= 39.706
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002496
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002496
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002484
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_013n_2019110100_123_993_12214865_0_r1705977416_103.zip
Uploading the intermediate file: upload_file_103.zip
  00:19:22 STEP 2497 H=2497:00 +CPU= 21.392
  00:19:44 STEP 2498 H=2498:00 +CPU= 21.938
  00:20:19 STEP 2499 H=2499:00 +CPU= 34.309
  00:20:41 STEP 2500 H=2500:00 +CPU= 21.800
  00:21:02 STEP 2501 H=2501:00 +CPU= 21.194
  00:21:37 STEP 2502 H=2502:00 +CPU= 34.983
  00:21:58 STEP 2503 H=2503:00 +CPU= 21.234
  00:22:20 STEP 2504 H=2504:00 +CPU= 21.817
  00:22:54 STEP 2505 H=2505:00 +CPU= 34.485
  00:23:16 STEP 2506 H=2506:00 +CPU= 21.961
  00:23:38 STEP 2507 H=2507:00 +CPU= 21.536
  00:24:16 STEP 2508 H=2508:00 +CPU= 37.813
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002508
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002508
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002508
  00:24:37 STEP 2509 H=2509:00 +CPU= 21.187
  00:24:59 STEP 2510 H=2510:00 +CPU= 21.829
  00:25:34 STEP 2511 H=2511:00 +CPU= 34.245
  00:25:55 STEP 2512 H=2512:00 +CPU= 21.851
  00:26:17 STEP 2513 H=2513:00 +CPU= 21.230
  00:26:52 STEP 2514 H=2514:00 +CPU= 35.002
  00:27:13 STEP 2515 H=2515:00 +CPU= 21.223
  00:27:35 STEP 2516 H=2516:00 +CPU= 21.813
  00:28:09 STEP 2517 H=2517:00 +CPU= 34.360
  00:28:31 STEP 2518 H=2518:00 +CPU= 21.678
  00:28:53 STEP 2519 H=2519:00 +CPU= 22.267
  00:29:33 STEP 2520 H=2520:00 +CPU= 39.714
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002520
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002520
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002508
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_013n_2019110100_123_993_12214865_0_r1705977416_104.zip
Uploading the intermediate file: upload_file_104.zip
  00:29:55 STEP 2521 H=2521:00 +CPU= 21.308
  00:30:17 STEP 2522 H=2522:00 +CPU= 21.902
  00:30:51 STEP 2523 H=2523:00 +CPU= 34.296
  00:31:13 STEP 2524 H=2524:00 +CPU= 21.623
  00:31:34 STEP 2525 H=2525:00 +CPU= 21.199
  00:32:09 STEP 2526 H=2526:00 +CPU= 34.944
  00:32:30 STEP 2527 H=2527:00 +CPU= 21.242
  00:32:52 STEP 2528 H=2528:00 +CPU= 21.816
  00:33:27 STEP 2529 H=2529:00 +CPU= 34.459
  00:33:48 STEP 2530 H=2530:00 +CPU= 21.587
  00:34:10 STEP 2531 H=2531:00 +CPU= 21.418
  00:34:48 STEP 2532 H=2532:00 +CPU= 37.783
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002532
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002532
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002532
  00:35:09 STEP 2533 H=2533:00 +CPU= 21.260
  00:35:31 STEP 2534 H=2534:00 +CPU= 21.865
  00:36:06 STEP 2535 H=2535:00 +CPU= 34.324
  00:36:27 STEP 2536 H=2536:00 +CPU= 21.862
  00:36:49 STEP 2537 H=2537:00 +CPU= 21.320
  00:37:24 STEP 2538 H=2538:00 +CPU= 35.004
  00:37:45 STEP 2539 H=2539:00 +CPU= 21.209
  00:38:07 STEP 2540 H=2540:00 +CPU= 21.842
  00:38:41 STEP 2541 H=2541:00 +CPU= 34.464
  00:39:03 STEP 2542 H=2542:00 +CPU= 21.721
  00:39:25 STEP 2543 H=2543:00 +CPU= 22.045
  00:40:05 STEP 2544 H=2544:00 +CPU= 39.731
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002544
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002544
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002532
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_013n_2019110100_123_993_12214865_0_r1705977416_105.zip
Uploading the intermediate file: upload_file_105.zip
  00:40:27 STEP 2545 H=2545:00 +CPU= 21.311
  00:40:49 STEP 2546 H=2546:00 +CPU= 22.018
  00:41:23 STEP 2547 H=2547:00 +CPU= 34.154
  00:41:45 STEP 2548 H=2548:00 +CPU= 21.820
  00:42:06 STEP 2549 H=2549:00 +CPU= 21.214
  00:42:41 STEP 2550 H=2550:00 +CPU= 34.890
  00:43:02 STEP 2551 H=2551:00 +CPU= 21.242
  00:43:24 STEP 2552 H=2552:00 +CPU= 21.828
  00:43:59 STEP 2553 H=2553:00 +CPU= 34.381
  00:44:21 STEP 2554 H=2554:00 +CPU= 21.834
  00:44:43 STEP 2555 H=2555:00 +CPU= 21.550
  00:45:20 STEP 2556 H=2556:00 +CPU= 37.613
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002556
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002556
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002556
  00:45:42 STEP 2557 H=2557:00 +CPU= 21.199
  00:46:03 STEP 2558 H=2558:00 +CPU= 21.875
  00:46:38 STEP 2559 H=2559:00 +CPU= 34.258
  00:47:00 STEP 2560 H=2560:00 +CPU= 21.803
  00:47:21 STEP 2561 H=2561:00 +CPU= 21.241
  00:47:56 STEP 2562 H=2562:00 +CPU= 34.933
  00:48:17 STEP 2563 H=2563:00 +CPU= 21.161
  00:48:39 STEP 2564 H=2564:00 +CPU= 21.838
  00:49:13 STEP 2565 H=2565:00 +CPU= 34.333
  00:49:35 STEP 2566 H=2566:00 +CPU= 21.600
  00:49:57 STEP 2567 H=2567:00 +CPU= 21.881
  00:50:37 STEP 2568 H=2568:00 +CPU= 39.686
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002568
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002568
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002556
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_013n_2019110100_123_993_12214865_0_r1705977416_106.zip
Uploading the intermediate file: upload_file_106.zip
  00:50:58 STEP 2569 H=2569:00 +CPU= 21.356
  00:51:20 STEP 2570 H=2570:00 +CPU= 21.883
  00:51:55 STEP 2571 H=2571:00 +CPU= 34.120
  00:52:16 STEP 2572 H=2572:00 +CPU= 21.823
  00:52:37 STEP 2573 H=2573:00 +CPU= 20.988
  00:53:12 STEP 2574 H=2574:00 +CPU= 34.920
  00:53:34 STEP 2575 H=2575:00 +CPU= 21.245
  00:53:56 STEP 2576 H=2576:00 +CPU= 21.860
  00:54:30 STEP 2577 H=2577:00 +CPU= 34.430
  00:54:52 STEP 2578 H=2578:00 +CPU= 21.810
  00:55:14 STEP 2579 H=2579:00 +CPU= 21.473
  00:55:52 STEP 2580 H=2580:00 +CPU= 37.704
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002580
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002580
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002580
  00:56:13 STEP 2581 H=2581:00 +CPU= 21.129
  00:56:35 STEP 2582 H=2582:00 +CPU= 21.853
  00:57:09 STEP 2583 H=2583:00 +CPU= 34.287
  00:57:31 STEP 2584 H=2584:00 +CPU= 21.739
  00:57:52 STEP 2585 H=2585:00 +CPU= 21.260
  00:58:27 STEP 2586 H=2586:00 +CPU= 35.065
  00:58:48 STEP 2587 H=2587:00 +CPU= 21.139
  00:59:10 STEP 2588 H=2588:00 +CPU= 21.838
  00:59:45 STEP 2589 H=2589:00 +CPU= 34.412
  01:00:06 STEP 2590 H=2590:00 +CPU= 21.550
  01:00:28 STEP 2591 H=2591:00 +CPU= 21.996
  01:01:08 STEP 2592 H=2592:00 +CPU= 39.720
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002592
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002592
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002580
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_013n_2019110100_123_993_12214865_0_r1705977416_107.zip
Uploading the intermediate file: upload_file_107.zip
  01:01:30 STEP 2593 H=2593:00 +CPU= 21.322
  01:01:52 STEP 2594 H=2594:00 +CPU= 22.033
  01:02:26 STEP 2595 H=2595:00 +CPU= 34.296
  01:02:48 STEP 2596 H=2596:00 +CPU= 21.807
  01:03:09 STEP 2597 H=2597:00 +CPU= 21.204
  01:03:44 STEP 2598 H=2598:00 +CPU= 34.916
  01:04:06 STEP 2599 H=2599:00 +CPU= 21.226
  01:04:27 STEP 2600 H=2600:00 +CPU= 21.839
  01:05:02 STEP 2601 H=2601:00 +CPU= 34.428
  01:05:24 STEP 2602 H=2602:00 +CPU= 21.729
  01:05:46 STEP 2603 H=2603:00 +CPU= 21.542
  01:06:23 STEP 2604 H=2604:00 +CPU= 37.586
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002604
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002604
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002604
  01:06:44 STEP 2605 H=2605:00 +CPU= 21.123
  01:07:06 STEP 2606 H=2606:00 +CPU= 21.909
  01:07:41 STEP 2607 H=2607:00 +CPU= 34.320
  01:08:02 STEP 2608 H=2608:00 +CPU= 21.727
  01:08:23 STEP 2609 H=2609:00 +CPU= 21.084
  01:08:59 STEP 2610 H=2610:00 +CPU= 35.086
  01:09:20 STEP 2611 H=2611:00 +CPU= 21.130
  01:09:42 STEP 2612 H=2612:00 +CPU= 21.862
  01:10:16 STEP 2613 H=2613:00 +CPU= 34.439
  01:10:38 STEP 2614 H=2614:00 +CPU= 21.536
  01:11:00 STEP 2615 H=2615:00 +CPU= 21.835
  01:11:39 STEP 2616 H=2616:00 +CPU= 39.672
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002616
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002616
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002604
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_013n_2019110100_123_993_12214865_0_r1705977416_108.zip
Uploading the intermediate file: upload_file_108.zip
  01:12:01 STEP 2617 H=2617:00 +CPU= 21.402
  01:12:23 STEP 2618 H=2618:00 +CPU= 21.977
  01:12:58 STEP 2619 H=2619:00 +CPU= 34.323
  01:13:20 STEP 2620 H=2620:00 +CPU= 21.884
  01:13:41 STEP 2621 H=2621:00 +CPU= 21.267
  01:14:16 STEP 2622 H=2622:00 +CPU= 34.965
  01:14:37 STEP 2623 H=2623:00 +CPU= 21.293
  01:14:59 STEP 2624 H=2624:00 +CPU= 21.877
  01:15:34 STEP 2625 H=2625:00 +CPU= 34.522
  01:15:55 STEP 2626 H=2626:00 +CPU= 21.645
  01:16:17 STEP 2627 H=2627:00 +CPU= 21.459
  01:16:55 STEP 2628 H=2628:00 +CPU= 37.782
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002628
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002628
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002628
  01:17:16 STEP 2629 H=2629:00 +CPU= 21.168
  01:17:38 STEP 2630 H=2630:00 +CPU= 21.972
  01:18:13 STEP 2631 H=2631:00 +CPU= 34.412
  01:18:35 STEP 2632 H=2632:00 +CPU= 21.734
  01:18:56 STEP 2633 H=2633:00 +CPU= 21.519
  01:19:31 STEP 2634 H=2634:00 +CPU= 35.134
  01:19:52 STEP 2635 H=2635:00 +CPU= 21.086
  01:20:14 STEP 2636 H=2636:00 +CPU= 21.967
  01:20:49 STEP 2637 H=2637:00 +CPU= 34.505
  01:21:10 STEP 2638 H=2638:00 +CPU= 21.451
  01:21:32 STEP 2639 H=2639:00 +CPU= 22.003
  01:22:12 STEP 2640 H=2640:00 +CPU= 39.657
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002640
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002640
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002628
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_013n_2019110100_123_993_12214865_0_r1705977416_109.zip
Uploading the intermediate file: upload_file_109.zip
  01:22:34 STEP 2641 H=2641:00 +CPU= 21.316
Uploading trickle at timestep: 9504000
  01:22:56 STEP 2642 H=2642:00 +CPU= 21.939
  01:23:30 STEP 2643 H=2643:00 +CPU= 34.412
  01:23:52 STEP 2644 H=2644:00 +CPU= 21.741
  01:24:13 STEP 2645 H=2645:00 +CPU= 21.250
  01:24:48 STEP 2646 H=2646:00 +CPU= 34.951
  01:25:10 STEP 2647 H=2647:00 +CPU= 21.198
  01:25:31 STEP 2648 H=2648:00 +CPU= 21.855
  01:26:06 STEP 2649 H=2649:00 +CPU= 34.521
  01:26:28 STEP 2650 H=2650:00 +CPU= 21.494
  01:26:49 STEP 2651 H=2651:00 +CPU= 21.390
  01:27:27 STEP 2652 H=2652:00 +CPU= 37.802
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002652
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002652
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002652
  01:27:48 STEP 2653 H=2653:00 +CPU= 21.144
  01:28:10 STEP 2654 H=2654:00 +CPU= 21.902
  01:28:45 STEP 2655 H=2655:00 +CPU= 34.436
  01:29:06 STEP 2656 H=2656:00 +CPU= 21.652
  01:29:28 STEP 2657 H=2657:00 +CPU= 21.302
  01:30:03 STEP 2658 H=2658:00 +CPU= 34.979
  01:30:24 STEP 2659 H=2659:00 +CPU= 21.073
  01:30:46 STEP 2660 H=2660:00 +CPU= 21.913
  01:31:21 STEP 2661 H=2661:00 +CPU= 34.820
  01:31:42 STEP 2662 H=2662:00 +CPU= 21.380
  01:32:04 STEP 2663 H=2663:00 +CPU= 22.093
  01:32:44 STEP 2664 H=2664:00 +CPU= 39.876
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002664
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002664
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002652
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_013n_2019110100_123_993_12214865_0_r1705977416_110.zip
Uploading the intermediate file: upload_file_110.zip
  01:33:06 STEP 2665 H=2665:00 +CPU= 21.250
  01:33:28 STEP 2666 H=2666:00 +CPU= 21.914
  01:34:03 STEP 2667 H=2667:00 +CPU= 34.375
  01:34:24 STEP 2668 H=2668:00 +CPU= 21.765
  01:34:46 STEP 2669 H=2669:00 +CPU= 21.230
  01:35:21 STEP 2670 H=2670:00 +CPU= 35.073
  01:35:42 STEP 2671 H=2671:00 +CPU= 21.260
  01:36:04 STEP 2672 H=2672:00 +CPU= 21.928
  01:36:39 STEP 2673 H=2673:00 +CPU= 34.674
  01:37:01 STEP 2674 H=2674:00 +CPU= 21.607
  01:37:22 STEP 2675 H=2675:00 +CPU= 21.478
  01:38:00 STEP 2676 H=2676:00 +CPU= 37.923
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002676
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002676
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002676
  01:38:21 STEP 2677 H=2677:00 +CPU= 21.115
  01:38:43 STEP 2678 H=2678:00 +CPU= 21.947
  01:39:18 STEP 2679 H=2679:00 +CPU= 34.511
  01:39:40 STEP 2680 H=2680:00 +CPU= 21.685
  01:40:01 STEP 2681 H=2681:00 +CPU= 21.336
  01:40:36 STEP 2682 H=2682:00 +CPU= 35.210
  01:40:57 STEP 2683 H=2683:00 +CPU= 21.067
  01:41:19 STEP 2684 H=2684:00 +CPU= 21.924
  01:41:54 STEP 2685 H=2685:00 +CPU= 34.631
  01:42:16 STEP 2686 H=2686:00 +CPU= 21.458
  01:42:38 STEP 2687 H=2687:00 +CPU= 22.026
  01:43:18 STEP 2688 H=2688:00 +CPU= 39.884
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002688
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002688
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002676
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_013n_2019110100_123_993_12214865_0_r1705977416_111.zip
Uploading the intermediate file: upload_file_111.zip
  01:43:39 STEP 2689 H=2689:00 +CPU= 21.236
  01:44:01 STEP 2690 H=2690:00 +CPU= 22.036
  01:44:36 STEP 2691 H=2691:00 +CPU= 34.396
  01:44:58 STEP 2692 H=2692:00 +CPU= 21.806
  01:45:19 STEP 2693 H=2693:00 +CPU= 21.255
  01:45:54 STEP 2694 H=2694:00 +CPU= 34.993
  01:46:15 STEP 2695 H=2695:00 +CPU= 21.172
  01:46:37 STEP 2696 H=2696:00 +CPU= 21.711
  01:47:12 STEP 2697 H=2697:00 +CPU= 34.630
  01:47:33 STEP 2698 H=2698:00 +CPU= 21.496
  01:47:55 STEP 2699 H=2699:00 +CPU= 21.466
  01:48:33 STEP 2700 H=2700:00 +CPU= 37.892
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002700
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002700
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002700
  01:48:54 STEP 2701 H=2701:00 +CPU= 21.112
  01:49:16 STEP 2702 H=2702:00 +CPU= 21.916
  01:49:51 STEP 2703 H=2703:00 +CPU= 34.544
  01:50:12 STEP 2704 H=2704:00 +CPU= 21.688
  01:50:34 STEP 2705 H=2705:00 +CPU= 21.364
  01:51:09 STEP 2706 H=2706:00 +CPU= 35.188
  01:51:30 STEP 2707 H=2707:00 +CPU= 21.079
  01:51:52 STEP 2708 H=2708:00 +CPU= 21.950
  01:52:27 STEP 2709 H=2709:00 +CPU= 34.663
  01:52:48 STEP 2710 H=2710:00 +CPU= 21.434
  01:53:10 STEP 2711 H=2711:00 +CPU= 22.057
  01:53:50 STEP 2712 H=2712:00 +CPU= 39.878
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002712
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002712
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002700
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_013n_2019110100_123_993_12214865_0_r1705977416_112.zip
Uploading the intermediate file: upload_file_112.zip
  01:54:12 STEP 2713 H=2713:00 +CPU= 21.268
  01:54:34 STEP 2714 H=2714:00 +CPU= 22.021
  01:55:09 STEP 2715 H=2715:00 +CPU= 34.284
  01:55:30 STEP 2716 H=2716:00 +CPU= 21.745
  01:55:52 STEP 2717 H=2717:00 +CPU= 21.235
  01:56:27 STEP 2718 H=2718:00 +CPU= 35.030
  01:56:48 STEP 2719 H=2719:00 +CPU= 21.225
  01:57:10 STEP 2720 H=2720:00 +CPU= 21.872
  01:57:44 STEP 2721 H=2721:00 +CPU= 34.522
  01:58:06 STEP 2722 H=2722:00 +CPU= 21.469
  01:58:28 STEP 2723 H=2723:00 +CPU= 21.439
  01:59:06 STEP 2724 H=2724:00 +CPU= 37.957
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002724
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002724
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002724
  01:59:27 STEP 2725 H=2725:00 +CPU= 21.032
  01:59:49 STEP 2726 H=2726:00 +CPU= 21.957
  02:00:23 STEP 2727 H=2727:00 +CPU= 34.573
  02:00:45 STEP 2728 H=2728:00 +CPU= 21.678
  02:01:06 STEP 2729 H=2729:00 +CPU= 21.282
  02:01:42 STEP 2730 H=2730:00 +CPU= 35.199
  02:02:03 STEP 2731 H=2731:00 +CPU= 21.046
  02:02:25 STEP 2732 H=2732:00 +CPU= 21.891
  02:02:59 STEP 2733 H=2733:00 +CPU= 34.591
  02:03:21 STEP 2734 H=2734:00 +CPU= 21.414
  02:03:43 STEP 2735 H=2735:00 +CPU= 22.024
  02:04:23 STEP 2736 H=2736:00 +CPU= 39.881
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002736
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002736
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002724
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_013n_2019110100_123_993_12214865_0_r1705977416_113.zip
Uploading the intermediate file: upload_file_113.zip
  02:04:44 STEP 2737 H=2737:00 +CPU= 21.173
  02:05:06 STEP 2738 H=2738:00 +CPU= 21.908
  02:05:41 STEP 2739 H=2739:00 +CPU= 34.590
  02:06:03 STEP 2740 H=2740:00 +CPU= 21.809
  02:06:24 STEP 2741 H=2741:00 +CPU= 21.247
  02:06:59 STEP 2742 H=2742:00 +CPU= 35.060
  02:07:20 STEP 2743 H=2743:00 +CPU= 21.044
  02:07:42 STEP 2744 H=2744:00 +CPU= 21.924
  02:08:17 STEP 2745 H=2745:00 +CPU= 34.704
  02:08:39 STEP 2746 H=2746:00 +CPU= 21.577
  02:09:01 STEP 2747 H=2747:00 +CPU= 21.500
  02:09:39 STEP 2748 H=2748:00 +CPU= 37.936
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002748
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002748
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002748
  02:10:00 STEP 2749 H=2749:00 +CPU= 21.088
  02:10:22 STEP 2750 H=2750:00 +CPU= 21.946
  02:10:56 STEP 2751 H=2751:00 +CPU= 34.650
  02:11:18 STEP 2752 H=2752:00 +CPU= 21.717
  02:11:40 STEP 2753 H=2753:00 +CPU= 21.464
  02:12:15 STEP 2754 H=2754:00 +CPU= 35.287
  02:12:36 STEP 2755 H=2755:00 +CPU= 21.101
  02:12:58 STEP 2756 H=2756:00 +CPU= 21.980
  02:13:33 STEP 2757 H=2757:00 +CPU= 34.731
  02:13:54 STEP 2758 H=2758:00 +CPU= 21.407
  02:14:16 STEP 2759 H=2759:00 +CPU= 22.045
  02:14:57 STEP 2760 H=2760:00 +CPU= 39.970
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002760
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002760
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002748
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_013n_2019110100_123_993_12214865_0_r1705977416_114.zip
Uploading the intermediate file: upload_file_114.zip
  02:15:18 STEP 2761 H=2761:00 +CPU= 21.395
  02:15:40 STEP 2762 H=2762:00 +CPU= 21.961
  02:16:15 STEP 2763 H=2763:00 +CPU= 34.460
  02:16:37 STEP 2764 H=2764:00 +CPU= 21.851
  02:16:58 STEP 2765 H=2765:00 +CPU= 21.288
  02:17:33 STEP 2766 H=2766:00 +CPU= 35.136
  02:17:55 STEP 2767 H=2767:00 +CPU= 21.247
  02:18:17 STEP 2768 H=2768:00 +CPU= 21.886
  02:18:51 STEP 2769 H=2769:00 +CPU= 34.656
  02:19:13 STEP 2770 H=2770:00 +CPU= 21.619
  02:19:35 STEP 2771 H=2771:00 +CPU= 21.442
  02:20:13 STEP 2772 H=2772:00 +CPU= 38.097
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002772
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002772
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002772
  02:20:34 STEP 2773 H=2773:00 +CPU= 21.330
  02:20:56 STEP 2774 H=2774:00 +CPU= 22.089
  02:21:31 STEP 2775 H=2775:00 +CPU= 34.576
  02:21:53 STEP 2776 H=2776:00 +CPU= 21.918
  02:22:15 STEP 2777 H=2777:00 +CPU= 21.420
  02:22:50 STEP 2778 H=2778:00 +CPU= 35.228
  02:23:11 STEP 2779 H=2779:00 +CPU= 21.202
  02:23:33 STEP 2780 H=2780:00 +CPU= 22.111
  02:24:08 STEP 2781 H=2781:00 +CPU= 34.395
  02:24:29 STEP 2782 H=2782:00 +CPU= 21.516
  02:24:51 STEP 2783 H=2783:00 +CPU= 22.020
  02:25:31 STEP 2784 H=2784:00 +CPU= 40.018
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002784
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002784
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002772
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_013n_2019110100_123_993_12214865_0_r1705977416_115.zip
Uploading the intermediate file: upload_file_115.zip
  02:25:53 STEP 2785 H=2785:00 +CPU= 21.536
  02:26:15 STEP 2786 H=2786:00 +CPU= 21.957
  02:26:50 STEP 2787 H=2787:00 +CPU= 34.068
  02:27:11 STEP 2788 H=2788:00 +CPU= 21.855
  02:27:33 STEP 2789 H=2789:00 +CPU= 21.271
  02:28:08 STEP 2790 H=2790:00 +CPU= 35.039
  02:28:29 STEP 2791 H=2791:00 +CPU= 21.282
  02:28:51 STEP 2792 H=2792:00 +CPU= 21.892
  02:29:26 STEP 2793 H=2793:00 +CPU= 34.485
  02:29:47 STEP 2794 H=2794:00 +CPU= 21.610
  02:30:06 STEP 2795 H=2795:00 +CPU= 18.361
  02:30:38 STEP 2796 H=2796:00 +CPU= 32.387
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002796
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002796
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002796
  02:30:56 STEP 2797 H=2797:00 +CPU= 18.008
  02:31:15 STEP 2798 H=2798:00 +CPU= 18.518
  02:31:45 STEP 2799 H=2799:00 +CPU= 29.842
  02:32:03 STEP 2800 H=2800:00 +CPU= 18.500
  02:32:21 STEP 2801 H=2801:00 +CPU= 17.949
  02:32:51 STEP 2802 H=2802:00 +CPU= 30.345
  02:33:09 STEP 2803 H=2803:00 +CPU= 17.949
  02:33:29 STEP 2804 H=2804:00 +CPU= 20.012
  02:34:03 STEP 2805 H=2805:00 +CPU= 33.920
  02:34:25 STEP 2806 H=2806:00 +CPU= 22.072
  02:34:48 STEP 2807 H=2807:00 +CPU= 22.023
  02:35:27 STEP 2808 H=2808:00 +CPU= 39.602
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002808
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002808
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002796
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_013n_2019110100_123_993_12214865_0_r1705977416_116.zip
Uploading the intermediate file: upload_file_116.zip
  02:35:49 STEP 2809 H=2809:00 +CPU= 21.394
  02:36:11 STEP 2810 H=2810:00 +CPU= 21.965
  02:36:45 STEP 2811 H=2811:00 +CPU= 34.369
  02:37:07 STEP 2812 H=2812:00 +CPU= 21.789
  02:37:29 STEP 2813 H=2813:00 +CPU= 21.202
  02:38:04 STEP 2814 H=2814:00 +CPU= 34.950
  02:38:25 STEP 2815 H=2815:00 +CPU= 21.169
  02:38:47 STEP 2816 H=2816:00 +CPU= 21.977
  02:39:21 STEP 2817 H=2817:00 +CPU= 34.318
  02:39:43 STEP 2818 H=2818:00 +CPU= 21.907
  02:40:04 STEP 2819 H=2819:00 +CPU= 21.274
  02:40:42 STEP 2820 H=2820:00 +CPU= 37.534
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002820
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002820
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002820
  02:41:03 STEP 2821 H=2821:00 +CPU= 21.220
  02:41:25 STEP 2822 H=2822:00 +CPU= 21.879
  02:41:59 STEP 2823 H=2823:00 +CPU= 34.106
  02:42:21 STEP 2824 H=2824:00 +CPU= 21.883
  02:42:42 STEP 2825 H=2825:00 +CPU= 21.179
  02:43:17 STEP 2826 H=2826:00 +CPU= 35.072
  02:43:39 STEP 2827 H=2827:00 +CPU= 21.172
  02:44:00 STEP 2828 H=2828:00 +CPU= 21.763
  02:44:34 STEP 2829 H=2829:00 +CPU= 33.990
  02:44:57 STEP 2830 H=2830:00 +CPU= 21.991
  02:45:19 STEP 2831 H=2831:00 +CPU= 22.047
  02:45:59 STEP 2832 H=2832:00 +CPU= 40.047
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002832
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002832
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002820
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_013n_2019110100_123_993_12214865_0_r1705977416_117.zip
Uploading the intermediate file: upload_file_117.zip
  02:46:21 STEP 2833 H=2833:00 +CPU= 21.248
  02:46:43 STEP 2834 H=2834:00 +CPU= 21.924
  02:47:17 STEP 2835 H=2835:00 +CPU= 34.462
  02:47:39 STEP 2836 H=2836:00 +CPU= 21.910
  02:48:01 STEP 2837 H=2837:00 +CPU= 21.249
  02:48:36 STEP 2838 H=2838:00 +CPU= 35.156
  02:48:57 STEP 2839 H=2839:00 +CPU= 21.292
  02:49:19 STEP 2840 H=2840:00 +CPU= 21.945
  02:49:54 STEP 2841 H=2841:00 +CPU= 34.226
  02:50:15 STEP 2842 H=2842:00 +CPU= 21.895
  02:50:37 STEP 2843 H=2843:00 +CPU= 21.216
  02:51:14 STEP 2844 H=2844:00 +CPU= 37.697
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002844
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002844
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002844
  02:51:36 STEP 2845 H=2845:00 +CPU= 21.260
  02:51:58 STEP 2846 H=2846:00 +CPU= 21.955
  02:52:32 STEP 2847 H=2847:00 +CPU= 34.418
  02:52:54 STEP 2848 H=2848:00 +CPU= 21.941
  02:53:15 STEP 2849 H=2849:00 +CPU= 21.213
  02:53:51 STEP 2850 H=2850:00 +CPU= 35.090
  02:54:12 STEP 2851 H=2851:00 +CPU= 21.186
  02:54:34 STEP 2852 H=2852:00 +CPU= 21.920
  02:55:08 STEP 2853 H=2853:00 +CPU= 34.267
  02:55:30 STEP 2854 H=2854:00 +CPU= 21.900
  02:55:52 STEP 2855 H=2855:00 +CPU= 22.122
  02:56:32 STEP 2856 H=2856:00 +CPU= 39.693
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002856
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002856
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002844
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_013n_2019110100_123_993_12214865_0_r1705977416_118.zip
Uploading the intermediate file: upload_file_118.zip
  02:56:54 STEP 2857 H=2857:00 +CPU= 21.368
  02:57:16 STEP 2858 H=2858:00 +CPU= 22.055
  02:57:51 STEP 2859 H=2859:00 +CPU= 34.265
  02:58:12 STEP 2860 H=2860:00 +CPU= 21.912
  02:58:34 STEP 2861 H=2861:00 +CPU= 21.309
  02:59:09 STEP 2862 H=2862:00 +CPU= 35.061
  02:59:30 STEP 2863 H=2863:00 +CPU= 21.294
  02:59:52 STEP 2864 H=2864:00 +CPU= 21.915
  03:00:27 STEP 2865 H=2865:00 +CPU= 34.376
  03:00:48 STEP 2866 H=2866:00 +CPU= 21.590
  03:01:10 STEP 2867 H=2867:00 +CPU= 21.260
  03:01:47 STEP 2868 H=2868:00 +CPU= 37.407
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002868
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002868
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002868
  03:02:08 STEP 2869 H=2869:00 +CPU= 21.280
  03:02:30 STEP 2870 H=2870:00 +CPU= 21.883
  03:03:05 STEP 2871 H=2871:00 +CPU= 34.118
  03:03:26 STEP 2872 H=2872:00 +CPU= 21.855
  03:03:48 STEP 2873 H=2873:00 +CPU= 21.236
  03:04:23 STEP 2874 H=2874:00 +CPU= 35.073
  03:04:44 STEP 2875 H=2875:00 +CPU= 21.234
  03:05:06 STEP 2876 H=2876:00 +CPU= 21.825
  03:05:40 STEP 2877 H=2877:00 +CPU= 34.384
  03:06:03 STEP 2878 H=2878:00 +CPU= 21.918
  03:06:25 STEP 2879 H=2879:00 +CPU= 22.115
  03:07:05 STEP 2880 H=2880:00 +CPU= 39.661
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002880
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002880
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002868
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_013n_2019110100_123_993_12214865_0_r1705977416_119.zip
Uploading the intermediate file: upload_file_119.zip
  03:07:26 STEP 2881 H=2881:00 +CPU= 21.252
Uploading trickle at timestep: 10368000
  03:07:48 STEP 2882 H=2882:00 +CPU= 21.990
  03:08:23 STEP 2883 H=2883:00 +CPU= 34.467
  03:08:45 STEP 2884 H=2884:00 +CPU= 21.832
  03:09:06 STEP 2885 H=2885:00 +CPU= 21.213
  03:09:41 STEP 2886 H=2886:00 +CPU= 34.869
  03:10:02 STEP 2887 H=2887:00 +CPU= 21.219
  03:10:24 STEP 2888 H=2888:00 +CPU= 21.840
  03:10:58 STEP 2889 H=2889:00 +CPU= 34.278
  03:11:20 STEP 2890 H=2890:00 +CPU= 21.823
  03:11:41 STEP 2891 H=2891:00 +CPU= 21.210
  03:12:19 STEP 2892 H=2892:00 +CPU= 37.218
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002892
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002892
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002892
  03:12:40 STEP 2893 H=2893:00 +CPU= 21.239
  03:13:02 STEP 2894 H=2894:00 +CPU= 21.851
  03:13:36 STEP 2895 H=2895:00 +CPU= 34.233
  03:13:58 STEP 2896 H=2896:00 +CPU= 21.820
  03:14:19 STEP 2897 H=2897:00 +CPU= 21.213
  03:14:54 STEP 2898 H=2898:00 +CPU= 34.879
  03:15:15 STEP 2899 H=2899:00 +CPU= 21.191
  03:15:37 STEP 2900 H=2900:00 +CPU= 21.819
  03:16:12 STEP 2901 H=2901:00 +CPU= 34.350
  03:16:34 STEP 2902 H=2902:00 +CPU= 21.966
  03:16:56 STEP 2903 H=2903:00 +CPU= 22.044
  03:17:36 STEP 2904 H=2904:00 +CPU= 39.574
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002904
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002904
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002892
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_013n_2019110100_123_993_12214865_0_r1705977416_120.zip
Uploading the intermediate file: upload_file_120.zip
  03:17:57 STEP 2905 H=2905:00 +CPU= 21.322
  03:18:19 STEP 2906 H=2906:00 +CPU= 21.879
  03:18:53 STEP 2907 H=2907:00 +CPU= 34.136
  03:19:15 STEP 2908 H=2908:00 +CPU= 21.623
  03:19:36 STEP 2909 H=2909:00 +CPU= 21.186
  03:20:11 STEP 2910 H=2910:00 +CPU= 34.913
  03:20:33 STEP 2911 H=2911:00 +CPU= 21.217
  03:20:54 STEP 2912 H=2912:00 +CPU= 21.851
  03:21:29 STEP 2913 H=2913:00 +CPU= 34.206
  03:21:51 STEP 2914 H=2914:00 +CPU= 21.915
  03:22:12 STEP 2915 H=2915:00 +CPU= 21.270
  03:22:49 STEP 2916 H=2916:00 +CPU= 37.368
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002916
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002916
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002916
  03:23:11 STEP 2917 H=2917:00 +CPU= 21.241
  03:23:33 STEP 2918 H=2918:00 +CPU= 21.879
  03:24:07 STEP 2919 H=2919:00 +CPU= 34.354
  03:24:29 STEP 2920 H=2920:00 +CPU= 21.850
  03:24:50 STEP 2921 H=2921:00 +CPU= 21.254
  03:25:25 STEP 2922 H=2922:00 +CPU= 34.992
  03:25:46 STEP 2923 H=2923:00 +CPU= 21.254
  03:26:08 STEP 2924 H=2924:00 +CPU= 21.814
  03:26:43 STEP 2925 H=2925:00 +CPU= 34.421
  03:27:05 STEP 2926 H=2926:00 +CPU= 21.785
  03:27:27 STEP 2927 H=2927:00 +CPU= 22.279
  03:28:07 STEP 2928 H=2928:00 +CPU= 39.945
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002928
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002928
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002916
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_013n_2019110100_123_993_12214865_0_r1705977416_121.zip
Uploading the intermediate file: upload_file_121.zip
  03:28:29 STEP 2929 H=2929:00 +CPU= 21.424
  03:28:51 STEP 2930 H=2930:00 +CPU= 21.951
  03:29:25 STEP 2931 H=2931:00 +CPU= 34.257
  03:29:47 STEP 2932 H=2932:00 +CPU= 21.843
  03:30:09 STEP 2933 H=2933:00 +CPU= 21.224
  03:30:44 STEP 2934 H=2934:00 +CPU= 34.952
  03:31:05 STEP 2935 H=2935:00 +CPU= 21.279
  03:31:27 STEP 2936 H=2936:00 +CPU= 21.898
  03:32:01 STEP 2937 H=2937:00 +CPU= 34.422
  03:32:23 STEP 2938 H=2938:00 +CPU= 21.731
  03:32:44 STEP 2939 H=2939:00 +CPU= 21.350
  03:33:22 STEP 2940 H=2940:00 +CPU= 37.718
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002940
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002940
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002940
  03:33:43 STEP 2941 H=2941:00 +CPU= 21.261
  03:34:05 STEP 2942 H=2942:00 +CPU= 21.867
  03:34:40 STEP 2943 H=2943:00 +CPU= 34.298
  03:35:01 STEP 2944 H=2944:00 +CPU= 21.784
  03:35:23 STEP 2945 H=2945:00 +CPU= 21.253
  03:35:58 STEP 2946 H=2946:00 +CPU= 35.090
  03:36:19 STEP 2947 H=2947:00 +CPU= 21.195
  03:36:41 STEP 2948 H=2948:00 +CPU= 21.885
  03:37:16 STEP 2949 H=2949:00 +CPU= 34.609
  03:37:37 STEP 2950 H=2950:00 +CPU= 21.353
  03:37:59 STEP 2951 H=2951:00 +CPU= 21.936
  03:38:39 STEP 2952 H=2952:00 +CPU= 38.867
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 STEPO, YGPSDT[clipped](  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  3.19925486346338E-02 -1.00000000000000E+00  1.00000000000000E+00
  MAXGPFV : MAX. VALUE =    1.08256973847747     
  MAXGPFV : MAX. VALUE =   0.766000000000000     
 NSTEP =  2952 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGhnw4+002952 MODE=a
 IO-STREAM CLOSED - ICMGGhnw4+002952
 MPI-TASK:   1 -    322531114 BYTES IN      8 RECORDS TRANSFERRED IN    0.0004 SECONDS806327.8 Mbytes/s, TOTAL TIME=    0.0102( 3.9%)
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302231500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302233000  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302234500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200303000000  !!!!!!!!!!!! 
 03:38:39 STEP 2952 H=2952:00 +CPU= 38.867
 END CNT3
 NSTEP =  2952 CNT0   000000000  34.151  34.151  34.400   0.993               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ          654/    28953814 WRITTEN        46048/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1   1116    0      654        28275    46048 ************   183.8     0.0   183.8     0.9   296.4
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 *********       0.0    100.00   -100.00
   1 CNT4     - FORWARD INTEGRATION                  1 *********       0.0    100.00   -100.00
   8 SCAN2M - GRID-POINT DYNAMICS                 3200    2229.0    2229.0      0.00      0.00
   9 SPCM     - SPECTRAL COMP.                    2952     377.8     377.8      0.00      0.00
  10 SCAN2M - PHYSICS                             2953  -61526.3       0.0    132.64   -132.64
  11 IOPACK   - OUTPUT P.P. RESULTS                247    1125.5    1125.5      0.00      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                126      14.4      14.4      0.00      0.00
  13 SCAN2M - RADIATION CALC.                      985   13158.8   13158.8      0.00      0.00
  14 SUINIF                                          1    1620.3    1620.3      0.00      0.00
  17 GRIDFPOS IN CNT4                              247      43.9      43.9      0.00      0.00
  18 SUSPECG                                         1     291.6     291.6      0.00      0.00
  19 SUSPEC                                          1     299.2     299.2      0.00      0.00
  24 SUGRIDU                                         1     994.2     994.2      0.00      0.00
  25 SPECRT                                          1     166.4     166.4      0.00      0.00
  26 SUGRIDF                                         1     160.4     160.4      0.00      0.00
  27 RESTART FILES - WRITING                       123    2260.0    2260.0      0.00      0.00
  28 RESTART FILES - READING                         1       0.0       0.0      0.00      0.00
  29 SU4FPOS IN CNT4                               247       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                               247    2224.3    2224.3      0.00      0.00
  31 POSDDH IN STEPO                                13       0.7       0.7      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   2953    3309.9    3309.9      0.00      0.00
  38 WAM      - TOTAL COST OF WAVE MODEL          2952    2778.6    2778.6      0.00      0.00
  39 SU0YOMB                                         1     268.9     268.9      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   2953      29.2      29.2      0.00      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             2952     236.5     236.5      0.00      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             2952      57.5      57.5      0.00      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                126       0.2       0.2      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM    10094     148.0     148.0      0.00      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      6152     133.1     133.1      0.00      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       6152      54.4      54.4      0.00      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM     10094      51.2      51.2      0.00      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            2      20.3      20.3      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION          10094      17.9      17.9      0.00      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           6152      15.3      15.3      0.00      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION          10094      17.5      17.5      0.00      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           6152      15.2      15.2      0.00      0.00
 400 GSTATS                                     589499       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                564603       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME  -136982.5 CPU TIME   77534.9 VECTOR TIME    77534.9


===-=== END   OF TIMING STATISTICS ===-===
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002952
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002952
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002952
Adding to the zip: /var/lib/boinc-client/slots/1/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/1/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMUAhnw4+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMSHhnw4+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12214865/ICMGGhnw4+002928
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_013n_2019110100_123_993_12214865_0_r1705977416_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
03:42:01 (17489): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:55:03 1538124 22316251 oifs_43r3_013n_2019110100_123_993_12214865_0 10,623,600 77,535 0.0073
09 May 2023 16:55:03 1538124 22316251 oifs_43r3_013n_2019110100_123_993_12214865_0 10,368,000 75,648 0.0073
09 May 2023 16:55:02 1538124 22316251 oifs_43r3_013n_2019110100_123_993_12214865_0 9,504,000 69,373 0.0073
09 May 2023 16:55:02 1538124 22316251 oifs_43r3_013n_2019110100_123_993_12214865_0 8,640,000 63,072 0.0073
09 May 2023 16:55:01 1538124 22316251 oifs_43r3_013n_2019110100_123_993_12214865_0 7,776,000 56,780 0.0073
09 May 2023 16:55:01 1538124 22316251 oifs_43r3_013n_2019110100_123_993_12214865_0 6,912,000 50,479 0.0073
09 May 2023 16:55:00 1538124 22316251 oifs_43r3_013n_2019110100_123_993_12214865_0 6,048,000 44,184 0.0073
09 May 2023 16:54:59 1538124 22316251 oifs_43r3_013n_2019110100_123_993_12214865_0 5,184,000 37,884 0.0073
09 May 2023 16:54:59 1538124 22316251 oifs_43r3_013n_2019110100_123_993_12214865_0 4,320,000 31,591 0.0073
09 May 2023 16:54:59 1538124 22316251 oifs_43r3_013n_2019110100_123_993_12214865_0 3,456,000 25,289 0.0073
09 May 2023 16:54:58 1538124 22316251 oifs_43r3_013n_2019110100_123_993_12214865_0 2,592,000 18,976 0.0073
09 May 2023 16:54:57 1538124 22316251 oifs_43r3_013n_2019110100_123_993_12214865_0 1,728,000 12,664 0.0073
09 May 2023 16:54:56 1538124 22316251 oifs_43r3_013n_2019110100_123_993_12214865_0 864,000 6,351 0.0074


©2024 climateprediction.net