climateprediction.net home page
Task 22317130

Task 22317130

Name oifs_43r3_01g1_2019110100_123_993_12215311_1
Workunit 12215311
Created 26 Feb 2023, 12:01:50 UTC
Sent 26 Feb 2023, 12:02:01 UTC
Report deadline 27 Apr 2023, 12:02:01 UTC
Received 28 Feb 2023, 2:41:38 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 9 (0x00000009) Unknown error code
Computer ID 1496322
Run time 22 hours 49 min 17 sec
CPU time 22 hours 21 min 28 sec
Validate state Invalid
Credit 14,873.04
Device peak FLOPS 4.34 GFLOPS
Application version OpenIFS 43r3 v1.21
x86_64-pc-linux-gnu
Peak working set size 4,424.61 MB
Peak swap size 4,983.12 MB
Peak disk usage 1,268.90 MB
Stderr
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<message>
process exited with code 9 (0x9, -247)</message>
<stderr_txt>
slots/1/ICMGGhnw4+002376
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002376
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002364
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01g1_2019110100_123_993_12215311_1_r1700035389_98.zip
Uploading the intermediate file: upload_file_98.zip
  23:32:45 STEP 2377 H=2377:00 +CPU= 23.637
  23:33:12 STEP 2378 H=2378:00 +CPU= 26.905
  23:33:50 STEP 2379 H=2379:00 +CPU= 37.526
  23:34:15 STEP 2380 H=2380:00 +CPU= 24.319
  23:34:38 STEP 2381 H=2381:00 +CPU= 23.422
  23:35:16 STEP 2382 H=2382:00 +CPU= 37.503
  23:35:39 STEP 2383 H=2383:00 +CPU= 23.477
  23:36:03 STEP 2384 H=2384:00 +CPU= 24.164
  23:36:40 STEP 2385 H=2385:00 +CPU= 36.623
  23:37:04 STEP 2386 H=2386:00 +CPU= 24.129
  23:37:28 STEP 2387 H=2387:00 +CPU= 23.602
  23:38:08 STEP 2388 H=2388:00 +CPU= 40.064
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002388
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002388
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002388
  23:38:32 STEP 2389 H=2389:00 +CPU= 23.338
  23:38:56 STEP 2390 H=2390:00 +CPU= 24.135
  23:39:33 STEP 2391 H=2391:00 +CPU= 36.701
  23:39:57 STEP 2392 H=2392:00 +CPU= 24.228
  23:40:21 STEP 2393 H=2393:00 +CPU= 23.687
  23:40:59 STEP 2394 H=2394:00 +CPU= 37.629
  23:41:22 STEP 2395 H=2395:00 +CPU= 23.332
  23:41:46 STEP 2396 H=2396:00 +CPU= 24.305
  23:42:23 STEP 2397 H=2397:00 +CPU= 36.960
  23:42:48 STEP 2398 H=2398:00 +CPU= 24.007
  23:43:12 STEP 2399 H=2399:00 +CPU= 24.120
  23:43:55 STEP 2400 H=2400:00 +CPU= 42.668
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002400
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002400
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002388
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002388
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002388
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01g1_2019110100_123_993_12215311_1_r1700035389_99.zip
Uploading the intermediate file: upload_file_99.zip
  23:44:18 STEP 2401 H=2401:00 +CPU= 23.715
Uploading trickle at timestep: 8640000
  23:44:43 STEP 2402 H=2402:00 +CPU= 24.219
  23:45:20 STEP 2403 H=2403:00 +CPU= 36.702
  23:45:44 STEP 2404 H=2404:00 +CPU= 24.166
  23:46:07 STEP 2405 H=2405:00 +CPU= 23.572
  23:46:45 STEP 2406 H=2406:00 +CPU= 37.540
  23:47:09 STEP 2407 H=2407:00 +CPU= 23.368
  23:47:33 STEP 2408 H=2408:00 +CPU= 24.228
  23:48:10 STEP 2409 H=2409:00 +CPU= 37.207
  23:48:34 STEP 2410 H=2410:00 +CPU= 24.118
  23:48:58 STEP 2411 H=2411:00 +CPU= 23.332
  23:49:38 STEP 2412 H=2412:00 +CPU= 40.358
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002412
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002412
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002412
  23:50:02 STEP 2413 H=2413:00 +CPU= 23.519
  23:50:26 STEP 2414 H=2414:00 +CPU= 24.159
  23:51:03 STEP 2415 H=2415:00 +CPU= 36.718
  23:51:27 STEP 2416 H=2416:00 +CPU= 24.189
  23:51:51 STEP 2417 H=2417:00 +CPU= 23.383
  23:52:28 STEP 2418 H=2418:00 +CPU= 37.551
  23:52:52 STEP 2419 H=2419:00 +CPU= 23.500
  23:53:16 STEP 2420 H=2420:00 +CPU= 24.172
  23:53:53 STEP 2421 H=2421:00 +CPU= 36.660
  23:54:17 STEP 2422 H=2422:00 +CPU= 24.270
  23:54:42 STEP 2423 H=2423:00 +CPU= 24.347
  23:55:25 STEP 2424 H=2424:00 +CPU= 42.780
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002424
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002424
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002412
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01g1_2019110100_123_993_12215311_1_r1700035389_100.zip
Uploading the intermediate file: upload_file_100.zip
  23:55:49 STEP 2425 H=2425:00 +CPU= 23.655
  23:56:13 STEP 2426 H=2426:00 +CPU= 24.253
  23:56:50 STEP 2427 H=2427:00 +CPU= 36.873
  23:57:14 STEP 2428 H=2428:00 +CPU= 24.291
  23:57:38 STEP 2429 H=2429:00 +CPU= 23.528
  23:58:16 STEP 2430 H=2430:00 +CPU= 37.512
  23:58:39 STEP 2431 H=2431:00 +CPU= 23.780
  23:59:04 STEP 2432 H=2432:00 +CPU= 24.236
  23:59:41 STEP 2433 H=2433:00 +CPU= 36.850
  00:00:06 STEP 2434 H=2434:00 +CPU= 24.493
  00:00:29 STEP 2435 H=2435:00 +CPU= 23.582
  00:01:10 STEP 2436 H=2436:00 +CPU= 40.203
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=           20  MAX ETADOT VERTICAL VEL.=   8.574762805948578E-008
  LON  =    160.000000000000       degrees
  LAT  =    36.4483927977945       degrees
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002436
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002436
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002436
  00:01:33 STEP 2437 H=2437:00 +CPU= 23.406
  00:01:57 STEP 2438 H=2438:00 +CPU= 24.241
  00:02:35 STEP 2439 H=2439:00 +CPU= 37.124
  00:02:59 STEP 2440 H=2440:00 +CPU= 24.067
  00:03:22 STEP 2441 H=2441:00 +CPU= 23.402
  00:04:00 STEP 2442 H=2442:00 +CPU= 37.616
  00:04:24 STEP 2443 H=2443:00 +CPU= 23.637
  00:04:48 STEP 2444 H=2444:00 +CPU= 24.154
  00:05:25 STEP 2445 H=2445:00 +CPU= 36.796
  00:05:49 STEP 2446 H=2446:00 +CPU= 24.411
  00:06:14 STEP 2447 H=2447:00 +CPU= 24.356
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=           25  MAX ETADOT VERTICAL VEL.=   1.554946929737471E-006
  LON  =    166.250000000000       degrees
  LAT  =    40.9343383242788       degrees
  00:06:56 STEP 2448 H=2448:00 +CPU= 42.305
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002448
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002448
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002436
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01g1_2019110100_123_993_12215311_1_r1700035389_101.zip
Uploading the intermediate file: upload_file_101.zip
  00:07:20 STEP 2449 H=2449:00 +CPU= 23.805
  00:07:45 STEP 2450 H=2450:00 +CPU= 24.449
  00:08:22 STEP 2451 H=2451:00 +CPU= 37.145
  00:08:46 STEP 2452 H=2452:00 +CPU= 24.199
  00:09:10 STEP 2453 H=2453:00 +CPU= 23.404
  00:09:48 STEP 2454 H=2454:00 +CPU= 37.848
  00:10:11 STEP 2455 H=2455:00 +CPU= 23.534
  00:10:36 STEP 2456 H=2456:00 +CPU= 24.139
  00:11:13 STEP 2457 H=2457:00 +CPU= 37.034
  00:11:37 STEP 2458 H=2458:00 +CPU= 24.346
  00:12:01 STEP 2459 H=2459:00 +CPU= 23.609
  00:12:41 STEP 2460 H=2460:00 +CPU= 39.836
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002460
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002460
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002460
  00:13:05 STEP 2461 H=2461:00 +CPU= 23.558
  00:13:30 STEP 2462 H=2462:00 +CPU= 24.817
  00:14:11 STEP 2463 H=2463:00 +CPU= 40.730
  00:14:35 STEP 2464 H=2464:00 +CPU= 24.355
  00:14:59 STEP 2465 H=2465:00 +CPU= 23.538
  00:15:37 STEP 2466 H=2466:00 +CPU= 37.713
  00:16:00 STEP 2467 H=2467:00 +CPU= 23.470
  00:16:26 STEP 2468 H=2468:00 +CPU= 25.874
  00:17:05 STEP 2469 H=2469:00 +CPU= 38.453
  00:17:29 STEP 2470 H=2470:00 +CPU= 24.408
  00:17:54 STEP 2471 H=2471:00 +CPU= 24.130
  00:18:36 STEP 2472 H=2472:00 +CPU= 42.507
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002472
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002472
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002460
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01g1_2019110100_123_993_12215311_1_r1700035389_102.zip
Uploading the intermediate file: upload_file_102.zip
  00:19:00 STEP 2473 H=2473:00 +CPU= 23.758
  00:19:25 STEP 2474 H=2474:00 +CPU= 24.381
  00:20:01 STEP 2475 H=2475:00 +CPU= 36.499
  00:20:26 STEP 2476 H=2476:00 +CPU= 24.272
  00:20:49 STEP 2477 H=2477:00 +CPU= 23.480
  00:21:27 STEP 2478 H=2478:00 +CPU= 37.496
  00:21:50 STEP 2479 H=2479:00 +CPU= 23.597
  00:22:15 STEP 2480 H=2480:00 +CPU= 24.283
  00:22:52 STEP 2481 H=2481:00 +CPU= 36.921
  00:23:16 STEP 2482 H=2482:00 +CPU= 24.214
  00:23:40 STEP 2483 H=2483:00 +CPU= 23.584
  00:24:20 STEP 2484 H=2484:00 +CPU= 40.478
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002484
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002484
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002484
  00:24:44 STEP 2485 H=2485:00 +CPU= 23.418
  00:25:08 STEP 2486 H=2486:00 +CPU= 24.068
  00:25:45 STEP 2487 H=2487:00 +CPU= 36.940
  00:26:09 STEP 2488 H=2488:00 +CPU= 24.194
  00:26:33 STEP 2489 H=2489:00 +CPU= 23.509
  00:27:11 STEP 2490 H=2490:00 +CPU= 37.599
  00:27:34 STEP 2491 H=2491:00 +CPU= 23.461
  00:27:58 STEP 2492 H=2492:00 +CPU= 24.214
  00:28:35 STEP 2493 H=2493:00 +CPU= 36.751
  00:29:00 STEP 2494 H=2494:00 +CPU= 24.244
  00:29:24 STEP 2495 H=2495:00 +CPU= 24.298
  00:30:07 STEP 2496 H=2496:00 +CPU= 42.545
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002496
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002496
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002484
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01g1_2019110100_123_993_12215311_1_r1700035389_103.zip
Uploading the intermediate file: upload_file_103.zip
  00:30:31 STEP 2497 H=2497:00 +CPU= 23.746
  00:30:55 STEP 2498 H=2498:00 +CPU= 24.272
  00:31:32 STEP 2499 H=2499:00 +CPU= 36.761
  00:31:56 STEP 2500 H=2500:00 +CPU= 24.129
  00:32:20 STEP 2501 H=2501:00 +CPU= 23.408
  00:32:57 STEP 2502 H=2502:00 +CPU= 37.535
  00:33:21 STEP 2503 H=2503:00 +CPU= 23.670
  00:33:45 STEP 2504 H=2504:00 +CPU= 24.093
  00:34:22 STEP 2505 H=2505:00 +CPU= 36.787
  00:34:46 STEP 2506 H=2506:00 +CPU= 24.196
  00:35:10 STEP 2507 H=2507:00 +CPU= 23.605
  00:35:50 STEP 2508 H=2508:00 +CPU= 40.032
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002508
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002508
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002508
  00:36:14 STEP 2509 H=2509:00 +CPU= 23.524
  00:36:38 STEP 2510 H=2510:00 +CPU= 24.348
  00:37:15 STEP 2511 H=2511:00 +CPU= 36.957
  00:37:40 STEP 2512 H=2512:00 +CPU= 24.376
  00:38:03 STEP 2513 H=2513:00 +CPU= 23.490
  00:38:41 STEP 2514 H=2514:00 +CPU= 37.535
  00:39:05 STEP 2515 H=2515:00 +CPU= 23.443
  00:39:29 STEP 2516 H=2516:00 +CPU= 24.039
  00:40:06 STEP 2517 H=2517:00 +CPU= 36.900
  00:40:30 STEP 2518 H=2518:00 +CPU= 24.035
  00:40:54 STEP 2519 H=2519:00 +CPU= 24.205
  00:41:37 STEP 2520 H=2520:00 +CPU= 42.523
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002520
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002520
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002508
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01g1_2019110100_123_993_12215311_1_r1700035389_104.zip
Uploading the intermediate file: upload_file_104.zip
  00:42:01 STEP 2521 H=2521:00 +CPU= 23.701
  00:42:25 STEP 2522 H=2522:00 +CPU= 24.142
  00:43:02 STEP 2523 H=2523:00 +CPU= 36.664
  00:43:26 STEP 2524 H=2524:00 +CPU= 24.071
  00:43:49 STEP 2525 H=2525:00 +CPU= 23.313
  00:44:27 STEP 2526 H=2526:00 +CPU= 37.476
  00:44:51 STEP 2527 H=2527:00 +CPU= 23.548
  00:45:15 STEP 2528 H=2528:00 +CPU= 24.176
  00:45:52 STEP 2529 H=2529:00 +CPU= 37.012
  00:46:16 STEP 2530 H=2530:00 +CPU= 24.185
  00:46:40 STEP 2531 H=2531:00 +CPU= 23.503
  00:47:20 STEP 2532 H=2532:00 +CPU= 40.129
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002532
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002532
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002532
  00:47:44 STEP 2533 H=2533:00 +CPU= 23.549
  00:48:08 STEP 2534 H=2534:00 +CPU= 23.909
  00:48:45 STEP 2535 H=2535:00 +CPU= 36.729
  00:49:09 STEP 2536 H=2536:00 +CPU= 24.200
  00:49:33 STEP 2537 H=2537:00 +CPU= 23.533
  00:50:10 STEP 2538 H=2538:00 +CPU= 37.387
  00:50:33 STEP 2539 H=2539:00 +CPU= 23.341
  00:50:58 STEP 2540 H=2540:00 +CPU= 24.098
  00:51:34 STEP 2541 H=2541:00 +CPU= 36.685
  00:51:59 STEP 2542 H=2542:00 +CPU= 24.089
  00:52:23 STEP 2543 H=2543:00 +CPU= 24.323
  00:53:06 STEP 2544 H=2544:00 +CPU= 42.553
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002544
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002544
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002532
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01g1_2019110100_123_993_12215311_1_r1700035389_105.zip
Uploading the intermediate file: upload_file_105.zip
  00:53:29 STEP 2545 H=2545:00 +CPU= 23.627
  00:53:54 STEP 2546 H=2546:00 +CPU= 24.246
  00:54:31 STEP 2547 H=2547:00 +CPU= 36.947
  00:54:55 STEP 2548 H=2548:00 +CPU= 24.152
  00:55:19 STEP 2549 H=2549:00 +CPU= 23.372
  00:55:56 STEP 2550 H=2550:00 +CPU= 37.466
  00:56:20 STEP 2551 H=2551:00 +CPU= 23.625
  00:56:44 STEP 2552 H=2552:00 +CPU= 24.186
  00:57:21 STEP 2553 H=2553:00 +CPU= 36.562
  00:57:45 STEP 2554 H=2554:00 +CPU= 24.078
  00:58:08 STEP 2555 H=2555:00 +CPU= 23.351
  00:58:49 STEP 2556 H=2556:00 +CPU= 40.024
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002556
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002556
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002556
  00:59:12 STEP 2557 H=2557:00 +CPU= 23.474
  00:59:38 STEP 2558 H=2558:00 +CPU= 25.792
  01:00:16 STEP 2559 H=2559:00 +CPU= 38.078
  01:00:42 STEP 2560 H=2560:00 +CPU= 25.418
  01:01:05 STEP 2561 H=2561:00 +CPU= 23.514
  01:01:43 STEP 2562 H=2562:00 +CPU= 37.497
  01:02:07 STEP 2563 H=2563:00 +CPU= 23.412
  01:02:31 STEP 2564 H=2564:00 +CPU= 24.108
  01:03:08 STEP 2565 H=2565:00 +CPU= 36.909
  01:03:32 STEP 2566 H=2566:00 +CPU= 24.028
  01:03:56 STEP 2567 H=2567:00 +CPU= 24.177
  01:04:39 STEP 2568 H=2568:00 +CPU= 42.318
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002568
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002568
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002556
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01g1_2019110100_123_993_12215311_1_r1700035389_106.zip
Uploading the intermediate file: upload_file_106.zip
  01:05:02 STEP 2569 H=2569:00 +CPU= 23.563
  01:05:27 STEP 2570 H=2570:00 +CPU= 24.221
  01:06:04 STEP 2571 H=2571:00 +CPU= 37.011
  01:06:28 STEP 2572 H=2572:00 +CPU= 24.109
  01:06:52 STEP 2573 H=2573:00 +CPU= 23.320
  01:07:29 STEP 2574 H=2574:00 +CPU= 37.684
  01:07:53 STEP 2575 H=2575:00 +CPU= 23.483
  01:08:17 STEP 2576 H=2576:00 +CPU= 24.265
  01:08:54 STEP 2577 H=2577:00 +CPU= 36.696
  01:09:18 STEP 2578 H=2578:00 +CPU= 24.170
  01:09:42 STEP 2579 H=2579:00 +CPU= 23.524
  01:10:22 STEP 2580 H=2580:00 +CPU= 40.330
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002580
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002580
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002580
  01:10:46 STEP 2581 H=2581:00 +CPU= 23.371
  01:11:10 STEP 2582 H=2582:00 +CPU= 24.210
  01:11:47 STEP 2583 H=2583:00 +CPU= 36.786
  01:12:11 STEP 2584 H=2584:00 +CPU= 24.107
  01:12:35 STEP 2585 H=2585:00 +CPU= 23.321
  01:13:12 STEP 2586 H=2586:00 +CPU= 37.533
  01:13:36 STEP 2587 H=2587:00 +CPU= 23.334
  01:14:00 STEP 2588 H=2588:00 +CPU= 24.152
  01:14:37 STEP 2589 H=2589:00 +CPU= 36.744
  01:15:01 STEP 2590 H=2590:00 +CPU= 24.036
  01:15:25 STEP 2591 H=2591:00 +CPU= 24.391
  01:16:08 STEP 2592 H=2592:00 +CPU= 42.085
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002592
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002592
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002580
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01g1_2019110100_123_993_12215311_1_r1700035389_107.zip
Uploading the intermediate file: upload_file_107.zip
  01:16:32 STEP 2593 H=2593:00 +CPU= 23.705
  01:16:56 STEP 2594 H=2594:00 +CPU= 24.204
  01:17:33 STEP 2595 H=2595:00 +CPU= 36.799
  01:17:57 STEP 2596 H=2596:00 +CPU= 24.168
  01:18:20 STEP 2597 H=2597:00 +CPU= 23.444
  01:18:58 STEP 2598 H=2598:00 +CPU= 37.600
  01:19:22 STEP 2599 H=2599:00 +CPU= 23.447
  01:19:46 STEP 2600 H=2600:00 +CPU= 24.001
  01:20:23 STEP 2601 H=2601:00 +CPU= 36.794
  01:20:47 STEP 2602 H=2602:00 +CPU= 24.297
  01:21:11 STEP 2603 H=2603:00 +CPU= 23.476
  01:21:51 STEP 2604 H=2604:00 +CPU= 40.200
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002604
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002604
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002604
  01:22:14 STEP 2605 H=2605:00 +CPU= 23.400
  01:22:39 STEP 2606 H=2606:00 +CPU= 24.082
  01:23:15 STEP 2607 H=2607:00 +CPU= 36.660
  01:23:40 STEP 2608 H=2608:00 +CPU= 24.130
  01:24:03 STEP 2609 H=2609:00 +CPU= 23.489
  01:24:41 STEP 2610 H=2610:00 +CPU= 37.367
  01:25:04 STEP 2611 H=2611:00 +CPU= 23.493
  01:25:29 STEP 2612 H=2612:00 +CPU= 24.220
  01:26:05 STEP 2613 H=2613:00 +CPU= 36.758
  01:26:29 STEP 2614 H=2614:00 +CPU= 23.889
  01:26:54 STEP 2615 H=2615:00 +CPU= 24.209
  01:27:36 STEP 2616 H=2616:00 +CPU= 42.575
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002616
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002616
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002604
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01g1_2019110100_123_993_12215311_1_r1700035389_108.zip
Uploading the intermediate file: upload_file_108.zip
  01:28:00 STEP 2617 H=2617:00 +CPU= 23.674
  01:28:24 STEP 2618 H=2618:00 +CPU= 24.152
  01:29:01 STEP 2619 H=2619:00 +CPU= 36.834
  01:29:25 STEP 2620 H=2620:00 +CPU= 24.038
  01:29:49 STEP 2621 H=2621:00 +CPU= 23.368
  01:30:27 STEP 2622 H=2622:00 +CPU= 37.549
  01:30:50 STEP 2623 H=2623:00 +CPU= 23.529
  01:31:15 STEP 2624 H=2624:00 +CPU= 24.251
  01:31:51 STEP 2625 H=2625:00 +CPU= 36.704
  01:32:16 STEP 2626 H=2626:00 +CPU= 24.191
  01:32:39 STEP 2627 H=2627:00 +CPU= 23.523
  01:33:19 STEP 2628 H=2628:00 +CPU= 40.139
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002628
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002628
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002628
  01:33:43 STEP 2629 H=2629:00 +CPU= 23.319
  01:34:07 STEP 2630 H=2630:00 +CPU= 24.189
  01:34:44 STEP 2631 H=2631:00 +CPU= 36.983
  01:35:08 STEP 2632 H=2632:00 +CPU= 24.090
  01:35:32 STEP 2633 H=2633:00 +CPU= 23.316
  01:36:10 STEP 2634 H=2634:00 +CPU= 37.640
  01:36:33 STEP 2635 H=2635:00 +CPU= 23.502
  01:36:58 STEP 2636 H=2636:00 +CPU= 24.307
  01:37:35 STEP 2637 H=2637:00 +CPU= 36.850
  01:37:59 STEP 2638 H=2638:00 +CPU= 24.039
  01:38:23 STEP 2639 H=2639:00 +CPU= 24.294
  01:39:06 STEP 2640 H=2640:00 +CPU= 42.424
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002640
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002640
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002628
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01g1_2019110100_123_993_12215311_1_r1700035389_109.zip
Uploading the intermediate file: upload_file_109.zip
  01:39:29 STEP 2641 H=2641:00 +CPU= 23.631
Uploading trickle at timestep: 9504000
  01:39:54 STEP 2642 H=2642:00 +CPU= 24.390
  01:40:31 STEP 2643 H=2643:00 +CPU= 36.800
  01:40:55 STEP 2644 H=2644:00 +CPU= 24.001
  01:41:18 STEP 2645 H=2645:00 +CPU= 23.437
  01:41:56 STEP 2646 H=2646:00 +CPU= 37.741
  01:42:20 STEP 2647 H=2647:00 +CPU= 23.461
  01:42:44 STEP 2648 H=2648:00 +CPU= 24.304
  01:43:24 STEP 2649 H=2649:00 +CPU= 39.647
  01:43:48 STEP 2650 H=2650:00 +CPU= 24.367
  01:44:12 STEP 2651 H=2651:00 +CPU= 23.540
  01:44:52 STEP 2652 H=2652:00 +CPU= 40.103
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002652
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002652
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002652
  01:45:16 STEP 2653 H=2653:00 +CPU= 23.436
  01:45:40 STEP 2654 H=2654:00 +CPU= 24.252
  01:46:17 STEP 2655 H=2655:00 +CPU= 36.740
  01:46:41 STEP 2656 H=2656:00 +CPU= 24.211
  01:47:05 STEP 2657 H=2657:00 +CPU= 23.556
  01:47:42 STEP 2658 H=2658:00 +CPU= 37.428
  01:48:06 STEP 2659 H=2659:00 +CPU= 23.706
  01:48:30 STEP 2660 H=2660:00 +CPU= 24.038
  01:49:07 STEP 2661 H=2661:00 +CPU= 36.655
  01:49:31 STEP 2662 H=2662:00 +CPU= 24.099
  01:49:56 STEP 2663 H=2663:00 +CPU= 24.192
  01:50:39 STEP 2664 H=2664:00 +CPU= 42.757
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002664
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002664
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002652
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01g1_2019110100_123_993_12215311_1_r1700035389_110.zip
Uploading the intermediate file: upload_file_110.zip
  01:51:02 STEP 2665 H=2665:00 +CPU= 23.793
  01:51:27 STEP 2666 H=2666:00 +CPU= 24.013
  01:52:03 STEP 2667 H=2667:00 +CPU= 36.667
  01:52:27 STEP 2668 H=2668:00 +CPU= 24.019
  01:52:51 STEP 2669 H=2669:00 +CPU= 23.449
  01:53:29 STEP 2670 H=2670:00 +CPU= 37.606
  01:53:52 STEP 2671 H=2671:00 +CPU= 23.306
  01:54:16 STEP 2672 H=2672:00 +CPU= 24.174
  01:54:53 STEP 2673 H=2673:00 +CPU= 36.574
  01:55:17 STEP 2674 H=2674:00 +CPU= 24.238
  01:55:41 STEP 2675 H=2675:00 +CPU= 23.642
  01:56:21 STEP 2676 H=2676:00 +CPU= 39.948
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002676
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002676
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002676
  01:56:45 STEP 2677 H=2677:00 +CPU= 23.517
  01:57:09 STEP 2678 H=2678:00 +CPU= 24.091
  01:57:46 STEP 2679 H=2679:00 +CPU= 36.889
  01:58:10 STEP 2680 H=2680:00 +CPU= 24.068
  01:58:34 STEP 2681 H=2681:00 +CPU= 23.478
  01:59:12 STEP 2682 H=2682:00 +CPU= 37.831
  01:59:35 STEP 2683 H=2683:00 +CPU= 23.268
  01:59:59 STEP 2684 H=2684:00 +CPU= 23.966
  02:00:36 STEP 2685 H=2685:00 +CPU= 36.931
  02:01:00 STEP 2686 H=2686:00 +CPU= 24.074
  02:01:24 STEP 2687 H=2687:00 +CPU= 24.160
  02:02:07 STEP 2688 H=2688:00 +CPU= 42.281
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002688
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002688
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002676
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01g1_2019110100_123_993_12215311_1_r1700035389_111.zip
Uploading the intermediate file: upload_file_111.zip
  02:02:31 STEP 2689 H=2689:00 +CPU= 23.843
  02:02:55 STEP 2690 H=2690:00 +CPU= 24.315
  02:03:32 STEP 2691 H=2691:00 +CPU= 36.708
  02:03:56 STEP 2692 H=2692:00 +CPU= 24.027
  02:04:20 STEP 2693 H=2693:00 +CPU= 23.548
  02:04:58 STEP 2694 H=2694:00 +CPU= 37.601
  02:05:21 STEP 2695 H=2695:00 +CPU= 23.570
  02:05:46 STEP 2696 H=2696:00 +CPU= 24.284
  02:06:23 STEP 2697 H=2697:00 +CPU= 36.872
  02:06:47 STEP 2698 H=2698:00 +CPU= 24.028
  02:07:10 STEP 2699 H=2699:00 +CPU= 23.438
  02:07:50 STEP 2700 H=2700:00 +CPU= 39.966
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002700
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002700
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002700
  02:08:14 STEP 2701 H=2701:00 +CPU= 23.673
  02:08:38 STEP 2702 H=2702:00 +CPU= 24.152
  02:09:15 STEP 2703 H=2703:00 +CPU= 36.813
  02:09:40 STEP 2704 H=2704:00 +CPU= 24.311
  02:10:03 STEP 2705 H=2705:00 +CPU= 23.370
  02:10:41 STEP 2706 H=2706:00 +CPU= 37.703
  02:11:04 STEP 2707 H=2707:00 +CPU= 23.428
  02:11:29 STEP 2708 H=2708:00 +CPU= 24.140
  02:12:06 STEP 2709 H=2709:00 +CPU= 36.722
  02:12:30 STEP 2710 H=2710:00 +CPU= 24.320
  02:12:54 STEP 2711 H=2711:00 +CPU= 24.225
  02:13:37 STEP 2712 H=2712:00 +CPU= 42.531
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002712
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002712
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002700
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01g1_2019110100_123_993_12215311_1_r1700035389_112.zip
Uploading the intermediate file: upload_file_112.zip
  02:14:01 STEP 2713 H=2713:00 +CPU= 23.591
  02:14:25 STEP 2714 H=2714:00 +CPU= 24.302
  02:15:02 STEP 2715 H=2715:00 +CPU= 37.080
  02:15:26 STEP 2716 H=2716:00 +CPU= 23.948
  02:15:50 STEP 2717 H=2717:00 +CPU= 23.345
  02:16:27 STEP 2718 H=2718:00 +CPU= 37.481
  02:16:51 STEP 2719 H=2719:00 +CPU= 23.540
  02:17:15 STEP 2720 H=2720:00 +CPU= 24.036
  02:17:52 STEP 2721 H=2721:00 +CPU= 36.665
  02:18:16 STEP 2722 H=2722:00 +CPU= 24.027
  02:18:39 STEP 2723 H=2723:00 +CPU= 23.441
  02:19:19 STEP 2724 H=2724:00 +CPU= 39.880
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002724
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002724
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002724
  02:19:43 STEP 2725 H=2725:00 +CPU= 23.387
  02:20:07 STEP 2726 H=2726:00 +CPU= 24.191
  02:20:44 STEP 2727 H=2727:00 +CPU= 36.786
  02:21:08 STEP 2728 H=2728:00 +CPU= 24.208
  02:21:32 STEP 2729 H=2729:00 +CPU= 23.577
  02:22:10 STEP 2730 H=2730:00 +CPU= 37.662
  02:22:33 STEP 2731 H=2731:00 +CPU= 23.279
  02:22:57 STEP 2732 H=2732:00 +CPU= 24.100
  02:23:34 STEP 2733 H=2733:00 +CPU= 37.032
  02:23:59 STEP 2734 H=2734:00 +CPU= 24.095
  02:24:23 STEP 2735 H=2735:00 +CPU= 24.004
  02:25:05 STEP 2736 H=2736:00 +CPU= 42.202
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002736
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002736
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002724
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01g1_2019110100_123_993_12215311_1_r1700035389_113.zip
Uploading the intermediate file: upload_file_113.zip
  02:25:29 STEP 2737 H=2737:00 +CPU= 23.703
  02:25:53 STEP 2738 H=2738:00 +CPU= 24.387
  02:26:31 STEP 2739 H=2739:00 +CPU= 37.571
  02:26:58 STEP 2740 H=2740:00 +CPU= 26.471
  02:27:21 STEP 2741 H=2741:00 +CPU= 23.763
  02:27:59 STEP 2742 H=2742:00 +CPU= 37.647
  02:28:23 STEP 2743 H=2743:00 +CPU= 23.639
  02:28:47 STEP 2744 H=2744:00 +CPU= 24.176
  02:29:24 STEP 2745 H=2745:00 +CPU= 36.597
  02:29:48 STEP 2746 H=2746:00 +CPU= 24.127
  02:30:12 STEP 2747 H=2747:00 +CPU= 23.471
  02:30:52 STEP 2748 H=2748:00 +CPU= 40.365
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002748
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002748
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002748
  02:31:16 STEP 2749 H=2749:00 +CPU= 23.369
  02:31:40 STEP 2750 H=2750:00 +CPU= 24.006
  02:32:17 STEP 2751 H=2751:00 +CPU= 37.030
  02:32:41 STEP 2752 H=2752:00 +CPU= 24.082
  02:33:04 STEP 2753 H=2753:00 +CPU= 23.343
  02:33:42 STEP 2754 H=2754:00 +CPU= 37.618
  02:34:06 STEP 2755 H=2755:00 +CPU= 23.471
  02:34:30 STEP 2756 H=2756:00 +CPU= 24.107
  02:35:07 STEP 2757 H=2757:00 +CPU= 36.539
  02:35:31 STEP 2758 H=2758:00 +CPU= 24.142
  02:35:55 STEP 2759 H=2759:00 +CPU= 24.176
  02:36:38 STEP 2760 H=2760:00 +CPU= 42.429
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002760
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002760
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002748
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01g1_2019110100_123_993_12215311_1_r1700035389_114.zip
Uploading the intermediate file: upload_file_114.zip
  02:37:01 STEP 2761 H=2761:00 +CPU= 23.700
  02:37:26 STEP 2762 H=2762:00 +CPU= 24.202
  02:38:02 STEP 2763 H=2763:00 +CPU= 36.688
  02:38:27 STEP 2764 H=2764:00 +CPU= 24.021
  02:38:50 STEP 2765 H=2765:00 +CPU= 23.331
  02:39:28 STEP 2766 H=2766:00 +CPU= 37.695
  02:39:51 STEP 2767 H=2767:00 +CPU= 23.405
  02:40:15 STEP 2768 H=2768:00 +CPU= 24.063
  02:40:52 STEP 2769 H=2769:00 +CPU= 36.775
  02:41:17 STEP 2770 H=2770:00 +CPU= 24.123
  02:41:40 STEP 2771 H=2771:00 +CPU= 23.536
  02:42:20 STEP 2772 H=2772:00 +CPU= 39.942
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002772
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002772
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002772
  02:42:44 STEP 2773 H=2773:00 +CPU= 23.320
  02:43:08 STEP 2774 H=2774:00 +CPU= 24.156
  02:43:45 STEP 2775 H=2775:00 +CPU= 36.621
  02:44:09 STEP 2776 H=2776:00 +CPU= 24.223
  02:44:33 STEP 2777 H=2777:00 +CPU= 23.497
  02:45:10 STEP 2778 H=2778:00 +CPU= 37.333
  02:45:34 STEP 2779 H=2779:00 +CPU= 23.520
  02:45:58 STEP 2780 H=2780:00 +CPU= 24.258
  02:46:35 STEP 2781 H=2781:00 +CPU= 36.721
  02:46:59 STEP 2782 H=2782:00 +CPU= 24.104
  02:47:23 STEP 2783 H=2783:00 +CPU= 24.041
  02:48:06 STEP 2784 H=2784:00 +CPU= 42.379
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002784
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002784
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002772
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01g1_2019110100_123_993_12215311_1_r1700035389_115.zip
Uploading the intermediate file: upload_file_115.zip
  02:48:29 STEP 2785 H=2785:00 +CPU= 23.532
  02:48:53 STEP 2786 H=2786:00 +CPU= 24.170
  02:49:30 STEP 2787 H=2787:00 +CPU= 36.593
  02:49:54 STEP 2788 H=2788:00 +CPU= 24.107
  02:50:18 STEP 2789 H=2789:00 +CPU= 23.236
  02:50:55 STEP 2790 H=2790:00 +CPU= 37.433
  02:51:19 STEP 2791 H=2791:00 +CPU= 23.387
  02:51:43 STEP 2792 H=2792:00 +CPU= 24.114
  02:52:20 STEP 2793 H=2793:00 +CPU= 36.684
  02:52:44 STEP 2794 H=2794:00 +CPU= 24.222
  02:53:08 STEP 2795 H=2795:00 +CPU= 23.549
  02:53:48 STEP 2796 H=2796:00 +CPU= 39.791
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002796
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002796
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002796
  02:54:11 STEP 2797 H=2797:00 +CPU= 23.471
  02:54:35 STEP 2798 H=2798:00 +CPU= 24.256
  02:55:12 STEP 2799 H=2799:00 +CPU= 36.708
  02:55:36 STEP 2800 H=2800:00 +CPU= 24.037
  02:56:00 STEP 2801 H=2801:00 +CPU= 23.406
  02:56:38 STEP 2802 H=2802:00 +CPU= 37.749
  02:57:01 STEP 2803 H=2803:00 +CPU= 23.365
  02:57:25 STEP 2804 H=2804:00 +CPU= 24.011
  02:58:02 STEP 2805 H=2805:00 +CPU= 36.648
  02:58:26 STEP 2806 H=2806:00 +CPU= 24.327
  02:58:51 STEP 2807 H=2807:00 +CPU= 24.032
  02:59:33 STEP 2808 H=2808:00 +CPU= 42.364
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002808
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002808
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002796
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01g1_2019110100_123_993_12215311_1_r1700035389_116.zip
Uploading the intermediate file: upload_file_116.zip
  02:59:57 STEP 2809 H=2809:00 +CPU= 23.727
  03:00:21 STEP 2810 H=2810:00 +CPU= 24.136
  03:00:58 STEP 2811 H=2811:00 +CPU= 36.690
  03:01:22 STEP 2812 H=2812:00 +CPU= 24.324
  03:01:46 STEP 2813 H=2813:00 +CPU= 23.567
  03:02:24 STEP 2814 H=2814:00 +CPU= 37.416
  03:02:47 STEP 2815 H=2815:00 +CPU= 23.386
  03:03:11 STEP 2816 H=2816:00 +CPU= 24.162
  03:03:48 STEP 2817 H=2817:00 +CPU= 36.796
  03:04:12 STEP 2818 H=2818:00 +CPU= 23.934
  03:04:36 STEP 2819 H=2819:00 +CPU= 23.438
  03:05:16 STEP 2820 H=2820:00 +CPU= 40.109
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002820
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002820
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002820
  03:05:40 STEP 2821 H=2821:00 +CPU= 23.450
  03:06:04 STEP 2822 H=2822:00 +CPU= 24.049
  03:06:40 STEP 2823 H=2823:00 +CPU= 36.492
  03:07:04 STEP 2824 H=2824:00 +CPU= 24.042
  03:07:28 STEP 2825 H=2825:00 +CPU= 23.360
  03:08:05 STEP 2826 H=2826:00 +CPU= 37.238
  03:08:29 STEP 2827 H=2827:00 +CPU= 23.503
  03:08:53 STEP 2828 H=2828:00 +CPU= 23.976
  03:09:30 STEP 2829 H=2829:00 +CPU= 36.721
  03:09:56 STEP 2830 H=2830:00 +CPU= 26.545
  03:10:21 STEP 2831 H=2831:00 +CPU= 24.640
  03:11:04 STEP 2832 H=2832:00 +CPU= 42.803
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002832
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002832
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002820
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01g1_2019110100_123_993_12215311_1_r1700035389_117.zip
Uploading the intermediate file: upload_file_117.zip
  03:11:28 STEP 2833 H=2833:00 +CPU= 23.828
  03:11:52 STEP 2834 H=2834:00 +CPU= 24.302
  03:12:29 STEP 2835 H=2835:00 +CPU= 36.632
  03:12:53 STEP 2836 H=2836:00 +CPU= 24.136
  03:13:17 STEP 2837 H=2837:00 +CPU= 23.277
  03:13:54 STEP 2838 H=2838:00 +CPU= 37.531
  03:14:18 STEP 2839 H=2839:00 +CPU= 23.499
  03:14:42 STEP 2840 H=2840:00 +CPU= 24.037
  03:15:19 STEP 2841 H=2841:00 +CPU= 36.520
  03:15:43 STEP 2842 H=2842:00 +CPU= 24.115
  03:16:06 STEP 2843 H=2843:00 +CPU= 23.383
  03:16:46 STEP 2844 H=2844:00 +CPU= 39.834
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002844
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002844
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002844
  03:17:10 STEP 2845 H=2845:00 +CPU= 23.336
  03:17:34 STEP 2846 H=2846:00 +CPU= 24.051
  03:18:11 STEP 2847 H=2847:00 +CPU= 36.602
  03:18:35 STEP 2848 H=2848:00 +CPU= 24.138
  03:18:58 STEP 2849 H=2849:00 +CPU= 23.401
  03:19:36 STEP 2850 H=2850:00 +CPU= 37.305
  03:19:59 STEP 2851 H=2851:00 +CPU= 23.400
  03:20:23 STEP 2852 H=2852:00 +CPU= 24.182
  03:21:00 STEP 2853 H=2853:00 +CPU= 36.611
  03:21:24 STEP 2854 H=2854:00 +CPU= 24.099
  03:21:49 STEP 2855 H=2855:00 +CPU= 24.255
  03:22:31 STEP 2856 H=2856:00 +CPU= 42.407
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002856
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002856
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002844
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01g1_2019110100_123_993_12215311_1_r1700035389_118.zip
Uploading the intermediate file: upload_file_118.zip
  03:22:55 STEP 2857 H=2857:00 +CPU= 23.660
  03:23:19 STEP 2858 H=2858:00 +CPU= 24.167
  03:23:56 STEP 2859 H=2859:00 +CPU= 36.432
  03:24:20 STEP 2860 H=2860:00 +CPU= 24.016
  03:24:44 STEP 2861 H=2861:00 +CPU= 23.551
  03:25:21 STEP 2862 H=2862:00 +CPU= 37.274
  03:25:45 STEP 2863 H=2863:00 +CPU= 23.595
  03:26:09 STEP 2864 H=2864:00 +CPU= 24.206
  03:26:45 STEP 2865 H=2865:00 +CPU= 36.455
  03:27:10 STEP 2866 H=2866:00 +CPU= 24.119
  03:27:33 STEP 2867 H=2867:00 +CPU= 23.290
  03:28:13 STEP 2868 H=2868:00 +CPU= 39.763
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002868
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002868
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002868
  03:28:37 STEP 2869 H=2869:00 +CPU= 23.458
  03:29:01 STEP 2870 H=2870:00 +CPU= 24.100
  03:29:38 STEP 2871 H=2871:00 +CPU= 36.724
  03:30:02 STEP 2872 H=2872:00 +CPU= 24.093
  03:30:25 STEP 2873 H=2873:00 +CPU= 23.379
  03:31:03 STEP 2874 H=2874:00 +CPU= 37.529
  03:31:26 STEP 2875 H=2875:00 +CPU= 23.264
  03:31:50 STEP 2876 H=2876:00 +CPU= 24.064
  03:32:27 STEP 2877 H=2877:00 +CPU= 36.656
  03:32:51 STEP 2878 H=2878:00 +CPU= 23.957
  03:33:15 STEP 2879 H=2879:00 +CPU= 23.976
  03:33:58 STEP 2880 H=2880:00 +CPU= 42.205
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002880
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002880
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002868
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01g1_2019110100_123_993_12215311_1_r1700035389_119.zip
Uploading the intermediate file: upload_file_119.zip
  03:34:21 STEP 2881 H=2881:00 +CPU= 23.420
Uploading trickle at timestep: 10368000
  03:34:46 STEP 2882 H=2882:00 +CPU= 24.212
  03:35:22 STEP 2883 H=2883:00 +CPU= 36.339
  03:35:46 STEP 2884 H=2884:00 +CPU= 24.057
  03:36:10 STEP 2885 H=2885:00 +CPU= 23.356
  03:36:47 STEP 2886 H=2886:00 +CPU= 37.304
  03:37:10 STEP 2887 H=2887:00 +CPU= 23.387
  03:37:35 STEP 2888 H=2888:00 +CPU= 24.060
  03:38:11 STEP 2889 H=2889:00 +CPU= 36.405
  03:38:35 STEP 2890 H=2890:00 +CPU= 24.144
  03:38:59 STEP 2891 H=2891:00 +CPU= 23.423
  03:39:39 STEP 2892 H=2892:00 +CPU= 39.944
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002892
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002892
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002892
  03:40:02 STEP 2893 H=2893:00 +CPU= 23.357
  03:40:27 STEP 2894 H=2894:00 +CPU= 24.037
  03:41:03 STEP 2895 H=2895:00 +CPU= 36.737
  03:41:28 STEP 2896 H=2896:00 +CPU= 24.065
  03:41:51 STEP 2897 H=2897:00 +CPU= 23.354
  03:42:28 STEP 2898 H=2898:00 +CPU= 37.274
  03:42:52 STEP 2899 H=2899:00 +CPU= 23.528
  03:43:16 STEP 2900 H=2900:00 +CPU= 23.993
  03:43:53 STEP 2901 H=2901:00 +CPU= 36.465
  03:44:17 STEP 2902 H=2902:00 +CPU= 23.978
  03:44:41 STEP 2903 H=2903:00 +CPU= 24.139
  03:45:24 STEP 2904 H=2904:00 +CPU= 42.271
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002904
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002904
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002892
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01g1_2019110100_123_993_12215311_1_r1700035389_120.zip
Uploading the intermediate file: upload_file_120.zip
  03:45:48 STEP 2905 H=2905:00 +CPU= 23.882
  03:46:12 STEP 2906 H=2906:00 +CPU= 24.132
  03:46:49 STEP 2907 H=2907:00 +CPU= 36.728
  03:47:13 STEP 2908 H=2908:00 +CPU= 24.140
  03:47:36 STEP 2909 H=2909:00 +CPU= 23.468
  03:48:14 STEP 2910 H=2910:00 +CPU= 37.444
  03:48:37 STEP 2911 H=2911:00 +CPU= 23.341
  03:49:01 STEP 2912 H=2912:00 +CPU= 24.103
  03:49:38 STEP 2913 H=2913:00 +CPU= 36.860
  03:50:03 STEP 2914 H=2914:00 +CPU= 24.074
  03:50:26 STEP 2915 H=2915:00 +CPU= 23.374
  03:51:06 STEP 2916 H=2916:00 +CPU= 40.167
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002916
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002916
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002916
  03:51:30 STEP 2917 H=2917:00 +CPU= 23.435
  03:51:54 STEP 2918 H=2918:00 +CPU= 24.160
  03:52:31 STEP 2919 H=2919:00 +CPU= 36.690
  03:52:55 STEP 2920 H=2920:00 +CPU= 24.287
  03:53:19 STEP 2921 H=2921:00 +CPU= 23.429
  03:53:59 STEP 2922 H=2922:00 +CPU= 39.784
  03:54:23 STEP 2923 H=2923:00 +CPU= 23.825
  03:54:47 STEP 2924 H=2924:00 +CPU= 24.165
  03:55:24 STEP 2925 H=2925:00 +CPU= 36.569
  03:55:48 STEP 2926 H=2926:00 +CPU= 24.211
  03:56:12 STEP 2927 H=2927:00 +CPU= 24.283
  03:56:55 STEP 2928 H=2928:00 +CPU= 42.288
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002928
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002928
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002916
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01g1_2019110100_123_993_12215311_1_r1700035389_121.zip
Uploading the intermediate file: upload_file_121.zip
  03:57:18 STEP 2929 H=2929:00 +CPU= 23.613
  03:57:43 STEP 2930 H=2930:00 +CPU= 24.074
  03:58:19 STEP 2931 H=2931:00 +CPU= 36.757
  03:58:44 STEP 2932 H=2932:00 +CPU= 23.966
  03:59:07 STEP 2933 H=2933:00 +CPU= 23.274
  03:59:44 STEP 2934 H=2934:00 +CPU= 37.379
  04:00:08 STEP 2935 H=2935:00 +CPU= 23.477
  04:00:32 STEP 2936 H=2936:00 +CPU= 24.063
  04:01:09 STEP 2937 H=2937:00 +CPU= 36.630
  04:01:33 STEP 2938 H=2938:00 +CPU= 23.992
  04:01:56 STEP 2939 H=2939:00 +CPU= 23.396
  04:02:36 STEP 2940 H=2940:00 +CPU= 39.829
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002940
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002940
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002940
  04:03:00 STEP 2941 H=2941:00 +CPU= 23.430
  04:03:24 STEP 2942 H=2942:00 +CPU= 24.167
  04:04:01 STEP 2943 H=2943:00 +CPU= 36.635
  04:04:25 STEP 2944 H=2944:00 +CPU= 24.101
  04:04:49 STEP 2945 H=2945:00 +CPU= 23.478
  04:05:26 STEP 2946 H=2946:00 +CPU= 37.538
  04:05:50 STEP 2947 H=2947:00 +CPU= 23.312
  04:06:14 STEP 2948 H=2948:00 +CPU= 24.340
  04:06:51 STEP 2949 H=2949:00 +CPU= 37.123
  04:07:16 STEP 2950 H=2950:00 +CPU= 24.155
  04:07:40 STEP 2951 H=2951:00 +CPU= 24.089
  04:08:21 STEP 2952 H=2952:00 +CPU= 40.886
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  3.19925486346338E-02 -1.00000000000000E+00  1.00000000000000E+00
  MAXGPFV : MAX. VALUE =    1.15613856724929     
  MAXGPFV : MAX. VALUE =   0.739797854132400     
 NSTEP =  2952 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGhnw4+002952 MODE=a
 IO-STREAM CLOSED - ICMGGhnw4+002952
 MPI-TASK:   1 -    323664826 BYTES IN      8 RECORDS TRANSFERRED IN    0.0005 SECONDS647329.7 Mbytes/s, TOTAL TIME=    0.0105( 4.8%)
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302231500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302233000  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302234500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200303000000  !!!!!!!!!!!! 
 04:08:21 STEP 2952 H=2952:00 +CPU= 40.886
 END CNT3
 NSTEP =  2952 CNT0   000000000  36.093  36.093  36.353   0.993               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ          654/    28953814 WRITTEN        46048/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1   1116    0      654        28275    46048 ************   193.6     0.0   193.6     0.9   301.5
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********    100.00      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 3200    2187.7    2187.7      5.10      0.00
   9 SPCM     - SPECTRAL COMP.                    2952     346.8     346.8      0.75      0.00
  10 SCAN2M - PHYSICS                             2953   12418.7   12418.7     26.74      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                247    1134.3    1134.3      0.20      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                126      14.9      14.9      0.00      0.00
  13 SCAN2M - RADIATION CALC.                      985   12932.0   12932.0      9.29      0.00
  14 SUINIF                                          1    1564.2    1564.2      0.00      0.00
  17 GRIDFPOS IN CNT4                              247      45.5      45.5      0.01      0.00
  18 SUSPECG                                         1     270.9     270.9      0.00      0.00
  19 SUSPEC                                          1     278.7     278.7      0.00      0.00
  24 SUGRIDU                                         1     933.5     933.5      0.00      0.00
  25 SPECRT                                          1     178.4     178.4      0.00      0.00
  26 SUGRIDF                                         1     173.6     173.6      0.00      0.00
  27 RESTART FILES - WRITING                       123    2277.5    2277.5      0.20      0.00
  28 RESTART FILES - READING                         1       0.1       0.1      0.00      0.00
  29 SU4FPOS IN CNT4                               247       0.2       0.2      0.00      0.00
  30 DYNFPOS IN CNT4                               247  225652.1  225652.1     40.64      0.00
  31 POSDDH IN STEPO                                13      21.0      21.0      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   2953    3552.2    3552.2      7.65      0.00
  38 WAM      - TOTAL COST OF WAVE MODEL          2952    2908.9    2908.9      6.26      0.00
  39 SU0YOMB                                         1     251.0     251.0      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   2953      20.0      20.0      0.04      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             2952     211.8     211.8      0.46      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             2952      47.7      47.7      0.10      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                126       0.2       0.2      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM    10094    5618.0    5618.0     41.35      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      6152     135.8     135.8      0.61      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       6152      55.7      55.7      0.25      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM     10094      53.7      53.7      0.40      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            2      18.5      18.5      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION          10094      17.7      17.7      0.13      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           6152      15.1      15.1      0.07      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION          10094      21.1      21.1      0.16      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           6152      11.6      11.6      0.05      0.00
 400 GSTATS                                     589499       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                564603       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME   137150.9 CPU TIME   80488.2 VECTOR TIME    80488.2


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       77.5
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002952
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002952
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002952
Adding to the zip: /var/lib/boinc-client/slots/1/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/1/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMGGhnw4+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMUAhnw4+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12215311/ICMSHhnw4+002952
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_01g1_2019110100_123_993_12215311_1_r1700035389_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
04:11:44 (664532): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:54:55 1496322 22317130 oifs_43r3_01g1_2019110100_123_993_12215311_1 10,623,600 80,488 0.0076
09 May 2023 16:54:54 1496322 22317130 oifs_43r3_01g1_2019110100_123_993_12215311_1 10,368,000 78,437 0.0076
09 May 2023 16:54:54 1496322 22317130 oifs_43r3_01g1_2019110100_123_993_12215311_1 9,504,000 71,565 0.0075
09 May 2023 16:54:53 1496322 22317130 oifs_43r3_01g1_2019110100_123_993_12215311_1 8,640,000 64,685 0.0075
09 May 2023 16:54:52 1496322 22317130 oifs_43r3_01g1_2019110100_123_993_12215311_1 7,776,000 57,794 0.0074
09 May 2023 16:54:50 1496322 22317130 oifs_43r3_01g1_2019110100_123_993_12215311_1 6,912,000 50,983 0.0074
09 May 2023 16:54:50 1496322 22317130 oifs_43r3_01g1_2019110100_123_993_12215311_1 6,048,000 44,053 0.0073
09 May 2023 16:54:49 1496322 22317130 oifs_43r3_01g1_2019110100_123_993_12215311_1 5,184,000 38,629 0.0075
09 May 2023 16:54:48 1496322 22317130 oifs_43r3_01g1_2019110100_123_993_12215311_1 4,320,000 32,198 0.0075
09 May 2023 16:54:47 1496322 22317130 oifs_43r3_01g1_2019110100_123_993_12215311_1 3,456,000 25,652 0.0074
09 May 2023 16:54:46 1496322 22317130 oifs_43r3_01g1_2019110100_123_993_12215311_1 2,592,000 18,634 0.0072
09 May 2023 16:54:31 1496322 22317130 oifs_43r3_01g1_2019110100_123_993_12215311_1 1,728,000 12,351 0.0071
09 May 2023 16:54:29 1496322 22317130 oifs_43r3_01g1_2019110100_123_993_12215311_1 864,000 6,420 0.0074


©2024 climateprediction.net