climateprediction.net home page
Task 22314918

Task 22314918

Name oifs_43r3_003q_2019110100_123_993_12213572_0
Workunit 12213572
Created 24 Feb 2023, 11:57:01 UTC
Sent 24 Feb 2023, 12:00:05 UTC
Report deadline 25 Apr 2023, 12:00:05 UTC
Received 25 Feb 2023, 14:31:19 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1527784
Run time 15 hours 51 min 39 sec
CPU time 15 hours 19 min 32 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 6.66 GFLOPS
Application version OpenIFS 43r3 v1.21
x86_64-pc-linux-gnu
Peak working set size 4,416.16 MB
Peak swap size 4,983.13 MB
Peak disk usage 1,751.82 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<stderr_txt>
Ahnw4+002364
  10:39:22 STEP 2365 H=2365:00 +CPU= 15.945
  10:39:39 STEP 2366 H=2366:00 +CPU= 16.261
  10:40:03 STEP 2367 H=2367:00 +CPU= 24.032
  10:40:20 STEP 2368 H=2368:00 +CPU= 16.303
  10:40:36 STEP 2369 H=2369:00 +CPU= 15.832
  10:41:01 STEP 2370 H=2370:00 +CPU= 24.448
  10:41:17 STEP 2371 H=2371:00 +CPU= 15.833
  10:41:34 STEP 2372 H=2372:00 +CPU= 16.200
  10:41:59 STEP 2373 H=2373:00 +CPU= 24.312
  10:42:16 STEP 2374 H=2374:00 +CPU= 16.176
  10:42:34 STEP 2375 H=2375:00 +CPU= 16.591
  10:43:05 STEP 2376 H=2376:00 +CPU= 28.399
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002376
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002376
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002364
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_003q_2019110100_123_993_12213572_0_r1915204257_98.zip
Uploading the intermediate file: upload_file_98.zip
  10:43:21 STEP 2377 H=2377:00 +CPU= 15.770
  10:43:38 STEP 2378 H=2378:00 +CPU= 16.560
  10:44:03 STEP 2379 H=2379:00 +CPU= 23.976
  10:44:20 STEP 2380 H=2380:00 +CPU= 16.178
  10:44:37 STEP 2381 H=2381:00 +CPU= 16.136
  10:45:03 STEP 2382 H=2382:00 +CPU= 24.782
  10:45:21 STEP 2383 H=2383:00 +CPU= 16.024
  10:45:37 STEP 2384 H=2384:00 +CPU= 16.124
  10:46:03 STEP 2385 H=2385:00 +CPU= 24.434
  10:46:21 STEP 2386 H=2386:00 +CPU= 16.731
  10:46:38 STEP 2387 H=2387:00 +CPU= 15.904
  10:47:08 STEP 2388 H=2388:00 +CPU= 27.042
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002388
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002388
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002388
  10:47:24 STEP 2389 H=2389:00 +CPU= 16.056
  10:47:42 STEP 2390 H=2390:00 +CPU= 16.499
  10:48:10 STEP 2391 H=2391:00 +CPU= 24.611
  10:48:30 STEP 2392 H=2392:00 +CPU= 16.779
  10:48:47 STEP 2393 H=2393:00 +CPU= 16.023
  10:49:14 STEP 2394 H=2394:00 +CPU= 24.972
  10:49:30 STEP 2395 H=2395:00 +CPU= 16.060
  10:49:47 STEP 2396 H=2396:00 +CPU= 16.226
  10:50:11 STEP 2397 H=2397:00 +CPU= 24.064
  10:50:29 STEP 2398 H=2398:00 +CPU= 16.599
  10:50:46 STEP 2399 H=2399:00 +CPU= 16.178
  10:51:16 STEP 2400 H=2400:00 +CPU= 28.558
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002400
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002400
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002388
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002388
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002388
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_003q_2019110100_123_993_12213572_0_r1915204257_99.zip
Uploading the intermediate file: upload_file_99.zip
  10:51:32 STEP 2401 H=2401:00 +CPU= 15.647
  10:51:49 STEP 2402 H=2402:00 +CPU= 16.149
  10:52:13 STEP 2403 H=2403:00 +CPU= 23.914
  10:52:30 STEP 2404 H=2404:00 +CPU= 16.275
  10:52:46 STEP 2405 H=2405:00 +CPU= 15.755
  10:53:12 STEP 2406 H=2406:00 +CPU= 24.165
  10:53:31 STEP 2407 H=2407:00 +CPU= 15.738
  10:53:50 STEP 2408 H=2408:00 +CPU= 15.798
  10:54:20 STEP 2409 H=2409:00 +CPU= 24.020
  10:54:39 STEP 2410 H=2410:00 +CPU= 16.045
  10:54:55 STEP 2411 H=2411:00 +CPU= 15.928
  10:55:24 STEP 2412 H=2412:00 +CPU= 25.725
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002412
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002412
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002412
  10:55:44 STEP 2413 H=2413:00 +CPU= 15.811
  10:56:03 STEP 2414 H=2414:00 +CPU= 15.953
  10:56:33 STEP 2415 H=2415:00 +CPU= 23.955
  10:56:51 STEP 2416 H=2416:00 +CPU= 16.369
  10:57:08 STEP 2417 H=2417:00 +CPU= 15.818
  10:57:33 STEP 2418 H=2418:00 +CPU= 24.616
  10:57:50 STEP 2419 H=2419:00 +CPU= 16.124
  10:58:06 STEP 2420 H=2420:00 +CPU= 16.245
  10:58:32 STEP 2421 H=2421:00 +CPU= 24.210
  10:58:49 STEP 2422 H=2422:00 +CPU= 16.527
  10:59:06 STEP 2423 H=2423:00 +CPU= 16.338
  10:59:38 STEP 2424 H=2424:00 +CPU= 28.732
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002424
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002424
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002412
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_003q_2019110100_123_993_12213572_0_r1915204257_100.zip
Uploading the intermediate file: upload_file_100.zip
  10:59:54 STEP 2425 H=2425:00 +CPU= 15.856
  11:00:12 STEP 2426 H=2426:00 +CPU= 16.156
  11:00:38 STEP 2427 H=2427:00 +CPU= 24.420
  11:00:56 STEP 2428 H=2428:00 +CPU= 16.657
  11:01:13 STEP 2429 H=2429:00 +CPU= 15.753
  11:01:38 STEP 2430 H=2430:00 +CPU= 24.619
  11:01:55 STEP 2431 H=2431:00 +CPU= 16.350
  11:02:12 STEP 2432 H=2432:00 +CPU= 16.129
  11:02:36 STEP 2433 H=2433:00 +CPU= 24.170
  11:02:53 STEP 2434 H=2434:00 +CPU= 16.464
  11:03:09 STEP 2435 H=2435:00 +CPU= 15.754
  11:03:36 STEP 2436 H=2436:00 +CPU= 26.410
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002436
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002436
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002436
  11:03:53 STEP 2437 H=2437:00 +CPU= 15.980
  11:04:09 STEP 2438 H=2438:00 +CPU= 16.101
  11:04:34 STEP 2439 H=2439:00 +CPU= 24.215
  11:04:51 STEP 2440 H=2440:00 +CPU= 16.394
  11:05:07 STEP 2441 H=2441:00 +CPU= 15.626
  11:05:32 STEP 2442 H=2442:00 +CPU= 24.615
  11:05:49 STEP 2443 H=2443:00 +CPU= 16.051
  11:06:05 STEP 2444 H=2444:00 +CPU= 16.065
  11:06:30 STEP 2445 H=2445:00 +CPU= 24.044
  11:06:46 STEP 2446 H=2446:00 +CPU= 16.298
  11:07:03 STEP 2447 H=2447:00 +CPU= 16.089
  11:07:35 STEP 2448 H=2448:00 +CPU= 28.704
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002448
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002448
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002436
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_003q_2019110100_123_993_12213572_0_r1915204257_101.zip
Uploading the intermediate file: upload_file_101.zip
  11:07:51 STEP 2449 H=2449:00 +CPU= 15.806
  11:08:08 STEP 2450 H=2450:00 +CPU= 15.919
  11:08:33 STEP 2451 H=2451:00 +CPU= 23.930
  11:08:50 STEP 2452 H=2452:00 +CPU= 16.375
  11:09:06 STEP 2453 H=2453:00 +CPU= 15.478
  11:09:31 STEP 2454 H=2454:00 +CPU= 24.451
  11:09:47 STEP 2455 H=2455:00 +CPU= 16.047
  11:10:04 STEP 2456 H=2456:00 +CPU= 16.027
  11:10:31 STEP 2457 H=2457:00 +CPU= 24.605
  11:10:48 STEP 2458 H=2458:00 +CPU= 16.506
  11:11:04 STEP 2459 H=2459:00 +CPU= 15.597
  11:11:31 STEP 2460 H=2460:00 +CPU= 26.299
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002460
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002460
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002460
  11:11:48 STEP 2461 H=2461:00 +CPU= 16.094
  11:12:04 STEP 2462 H=2462:00 +CPU= 15.861
  11:12:29 STEP 2463 H=2463:00 +CPU= 24.415
  11:12:46 STEP 2464 H=2464:00 +CPU= 16.725
  11:13:02 STEP 2465 H=2465:00 +CPU= 15.579
  11:13:28 STEP 2466 H=2466:00 +CPU= 24.798
  11:13:44 STEP 2467 H=2467:00 +CPU= 16.222
  11:14:01 STEP 2468 H=2468:00 +CPU= 16.017
  11:14:26 STEP 2469 H=2469:00 +CPU= 24.379
  11:14:43 STEP 2470 H=2470:00 +CPU= 16.445
  11:14:59 STEP 2471 H=2471:00 +CPU= 15.960
  11:15:29 STEP 2472 H=2472:00 +CPU= 28.698
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002472
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002472
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002460
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_003q_2019110100_123_993_12213572_0_r1915204257_102.zip
Uploading the intermediate file: upload_file_102.zip
  11:15:46 STEP 2473 H=2473:00 +CPU= 16.096
  11:16:02 STEP 2474 H=2474:00 +CPU= 16.065
  11:16:27 STEP 2475 H=2475:00 +CPU= 24.453
  11:16:44 STEP 2476 H=2476:00 +CPU= 16.468
  11:17:00 STEP 2477 H=2477:00 +CPU= 15.640
  11:17:26 STEP 2478 H=2478:00 +CPU= 24.703
  11:17:42 STEP 2479 H=2479:00 +CPU= 16.133
  11:17:59 STEP 2480 H=2480:00 +CPU= 16.107
  11:18:24 STEP 2481 H=2481:00 +CPU= 24.256
  11:18:41 STEP 2482 H=2482:00 +CPU= 16.541
  11:18:57 STEP 2483 H=2483:00 +CPU= 15.654
  11:19:24 STEP 2484 H=2484:00 +CPU= 26.509
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002484
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002484
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002484
  11:19:40 STEP 2485 H=2485:00 +CPU= 16.179
  11:19:57 STEP 2486 H=2486:00 +CPU= 16.049
  11:20:21 STEP 2487 H=2487:00 +CPU= 24.256
  11:20:38 STEP 2488 H=2488:00 +CPU= 16.451
  11:20:54 STEP 2489 H=2489:00 +CPU= 15.634
  11:21:20 STEP 2490 H=2490:00 +CPU= 24.646
  11:21:36 STEP 2491 H=2491:00 +CPU= 16.058
  11:21:52 STEP 2492 H=2492:00 +CPU= 16.039
  11:22:17 STEP 2493 H=2493:00 +CPU= 24.235
  11:22:34 STEP 2494 H=2494:00 +CPU= 16.288
  11:22:51 STEP 2495 H=2495:00 +CPU= 16.298
  11:23:20 STEP 2496 H=2496:00 +CPU= 28.174
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002496
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002496
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002484
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_003q_2019110100_123_993_12213572_0_r1915204257_103.zip
Uploading the intermediate file: upload_file_103.zip
  11:23:36 STEP 2497 H=2497:00 +CPU= 15.873
  11:23:53 STEP 2498 H=2498:00 +CPU= 16.132
  11:24:18 STEP 2499 H=2499:00 +CPU= 24.250
  11:24:37 STEP 2500 H=2500:00 +CPU= 16.676
  11:24:53 STEP 2501 H=2501:00 +CPU= 15.762
  11:25:20 STEP 2502 H=2502:00 +CPU= 25.072
  11:25:40 STEP 2503 H=2503:00 +CPU= 16.280
  11:25:57 STEP 2504 H=2504:00 +CPU= 16.060
  11:26:23 STEP 2505 H=2505:00 +CPU= 24.343
  11:26:40 STEP 2506 H=2506:00 +CPU= 16.490
  11:26:56 STEP 2507 H=2507:00 +CPU= 15.701
  11:27:23 STEP 2508 H=2508:00 +CPU= 26.425
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002508
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002508
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002508
  11:27:40 STEP 2509 H=2509:00 +CPU= 16.164
  11:27:57 STEP 2510 H=2510:00 +CPU= 16.213
  11:28:22 STEP 2511 H=2511:00 +CPU= 24.130
  11:28:39 STEP 2512 H=2512:00 +CPU= 16.377
  11:28:57 STEP 2513 H=2513:00 +CPU= 15.903
  11:29:24 STEP 2514 H=2514:00 +CPU= 24.802
  11:29:40 STEP 2515 H=2515:00 +CPU= 15.995
  11:29:58 STEP 2516 H=2516:00 +CPU= 16.162
  11:30:23 STEP 2517 H=2517:00 +CPU= 24.124
  11:30:40 STEP 2518 H=2518:00 +CPU= 16.346
  11:30:57 STEP 2519 H=2519:00 +CPU= 16.247
  11:31:26 STEP 2520 H=2520:00 +CPU= 28.317
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002520
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002520
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002508
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_003q_2019110100_123_993_12213572_0_r1915204257_104.zip
Uploading the intermediate file: upload_file_104.zip
  11:31:43 STEP 2521 H=2521:00 +CPU= 15.875
  11:32:00 STEP 2522 H=2522:00 +CPU= 15.898
  11:32:25 STEP 2523 H=2523:00 +CPU= 24.170
  11:32:43 STEP 2524 H=2524:00 +CPU= 16.460
  11:32:59 STEP 2525 H=2525:00 +CPU= 15.552
  11:33:24 STEP 2526 H=2526:00 +CPU= 24.592
  11:33:41 STEP 2527 H=2527:00 +CPU= 16.234
  11:33:57 STEP 2528 H=2528:00 +CPU= 15.855
  11:34:22 STEP 2529 H=2529:00 +CPU= 24.033
  11:34:38 STEP 2530 H=2530:00 +CPU= 16.370
  11:34:54 STEP 2531 H=2531:00 +CPU= 15.543
  11:35:21 STEP 2532 H=2532:00 +CPU= 26.300
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002532
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002532
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002532
  11:35:37 STEP 2533 H=2533:00 +CPU= 16.023
  11:35:53 STEP 2534 H=2534:00 +CPU= 15.888
  11:36:19 STEP 2535 H=2535:00 +CPU= 24.604
  11:36:36 STEP 2536 H=2536:00 +CPU= 16.786
  11:36:53 STEP 2537 H=2537:00 +CPU= 15.885
  11:37:19 STEP 2538 H=2538:00 +CPU= 24.906
  11:37:36 STEP 2539 H=2539:00 +CPU= 16.011
  11:37:52 STEP 2540 H=2540:00 +CPU= 15.943
  11:38:17 STEP 2541 H=2541:00 +CPU= 24.155
  11:38:33 STEP 2542 H=2542:00 +CPU= 16.222
  11:38:50 STEP 2543 H=2543:00 +CPU= 16.152
  11:39:19 STEP 2544 H=2544:00 +CPU= 28.251
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002544
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002544
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002532
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_003q_2019110100_123_993_12213572_0_r1915204257_105.zip
Uploading the intermediate file: upload_file_105.zip
  11:39:36 STEP 2545 H=2545:00 +CPU= 15.837
  11:39:52 STEP 2546 H=2546:00 +CPU= 16.019
  11:40:17 STEP 2547 H=2547:00 +CPU= 24.130
  11:40:34 STEP 2548 H=2548:00 +CPU= 16.578
  11:40:50 STEP 2549 H=2549:00 +CPU= 15.792
  11:41:16 STEP 2550 H=2550:00 +CPU= 24.714
  11:41:32 STEP 2551 H=2551:00 +CPU= 16.128
  11:41:49 STEP 2552 H=2552:00 +CPU= 16.066
  11:42:14 STEP 2553 H=2553:00 +CPU= 24.159
  11:42:31 STEP 2554 H=2554:00 +CPU= 16.498
  11:42:49 STEP 2555 H=2555:00 +CPU= 15.922
  11:43:15 STEP 2556 H=2556:00 +CPU= 26.127
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002556
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002556
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002556
  11:43:31 STEP 2557 H=2557:00 +CPU= 15.799
  11:43:48 STEP 2558 H=2558:00 +CPU= 16.091
  11:44:13 STEP 2559 H=2559:00 +CPU= 24.088
  11:44:30 STEP 2560 H=2560:00 +CPU= 16.487
  11:44:46 STEP 2561 H=2561:00 +CPU= 15.584
  11:45:12 STEP 2562 H=2562:00 +CPU= 24.639
  11:45:28 STEP 2563 H=2563:00 +CPU= 15.986
  11:45:45 STEP 2564 H=2564:00 +CPU= 15.960
  11:46:10 STEP 2565 H=2565:00 +CPU= 24.309
  11:46:27 STEP 2566 H=2566:00 +CPU= 16.399
  11:46:43 STEP 2567 H=2567:00 +CPU= 16.133
  11:47:13 STEP 2568 H=2568:00 +CPU= 28.284
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002568
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002568
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002556
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_003q_2019110100_123_993_12213572_0_r1915204257_106.zip
Uploading the intermediate file: upload_file_106.zip
  11:47:29 STEP 2569 H=2569:00 +CPU= 15.587
  11:47:45 STEP 2570 H=2570:00 +CPU= 15.887
  11:48:10 STEP 2571 H=2571:00 +CPU= 24.207
  11:48:27 STEP 2572 H=2572:00 +CPU= 16.182
  11:48:43 STEP 2573 H=2573:00 +CPU= 15.593
  11:49:07 STEP 2574 H=2574:00 +CPU= 24.308
  11:49:24 STEP 2575 H=2575:00 +CPU= 15.959
  11:49:40 STEP 2576 H=2576:00 +CPU= 15.963
  11:50:04 STEP 2577 H=2577:00 +CPU= 24.041
  11:50:21 STEP 2578 H=2578:00 +CPU= 16.272
  11:50:37 STEP 2579 H=2579:00 +CPU= 15.560
  11:51:04 STEP 2580 H=2580:00 +CPU= 26.265
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002580
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002580
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002580
  11:51:20 STEP 2581 H=2581:00 +CPU= 16.051
  11:51:36 STEP 2582 H=2582:00 +CPU= 15.986
  11:52:01 STEP 2583 H=2583:00 +CPU= 24.006
  11:52:17 STEP 2584 H=2584:00 +CPU= 16.329
  11:52:33 STEP 2585 H=2585:00 +CPU= 15.526
  11:52:58 STEP 2586 H=2586:00 +CPU= 24.408
  11:53:14 STEP 2587 H=2587:00 +CPU= 15.917
  11:53:30 STEP 2588 H=2588:00 +CPU= 15.871
  11:53:56 STEP 2589 H=2589:00 +CPU= 24.295
  11:54:13 STEP 2590 H=2590:00 +CPU= 16.336
  11:54:30 STEP 2591 H=2591:00 +CPU= 15.879
  11:55:00 STEP 2592 H=2592:00 +CPU= 28.682
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002592
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002592
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002580
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_003q_2019110100_123_993_12213572_0_r1915204257_107.zip
Uploading the intermediate file: upload_file_107.zip
  11:55:17 STEP 2593 H=2593:00 +CPU= 15.635
Uploading trickle at timestep: 9331200
  11:55:33 STEP 2594 H=2594:00 +CPU= 15.768
  11:55:57 STEP 2595 H=2595:00 +CPU= 23.938
  11:56:14 STEP 2596 H=2596:00 +CPU= 16.271
  11:56:31 STEP 2597 H=2597:00 +CPU= 15.742
  11:56:56 STEP 2598 H=2598:00 +CPU= 24.420
  11:57:12 STEP 2599 H=2599:00 +CPU= 15.847
  11:57:28 STEP 2600 H=2600:00 +CPU= 16.031
  11:57:53 STEP 2601 H=2601:00 +CPU= 23.988
  11:58:09 STEP 2602 H=2602:00 +CPU= 16.271
  11:58:25 STEP 2603 H=2603:00 +CPU= 15.590
  11:58:52 STEP 2604 H=2604:00 +CPU= 26.336
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002604
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002604
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002604
  11:59:08 STEP 2605 H=2605:00 +CPU= 15.858
  11:59:24 STEP 2606 H=2606:00 +CPU= 16.003
  11:59:49 STEP 2607 H=2607:00 +CPU= 23.972
  12:00:06 STEP 2608 H=2608:00 +CPU= 16.077
  12:00:25 STEP 2609 H=2609:00 +CPU= 15.119
  12:00:54 STEP 2610 H=2610:00 +CPU= 23.984
  12:01:13 STEP 2611 H=2611:00 +CPU= 15.595
  12:01:32 STEP 2612 H=2612:00 +CPU= 15.764
  12:02:02 STEP 2613 H=2613:00 +CPU= 23.748
  12:02:22 STEP 2614 H=2614:00 +CPU= 15.845
  12:02:42 STEP 2615 H=2615:00 +CPU= 15.682
  12:03:17 STEP 2616 H=2616:00 +CPU= 28.103
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002616
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002616
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002604
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_003q_2019110100_123_993_12213572_0_r1915204257_108.zip
Uploading the intermediate file: upload_file_108.zip
  12:03:39 STEP 2617 H=2617:00 +CPU= 16.095
  12:04:00 STEP 2618 H=2618:00 +CPU= 16.205
  12:04:30 STEP 2619 H=2619:00 +CPU= 24.218
  12:04:51 STEP 2620 H=2620:00 +CPU= 16.479
  12:05:11 STEP 2621 H=2621:00 +CPU= 15.917
  12:05:42 STEP 2622 H=2622:00 +CPU= 24.625
  12:06:02 STEP 2623 H=2623:00 +CPU= 16.192
  12:06:23 STEP 2624 H=2624:00 +CPU= 16.296
  12:06:53 STEP 2625 H=2625:00 +CPU= 24.367
  12:07:13 STEP 2626 H=2626:00 +CPU= 16.647
  12:07:33 STEP 2627 H=2627:00 +CPU= 15.905
  12:08:05 STEP 2628 H=2628:00 +CPU= 26.448
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002628
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002628
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002628
  12:08:25 STEP 2629 H=2629:00 +CPU= 16.437
  12:08:45 STEP 2630 H=2630:00 +CPU= 16.252
  12:09:15 STEP 2631 H=2631:00 +CPU= 24.144
  12:09:35 STEP 2632 H=2632:00 +CPU= 16.563
  12:09:54 STEP 2633 H=2633:00 +CPU= 15.960
  12:10:24 STEP 2634 H=2634:00 +CPU= 24.637
  12:10:43 STEP 2635 H=2635:00 +CPU= 16.306
  12:11:03 STEP 2636 H=2636:00 +CPU= 16.604
  12:11:32 STEP 2637 H=2637:00 +CPU= 24.278
  12:11:52 STEP 2638 H=2638:00 +CPU= 16.634
  12:12:12 STEP 2639 H=2639:00 +CPU= 16.267
  12:12:49 STEP 2640 H=2640:00 +CPU= 28.257
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002640
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002640
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002628
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_003q_2019110100_123_993_12213572_0_r1915204257_109.zip
Uploading the intermediate file: upload_file_109.zip
  12:13:10 STEP 2641 H=2641:00 +CPU= 16.016
  12:13:31 STEP 2642 H=2642:00 +CPU= 16.350
  12:14:02 STEP 2643 H=2643:00 +CPU= 24.203
  12:14:22 STEP 2644 H=2644:00 +CPU= 16.535
  12:14:42 STEP 2645 H=2645:00 +CPU= 15.852
  12:15:14 STEP 2646 H=2646:00 +CPU= 24.657
  12:15:35 STEP 2647 H=2647:00 +CPU= 16.275
  12:15:56 STEP 2648 H=2648:00 +CPU= 16.364
  12:16:27 STEP 2649 H=2649:00 +CPU= 24.192
  12:16:48 STEP 2650 H=2650:00 +CPU= 16.465
  12:17:08 STEP 2651 H=2651:00 +CPU= 15.940
  12:17:43 STEP 2652 H=2652:00 +CPU= 26.528
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002652
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002652
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002652
  12:18:04 STEP 2653 H=2653:00 +CPU= 16.207
  12:18:24 STEP 2654 H=2654:00 +CPU= 16.243
  12:18:55 STEP 2655 H=2655:00 +CPU= 24.365
  12:19:16 STEP 2656 H=2656:00 +CPU= 16.597
  12:19:36 STEP 2657 H=2657:00 +CPU= 15.645
  12:20:08 STEP 2658 H=2658:00 +CPU= 24.920
  12:20:28 STEP 2659 H=2659:00 +CPU= 16.214
  12:20:48 STEP 2660 H=2660:00 +CPU= 16.066
  12:21:18 STEP 2661 H=2661:00 +CPU= 24.313
  12:21:39 STEP 2662 H=2662:00 +CPU= 16.492
  12:21:58 STEP 2663 H=2663:00 +CPU= 16.205
  12:22:29 STEP 2664 H=2664:00 +CPU= 29.107
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002664
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002664
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002652
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_003q_2019110100_123_993_12213572_0_r1915204257_110.zip
Uploading the intermediate file: upload_file_110.zip
  12:22:46 STEP 2665 H=2665:00 +CPU= 16.394
  12:23:04 STEP 2666 H=2666:00 +CPU= 16.236
  12:23:30 STEP 2667 H=2667:00 +CPU= 24.857
  12:23:47 STEP 2668 H=2668:00 +CPU= 16.881
  12:24:04 STEP 2669 H=2669:00 +CPU= 15.998
  12:24:31 STEP 2670 H=2670:00 +CPU= 25.394
  12:24:48 STEP 2671 H=2671:00 +CPU= 16.605
  12:25:05 STEP 2672 H=2672:00 +CPU= 16.367
  12:25:31 STEP 2673 H=2673:00 +CPU= 25.095
  12:25:49 STEP 2674 H=2674:00 +CPU= 17.024
  12:26:06 STEP 2675 H=2675:00 +CPU= 15.932
  12:26:35 STEP 2676 H=2676:00 +CPU= 27.473
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002676
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002676
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002676
  12:26:52 STEP 2677 H=2677:00 +CPU= 16.528
  12:27:09 STEP 2678 H=2678:00 +CPU= 16.391
  12:27:36 STEP 2679 H=2679:00 +CPU= 25.099
  12:27:53 STEP 2680 H=2680:00 +CPU= 16.955
  12:28:10 STEP 2681 H=2681:00 +CPU= 15.985
  12:28:37 STEP 2682 H=2682:00 +CPU= 25.548
  12:28:54 STEP 2683 H=2683:00 +CPU= 16.542
  12:29:11 STEP 2684 H=2684:00 +CPU= 16.390
  12:29:37 STEP 2685 H=2685:00 +CPU= 24.946
  12:29:55 STEP 2686 H=2686:00 +CPU= 17.045
  12:30:12 STEP 2687 H=2687:00 +CPU= 16.258
  12:30:43 STEP 2688 H=2688:00 +CPU= 29.434
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002688
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002688
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002676
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_003q_2019110100_123_993_12213572_0_r1915204257_111.zip
Uploading the intermediate file: upload_file_111.zip
  12:31:01 STEP 2689 H=2689:00 +CPU= 16.391
  12:31:18 STEP 2690 H=2690:00 +CPU= 16.218
  12:31:44 STEP 2691 H=2691:00 +CPU= 25.070
  12:32:02 STEP 2692 H=2692:00 +CPU= 16.905
  12:32:19 STEP 2693 H=2693:00 +CPU= 15.987
  12:32:46 STEP 2694 H=2694:00 +CPU= 25.653
  12:33:03 STEP 2695 H=2695:00 +CPU= 16.536
  12:33:20 STEP 2696 H=2696:00 +CPU= 16.481
  12:33:47 STEP 2697 H=2697:00 +CPU= 25.073
  12:34:04 STEP 2698 H=2698:00 +CPU= 17.042
  12:34:21 STEP 2699 H=2699:00 +CPU= 15.860
  12:34:50 STEP 2700 H=2700:00 +CPU= 27.502
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002700
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002700
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002700
  12:35:07 STEP 2701 H=2701:00 +CPU= 16.527
  12:35:24 STEP 2702 H=2702:00 +CPU= 16.508
  12:35:50 STEP 2703 H=2703:00 +CPU= 24.981
  12:36:08 STEP 2704 H=2704:00 +CPU= 16.911
  12:36:25 STEP 2705 H=2705:00 +CPU= 16.073
  12:36:52 STEP 2706 H=2706:00 +CPU= 25.505
  12:37:09 STEP 2707 H=2707:00 +CPU= 16.576
  12:37:26 STEP 2708 H=2708:00 +CPU= 16.462
  12:37:52 STEP 2709 H=2709:00 +CPU= 24.927
  12:38:10 STEP 2710 H=2710:00 +CPU= 16.896
  12:38:27 STEP 2711 H=2711:00 +CPU= 16.461
  12:38:58 STEP 2712 H=2712:00 +CPU= 29.389
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002712
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002712
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002700
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_003q_2019110100_123_993_12213572_0_r1915204257_112.zip
Uploading the intermediate file: upload_file_112.zip
  12:39:16 STEP 2713 H=2713:00 +CPU= 16.197
  12:39:33 STEP 2714 H=2714:00 +CPU= 16.267
  12:39:59 STEP 2715 H=2715:00 +CPU= 25.063
  12:40:17 STEP 2716 H=2716:00 +CPU= 16.703
  12:40:34 STEP 2717 H=2717:00 +CPU= 16.022
  12:41:01 STEP 2718 H=2718:00 +CPU= 25.668
  12:41:18 STEP 2719 H=2719:00 +CPU= 16.384
  12:41:35 STEP 2720 H=2720:00 +CPU= 16.412
  12:42:02 STEP 2721 H=2721:00 +CPU= 25.076
  12:42:19 STEP 2722 H=2722:00 +CPU= 16.891
  12:42:36 STEP 2723 H=2723:00 +CPU= 15.998
  12:43:05 STEP 2724 H=2724:00 +CPU= 27.396
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002724
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002724
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002724
  12:43:22 STEP 2725 H=2725:00 +CPU= 16.260
  12:43:39 STEP 2726 H=2726:00 +CPU= 16.401
  12:44:06 STEP 2727 H=2727:00 +CPU= 25.267
  12:44:24 STEP 2728 H=2728:00 +CPU= 16.840
  12:44:40 STEP 2729 H=2729:00 +CPU= 15.701
  12:45:06 STEP 2730 H=2730:00 +CPU= 25.031
  12:45:23 STEP 2731 H=2731:00 +CPU= 16.100
  12:45:41 STEP 2732 H=2732:00 +CPU= 16.343
  12:46:07 STEP 2733 H=2733:00 +CPU= 24.666
  12:46:24 STEP 2734 H=2734:00 +CPU= 16.455
  12:46:41 STEP 2735 H=2735:00 +CPU= 16.460
  12:47:11 STEP 2736 H=2736:00 +CPU= 28.621
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002736
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002736
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002724
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_003q_2019110100_123_993_12213572_0_r1915204257_113.zip
Uploading the intermediate file: upload_file_113.zip
  12:47:30 STEP 2737 H=2737:00 +CPU= 16.688
  12:47:48 STEP 2738 H=2738:00 +CPU= 16.519
  12:48:15 STEP 2739 H=2739:00 +CPU= 25.091
  12:48:33 STEP 2740 H=2740:00 +CPU= 16.907
  12:48:50 STEP 2741 H=2741:00 +CPU= 16.197
  12:49:18 STEP 2742 H=2742:00 +CPU= 25.572
  12:49:35 STEP 2743 H=2743:00 +CPU= 15.977
  12:49:51 STEP 2744 H=2744:00 +CPU= 16.096
  12:50:17 STEP 2745 H=2745:00 +CPU= 24.448
  12:50:34 STEP 2746 H=2746:00 +CPU= 16.474
  12:50:51 STEP 2747 H=2747:00 +CPU= 15.846
  12:51:19 STEP 2748 H=2748:00 +CPU= 26.625
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002748
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002748
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002748
  12:51:35 STEP 2749 H=2749:00 +CPU= 15.987
  12:51:52 STEP 2750 H=2750:00 +CPU= 16.205
  12:52:17 STEP 2751 H=2751:00 +CPU= 24.232
  12:52:35 STEP 2752 H=2752:00 +CPU= 16.740
  12:52:53 STEP 2753 H=2753:00 +CPU= 16.170
  12:53:20 STEP 2754 H=2754:00 +CPU= 25.446
  12:53:38 STEP 2755 H=2755:00 +CPU= 16.562
  12:53:56 STEP 2756 H=2756:00 +CPU= 16.753
  12:54:22 STEP 2757 H=2757:00 +CPU= 24.706
  12:54:40 STEP 2758 H=2758:00 +CPU= 16.944
  12:54:57 STEP 2759 H=2759:00 +CPU= 16.442
  12:55:27 STEP 2760 H=2760:00 +CPU= 28.313
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002760
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002760
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002748
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_003q_2019110100_123_993_12213572_0_r1915204257_114.zip
Uploading the intermediate file: upload_file_114.zip
  12:55:44 STEP 2761 H=2761:00 +CPU= 15.991
  12:56:01 STEP 2762 H=2762:00 +CPU= 16.199
  12:56:28 STEP 2763 H=2763:00 +CPU= 24.670
  12:56:46 STEP 2764 H=2764:00 +CPU= 17.135
  12:57:04 STEP 2765 H=2765:00 +CPU= 16.523
  12:57:33 STEP 2766 H=2766:00 +CPU= 25.837
  12:57:50 STEP 2767 H=2767:00 +CPU= 16.504
  12:58:09 STEP 2768 H=2768:00 +CPU= 16.864
  12:58:36 STEP 2769 H=2769:00 +CPU= 25.265
  12:58:54 STEP 2770 H=2770:00 +CPU= 17.042
  12:59:12 STEP 2771 H=2771:00 +CPU= 16.507
  12:59:41 STEP 2772 H=2772:00 +CPU= 27.556
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002772
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002772
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002772
  12:59:59 STEP 2773 H=2773:00 +CPU= 16.586
  13:00:17 STEP 2774 H=2774:00 +CPU= 16.853
  13:00:44 STEP 2775 H=2775:00 +CPU= 25.188
  13:01:02 STEP 2776 H=2776:00 +CPU= 17.024
  13:01:20 STEP 2777 H=2777:00 +CPU= 16.531
  13:01:47 STEP 2778 H=2778:00 +CPU= 25.702
  13:02:05 STEP 2779 H=2779:00 +CPU= 16.658
  13:02:23 STEP 2780 H=2780:00 +CPU= 16.947
  13:02:50 STEP 2781 H=2781:00 +CPU= 25.256
  13:03:09 STEP 2782 H=2782:00 +CPU= 17.099
  13:03:27 STEP 2783 H=2783:00 +CPU= 17.007
  13:03:59 STEP 2784 H=2784:00 +CPU= 29.503
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002784
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002784
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002772
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_003q_2019110100_123_993_12213572_0_r1915204257_115.zip
Uploading the intermediate file: upload_file_115.zip
  13:04:17 STEP 2785 H=2785:00 +CPU= 16.561
  13:04:35 STEP 2786 H=2786:00 +CPU= 16.841
  13:05:02 STEP 2787 H=2787:00 +CPU= 25.319
  13:05:20 STEP 2788 H=2788:00 +CPU= 17.068
  13:05:38 STEP 2789 H=2789:00 +CPU= 16.470
  13:06:06 STEP 2790 H=2790:00 +CPU= 25.759
  13:06:24 STEP 2791 H=2791:00 +CPU= 16.659
  13:06:42 STEP 2792 H=2792:00 +CPU= 16.943
  13:07:09 STEP 2793 H=2793:00 +CPU= 25.272
  13:07:27 STEP 2794 H=2794:00 +CPU= 17.065
  13:07:45 STEP 2795 H=2795:00 +CPU= 16.600
  13:08:14 STEP 2796 H=2796:00 +CPU= 27.419
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002796
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002796
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002796
  13:08:32 STEP 2797 H=2797:00 +CPU= 16.711
  13:08:50 STEP 2798 H=2798:00 +CPU= 17.027
  13:09:16 STEP 2799 H=2799:00 +CPU= 25.260
  13:09:35 STEP 2800 H=2800:00 +CPU= 17.024
  13:09:52 STEP 2801 H=2801:00 +CPU= 16.529
  13:10:20 STEP 2802 H=2802:00 +CPU= 25.712
  13:10:38 STEP 2803 H=2803:00 +CPU= 16.499
  13:10:56 STEP 2804 H=2804:00 +CPU= 16.958
  13:11:23 STEP 2805 H=2805:00 +CPU= 25.264
  13:11:41 STEP 2806 H=2806:00 +CPU= 17.083
  13:12:00 STEP 2807 H=2807:00 +CPU= 16.914
  13:12:32 STEP 2808 H=2808:00 +CPU= 29.475
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002808
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002808
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002796
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_003q_2019110100_123_993_12213572_0_r1915204257_116.zip
Uploading the intermediate file: upload_file_116.zip
  13:12:50 STEP 2809 H=2809:00 +CPU= 16.431
  13:13:08 STEP 2810 H=2810:00 +CPU= 16.888
  13:13:35 STEP 2811 H=2811:00 +CPU= 25.248
  13:13:53 STEP 2812 H=2812:00 +CPU= 16.987
  13:14:11 STEP 2813 H=2813:00 +CPU= 16.405
  13:14:39 STEP 2814 H=2814:00 +CPU= 25.737
  13:14:57 STEP 2815 H=2815:00 +CPU= 16.534
  13:15:15 STEP 2816 H=2816:00 +CPU= 16.935
  13:15:42 STEP 2817 H=2817:00 +CPU= 25.354
  13:16:00 STEP 2818 H=2818:00 +CPU= 17.008
  13:16:18 STEP 2819 H=2819:00 +CPU= 16.617
  13:16:48 STEP 2820 H=2820:00 +CPU= 27.535
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002820
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002820
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002820
  13:17:05 STEP 2821 H=2821:00 +CPU= 16.455
  13:17:23 STEP 2822 H=2822:00 +CPU= 16.962
  13:17:51 STEP 2823 H=2823:00 +CPU= 25.286
  13:18:08 STEP 2824 H=2824:00 +CPU= 16.935
  13:18:26 STEP 2825 H=2825:00 +CPU= 16.378
  13:18:54 STEP 2826 H=2826:00 +CPU= 25.759
  13:19:12 STEP 2827 H=2827:00 +CPU= 16.502
  13:19:30 STEP 2828 H=2828:00 +CPU= 16.871
  13:19:57 STEP 2829 H=2829:00 +CPU= 25.329
  13:20:15 STEP 2830 H=2830:00 +CPU= 16.799
  13:20:33 STEP 2831 H=2831:00 +CPU= 16.504
  13:21:04 STEP 2832 H=2832:00 +CPU= 28.855
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002832
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002832
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002820
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_003q_2019110100_123_993_12213572_0_r1915204257_117.zip
Uploading the intermediate file: upload_file_117.zip
  13:21:21 STEP 2833 H=2833:00 +CPU= 16.191
Uploading trickle at timestep: 10195200
  13:21:39 STEP 2834 H=2834:00 +CPU= 16.557
  13:22:05 STEP 2835 H=2835:00 +CPU= 24.669
  13:22:22 STEP 2836 H=2836:00 +CPU= 16.218
  13:22:37 STEP 2837 H=2837:00 +CPU= 15.542
  13:23:02 STEP 2838 H=2838:00 +CPU= 24.813
  13:23:18 STEP 2839 H=2839:00 +CPU= 15.782
  13:23:34 STEP 2840 H=2840:00 +CPU= 15.969
  13:23:59 STEP 2841 H=2841:00 +CPU= 24.297
  13:24:16 STEP 2842 H=2842:00 +CPU= 16.176
  13:24:34 STEP 2843 H=2843:00 +CPU= 15.934
  13:25:01 STEP 2844 H=2844:00 +CPU= 26.611
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002844
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002844
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002844
  13:25:18 STEP 2845 H=2845:00 +CPU= 15.971
  13:25:37 STEP 2846 H=2846:00 +CPU= 16.702
  13:26:06 STEP 2847 H=2847:00 +CPU= 25.896
  13:26:25 STEP 2848 H=2848:00 +CPU= 17.527
  13:26:43 STEP 2849 H=2849:00 +CPU= 16.746
  13:27:12 STEP 2850 H=2850:00 +CPU= 26.535
  13:27:30 STEP 2851 H=2851:00 +CPU= 17.102
  13:27:49 STEP 2852 H=2852:00 +CPU= 17.223
  13:28:17 STEP 2853 H=2853:00 +CPU= 25.973
  13:28:36 STEP 2854 H=2854:00 +CPU= 17.257
  13:28:55 STEP 2855 H=2855:00 +CPU= 17.363
  13:29:28 STEP 2856 H=2856:00 +CPU= 30.385
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002856
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002856
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002844
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_003q_2019110100_123_993_12213572_0_r1915204257_118.zip
Uploading the intermediate file: upload_file_118.zip
  13:29:46 STEP 2857 H=2857:00 +CPU= 17.012
  13:30:05 STEP 2858 H=2858:00 +CPU= 17.174
  13:30:33 STEP 2859 H=2859:00 +CPU= 25.948
  13:30:51 STEP 2860 H=2860:00 +CPU= 17.451
  13:31:09 STEP 2861 H=2861:00 +CPU= 16.588
  13:31:38 STEP 2862 H=2862:00 +CPU= 26.415
  13:31:56 STEP 2863 H=2863:00 +CPU= 16.957
  13:32:15 STEP 2864 H=2864:00 +CPU= 17.042
  13:32:42 STEP 2865 H=2865:00 +CPU= 25.877
  13:33:01 STEP 2866 H=2866:00 +CPU= 17.380
  13:33:19 STEP 2867 H=2867:00 +CPU= 16.591
  13:33:49 STEP 2868 H=2868:00 +CPU= 28.318
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002868
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002868
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002868
  13:34:07 STEP 2869 H=2869:00 +CPU= 16.900
  13:34:25 STEP 2870 H=2870:00 +CPU= 17.106
  13:34:53 STEP 2871 H=2871:00 +CPU= 25.951
  13:35:12 STEP 2872 H=2872:00 +CPU= 17.442
  13:35:30 STEP 2873 H=2873:00 +CPU= 16.619
  13:35:58 STEP 2874 H=2874:00 +CPU= 26.391
  13:36:16 STEP 2875 H=2875:00 +CPU= 16.917
  13:36:35 STEP 2876 H=2876:00 +CPU= 17.005
  13:37:03 STEP 2877 H=2877:00 +CPU= 25.915
  13:37:21 STEP 2878 H=2878:00 +CPU= 17.140
  13:37:40 STEP 2879 H=2879:00 +CPU= 17.234
  13:38:13 STEP 2880 H=2880:00 +CPU= 30.448
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002880
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002880
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002868
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_003q_2019110100_123_993_12213572_0_r1915204257_119.zip
Uploading the intermediate file: upload_file_119.zip
  13:38:31 STEP 2881 H=2881:00 +CPU= 16.905
  13:38:50 STEP 2882 H=2882:00 +CPU= 16.967
  13:39:18 STEP 2883 H=2883:00 +CPU= 26.009
  13:39:36 STEP 2884 H=2884:00 +CPU= 17.180
  13:39:54 STEP 2885 H=2885:00 +CPU= 16.636
  13:40:23 STEP 2886 H=2886:00 +CPU= 26.459
  13:40:41 STEP 2887 H=2887:00 +CPU= 16.799
  13:40:59 STEP 2888 H=2888:00 +CPU= 17.049
  13:41:27 STEP 2889 H=2889:00 +CPU= 25.985
  13:41:45 STEP 2890 H=2890:00 +CPU= 17.315
  13:42:03 STEP 2891 H=2891:00 +CPU= 16.747
  13:42:34 STEP 2892 H=2892:00 +CPU= 28.354
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002892
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002892
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002892
  13:42:52 STEP 2893 H=2893:00 +CPU= 16.774
  13:43:10 STEP 2894 H=2894:00 +CPU= 17.056
  13:43:38 STEP 2895 H=2895:00 +CPU= 26.019
  13:43:57 STEP 2896 H=2896:00 +CPU= 17.236
  13:44:15 STEP 2897 H=2897:00 +CPU= 16.613
  13:44:44 STEP 2898 H=2898:00 +CPU= 26.458
  13:45:02 STEP 2899 H=2899:00 +CPU= 16.783
  13:45:20 STEP 2900 H=2900:00 +CPU= 17.009
  13:45:47 STEP 2901 H=2901:00 +CPU= 25.808
  13:46:06 STEP 2902 H=2902:00 +CPU= 17.097
  13:46:25 STEP 2903 H=2903:00 +CPU= 17.208
  13:46:58 STEP 2904 H=2904:00 +CPU= 30.482
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002904
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002904
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002892
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_003q_2019110100_123_993_12213572_0_r1915204257_120.zip
Uploading the intermediate file: upload_file_120.zip
  13:47:16 STEP 2905 H=2905:00 +CPU= 16.714
  13:47:34 STEP 2906 H=2906:00 +CPU= 17.069
  13:48:03 STEP 2907 H=2907:00 +CPU= 25.912
  13:48:21 STEP 2908 H=2908:00 +CPU= 17.107
  13:48:39 STEP 2909 H=2909:00 +CPU= 16.569
  13:49:07 STEP 2910 H=2910:00 +CPU= 26.348
  13:49:25 STEP 2911 H=2911:00 +CPU= 16.829
  13:49:44 STEP 2912 H=2912:00 +CPU= 17.045
  13:50:12 STEP 2913 H=2913:00 +CPU= 25.994
  13:50:30 STEP 2914 H=2914:00 +CPU= 17.265
  13:50:48 STEP 2915 H=2915:00 +CPU= 16.708
  13:51:19 STEP 2916 H=2916:00 +CPU= 28.338
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002916
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002916
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002916
  13:51:36 STEP 2917 H=2917:00 +CPU= 16.763
  13:51:55 STEP 2918 H=2918:00 +CPU= 17.102
  13:52:23 STEP 2919 H=2919:00 +CPU= 25.933
  13:52:41 STEP 2920 H=2920:00 +CPU= 17.395
  13:52:59 STEP 2921 H=2921:00 +CPU= 16.617
  13:53:28 STEP 2922 H=2922:00 +CPU= 26.436
  13:53:46 STEP 2923 H=2923:00 +CPU= 16.844
  13:54:04 STEP 2924 H=2924:00 +CPU= 17.037
  13:54:32 STEP 2925 H=2925:00 +CPU= 25.831
  13:54:50 STEP 2926 H=2926:00 +CPU= 17.177
  13:55:09 STEP 2927 H=2927:00 +CPU= 17.330
  13:55:42 STEP 2928 H=2928:00 +CPU= 30.334
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002928
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002928
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002916
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_003q_2019110100_123_993_12213572_0_r1915204257_121.zip
Uploading the intermediate file: upload_file_121.zip
  13:56:01 STEP 2929 H=2929:00 +CPU= 16.809
  13:56:19 STEP 2930 H=2930:00 +CPU= 17.178
  13:56:47 STEP 2931 H=2931:00 +CPU= 25.945
  13:57:06 STEP 2932 H=2932:00 +CPU= 17.352
  13:57:24 STEP 2933 H=2933:00 +CPU= 16.546
  13:57:52 STEP 2934 H=2934:00 +CPU= 26.396
  13:58:10 STEP 2935 H=2935:00 +CPU= 16.901
  13:58:28 STEP 2936 H=2936:00 +CPU= 17.001
  13:58:56 STEP 2937 H=2937:00 +CPU= 25.840
  13:59:15 STEP 2938 H=2938:00 +CPU= 17.396
  13:59:33 STEP 2939 H=2939:00 +CPU= 16.548
  14:00:03 STEP 2940 H=2940:00 +CPU= 28.314
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002940
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002940
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002940
  14:00:21 STEP 2941 H=2941:00 +CPU= 16.831
  14:00:39 STEP 2942 H=2942:00 +CPU= 17.106
  14:01:07 STEP 2943 H=2943:00 +CPU= 25.969
  14:01:26 STEP 2944 H=2944:00 +CPU= 17.283
  14:01:44 STEP 2945 H=2945:00 +CPU= 16.503
  14:02:12 STEP 2946 H=2946:00 +CPU= 26.447
  14:02:30 STEP 2947 H=2947:00 +CPU= 16.811
  14:02:48 STEP 2948 H=2948:00 +CPU= 16.912
  14:03:16 STEP 2949 H=2949:00 +CPU= 25.782
  14:03:34 STEP 2950 H=2950:00 +CPU= 17.173
  14:03:52 STEP 2951 H=2951:00 +CPU= 16.498
  14:04:18 STEP 2952 H=2952:00 +CPU= 24.949
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 STEPO, YSPSDT_AR1     (  1,...), SP NORMS 2D: 4.865283731608E-01 1.865286143845E-01 6.362598939121E-02
 STEPO, YSPSDT_AR1     (SUM,...), SP NORMS 2D: 5.260318722649E-01
 STEPO, YGPSDT         (  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  3.48989191816039E-02 -1.72994898449055E+00  1.89761310057317E+00
 STEPO, YGPSDT[clipped](  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  3.19925486346338E-02 -1.00000000000000E+00  1.00000000000000E+00
  MAXGPFV : MAX. VALUE =    1.03921726648247     
  MAXGPFV : MAX. VALUE =   0.728665338405998     
 NSTEP =  2952 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGhnw4+002952 MODE=a
 IO-STREAM CLOSED - ICMGGhnw4+002952
 MPI-TASK:   1 -    335446170 BYTES IN      8 RECORDS TRANSFERRED IN    0.0004 SECONDS838615.4 Mbytes/s, TOTAL TIME=    0.0065( 6.2%)
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302231500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302233000  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302234500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200303000000  !!!!!!!!!!!! 
 14:04:18 STEP 2952 H=2952:00 +CPU= 24.949
 END CNT3
 NSTEP =  2952 CNT0   000000000  21.287  21.287  22.039   0.966               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           35/   804992476 WRITTEN        13055/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    318    0       35       786125    13055 ************    53.7     2.9    50.8     3.5    79.8
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.98      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                  911    2056.2    2056.2     10.83      0.00
   9 SPCM     - SPECTRAL COMP.                     840     335.3     335.3      1.63      0.00
  10 SCAN2M - PHYSICS                              841    8308.5    8308.5     40.40      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                 70    1121.3    1121.3      0.45      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 36      12.1      12.1      0.00      0.00
  13 SCAN2M - RADIATION CALC.                      281    8770.2    8770.2     14.25      0.00
  17 GRIDFPOS IN CNT4                               70      36.0      36.0      0.01      0.00
  27 RESTART FILES - WRITING                        35    2242.6    2242.6      0.45      0.00
  28 RESTART FILES - READING                         1    3877.9    3877.9      0.02      0.00
  29 SU4FPOS IN CNT4                                70       0.0       0.0      0.00      0.00
  30 DYNFPOS IN CNT4                                70    1650.0    1650.0      0.67      0.00
  31 POSDDH IN STEPO                                 4       0.6       0.6      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                    841    3029.6    3029.6     14.73      0.00
  38 WAM      - TOTAL COST OF WAVE MODEL           841    2063.4    2063.4     10.03      0.00
  39 SU0YOMB                                         1     240.1     240.1      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                    841      21.0      21.0      0.10      0.00
  54 SPCM     - M TO S/S TO M TRANSP.              840     291.7     291.7      1.42      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.              840      54.1      54.1      0.26      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 36       0.1       0.1      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     2876     114.7     114.7      1.91      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      1750     111.6     111.6      1.13      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       1750      46.1      46.1      0.47      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      2876      38.4      38.4      0.64      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            2      13.9      13.9      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           2876      20.7      20.7      0.34      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           1750      18.1      18.1      0.18      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           2876      18.4      18.4      0.31      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           1750      12.7      12.7      0.13      0.00
 400 GSTATS                                     168230       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                161072       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    17297.1 CPU TIME   16295.6 VECTOR TIME    16295.6


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY      614.5
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGhnw4+002952
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHhnw4+002952
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAhnw4+002952
Adding to the zip: /var/lib/boinc-client/slots/1/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/1/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMSHhnw4+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMGGhnw4+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213572/ICMUAhnw4+002952
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_003q_2019110100_123_993_12213572_0_r1915204257_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
14:07:40 (4582): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:53:42 1527784 22314918 oifs_43r3_003q_2019110100_123_993_12213572_0 10,623,600 55,172 0.0052
09 May 2023 16:53:39 1527784 22314918 oifs_43r3_003q_2019110100_123_993_12213572_0 10,195,200 52,756 0.0052
09 May 2023 16:53:36 1527784 22314918 oifs_43r3_003q_2019110100_123_993_12213572_0 9,331,200 48,075 0.0052
09 May 2023 16:53:34 1527784 22314918 oifs_43r3_003q_2019110100_123_993_12213572_0 8,467,200 43,488 0.0051
09 May 2023 16:52:54 1527784 22314918 oifs_43r3_003q_2019110100_123_993_12213572_0 6,912,000 35,073 0.0051
09 May 2023 16:52:52 1527784 22314918 oifs_43r3_003q_2019110100_123_993_12213572_0 6,048,000 30,705 0.0051
09 May 2023 16:52:49 1527784 22314918 oifs_43r3_003q_2019110100_123_993_12213572_0 5,184,000 26,352 0.0051
09 May 2023 16:52:47 1527784 22314918 oifs_43r3_003q_2019110100_123_993_12213572_0 4,320,000 21,938 0.0051
09 May 2023 16:52:43 1527784 22314918 oifs_43r3_003q_2019110100_123_993_12213572_0 3,456,000 17,453 0.0051
09 May 2023 16:52:41 1527784 22314918 oifs_43r3_003q_2019110100_123_993_12213572_0 2,592,000 13,004 0.0050
09 May 2023 16:52:39 1527784 22314918 oifs_43r3_003q_2019110100_123_993_12213572_0 1,728,000 8,564 0.0050
09 May 2023 16:52:38 1527784 22314918 oifs_43r3_003q_2019110100_123_993_12213572_0 864,000 4,260 0.0049


©2024 climateprediction.net