climateprediction.net home page
Task 22315067

Task 22315067

Name oifs_43r3_007u_2019110100_123_993_12213720_0
Workunit 12213720
Created 24 Feb 2023, 12:28:30 UTC
Sent 24 Feb 2023, 12:41:37 UTC
Report deadline 25 Apr 2023, 12:41:37 UTC
Received 25 Feb 2023, 3:57:33 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1513725
Run time 12 hours 49 min 12 sec
CPU time 12 hours 39 min 14 sec
Validate state Valid
Credit 14,515.20
Device peak FLOPS 8.33 GFLOPS
Application version OpenIFS 43r3 v1.21
x86_64-pc-linux-gnu
Peak working set size 4,415.71 MB
Peak swap size 4,974.29 MB
Peak disk usage 1,268.90 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<stderr_txt>
9:44 STEP 2371 H=2371:00 +CPU= 13.031
  01:49:56 STEP 2372 H=2372:00 +CPU= 12.518
  01:50:16 STEP 2373 H=2373:00 +CPU= 19.313
  01:50:29 STEP 2374 H=2374:00 +CPU= 12.910
  01:50:41 STEP 2375 H=2375:00 +CPU= 12.534
  01:51:05 STEP 2376 H=2376:00 +CPU= 23.936
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002376
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002376
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002352
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002364
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007u_2019110100_123_993_12213720_0_r40207961_98.zip
Uploading the intermediate file: upload_file_98.zip
  01:51:18 STEP 2377 H=2377:00 +CPU= 12.798
  01:51:31 STEP 2378 H=2378:00 +CPU= 12.701
  01:51:52 STEP 2379 H=2379:00 +CPU= 20.275
  01:52:04 STEP 2380 H=2380:00 +CPU= 12.493
  01:52:16 STEP 2381 H=2381:00 +CPU= 12.011
  01:52:38 STEP 2382 H=2382:00 +CPU= 21.593
  01:52:51 STEP 2383 H=2383:00 +CPU= 13.077
  01:53:04 STEP 2384 H=2384:00 +CPU= 13.079
  01:53:25 STEP 2385 H=2385:00 +CPU= 20.605
  01:53:37 STEP 2386 H=2386:00 +CPU= 12.622
  01:53:49 STEP 2387 H=2387:00 +CPU= 12.052
  01:54:11 STEP 2388 H=2388:00 +CPU= 21.560
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002388
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002388
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002388
  01:54:23 STEP 2389 H=2389:00 +CPU= 12.009
  01:54:36 STEP 2390 H=2390:00 +CPU= 12.931
  01:54:56 STEP 2391 H=2391:00 +CPU= 19.740
  01:55:08 STEP 2392 H=2392:00 +CPU= 12.527
  01:55:22 STEP 2393 H=2393:00 +CPU= 13.470
  01:55:42 STEP 2394 H=2394:00 +CPU= 20.678
  01:55:54 STEP 2395 H=2395:00 +CPU= 11.769
  01:56:07 STEP 2396 H=2396:00 +CPU= 12.698
  01:56:27 STEP 2397 H=2397:00 +CPU= 19.532
  01:56:39 STEP 2398 H=2398:00 +CPU= 12.950
  01:56:53 STEP 2399 H=2399:00 +CPU= 13.548
  01:57:17 STEP 2400 H=2400:00 +CPU= 24.018
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002400
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002400
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002376
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002388
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002388
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002388
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007u_2019110100_123_993_12213720_0_r40207961_99.zip
Uploading the intermediate file: upload_file_99.zip
  01:57:29 STEP 2401 H=2401:00 +CPU= 12.040
  01:57:42 STEP 2402 H=2402:00 +CPU= 12.572
Uploading trickle at timestep: 8640000
  01:58:02 STEP 2403 H=2403:00 +CPU= 19.708
  01:58:15 STEP 2404 H=2404:00 +CPU= 13.128
  01:58:28 STEP 2405 H=2405:00 +CPU= 12.628
  01:58:47 STEP 2406 H=2406:00 +CPU= 19.766
  01:59:00 STEP 2407 H=2407:00 +CPU= 12.709
  01:59:13 STEP 2408 H=2408:00 +CPU= 12.413
  01:59:33 STEP 2409 H=2409:00 +CPU= 20.662
  01:59:46 STEP 2410 H=2410:00 +CPU= 12.354
  01:59:58 STEP 2411 H=2411:00 +CPU= 12.297
  02:00:21 STEP 2412 H=2412:00 +CPU= 22.701
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002412
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002412
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002412
  02:00:33 STEP 2413 H=2413:00 +CPU= 12.282
  02:00:46 STEP 2414 H=2414:00 +CPU= 12.849
  02:01:06 STEP 2415 H=2415:00 +CPU= 20.281
  02:01:20 STEP 2416 H=2416:00 +CPU= 13.246
  02:01:32 STEP 2417 H=2417:00 +CPU= 12.815
  02:01:53 STEP 2418 H=2418:00 +CPU= 20.869
  02:02:05 STEP 2419 H=2419:00 +CPU= 12.127
  02:02:18 STEP 2420 H=2420:00 +CPU= 12.678
  02:02:39 STEP 2421 H=2421:00 +CPU= 20.541
  02:02:51 STEP 2422 H=2422:00 +CPU= 12.645
  02:03:04 STEP 2423 H=2423:00 +CPU= 12.057
  02:03:26 STEP 2424 H=2424:00 +CPU= 22.413
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002424
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002424
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002400
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002412
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002412
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007u_2019110100_123_993_12213720_0_r40207961_100.zip
Uploading the intermediate file: upload_file_100.zip
  02:03:39 STEP 2425 H=2425:00 +CPU= 12.456
  02:03:51 STEP 2426 H=2426:00 +CPU= 12.534
  02:04:11 STEP 2427 H=2427:00 +CPU= 20.264
  02:04:24 STEP 2428 H=2428:00 +CPU= 12.862
  02:04:37 STEP 2429 H=2429:00 +CPU= 12.456
  02:04:58 STEP 2430 H=2430:00 +CPU= 21.157
  02:05:10 STEP 2431 H=2431:00 +CPU= 11.921
  02:05:23 STEP 2432 H=2432:00 +CPU= 12.736
  02:05:43 STEP 2433 H=2433:00 +CPU= 19.916
  02:05:55 STEP 2434 H=2434:00 +CPU= 12.391
  02:06:08 STEP 2435 H=2435:00 +CPU= 12.876
  02:06:30 STEP 2436 H=2436:00 +CPU= 22.055
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002436
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002436
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002436
  02:06:42 STEP 2437 H=2437:00 +CPU= 12.272
  02:06:56 STEP 2438 H=2438:00 +CPU= 13.073
  02:07:16 STEP 2439 H=2439:00 +CPU= 20.039
  02:07:28 STEP 2440 H=2440:00 +CPU= 12.476
  02:07:41 STEP 2441 H=2441:00 +CPU= 12.746
  02:08:02 STEP 2442 H=2442:00 +CPU= 20.935
  02:08:14 STEP 2443 H=2443:00 +CPU= 12.399
  02:08:28 STEP 2444 H=2444:00 +CPU= 13.192
  02:08:48 STEP 2445 H=2445:00 +CPU= 20.452
  02:09:01 STEP 2446 H=2446:00 +CPU= 12.640
  02:09:14 STEP 2447 H=2447:00 +CPU= 13.094
  02:09:38 STEP 2448 H=2448:00 +CPU= 23.699
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002448
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002448
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002424
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002436
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002436
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007u_2019110100_123_993_12213720_0_r40207961_101.zip
Uploading the intermediate file: upload_file_101.zip
  02:09:50 STEP 2449 H=2449:00 +CPU= 12.450
  02:10:04 STEP 2450 H=2450:00 +CPU= 13.442
  02:10:25 STEP 2451 H=2451:00 +CPU= 20.664
  02:10:37 STEP 2452 H=2452:00 +CPU= 12.544
  02:10:49 STEP 2453 H=2453:00 +CPU= 11.802
  02:11:09 STEP 2454 H=2454:00 +CPU= 20.515
  02:11:22 STEP 2455 H=2455:00 +CPU= 12.233
  02:11:35 STEP 2456 H=2456:00 +CPU= 13.027
  02:11:55 STEP 2457 H=2457:00 +CPU= 20.293
  02:12:08 STEP 2458 H=2458:00 +CPU= 13.000
  02:12:21 STEP 2459 H=2459:00 +CPU= 12.496
  02:12:44 STEP 2460 H=2460:00 +CPU= 22.968
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002460
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002460
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002460
  02:12:56 STEP 2461 H=2461:00 +CPU= 12.333
  02:13:09 STEP 2462 H=2462:00 +CPU= 13.414
  02:13:29 STEP 2463 H=2463:00 +CPU= 19.984
  02:13:41 STEP 2464 H=2464:00 +CPU= 12.024
  02:13:54 STEP 2465 H=2465:00 +CPU= 12.789
  02:14:15 STEP 2466 H=2466:00 +CPU= 20.426
  02:14:27 STEP 2467 H=2467:00 +CPU= 12.237
  02:14:40 STEP 2468 H=2468:00 +CPU= 13.056
  02:15:00 STEP 2469 H=2469:00 +CPU= 20.160
  02:15:13 STEP 2470 H=2470:00 +CPU= 12.935
  02:15:26 STEP 2471 H=2471:00 +CPU= 12.538
  02:15:48 STEP 2472 H=2472:00 +CPU= 21.752
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002472
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002472
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002460
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007u_2019110100_123_993_12213720_0_r40207961_102.zip
Uploading the intermediate file: upload_file_102.zip
  02:16:00 STEP 2473 H=2473:00 +CPU= 12.090
  02:16:13 STEP 2474 H=2474:00 +CPU= 13.255
  02:16:33 STEP 2475 H=2475:00 +CPU= 20.149
  02:16:47 STEP 2476 H=2476:00 +CPU= 13.521
  02:17:00 STEP 2477 H=2477:00 +CPU= 12.747
  02:17:21 STEP 2478 H=2478:00 +CPU= 21.343
  02:17:34 STEP 2479 H=2479:00 +CPU= 12.618
  02:17:46 STEP 2480 H=2480:00 +CPU= 12.584
  02:18:07 STEP 2481 H=2481:00 +CPU= 20.622
  02:18:20 STEP 2482 H=2482:00 +CPU= 12.681
  02:18:32 STEP 2483 H=2483:00 +CPU= 12.195
  02:18:54 STEP 2484 H=2484:00 +CPU= 22.060
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002484
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002484
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002484
  02:19:06 STEP 2485 H=2485:00 +CPU= 12.544
  02:19:19 STEP 2486 H=2486:00 +CPU= 12.384
  02:19:39 STEP 2487 H=2487:00 +CPU= 20.485
  02:19:53 STEP 2488 H=2488:00 +CPU= 13.270
  02:20:06 STEP 2489 H=2489:00 +CPU= 12.903
  02:20:27 STEP 2490 H=2490:00 +CPU= 21.072
  02:20:39 STEP 2491 H=2491:00 +CPU= 12.111
  02:20:52 STEP 2492 H=2492:00 +CPU= 12.911
  02:21:11 STEP 2493 H=2493:00 +CPU= 19.372
  02:21:24 STEP 2494 H=2494:00 +CPU= 12.818
  02:21:37 STEP 2495 H=2495:00 +CPU= 13.264
  02:22:01 STEP 2496 H=2496:00 +CPU= 23.560
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002496
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002496
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002484
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007u_2019110100_123_993_12213720_0_r40207961_103.zip
Uploading the intermediate file: upload_file_103.zip
  02:22:14 STEP 2497 H=2497:00 +CPU= 12.855
  02:22:27 STEP 2498 H=2498:00 +CPU= 13.175
  02:22:47 STEP 2499 H=2499:00 +CPU= 19.883
  02:23:01 STEP 2500 H=2500:00 +CPU= 13.258
  02:23:13 STEP 2501 H=2501:00 +CPU= 12.364
  02:23:33 STEP 2502 H=2502:00 +CPU= 20.058
  02:23:45 STEP 2503 H=2503:00 +CPU= 12.268
  02:23:59 STEP 2504 H=2504:00 +CPU= 13.072
  02:24:18 STEP 2505 H=2505:00 +CPU= 19.627
  02:24:31 STEP 2506 H=2506:00 +CPU= 12.369
  02:24:43 STEP 2507 H=2507:00 +CPU= 12.510
  02:25:04 STEP 2508 H=2508:00 +CPU= 21.099
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002508
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002508
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002508
  02:25:16 STEP 2509 H=2509:00 +CPU= 11.942
  02:25:29 STEP 2510 H=2510:00 +CPU= 12.707
  02:25:49 STEP 2511 H=2511:00 +CPU= 20.379
  02:26:02 STEP 2512 H=2512:00 +CPU= 12.820
  02:26:15 STEP 2513 H=2513:00 +CPU= 12.640
  02:26:36 STEP 2514 H=2514:00 +CPU= 20.711
  02:26:48 STEP 2515 H=2515:00 +CPU= 11.962
  02:27:00 STEP 2516 H=2516:00 +CPU= 12.343
  02:27:21 STEP 2517 H=2517:00 +CPU= 20.551
  02:27:34 STEP 2518 H=2518:00 +CPU= 13.460
  02:27:46 STEP 2519 H=2519:00 +CPU= 12.272
  02:28:09 STEP 2520 H=2520:00 +CPU= 22.475
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002520
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002520
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002508
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007u_2019110100_123_993_12213720_0_r40207961_104.zip
Uploading the intermediate file: upload_file_104.zip
  02:28:22 STEP 2521 H=2521:00 +CPU= 12.409
  02:28:34 STEP 2522 H=2522:00 +CPU= 12.624
  02:28:55 STEP 2523 H=2523:00 +CPU= 20.306
  02:29:08 STEP 2524 H=2524:00 +CPU= 13.256
  02:29:21 STEP 2525 H=2525:00 +CPU= 12.773
  02:29:42 STEP 2526 H=2526:00 +CPU= 21.081
  02:29:54 STEP 2527 H=2527:00 +CPU= 11.996
  02:30:07 STEP 2528 H=2528:00 +CPU= 12.648
  02:30:27 STEP 2529 H=2529:00 +CPU= 19.339
  02:30:39 STEP 2530 H=2530:00 +CPU= 12.340
  02:30:51 STEP 2531 H=2531:00 +CPU= 11.781
  02:31:13 STEP 2532 H=2532:00 +CPU= 22.267
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002532
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002532
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002532
  02:31:25 STEP 2533 H=2533:00 +CPU= 11.679
  02:31:37 STEP 2534 H=2534:00 +CPU= 12.394
  02:31:57 STEP 2535 H=2535:00 +CPU= 19.604
  02:32:09 STEP 2536 H=2536:00 +CPU= 12.349
  02:32:21 STEP 2537 H=2537:00 +CPU= 12.253
  02:32:42 STEP 2538 H=2538:00 +CPU= 20.181
  02:32:54 STEP 2539 H=2539:00 +CPU= 11.928
  02:33:06 STEP 2540 H=2540:00 +CPU= 12.459
  02:33:26 STEP 2541 H=2541:00 +CPU= 19.925
  02:33:39 STEP 2542 H=2542:00 +CPU= 12.989
  02:33:52 STEP 2543 H=2543:00 +CPU= 12.388
  02:34:14 STEP 2544 H=2544:00 +CPU= 22.470
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002544
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002544
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002532
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007u_2019110100_123_993_12213720_0_r40207961_105.zip
Uploading the intermediate file: upload_file_105.zip
  02:34:26 STEP 2545 H=2545:00 +CPU= 11.890
  02:34:39 STEP 2546 H=2546:00 +CPU= 12.968
  02:34:59 STEP 2547 H=2547:00 +CPU= 20.111
  02:35:12 STEP 2548 H=2548:00 +CPU= 12.591
  02:35:25 STEP 2549 H=2549:00 +CPU= 12.530
  02:35:45 STEP 2550 H=2550:00 +CPU= 20.099
  02:35:58 STEP 2551 H=2551:00 +CPU= 12.785
  02:36:11 STEP 2552 H=2552:00 +CPU= 13.339
  02:36:31 STEP 2553 H=2553:00 +CPU= 19.922
  02:36:44 STEP 2554 H=2554:00 +CPU= 13.040
  02:36:56 STEP 2555 H=2555:00 +CPU= 12.501
  02:37:18 STEP 2556 H=2556:00 +CPU= 21.791
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002556
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002556
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002556
  02:37:30 STEP 2557 H=2557:00 +CPU= 11.716
  02:37:43 STEP 2558 H=2558:00 +CPU= 13.391
  02:38:03 STEP 2559 H=2559:00 +CPU= 19.985
  02:38:17 STEP 2560 H=2560:00 +CPU= 13.042
  02:38:29 STEP 2561 H=2561:00 +CPU= 12.190
  02:38:49 STEP 2562 H=2562:00 +CPU= 19.817
  02:39:01 STEP 2563 H=2563:00 +CPU= 12.428
  02:39:14 STEP 2564 H=2564:00 +CPU= 12.908
  02:39:34 STEP 2565 H=2565:00 +CPU= 19.949
  02:39:48 STEP 2566 H=2566:00 +CPU= 13.544
  02:40:01 STEP 2567 H=2567:00 +CPU= 13.174
  02:40:24 STEP 2568 H=2568:00 +CPU= 23.469
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002568
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002568
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002556
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007u_2019110100_123_993_12213720_0_r40207961_106.zip
Uploading the intermediate file: upload_file_106.zip
  02:40:37 STEP 2569 H=2569:00 +CPU= 12.281
  02:40:49 STEP 2570 H=2570:00 +CPU= 12.333
  02:41:08 STEP 2571 H=2571:00 +CPU= 19.011
  02:41:22 STEP 2572 H=2572:00 +CPU= 13.204
  02:41:34 STEP 2573 H=2573:00 +CPU= 12.408
  02:41:55 STEP 2574 H=2574:00 +CPU= 20.617
  02:42:07 STEP 2575 H=2575:00 +CPU= 11.984
  02:42:19 STEP 2576 H=2576:00 +CPU= 12.349
  02:42:39 STEP 2577 H=2577:00 +CPU= 20.234
  02:42:53 STEP 2578 H=2578:00 +CPU= 13.441
  02:43:06 STEP 2579 H=2579:00 +CPU= 12.765
  02:43:27 STEP 2580 H=2580:00 +CPU= 21.254
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002580
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002580
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002580
  02:43:40 STEP 2581 H=2581:00 +CPU= 12.749
  02:43:52 STEP 2582 H=2582:00 +CPU= 12.807
  02:44:12 STEP 2583 H=2583:00 +CPU= 19.257
  02:44:24 STEP 2584 H=2584:00 +CPU= 12.637
  02:44:37 STEP 2585 H=2585:00 +CPU= 12.526
  02:44:57 STEP 2586 H=2586:00 +CPU= 19.960
  02:45:09 STEP 2587 H=2587:00 +CPU= 12.477
  02:45:23 STEP 2588 H=2588:00 +CPU= 13.159
  02:45:43 STEP 2589 H=2589:00 +CPU= 19.910
  02:45:55 STEP 2590 H=2590:00 +CPU= 12.171
  02:46:08 STEP 2591 H=2591:00 +CPU= 12.988
  02:46:31 STEP 2592 H=2592:00 +CPU= 22.519
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002592
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002592
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002580
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007u_2019110100_123_993_12213720_0_r40207961_107.zip
Uploading the intermediate file: upload_file_107.zip
  02:46:44 STEP 2593 H=2593:00 +CPU= 12.845
  02:46:56 STEP 2594 H=2594:00 +CPU= 12.280
  02:47:17 STEP 2595 H=2595:00 +CPU= 20.639
  02:47:29 STEP 2596 H=2596:00 +CPU= 12.757
  02:47:42 STEP 2597 H=2597:00 +CPU= 12.693
  02:48:03 STEP 2598 H=2598:00 +CPU= 20.541
  02:48:15 STEP 2599 H=2599:00 +CPU= 12.095
  02:48:28 STEP 2600 H=2600:00 +CPU= 13.286
  02:48:49 STEP 2601 H=2601:00 +CPU= 20.752
  02:49:02 STEP 2602 H=2602:00 +CPU= 12.416
  02:49:14 STEP 2603 H=2603:00 +CPU= 12.744
  02:49:36 STEP 2604 H=2604:00 +CPU= 21.435
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002604
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002604
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002604
  02:49:49 STEP 2605 H=2605:00 +CPU= 12.731
  02:50:01 STEP 2606 H=2606:00 +CPU= 12.929
  02:50:21 STEP 2607 H=2607:00 +CPU= 19.387
  02:50:33 STEP 2608 H=2608:00 +CPU= 12.192
  02:50:45 STEP 2609 H=2609:00 +CPU= 12.008
  02:51:06 STEP 2610 H=2610:00 +CPU= 20.757
  02:51:18 STEP 2611 H=2611:00 +CPU= 12.534
  02:51:31 STEP 2612 H=2612:00 +CPU= 12.201
  02:51:50 STEP 2613 H=2613:00 +CPU= 19.638
  02:52:04 STEP 2614 H=2614:00 +CPU= 13.454
  02:52:16 STEP 2615 H=2615:00 +CPU= 12.533
  02:52:40 STEP 2616 H=2616:00 +CPU= 23.161
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002616
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002616
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002604
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007u_2019110100_123_993_12213720_0_r40207961_108.zip
Uploading the intermediate file: upload_file_108.zip
  02:52:52 STEP 2617 H=2617:00 +CPU= 12.322
  02:53:06 STEP 2618 H=2618:00 +CPU= 13.050
  02:53:27 STEP 2619 H=2619:00 +CPU= 21.014
  02:53:39 STEP 2620 H=2620:00 +CPU= 12.460
  02:53:51 STEP 2621 H=2621:00 +CPU= 12.436
  02:54:13 STEP 2622 H=2622:00 +CPU= 21.456
  02:54:25 STEP 2623 H=2623:00 +CPU= 11.931
  02:54:37 STEP 2624 H=2624:00 +CPU= 12.323
  02:54:57 STEP 2625 H=2625:00 +CPU= 19.523
  02:55:08 STEP 2626 H=2626:00 +CPU= 11.532
  02:55:22 STEP 2627 H=2627:00 +CPU= 13.150
  02:55:44 STEP 2628 H=2628:00 +CPU= 22.015
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002628
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002628
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002628
  02:55:56 STEP 2629 H=2629:00 +CPU= 11.875
  02:56:07 STEP 2630 H=2630:00 +CPU= 11.709
  02:56:27 STEP 2631 H=2631:00 +CPU= 19.358
  02:56:39 STEP 2632 H=2632:00 +CPU= 12.451
  02:56:52 STEP 2633 H=2633:00 +CPU= 12.404
  02:57:12 STEP 2634 H=2634:00 +CPU= 20.213
  02:57:24 STEP 2635 H=2635:00 +CPU= 12.367
  02:57:37 STEP 2636 H=2636:00 +CPU= 12.918
  02:57:58 STEP 2637 H=2637:00 +CPU= 20.266
  02:58:10 STEP 2638 H=2638:00 +CPU= 12.922
  02:58:23 STEP 2639 H=2639:00 +CPU= 12.534
  02:58:47 STEP 2640 H=2640:00 +CPU= 23.417
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002640
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002640
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002628
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007u_2019110100_123_993_12213720_0_r40207961_109.zip
Uploading the intermediate file: upload_file_109.zip
  02:59:00 STEP 2641 H=2641:00 +CPU= 12.635
Uploading trickle at timestep: 9504000
  02:59:13 STEP 2642 H=2642:00 +CPU= 12.813
  02:59:33 STEP 2643 H=2643:00 +CPU= 20.280
  02:59:46 STEP 2644 H=2644:00 +CPU= 12.830
  02:59:58 STEP 2645 H=2645:00 +CPU= 12.114
  03:00:19 STEP 2646 H=2646:00 +CPU= 20.728
  03:00:31 STEP 2647 H=2647:00 +CPU= 12.756
  03:00:44 STEP 2648 H=2648:00 +CPU= 12.923
  03:01:04 STEP 2649 H=2649:00 +CPU= 19.664
  03:01:17 STEP 2650 H=2650:00 +CPU= 12.886
  03:01:30 STEP 2651 H=2651:00 +CPU= 12.357
  03:01:51 STEP 2652 H=2652:00 +CPU= 21.905
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002652
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002652
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002652
  03:02:04 STEP 2653 H=2653:00 +CPU= 12.560
  03:02:16 STEP 2654 H=2654:00 +CPU= 12.098
  03:02:35 STEP 2655 H=2655:00 +CPU= 18.983
  03:02:48 STEP 2656 H=2656:00 +CPU= 12.725
  03:03:00 STEP 2657 H=2657:00 +CPU= 12.505
  03:03:20 STEP 2658 H=2658:00 +CPU= 19.894
  03:03:33 STEP 2659 H=2659:00 +CPU= 12.685
  03:03:46 STEP 2660 H=2660:00 +CPU= 12.603
  03:04:06 STEP 2661 H=2661:00 +CPU= 20.554
  03:04:19 STEP 2662 H=2662:00 +CPU= 12.499
  03:04:31 STEP 2663 H=2663:00 +CPU= 12.640
  03:04:55 STEP 2664 H=2664:00 +CPU= 23.432
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002664
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002664
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002652
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007u_2019110100_123_993_12213720_0_r40207961_110.zip
Uploading the intermediate file: upload_file_110.zip
  03:05:08 STEP 2665 H=2665:00 +CPU= 12.341
  03:05:20 STEP 2666 H=2666:00 +CPU= 12.773
  03:05:41 STEP 2667 H=2667:00 +CPU= 20.458
  03:05:54 STEP 2668 H=2668:00 +CPU= 12.834
  03:06:06 STEP 2669 H=2669:00 +CPU= 12.329
  03:06:27 STEP 2670 H=2670:00 +CPU= 20.572
  03:06:38 STEP 2671 H=2671:00 +CPU= 11.745
  03:06:51 STEP 2672 H=2672:00 +CPU= 12.801
  03:07:12 STEP 2673 H=2673:00 +CPU= 20.161
  03:07:25 STEP 2674 H=2674:00 +CPU= 13.505
  03:07:38 STEP 2675 H=2675:00 +CPU= 12.817
  03:08:01 STEP 2676 H=2676:00 +CPU= 22.659
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002676
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002676
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002676
  03:08:13 STEP 2677 H=2677:00 +CPU= 11.963
  03:08:26 STEP 2678 H=2678:00 +CPU= 13.225
  03:08:46 STEP 2679 H=2679:00 +CPU= 19.825
  03:08:59 STEP 2680 H=2680:00 +CPU= 13.087
  03:09:12 STEP 2681 H=2681:00 +CPU= 13.028
  03:09:31 STEP 2682 H=2682:00 +CPU= 19.161
  03:09:44 STEP 2683 H=2683:00 +CPU= 12.731
  03:09:57 STEP 2684 H=2684:00 +CPU= 12.769
  03:10:18 STEP 2685 H=2685:00 +CPU= 21.230
  03:10:31 STEP 2686 H=2686:00 +CPU= 12.639
  03:10:44 STEP 2687 H=2687:00 +CPU= 13.030
  03:11:08 STEP 2688 H=2688:00 +CPU= 23.295
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002688
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002688
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002676
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007u_2019110100_123_993_12213720_0_r40207961_111.zip
Uploading the intermediate file: upload_file_111.zip
  03:11:20 STEP 2689 H=2689:00 +CPU= 12.426
  03:11:33 STEP 2690 H=2690:00 +CPU= 12.529
  03:11:53 STEP 2691 H=2691:00 +CPU= 20.834
  03:12:06 STEP 2692 H=2692:00 +CPU= 12.721
  03:12:19 STEP 2693 H=2693:00 +CPU= 12.932
  03:12:41 STEP 2694 H=2694:00 +CPU= 21.517
  03:12:53 STEP 2695 H=2695:00 +CPU= 12.493
  03:13:06 STEP 2696 H=2696:00 +CPU= 12.556
  03:13:26 STEP 2697 H=2697:00 +CPU= 20.162
  03:13:39 STEP 2698 H=2698:00 +CPU= 13.003
  03:13:52 STEP 2699 H=2699:00 +CPU= 13.403
  03:14:15 STEP 2700 H=2700:00 +CPU= 22.449
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002700
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002700
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002700
  03:14:27 STEP 2701 H=2701:00 +CPU= 12.092
  03:14:40 STEP 2702 H=2702:00 +CPU= 12.752
  03:15:00 STEP 2703 H=2703:00 +CPU= 20.315
  03:15:13 STEP 2704 H=2704:00 +CPU= 12.771
  03:15:25 STEP 2705 H=2705:00 +CPU= 12.466
  03:15:46 STEP 2706 H=2706:00 +CPU= 20.853
  03:15:58 STEP 2707 H=2707:00 +CPU= 12.104
  03:16:11 STEP 2708 H=2708:00 +CPU= 13.004
  03:16:32 STEP 2709 H=2709:00 +CPU= 20.655
  03:16:45 STEP 2710 H=2710:00 +CPU= 12.965
  03:16:58 STEP 2711 H=2711:00 +CPU= 12.709
  03:17:21 STEP 2712 H=2712:00 +CPU= 23.142
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002712
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002712
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002700
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007u_2019110100_123_993_12213720_0_r40207961_112.zip
Uploading the intermediate file: upload_file_112.zip
  03:17:34 STEP 2713 H=2713:00 +CPU= 12.493
  03:17:46 STEP 2714 H=2714:00 +CPU= 12.152
  03:18:06 STEP 2715 H=2715:00 +CPU= 20.274
  03:18:19 STEP 2716 H=2716:00 +CPU= 12.466
  03:18:31 STEP 2717 H=2717:00 +CPU= 12.368
  03:18:52 STEP 2718 H=2718:00 +CPU= 20.498
  03:19:04 STEP 2719 H=2719:00 +CPU= 12.192
  03:19:16 STEP 2720 H=2720:00 +CPU= 12.306
  03:19:36 STEP 2721 H=2721:00 +CPU= 20.021
  03:19:49 STEP 2722 H=2722:00 +CPU= 12.801
  03:20:01 STEP 2723 H=2723:00 +CPU= 12.168
  03:20:24 STEP 2724 H=2724:00 +CPU= 22.366
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002724
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002724
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002724
  03:20:36 STEP 2725 H=2725:00 +CPU= 12.205
  03:20:49 STEP 2726 H=2726:00 +CPU= 12.793
  03:21:09 STEP 2727 H=2727:00 +CPU= 19.692
  03:21:22 STEP 2728 H=2728:00 +CPU= 13.576
  03:21:34 STEP 2729 H=2729:00 +CPU= 11.791
  03:21:54 STEP 2730 H=2730:00 +CPU= 20.159
  03:22:05 STEP 2731 H=2731:00 +CPU= 11.019
  03:22:17 STEP 2732 H=2732:00 +CPU= 11.810
  03:22:37 STEP 2733 H=2733:00 +CPU= 20.255
  03:22:50 STEP 2734 H=2734:00 +CPU= 12.712
  03:23:03 STEP 2735 H=2735:00 +CPU= 12.770
  03:23:27 STEP 2736 H=2736:00 +CPU= 24.332
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002736
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002736
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002724
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007u_2019110100_123_993_12213720_0_r40207961_113.zip
Uploading the intermediate file: upload_file_113.zip
  03:23:40 STEP 2737 H=2737:00 +CPU= 12.491
  03:23:53 STEP 2738 H=2738:00 +CPU= 13.327
  03:24:13 STEP 2739 H=2739:00 +CPU= 19.572
  03:24:27 STEP 2740 H=2740:00 +CPU= 13.564
  03:24:39 STEP 2741 H=2741:00 +CPU= 12.282
  03:25:00 STEP 2742 H=2742:00 +CPU= 20.747
  03:25:12 STEP 2743 H=2743:00 +CPU= 11.930
  03:25:24 STEP 2744 H=2744:00 +CPU= 12.658
  03:25:44 STEP 2745 H=2745:00 +CPU= 20.108
  03:25:57 STEP 2746 H=2746:00 +CPU= 12.662
  03:26:09 STEP 2747 H=2747:00 +CPU= 12.084
  03:26:31 STEP 2748 H=2748:00 +CPU= 21.437
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002748
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002748
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002748
  03:26:42 STEP 2749 H=2749:00 +CPU= 11.683
  03:26:55 STEP 2750 H=2750:00 +CPU= 12.313
  03:27:14 STEP 2751 H=2751:00 +CPU= 18.825
  03:27:26 STEP 2752 H=2752:00 +CPU= 12.259
  03:27:37 STEP 2753 H=2753:00 +CPU= 11.349
  03:27:57 STEP 2754 H=2754:00 +CPU= 19.650
  03:28:09 STEP 2755 H=2755:00 +CPU= 12.567
  03:28:22 STEP 2756 H=2756:00 +CPU= 12.326
  03:28:41 STEP 2757 H=2757:00 +CPU= 19.069
  03:28:54 STEP 2758 H=2758:00 +CPU= 12.608
  03:29:06 STEP 2759 H=2759:00 +CPU= 12.627
  03:29:30 STEP 2760 H=2760:00 +CPU= 23.373
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002760
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002760
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002748
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007u_2019110100_123_993_12213720_0_r40207961_114.zip
Uploading the intermediate file: upload_file_114.zip
  03:29:42 STEP 2761 H=2761:00 +CPU= 12.260
  03:29:56 STEP 2762 H=2762:00 +CPU= 13.570
  03:30:16 STEP 2763 H=2763:00 +CPU= 20.313
  03:30:29 STEP 2764 H=2764:00 +CPU= 13.159
  03:30:43 STEP 2765 H=2765:00 +CPU= 13.160
  03:31:03 STEP 2766 H=2766:00 +CPU= 20.357
  03:31:15 STEP 2767 H=2767:00 +CPU= 12.162
  03:31:28 STEP 2768 H=2768:00 +CPU= 12.539
  03:31:48 STEP 2769 H=2769:00 +CPU= 20.332
  03:32:01 STEP 2770 H=2770:00 +CPU= 12.613
  03:32:13 STEP 2771 H=2771:00 +CPU= 12.480
  03:32:35 STEP 2772 H=2772:00 +CPU= 21.787
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002772
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002772
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002772
  03:32:47 STEP 2773 H=2773:00 +CPU= 12.392
  03:33:00 STEP 2774 H=2774:00 +CPU= 12.316
  03:33:20 STEP 2775 H=2775:00 +CPU= 20.175
  03:33:32 STEP 2776 H=2776:00 +CPU= 12.467
  03:33:45 STEP 2777 H=2777:00 +CPU= 12.567
  03:34:05 STEP 2778 H=2778:00 +CPU= 19.695
  03:34:17 STEP 2779 H=2779:00 +CPU= 12.083
  03:34:31 STEP 2780 H=2780:00 +CPU= 13.537
  03:34:50 STEP 2781 H=2781:00 +CPU= 19.368
  03:35:03 STEP 2782 H=2782:00 +CPU= 13.331
  03:35:17 STEP 2783 H=2783:00 +CPU= 13.226
  03:35:40 STEP 2784 H=2784:00 +CPU= 23.650
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002784
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002784
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002772
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007u_2019110100_123_993_12213720_0_r40207961_115.zip
Uploading the intermediate file: upload_file_115.zip
  03:35:53 STEP 2785 H=2785:00 +CPU= 12.427
  03:36:07 STEP 2786 H=2786:00 +CPU= 13.401
  03:36:27 STEP 2787 H=2787:00 +CPU= 20.264
  03:36:40 STEP 2788 H=2788:00 +CPU= 13.405
  03:36:53 STEP 2789 H=2789:00 +CPU= 12.795
  03:37:13 STEP 2790 H=2790:00 +CPU= 20.258
  03:37:26 STEP 2791 H=2791:00 +CPU= 12.788
  03:37:39 STEP 2792 H=2792:00 +CPU= 12.556
  03:37:59 STEP 2793 H=2793:00 +CPU= 20.459
  03:38:13 STEP 2794 H=2794:00 +CPU= 13.457
  03:38:25 STEP 2795 H=2795:00 +CPU= 12.598
  03:38:47 STEP 2796 H=2796:00 +CPU= 21.715
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002796
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002796
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002796
  03:38:59 STEP 2797 H=2797:00 +CPU= 12.294
  03:39:13 STEP 2798 H=2798:00 +CPU= 13.156
  03:39:33 STEP 2799 H=2799:00 +CPU= 20.217
  03:39:46 STEP 2800 H=2800:00 +CPU= 13.404
  03:39:59 STEP 2801 H=2801:00 +CPU= 12.673
  03:40:19 STEP 2802 H=2802:00 +CPU= 20.139
  03:40:32 STEP 2803 H=2803:00 +CPU= 12.469
  03:40:45 STEP 2804 H=2804:00 +CPU= 12.941
  03:41:05 STEP 2805 H=2805:00 +CPU= 20.024
  03:41:18 STEP 2806 H=2806:00 +CPU= 13.078
  03:41:31 STEP 2807 H=2807:00 +CPU= 12.900
  03:41:55 STEP 2808 H=2808:00 +CPU= 23.775
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002808
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002808
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002796
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007u_2019110100_123_993_12213720_0_r40207961_116.zip
Uploading the intermediate file: upload_file_116.zip
  03:42:06 STEP 2809 H=2809:00 +CPU= 11.776
  03:42:21 STEP 2810 H=2810:00 +CPU= 12.456
  03:42:40 STEP 2811 H=2811:00 +CPU= 19.609
  03:42:53 STEP 2812 H=2812:00 +CPU= 12.656
  03:43:06 STEP 2813 H=2813:00 +CPU= 12.960
  03:43:27 STEP 2814 H=2814:00 +CPU= 21.207
  03:43:40 STEP 2815 H=2815:00 +CPU= 12.471
  03:43:52 STEP 2816 H=2816:00 +CPU= 12.741
  03:44:12 STEP 2817 H=2817:00 +CPU= 19.586
  03:44:25 STEP 2818 H=2818:00 +CPU= 13.044
  03:44:38 STEP 2819 H=2819:00 +CPU= 12.645
  03:44:59 STEP 2820 H=2820:00 +CPU= 21.586
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002820
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002820
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002820
  03:45:12 STEP 2821 H=2821:00 +CPU= 12.479
  03:45:25 STEP 2822 H=2822:00 +CPU= 13.678
  03:45:45 STEP 2823 H=2823:00 +CPU= 19.698
  03:45:58 STEP 2824 H=2824:00 +CPU= 12.605
  03:46:10 STEP 2825 H=2825:00 +CPU= 12.364
  03:46:29 STEP 2826 H=2826:00 +CPU= 19.174
  03:46:42 STEP 2827 H=2827:00 +CPU= 12.517
  03:46:55 STEP 2828 H=2828:00 +CPU= 13.165
  03:47:15 STEP 2829 H=2829:00 +CPU= 19.970
  03:47:28 STEP 2830 H=2830:00 +CPU= 13.083
  03:47:41 STEP 2831 H=2831:00 +CPU= 12.409
  03:48:05 STEP 2832 H=2832:00 +CPU= 23.837
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002832
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002832
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002820
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007u_2019110100_123_993_12213720_0_r40207961_117.zip
Uploading the intermediate file: upload_file_117.zip
  03:48:17 STEP 2833 H=2833:00 +CPU= 12.251
  03:48:30 STEP 2834 H=2834:00 +CPU= 12.638
  03:48:51 STEP 2835 H=2835:00 +CPU= 20.639
  03:49:03 STEP 2836 H=2836:00 +CPU= 12.746
  03:49:15 STEP 2837 H=2837:00 +CPU= 11.890
  03:49:36 STEP 2838 H=2838:00 +CPU= 20.763
  03:49:48 STEP 2839 H=2839:00 +CPU= 12.293
  03:50:01 STEP 2840 H=2840:00 +CPU= 12.888
  03:50:22 STEP 2841 H=2841:00 +CPU= 20.253
  03:50:35 STEP 2842 H=2842:00 +CPU= 13.250
  03:50:47 STEP 2843 H=2843:00 +CPU= 12.321
  03:51:09 STEP 2844 H=2844:00 +CPU= 22.148
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002844
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002844
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002844
  03:51:22 STEP 2845 H=2845:00 +CPU= 12.974
  03:51:35 STEP 2846 H=2846:00 +CPU= 12.463
  03:51:54 STEP 2847 H=2847:00 +CPU= 19.587
  03:52:07 STEP 2848 H=2848:00 +CPU= 12.930
  03:52:20 STEP 2849 H=2849:00 +CPU= 12.231
  03:52:40 STEP 2850 H=2850:00 +CPU= 20.061
  03:52:52 STEP 2851 H=2851:00 +CPU= 12.538
  03:53:05 STEP 2852 H=2852:00 +CPU= 12.982
  03:53:26 STEP 2853 H=2853:00 +CPU= 20.463
  03:53:39 STEP 2854 H=2854:00 +CPU= 12.621
  03:53:51 STEP 2855 H=2855:00 +CPU= 12.740
  03:54:16 STEP 2856 H=2856:00 +CPU= 24.039
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002856
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002856
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002844
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007u_2019110100_123_993_12213720_0_r40207961_118.zip
Uploading the intermediate file: upload_file_118.zip
  03:54:29 STEP 2857 H=2857:00 +CPU= 12.680
  03:54:42 STEP 2858 H=2858:00 +CPU= 13.083
  03:55:02 STEP 2859 H=2859:00 +CPU= 20.137
  03:55:13 STEP 2860 H=2860:00 +CPU= 11.475
  03:55:26 STEP 2861 H=2861:00 +CPU= 12.359
  03:55:46 STEP 2862 H=2862:00 +CPU= 19.905
  03:55:59 STEP 2863 H=2863:00 +CPU= 13.026
  03:56:11 STEP 2864 H=2864:00 +CPU= 12.283
  03:56:31 STEP 2865 H=2865:00 +CPU= 20.071
  03:56:44 STEP 2866 H=2866:00 +CPU= 12.501
  03:56:56 STEP 2867 H=2867:00 +CPU= 12.372
  03:57:18 STEP 2868 H=2868:00 +CPU= 21.815
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002868
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002868
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002868
  03:57:30 STEP 2869 H=2869:00 +CPU= 11.878
  03:57:42 STEP 2870 H=2870:00 +CPU= 12.616
  03:58:02 STEP 2871 H=2871:00 +CPU= 19.797
  03:58:15 STEP 2872 H=2872:00 +CPU= 13.173
  03:58:28 STEP 2873 H=2873:00 +CPU= 12.993
  03:58:49 STEP 2874 H=2874:00 +CPU= 20.469
  03:59:01 STEP 2875 H=2875:00 +CPU= 12.478
  03:59:15 STEP 2876 H=2876:00 +CPU= 13.373
  03:59:35 STEP 2877 H=2877:00 +CPU= 20.377
  03:59:48 STEP 2878 H=2878:00 +CPU= 13.321
  04:00:01 STEP 2879 H=2879:00 +CPU= 12.664
  04:00:25 STEP 2880 H=2880:00 +CPU= 23.131
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002880
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002880
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002868
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007u_2019110100_123_993_12213720_0_r40207961_119.zip
Uploading the intermediate file: upload_file_119.zip
  04:00:38 STEP 2881 H=2881:00 +CPU= 13.337
Uploading trickle at timestep: 10368000
  04:00:51 STEP 2882 H=2882:00 +CPU= 12.913
  04:01:12 STEP 2883 H=2883:00 +CPU= 20.543
  04:01:24 STEP 2884 H=2884:00 +CPU= 12.282
  04:01:36 STEP 2885 H=2885:00 +CPU= 12.328
  04:01:56 STEP 2886 H=2886:00 +CPU= 19.724
  04:02:08 STEP 2887 H=2887:00 +CPU= 12.356
  04:02:21 STEP 2888 H=2888:00 +CPU= 12.477
  04:02:41 STEP 2889 H=2889:00 +CPU= 20.415
  04:02:55 STEP 2890 H=2890:00 +CPU= 13.543
  04:03:07 STEP 2891 H=2891:00 +CPU= 12.528
  04:03:29 STEP 2892 H=2892:00 +CPU= 21.209
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002892
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002892
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002892
  04:03:41 STEP 2893 H=2893:00 +CPU= 12.459
  04:03:54 STEP 2894 H=2894:00 +CPU= 12.893
  04:04:14 STEP 2895 H=2895:00 +CPU= 20.278
  04:04:26 STEP 2896 H=2896:00 +CPU= 12.130
  04:04:39 STEP 2897 H=2897:00 +CPU= 12.273
  04:05:01 STEP 2898 H=2898:00 +CPU= 21.811
  04:05:13 STEP 2899 H=2899:00 +CPU= 12.270
  04:05:26 STEP 2900 H=2900:00 +CPU= 12.986
  04:05:46 STEP 2901 H=2901:00 +CPU= 20.038
  04:05:59 STEP 2902 H=2902:00 +CPU= 12.600
  04:06:12 STEP 2903 H=2903:00 +CPU= 13.292
  04:06:35 STEP 2904 H=2904:00 +CPU= 23.256
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002904
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002904
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002892
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007u_2019110100_123_993_12213720_0_r40207961_120.zip
Uploading the intermediate file: upload_file_120.zip
  04:06:48 STEP 2905 H=2905:00 +CPU= 12.095
  04:07:00 STEP 2906 H=2906:00 +CPU= 12.856
  04:07:20 STEP 2907 H=2907:00 +CPU= 19.503
  04:07:33 STEP 2908 H=2908:00 +CPU= 12.733
  04:07:45 STEP 2909 H=2909:00 +CPU= 12.537
  04:08:06 STEP 2910 H=2910:00 +CPU= 21.079
  04:08:19 STEP 2911 H=2911:00 +CPU= 12.605
  04:08:32 STEP 2912 H=2912:00 +CPU= 13.077
  04:08:52 STEP 2913 H=2913:00 +CPU= 19.540
  04:09:04 STEP 2914 H=2914:00 +CPU= 12.340
  04:09:16 STEP 2915 H=2915:00 +CPU= 12.128
  04:09:39 STEP 2916 H=2916:00 +CPU= 22.870
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002916
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002916
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002916
  04:09:52 STEP 2917 H=2917:00 +CPU= 12.527
  04:10:04 STEP 2918 H=2918:00 +CPU= 12.648
  04:10:24 STEP 2919 H=2919:00 +CPU= 19.755
  04:10:37 STEP 2920 H=2920:00 +CPU= 12.970
  04:10:50 STEP 2921 H=2921:00 +CPU= 12.714
  04:11:10 STEP 2922 H=2922:00 +CPU= 20.048
  04:11:22 STEP 2923 H=2923:00 +CPU= 11.848
  04:11:35 STEP 2924 H=2924:00 +CPU= 13.097
  04:11:54 STEP 2925 H=2925:00 +CPU= 19.235
  04:12:07 STEP 2926 H=2926:00 +CPU= 12.685
  04:12:20 STEP 2927 H=2927:00 +CPU= 12.899
  04:12:43 STEP 2928 H=2928:00 +CPU= 22.860
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002928
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002928
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002916
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007u_2019110100_123_993_12213720_0_r40207961_121.zip
Uploading the intermediate file: upload_file_121.zip
  04:12:55 STEP 2929 H=2929:00 +CPU= 12.410
  04:13:09 STEP 2930 H=2930:00 +CPU= 13.077
  04:13:28 STEP 2931 H=2931:00 +CPU= 19.866
  04:13:41 STEP 2932 H=2932:00 +CPU= 12.533
  04:13:53 STEP 2933 H=2933:00 +CPU= 11.969
  04:14:14 STEP 2934 H=2934:00 +CPU= 20.930
  04:14:26 STEP 2935 H=2935:00 +CPU= 12.097
  04:14:39 STEP 2936 H=2936:00 +CPU= 12.967
  04:14:58 STEP 2937 H=2937:00 +CPU= 19.063
  04:15:11 STEP 2938 H=2938:00 +CPU= 13.205
  04:15:24 STEP 2939 H=2939:00 +CPU= 12.305
  04:15:45 STEP 2940 H=2940:00 +CPU= 20.950
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002940
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002940
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002940
  04:15:58 STEP 2941 H=2941:00 +CPU= 13.072
  04:16:10 STEP 2942 H=2942:00 +CPU= 12.327
  04:16:30 STEP 2943 H=2943:00 +CPU= 19.432
  04:16:43 STEP 2944 H=2944:00 +CPU= 13.017
  04:16:55 STEP 2945 H=2945:00 +CPU= 12.091
  04:17:15 STEP 2946 H=2946:00 +CPU= 20.413
  04:17:28 STEP 2947 H=2947:00 +CPU= 12.883
  04:17:41 STEP 2948 H=2948:00 +CPU= 12.499
  04:18:01 STEP 2949 H=2949:00 +CPU= 20.318
  04:18:13 STEP 2950 H=2950:00 +CPU= 11.994
  04:18:25 STEP 2951 H=2951:00 +CPU= 12.057
  04:18:47 STEP 2952 H=2952:00 +CPU= 21.933
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  3.19925486346338E-02 -1.00000000000000E+00  1.00000000000000E+00
  MAXGPFV : MAX. VALUE =    1.11594905437320     
  MAXGPFV : MAX. VALUE =   0.754706427602613     
 NSTEP =  2952 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGhnw4+002952 MODE=a
 IO-STREAM CLOSED - ICMGGhnw4+002952
 MPI-TASK:   1 -    312089418 BYTES IN      8 RECORDS TRANSFERRED IN    0.0002 SECONDS******** Mbytes/s, TOTAL TIME=    0.0053( 3.8%)
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302231500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302233000  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200302234500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20200303000000  !!!!!!!!!!!! 
 04:18:47 STEP 2952 H=2952:00 +CPU= 21.933
 END CNT3
 NSTEP =  2952 CNT0   000000000  19.204  19.204  19.248   0.998               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ          654/    28953814 WRITTEN        46048/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1   1116    0      654        28275    46048 ************   120.1     0.0   120.1     1.5   182.7
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.99      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 3200    1116.7    1116.7      7.78      0.00
   9 SPCM     - SPECTRAL COMP.                    2952     160.8     160.8      1.03      0.00
  10 SCAN2M - PHYSICS                             2953    7137.3    7137.3     45.87      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                247     693.0     693.0      0.37      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                126      11.8      11.8      0.00      0.00
  13 SCAN2M - RADIATION CALC.                      985    7576.8    7576.8     16.24      0.00
  14 SUINIF                                          1    2399.5    2399.5      0.01      0.00
  17 GRIDFPOS IN CNT4                              247      27.2      27.2      0.01      0.00
  18 SUSPECG                                         1     363.2     363.2      0.00      0.00
  19 SUSPEC                                          1     369.9     369.9      0.00      0.00
  24 SUGRIDU                                         1    1609.2    1609.2      0.00      0.00
  25 SPECRT                                          1     146.0     146.0      0.00      0.00
  26 SUGRIDF                                         1     274.3     274.3      0.00      0.00
  27 RESTART FILES - WRITING                       123    1391.7    1391.7      0.37      0.00
  28 RESTART FILES - READING                         1       0.1       0.1      0.00      0.00
  29 SU4FPOS IN CNT4                               247       0.0       0.0      0.00      0.00
  30 DYNFPOS IN CNT4                               247    1320.9    1320.9      0.71      0.00
  31 POSDDH IN STEPO                                13       0.5       0.5      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   2953    1855.5    1855.5     11.93      0.00
  38 WAM      - TOTAL COST OF WAVE MODEL          2952    1654.5    1654.5     10.63      0.00
  39 SU0YOMB                                         1     719.6     719.6      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   2953       8.4       8.4      0.05      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             2952      68.0      68.0      0.44      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             2952      13.5      13.5      0.09      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                126       0.1       0.1      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM    10094      79.9      79.9      1.76      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      6152      80.2      80.2      1.07      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       6152      33.4      33.4      0.45      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM     10094      29.2      29.2      0.64      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            2      44.8      44.8      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION          10094      10.4      10.4      0.23      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           6152       9.3       9.3      0.12      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION          10094      15.5      15.5      0.34      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           6152      12.4      12.4      0.17      0.00
 400 GSTATS                                     589499       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                564603       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    45945.8 CPU TIME   45554.1 VECTOR TIME    45554.1


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY      231.3
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMGGhnw4+002952
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMSHhnw4+002952
Moving to projects directory: /var/lib/boinc-client/slots/15/ICMUAhnw4+002952
Adding to the zip: /var/lib/boinc-client/slots/15/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/15/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMSHhnw4+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMUAhnw4+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_12213720/ICMGGhnw4+002952
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_007u_2019110100_123_993_12213720_0_r40207961_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
04:22:10 (1178622): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:53:09 1513725 22315067 oifs_43r3_007u_2019110100_123_993_12213720_0 10,623,600 45,554 0.0043
09 May 2023 16:53:09 1513725 22315067 oifs_43r3_007u_2019110100_123_993_12213720_0 10,368,000 44,454 0.0043
09 May 2023 16:53:06 1513725 22315067 oifs_43r3_007u_2019110100_123_993_12213720_0 9,504,000 40,769 0.0043
09 May 2023 16:53:03 1513725 22315067 oifs_43r3_007u_2019110100_123_993_12213720_0 8,640,000 37,095 0.0043
09 May 2023 16:53:00 1513725 22315067 oifs_43r3_007u_2019110100_123_993_12213720_0 7,776,000 33,408 0.0043
09 May 2023 16:52:57 1513725 22315067 oifs_43r3_007u_2019110100_123_993_12213720_0 6,912,000 29,732 0.0043
09 May 2023 16:52:52 1513725 22315067 oifs_43r3_007u_2019110100_123_993_12213720_0 6,048,000 26,046 0.0043
09 May 2023 16:52:49 1513725 22315067 oifs_43r3_007u_2019110100_123_993_12213720_0 5,184,000 22,381 0.0043
09 May 2023 16:52:47 1513725 22315067 oifs_43r3_007u_2019110100_123_993_12213720_0 4,320,000 18,696 0.0043
09 May 2023 16:52:45 1513725 22315067 oifs_43r3_007u_2019110100_123_993_12213720_0 3,456,000 15,020 0.0043
09 May 2023 16:52:43 1513725 22315067 oifs_43r3_007u_2019110100_123_993_12213720_0 2,592,000 11,346 0.0044
09 May 2023 16:52:41 1513725 22315067 oifs_43r3_007u_2019110100_123_993_12213720_0 1,728,000 7,634 0.0044
09 May 2023 16:52:40 1513725 22315067 oifs_43r3_007u_2019110100_123_993_12213720_0 864,000 3,943 0.0046


©2024 climateprediction.net