Task 22263528

Name	oifs_43r3_ps_0011_1993050100_123_962_12178655_0
Workunit	12178655
Created	22 Dec 2022, 2:00:00 UTC
Sent	6 Jan 2023, 4:11:24 UTC
Report deadline	5 Feb 2023, 4:11:24 UTC
Received	7 Jan 2023, 3:59:05 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	1 (0x00000001) Unknown error code
Computer ID	1537854
Run time	16 hours 57 min 28 sec
CPU time	15 hours 55 min 56 sec
Validate state	Invalid
Credit	5,201.28
Device peak FLOPS	3.60 GFLOPS
Application version	OpenIFS 43r3 Perturbed Surface v1.05 x86_64-pc-linux-gnu
Peak working set size	4,416.32 MB
Peak swap size	4,978.07 MB
Peak disk usage	3,686.55 MB
Stderr	<core_client_version>7.20.5</core_client_version> <![CDATA[ <message> process exited with code 1 (0x1, -255)</message> <stderr_txt> 12178655/ICMUAhq0f+000336 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000348 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000348 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000348 Zipping up the intermediate file: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_0011_1993050100_123_962_12178655_0_r1772798325_14.zip Uploading the intermediate file: upload_file_14.zip 12:50:29 STEP 361 H= 361:00 +CPU= 43.281 12:51:16 STEP 362 H= 362:00 +CPU= 44.795 12:52:29 STEP 363 H= 363:00 +CPU= 68.402 12:53:17 STEP 364 H= 364:00 +CPU= 44.658 12:54:02 STEP 365 H= 365:00 +CPU= 42.988 12:55:17 STEP 366 H= 366:00 +CPU= 70.026 12:56:04 STEP 367 H= 367:00 +CPU= 43.248 12:56:52 STEP 368 H= 368:00 +CPU= 44.880 12:58:05 STEP 369 H= 369:00 +CPU= 68.564 12:58:53 STEP 370 H= 370:00 +CPU= 44.883 12:59:39 STEP 371 H= 371:00 +CPU= 43.662 13:01:01 STEP 372 H= 372:00 +CPU= 76.423 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000372 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000372 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000372 13:01:47 STEP 373 H= 373:00 +CPU= 43.549 13:02:35 STEP 374 H= 374:00 +CPU= 44.704 13:03:48 STEP 375 H= 375:00 +CPU= 68.567 13:04:35 STEP 376 H= 376:00 +CPU= 44.853 13:05:22 STEP 377 H= 377:00 +CPU= 43.414 13:06:36 STEP 378 H= 378:00 +CPU= 69.839 13:07:22 STEP 379 H= 379:00 +CPU= 43.228 13:08:09 STEP 380 H= 380:00 +CPU= 44.608 13:09:22 STEP 381 H= 381:00 +CPU= 68.345 13:10:10 STEP 382 H= 382:00 +CPU= 44.517 13:10:57 STEP 383 H= 383:00 +CPU= 44.873 13:12:23 STEP 384 H= 384:00 +CPU= 80.035 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000384 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000384 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000384 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000360 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000360 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000360 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000372 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000372 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000372 Zipping up the intermediate file: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_0011_1993050100_123_962_12178655_0_r1772798325_15.zip Uploading the intermediate file: upload_file_15.zip 13:13:09 STEP 385 H= 385:00 +CPU= 43.365 13:13:57 STEP 386 H= 386:00 +CPU= 44.539 13:15:10 STEP 387 H= 387:00 +CPU= 68.308 13:15:58 STEP 388 H= 388:00 +CPU= 44.646 13:16:44 STEP 389 H= 389:00 +CPU= 42.964 13:17:59 STEP 390 H= 390:00 +CPU= 69.779 13:18:45 STEP 391 H= 391:00 +CPU= 43.539 13:19:33 STEP 392 H= 392:00 +CPU= 44.799 13:20:46 STEP 393 H= 393:00 +CPU= 68.268 13:21:34 STEP 394 H= 394:00 +CPU= 44.938 13:22:20 STEP 395 H= 395:00 +CPU= 43.336 13:23:41 STEP 396 H= 396:00 +CPU= 76.630 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000396 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000396 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000396 13:24:28 STEP 397 H= 397:00 +CPU= 43.502 13:25:15 STEP 398 H= 398:00 +CPU= 44.739 13:26:28 STEP 399 H= 399:00 +CPU= 68.657 13:27:16 STEP 400 H= 400:00 +CPU= 45.013 13:28:02 STEP 401 H= 401:00 +CPU= 43.329 13:29:17 STEP 402 H= 402:00 +CPU= 69.978 13:30:03 STEP 403 H= 403:00 +CPU= 43.381 13:30:51 STEP 404 H= 404:00 +CPU= 44.673 13:32:04 STEP 405 H= 405:00 +CPU= 68.213 13:32:51 STEP 406 H= 406:00 +CPU= 44.544 13:33:39 STEP 407 H= 407:00 +CPU= 44.799 13:35:04 STEP 408 H= 408:00 +CPU= 80.015 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000408 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000408 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000408 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000384 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000384 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000384 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000396 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000396 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000396 Zipping up the intermediate file: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_0011_1993050100_123_962_12178655_0_r1772798325_16.zip Uploading the intermediate file: upload_file_16.zip 13:35:51 STEP 409 H= 409:00 +CPU= 43.427 13:36:39 STEP 410 H= 410:00 +CPU= 44.164 13:37:52 STEP 411 H= 411:00 +CPU= 68.526 13:38:40 STEP 412 H= 412:00 +CPU= 44.585 13:39:26 STEP 413 H= 413:00 +CPU= 43.540 13:40:41 STEP 414 H= 414:00 +CPU= 69.766 13:41:27 STEP 415 H= 415:00 +CPU= 43.664 13:42:15 STEP 416 H= 416:00 +CPU= 44.706 13:43:28 STEP 417 H= 417:00 +CPU= 68.541 13:44:16 STEP 418 H= 418:00 +CPU= 44.850 13:45:02 STEP 419 H= 419:00 +CPU= 43.336 13:46:23 STEP 420 H= 420:00 +CPU= 76.522 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000420 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000420 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000420 13:47:09 STEP 421 H= 421:00 +CPU= 43.517 13:47:57 STEP 422 H= 422:00 +CPU= 44.824 13:49:10 STEP 423 H= 423:00 +CPU= 68.360 13:49:58 STEP 424 H= 424:00 +CPU= 44.907 13:50:44 STEP 425 H= 425:00 +CPU= 43.442 13:51:59 STEP 426 H= 426:00 +CPU= 69.833 13:52:45 STEP 427 H= 427:00 +CPU= 43.449 13:53:33 STEP 428 H= 428:00 +CPU= 44.636 13:54:45 STEP 429 H= 429:00 +CPU= 67.979 13:55:33 STEP 430 H= 430:00 +CPU= 44.677 13:56:21 STEP 431 H= 431:00 +CPU= 44.415 13:57:46 STEP 432 H= 432:00 +CPU= 80.026 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000432 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000432 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000432 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000408 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000408 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000408 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000420 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000420 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000420 Zipping up the intermediate file: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_0011_1993050100_123_962_12178655_0_r1772798325_17.zip Uploading the intermediate file: upload_file_17.zip 13:58:32 STEP 433 H= 433:00 +CPU= 43.131 13:59:20 STEP 434 H= 434:00 +CPU= 44.660 14:00:32 STEP 435 H= 435:00 +CPU= 68.014 14:01:20 STEP 436 H= 436:00 +CPU= 44.628 14:02:06 STEP 437 H= 437:00 +CPU= 43.339 14:03:20 STEP 438 H= 438:00 +CPU= 69.999 14:04:07 STEP 439 H= 439:00 +CPU= 43.618 14:04:55 STEP 440 H= 440:00 +CPU= 44.801 14:06:08 STEP 441 H= 441:00 +CPU= 68.683 14:06:55 STEP 442 H= 442:00 +CPU= 45.003 14:07:42 STEP 443 H= 443:00 +CPU= 43.719 14:09:03 STEP 444 H= 444:00 +CPU= 76.520 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000444 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000444 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000444 14:09:50 STEP 445 H= 445:00 +CPU= 43.641 14:10:37 STEP 446 H= 446:00 +CPU= 44.638 14:11:50 STEP 447 H= 447:00 +CPU= 68.350 14:12:37 STEP 448 H= 448:00 +CPU= 44.747 14:13:24 STEP 449 H= 449:00 +CPU= 43.450 14:14:38 STEP 450 H= 450:00 +CPU= 69.496 14:15:25 STEP 451 H= 451:00 +CPU= 43.563 14:16:12 STEP 452 H= 452:00 +CPU= 44.513 14:17:25 STEP 453 H= 453:00 +CPU= 68.520 14:18:13 STEP 454 H= 454:00 +CPU= 44.636 14:19:01 STEP 455 H= 455:00 +CPU= 44.970 14:20:26 STEP 456 H= 456:00 +CPU= 80.193 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000456 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000456 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000456 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000432 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000432 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000432 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000444 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000444 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000444 Zipping up the intermediate file: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_0011_1993050100_123_962_12178655_0_r1772798325_18.zip Uploading the intermediate file: upload_file_18.zip 14:21:13 STEP 457 H= 457:00 +CPU= 43.248 14:22:00 STEP 458 H= 458:00 +CPU= 44.574 14:23:13 STEP 459 H= 459:00 +CPU= 68.434 14:24:01 STEP 460 H= 460:00 +CPU= 44.805 14:24:47 STEP 461 H= 461:00 +CPU= 43.558 14:26:01 STEP 462 H= 462:00 +CPU= 69.738 14:26:47 STEP 463 H= 463:00 +CPU= 43.466 14:27:35 STEP 464 H= 464:00 +CPU= 44.762 14:28:47 STEP 465 H= 465:00 +CPU= 68.314 14:29:35 STEP 466 H= 466:00 +CPU= 44.885 14:30:21 STEP 467 H= 467:00 +CPU= 43.581 14:31:43 STEP 468 H= 468:00 +CPU= 76.741 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000468 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000468 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000468 14:32:29 STEP 469 H= 469:00 +CPU= 43.480 14:33:17 STEP 470 H= 470:00 +CPU= 45.021 14:34:30 STEP 471 H= 471:00 +CPU= 68.097 14:35:18 STEP 472 H= 472:00 +CPU= 44.865 14:36:04 STEP 473 H= 473:00 +CPU= 43.031 14:37:19 STEP 474 H= 474:00 +CPU= 69.845 14:38:05 STEP 475 H= 475:00 +CPU= 43.441 14:38:53 STEP 476 H= 476:00 +CPU= 44.750 14:40:06 STEP 477 H= 477:00 +CPU= 68.180 14:40:53 STEP 478 H= 478:00 +CPU= 44.569 14:41:41 STEP 479 H= 479:00 +CPU= 44.940 14:43:09 STEP 480 H= 480:00 +CPU= 80.183 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000480 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000480 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000480 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000456 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000456 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000456 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000468 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000468 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000468 Zipping up the intermediate file: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_0011_1993050100_123_962_12178655_0_r1772798325_19.zip Uploading the intermediate file: upload_file_19.zip 14:43:55 STEP 481 H= 481:00 +CPU= 43.339 14:44:42 STEP 482 H= 482:00 +CPU= 44.732 14:45:55 STEP 483 H= 483:00 +CPU= 68.190 14:46:43 STEP 484 H= 484:00 +CPU= 44.813 14:47:29 STEP 485 H= 485:00 +CPU= 43.487 14:48:43 STEP 486 H= 486:00 +CPU= 69.781 14:49:29 STEP 487 H= 487:00 +CPU= 43.553 14:50:17 STEP 488 H= 488:00 +CPU= 44.841 14:51:30 STEP 489 H= 489:00 +CPU= 68.508 14:52:18 STEP 490 H= 490:00 +CPU= 44.884 14:53:04 STEP 491 H= 491:00 +CPU= 43.610 14:54:26 STEP 492 H= 492:00 +CPU= 76.444 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000492 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000492 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000492 14:55:12 STEP 493 H= 493:00 +CPU= 43.584 14:56:00 STEP 494 H= 494:00 +CPU= 44.683 14:57:13 STEP 495 H= 495:00 +CPU= 68.207 14:58:00 STEP 496 H= 496:00 +CPU= 44.476 14:58:47 STEP 497 H= 497:00 +CPU= 43.562 15:00:01 STEP 498 H= 498:00 +CPU= 69.804 15:00:47 STEP 499 H= 499:00 +CPU= 43.615 15:01:35 STEP 500 H= 500:00 +CPU= 44.857 15:02:48 STEP 501 H= 501:00 +CPU= 68.429 15:03:36 STEP 502 H= 502:00 +CPU= 44.781 15:04:23 STEP 503 H= 503:00 +CPU= 44.659 15:05:48 STEP 504 H= 504:00 +CPU= 80.052 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000504 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000504 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000504 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000480 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000480 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000480 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000492 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000492 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000492 Zipping up the intermediate file: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_0011_1993050100_123_962_12178655_0_r1772798325_20.zip Uploading the intermediate file: upload_file_20.zip 15:06:35 STEP 505 H= 505:00 +CPU= 43.353 15:07:23 STEP 506 H= 506:00 +CPU= 44.975 15:08:36 STEP 507 H= 507:00 +CPU= 68.506 15:09:23 STEP 508 H= 508:00 +CPU= 44.856 15:10:10 STEP 509 H= 509:00 +CPU= 43.446 15:11:24 STEP 510 H= 510:00 +CPU= 69.848 15:12:11 STEP 511 H= 511:00 +CPU= 43.200 15:12:58 STEP 512 H= 512:00 +CPU= 44.751 15:14:11 STEP 513 H= 513:00 +CPU= 68.071 15:14:59 STEP 514 H= 514:00 +CPU= 44.767 15:15:45 STEP 515 H= 515:00 +CPU= 43.453 15:17:07 STEP 516 H= 516:00 +CPU= 76.348 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000516 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000516 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000516 15:17:54 STEP 517 H= 517:00 +CPU= 43.621 15:18:41 STEP 518 H= 518:00 +CPU= 44.642 15:19:54 STEP 519 H= 519:00 +CPU= 68.296 15:20:41 STEP 520 H= 520:00 +CPU= 44.616 15:21:28 STEP 521 H= 521:00 +CPU= 43.402 15:22:42 STEP 522 H= 522:00 +CPU= 69.876 15:23:28 STEP 523 H= 523:00 +CPU= 43.412 15:24:16 STEP 524 H= 524:00 +CPU= 44.639 15:25:28 STEP 525 H= 525:00 +CPU= 68.172 15:26:16 STEP 526 H= 526:00 +CPU= 44.691 15:27:03 STEP 527 H= 527:00 +CPU= 44.616 15:28:29 STEP 528 H= 528:00 +CPU= 80.240 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000528 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000528 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000528 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000504 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000504 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000504 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000516 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000516 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000516 Zipping up the intermediate file: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_0011_1993050100_123_962_12178655_0_r1772798325_21.zip Uploading the intermediate file: upload_file_21.zip 15:29:15 STEP 529 H= 529:00 +CPU= 43.272 15:30:03 STEP 530 H= 530:00 +CPU= 44.873 15:31:16 STEP 531 H= 531:00 +CPU= 68.489 15:32:03 STEP 532 H= 532:00 +CPU= 44.808 15:32:50 STEP 533 H= 533:00 +CPU= 43.488 15:34:04 STEP 534 H= 534:00 +CPU= 69.644 15:34:50 STEP 535 H= 535:00 +CPU= 43.509 15:35:38 STEP 536 H= 536:00 +CPU= 44.735 15:36:51 STEP 537 H= 537:00 +CPU= 68.271 15:37:39 STEP 538 H= 538:00 +CPU= 44.766 15:38:25 STEP 539 H= 539:00 +CPU= 43.516 15:39:47 STEP 540 H= 540:00 +CPU= 76.888 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000540 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000540 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000540 15:40:33 STEP 541 H= 541:00 +CPU= 43.321 15:41:21 STEP 542 H= 542:00 +CPU= 44.896 15:42:34 STEP 543 H= 543:00 +CPU= 68.562 15:43:21 STEP 544 H= 544:00 +CPU= 44.776 15:44:08 STEP 545 H= 545:00 +CPU= 43.413 15:45:22 STEP 546 H= 546:00 +CPU= 69.880 15:46:08 STEP 547 H= 547:00 +CPU= 43.278 15:46:55 STEP 548 H= 548:00 +CPU= 44.819 15:48:08 STEP 549 H= 549:00 +CPU= 68.240 15:48:56 STEP 550 H= 550:00 +CPU= 44.852 15:49:44 STEP 551 H= 551:00 +CPU= 44.910 15:51:09 STEP 552 H= 552:00 +CPU= 80.350 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000552 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000552 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000552 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000528 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000528 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000528 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000540 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000540 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000540 Zipping up the intermediate file: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_0011_1993050100_123_962_12178655_0_r1772798325_22.zip Uploading the intermediate file: upload_file_22.zip Uploading trickle at timestep: 1987200 15:51:55 STEP 553 H= 553:00 +CPU= 43.245 15:52:43 STEP 554 H= 554:00 +CPU= 44.626 15:53:56 STEP 555 H= 555:00 +CPU= 68.394 15:54:44 STEP 556 H= 556:00 +CPU= 44.579 15:55:30 STEP 557 H= 557:00 +CPU= 43.522 15:56:44 STEP 558 H= 558:00 +CPU= 69.561 15:57:31 STEP 559 H= 559:00 +CPU= 43.444 15:58:18 STEP 560 H= 560:00 +CPU= 44.714 15:59:31 STEP 561 H= 561:00 +CPU= 68.346 16:00:19 STEP 562 H= 562:00 +CPU= 44.983 16:01:05 STEP 563 H= 563:00 +CPU= 43.415 16:02:26 STEP 564 H= 564:00 +CPU= 76.326 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000564 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000564 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000564 16:03:12 STEP 565 H= 565:00 +CPU= 43.481 16:04:00 STEP 566 H= 566:00 +CPU= 44.830 16:05:13 STEP 567 H= 567:00 +CPU= 68.341 16:06:00 STEP 568 H= 568:00 +CPU= 44.915 16:06:47 STEP 569 H= 569:00 +CPU= 43.444 16:08:01 STEP 570 H= 570:00 +CPU= 69.916 16:08:47 STEP 571 H= 571:00 +CPU= 43.424 16:09:35 STEP 572 H= 572:00 +CPU= 44.767 16:10:48 STEP 573 H= 573:00 +CPU= 68.430 16:11:35 STEP 574 H= 574:00 +CPU= 44.770 16:12:23 STEP 575 H= 575:00 +CPU= 44.633 16:13:48 STEP 576 H= 576:00 +CPU= 80.093 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000576 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000576 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000576 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000552 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000552 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000552 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000564 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000564 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000564 Zipping up the intermediate file: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_0011_1993050100_123_962_12178655_0_r1772798325_23.zip Uploading the intermediate file: upload_file_23.zip 16:14:35 STEP 577 H= 577:00 +CPU= 43.237 16:15:23 STEP 578 H= 578:00 +CPU= 44.621 16:16:36 STEP 579 H= 579:00 +CPU= 68.363 16:17:24 STEP 580 H= 580:00 +CPU= 44.880 16:18:10 STEP 581 H= 581:00 +CPU= 43.297 16:19:24 STEP 582 H= 582:00 +CPU= 69.946 16:20:11 STEP 583 H= 583:00 +CPU= 43.580 16:20:58 STEP 584 H= 584:00 +CPU= 44.823 16:22:11 STEP 585 H= 585:00 +CPU= 68.468 16:22:59 STEP 586 H= 586:00 +CPU= 44.995 16:23:45 STEP 587 H= 587:00 +CPU= 43.510 16:25:07 STEP 588 H= 588:00 +CPU= 76.720 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000588 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000588 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000588 16:25:53 STEP 589 H= 589:00 +CPU= 43.402 16:26:41 STEP 590 H= 590:00 +CPU= 44.606 16:27:54 STEP 591 H= 591:00 +CPU= 68.505 16:28:41 STEP 592 H= 592:00 +CPU= 44.873 16:29:27 STEP 593 H= 593:00 +CPU= 43.505 16:30:42 STEP 594 H= 594:00 +CPU= 69.692 16:31:28 STEP 595 H= 595:00 +CPU= 43.393 16:32:15 STEP 596 H= 596:00 +CPU= 44.593 16:33:28 STEP 597 H= 597:00 +CPU= 68.274 16:34:15 STEP 598 H= 598:00 +CPU= 44.336 16:35:03 STEP 599 H= 599:00 +CPU= 44.910 16:36:28 STEP 600 H= 600:00 +CPU= 79.996 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000600 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000600 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000600 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000576 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000576 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000576 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000588 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000588 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000588 Zipping up the intermediate file: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_0011_1993050100_123_962_12178655_0_r1772798325_24.zip Uploading the intermediate file: upload_file_24.zip 16:37:15 STEP 601 H= 601:00 +CPU= 43.469 16:38:03 STEP 602 H= 602:00 +CPU= 44.810 16:39:15 STEP 603 H= 603:00 +CPU= 68.145 16:40:03 STEP 604 H= 604:00 +CPU= 44.631 16:40:49 STEP 605 H= 605:00 +CPU= 43.580 16:42:03 STEP 606 H= 606:00 +CPU= 69.891 16:42:49 STEP 607 H= 607:00 +CPU= 43.410 16:43:37 STEP 608 H= 608:00 +CPU= 44.781 16:44:50 STEP 609 H= 609:00 +CPU= 68.327 16:45:37 STEP 610 H= 610:00 +CPU= 44.595 16:46:23 STEP 611 H= 611:00 +CPU= 43.435 16:47:45 STEP 612 H= 612:00 +CPU= 76.454 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000612 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000612 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000612 16:48:31 STEP 613 H= 613:00 +CPU= 43.462 16:49:18 STEP 614 H= 614:00 +CPU= 44.560 16:50:31 STEP 615 H= 615:00 +CPU= 68.457 16:51:19 STEP 616 H= 616:00 +CPU= 44.756 16:52:05 STEP 617 H= 617:00 +CPU= 43.310 16:53:20 STEP 618 H= 618:00 +CPU= 69.793 16:54:06 STEP 619 H= 619:00 +CPU= 43.294 16:54:54 STEP 620 H= 620:00 +CPU= 44.719 16:56:06 STEP 621 H= 621:00 +CPU= 68.136 16:56:54 STEP 622 H= 622:00 +CPU= 44.742 16:57:42 STEP 623 H= 623:00 +CPU= 44.911 16:59:07 STEP 624 H= 624:00 +CPU= 80.393 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000624 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000624 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000624 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000600 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000600 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000600 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000612 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000612 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000612 Zipping up the intermediate file: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_0011_1993050100_123_962_12178655_0_r1772798325_25.zip Uploading the intermediate file: upload_file_25.zip 16:59:54 STEP 625 H= 625:00 +CPU= 43.424 17:00:41 STEP 626 H= 626:00 +CPU= 44.756 17:01:54 STEP 627 H= 627:00 +CPU= 68.318 17:02:41 STEP 628 H= 628:00 +CPU= 44.650 17:03:28 STEP 629 H= 629:00 +CPU= 43.421 17:04:42 STEP 630 H= 630:00 +CPU= 69.678 17:05:28 STEP 631 H= 631:00 +CPU= 43.437 17:06:16 STEP 632 H= 632:00 +CPU= 44.807 17:07:28 STEP 633 H= 633:00 +CPU= 68.328 17:08:16 STEP 634 H= 634:00 +CPU= 44.766 17:09:02 STEP 635 H= 635:00 +CPU= 43.502 17:10:24 STEP 636 H= 636:00 +CPU= 76.674 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000636 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000636 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000636 17:11:10 STEP 637 H= 637:00 +CPU= 43.375 17:11:57 STEP 638 H= 638:00 +CPU= 44.683 17:13:10 STEP 639 H= 639:00 +CPU= 68.606 17:13:58 STEP 640 H= 640:00 +CPU= 44.701 17:14:45 STEP 641 H= 641:00 +CPU= 43.528 17:15:59 STEP 642 H= 642:00 +CPU= 69.784 17:16:45 STEP 643 H= 643:00 +CPU= 43.305 17:17:33 STEP 644 H= 644:00 +CPU= 44.838 17:18:46 STEP 645 H= 645:00 +CPU= 68.265 17:19:33 STEP 646 H= 646:00 +CPU= 44.684 17:20:21 STEP 647 H= 647:00 +CPU= 44.716 17:21:46 STEP 648 H= 648:00 +CPU= 80.234 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000648 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000648 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000648 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000624 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000624 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000624 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000636 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000636 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000636 Zipping up the intermediate file: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_0011_1993050100_123_962_12178655_0_r1772798325_26.zip Uploading the intermediate file: upload_file_26.zip 17:22:32 STEP 649 H= 649:00 +CPU= 43.441 17:23:20 STEP 650 H= 650:00 +CPU= 44.683 17:24:32 STEP 651 H= 651:00 +CPU= 68.413 17:25:20 STEP 652 H= 652:00 +CPU= 44.707 17:26:06 STEP 653 H= 653:00 +CPU= 43.446 17:27:20 STEP 654 H= 654:00 +CPU= 69.768 17:28:07 STEP 655 H= 655:00 +CPU= 43.679 17:28:55 STEP 656 H= 656:00 +CPU= 44.818 17:30:07 STEP 657 H= 657:00 +CPU= 68.536 17:30:55 STEP 658 H= 658:00 +CPU= 44.713 17:31:41 STEP 659 H= 659:00 +CPU= 43.467 17:33:03 STEP 660 H= 660:00 +CPU= 76.520 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000660 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000660 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000660 17:33:49 STEP 661 H= 661:00 +CPU= 43.485 17:34:37 STEP 662 H= 662:00 +CPU= 44.866 17:35:49 STEP 663 H= 663:00 +CPU= 68.536 17:36:37 STEP 664 H= 664:00 +CPU= 44.717 17:37:23 STEP 665 H= 665:00 +CPU= 43.421 17:38:37 STEP 666 H= 666:00 +CPU= 69.797 17:39:24 STEP 667 H= 667:00 +CPU= 43.400 17:40:11 STEP 668 H= 668:00 +CPU= 44.567 17:41:24 STEP 669 H= 669:00 +CPU= 68.553 17:42:11 STEP 670 H= 670:00 +CPU= 44.645 17:42:59 STEP 671 H= 671:00 +CPU= 44.812 17:44:25 STEP 672 H= 672:00 +CPU= 80.276 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000672 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000672 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000672 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000648 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000648 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000648 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000660 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000660 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000660 Zipping up the intermediate file: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_0011_1993050100_123_962_12178655_0_r1772798325_27.zip Uploading the intermediate file: upload_file_27.zip 17:45:11 STEP 673 H= 673:00 +CPU= 43.412 17:45:58 STEP 674 H= 674:00 +CPU= 44.619 17:47:11 STEP 675 H= 675:00 +CPU= 68.275 17:47:58 STEP 676 H= 676:00 +CPU= 44.570 17:48:44 STEP 677 H= 677:00 +CPU= 43.359 17:49:58 STEP 678 H= 678:00 +CPU= 69.718 17:50:44 STEP 679 H= 679:00 +CPU= 43.377 17:51:32 STEP 680 H= 680:00 +CPU= 44.645 17:52:45 STEP 681 H= 681:00 +CPU= 68.435 17:53:32 STEP 682 H= 682:00 +CPU= 44.846 17:54:19 STEP 683 H= 683:00 +CPU= 43.446 17:55:40 STEP 684 H= 684:00 +CPU= 76.591 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000684 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000684 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000684 17:56:26 STEP 685 H= 685:00 +CPU= 43.521 17:57:14 STEP 686 H= 686:00 +CPU= 44.971 17:58:27 STEP 687 H= 687:00 +CPU= 68.395 17:59:15 STEP 688 H= 688:00 +CPU= 45.050 18:00:01 STEP 689 H= 689:00 +CPU= 43.309 18:01:16 STEP 690 H= 690:00 +CPU= 69.976 18:02:02 STEP 691 H= 691:00 +CPU= 43.376 18:02:49 STEP 692 H= 692:00 +CPU= 44.654 18:04:02 STEP 693 H= 693:00 +CPU= 68.222 18:04:50 STEP 694 H= 694:00 +CPU= 44.946 18:05:37 STEP 695 H= 695:00 +CPU= 44.791 18:07:03 STEP 696 H= 696:00 +CPU= 80.452 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000696 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000696 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000696 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000672 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000672 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000672 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000684 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000684 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000684 Zipping up the intermediate file: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_0011_1993050100_123_962_12178655_0_r1772798325_28.zip Uploading the intermediate file: upload_file_28.zip 18:07:49 STEP 697 H= 697:00 +CPU= 43.332 18:08:37 STEP 698 H= 698:00 +CPU= 44.686 18:09:49 STEP 699 H= 699:00 +CPU= 68.285 18:10:37 STEP 700 H= 700:00 +CPU= 44.708 18:11:23 STEP 701 H= 701:00 +CPU= 43.286 18:12:37 STEP 702 H= 702:00 +CPU= 69.900 18:13:23 STEP 703 H= 703:00 +CPU= 43.439 18:14:11 STEP 704 H= 704:00 +CPU= 44.612 18:15:24 STEP 705 H= 705:00 +CPU= 68.483 18:16:11 STEP 706 H= 706:00 +CPU= 44.759 18:16:58 STEP 707 H= 707:00 +CPU= 43.489 18:18:19 STEP 708 H= 708:00 +CPU= 76.612 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000708 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000708 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000708 18:19:05 STEP 709 H= 709:00 +CPU= 43.571 18:19:53 STEP 710 H= 710:00 +CPU= 44.759 18:21:06 STEP 711 H= 711:00 +CPU= 68.433 18:21:54 STEP 712 H= 712:00 +CPU= 44.791 18:22:40 STEP 713 H= 713:00 +CPU= 43.522 18:23:54 STEP 714 H= 714:00 +CPU= 69.984 18:24:41 STEP 715 H= 715:00 +CPU= 43.376 18:25:28 STEP 716 H= 716:00 +CPU= 44.714 18:26:41 STEP 717 H= 717:00 +CPU= 68.609 18:27:29 STEP 718 H= 718:00 +CPU= 44.794 18:28:16 STEP 719 H= 719:00 +CPU= 44.843 18:29:42 STEP 720 H= 720:00 +CPU= 80.173 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000720 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000720 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000720 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000696 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000696 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000696 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000708 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000708 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000708 Zipping up the intermediate file: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_0011_1993050100_123_962_12178655_0_r1772798325_29.zip Uploading the intermediate file: upload_file_29.zip 18:30:28 STEP 721 H= 721:00 +CPU= 43.333 18:31:16 STEP 722 H= 722:00 +CPU= 44.817 18:32:28 STEP 723 H= 723:00 +CPU= 68.349 18:33:16 STEP 724 H= 724:00 +CPU= 44.809 18:34:02 STEP 725 H= 725:00 +CPU= 43.560 18:35:17 STEP 726 H= 726:00 +CPU= 69.937 18:36:03 STEP 727 H= 727:00 +CPU= 43.291 18:36:51 STEP 728 H= 728:00 +CPU= 45.029 18:38:04 STEP 729 H= 729:00 +CPU= 68.338 18:38:51 STEP 730 H= 730:00 +CPU= 44.812 18:39:37 STEP 731 H= 731:00 +CPU= 43.441 18:40:59 STEP 732 H= 732:00 +CPU= 76.582 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000732 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000732 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000732 18:41:45 STEP 733 H= 733:00 +CPU= 43.398 18:42:33 STEP 734 H= 734:00 +CPU= 44.894 18:43:46 STEP 735 H= 735:00 +CPU= 68.410 18:44:33 STEP 736 H= 736:00 +CPU= 44.801 18:45:20 STEP 737 H= 737:00 +CPU= 43.405 18:46:34 STEP 738 H= 738:00 +CPU= 69.995 18:47:20 STEP 739 H= 739:00 +CPU= 43.338 18:48:08 STEP 740 H= 740:00 +CPU= 44.778 18:49:21 STEP 741 H= 741:00 +CPU= 68.319 18:50:08 STEP 742 H= 742:00 +CPU= 44.901 18:50:56 STEP 743 H= 743:00 +CPU= 44.638 18:52:21 STEP 744 H= 744:00 +CPU= 80.115 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000744 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000744 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000744 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000720 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000720 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000720 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000732 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000732 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000732 Zipping up the intermediate file: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_0011_1993050100_123_962_12178655_0_r1772798325_30.zip Uploading the intermediate file: upload_file_30.zip 18:53:07 STEP 745 H= 745:00 +CPU= 43.405 18:53:55 STEP 746 H= 746:00 +CPU= 44.859 18:55:08 STEP 747 H= 747:00 +CPU= 68.315 18:55:55 STEP 748 H= 748:00 +CPU= 44.844 18:56:42 STEP 749 H= 749:00 +CPU= 43.513 18:57:56 STEP 750 H= 750:00 +CPU= 69.833 18:58:42 STEP 751 H= 751:00 +CPU= 43.418 18:59:30 STEP 752 H= 752:00 +CPU= 44.827 19:00:43 STEP 753 H= 753:00 +CPU= 68.552 19:01:30 STEP 754 H= 754:00 +CPU= 44.897 19:02:17 STEP 755 H= 755:00 +CPU= 43.620 19:03:38 STEP 756 H= 756:00 +CPU= 76.779 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000756 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000756 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000756 19:04:25 STEP 757 H= 757:00 +CPU= 43.614 19:05:13 STEP 758 H= 758:00 +CPU= 44.792 19:06:25 STEP 759 H= 759:00 +CPU= 68.467 19:07:13 STEP 760 H= 760:00 +CPU= 44.788 19:07:59 STEP 761 H= 761:00 +CPU= 43.375 19:09:14 STEP 762 H= 762:00 +CPU= 70.049 19:10:00 STEP 763 H= 763:00 +CPU= 43.371 19:10:47 STEP 764 H= 764:00 +CPU= 44.651 19:12:00 STEP 765 H= 765:00 +CPU= 68.255 19:12:47 STEP 766 H= 766:00 +CPU= 44.809 19:13:35 STEP 767 H= 767:00 +CPU= 44.818 19:15:00 STEP 768 H= 768:00 +CPU= 80.329 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000768 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000768 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000768 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000744 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000744 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000744 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000756 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000756 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000756 Zipping up the intermediate file: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_0011_1993050100_123_962_12178655_0_r1772798325_31.zip Uploading the intermediate file: upload_file_31.zip 19:15:47 STEP 769 H= 769:00 +CPU= 43.439 19:16:34 STEP 770 H= 770:00 +CPU= 44.708 19:17:47 STEP 771 H= 771:00 +CPU= 68.545 19:18:35 STEP 772 H= 772:00 +CPU= 44.904 19:19:22 STEP 773 H= 773:00 +CPU= 43.447 19:20:36 STEP 774 H= 774:00 +CPU= 70.211 19:21:23 STEP 775 H= 775:00 +CPU= 43.547 19:22:11 STEP 776 H= 776:00 +CPU= 44.870 19:23:23 STEP 777 H= 777:00 +CPU= 68.581 19:24:11 STEP 778 H= 778:00 +CPU= 44.829 19:24:58 STEP 779 H= 779:00 +CPU= 43.788 19:26:19 STEP 780 H= 780:00 +CPU= 76.561 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000780 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000780 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000780 19:27:06 STEP 781 H= 781:00 +CPU= 43.708 19:27:54 STEP 782 H= 782:00 +CPU= 44.887 19:29:07 STEP 783 H= 783:00 +CPU= 68.458 19:29:54 STEP 784 H= 784:00 +CPU= 44.737 19:30:41 STEP 785 H= 785:00 +CPU= 43.457 19:31:55 STEP 786 H= 786:00 +CPU= 69.960 19:32:42 STEP 787 H= 787:00 +CPU= 43.589 19:33:29 STEP 788 H= 788:00 +CPU= 44.611 19:34:42 STEP 789 H= 789:00 +CPU= 68.521 19:35:29 STEP 790 H= 790:00 +CPU= 44.743 19:36:17 STEP 791 H= 791:00 +CPU= 44.763 19:37:43 STEP 792 H= 792:00 +CPU= 80.431 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000792 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000792 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000792 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000768 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000768 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000768 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000780 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000780 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000780 Zipping up the intermediate file: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_0011_1993050100_123_962_12178655_0_r1772798325_32.zip Uploading the intermediate file: upload_file_32.zip Uploading trickle at timestep: 2851200 19:38:29 STEP 793 H= 793:00 +CPU= 43.422 19:39:17 STEP 794 H= 794:00 +CPU= 44.783 19:40:30 STEP 795 H= 795:00 +CPU= 68.631 19:41:17 STEP 796 H= 796:00 +CPU= 44.784 19:42:04 STEP 797 H= 797:00 +CPU= 43.626 19:43:19 STEP 798 H= 798:00 +CPU= 70.059 19:44:05 STEP 799 H= 799:00 +CPU= 43.695 19:44:53 STEP 800 H= 800:00 +CPU= 44.811 19:46:06 STEP 801 H= 801:00 +CPU= 68.472 19:46:54 STEP 802 H= 802:00 +CPU= 44.798 19:47:40 STEP 803 H= 803:00 +CPU= 43.541 19:49:01 STEP 804 H= 804:00 +CPU= 76.626 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000804 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000804 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000804 19:49:48 STEP 805 H= 805:00 +CPU= 43.703 19:50:36 STEP 806 H= 806:00 +CPU= 44.819 19:51:49 STEP 807 H= 807:00 +CPU= 68.577 19:52:36 STEP 808 H= 808:00 +CPU= 44.881 19:53:23 STEP 809 H= 809:00 +CPU= 43.578 19:54:37 STEP 810 H= 810:00 +CPU= 70.079 19:55:24 STEP 811 H= 811:00 +CPU= 43.505 19:56:11 STEP 812 H= 812:00 +CPU= 44.790 19:57:24 STEP 813 H= 813:00 +CPU= 68.290 19:58:12 STEP 814 H= 814:00 +CPU= 44.666 19:59:00 STEP 815 H= 815:00 +CPU= 44.952 20:00:25 STEP 816 H= 816:00 +CPU= 80.209 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000816 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000816 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000816 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000792 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000792 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000792 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000804 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000804 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000804 Zipping up the intermediate file: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_0011_1993050100_123_962_12178655_0_r1772798325_33.zip Uploading the intermediate file: upload_file_33.zip 20:01:12 STEP 817 H= 817:00 +CPU= 43.548 20:01:59 STEP 818 H= 818:00 +CPU= 44.838 20:03:12 STEP 819 H= 819:00 +CPU= 68.512 20:04:00 STEP 820 H= 820:00 +CPU= 44.793 20:04:46 STEP 821 H= 821:00 +CPU= 43.268 20:06:00 STEP 822 H= 822:00 +CPU= 69.892 20:06:46 STEP 823 H= 823:00 +CPU= 43.592 20:07:34 STEP 824 H= 824:00 +CPU= 44.856 20:08:47 STEP 825 H= 825:00 +CPU= 68.477 20:09:34 STEP 826 H= 826:00 +CPU= 44.872 20:10:21 STEP 827 H= 827:00 +CPU= 43.505 20:11:42 STEP 828 H= 828:00 +CPU= 76.450 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000828 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000828 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000828 20:12:29 STEP 829 H= 829:00 +CPU= 43.637 20:13:16 STEP 830 H= 830:00 +CPU= 44.704 20:14:29 STEP 831 H= 831:00 +CPU= 68.471 20:15:16 STEP 832 H= 832:00 +CPU= 44.755 20:16:03 STEP 833 H= 833:00 +CPU= 43.378 20:17:16 STEP 834 H= 834:00 +CPU= 69.707 20:18:03 STEP 835 H= 835:00 +CPU= 43.449 20:18:50 STEP 836 H= 836:00 +CPU= 44.752 20:20:03 STEP 837 H= 837:00 +CPU= 68.215 20:20:50 STEP 838 H= 838:00 +CPU= 44.598 20:21:38 STEP 839 H= 839:00 +CPU= 44.813 20:23:03 STEP 840 H= 840:00 +CPU= 80.139 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000840 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000840 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000840 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000816 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000816 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000816 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000828 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000828 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000828 Zipping up the intermediate file: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_0011_1993050100_123_962_12178655_0_r1772798325_34.zip Uploading the intermediate file: upload_file_34.zip 20:23:50 STEP 841 H= 841:00 +CPU= 43.311 20:24:37 STEP 842 H= 842:00 +CPU= 44.806 20:25:50 STEP 843 H= 843:00 +CPU= 68.326 20:26:37 STEP 844 H= 844:00 +CPU= 44.672 20:27:24 STEP 845 H= 845:00 +CPU= 43.484 20:28:38 STEP 846 H= 846:00 +CPU= 69.784 20:29:24 STEP 847 H= 847:00 +CPU= 43.444 20:30:12 STEP 848 H= 848:00 +CPU= 44.658 20:31:24 STEP 849 H= 849:00 +CPU= 68.520 20:32:12 STEP 850 H= 850:00 +CPU= 44.689 20:32:58 STEP 851 H= 851:00 +CPU= 43.602 20:34:19 STEP 852 H= 852:00 +CPU= 76.367 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000852 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000852 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000852 20:35:06 STEP 853 H= 853:00 +CPU= 43.638 20:35:54 STEP 854 H= 854:00 +CPU= 44.909 20:37:07 STEP 855 H= 855:00 +CPU= 68.553 20:37:55 STEP 856 H= 856:00 +CPU= 44.949 20:38:41 STEP 857 H= 857:00 +CPU= 43.612 20:39:55 STEP 858 H= 858:00 +CPU= 69.498 20:40:41 STEP 859 H= 859:00 +CPU= 43.369 20:41:29 STEP 860 H= 860:00 +CPU= 44.641 20:42:41 STEP 861 H= 861:00 +CPU= 68.150 20:43:29 STEP 862 H= 862:00 +CPU= 44.633 20:44:16 STEP 863 H= 863:00 +CPU= 44.710 20:45:41 STEP 864 H= 864:00 +CPU= 80.059 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000864 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000864 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000864 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000840 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000840 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000840 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000852 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000852 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000852 Zipping up the intermediate file: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_0011_1993050100_123_962_12178655_0_r1772798325_35.zip Uploading the intermediate file: upload_file_35.zip 20:46:27 STEP 865 H= 865:00 +CPU= 43.267 20:47:15 STEP 866 H= 866:00 +CPU= 44.799 20:48:28 STEP 867 H= 867:00 +CPU= 68.297 20:49:16 STEP 868 H= 868:00 +CPU= 44.748 20:50:02 STEP 869 H= 869:00 +CPU= 43.417 20:51:16 STEP 870 H= 870:00 +CPU= 69.801 20:52:03 STEP 871 H= 871:00 +CPU= 43.668 20:52:51 STEP 872 H= 872:00 +CPU= 45.058 20:54:04 STEP 873 H= 873:00 +CPU= 68.551 20:54:52 STEP 874 H= 874:00 +CPU= 44.850 20:55:38 STEP 875 H= 875:00 +CPU= 43.459 20:56:59 STEP 876 H= 876:00 +CPU= 76.460 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000876 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000876 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000876 20:57:45 STEP 877 H= 877:00 +CPU= 43.660 20:58:33 STEP 878 H= 878:00 +CPU= 44.645 20:59:46 STEP 879 H= 879:00 +CPU= 68.495 21:00:34 STEP 880 H= 880:00 +CPU= 44.858 21:01:20 STEP 881 H= 881:00 +CPU= 43.438 21:02:34 STEP 882 H= 882:00 +CPU= 69.643 21:03:20 STEP 883 H= 883:00 +CPU= 43.411 21:04:07 STEP 884 H= 884:00 +CPU= 44.679 21:05:20 STEP 885 H= 885:00 +CPU= 68.354 21:06:08 STEP 886 H= 886:00 +CPU= 44.668 21:06:55 STEP 887 H= 887:00 +CPU= 44.905 21:08:21 STEP 888 H= 888:00 +CPU= 80.137 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000888 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000888 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000888 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000864 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000864 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000864 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000876 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000876 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000876 Zipping up the intermediate file: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_0011_1993050100_123_962_12178655_0_r1772798325_36.zip Uploading the intermediate file: upload_file_36.zip 21:09:07 STEP 889 H= 889:00 +CPU= 43.266 21:09:55 STEP 890 H= 890:00 +CPU= 44.758 21:11:07 STEP 891 H= 891:00 +CPU= 68.462 21:11:55 STEP 892 H= 892:00 +CPU= 44.646 21:12:41 STEP 893 H= 893:00 +CPU= 43.345 21:13:55 STEP 894 H= 894:00 +CPU= 69.809 21:14:41 STEP 895 H= 895:00 +CPU= 43.516 21:15:29 STEP 896 H= 896:00 +CPU= 44.778 21:16:41 STEP 897 H= 897:00 +CPU= 68.228 21:17:29 STEP 898 H= 898:00 +CPU= 44.844 21:18:15 STEP 899 H= 899:00 +CPU= 43.456 21:19:36 STEP 900 H= 900:00 +CPU= 76.553 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000900 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000900 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000900 21:20:22 STEP 901 H= 901:00 +CPU= 43.312 21:21:10 STEP 902 H= 902:00 +CPU= 44.829 21:22:23 STEP 903 H= 903:00 +CPU= 68.355 21:23:10 STEP 904 H= 904:00 +CPU= 44.666 21:23:56 STEP 905 H= 905:00 +CPU= 43.427 21:25:10 STEP 906 H= 906:00 +CPU= 69.694 21:25:56 STEP 907 H= 907:00 +CPU= 43.385 21:26:44 STEP 908 H= 908:00 +CPU= 44.734 21:27:56 STEP 909 H= 909:00 +CPU= 68.410 21:28:44 STEP 910 H= 910:00 +CPU= 44.763 21:29:32 STEP 911 H= 911:00 +CPU= 44.679 21:30:57 STEP 912 H= 912:00 +CPU= 80.379 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000912 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000912 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000912 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000888 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000888 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000888 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000900 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000900 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000900 Zipping up the intermediate file: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_0011_1993050100_123_962_12178655_0_r1772798325_37.zip Uploading the intermediate file: upload_file_37.zip 21:31:43 STEP 913 H= 913:00 +CPU= 43.237 21:32:31 STEP 914 H= 914:00 +CPU= 44.552 21:33:44 STEP 915 H= 915:00 +CPU= 68.454 21:34:31 STEP 916 H= 916:00 +CPU= 44.755 21:35:17 STEP 917 H= 917:00 +CPU= 43.470 21:36:32 STEP 918 H= 918:00 +CPU= 69.898 21:37:18 STEP 919 H= 919:00 +CPU= 43.485 21:38:06 STEP 920 H= 920:00 +CPU= 44.953 21:39:18 STEP 921 H= 921:00 +CPU= 68.371 21:40:06 STEP 922 H= 922:00 +CPU= 44.827 21:40:52 STEP 923 H= 923:00 +CPU= 43.625 21:42:13 STEP 924 H= 924:00 +CPU= 76.328 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000924 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000924 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000924 21:43:00 STEP 925 H= 925:00 +CPU= 43.576 21:43:47 STEP 926 H= 926:00 +CPU= 44.838 21:45:00 STEP 927 H= 927:00 +CPU= 68.370 21:45:47 STEP 928 H= 928:00 +CPU= 44.674 21:46:33 STEP 929 H= 929:00 +CPU= 43.413 21:47:47 STEP 930 H= 930:00 +CPU= 69.753 21:48:33 STEP 931 H= 931:00 +CPU= 43.472 21:49:21 STEP 932 H= 932:00 +CPU= 44.706 21:50:33 STEP 933 H= 933:00 +CPU= 68.064 21:51:21 STEP 934 H= 934:00 +CPU= 44.695 21:52:08 STEP 935 H= 935:00 +CPU= 44.790 21:53:34 STEP 936 H= 936:00 +CPU= 80.375 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000936 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000936 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000936 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000912 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000912 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000912 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000924 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000924 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000924 Zipping up the intermediate file: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_0011_1993050100_123_962_12178655_0_r1772798325_38.zip Uploading the intermediate file: upload_file_38.zip 21:54:20 STEP 937 H= 937:00 +CPU= 43.311 21:55:08 STEP 938 H= 938:00 +CPU= 44.703 21:56:21 STEP 939 H= 939:00 +CPU= 68.395 21:57:08 STEP 940 H= 940:00 +CPU= 44.676 21:57:54 STEP 941 H= 941:00 +CPU= 43.388 21:59:08 STEP 942 H= 942:00 +CPU= 70.006 21:59:55 STEP 943 H= 943:00 +CPU= 43.480 22:00:42 STEP 944 H= 944:00 +CPU= 44.815 22:01:55 STEP 945 H= 945:00 +CPU= 68.598 22:02:43 STEP 946 H= 946:00 +CPU= 44.844 22:03:29 STEP 947 H= 947:00 +CPU= 43.628 22:04:50 STEP 948 H= 948:00 +CPU= 76.696 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000948 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000948 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000948 22:05:37 STEP 949 H= 949:00 +CPU= 43.528 22:06:24 STEP 950 H= 950:00 +CPU= 44.677 22:07:37 STEP 951 H= 951:00 +CPU= 68.494 22:08:24 STEP 952 H= 952:00 +CPU= 44.709 22:09:10 STEP 953 H= 953:00 +CPU= 43.320 22:10:24 STEP 954 H= 954:00 +CPU= 69.794 22:11:11 STEP 955 H= 955:00 +CPU= 43.593 22:11:58 STEP 956 H= 956:00 +CPU= 44.804 22:13:11 STEP 957 H= 957:00 +CPU= 68.523 22:13:59 STEP 958 H= 958:00 +CPU= 44.814 22:14:47 STEP 959 H= 959:00 +CPU= 44.930 22:16:12 STEP 960 H= 960:00 +CPU= 80.276 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000960 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000960 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000960 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000936 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000936 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000936 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000948 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000948 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000948 Zipping up the intermediate file: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_0011_1993050100_123_962_12178655_0_r1772798325_39.zip Uploading the intermediate file: upload_file_39.zip 22:16:58 STEP 961 H= 961:00 +CPU= 43.317 22:17:45 STEP 962 H= 962:00 +CPU= 44.642 22:18:58 STEP 963 H= 963:00 +CPU= 68.410 22:19:45 STEP 964 H= 964:00 +CPU= 44.687 22:20:32 STEP 965 H= 965:00 +CPU= 43.504 22:21:46 STEP 966 H= 966:00 +CPU= 69.825 22:22:32 STEP 967 H= 967:00 +CPU= 43.491 22:23:20 STEP 968 H= 968:00 +CPU= 44.905 22:24:32 STEP 969 H= 969:00 +CPU= 68.514 22:25:20 STEP 970 H= 970:00 +CPU= 44.901 22:26:07 STEP 971 H= 971:00 +CPU= 43.509 22:27:28 STEP 972 H= 972:00 +CPU= 76.626 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000972 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000972 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000972 22:28:14 STEP 973 H= 973:00 +CPU= 43.600 22:29:02 STEP 974 H= 974:00 +CPU= 44.811 22:30:15 STEP 975 H= 975:00 +CPU= 68.594 22:31:03 STEP 976 H= 976:00 +CPU= 44.799 22:31:49 STEP 977 H= 977:00 +CPU= 43.404 22:33:03 STEP 978 H= 978:00 +CPU= 69.816 22:33:49 STEP 979 H= 979:00 +CPU= 43.487 22:34:37 STEP 980 H= 980:00 +CPU= 44.747 22:35:50 STEP 981 H= 981:00 +CPU= 68.673 22:36:37 STEP 982 H= 982:00 +CPU= 44.648 22:37:25 STEP 983 H= 983:00 +CPU= 45.041 22:38:50 STEP 984 H= 984:00 +CPU= 80.119 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000984 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000984 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000984 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000960 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000960 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000960 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000972 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000972 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000972 Zipping up the intermediate file: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_0011_1993050100_123_962_12178655_0_r1772798325_40.zip Uploading the intermediate file: upload_file_40.zip 22:39:37 STEP 985 H= 985:00 +CPU= 43.551 22:40:24 STEP 986 H= 986:00 +CPU= 44.623 22:41:37 STEP 987 H= 987:00 +CPU= 68.541 22:42:25 STEP 988 H= 988:00 +CPU= 44.898 22:43:11 STEP 989 H= 989:00 +CPU= 43.697 22:44:26 STEP 990 H= 990:00 +CPU= 69.967 22:45:12 STEP 991 H= 991:00 +CPU= 43.663 22:46:00 STEP 992 H= 992:00 +CPU= 44.775 22:47:13 STEP 993 H= 993:00 +CPU= 68.803 22:48:01 STEP 994 H= 994:00 +CPU= 44.876 22:48:47 STEP 995 H= 995:00 +CPU= 43.502 22:50:08 STEP 996 H= 996:00 +CPU= 76.426 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+000996 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+000996 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+000996 22:50:54 STEP 997 H= 997:00 +CPU= 43.532 22:51:42 STEP 998 H= 998:00 +CPU= 44.760 22:52:55 STEP 999 H= 999:00 +CPU= 68.423 22:53:42 STEP 1000 H=1000:00 +CPU= 44.878 22:54:29 STEP 1001 H=1001:00 +CPU= 43.402 22:55:43 STEP 1002 H=1002:00 +CPU= 69.868 22:56:29 STEP 1003 H=1003:00 +CPU= 43.587 22:57:17 STEP 1004 H=1004:00 +CPU= 44.938 22:58:29 STEP 1005 H=1005:00 +CPU= 68.213 22:59:17 STEP 1006 H=1006:00 +CPU= 44.730 23:00:05 STEP 1007 H=1007:00 +CPU= 44.888 23:01:30 STEP 1008 H=1008:00 +CPU= 80.071 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+001008 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+001008 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+001008 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000984 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000984 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000984 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+000996 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+000996 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+000996 Zipping up the intermediate file: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_0011_1993050100_123_962_12178655_0_r1772798325_41.zip Uploading the intermediate file: upload_file_41.zip 23:02:16 STEP 1009 H=1009:00 +CPU= 43.427 23:03:04 STEP 1010 H=1010:00 +CPU= 44.718 23:04:16 STEP 1011 H=1011:00 +CPU= 68.403 23:05:04 STEP 1012 H=1012:00 +CPU= 44.605 23:05:50 STEP 1013 H=1013:00 +CPU= 43.507 23:07:04 STEP 1014 H=1014:00 +CPU= 70.009 23:07:50 STEP 1015 H=1015:00 +CPU= 43.563 23:08:38 STEP 1016 H=1016:00 +CPU= 44.861 23:09:51 STEP 1017 H=1017:00 +CPU= 68.544 23:10:38 STEP 1018 H=1018:00 +CPU= 44.715 23:11:25 STEP 1019 H=1019:00 +CPU= 43.724 23:12:46 STEP 1020 H=1020:00 +CPU= 76.472 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+001020 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+001020 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+001020 23:13:32 STEP 1021 H=1021:00 +CPU= 43.479 23:14:20 STEP 1022 H=1022:00 +CPU= 44.854 23:15:32 STEP 1023 H=1023:00 +CPU= 68.341 23:16:20 STEP 1024 H=1024:00 +CPU= 44.776 23:17:06 STEP 1025 H=1025:00 +CPU= 43.767 23:18:21 STEP 1026 H=1026:00 +CPU= 70.015 23:19:07 STEP 1027 H=1027:00 +CPU= 43.513 23:19:54 STEP 1028 H=1028:00 +CPU= 44.808 23:21:07 STEP 1029 H=1029:00 +CPU= 68.122 23:21:54 STEP 1030 H=1030:00 +CPU= 44.777 23:22:42 STEP 1031 H=1031:00 +CPU= 44.803 23:24:07 STEP 1032 H=1032:00 +CPU= 80.225 Moving to projects directory: /home/luuser/slots/1/ICMGGhq0f+001032 Moving to projects directory: /home/luuser/slots/1/ICMSHhq0f+001032 Moving to projects directory: /home/luuser/slots/1/ICMUAhq0f+001032 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+001008 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+001008 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+001008 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMGGhq0f+001020 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMSHhq0f+001020 Adding to the zip: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_12178655/ICMUAhq0f+001020 Zipping up the intermediate file: /home/luuser/projects/climateprediction.net/oifs_43r3_ps_0011_1993050100_123_962_12178655_0_r1772798325_42.zip Uploading the intermediate file: upload_file_42.zip Uploading trickle at timestep: 3715200 23:24:55 STEP 1033 H=1033:00 +CPU= 43.570 23:25:42 STEP 1034 H=1034:00 +CPU= 44.745 23:27:03 STEP 1035 H=1035:00 +CPU= 67.958 The child process terminated with status: 0 ..Failed, model did not complete successfully </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
09 May 2023 16:10:55	1537854	22263528	oifs_43r3_ps_0011_1993050100_123_962_12178655_0	3,715,200	57,152	0.0154
09 May 2023 16:10:42	1537854	22263528	oifs_43r3_ps_0011_1993050100_123_962_12178655_0	2,851,200	44,383	0.0156
09 May 2023 16:10:30	1537854	22263528	oifs_43r3_ps_0011_1993050100_123_962_12178655_0	1,987,200	31,609	0.0159