climateprediction.net home page
Task 22260645

Task 22260645

Name oifs_43r3_ps_0280_1990050100_123_959_12175924_0
Workunit 12175924
Created 21 Dec 2022, 18:46:49 UTC
Sent 21 Dec 2022, 18:51:14 UTC
Report deadline 20 Jan 2023, 18:51:14 UTC
Received 22 Dec 2022, 17:14:18 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1532184
Run time 21 hours 30 min 54 sec
CPU time 21 hours 14 min 12 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 7.02 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,415.76 MB
Peak swap size 4,974.80 MB
Peak disk usage 1,210.58 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<stderr_txt>
k_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :          GP_MODEL_HEAP 
[EC_DRHOOK:W31Ub20:1:1:8001:8001] [20221222:130858:1671710938:62054.039] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :           GP_MODEL 
[EC_DRHOOK:W31Ub20:1:1:8001:8001] [20221222:130858:1671710938:62054.039] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :            RADDRV 
[EC_DRHOOK:W31Ub20:1:1:8001:8001] [20221222:130858:1671710938:62054.039] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :             RADINTG 
[EC_DRHOOK:W31Ub20:1:1:8001:8001] [20221222:130858:1671710938:62054.039] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :              >OMP-RADINTG-RADLSW       (1210) 
[EC_DRHOOK:W31Ub20:1:1:8001:8001] [20221222:130858:1671710938:62054.039] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :               RADIATION_SCHEME 
[EC_DRHOOK:W31Ub20:1:1:8001:8001] [20221222:130858:1671710938:62054.039] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :                radiation_interface:radiation 
[EC_DRHOOK:W31Ub20:1:1:8001:8001] [20221222:130858:1671710938:62054.039] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :                 radiation_mcica_lw:solver_mcica_lw 
[EC_DRHOOK:W31Ub20:1:1:8001:8001] [20221222:130858:1671710938:62054.039] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :                  radiation_adding_ica_lw:calc_fluxes_no_scattering_lw 
[EC_DRHOOK:W31Ub20:1:1:8001:8001] [20221222:130859:1671710939:62055.040] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#15, nsigs = 1
[EC_DRHOOK:W31Ub20:1:1:8001:8001] [20221222:130859:1671710939:62055.040] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1ce8bb0 for signal#15, nsigs = 1
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
oifs_43r3_model.e  0000000001CE916B  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000081FFF1  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DC9090  Unknown               Unknown  Unknown
oifs_43r3_model.e  00000000019760FB  radiation_adding_         165  radiation_adding_ica_lw.F90
oifs_43r3_model.e  000000000197281C  radiation_mcica_l         164  radiation_mcica_lw.F90
oifs_43r3_model.e  0000000001862B6D  radiation_interfa         387  radiation_interface.F90
oifs_43r3_model.e  00000000012D30E5  radiation_scheme_         484  radiation_scheme.F90
oifs_43r3_model.e  000000000129A415  radintg_                 1455  radintg.F90
oifs_43r3_model.e  0000000001270124  raddrv_                   537  raddrv.F90
oifs_43r3_model.e  0000000000BFD839  gp_model_                 482  gp_model.F90
oifs_43r3_model.e  00000000012E9482  gp_model_heap_             74  gp_model_heap.F90
oifs_43r3_model.e  0000000000BBC1CE  scan2m_                   535  scan2m.F90
oifs_43r3_model.e  000000000057A664  stepo_                    327  stepo.F90
oifs_43r3_model.e  000000000055DEEC  cnt4_                    1133  cnt4.F90
oifs_43r3_model.e  00000000005471C9  cnt3_                     267  cnt3.F90
oifs_43r3_model.e  0000000000546412  cnt2_                      88  cnt2.F90
oifs_43r3_model.e  0000000000545E28  cnt1_                      92  cnt1.F90
oifs_43r3_model.e  000000000040708D  cnt0_                     146  cnt0.F90
oifs_43r3_model.e  000000000040220F  MAIN__                     96  master.F90
oifs_43r3_model.e  00000000004021A2  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCA390  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000040206E  Unknown               Unknown  Unknown
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1990050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0280
(argv4) batchid: 959
(argv5) wuid: 12175924
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/24
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/24/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/24/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_756a88a212347948af98ceb6f2a9c70d to: /var/lib/boinc-client/slots/24/oifs_43r3_ps_0280_1990050100_123_959_12175924.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/24/oifs_43r3_ps_0280_1990050100_123_959_12175924.zip
ic_ancil_file: ic_ancil_12175924
ifsdata_file: ifsdata_12175924
climate_data_file: clim_data_12175924
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_aac9baaf0855af8e4452d6e330af521a to: /var/lib/boinc-client/slots/24/ic_ancil_12175924.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/24/ic_ancil_12175924.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_1bf8b46efd268681142151c4ea7821a2 to: /var/lib/boinc-client/slots/24/ifsdata/ifsdata_12175924.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/24/ifsdata/ifsdata_12175924.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/24/159l_2/clim_data_12175924.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/24/159l_2/clim_data_12175924.zip
Checking for progress XML file: /var/lib/boinc-client/slots/24/progress_file_12175924.xml
Opened progress file ok : /var/lib/boinc-client/slots/24/progress_file_12175924.xml
-- Model is restarting --
Adjusting last_iter, 2463, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/24/progress_file_12175924.xml
last_cpu_time: 61580
upload_file_number: 102
last_iter: 2447
last_upload: 8812800
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0280_1990050100_123_959_12175924_0_r106034934
Executing the command: /var/lib/boinc-client/slots/24/oifs_43r3_model.exe
The child process has been launched with process id: 1500
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:W31Ub20:1:1:1500:1500] [20221222:131045:1671711045:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:W31Ub20:1:1:1500:1500] [20221222:131045:1671711045:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:W31Ub20:1:1:1500:1500] [20221222:131045:1671711045:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:W31Ub20:1:1:1500:1500] [20221222:131045:1671711045:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:W31Ub20:1:1:1500:1500] [20221222:131045:1671711045:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:W31Ub20:1:1:1500:1500] [20221222:131045:1671711045:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:W31Ub20:1:1:1500:1500] [20221222:131045:1671711045:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:W31Ub20:1:1:1500:1500] [20221222:131045:1671711045:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:W31Ub20:1:1:1500:1500] [20221222:131045:1671711045:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:W31Ub20:1:1:1500:1500] [20221222:131045:1671711045:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:W31Ub20:1:1:1500:1500] [20221222:131045:1671711045:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:W31Ub20:1:1:1500:1500] [20221222:131045:1671711045:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:W31Ub20:1:1:1500:1500] [20221222:131045:1671711045:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:W31Ub20:1:1:1500:1500] [20221222:131045:1671711045:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:W31Ub20:1:1:1500:1500] [20221222:131045:1671711045:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:W31Ub20:1:1:1500:1500] [20221222:131045:1671711045:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:W31Ub20:1:1:1500:1500] [20221222:131045:1671711045:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:W31Ub20:1:1:1500:1500] [20221222:131045:1671711045:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:W31Ub20:1:1:1500:1500] [20221222:131045:1671711045:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:W31Ub20:1:1:1500:1500] [20221222:131045:1671711045:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:W31Ub20:1:1:1500:1500] [20221222:131045:1671711045:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:W31Ub20:1:1:1500:1500] [20221222:131045:1671711045:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:W31Ub20:1:1:1500:1500] [20221222:131045:1671711045:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:W31Ub20:1:1:1500:1500] [20221222:131045:1671711045:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:W31Ub20:1:1:1500:1500] [20221222:131045:1671711045:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:W31Ub20:1:1:1500:1500] [20221222:131045:1671711045:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:W31Ub20:1:1:1500:1500] [20221222:131045:1671711045:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:W31Ub20:1:1:1500:1500] [20221222:131045:1671711045:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:W31Ub20:1:1:1500:1500] [20221222:131045:1671711045:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:W31Ub20:1:1:1500:1500] [20221222:131045:1671711045:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  13:11:53 STEP 2448 H=2448:00 +CPU= 42.944
  13:12:16 STEP 2449 H=2449:00 +CPU= 22.123
  13:12:39 STEP 2450 H=2450:00 +CPU= 21.377
  13:13:11 STEP 2451 H=2451:00 +CPU= 31.800
  13:13:32 STEP 2452 H=2452:00 +CPU= 20.727
  13:13:52 STEP 2453 H=2453:00 +CPU= 20.411
  13:14:26 STEP 2454 H=2454:00 +CPU= 32.383
  13:14:46 STEP 2455 H=2455:00 +CPU= 20.039
  13:15:07 STEP 2456 H=2456:00 +CPU= 20.396
  13:15:39 STEP 2457 H=2457:00 +CPU= 31.634
  13:16:00 STEP 2458 H=2458:00 +CPU= 21.034
  13:16:21 STEP 2459 H=2459:00 +CPU= 20.088
  13:16:56 STEP 2460 H=2460:00 +CPU= 34.612
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHhq0f+002460
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAhq0f+002460
  13:17:17 STEP 2461 H=2461:00 +CPU= 20.921
  13:17:38 STEP 2462 H=2462:00 +CPU= 20.925
  13:18:09 STEP 2463 H=2463:00 +CPU= 30.097
  13:18:30 STEP 2464 H=2464:00 +CPU= 20.408
  13:18:49 STEP 2465 H=2465:00 +CPU= 18.809
  13:19:19 STEP 2466 H=2466:00 +CPU= 29.786
  13:19:38 STEP 2467 H=2467:00 +CPU= 18.740
  13:19:58 STEP 2468 H=2468:00 +CPU= 20.000
  13:20:31 STEP 2469 H=2469:00 +CPU= 32.338
  13:20:52 STEP 2470 H=2470:00 +CPU= 20.756
  13:21:13 STEP 2471 H=2471:00 +CPU= 21.191
  13:22:00 STEP 2472 H=2472:00 +CPU= 36.297
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMGGhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMSHhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMGGhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMSHhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMUAhq0f+002460
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0280_1990050100_123_959_12175924_0_r106034934_102.zip
Uploading the intermediate file: upload_file_102.zip
  13:22:21 STEP 2473 H=2473:00 +CPU= 21.161
  13:22:42 STEP 2474 H=2474:00 +CPU= 21.016
  13:23:14 STEP 2475 H=2475:00 +CPU= 31.033
  13:23:35 STEP 2476 H=2476:00 +CPU= 21.080
  13:23:56 STEP 2477 H=2477:00 +CPU= 20.889
  13:24:28 STEP 2478 H=2478:00 +CPU= 31.495
  13:24:49 STEP 2479 H=2479:00 +CPU= 20.554
  13:25:10 STEP 2480 H=2480:00 +CPU= 21.096
  13:25:41 STEP 2481 H=2481:00 +CPU= 31.283
  13:26:04 STEP 2482 H=2482:00 +CPU= 22.298
  13:26:24 STEP 2483 H=2483:00 +CPU= 20.678
  13:26:59 STEP 2484 H=2484:00 +CPU= 34.816
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAhq0f+002484
  13:27:20 STEP 2485 H=2485:00 +CPU= 20.654
  13:27:42 STEP 2486 H=2486:00 +CPU= 21.132
  13:28:14 STEP 2487 H=2487:00 +CPU= 31.786
  13:28:35 STEP 2488 H=2488:00 +CPU= 21.535
  13:28:56 STEP 2489 H=2489:00 +CPU= 20.659
  13:29:29 STEP 2490 H=2490:00 +CPU= 32.731
  13:29:50 STEP 2491 H=2491:00 +CPU= 20.771
  13:30:12 STEP 2492 H=2492:00 +CPU= 21.194
  13:30:44 STEP 2493 H=2493:00 +CPU= 32.199
  13:31:06 STEP 2494 H=2494:00 +CPU= 21.217
  13:31:27 STEP 2495 H=2495:00 +CPU= 20.634
  13:32:05 STEP 2496 H=2496:00 +CPU= 35.405
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMGGhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMSHhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMGGhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMSHhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMUAhq0f+002484
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0280_1990050100_123_959_12175924_0_r106034934_103.zip
Uploading the intermediate file: upload_file_103.zip
  13:32:27 STEP 2497 H=2497:00 +CPU= 20.688
  13:32:48 STEP 2498 H=2498:00 +CPU= 20.926
  13:33:20 STEP 2499 H=2499:00 +CPU= 31.861
  13:33:42 STEP 2500 H=2500:00 +CPU= 21.098
  13:34:02 STEP 2501 H=2501:00 +CPU= 20.610
  13:34:35 STEP 2502 H=2502:00 +CPU= 32.450
  13:34:57 STEP 2503 H=2503:00 +CPU= 20.903
  13:35:18 STEP 2504 H=2504:00 +CPU= 21.242
  13:35:50 STEP 2505 H=2505:00 +CPU= 31.625
  13:36:12 STEP 2506 H=2506:00 +CPU= 21.251
  13:36:33 STEP 2507 H=2507:00 +CPU= 20.706
  13:37:08 STEP 2508 H=2508:00 +CPU= 35.001
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAhq0f+002508
  13:37:29 STEP 2509 H=2509:00 +CPU= 20.680
  13:37:50 STEP 2510 H=2510:00 +CPU= 20.954
  13:38:22 STEP 2511 H=2511:00 +CPU= 31.840
  13:38:44 STEP 2512 H=2512:00 +CPU= 21.027
  13:39:05 STEP 2513 H=2513:00 +CPU= 21.095
  13:39:38 STEP 2514 H=2514:00 +CPU= 32.724
  13:39:59 STEP 2515 H=2515:00 +CPU= 20.497
  13:40:20 STEP 2516 H=2516:00 +CPU= 20.791
  13:40:52 STEP 2517 H=2517:00 +CPU= 31.638
  13:41:13 STEP 2518 H=2518:00 +CPU= 21.119
  13:41:34 STEP 2519 H=2519:00 +CPU= 20.301
  13:42:12 STEP 2520 H=2520:00 +CPU= 36.415
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMGGhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMSHhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMGGhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMSHhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMUAhq0f+002508
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0280_1990050100_123_959_12175924_0_r106034934_104.zip
Uploading the intermediate file: upload_file_104.zip
  13:42:32 STEP 2521 H=2521:00 +CPU= 19.797
  13:42:51 STEP 2522 H=2522:00 +CPU= 19.813
  13:43:22 STEP 2523 H=2523:00 +CPU= 30.654
  13:43:42 STEP 2524 H=2524:00 +CPU= 20.137
  13:44:02 STEP 2525 H=2525:00 +CPU= 19.635
  13:44:33 STEP 2526 H=2526:00 +CPU= 31.163
  13:44:53 STEP 2527 H=2527:00 +CPU= 20.015
  13:45:13 STEP 2528 H=2528:00 +CPU= 20.158
  13:45:44 STEP 2529 H=2529:00 +CPU= 30.300
  13:46:05 STEP 2530 H=2530:00 +CPU= 21.149
  13:46:25 STEP 2531 H=2531:00 +CPU= 20.335
  13:47:00 STEP 2532 H=2532:00 +CPU= 34.535
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAhq0f+002532
  13:47:21 STEP 2533 H=2533:00 +CPU= 20.806
  13:47:43 STEP 2534 H=2534:00 +CPU= 20.650
  13:48:15 STEP 2535 H=2535:00 +CPU= 31.697
  13:48:36 STEP 2536 H=2536:00 +CPU= 21.169
  13:48:56 STEP 2537 H=2537:00 +CPU= 20.154
  13:49:29 STEP 2538 H=2538:00 +CPU= 32.281
  13:49:50 STEP 2539 H=2539:00 +CPU= 20.418
  13:50:11 STEP 2540 H=2540:00 +CPU= 20.781
  13:50:44 STEP 2541 H=2541:00 +CPU= 31.804
  13:51:05 STEP 2542 H=2542:00 +CPU= 21.487
  13:51:27 STEP 2543 H=2543:00 +CPU= 21.173
  13:52:06 STEP 2544 H=2544:00 +CPU= 37.022
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMGGhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMSHhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMGGhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMSHhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMUAhq0f+002532
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0280_1990050100_123_959_12175924_0_r106034934_105.zip
Uploading the intermediate file: upload_file_105.zip
  13:52:28 STEP 2545 H=2545:00 +CPU= 20.814
  13:52:48 STEP 2546 H=2546:00 +CPU= 20.226
  13:53:21 STEP 2547 H=2547:00 +CPU= 32.202
  13:53:43 STEP 2548 H=2548:00 +CPU= 21.287
  13:54:03 STEP 2549 H=2549:00 +CPU= 20.218
  13:54:36 STEP 2550 H=2550:00 +CPU= 32.198
  13:54:57 STEP 2551 H=2551:00 +CPU= 20.599
  13:55:18 STEP 2552 H=2552:00 +CPU= 21.113
  13:55:50 STEP 2553 H=2553:00 +CPU= 31.383
  13:56:12 STEP 2554 H=2554:00 +CPU= 21.394
  13:56:33 STEP 2555 H=2555:00 +CPU= 20.655
  13:57:08 STEP 2556 H=2556:00 +CPU= 34.661
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAhq0f+002556
  13:57:29 STEP 2557 H=2557:00 +CPU= 21.047
  13:57:50 STEP 2558 H=2558:00 +CPU= 20.965
  13:58:23 STEP 2559 H=2559:00 +CPU= 31.898
  13:58:44 STEP 2560 H=2560:00 +CPU= 21.459
  13:59:05 STEP 2561 H=2561:00 +CPU= 20.386
  13:59:37 STEP 2562 H=2562:00 +CPU= 32.281
  13:59:59 STEP 2563 H=2563:00 +CPU= 20.804
  14:00:20 STEP 2564 H=2564:00 +CPU= 20.691
  14:00:52 STEP 2565 H=2565:00 +CPU= 31.485
  14:01:14 STEP 2566 H=2566:00 +CPU= 21.324
  14:01:35 STEP 2567 H=2567:00 +CPU= 20.822
  14:02:17 STEP 2568 H=2568:00 +CPU= 36.759
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMGGhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMSHhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMGGhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMSHhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMUAhq0f+002556
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0280_1990050100_123_959_12175924_0_r106034934_106.zip
Uploading the intermediate file: upload_file_106.zip
  14:02:38 STEP 2569 H=2569:00 +CPU= 20.649
  14:02:59 STEP 2570 H=2570:00 +CPU= 20.818
  14:03:32 STEP 2571 H=2571:00 +CPU= 31.951
  14:03:53 STEP 2572 H=2572:00 +CPU= 21.026
  14:04:14 STEP 2573 H=2573:00 +CPU= 20.607
  14:04:47 STEP 2574 H=2574:00 +CPU= 31.909
  14:05:07 STEP 2575 H=2575:00 +CPU= 20.466
  14:05:28 STEP 2576 H=2576:00 +CPU= 20.596
  14:06:00 STEP 2577 H=2577:00 +CPU= 31.692
  14:06:22 STEP 2578 H=2578:00 +CPU= 21.162
  14:06:43 STEP 2579 H=2579:00 +CPU= 20.356
  14:07:18 STEP 2580 H=2580:00 +CPU= 34.403
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAhq0f+002580
  14:07:39 STEP 2581 H=2581:00 +CPU= 20.776
  14:08:00 STEP 2582 H=2582:00 +CPU= 20.703
  14:08:33 STEP 2583 H=2583:00 +CPU= 31.629
  14:08:54 STEP 2584 H=2584:00 +CPU= 21.259
  14:09:14 STEP 2585 H=2585:00 +CPU= 20.263
  14:09:47 STEP 2586 H=2586:00 +CPU= 32.030
  14:10:08 STEP 2587 H=2587:00 +CPU= 20.512
  14:10:29 STEP 2588 H=2588:00 +CPU= 20.783
  14:11:01 STEP 2589 H=2589:00 +CPU= 31.702
  14:11:23 STEP 2590 H=2590:00 +CPU= 21.304
  14:11:45 STEP 2591 H=2591:00 +CPU= 20.981
  14:12:23 STEP 2592 H=2592:00 +CPU= 36.295
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMGGhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMSHhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMGGhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMSHhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMUAhq0f+002580
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0280_1990050100_123_959_12175924_0_r106034934_107.zip
Uploading the intermediate file: upload_file_107.zip
  14:12:44 STEP 2593 H=2593:00 +CPU= 20.456
  14:13:06 STEP 2594 H=2594:00 +CPU= 20.949
  14:13:37 STEP 2595 H=2595:00 +CPU= 31.393
  14:13:58 STEP 2596 H=2596:00 +CPU= 21.010
  14:14:19 STEP 2597 H=2597:00 +CPU= 20.473
  14:14:52 STEP 2598 H=2598:00 +CPU= 32.839
  14:15:13 STEP 2599 H=2599:00 +CPU= 20.514
  14:15:34 STEP 2600 H=2600:00 +CPU= 20.668
  14:16:05 STEP 2601 H=2601:00 +CPU= 31.347
  14:16:26 STEP 2602 H=2602:00 +CPU= 21.089
  14:16:47 STEP 2603 H=2603:00 +CPU= 20.645
  14:17:23 STEP 2604 H=2604:00 +CPU= 34.696
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAhq0f+002604
  14:17:44 STEP 2605 H=2605:00 +CPU= 20.761
  14:18:05 STEP 2606 H=2606:00 +CPU= 20.789
  14:18:38 STEP 2607 H=2607:00 +CPU= 31.795
  14:18:59 STEP 2608 H=2608:00 +CPU= 21.125
  14:19:20 STEP 2609 H=2609:00 +CPU= 20.268
  14:19:52 STEP 2610 H=2610:00 +CPU= 32.110
  14:20:13 STEP 2611 H=2611:00 +CPU= 20.505
  14:20:34 STEP 2612 H=2612:00 +CPU= 20.862
  14:21:07 STEP 2613 H=2613:00 +CPU= 31.571
  14:21:28 STEP 2614 H=2614:00 +CPU= 21.313
  14:21:50 STEP 2615 H=2615:00 +CPU= 21.119
  14:22:30 STEP 2616 H=2616:00 +CPU= 37.288
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMGGhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMSHhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMGGhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMSHhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMUAhq0f+002604
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0280_1990050100_123_959_12175924_0_r106034934_108.zip
Uploading the intermediate file: upload_file_108.zip
  14:22:51 STEP 2617 H=2617:00 +CPU= 20.690
  14:23:13 STEP 2618 H=2618:00 +CPU= 20.947
  14:23:45 STEP 2619 H=2619:00 +CPU= 32.034
  14:24:07 STEP 2620 H=2620:00 +CPU= 20.946
  14:24:27 STEP 2621 H=2621:00 +CPU= 20.438
  14:25:00 STEP 2622 H=2622:00 +CPU= 32.517
  14:25:21 STEP 2623 H=2623:00 +CPU= 21.290
  14:25:43 STEP 2624 H=2624:00 +CPU= 21.796
  14:26:16 STEP 2625 H=2625:00 +CPU= 32.333
  14:26:39 STEP 2626 H=2626:00 +CPU= 22.491
  14:27:02 STEP 2627 H=2627:00 +CPU= 22.760
  14:27:39 STEP 2628 H=2628:00 +CPU= 36.853
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAhq0f+002628
  14:28:03 STEP 2629 H=2629:00 +CPU= 22.719
  14:28:27 STEP 2630 H=2630:00 +CPU= 23.189
  14:29:04 STEP 2631 H=2631:00 +CPU= 36.041
  14:29:28 STEP 2632 H=2632:00 +CPU= 24.175
  14:29:52 STEP 2633 H=2633:00 +CPU= 22.905
  14:30:29 STEP 2634 H=2634:00 +CPU= 36.963
  14:30:53 STEP 2635 H=2635:00 +CPU= 23.694
  14:31:17 STEP 2636 H=2636:00 +CPU= 23.723
  14:31:54 STEP 2637 H=2637:00 +CPU= 36.121
  14:32:18 STEP 2638 H=2638:00 +CPU= 24.017
  14:32:43 STEP 2639 H=2639:00 +CPU= 24.062
  14:33:26 STEP 2640 H=2640:00 +CPU= 40.319
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMGGhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMSHhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMGGhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMSHhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMUAhq0f+002628
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0280_1990050100_123_959_12175924_0_r106034934_109.zip
Uploading the intermediate file: upload_file_109.zip
  14:33:47 STEP 2641 H=2641:00 +CPU= 21.317
  14:34:08 STEP 2642 H=2642:00 +CPU= 20.992
  14:34:40 STEP 2643 H=2643:00 +CPU= 31.646
  14:35:01 STEP 2644 H=2644:00 +CPU= 21.272
  14:35:22 STEP 2645 H=2645:00 +CPU= 20.441
  14:35:54 STEP 2646 H=2646:00 +CPU= 32.370
  14:36:15 STEP 2647 H=2647:00 +CPU= 20.809
  14:36:37 STEP 2648 H=2648:00 +CPU= 21.476
  14:37:11 STEP 2649 H=2649:00 +CPU= 33.944
  14:37:35 STEP 2650 H=2650:00 +CPU= 23.983
  14:37:59 STEP 2651 H=2651:00 +CPU= 22.919
  14:38:39 STEP 2652 H=2652:00 +CPU= 39.195
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAhq0f+002652
  14:39:03 STEP 2653 H=2653:00 +CPU= 23.544
  14:39:27 STEP 2654 H=2654:00 +CPU= 23.576
  14:40:04 STEP 2655 H=2655:00 +CPU= 36.076
  14:40:28 STEP 2656 H=2656:00 +CPU= 23.743
  14:40:51 STEP 2657 H=2657:00 +CPU= 23.064
  14:41:29 STEP 2658 H=2658:00 +CPU= 36.950
  14:41:53 STEP 2659 H=2659:00 +CPU= 23.534
  14:42:17 STEP 2660 H=2660:00 +CPU= 24.110
  14:42:54 STEP 2661 H=2661:00 +CPU= 36.069
  14:43:19 STEP 2662 H=2662:00 +CPU= 24.411
  14:43:43 STEP 2663 H=2663:00 +CPU= 24.108
  14:44:27 STEP 2664 H=2664:00 +CPU= 41.916
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMGGhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMSHhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMGGhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMSHhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMUAhq0f+002652
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0280_1990050100_123_959_12175924_0_r106034934_110.zip
Uploading the intermediate file: upload_file_110.zip
  14:44:52 STEP 2665 H=2665:00 +CPU= 23.998
  14:45:17 STEP 2666 H=2666:00 +CPU= 24.591
  14:45:55 STEP 2667 H=2667:00 +CPU= 37.785
  14:46:20 STEP 2668 H=2668:00 +CPU= 23.932
  14:46:43 STEP 2669 H=2669:00 +CPU= 23.031
  14:47:20 STEP 2670 H=2670:00 +CPU= 36.725
  14:47:44 STEP 2671 H=2671:00 +CPU= 23.444
  14:48:08 STEP 2672 H=2672:00 +CPU= 23.822
  14:48:44 STEP 2673 H=2673:00 +CPU= 36.181
  14:49:09 STEP 2674 H=2674:00 +CPU= 24.117
  14:49:33 STEP 2675 H=2675:00 +CPU= 23.222
  14:50:13 STEP 2676 H=2676:00 +CPU= 39.245
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAhq0f+002676
  14:50:37 STEP 2677 H=2677:00 +CPU= 23.302
  14:51:01 STEP 2678 H=2678:00 +CPU= 23.997
  14:51:38 STEP 2679 H=2679:00 +CPU= 36.399
  14:52:02 STEP 2680 H=2680:00 +CPU= 23.780
  14:52:26 STEP 2681 H=2681:00 +CPU= 23.643
  14:53:03 STEP 2682 H=2682:00 +CPU= 36.604
  14:53:27 STEP 2683 H=2683:00 +CPU= 23.640
  14:53:51 STEP 2684 H=2684:00 +CPU= 24.159
  14:54:28 STEP 2685 H=2685:00 +CPU= 36.552
  14:54:53 STEP 2686 H=2686:00 +CPU= 24.483
  14:55:19 STEP 2687 H=2687:00 +CPU= 24.842
  14:56:02 STEP 2688 H=2688:00 +CPU= 42.300
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMGGhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMSHhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMGGhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMSHhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMUAhq0f+002676
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0280_1990050100_123_959_12175924_0_r106034934_111.zip
Uploading the intermediate file: upload_file_111.zip
  14:56:27 STEP 2689 H=2689:00 +CPU= 23.548
Uploading trickle at timestep: 9676800
  14:56:51 STEP 2690 H=2690:00 +CPU= 24.118
  14:57:28 STEP 2691 H=2691:00 +CPU= 36.333
  14:57:52 STEP 2692 H=2692:00 +CPU= 23.743
  14:58:16 STEP 2693 H=2693:00 +CPU= 23.459
  14:58:54 STEP 2694 H=2694:00 +CPU= 37.100
  14:59:18 STEP 2695 H=2695:00 +CPU= 23.499
  14:59:43 STEP 2696 H=2696:00 +CPU= 24.247
  15:00:20 STEP 2697 H=2697:00 +CPU= 37.047
  15:00:45 STEP 2698 H=2698:00 +CPU= 23.592
  15:01:09 STEP 2699 H=2699:00 +CPU= 23.696
  15:01:49 STEP 2700 H=2700:00 +CPU= 39.850
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAhq0f+002700
  15:02:13 STEP 2701 H=2701:00 +CPU= 23.410
  15:02:38 STEP 2702 H=2702:00 +CPU= 24.501
  15:03:16 STEP 2703 H=2703:00 +CPU= 36.340
  15:03:40 STEP 2704 H=2704:00 +CPU= 24.342
  15:04:04 STEP 2705 H=2705:00 +CPU= 23.581
  15:04:42 STEP 2706 H=2706:00 +CPU= 37.253
  15:05:06 STEP 2707 H=2707:00 +CPU= 23.493
  15:05:30 STEP 2708 H=2708:00 +CPU= 24.116
  15:06:07 STEP 2709 H=2709:00 +CPU= 36.609
  15:06:32 STEP 2710 H=2710:00 +CPU= 24.758
  15:06:56 STEP 2711 H=2711:00 +CPU= 23.661
  15:07:41 STEP 2712 H=2712:00 +CPU= 42.728
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMGGhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMSHhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMGGhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMSHhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMUAhq0f+002700
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0280_1990050100_123_959_12175924_0_r106034934_112.zip
Uploading the intermediate file: upload_file_112.zip
  15:08:05 STEP 2713 H=2713:00 +CPU= 23.120
  15:08:30 STEP 2714 H=2714:00 +CPU= 23.969
  15:09:07 STEP 2715 H=2715:00 +CPU= 36.534
  15:09:31 STEP 2716 H=2716:00 +CPU= 23.928
  15:09:55 STEP 2717 H=2717:00 +CPU= 23.407
  15:10:32 STEP 2718 H=2718:00 +CPU= 36.471
  15:10:56 STEP 2719 H=2719:00 +CPU= 23.900
  15:11:20 STEP 2720 H=2720:00 +CPU= 23.422
  15:11:57 STEP 2721 H=2721:00 +CPU= 37.344
  15:12:22 STEP 2722 H=2722:00 +CPU= 24.303
  15:12:46 STEP 2723 H=2723:00 +CPU= 23.084
  15:13:26 STEP 2724 H=2724:00 +CPU= 38.951
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAhq0f+002724
  15:13:51 STEP 2725 H=2725:00 +CPU= 23.847
  15:14:15 STEP 2726 H=2726:00 +CPU= 23.900
  15:14:53 STEP 2727 H=2727:00 +CPU= 37.306
  15:15:18 STEP 2728 H=2728:00 +CPU= 24.393
  15:15:42 STEP 2729 H=2729:00 +CPU= 23.376
  15:16:20 STEP 2730 H=2730:00 +CPU= 37.474
  15:16:44 STEP 2731 H=2731:00 +CPU= 23.975
  15:17:09 STEP 2732 H=2732:00 +CPU= 23.777
  15:17:45 STEP 2733 H=2733:00 +CPU= 36.404
  15:18:10 STEP 2734 H=2734:00 +CPU= 24.428
  15:18:35 STEP 2735 H=2735:00 +CPU= 23.934
  15:19:18 STEP 2736 H=2736:00 +CPU= 42.063
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMGGhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMSHhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMGGhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMSHhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMUAhq0f+002724
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0280_1990050100_123_959_12175924_0_r106034934_113.zip
Uploading the intermediate file: upload_file_113.zip
  15:19:43 STEP 2737 H=2737:00 +CPU= 23.449
  15:20:07 STEP 2738 H=2738:00 +CPU= 23.758
  15:20:43 STEP 2739 H=2739:00 +CPU= 36.158
  15:21:09 STEP 2740 H=2740:00 +CPU= 24.703
  15:21:32 STEP 2741 H=2741:00 +CPU= 23.023
  15:22:09 STEP 2742 H=2742:00 +CPU= 36.407
  15:22:33 STEP 2743 H=2743:00 +CPU= 23.792
  15:22:58 STEP 2744 H=2744:00 +CPU= 24.237
  15:23:34 STEP 2745 H=2745:00 +CPU= 36.238
  15:23:59 STEP 2746 H=2746:00 +CPU= 24.335
  15:24:23 STEP 2747 H=2747:00 +CPU= 23.359
  15:25:04 STEP 2748 H=2748:00 +CPU= 40.113
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAhq0f+002748
  15:25:28 STEP 2749 H=2749:00 +CPU= 24.088
  15:25:53 STEP 2750 H=2750:00 +CPU= 24.088
  15:26:32 STEP 2751 H=2751:00 +CPU= 37.383
  15:26:58 STEP 2752 H=2752:00 +CPU= 25.310
  15:27:23 STEP 2753 H=2753:00 +CPU= 25.210
  15:28:04 STEP 2754 H=2754:00 +CPU= 39.324
  15:28:31 STEP 2755 H=2755:00 +CPU= 26.165
  15:28:58 STEP 2756 H=2756:00 +CPU= 26.202
  15:29:38 STEP 2757 H=2757:00 +CPU= 40.098
  15:30:07 STEP 2758 H=2758:00 +CPU= 27.866
  15:30:36 STEP 2759 H=2759:00 +CPU= 28.204
  15:31:28 STEP 2760 H=2760:00 +CPU= 49.841
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMGGhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMSHhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMGGhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMSHhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMUAhq0f+002748
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0280_1990050100_123_959_12175924_0_r106034934_114.zip
Uploading the intermediate file: upload_file_114.zip
  15:31:57 STEP 2761 H=2761:00 +CPU= 28.391
  15:32:26 STEP 2762 H=2762:00 +CPU= 28.289
  15:33:11 STEP 2763 H=2763:00 +CPU= 43.285
  15:33:41 STEP 2764 H=2764:00 +CPU= 29.597
  15:34:10 STEP 2765 H=2765:00 +CPU= 28.153
  15:34:55 STEP 2766 H=2766:00 +CPU= 44.280
  15:35:25 STEP 2767 H=2767:00 +CPU= 29.118
  15:35:55 STEP 2768 H=2768:00 +CPU= 29.201
  15:36:40 STEP 2769 H=2769:00 +CPU= 43.829
  15:37:11 STEP 2770 H=2770:00 +CPU= 30.341
  15:37:40 STEP 2771 H=2771:00 +CPU= 28.577
  15:38:29 STEP 2772 H=2772:00 +CPU= 48.236
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAhq0f+002772
  15:38:59 STEP 2773 H=2773:00 +CPU= 29.303
  15:39:29 STEP 2774 H=2774:00 +CPU= 29.239
  15:40:14 STEP 2775 H=2775:00 +CPU= 43.657
  15:40:45 STEP 2776 H=2776:00 +CPU= 29.715
  15:41:14 STEP 2777 H=2777:00 +CPU= 29.049
  15:42:00 STEP 2778 H=2778:00 +CPU= 44.663
  15:42:29 STEP 2779 H=2779:00 +CPU= 28.990
  15:43:00 STEP 2780 H=2780:00 +CPU= 29.727
  15:43:45 STEP 2781 H=2781:00 +CPU= 43.994
  15:44:15 STEP 2782 H=2782:00 +CPU= 29.348
  15:44:46 STEP 2783 H=2783:00 +CPU= 29.631
  15:45:37 STEP 2784 H=2784:00 +CPU= 50.106
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMGGhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMSHhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMGGhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMSHhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMUAhq0f+002772
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0280_1990050100_123_959_12175924_0_r106034934_115.zip
Uploading the intermediate file: upload_file_115.zip
  15:46:03 STEP 2785 H=2785:00 +CPU= 26.264
  15:46:29 STEP 2786 H=2786:00 +CPU= 26.248
  15:47:09 STEP 2787 H=2787:00 +CPU= 39.444
  15:47:35 STEP 2788 H=2788:00 +CPU= 26.365
  15:48:01 STEP 2789 H=2789:00 +CPU= 25.460
  15:48:41 STEP 2790 H=2790:00 +CPU= 39.893
  15:49:07 STEP 2791 H=2791:00 +CPU= 26.343
  15:49:36 STEP 2792 H=2792:00 +CPU= 28.579
  15:50:21 STEP 2793 H=2793:00 +CPU= 44.185
  15:50:51 STEP 2794 H=2794:00 +CPU= 29.788
  15:51:21 STEP 2795 H=2795:00 +CPU= 28.944
  15:52:10 STEP 2796 H=2796:00 +CPU= 47.998
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAhq0f+002796
  15:52:40 STEP 2797 H=2797:00 +CPU= 29.562
  15:53:10 STEP 2798 H=2798:00 +CPU= 29.560
  15:53:56 STEP 2799 H=2799:00 +CPU= 43.947
  15:54:26 STEP 2800 H=2800:00 +CPU= 29.845
  15:54:55 STEP 2801 H=2801:00 +CPU= 28.613
  15:55:40 STEP 2802 H=2802:00 +CPU= 44.707
  15:56:10 STEP 2803 H=2803:00 +CPU= 29.370
  15:56:40 STEP 2804 H=2804:00 +CPU= 29.299
  15:57:24 STEP 2805 H=2805:00 +CPU= 43.388
  15:57:54 STEP 2806 H=2806:00 +CPU= 29.212
  15:58:24 STEP 2807 H=2807:00 +CPU= 29.228
  15:59:16 STEP 2808 H=2808:00 +CPU= 50.507
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMGGhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMSHhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMGGhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMSHhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMUAhq0f+002796
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0280_1990050100_123_959_12175924_0_r106034934_116.zip
Uploading the intermediate file: upload_file_116.zip
  15:59:45 STEP 2809 H=2809:00 +CPU= 28.563
  16:00:14 STEP 2810 H=2810:00 +CPU= 29.132
  16:00:58 STEP 2811 H=2811:00 +CPU= 42.963
  16:01:27 STEP 2812 H=2812:00 +CPU= 29.466
  16:01:55 STEP 2813 H=2813:00 +CPU= 27.951
  16:02:38 STEP 2814 H=2814:00 +CPU= 43.009
  16:03:09 STEP 2815 H=2815:00 +CPU= 30.669
  16:03:39 STEP 2816 H=2816:00 +CPU= 28.960
  16:04:24 STEP 2817 H=2817:00 +CPU= 44.205
  16:04:54 STEP 2818 H=2818:00 +CPU= 29.488
  16:05:23 STEP 2819 H=2819:00 +CPU= 27.711
  16:06:12 STEP 2820 H=2820:00 +CPU= 47.881
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAhq0f+002820
  16:06:42 STEP 2821 H=2821:00 +CPU= 28.623
  16:07:11 STEP 2822 H=2822:00 +CPU= 29.366
  16:07:56 STEP 2823 H=2823:00 +CPU= 44.008
  16:08:27 STEP 2824 H=2824:00 +CPU= 29.532
  16:08:56 STEP 2825 H=2825:00 +CPU= 28.390
  16:09:42 STEP 2826 H=2826:00 +CPU= 45.487
  16:10:11 STEP 2827 H=2827:00 +CPU= 28.673
  16:10:41 STEP 2828 H=2828:00 +CPU= 29.124
  16:11:26 STEP 2829 H=2829:00 +CPU= 44.046
  16:11:55 STEP 2830 H=2830:00 +CPU= 29.134
  16:12:26 STEP 2831 H=2831:00 +CPU= 29.274
  16:13:19 STEP 2832 H=2832:00 +CPU= 50.499
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMGGhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMSHhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMGGhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMSHhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMUAhq0f+002820
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0280_1990050100_123_959_12175924_0_r106034934_117.zip
Uploading the intermediate file: upload_file_117.zip
  16:13:49 STEP 2833 H=2833:00 +CPU= 28.928
  16:14:19 STEP 2834 H=2834:00 +CPU= 28.862
  16:15:04 STEP 2835 H=2835:00 +CPU= 44.414
  16:15:34 STEP 2836 H=2836:00 +CPU= 28.900
  16:16:03 STEP 2837 H=2837:00 +CPU= 28.395
  16:16:47 STEP 2838 H=2838:00 +CPU= 44.421
  16:17:17 STEP 2839 H=2839:00 +CPU= 28.943
  16:17:47 STEP 2840 H=2840:00 +CPU= 29.256
  16:18:31 STEP 2841 H=2841:00 +CPU= 43.319
  16:19:01 STEP 2842 H=2842:00 +CPU= 29.490
  16:19:30 STEP 2843 H=2843:00 +CPU= 28.819
  16:20:19 STEP 2844 H=2844:00 +CPU= 47.506
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAhq0f+002844
  16:20:48 STEP 2845 H=2845:00 +CPU= 28.557
  16:21:18 STEP 2846 H=2846:00 +CPU= 29.078
  16:22:03 STEP 2847 H=2847:00 +CPU= 44.353
  16:22:34 STEP 2848 H=2848:00 +CPU= 30.293
  16:23:03 STEP 2849 H=2849:00 +CPU= 28.323
  16:23:50 STEP 2850 H=2850:00 +CPU= 45.624
  16:24:19 STEP 2851 H=2851:00 +CPU= 28.748
  16:24:48 STEP 2852 H=2852:00 +CPU= 29.064
  16:25:34 STEP 2853 H=2853:00 +CPU= 44.381
  16:26:04 STEP 2854 H=2854:00 +CPU= 29.307
  16:26:33 STEP 2855 H=2855:00 +CPU= 28.507
  16:27:27 STEP 2856 H=2856:00 +CPU= 51.272
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMGGhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMSHhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMGGhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMSHhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMUAhq0f+002844
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0280_1990050100_123_959_12175924_0_r106034934_118.zip
Uploading the intermediate file: upload_file_118.zip
  16:27:56 STEP 2857 H=2857:00 +CPU= 28.416
  16:28:26 STEP 2858 H=2858:00 +CPU= 29.091
  16:29:13 STEP 2859 H=2859:00 +CPU= 45.491
  16:29:42 STEP 2860 H=2860:00 +CPU= 29.089
  16:30:12 STEP 2861 H=2861:00 +CPU= 28.968
  16:30:58 STEP 2862 H=2862:00 +CPU= 46.478
  16:31:30 STEP 2863 H=2863:00 +CPU= 31.241
  16:32:00 STEP 2864 H=2864:00 +CPU= 29.534
  16:32:45 STEP 2865 H=2865:00 +CPU= 44.250
  16:33:16 STEP 2866 H=2866:00 +CPU= 29.749
  16:33:46 STEP 2867 H=2867:00 +CPU= 29.198
  16:34:34 STEP 2868 H=2868:00 +CPU= 47.419
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAhq0f+002868
  16:35:03 STEP 2869 H=2869:00 +CPU= 28.556
  16:35:33 STEP 2870 H=2870:00 +CPU= 28.913
  16:36:18 STEP 2871 H=2871:00 +CPU= 44.230
  16:36:47 STEP 2872 H=2872:00 +CPU= 29.017
  16:37:16 STEP 2873 H=2873:00 +CPU= 28.141
  16:38:01 STEP 2874 H=2874:00 +CPU= 44.544
  16:38:31 STEP 2875 H=2875:00 +CPU= 29.686
  16:39:01 STEP 2876 H=2876:00 +CPU= 28.799
  16:39:46 STEP 2877 H=2877:00 +CPU= 45.155
  16:40:18 STEP 2878 H=2878:00 +CPU= 30.951
  16:40:48 STEP 2879 H=2879:00 +CPU= 29.710
  16:41:41 STEP 2880 H=2880:00 +CPU= 50.579
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMGGhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMSHhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMGGhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMSHhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMUAhq0f+002868
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0280_1990050100_123_959_12175924_0_r106034934_119.zip
Uploading the intermediate file: upload_file_119.zip
  16:42:11 STEP 2881 H=2881:00 +CPU= 29.142
  16:42:41 STEP 2882 H=2882:00 +CPU= 29.264
  16:43:26 STEP 2883 H=2883:00 +CPU= 44.047
  16:43:56 STEP 2884 H=2884:00 +CPU= 28.704
  16:44:24 STEP 2885 H=2885:00 +CPU= 28.015
  16:45:09 STEP 2886 H=2886:00 +CPU= 44.287
  16:45:37 STEP 2887 H=2887:00 +CPU= 27.955
  16:46:06 STEP 2888 H=2888:00 +CPU= 28.637
  16:46:51 STEP 2889 H=2889:00 +CPU= 44.187
  16:47:21 STEP 2890 H=2890:00 +CPU= 29.477
  16:47:48 STEP 2891 H=2891:00 +CPU= 27.153
  16:48:38 STEP 2892 H=2892:00 +CPU= 49.006
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAhq0f+002892
  16:49:08 STEP 2893 H=2893:00 +CPU= 28.577
  16:49:37 STEP 2894 H=2894:00 +CPU= 28.554
  16:50:22 STEP 2895 H=2895:00 +CPU= 44.362
  16:50:53 STEP 2896 H=2896:00 +CPU= 29.558
  16:51:22 STEP 2897 H=2897:00 +CPU= 28.242
  16:52:08 STEP 2898 H=2898:00 +CPU= 44.626
  16:52:37 STEP 2899 H=2899:00 +CPU= 28.764
  16:53:06 STEP 2900 H=2900:00 +CPU= 28.477
  16:53:51 STEP 2901 H=2901:00 +CPU= 44.558
  16:54:21 STEP 2902 H=2902:00 +CPU= 28.823
  16:54:50 STEP 2903 H=2903:00 +CPU= 28.412
  16:55:43 STEP 2904 H=2904:00 +CPU= 51.414
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMGGhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMSHhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMGGhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMSHhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMUAhq0f+002892
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0280_1990050100_123_959_12175924_0_r106034934_120.zip
Uploading the intermediate file: upload_file_120.zip
  16:56:12 STEP 2905 H=2905:00 +CPU= 28.221
  16:56:42 STEP 2906 H=2906:00 +CPU= 29.352
  16:57:28 STEP 2907 H=2907:00 +CPU= 44.691
  16:57:57 STEP 2908 H=2908:00 +CPU= 28.969
  16:58:26 STEP 2909 H=2909:00 +CPU= 28.792
  16:59:12 STEP 2910 H=2910:00 +CPU= 45.261
  16:59:41 STEP 2911 H=2911:00 +CPU= 28.723
  17:00:11 STEP 2912 H=2912:00 +CPU= 29.234
  17:00:56 STEP 2913 H=2913:00 +CPU= 44.092
  17:01:26 STEP 2914 H=2914:00 +CPU= 29.008
  17:01:55 STEP 2915 H=2915:00 +CPU= 28.397
  17:02:45 STEP 2916 H=2916:00 +CPU= 48.718
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAhq0f+002916
  17:03:15 STEP 2917 H=2917:00 +CPU= 29.521
  17:03:45 STEP 2918 H=2918:00 +CPU= 29.330
  17:04:31 STEP 2919 H=2919:00 +CPU= 44.547
  17:05:02 STEP 2920 H=2920:00 +CPU= 30.630
  17:05:31 STEP 2921 H=2921:00 +CPU= 27.882
  17:06:17 STEP 2922 H=2922:00 +CPU= 44.706
  17:06:47 STEP 2923 H=2923:00 +CPU= 29.493
  17:07:17 STEP 2924 H=2924:00 +CPU= 29.332
  17:08:02 STEP 2925 H=2925:00 +CPU= 44.533
  17:08:32 STEP 2926 H=2926:00 +CPU= 29.773
  17:09:02 STEP 2927 H=2927:00 +CPU= 28.616
  17:09:54 STEP 2928 H=2928:00 +CPU= 51.114
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMGGhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMSHhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMGGhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMSHhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMUAhq0f+002916
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0280_1990050100_123_959_12175924_0_r106034934_121.zip
Uploading the intermediate file: upload_file_121.zip
Uploading trickle at timestep: 10540800
  17:10:24 STEP 2929 H=2929:00 +CPU= 28.648
  17:10:52 STEP 2930 H=2930:00 +CPU= 28.335
  17:11:38 STEP 2931 H=2931:00 +CPU= 44.135
  17:12:08 STEP 2932 H=2932:00 +CPU= 29.108
  17:12:37 STEP 2933 H=2933:00 +CPU= 28.001
  17:13:24 STEP 2934 H=2934:00 +CPU= 45.504
  17:13:53 STEP 2935 H=2935:00 +CPU= 28.552
  17:14:23 STEP 2936 H=2936:00 +CPU= 29.005
  17:15:09 STEP 2937 H=2937:00 +CPU= 44.550
  17:15:39 STEP 2938 H=2938:00 +CPU= 29.144
  17:16:09 STEP 2939 H=2939:00 +CPU= 28.750
  17:16:58 STEP 2940 H=2940:00 +CPU= 48.800
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAhq0f+002940
  17:17:28 STEP 2941 H=2941:00 +CPU= 28.954
  17:17:57 STEP 2942 H=2942:00 +CPU= 28.973
  17:18:43 STEP 2943 H=2943:00 +CPU= 45.057
  17:19:14 STEP 2944 H=2944:00 +CPU= 28.980
  17:19:43 STEP 2945 H=2945:00 +CPU= 28.935
  17:20:30 STEP 2946 H=2946:00 +CPU= 45.496
  17:20:59 STEP 2947 H=2947:00 +CPU= 28.716
  17:21:29 STEP 2948 H=2948:00 +CPU= 29.152
  17:22:14 STEP 2949 H=2949:00 +CPU= 44.334
  17:22:43 STEP 2950 H=2950:00 +CPU= 29.138
  17:23:12 STEP 2951 H=2951:00 +CPU= 28.709
  17:24:00 STEP 2952 H=2952:00 +CPU= 47.281
The child process terminated with status: 0
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMGGhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMSHhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/24/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMGGhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMUAhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMGGhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMSHhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMGGhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMSHhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12175924/ICMSHhq0f+002928
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0280_1990050100_123_959_12175924_0_r106034934_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
17:27:24 (1424): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 15:48:22 1532184 22260645 oifs_43r3_ps_0280_1990050100_123_959_12175924_0 10,623,600 76,452 0.0072
09 May 2023 15:48:17 1532184 22260645 oifs_43r3_ps_0280_1990050100_123_959_12175924_0 10,540,800 75,626 0.0072
09 May 2023 15:48:07 1532184 22260645 oifs_43r3_ps_0280_1990050100_123_959_12175924_0 9,676,800 67,763 0.0070
09 May 2023 15:47:55 1532184 22260645 oifs_43r3_ps_0280_1990050100_123_959_12175924_0 8,640,000 60,034 0.0069
09 May 2023 15:47:50 1532184 22260645 oifs_43r3_ps_0280_1990050100_123_959_12175924_0 7,776,000 54,024 0.0069
09 May 2023 15:47:39 1532184 22260645 oifs_43r3_ps_0280_1990050100_123_959_12175924_0 6,912,000 48,002 0.0069
09 May 2023 15:47:28 1532184 22260645 oifs_43r3_ps_0280_1990050100_123_959_12175924_0 6,048,000 41,994 0.0069
09 May 2023 15:47:22 1532184 22260645 oifs_43r3_ps_0280_1990050100_123_959_12175924_0 5,184,000 35,987 0.0069
09 May 2023 15:47:11 1532184 22260645 oifs_43r3_ps_0280_1990050100_123_959_12175924_0 4,320,000 29,988 0.0069
09 May 2023 15:46:59 1532184 22260645 oifs_43r3_ps_0280_1990050100_123_959_12175924_0 3,456,000 23,976 0.0069
09 May 2023 15:46:54 1532184 22260645 oifs_43r3_ps_0280_1990050100_123_959_12175924_0 2,592,000 17,969 0.0069
09 May 2023 15:46:44 1532184 22260645 oifs_43r3_ps_0280_1990050100_123_959_12175924_0 1,728,000 11,950 0.0069
09 May 2023 15:46:33 1532184 22260645 oifs_43r3_ps_0280_1990050100_123_959_12175924_0 864,000 5,946 0.0069


©2024 climateprediction.net