climateprediction.net home page
Task 22279321

Task 22279321

Name oifs_43r3_ps_0465_1993050100_123_962_12179109_1
Workunit 12179109
Created 23 Dec 2022, 16:58:02 UTC
Sent 22 Jan 2023, 0:06:25 UTC
Report deadline 23 Mar 2023, 0:06:25 UTC
Received 25 Jan 2023, 13:36:43 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1507463
Run time 20 hours 35 min 59 sec
CPU time 20 hours 11 min 43 sec
Validate state Valid
Credit 14,873.04
Device peak FLOPS 4.20 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,417.63 MB
Peak swap size 4,978.07 MB
Peak disk usage 3,734.12 MB
Stderr
<core_client_version>7.9.3</core_client_version>
<![CDATA[
<stderr_txt>
7:00 +CPU= 17.659
  18:20:34 STEP 2468 H=2468:00 +CPU= 17.703
  18:21:02 STEP 2469 H=2469:00 +CPU= 26.999
  18:21:19 STEP 2470 H=2470:00 +CPU= 17.530
  18:21:39 STEP 2471 H=2471:00 +CPU= 19.102
  18:22:17 STEP 2472 H=2472:00 +CPU= 37.211
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002472
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMGGhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMSHhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMUAhq0f+002448
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMGGhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMSHhq0f+002460
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMUAhq0f+002460
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0465_1993050100_123_962_12179109_1_r2096414442_102.zip
Uploading the intermediate file: upload_file_102.zip
[EC_DRHOOK:grendel:1:1:44317:44317] [20230122:182237:1674411757:62913.810] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1538] Received signal#15 (SIGTERM) :: 2544MB (heap), 4415MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:grendel:1:1:44317:44317] [20230122:182237:1674411757:62913.810] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:grendel:1:1:44317:44317] [20230122:182237:1674411757:62913.810] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x81f3c0 (old at (nil))
[EC_DRHOOK:grendel:1:1:44317:44317] [20230122:182237:1674411757:62913.810] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1617] Signal#15 was caused by unrecognized si_code [memaddr=0x1], nsigs = 1
[EC_DRHOOK:grendel:1:1:44317:44317] [20230122:182237:1674411757:62913.810] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#15, nsigs = 1
[EC_DRHOOK:grendel:1:1:44317:44317] [20230122:182237:1674411757:62913.810] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3843] 2594 MB (maxheap), 4415 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:grendel:1:1:44317:44317] [20230122:182237:1674411757:62913.810] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :  MASTER 
[EC_DRHOOK:grendel:1:1:44317:44317] [20230122:182237:1674411757:62913.811] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :   CNT0 
[EC_DRHOOK:grendel:1:1:44317:44317] [20230122:182237:1674411757:62913.811] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :    CNT1 
[EC_DRHOOK:grendel:1:1:44317:44317] [20230122:182237:1674411757:62913.811] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :     CNT2 
[EC_DRHOOK:grendel:1:1:44317:44317] [20230122:182237:1674411757:62913.811] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :      CNT3 
[EC_DRHOOK:grendel:1:1:44317:44317] [20230122:182237:1674411757:62913.811] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :       CNT4 
[EC_DRHOOK:grendel:1:1:44317:44317] [20230122:182237:1674411757:62913.811] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :        WVCOUPLE 
[EC_DRHOOK:grendel:1:1:44317:44317] [20230122:182237:1674411757:62913.811] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :         WAVEMDL 
[EC_DRHOOK:grendel:1:1:44317:44317] [20230122:182237:1674411757:62913.811] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :          WAMODEL 
[EC_DRHOOK:grendel:1:1:44317:44317] [20230122:182237:1674411757:62913.811] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :           >OMP-WAMODEL 4            (1439) 
[EC_DRHOOK:grendel:1:1:44317:44317] [20230122:182237:1674411757:62913.811] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] :            SETICE 
[EC_DRHOOK:grendel:1:1:44317:44317] [20230122:182238:1674411758:62914.811] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#15, nsigs = 1
[EC_DRHOOK:grendel:1:1:44317:44317] [20230122:182238:1674411758:62914.811] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1ce8bb0 for signal#15, nsigs = 1
forrtl: error (78): process killed (SIGTERM)
Image              PC                Routine            Line        Source             
oifs_43r3_model.e  0000000001CE916B  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000081FFF1  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DC9090  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001CCAE94  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001A21307  setice_                    71  setice.F
oifs_43r3_model.e  000000000168DD56  wamodel_                 1115  wamodel.F
oifs_43r3_model.e  0000000000872295  wavemdl_                  584  wavemdl.F
oifs_43r3_model.e  00000000007E0165  wvcouple_                 260  wvcouple.F90
oifs_43r3_model.e  000000000055E4AD  cnt4_                    1283  cnt4.F90
oifs_43r3_model.e  00000000005471C9  cnt3_                     267  cnt3.F90
oifs_43r3_model.e  0000000000546412  cnt2_                      88  cnt2.F90
oifs_43r3_model.e  0000000000545E28  cnt1_                      92  cnt1.F90
oifs_43r3_model.e  000000000040708D  cnt0_                     146  cnt0.F90
oifs_43r3_model.e  000000000040220F  MAIN__                     96  master.F90
oifs_43r3_model.e  00000000004021A2  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCA390  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000040206E  Unknown               Unknown  Unknown
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1993050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0465
(argv4) batchid: 962
(argv5) wuid: 12179109
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/5
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/5/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/5/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_df60ffecd64ab039c6f985089801191e to: /var/lib/boinc-client/slots/5/oifs_43r3_ps_0465_1993050100_123_962_12179109.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/5/oifs_43r3_ps_0465_1993050100_123_962_12179109.zip
ic_ancil_file: ic_ancil_12179109
ifsdata_file: ifsdata_12179109
climate_data_file: clim_data_12179109
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_23564367c5e96ea1b7b2c6623bf32461 to: /var/lib/boinc-client/slots/5/ic_ancil_12179109.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/5/ic_ancil_12179109.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_2cdd8d83571c6748e7b6a412e5f5d948 to: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12179109.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/5/ifsdata/ifsdata_12179109.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/5/159l_2/clim_data_12179109.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/5/159l_2/clim_data_12179109.zip
Checking for progress XML file: /var/lib/boinc-client/slots/5/progress_file_12179109.xml
Opened progress file ok : /var/lib/boinc-client/slots/5/progress_file_12179109.xml
-- Model is restarting --
Adjusting last_iter, 2472, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/5/progress_file_12179109.xml
last_cpu_time: 61817
upload_file_number: 102
last_iter: 2471
last_upload: 8812800
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0465_1993050100_123_962_12179109_1_r2096414442
The child process has been launched with process id: 431
Executing the command: /var/lib/boinc-client/slots/5/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:grendel:1:1:431:431] [20230122:182841:1674412121:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:grendel:1:1:431:431] [20230122:182841:1674412121:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:grendel:1:1:431:431] [20230122:182841:1674412121:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:grendel:1:1:431:431] [20230122:182841:1674412121:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:grendel:1:1:431:431] [20230122:182841:1674412121:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:grendel:1:1:431:431] [20230122:182841:1674412121:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:grendel:1:1:431:431] [20230122:182841:1674412121:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:grendel:1:1:431:431] [20230122:182841:1674412121:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:grendel:1:1:431:431] [20230122:182841:1674412121:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:grendel:1:1:431:431] [20230122:182841:1674412121:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:grendel:1:1:431:431] [20230122:182841:1674412121:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:grendel:1:1:431:431] [20230122:182841:1674412121:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:grendel:1:1:431:431] [20230122:182841:1674412121:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:grendel:1:1:431:431] [20230122:182841:1674412121:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:grendel:1:1:431:431] [20230122:182841:1674412121:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:grendel:1:1:431:431] [20230122:182841:1674412121:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:grendel:1:1:431:431] [20230122:182841:1674412121:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:grendel:1:1:431:431] [20230122:182841:1674412121:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:grendel:1:1:431:431] [20230122:182841:1674412121:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:grendel:1:1:431:431] [20230122:182841:1674412121:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:grendel:1:1:431:431] [20230122:182841:1674412121:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:grendel:1:1:431:431] [20230122:182841:1674412121:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:grendel:1:1:431:431] [20230122:182841:1674412121:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:grendel:1:1:431:431] [20230122:182841:1674412121:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:grendel:1:1:431:431] [20230122:182841:1674412121:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:grendel:1:1:431:431] [20230122:182841:1674412121:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:grendel:1:1:431:431] [20230122:182841:1674412121:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:grendel:1:1:431:431] [20230122:182841:1674412121:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:grendel:1:1:431:431] [20230122:182841:1674412121:0.001] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:grendel:1:1:431:431] [20230122:182841:1674412121:0.001] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  18:29:32 STEP 2472 H=2472:00 +CPU= 36.170
  18:29:56 STEP 2473 H=2473:00 +CPU= 23.097
  18:30:18 STEP 2474 H=2474:00 +CPU= 21.486
  18:30:53 STEP 2475 H=2475:00 +CPU= 35.193
  18:31:16 STEP 2476 H=2476:00 +CPU= 22.783
  18:31:37 STEP 2477 H=2477:00 +CPU= 20.228
  18:32:14 STEP 2478 H=2478:00 +CPU= 36.162
  18:32:36 STEP 2479 H=2479:00 +CPU= 21.556
  18:32:57 STEP 2480 H=2480:00 +CPU= 21.449
  18:33:32 STEP 2481 H=2481:00 +CPU= 34.019
  18:33:55 STEP 2482 H=2482:00 +CPU= 22.854
  18:34:18 STEP 2483 H=2483:00 +CPU= 22.160
  18:34:50 STEP 2484 H=2484:00 +CPU= 32.208
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002484
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002484
  18:35:10 STEP 2485 H=2485:00 +CPU= 19.350
  18:35:30 STEP 2486 H=2486:00 +CPU= 19.565
  18:36:02 STEP 2487 H=2487:00 +CPU= 31.665
  18:36:25 STEP 2488 H=2488:00 +CPU= 22.816
  18:36:46 STEP 2489 H=2489:00 +CPU= 20.220
  18:37:18 STEP 2490 H=2490:00 +CPU= 31.575
  18:37:38 STEP 2491 H=2491:00 +CPU= 20.179
  18:37:59 STEP 2492 H=2492:00 +CPU= 20.821
  18:38:29 STEP 2493 H=2493:00 +CPU= 29.398
  18:38:48 STEP 2494 H=2494:00 +CPU= 18.924
  18:39:08 STEP 2495 H=2495:00 +CPU= 19.123
  18:39:51 STEP 2496 H=2496:00 +CPU= 42.265
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002496
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMGGhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMSHhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMUAhq0f+002472
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMGGhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMSHhq0f+002484
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMUAhq0f+002484
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0465_1993050100_123_962_12179109_1_r2096414442_103.zip
Uploading the intermediate file: upload_file_103.zip
  18:40:14 STEP 2497 H=2497:00 +CPU= 22.888
  18:40:34 STEP 2498 H=2498:00 +CPU= 18.815
  18:41:09 STEP 2499 H=2499:00 +CPU= 34.491
  18:41:28 STEP 2500 H=2500:00 +CPU= 19.575
  18:41:49 STEP 2501 H=2501:00 +CPU= 19.908
  18:42:26 STEP 2502 H=2502:00 +CPU= 37.094
  18:42:48 STEP 2503 H=2503:00 +CPU= 21.518
  18:43:11 STEP 2504 H=2504:00 +CPU= 23.020
  18:43:42 STEP 2505 H=2505:00 +CPU= 29.879
  18:43:59 STEP 2506 H=2506:00 +CPU= 17.508
  18:44:16 STEP 2507 H=2507:00 +CPU= 16.795
  18:44:46 STEP 2508 H=2508:00 +CPU= 29.204
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002508
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002508
  18:45:04 STEP 2509 H=2509:00 +CPU= 17.827
  18:45:23 STEP 2510 H=2510:00 +CPU= 18.741
  18:45:54 STEP 2511 H=2511:00 +CPU= 31.472
  18:46:16 STEP 2512 H=2512:00 +CPU= 21.619
  18:46:37 STEP 2513 H=2513:00 +CPU= 19.881
  18:47:07 STEP 2514 H=2514:00 +CPU= 30.271
  18:47:27 STEP 2515 H=2515:00 +CPU= 19.311
  18:47:47 STEP 2516 H=2516:00 +CPU= 19.760
  18:48:15 STEP 2517 H=2517:00 +CPU= 27.740
  18:48:33 STEP 2518 H=2518:00 +CPU= 17.889
  18:48:52 STEP 2519 H=2519:00 +CPU= 18.791
  18:49:31 STEP 2520 H=2520:00 +CPU= 36.484
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002520
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMGGhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMSHhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMUAhq0f+002496
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMGGhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMSHhq0f+002508
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMUAhq0f+002508
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0465_1993050100_123_962_12179109_1_r2096414442_104.zip
Uploading the intermediate file: upload_file_104.zip
  18:49:55 STEP 2521 H=2521:00 +CPU= 23.218
  18:50:18 STEP 2522 H=2522:00 +CPU= 23.376
  18:50:55 STEP 2523 H=2523:00 +CPU= 36.560
  18:51:20 STEP 2524 H=2524:00 +CPU= 24.131
  18:51:42 STEP 2525 H=2525:00 +CPU= 22.214
  18:52:15 STEP 2526 H=2526:00 +CPU= 31.921
  18:52:38 STEP 2527 H=2527:00 +CPU= 22.341
  18:52:58 STEP 2528 H=2528:00 +CPU= 19.540
  18:53:33 STEP 2529 H=2529:00 +CPU= 34.994
  18:53:57 STEP 2530 H=2530:00 +CPU= 23.818
  18:54:20 STEP 2531 H=2531:00 +CPU= 23.208
  18:55:00 STEP 2532 H=2532:00 +CPU= 38.825
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002532
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002532
  18:55:21 STEP 2533 H=2533:00 +CPU= 20.957
  18:55:45 STEP 2534 H=2534:00 +CPU= 23.599
  18:56:19 STEP 2535 H=2535:00 +CPU= 33.791
  18:56:38 STEP 2536 H=2536:00 +CPU= 18.395
  18:56:58 STEP 2537 H=2537:00 +CPU= 20.299
  18:57:31 STEP 2538 H=2538:00 +CPU= 31.814
  18:57:48 STEP 2539 H=2539:00 +CPU= 17.587
  18:58:08 STEP 2540 H=2540:00 +CPU= 19.119
  18:58:42 STEP 2541 H=2541:00 +CPU= 33.977
  18:59:00 STEP 2542 H=2542:00 +CPU= 17.741
  18:59:19 STEP 2543 H=2543:00 +CPU= 18.938
  18:59:54 STEP 2544 H=2544:00 +CPU= 34.381
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002544
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMGGhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMSHhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMUAhq0f+002520
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMGGhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMSHhq0f+002532
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMUAhq0f+002532
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0465_1993050100_123_962_12179109_1_r2096414442_105.zip
Uploading the intermediate file: upload_file_105.zip
  19:00:12 STEP 2545 H=2545:00 +CPU= 16.956
  19:00:29 STEP 2546 H=2546:00 +CPU= 17.397
  19:01:00 STEP 2547 H=2547:00 +CPU= 30.105
  19:01:18 STEP 2548 H=2548:00 +CPU= 18.561
  19:01:41 STEP 2549 H=2549:00 +CPU= 22.132
  19:02:15 STEP 2550 H=2550:00 +CPU= 33.431
  19:02:38 STEP 2551 H=2551:00 +CPU= 22.501
  19:03:00 STEP 2552 H=2552:00 +CPU= 22.015
  19:03:32 STEP 2553 H=2553:00 +CPU= 31.734
  19:03:55 STEP 2554 H=2554:00 +CPU= 22.586
  19:04:18 STEP 2555 H=2555:00 +CPU= 22.423
  19:04:56 STEP 2556 H=2556:00 +CPU= 37.830
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002556
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002556
  19:05:18 STEP 2557 H=2557:00 +CPU= 21.666
  19:05:42 STEP 2558 H=2558:00 +CPU= 23.919
  19:06:17 STEP 2559 H=2559:00 +CPU= 33.879
  19:06:40 STEP 2560 H=2560:00 +CPU= 23.263
  19:07:01 STEP 2561 H=2561:00 +CPU= 20.514
  19:07:33 STEP 2562 H=2562:00 +CPU= 31.604
  19:07:53 STEP 2563 H=2563:00 +CPU= 19.521
  19:08:14 STEP 2564 H=2564:00 +CPU= 20.766
  19:08:46 STEP 2565 H=2565:00 +CPU= 31.174
  19:09:08 STEP 2566 H=2566:00 +CPU= 22.300
  19:09:31 STEP 2567 H=2567:00 +CPU= 21.960
  19:10:09 STEP 2568 H=2568:00 +CPU= 37.366
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002568
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMGGhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMSHhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMUAhq0f+002544
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMGGhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMSHhq0f+002556
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMUAhq0f+002556
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0465_1993050100_123_962_12179109_1_r2096414442_106.zip
Uploading the intermediate file: upload_file_106.zip
  19:10:30 STEP 2569 H=2569:00 +CPU= 20.184
  19:10:52 STEP 2570 H=2570:00 +CPU= 21.737
  19:11:25 STEP 2571 H=2571:00 +CPU= 32.243
  19:11:46 STEP 2572 H=2572:00 +CPU= 20.310
  19:12:06 STEP 2573 H=2573:00 +CPU= 19.951
  19:12:41 STEP 2574 H=2574:00 +CPU= 34.876
  19:13:01 STEP 2575 H=2575:00 +CPU= 20.000
  19:13:25 STEP 2576 H=2576:00 +CPU= 22.799
  19:13:59 STEP 2577 H=2577:00 +CPU= 34.181
  19:14:24 STEP 2578 H=2578:00 +CPU= 24.796
  19:14:45 STEP 2579 H=2579:00 +CPU= 20.037
  19:15:21 STEP 2580 H=2580:00 +CPU= 36.318
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002580
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002580
  19:15:39 STEP 2581 H=2581:00 +CPU= 17.358
  19:15:57 STEP 2582 H=2582:00 +CPU= 17.668
  19:16:24 STEP 2583 H=2583:00 +CPU= 26.751
  19:16:41 STEP 2584 H=2584:00 +CPU= 17.130
  19:16:58 STEP 2585 H=2585:00 +CPU= 16.671
  19:17:25 STEP 2586 H=2586:00 +CPU= 27.466
  19:17:42 STEP 2587 H=2587:00 +CPU= 16.676
  19:18:00 STEP 2588 H=2588:00 +CPU= 17.382
  19:18:27 STEP 2589 H=2589:00 +CPU= 26.886
  19:18:44 STEP 2590 H=2590:00 +CPU= 17.151
  19:19:02 STEP 2591 H=2591:00 +CPU= 17.481
  19:19:41 STEP 2592 H=2592:00 +CPU= 34.790
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002592
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMGGhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMSHhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMUAhq0f+002568
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMGGhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMSHhq0f+002580
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMUAhq0f+002580
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0465_1993050100_123_962_12179109_1_r2096414442_107.zip
Uploading the intermediate file: upload_file_107.zip
  19:19:58 STEP 2593 H=2593:00 +CPU= 17.232
  19:20:15 STEP 2594 H=2594:00 +CPU= 17.348
  19:20:42 STEP 2595 H=2595:00 +CPU= 26.741
  19:21:00 STEP 2596 H=2596:00 +CPU= 17.348
  19:21:17 STEP 2597 H=2597:00 +CPU= 17.103
  19:21:45 STEP 2598 H=2598:00 +CPU= 27.272
  19:22:02 STEP 2599 H=2599:00 +CPU= 17.350
  19:22:20 STEP 2600 H=2600:00 +CPU= 17.456
  19:22:46 STEP 2601 H=2601:00 +CPU= 26.483
  19:23:03 STEP 2602 H=2602:00 +CPU= 17.046
  19:23:20 STEP 2603 H=2603:00 +CPU= 16.913
  19:23:51 STEP 2604 H=2604:00 +CPU= 29.770
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002604
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002604
  19:24:08 STEP 2605 H=2605:00 +CPU= 17.064
  19:24:26 STEP 2606 H=2606:00 +CPU= 17.557
  19:24:52 STEP 2607 H=2607:00 +CPU= 26.598
  19:25:10 STEP 2608 H=2608:00 +CPU= 17.196
  19:25:27 STEP 2609 H=2609:00 +CPU= 17.365
  19:25:55 STEP 2610 H=2610:00 +CPU= 27.677
  19:26:12 STEP 2611 H=2611:00 +CPU= 16.906
  19:26:30 STEP 2612 H=2612:00 +CPU= 17.445
  19:26:57 STEP 2613 H=2613:00 +CPU= 26.698
  19:27:14 STEP 2614 H=2614:00 +CPU= 17.285
  19:27:33 STEP 2615 H=2615:00 +CPU= 18.751
  19:28:09 STEP 2616 H=2616:00 +CPU= 34.583
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002616
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMGGhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMSHhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMUAhq0f+002592
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMGGhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMSHhq0f+002604
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMUAhq0f+002604
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0465_1993050100_123_962_12179109_1_r2096414442_108.zip
Uploading the intermediate file: upload_file_108.zip
  19:28:26 STEP 2617 H=2617:00 +CPU= 17.218
  19:28:43 STEP 2618 H=2618:00 +CPU= 17.417
  19:29:10 STEP 2619 H=2619:00 +CPU= 26.762
  19:29:28 STEP 2620 H=2620:00 +CPU= 17.414
  19:29:45 STEP 2621 H=2621:00 +CPU= 16.856
  19:30:13 STEP 2622 H=2622:00 +CPU= 27.791
  19:30:30 STEP 2623 H=2623:00 +CPU= 16.710
  19:30:48 STEP 2624 H=2624:00 +CPU= 17.406
  19:31:15 STEP 2625 H=2625:00 +CPU= 27.099
  19:31:33 STEP 2626 H=2626:00 +CPU= 17.617
  19:31:50 STEP 2627 H=2627:00 +CPU= 17.175
  19:32:21 STEP 2628 H=2628:00 +CPU= 29.751
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002628
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002628
  19:32:38 STEP 2629 H=2629:00 +CPU= 17.110
  19:32:55 STEP 2630 H=2630:00 +CPU= 17.151
  19:33:24 STEP 2631 H=2631:00 +CPU= 27.875
  19:33:42 STEP 2632 H=2632:00 +CPU= 17.979
  19:34:00 STEP 2633 H=2633:00 +CPU= 17.253
  19:34:29 STEP 2634 H=2634:00 +CPU= 28.528
  19:34:46 STEP 2635 H=2635:00 +CPU= 17.642
  19:35:04 STEP 2636 H=2636:00 +CPU= 17.186
  19:35:31 STEP 2637 H=2637:00 +CPU= 26.759
  19:35:48 STEP 2638 H=2638:00 +CPU= 17.240
  19:36:07 STEP 2639 H=2639:00 +CPU= 19.181
  19:36:43 STEP 2640 H=2640:00 +CPU= 34.367
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002640
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMGGhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMSHhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMUAhq0f+002616
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMGGhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMSHhq0f+002628
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMUAhq0f+002628
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0465_1993050100_123_962_12179109_1_r2096414442_109.zip
Uploading the intermediate file: upload_file_109.zip
  19:37:00 STEP 2641 H=2641:00 +CPU= 16.639
  19:37:18 STEP 2642 H=2642:00 +CPU= 17.560
  19:37:45 STEP 2643 H=2643:00 +CPU= 26.666
  19:38:02 STEP 2644 H=2644:00 +CPU= 17.411
  19:38:19 STEP 2645 H=2645:00 +CPU= 16.776
  19:38:47 STEP 2646 H=2646:00 +CPU= 27.230
  19:39:04 STEP 2647 H=2647:00 +CPU= 16.919
  19:39:22 STEP 2648 H=2648:00 +CPU= 17.329
  19:39:49 STEP 2649 H=2649:00 +CPU= 26.901
  19:40:07 STEP 2650 H=2650:00 +CPU= 17.745
  19:40:24 STEP 2651 H=2651:00 +CPU= 16.857
  19:40:54 STEP 2652 H=2652:00 +CPU= 29.643
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002652
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002652
  19:41:11 STEP 2653 H=2653:00 +CPU= 16.808
  19:41:28 STEP 2654 H=2654:00 +CPU= 17.335
  19:41:55 STEP 2655 H=2655:00 +CPU= 26.870
  19:42:13 STEP 2656 H=2656:00 +CPU= 17.526
  19:42:30 STEP 2657 H=2657:00 +CPU= 16.973
  19:42:57 STEP 2658 H=2658:00 +CPU= 27.209
  19:43:14 STEP 2659 H=2659:00 +CPU= 16.891
  19:43:32 STEP 2660 H=2660:00 +CPU= 17.257
  19:43:59 STEP 2661 H=2661:00 +CPU= 27.504
  19:44:17 STEP 2662 H=2662:00 +CPU= 17.432
  19:44:36 STEP 2663 H=2663:00 +CPU= 18.252
  19:45:11 STEP 2664 H=2664:00 +CPU= 34.387
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002664
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMGGhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMSHhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMUAhq0f+002640
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMGGhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMSHhq0f+002652
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMUAhq0f+002652
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0465_1993050100_123_962_12179109_1_r2096414442_110.zip
Uploading the intermediate file: upload_file_110.zip
  19:45:28 STEP 2665 H=2665:00 +CPU= 16.824
  19:45:46 STEP 2666 H=2666:00 +CPU= 17.583
  19:46:14 STEP 2667 H=2667:00 +CPU= 27.065
  19:46:31 STEP 2668 H=2668:00 +CPU= 17.393
  19:46:48 STEP 2669 H=2669:00 +CPU= 16.713
  19:47:15 STEP 2670 H=2670:00 +CPU= 27.158
  19:47:32 STEP 2671 H=2671:00 +CPU= 16.930
  19:47:50 STEP 2672 H=2672:00 +CPU= 17.290
  19:48:17 STEP 2673 H=2673:00 +CPU= 26.812
  19:48:34 STEP 2674 H=2674:00 +CPU= 17.344
  19:48:51 STEP 2675 H=2675:00 +CPU= 16.807
  19:49:21 STEP 2676 H=2676:00 +CPU= 29.577
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002676
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002676
  19:49:38 STEP 2677 H=2677:00 +CPU= 16.797
  19:49:56 STEP 2678 H=2678:00 +CPU= 17.742
  19:50:23 STEP 2679 H=2679:00 +CPU= 26.964
  19:50:40 STEP 2680 H=2680:00 +CPU= 17.405
  19:50:57 STEP 2681 H=2681:00 +CPU= 16.896
  19:51:26 STEP 2682 H=2682:00 +CPU= 27.990
  19:51:43 STEP 2683 H=2683:00 +CPU= 16.852
  19:52:01 STEP 2684 H=2684:00 +CPU= 17.476
  19:52:28 STEP 2685 H=2685:00 +CPU= 26.826
  19:52:45 STEP 2686 H=2686:00 +CPU= 17.238
  19:53:04 STEP 2687 H=2687:00 +CPU= 18.712
  19:53:38 STEP 2688 H=2688:00 +CPU= 34.044
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002688
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMGGhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMSHhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMUAhq0f+002664
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMGGhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMSHhq0f+002676
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMUAhq0f+002676
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0465_1993050100_123_962_12179109_1_r2096414442_111.zip
Uploading the intermediate file: upload_file_111.zip
  19:53:56 STEP 2689 H=2689:00 +CPU= 17.237
  19:54:14 STEP 2690 H=2690:00 +CPU= 17.769
  19:54:41 STEP 2691 H=2691:00 +CPU= 26.805
  19:54:58 STEP 2692 H=2692:00 +CPU= 17.459
  19:55:15 STEP 2693 H=2693:00 +CPU= 16.882
  19:55:43 STEP 2694 H=2694:00 +CPU= 27.340
  19:56:00 STEP 2695 H=2695:00 +CPU= 17.002
  19:56:18 STEP 2696 H=2696:00 +CPU= 17.620
  19:56:45 STEP 2697 H=2697:00 +CPU= 26.601
  19:57:02 STEP 2698 H=2698:00 +CPU= 17.153
  19:57:19 STEP 2699 H=2699:00 +CPU= 16.953
  19:57:48 STEP 2700 H=2700:00 +CPU= 29.157
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002700
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002700
  19:58:05 STEP 2701 H=2701:00 +CPU= 16.897
  19:58:23 STEP 2702 H=2702:00 +CPU= 17.470
  19:58:50 STEP 2703 H=2703:00 +CPU= 26.977
  19:59:07 STEP 2704 H=2704:00 +CPU= 17.113
  19:59:24 STEP 2705 H=2705:00 +CPU= 16.837
  19:59:52 STEP 2706 H=2706:00 +CPU= 27.618
  20:00:09 STEP 2707 H=2707:00 +CPU= 16.678
  20:00:27 STEP 2708 H=2708:00 +CPU= 17.551
  20:00:54 STEP 2709 H=2709:00 +CPU= 26.642
  20:01:11 STEP 2710 H=2710:00 +CPU= 17.106
  20:01:30 STEP 2711 H=2711:00 +CPU= 18.803
  20:02:05 STEP 2712 H=2712:00 +CPU= 34.493
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002712
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMGGhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMSHhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMUAhq0f+002688
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMGGhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMSHhq0f+002700
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMUAhq0f+002700
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0465_1993050100_123_962_12179109_1_r2096414442_112.zip
Uploading the intermediate file: upload_file_112.zip
  20:02:22 STEP 2713 H=2713:00 +CPU= 17.010
Uploading trickle at timestep: 9763200
  20:02:39 STEP 2714 H=2714:00 +CPU= 17.276
  20:03:06 STEP 2715 H=2715:00 +CPU= 26.763
  20:03:24 STEP 2716 H=2716:00 +CPU= 17.513
  20:03:41 STEP 2717 H=2717:00 +CPU= 16.800
  20:04:08 STEP 2718 H=2718:00 +CPU= 27.444
  20:04:26 STEP 2719 H=2719:00 +CPU= 16.974
  20:04:44 STEP 2720 H=2720:00 +CPU= 17.924
  20:05:11 STEP 2721 H=2721:00 +CPU= 26.726
  20:05:28 STEP 2722 H=2722:00 +CPU= 17.280
  20:05:45 STEP 2723 H=2723:00 +CPU= 16.689
  20:06:15 STEP 2724 H=2724:00 +CPU= 30.031
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002724
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002724
  20:06:32 STEP 2725 H=2725:00 +CPU= 16.911
  20:06:50 STEP 2726 H=2726:00 +CPU= 17.408
  20:07:17 STEP 2727 H=2727:00 +CPU= 26.480
  20:07:34 STEP 2728 H=2728:00 +CPU= 17.373
  20:07:51 STEP 2729 H=2729:00 +CPU= 16.873
  20:08:19 STEP 2730 H=2730:00 +CPU= 27.140
  20:08:36 STEP 2731 H=2731:00 +CPU= 17.116
  20:08:53 STEP 2732 H=2732:00 +CPU= 17.106
  20:09:20 STEP 2733 H=2733:00 +CPU= 26.584
  20:09:37 STEP 2734 H=2734:00 +CPU= 17.300
  20:09:57 STEP 2735 H=2735:00 +CPU= 19.084
  20:10:33 STEP 2736 H=2736:00 +CPU= 36.165
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002736
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMGGhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMSHhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMUAhq0f+002712
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMGGhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMSHhq0f+002724
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMUAhq0f+002724
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0465_1993050100_123_962_12179109_1_r2096414442_113.zip
Uploading the intermediate file: upload_file_113.zip
  20:10:51 STEP 2737 H=2737:00 +CPU= 17.057
  20:11:08 STEP 2738 H=2738:00 +CPU= 17.179
  20:11:36 STEP 2739 H=2739:00 +CPU= 27.258
  20:11:53 STEP 2740 H=2740:00 +CPU= 17.548
  20:12:10 STEP 2741 H=2741:00 +CPU= 16.821
  20:12:38 STEP 2742 H=2742:00 +CPU= 27.409
  20:12:55 STEP 2743 H=2743:00 +CPU= 16.671
  20:13:12 STEP 2744 H=2744:00 +CPU= 17.646
  20:13:39 STEP 2745 H=2745:00 +CPU= 26.709
  20:13:57 STEP 2746 H=2746:00 +CPU= 17.318
  20:14:14 STEP 2747 H=2747:00 +CPU= 16.882
  20:14:43 STEP 2748 H=2748:00 +CPU= 29.379
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002748
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002748
  20:15:00 STEP 2749 H=2749:00 +CPU= 16.799
  20:15:18 STEP 2750 H=2750:00 +CPU= 17.452
  20:15:45 STEP 2751 H=2751:00 +CPU= 26.716
  20:16:02 STEP 2752 H=2752:00 +CPU= 17.438
  20:16:19 STEP 2753 H=2753:00 +CPU= 16.699
  20:16:47 STEP 2754 H=2754:00 +CPU= 27.515
  20:17:04 STEP 2755 H=2755:00 +CPU= 16.860
  20:17:22 STEP 2756 H=2756:00 +CPU= 17.470
  20:17:49 STEP 2757 H=2757:00 +CPU= 26.464
  20:18:06 STEP 2758 H=2758:00 +CPU= 17.430
  20:18:25 STEP 2759 H=2759:00 +CPU= 18.762
  20:19:00 STEP 2760 H=2760:00 +CPU= 34.549
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002760
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMGGhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMSHhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMUAhq0f+002736
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMGGhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMSHhq0f+002748
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMUAhq0f+002748
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0465_1993050100_123_962_12179109_1_r2096414442_114.zip
Uploading the intermediate file: upload_file_114.zip
  20:19:18 STEP 2761 H=2761:00 +CPU= 17.071
  20:19:35 STEP 2762 H=2762:00 +CPU= 17.454
  20:20:03 STEP 2763 H=2763:00 +CPU= 27.331
  20:20:24 STEP 2764 H=2764:00 +CPU= 21.178
  20:20:48 STEP 2765 H=2765:00 +CPU= 23.369
  20:21:16 STEP 2766 H=2766:00 +CPU= 27.948
  20:21:34 STEP 2767 H=2767:00 +CPU= 17.263
  20:21:52 STEP 2768 H=2768:00 +CPU= 17.869
  20:22:23 STEP 2769 H=2769:00 +CPU= 30.644
  20:22:42 STEP 2770 H=2770:00 +CPU= 18.627
  20:23:00 STEP 2771 H=2771:00 +CPU= 18.309
  20:23:34 STEP 2772 H=2772:00 +CPU= 32.692
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002772
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002772
  20:23:53 STEP 2773 H=2773:00 +CPU= 17.336
  20:24:14 STEP 2774 H=2774:00 +CPU= 20.756
  20:24:48 STEP 2775 H=2775:00 +CPU= 33.716
  20:25:10 STEP 2776 H=2776:00 +CPU= 21.912
  20:25:31 STEP 2777 H=2777:00 +CPU= 20.334
  20:26:05 STEP 2778 H=2778:00 +CPU= 33.647
  20:26:27 STEP 2779 H=2779:00 +CPU= 21.617
  20:26:51 STEP 2780 H=2780:00 +CPU= 23.725
  20:27:27 STEP 2781 H=2781:00 +CPU= 35.578
  20:27:50 STEP 2782 H=2782:00 +CPU= 23.272
  20:28:13 STEP 2783 H=2783:00 +CPU= 21.667
  20:28:51 STEP 2784 H=2784:00 +CPU= 37.234
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002784
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMGGhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMSHhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMUAhq0f+002760
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMGGhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMSHhq0f+002772
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMUAhq0f+002772
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0465_1993050100_123_962_12179109_1_r2096414442_115.zip
Uploading the intermediate file: upload_file_115.zip
  20:29:11 STEP 2785 H=2785:00 +CPU= 20.112
  20:29:29 STEP 2786 H=2786:00 +CPU= 17.707
  20:29:56 STEP 2787 H=2787:00 +CPU= 27.223
  20:30:14 STEP 2788 H=2788:00 +CPU= 17.284
  20:30:31 STEP 2789 H=2789:00 +CPU= 17.096
  20:30:59 STEP 2790 H=2790:00 +CPU= 27.780
  20:31:16 STEP 2791 H=2791:00 +CPU= 17.055
  20:31:34 STEP 2792 H=2792:00 +CPU= 17.388
  20:32:01 STEP 2793 H=2793:00 +CPU= 27.260
  20:32:19 STEP 2794 H=2794:00 +CPU= 17.204
  20:32:36 STEP 2795 H=2795:00 +CPU= 16.744
  20:33:05 STEP 2796 H=2796:00 +CPU= 29.610
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002796
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002796
  20:33:22 STEP 2797 H=2797:00 +CPU= 16.858
  20:33:40 STEP 2798 H=2798:00 +CPU= 17.138
  20:34:07 STEP 2799 H=2799:00 +CPU= 27.116
  20:34:25 STEP 2800 H=2800:00 +CPU= 17.276
  20:34:43 STEP 2801 H=2801:00 +CPU= 17.359
  20:35:11 STEP 2802 H=2802:00 +CPU= 28.110
  20:35:29 STEP 2803 H=2803:00 +CPU= 17.113
  20:35:46 STEP 2804 H=2804:00 +CPU= 17.257
  20:36:14 STEP 2805 H=2805:00 +CPU= 27.425
  20:36:32 STEP 2806 H=2806:00 +CPU= 17.734
  20:36:51 STEP 2807 H=2807:00 +CPU= 18.696
  20:37:26 STEP 2808 H=2808:00 +CPU= 35.055
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002808
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMGGhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMSHhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMUAhq0f+002784
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMGGhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMSHhq0f+002796
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMUAhq0f+002796
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0465_1993050100_123_962_12179109_1_r2096414442_116.zip
Uploading the intermediate file: upload_file_116.zip
  20:37:43 STEP 2809 H=2809:00 +CPU= 16.831
  20:38:01 STEP 2810 H=2810:00 +CPU= 17.444
  20:38:29 STEP 2811 H=2811:00 +CPU= 27.182
  20:38:46 STEP 2812 H=2812:00 +CPU= 17.364
  20:39:03 STEP 2813 H=2813:00 +CPU= 16.787
  20:39:32 STEP 2814 H=2814:00 +CPU= 27.825
  20:39:49 STEP 2815 H=2815:00 +CPU= 16.729
  20:40:06 STEP 2816 H=2816:00 +CPU= 17.433
  20:40:33 STEP 2817 H=2817:00 +CPU= 26.893
  20:40:51 STEP 2818 H=2818:00 +CPU= 17.226
  20:41:08 STEP 2819 H=2819:00 +CPU= 17.099
  20:41:38 STEP 2820 H=2820:00 +CPU= 29.473
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002820
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002820
  20:41:55 STEP 2821 H=2821:00 +CPU= 17.348
  20:42:12 STEP 2822 H=2822:00 +CPU= 17.171
  20:42:40 STEP 2823 H=2823:00 +CPU= 27.035
  20:42:57 STEP 2824 H=2824:00 +CPU= 17.337
  20:43:14 STEP 2825 H=2825:00 +CPU= 16.837
  20:43:42 STEP 2826 H=2826:00 +CPU= 27.340
  20:43:59 STEP 2827 H=2827:00 +CPU= 16.981
  20:44:16 STEP 2828 H=2828:00 +CPU= 17.332
  20:44:43 STEP 2829 H=2829:00 +CPU= 26.609
  20:45:00 STEP 2830 H=2830:00 +CPU= 17.282
  20:45:19 STEP 2831 H=2831:00 +CPU= 18.470
  20:45:54 STEP 2832 H=2832:00 +CPU= 34.515
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002832
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMGGhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMSHhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMUAhq0f+002808
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMGGhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMSHhq0f+002820
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMUAhq0f+002820
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0465_1993050100_123_962_12179109_1_r2096414442_117.zip
Uploading the intermediate file: upload_file_117.zip
  20:46:11 STEP 2833 H=2833:00 +CPU= 16.736
  20:46:29 STEP 2834 H=2834:00 +CPU= 17.327
  20:46:56 STEP 2835 H=2835:00 +CPU= 27.091
  20:47:13 STEP 2836 H=2836:00 +CPU= 17.220
  20:47:30 STEP 2837 H=2837:00 +CPU= 16.853
  20:47:58 STEP 2838 H=2838:00 +CPU= 27.552
  20:48:15 STEP 2839 H=2839:00 +CPU= 16.866
  20:48:33 STEP 2840 H=2840:00 +CPU= 17.985
  20:49:00 STEP 2841 H=2841:00 +CPU= 26.791
  20:49:18 STEP 2842 H=2842:00 +CPU= 17.477
  20:49:35 STEP 2843 H=2843:00 +CPU= 16.903
  20:50:05 STEP 2844 H=2844:00 +CPU= 29.891
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002844
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002844
  20:50:22 STEP 2845 H=2845:00 +CPU= 16.780
  20:50:40 STEP 2846 H=2846:00 +CPU= 17.451
  20:51:07 STEP 2847 H=2847:00 +CPU= 26.597
  20:51:25 STEP 2848 H=2848:00 +CPU= 17.401
  20:51:41 STEP 2849 H=2849:00 +CPU= 16.586
  20:52:09 STEP 2850 H=2850:00 +CPU= 27.399
  20:52:27 STEP 2851 H=2851:00 +CPU= 17.281
  20:52:44 STEP 2852 H=2852:00 +CPU= 17.349
  20:53:11 STEP 2853 H=2853:00 +CPU= 26.882
  20:53:28 STEP 2854 H=2854:00 +CPU= 17.328
  20:53:47 STEP 2855 H=2855:00 +CPU= 18.505
  20:54:22 STEP 2856 H=2856:00 +CPU= 34.705
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002856
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMGGhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMSHhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMUAhq0f+002832
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMGGhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMSHhq0f+002844
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMUAhq0f+002844
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0465_1993050100_123_962_12179109_1_r2096414442_118.zip
Uploading the intermediate file: upload_file_118.zip
  20:54:39 STEP 2857 H=2857:00 +CPU= 16.960
  20:54:57 STEP 2858 H=2858:00 +CPU= 17.259
  20:55:24 STEP 2859 H=2859:00 +CPU= 26.802
  20:55:43 STEP 2860 H=2860:00 +CPU= 18.996
  20:56:04 STEP 2861 H=2861:00 +CPU= 20.866
  20:56:39 STEP 2862 H=2862:00 +CPU= 34.067
  20:57:01 STEP 2863 H=2863:00 +CPU= 21.717
  20:57:23 STEP 2864 H=2864:00 +CPU= 21.840
  20:57:54 STEP 2865 H=2865:00 +CPU= 30.505
  20:58:16 STEP 2866 H=2866:00 +CPU= 22.161
  20:58:38 STEP 2867 H=2867:00 +CPU= 21.463
  20:59:16 STEP 2868 H=2868:00 +CPU= 37.592
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002868
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002868
  20:59:37 STEP 2869 H=2869:00 +CPU= 20.069
  20:59:58 STEP 2870 H=2870:00 +CPU= 21.365
  21:00:29 STEP 2871 H=2871:00 +CPU= 30.815
  21:00:49 STEP 2872 H=2872:00 +CPU= 19.450
  21:01:08 STEP 2873 H=2873:00 +CPU= 18.853
  21:01:44 STEP 2874 H=2874:00 +CPU= 35.464
  21:02:04 STEP 2875 H=2875:00 +CPU= 19.872
  21:02:26 STEP 2876 H=2876:00 +CPU= 21.379
  21:03:01 STEP 2877 H=2877:00 +CPU= 34.801
  21:03:23 STEP 2878 H=2878:00 +CPU= 21.206
  21:03:44 STEP 2879 H=2879:00 +CPU= 20.882
  21:04:24 STEP 2880 H=2880:00 +CPU= 37.695
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002880
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMGGhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMSHhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMUAhq0f+002856
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMGGhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMSHhq0f+002868
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMUAhq0f+002868
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0465_1993050100_123_962_12179109_1_r2096414442_119.zip
Uploading the intermediate file: upload_file_119.zip
  21:04:44 STEP 2881 H=2881:00 +CPU= 19.933
  21:05:06 STEP 2882 H=2882:00 +CPU= 20.833
  21:05:37 STEP 2883 H=2883:00 +CPU= 30.881
  21:05:58 STEP 2884 H=2884:00 +CPU= 20.998
  21:06:19 STEP 2885 H=2885:00 +CPU= 20.866
  21:06:54 STEP 2886 H=2886:00 +CPU= 34.460
  21:07:15 STEP 2887 H=2887:00 +CPU= 20.129
  21:07:37 STEP 2888 H=2888:00 +CPU= 21.812
  21:08:10 STEP 2889 H=2889:00 +CPU= 32.364
  21:08:29 STEP 2890 H=2890:00 +CPU= 19.273
  21:08:48 STEP 2891 H=2891:00 +CPU= 19.149
  21:09:21 STEP 2892 H=2892:00 +CPU= 32.328
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002892
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002892
  21:09:39 STEP 2893 H=2893:00 +CPU= 17.674
  21:09:57 STEP 2894 H=2894:00 +CPU= 17.675
  21:10:25 STEP 2895 H=2895:00 +CPU= 27.275
  21:10:43 STEP 2896 H=2896:00 +CPU= 17.517
  21:11:00 STEP 2897 H=2897:00 +CPU= 17.178
  21:11:28 STEP 2898 H=2898:00 +CPU= 27.590
  21:11:45 STEP 2899 H=2899:00 +CPU= 17.176
  21:12:04 STEP 2900 H=2900:00 +CPU= 18.029
  21:12:32 STEP 2901 H=2901:00 +CPU= 27.347
  21:12:50 STEP 2902 H=2902:00 +CPU= 17.696
  21:13:09 STEP 2903 H=2903:00 +CPU= 18.963
  21:13:45 STEP 2904 H=2904:00 +CPU= 34.837
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002904
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMGGhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMSHhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMUAhq0f+002880
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMGGhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMSHhq0f+002892
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMUAhq0f+002892
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0465_1993050100_123_962_12179109_1_r2096414442_120.zip
Uploading the intermediate file: upload_file_120.zip
  21:14:03 STEP 2905 H=2905:00 +CPU= 18.188
  21:14:25 STEP 2906 H=2906:00 +CPU= 22.221
  21:14:56 STEP 2907 H=2907:00 +CPU= 30.412
  21:15:15 STEP 2908 H=2908:00 +CPU= 18.600
  21:15:34 STEP 2909 H=2909:00 +CPU= 18.689
  21:16:03 STEP 2910 H=2910:00 +CPU= 28.041
  21:16:20 STEP 2911 H=2911:00 +CPU= 17.370
  21:16:38 STEP 2912 H=2912:00 +CPU= 17.547
  21:17:07 STEP 2913 H=2913:00 +CPU= 28.145
  21:17:25 STEP 2914 H=2914:00 +CPU= 18.031
  21:17:42 STEP 2915 H=2915:00 +CPU= 17.028
  21:18:15 STEP 2916 H=2916:00 +CPU= 32.409
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002916
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002916
  21:18:37 STEP 2917 H=2917:00 +CPU= 21.370
  21:18:56 STEP 2918 H=2918:00 +CPU= 19.292
  21:19:27 STEP 2919 H=2919:00 +CPU= 30.401
  21:19:46 STEP 2920 H=2920:00 +CPU= 18.728
  21:20:05 STEP 2921 H=2921:00 +CPU= 18.332
  21:20:36 STEP 2922 H=2922:00 +CPU= 31.142
  21:20:57 STEP 2923 H=2923:00 +CPU= 19.942
  21:21:20 STEP 2924 H=2924:00 +CPU= 22.538
  21:21:53 STEP 2925 H=2925:00 +CPU= 33.354
  21:22:14 STEP 2926 H=2926:00 +CPU= 20.540
  21:22:35 STEP 2927 H=2927:00 +CPU= 20.040
  21:23:15 STEP 2928 H=2928:00 +CPU= 37.433
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002928
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMGGhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMSHhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMUAhq0f+002904
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMGGhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMSHhq0f+002916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMUAhq0f+002916
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0465_1993050100_123_962_12179109_1_r2096414442_121.zip
Uploading the intermediate file: upload_file_121.zip
  21:23:35 STEP 2929 H=2929:00 +CPU= 19.580
  21:23:55 STEP 2930 H=2930:00 +CPU= 19.988
  21:24:26 STEP 2931 H=2931:00 +CPU= 30.652
  21:24:46 STEP 2932 H=2932:00 +CPU= 19.602
  21:25:05 STEP 2933 H=2933:00 +CPU= 18.600
  21:25:35 STEP 2934 H=2934:00 +CPU= 29.201
  21:25:57 STEP 2935 H=2935:00 +CPU= 22.109
  21:26:20 STEP 2936 H=2936:00 +CPU= 22.788
  21:26:56 STEP 2937 H=2937:00 +CPU= 35.250
  21:27:16 STEP 2938 H=2938:00 +CPU= 19.795
  21:27:39 STEP 2939 H=2939:00 +CPU= 22.945
  21:28:14 STEP 2940 H=2940:00 +CPU= 34.053
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002940
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002940
  21:28:32 STEP 2941 H=2941:00 +CPU= 18.072
  21:28:50 STEP 2942 H=2942:00 +CPU= 17.513
  21:29:18 STEP 2943 H=2943:00 +CPU= 27.766
  21:29:37 STEP 2944 H=2944:00 +CPU= 18.349
  21:29:55 STEP 2945 H=2945:00 +CPU= 17.545
  21:30:26 STEP 2946 H=2946:00 +CPU= 30.521
  21:30:44 STEP 2947 H=2947:00 +CPU= 17.956
  21:31:04 STEP 2948 H=2948:00 +CPU= 19.607
  21:31:34 STEP 2949 H=2949:00 +CPU= 29.656
  21:31:53 STEP 2950 H=2950:00 +CPU= 19.040
  21:32:13 STEP 2951 H=2951:00 +CPU= 19.188
  21:32:49 STEP 2952 H=2952:00 +CPU= 33.242
The child process terminated with status: 0
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHhq0f+002952
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMGGhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMSHhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMUAhq0f+002928
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMGGhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMSHhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMUAhq0f+002940
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMGGhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMSHhq0f+002952
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12179109/ICMUAhq0f+002952
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0465_1993050100_123_962_12179109_1_r2096414442_122.zip
Uploading the final file: upload_file_122.zip
Uploading trickle at timestep: 10623600
21:36:12 (410): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:36:25 1507463 22279321 oifs_43r3_ps_0465_1993050100_123_962_12179109_1 10,623,600 72,703 0.0068
09 May 2023 16:36:20 1507463 22279321 oifs_43r3_ps_0465_1993050100_123_962_12179109_1 9,763,200 67,338 0.0069
09 May 2023 16:36:20 1507463 22279321 oifs_43r3_ps_0465_1993050100_123_962_12179109_1 9,763,200 67,338 0.0069
09 May 2023 16:36:07 1507463 22279321 oifs_43r3_ps_0465_1993050100_123_962_12179109_1 8,640,000 59,863 0.0069
09 May 2023 16:35:57 1507463 22279321 oifs_43r3_ps_0465_1993050100_123_962_12179109_1 7,776,000 52,692 0.0068
09 May 2023 16:35:46 1507463 22279321 oifs_43r3_ps_0465_1993050100_123_962_12179109_1 6,912,000 46,092 0.0067
09 May 2023 16:35:35 1507463 22279321 oifs_43r3_ps_0465_1993050100_123_962_12179109_1 6,048,000 39,580 0.0065
09 May 2023 16:35:23 1507463 22279321 oifs_43r3_ps_0465_1993050100_123_962_12179109_1 5,184,000 32,937 0.0064
09 May 2023 16:35:16 1507463 22279321 oifs_43r3_ps_0465_1993050100_123_962_12179109_1 4,320,000 27,403 0.0063
09 May 2023 16:35:01 1507463 22279321 oifs_43r3_ps_0465_1993050100_123_962_12179109_1 3,456,000 22,122 0.0064
09 May 2023 16:34:54 1507463 22279321 oifs_43r3_ps_0465_1993050100_123_962_12179109_1 2,592,000 16,713 0.0064
09 May 2023 16:34:42 1507463 22279321 oifs_43r3_ps_0465_1993050100_123_962_12179109_1 1,728,000 10,919 0.0063
09 May 2023 16:34:36 1507463 22279321 oifs_43r3_ps_0465_1993050100_123_962_12179109_1 864,000 5,343 0.0062


©2024 climateprediction.net