<core_client_version>7.22.0</core_client_version>
<![CDATA[
<stderr_txt>
pp_1.11_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/12/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/12/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_bd122a33b0ea1c0b0533fedb8ddc54eb to: /var/lib/boinc/slots/12/oifs_43r3_bl_a23n_2016092300_15_991_12209510.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/12/oifs_43r3_bl_a23n_2016092300_15_991_12209510.zip
ic_ancil_file: ic_ancil_12209510
ifsdata_file: ifsdata_12209510
climate_data_file: clim_data_12209510
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc/slots/12/ic_ancil_12209510.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/12/ic_ancil_12209510.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_51506a926a31d20338a9740e21cdb150 to: /var/lib/boinc/slots/12/ifsdata/ifsdata_12209510.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/12/ifsdata/ifsdata_12209510.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/12/159l_2/clim_data_12209510.zip
Unzipping the climate data zip file: /var/lib/boinc/slots/12/159l_2/clim_data_12209510.zip
Checking for progress XML file: /var/lib/boinc/slots/12/progress_file_12209510.xml
Opened progress file ok : /var/lib/boinc/slots/12/progress_file_12209510.xml
-- Model is restarting --
Adjusting last_iter, 1152, to previous model restart step.
Creating progress file: /var/lib/boinc/slots/12/progress_file_12209510.xml
last_cpu_time: 76281
upload_file_number: 11
last_iter: 1153
last_upload: 950400
model_completed: 0
total_length_of_simulation: 1296000
result_base_name: oifs_43r3_bl_a23n_2016092300_15_991_12209510_0_r1349836205
The child process has been launched with process id: 4894
Executing the command: /var/lib/boinc/slots/12/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:112521:1676456721:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2091] fp = 0x30e4a00
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:112521:1676456721:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:112521:1676456721:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:112521:1676456721:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:112521:1676456721:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:112521:1676456721:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:112521:1676456721:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:112521:1676456721:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:112521:1676456721:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:112521:1676456721:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:112521:1676456721:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:112521:1676456721:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:112521:1676456721:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:112521:1676456721:0.000] [ignore_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:112521:1676456721:0.000] [restore_default_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:112521:1676456721:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:112521:1676456721:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f520 (old at (nil))
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:112521:1676456721:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:112521:1676456721:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f520 (old at (nil))
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:112521:1676456721:0.000] [trapfpe_treatment@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:112521:1676456721:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:112521:1676456721:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:112521:1676456721:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f520 (old at (nil))
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:112521:1676456721:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:112521:1676456721:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:112521:1676456721:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:112521:1676456721:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f520 (old at (nil))
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:112521:1676456721:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f520 (old at (nil))
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:112521:1676456721:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f520 (old at (nil))
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:112521:1676456721:0.000] [catch_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMUAh7zg+001140
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a23n_2016092300_15_991_12209510_0_r1349836205_11.zip
Uploading the intermediate file: upload_file_11.zip
11:26:03 STEP 1152 H= 288:00 +CPU= 31.883
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001152
11:26:35 STEP 1153 H= 288:15 +CPU= 31.468
11:27:08 STEP 1154 H= 288:30 +CPU= 33.089
11:27:38 STEP 1155 H= 288:45 +CPU= 28.895
11:28:09 STEP 1156 H= 289:00 +CPU= 31.488
11:29:17 STEP 1157 H= 289:15 +CPU= 62.189
11:30:38 STEP 1158 H= 289:30 +CPU= 70.020
11:31:58 STEP 1159 H= 289:45 +CPU= 66.743
11:33:20 STEP 1160 H= 290:00 +CPU= 71.194
11:34:39 STEP 1161 H= 290:15 +CPU= 64.990
11:35:56 STEP 1162 H= 290:30 +CPU= 71.572
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:113634:1676457394:673.067] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1538] Received signal#15 (SIGTERM) :: 4032MB (heap), 4850MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:113634:1676457394:673.094] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:113634:1676457394:673.094] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x81f0c0 (old at (nil))
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:113634:1676457394:673.094] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1617] Signal#15 was caused by unrecognized si_code [memaddr=0x1], nsigs = 1
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:113634:1676457394:673.094] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#15, nsigs = 1
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:113634:1676457394:673.094] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3843] 4032 MB (maxheap), 4850 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:113634:1676457394:673.094] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : MASTER
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:113634:1676457394:673.094] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : CNT0
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:113634:1676457394:673.094] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : CNT1
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:113634:1676457394:673.094] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : CNT2
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:113634:1676457394:673.094] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : CNT3
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:113634:1676457394:673.094] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : CNT4
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:113634:1676457394:673.094] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : STEPO
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:113634:1676457394:673.094] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : SCAN2M
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:113634:1676457394:673.094] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : GP_MODEL_HEAP
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:113634:1676457394:673.094] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : GP_MODEL
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:113634:1676457394:673.094] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : EC_PHYS_DRV
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:113634:1676457394:673.094] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : >OMP-PHYSICS (1001)
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:113634:1676457394:673.094] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : EC_PHYS
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:113634:1676457394:673.094] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : CALLPAR
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:113634:1676457394:673.094] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : TURBULENCE_LAYER
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:113634:1676457394:673.094] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : VDFOUTER
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:113634:1676457394:673.094] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : VDFMAIN
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:113635:1676457395:674.094] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#15, nsigs = 1
[EC_DRHOOK:antares:1:1:4894:4894] [20230215:113635:1676457395:674.094] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x401140 for signal#15, nsigs = 1
forrtl: error (78): process killed (SIGTERM)
Image PC Routine Line Source
oifs_43r3_model.e 000000000081FCF1 Unknown Unknown Unknown
oifs_43r3_model.e 0000000001D8BB20 Unknown Unknown Unknown
oifs_43r3_model.e 00000000012D3361 vdfmain_ 929 vdfmain.F90
oifs_43r3_model.e 00000000012BA8D9 vdfouter_ 739 vdfouter.F90
oifs_43r3_model.e 00000000012B0762 turbulence_layer_ 158 turbulence_layer.F90
oifs_43r3_model.e 0000000001163FC3 callpar_ 869 callpar.F90
oifs_43r3_model.e 00000000010B682F ec_phys_ 670 ec_phys.F90
oifs_43r3_model.e 00000000010A915C ec_phys_drv_ 599 ec_phys_drv.F90
oifs_43r3_model.e 0000000000E680C3 gp_model_ 613 gp_model.F90
oifs_43r3_model.e 00000000015C1E62 gp_model_heap_ 74 gp_model_heap.F90
oifs_43r3_model.e 00000000015AC40E scan2m_ 535 scan2m.F90
oifs_43r3_model.e 00000000006620B4 stepo_ 327 stepo.F90
oifs_43r3_model.e 00000000004A0E7C cnt4_ 1133 cnt4.F90
oifs_43r3_model.e 000000000049DC29 cnt3_ 267 cnt3.F90
oifs_43r3_model.e 000000000049CE72 cnt2_ 88 cnt2.F90
oifs_43r3_model.e 000000000049CD68 cnt1_ 92 cnt1.F90
oifs_43r3_model.e 00000000004078AD cnt0_ 146 cnt0.F90
oifs_43r3_model.e 000000000040276F MAIN__ 96 master.F90
oifs_43r3_model.e 000000000040270D Unknown Unknown Unknown
oifs_43r3_model.e 0000000001D8287A Unknown Unknown Unknown
oifs_43r3_model.e 0000000001D840D7 Unknown Unknown Unknown
oifs_43r3_model.e 00000000004025E5 Unknown Unknown Unknown
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.11_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a23n
(argv4) batchid: 991
(argv5) wuid: 12209510
(argv6) fclen: 15
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/12
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.11
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/12/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/12/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_bd122a33b0ea1c0b0533fedb8ddc54eb to: /var/lib/boinc/slots/12/oifs_43r3_bl_a23n_2016092300_15_991_12209510.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/12/oifs_43r3_bl_a23n_2016092300_15_991_12209510.zip
ic_ancil_file: ic_ancil_12209510
ifsdata_file: ifsdata_12209510
climate_data_file: clim_data_12209510
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc/slots/12/ic_ancil_12209510.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/12/ic_ancil_12209510.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_51506a926a31d20338a9740e21cdb150 to: /var/lib/boinc/slots/12/ifsdata/ifsdata_12209510.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/12/ifsdata/ifsdata_12209510.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/12/159l_2/clim_data_12209510.zip
Unzipping the climate data zip file: /var/lib/boinc/slots/12/159l_2/clim_data_12209510.zip
Checking for progress XML file: /var/lib/boinc/slots/12/progress_file_12209510.xml
Opened progress file ok : /var/lib/boinc/slots/12/progress_file_12209510.xml
-- Model is restarting --
Adjusting last_iter, 1163, to previous model restart step.
Creating progress file: /var/lib/boinc/slots/12/progress_file_12209510.xml
last_cpu_time: 76881
upload_file_number: 12
last_iter: 1153
last_upload: 1037700
model_completed: 0
total_length_of_simulation: 1296000
result_base_name: oifs_43r3_bl_a23n_2016092300_15_991_12209510_0_r1349836205
The child process has been launched with process id: 8771
Executing the command: /var/lib/boinc/slots/12/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:antares:1:1:8771:8771] [20230215:113907:1676457547:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2091] fp = 0x30e4a00
[EC_DRHOOK:antares:1:1:8771:8771] [20230215:113907:1676457547:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:antares:1:1:8771:8771] [20230215:113907:1676457547:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:antares:1:1:8771:8771] [20230215:113907:1676457547:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:antares:1:1:8771:8771] [20230215:113907:1676457547:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:antares:1:1:8771:8771] [20230215:113907:1676457547:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:antares:1:1:8771:8771] [20230215:113907:1676457547:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:antares:1:1:8771:8771] [20230215:113907:1676457547:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:antares:1:1:8771:8771] [20230215:113907:1676457547:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:antares:1:1:8771:8771] [20230215:113907:1676457547:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:antares:1:1:8771:8771] [20230215:113907:1676457547:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:antares:1:1:8771:8771] [20230215:113907:1676457547:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:antares:1:1:8771:8771] [20230215:113907:1676457547:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:antares:1:1:8771:8771] [20230215:113907:1676457547:0.000] [ignore_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:antares:1:1:8771:8771] [20230215:113907:1676457547:0.000] [restore_default_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:antares:1:1:8771:8771] [20230215:113907:1676457547:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:antares:1:1:8771:8771] [20230215:113907:1676457547:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f520 (old at (nil))
[EC_DRHOOK:antares:1:1:8771:8771] [20230215:113907:1676457547:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:antares:1:1:8771:8771] [20230215:113907:1676457547:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f520 (old at (nil))
[EC_DRHOOK:antares:1:1:8771:8771] [20230215:113907:1676457547:0.000] [trapfpe_treatment@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:antares:1:1:8771:8771] [20230215:113907:1676457547:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:antares:1:1:8771:8771] [20230215:113907:1676457547:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:antares:1:1:8771:8771] [20230215:113907:1676457547:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f520 (old at (nil))
[EC_DRHOOK:antares:1:1:8771:8771] [20230215:113907:1676457547:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:antares:1:1:8771:8771] [20230215:113907:1676457547:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:antares:1:1:8771:8771] [20230215:113907:1676457547:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:antares:1:1:8771:8771] [20230215:113907:1676457547:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f520 (old at (nil))
[EC_DRHOOK:antares:1:1:8771:8771] [20230215:113907:1676457547:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f520 (old at (nil))
[EC_DRHOOK:antares:1:1:8771:8771] [20230215:113907:1676457547:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f520 (old at (nil))
[EC_DRHOOK:antares:1:1:8771:8771] [20230215:113907:1676457547:0.000] [catch_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:40:24 STEP 1152 H= 288:00 +CPU= 44.710
11:40:54 STEP 1153 H= 288:15 +CPU= 29.440
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:42:08 STEP 1154 H= 288:30 +CPU= 50.025
11:43:09 STEP 1155 H= 288:45 +CPU= 56.648
11:44:07 STEP 1156 H= 289:00 +CPU= 56.191
11:45:01 STEP 1157 H= 289:15 +CPU= 51.747
11:45:57 STEP 1158 H= 289:30 +CPU= 53.390
11:46:49 STEP 1159 H= 289:45 +CPU= 50.654
11:47:37 STEP 1160 H= 290:00 +CPU= 46.747
11:48:37 STEP 1161 H= 290:15 +CPU= 57.847
11:49:30 STEP 1162 H= 290:30 +CPU= 51.433
11:50:24 STEP 1163 H= 290:45 +CPU= 51.460
11:51:32 STEP 1164 H= 291:00 +CPU= 65.281
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001164
11:52:29 STEP 1165 H= 291:15 +CPU= 55.608
11:53:24 STEP 1166 H= 291:30 +CPU= 52.525
11:54:15 STEP 1167 H= 291:45 +CPU= 50.675
11:55:12 STEP 1168 H= 292:00 +CPU= 55.156
11:56:09 STEP 1169 H= 292:15 +CPU= 56.158
11:57:06 STEP 1170 H= 292:30 +CPU= 54.477
11:58:02 STEP 1171 H= 292:45 +CPU= 54.346
11:59:00 STEP 1172 H= 293:00 +CPU= 56.743
11:59:54 STEP 1173 H= 293:15 +CPU= 52.299
12:00:51 STEP 1174 H= 293:30 +CPU= 56.327
12:01:45 STEP 1175 H= 293:45 +CPU= 51.932
12:02:52 STEP 1176 H= 294:00 +CPU= 66.289
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001176
12:03:48 STEP 1177 H= 294:15 +CPU= 54.169
12:04:43 STEP 1178 H= 294:30 +CPU= 53.981
12:05:42 STEP 1179 H= 294:45 +CPU= 57.257
12:06:36 STEP 1180 H= 295:00 +CPU= 52.529
12:07:34 STEP 1181 H= 295:15 +CPU= 56.725
12:08:32 STEP 1182 H= 295:30 +CPU= 55.578
12:09:26 STEP 1183 H= 295:45 +CPU= 53.242
12:10:23 STEP 1184 H= 296:00 +CPU= 54.986
12:11:21 STEP 1185 H= 296:15 +CPU= 56.871
12:12:18 STEP 1186 H= 296:30 +CPU= 55.961
12:13:16 STEP 1187 H= 296:45 +CPU= 56.143
12:14:25 STEP 1188 H= 297:00 +CPU= 67.100
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001188
12:15:24 STEP 1189 H= 297:15 +CPU= 58.276
12:16:20 STEP 1190 H= 297:30 +CPU= 53.722
12:17:18 STEP 1191 H= 297:45 +CPU= 57.236
12:18:13 STEP 1192 H= 298:00 +CPU= 53.236
12:19:11 STEP 1193 H= 298:15 +CPU= 56.167
12:20:08 STEP 1194 H= 298:30 +CPU= 55.965
12:21:01 STEP 1195 H= 298:45 +CPU= 51.172
12:22:02 STEP 1196 H= 299:00 +CPU= 59.781
12:22:57 STEP 1197 H= 299:15 +CPU= 52.882
12:23:51 STEP 1198 H= 299:30 +CPU= 52.617
12:24:46 STEP 1199 H= 299:45 +CPU= 53.005
12:26:02 STEP 1200 H= 300:00 +CPU= 73.278
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001200
12:27:02 STEP 1201 H= 300:15 +CPU= 56.952
12:27:57 STEP 1202 H= 300:30 +CPU= 52.765
12:28:56 STEP 1203 H= 300:45 +CPU= 55.726
12:29:51 STEP 1204 H= 301:00 +CPU= 53.681
12:30:45 STEP 1205 H= 301:15 +CPU= 52.257
12:31:43 STEP 1206 H= 301:30 +CPU= 55.723
12:32:42 STEP 1207 H= 301:45 +CPU= 56.473
12:33:42 STEP 1208 H= 302:00 +CPU= 58.200
12:34:35 STEP 1209 H= 302:15 +CPU= 51.076
12:35:31 STEP 1210 H= 302:30 +CPU= 53.438
12:36:23 STEP 1211 H= 302:45 +CPU= 50.039
12:37:29 STEP 1212 H= 303:00 +CPU= 63.679
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001212
12:38:27 STEP 1213 H= 303:15 +CPU= 55.700
12:39:26 STEP 1214 H= 303:30 +CPU= 56.861
12:40:24 STEP 1215 H= 303:45 +CPU= 55.922
12:41:22 STEP 1216 H= 304:00 +CPU= 55.204
12:42:19 STEP 1217 H= 304:15 +CPU= 54.456
12:43:17 STEP 1218 H= 304:30 +CPU= 55.815
12:44:27 STEP 1219 H= 304:45 +CPU= 66.863
12:45:41 STEP 1220 H= 305:00 +CPU= 69.776
12:46:56 STEP 1221 H= 305:15 +CPU= 70.876
12:48:06 STEP 1222 H= 305:30 +CPU= 68.051
12:49:18 STEP 1223 H= 305:45 +CPU= 68.506
12:50:49 STEP 1224 H= 306:00 +CPU= 86.403
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001224
12:52:03 STEP 1225 H= 306:15 +CPU= 70.485
12:53:16 STEP 1226 H= 306:30 +CPU= 70.335
12:54:29 STEP 1227 H= 306:45 +CPU= 70.336
12:55:42 STEP 1228 H= 307:00 +CPU= 70.458
12:56:59 STEP 1229 H= 307:15 +CPU= 71.595
12:58:14 STEP 1230 H= 307:30 +CPU= 67.436
12:59:29 STEP 1231 H= 307:45 +CPU= 69.033
13:00:45 STEP 1232 H= 308:00 +CPU= 71.188
13:01:59 STEP 1233 H= 308:15 +CPU= 68.690
13:03:13 STEP 1234 H= 308:30 +CPU= 67.617
13:04:30 STEP 1235 H= 308:45 +CPU= 69.470
13:06:01 STEP 1236 H= 309:00 +CPU= 85.792
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001236
13:07:17 STEP 1237 H= 309:15 +CPU= 71.189
13:08:33 STEP 1238 H= 309:30 +CPU= 71.001
13:09:49 STEP 1239 H= 309:45 +CPU= 70.561
13:11:03 STEP 1240 H= 310:00 +CPU= 68.786
13:12:19 STEP 1241 H= 310:15 +CPU= 70.659
13:13:34 STEP 1242 H= 310:30 +CPU= 69.348
13:14:48 STEP 1243 H= 310:45 +CPU= 67.010
13:16:03 STEP 1244 H= 311:00 +CPU= 68.324
13:17:20 STEP 1245 H= 311:15 +CPU= 68.175
13:18:40 STEP 1246 H= 311:30 +CPU= 68.656
13:19:56 STEP 1247 H= 311:45 +CPU= 66.427
13:21:37 STEP 1248 H= 312:00 +CPU= 89.115
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001248
13:22:51 STEP 1249 H= 312:15 +CPU= 66.432
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMUAh7zg+001236
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMUAh7zg+001248
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a23n_2016092300_15_991_12209510_0_r1349836205_12.zip
Uploading the intermediate file: upload_file_12.zip
13:23:59 STEP 1250 H= 312:30 +CPU= 63.329
13:25:09 STEP 1251 H= 312:45 +CPU= 64.471
13:26:19 STEP 1252 H= 313:00 +CPU= 65.149
13:27:28 STEP 1253 H= 313:15 +CPU= 64.429
13:28:37 STEP 1254 H= 313:30 +CPU= 64.456
13:29:46 STEP 1255 H= 313:45 +CPU= 64.788
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:31:17 STEP 1256 H= 314:00 +CPU= 65.408
13:32:25 STEP 1257 H= 314:15 +CPU= 63.687
13:41:16 STEP 1258 H= 314:30 +CPU=143.931
13:42:30 STEP 1259 H= 314:45 +CPU= 70.209
13:43:55 STEP 1260 H= 315:00 +CPU= 82.632
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001260
13:45:07 STEP 1261 H= 315:15 +CPU= 69.404
13:46:19 STEP 1262 H= 315:30 +CPU= 69.217
13:47:29 STEP 1263 H= 315:45 +CPU= 67.795
13:48:43 STEP 1264 H= 316:00 +CPU= 70.927
13:49:59 STEP 1265 H= 316:15 +CPU= 72.448
13:51:13 STEP 1266 H= 316:30 +CPU= 70.665
13:52:30 STEP 1267 H= 316:45 +CPU= 72.372
13:53:46 STEP 1268 H= 317:00 +CPU= 71.116
13:54:59 STEP 1269 H= 317:15 +CPU= 70.178
13:56:11 STEP 1270 H= 317:30 +CPU= 68.385
13:57:25 STEP 1271 H= 317:45 +CPU= 70.375
13:58:54 STEP 1272 H= 318:00 +CPU= 85.071
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001272
14:00:08 STEP 1273 H= 318:15 +CPU= 69.327
14:01:21 STEP 1274 H= 318:30 +CPU= 70.002
14:02:35 STEP 1275 H= 318:45 +CPU= 71.011
14:03:52 STEP 1276 H= 319:00 +CPU= 72.984
14:05:07 STEP 1277 H= 319:15 +CPU= 70.330
14:06:20 STEP 1278 H= 319:30 +CPU= 69.303
14:07:31 STEP 1279 H= 319:45 +CPU= 67.547
14:08:45 STEP 1280 H= 320:00 +CPU= 69.959
14:09:58 STEP 1281 H= 320:15 +CPU= 69.856
14:11:11 STEP 1282 H= 320:30 +CPU= 69.364
14:12:21 STEP 1283 H= 320:45 +CPU= 66.552
14:13:46 STEP 1284 H= 321:00 +CPU= 82.016
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001284
14:14:59 STEP 1285 H= 321:15 +CPU= 69.193
14:16:12 STEP 1286 H= 321:30 +CPU= 70.143
14:17:21 STEP 1287 H= 321:45 +CPU= 65.855
14:18:35 STEP 1288 H= 322:00 +CPU= 70.533
14:19:46 STEP 1289 H= 322:15 +CPU= 68.889
14:20:56 STEP 1290 H= 322:30 +CPU= 67.524
14:22:08 STEP 1291 H= 322:45 +CPU= 68.912
14:23:22 STEP 1292 H= 323:00 +CPU= 68.592
14:24:38 STEP 1293 H= 323:15 +CPU= 71.413
14:25:49 STEP 1294 H= 323:30 +CPU= 67.742
14:27:05 STEP 1295 H= 323:45 +CPU= 72.215
14:28:41 STEP 1296 H= 324:00 +CPU= 90.830
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001296
14:29:48 STEP 1297 H= 324:15 +CPU= 64.463
14:31:04 STEP 1298 H= 324:30 +CPU= 66.423
14:32:22 STEP 1299 H= 324:45 +CPU= 68.664
14:33:37 STEP 1300 H= 325:00 +CPU= 69.990
14:34:54 STEP 1301 H= 325:15 +CPU= 69.724
14:36:09 STEP 1302 H= 325:30 +CPU= 69.286
14:37:23 STEP 1303 H= 325:45 +CPU= 69.330
14:38:38 STEP 1304 H= 326:00 +CPU= 69.449
14:39:53 STEP 1305 H= 326:15 +CPU= 68.692
14:41:09 STEP 1306 H= 326:30 +CPU= 69.268
14:42:23 STEP 1307 H= 326:45 +CPU= 69.823
14:43:54 STEP 1308 H= 327:00 +CPU= 83.017
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001308
14:45:10 STEP 1309 H= 327:15 +CPU= 67.715
14:46:23 STEP 1310 H= 327:30 +CPU= 67.199
14:47:38 STEP 1311 H= 327:45 +CPU= 66.777
14:48:52 STEP 1312 H= 328:00 +CPU= 67.936
14:50:08 STEP 1313 H= 328:15 +CPU= 68.617
14:51:22 STEP 1314 H= 328:30 +CPU= 68.329
14:52:32 STEP 1315 H= 328:45 +CPU= 66.192
14:53:35 STEP 1316 H= 329:00 +CPU= 61.441
14:54:39 STEP 1317 H= 329:15 +CPU= 62.547
14:55:40 STEP 1318 H= 329:30 +CPU= 59.375
14:56:43 STEP 1319 H= 329:45 +CPU= 61.376
14:58:08 STEP 1320 H= 330:00 +CPU= 81.420
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001320
14:59:11 STEP 1321 H= 330:15 +CPU= 60.623
15:00:15 STEP 1322 H= 330:30 +CPU= 61.928
15:01:20 STEP 1323 H= 330:45 +CPU= 62.314
15:02:21 STEP 1324 H= 331:00 +CPU= 59.440
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:03:46 STEP 1325 H= 331:15 +CPU= 62.358
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:05:14 STEP 1326 H= 331:30 +CPU= 63.995
15:06:28 STEP 1327 H= 331:45 +CPU= 68.785
15:07:42 STEP 1328 H= 332:00 +CPU= 69.400
15:08:56 STEP 1329 H= 332:15 +CPU= 70.843
15:10:07 STEP 1330 H= 332:30 +CPU= 67.024
15:11:19 STEP 1331 H= 332:45 +CPU= 67.767
15:12:48 STEP 1332 H= 333:00 +CPU= 84.194
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001332
15:14:01 STEP 1333 H= 333:15 +CPU= 68.838
15:15:11 STEP 1334 H= 333:30 +CPU= 67.144
15:16:21 STEP 1335 H= 333:45 +CPU= 66.408
15:17:33 STEP 1336 H= 334:00 +CPU= 69.050
15:18:44 STEP 1337 H= 334:15 +CPU= 68.246
15:19:59 STEP 1338 H= 334:30 +CPU= 70.330
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:21:32 STEP 1339 H= 334:45 +CPU= 68.269
15:22:39 STEP 1340 H= 335:00 +CPU= 65.155
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:24:07 STEP 1341 H= 335:15 +CPU= 65.174
15:25:09 STEP 1342 H= 335:30 +CPU= 60.804
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:26:30 STEP 1343 H= 335:45 +CPU= 58.819
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:28:13 STEP 1344 H= 336:00 +CPU= 78.507
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001344
15:29:08 STEP 1345 H= 336:15 +CPU= 54.379
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMUAh7zg+001332
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMUAh7zg+001344
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a23n_2016092300_15_991_12209510_0_r1349836205_13.zip
Uploading the intermediate file: upload_file_13.zip
15:30:05 STEP 1346 H= 336:30 +CPU= 54.924
15:31:03 STEP 1347 H= 336:45 +CPU= 56.239
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:32:23 STEP 1348 H= 337:00 +CPU= 57.742
15:33:26 STEP 1349 H= 337:15 +CPU= 62.481
15:34:21 STEP 1350 H= 337:30 +CPU= 53.438
15:35:20 STEP 1351 H= 337:45 +CPU= 57.400
15:36:21 STEP 1352 H= 338:00 +CPU= 57.660
15:37:21 STEP 1353 H= 338:15 +CPU= 58.234
15:38:18 STEP 1354 H= 338:30 +CPU= 53.456
15:39:16 STEP 1355 H= 338:45 +CPU= 55.840
15:40:24 STEP 1356 H= 339:00 +CPU= 65.382
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001356
15:41:21 STEP 1357 H= 339:15 +CPU= 55.954
15:42:17 STEP 1358 H= 339:30 +CPU= 54.491
15:43:10 STEP 1359 H= 339:45 +CPU= 51.582
15:44:04 STEP 1360 H= 340:00 +CPU= 51.133
15:45:01 STEP 1361 H= 340:15 +CPU= 53.910
15:45:58 STEP 1362 H= 340:30 +CPU= 54.055
15:46:58 STEP 1363 H= 340:45 +CPU= 56.917
15:47:55 STEP 1364 H= 341:00 +CPU= 55.370
15:48:52 STEP 1365 H= 341:15 +CPU= 55.774
15:49:51 STEP 1366 H= 341:30 +CPU= 55.876
15:50:47 STEP 1367 H= 341:45 +CPU= 53.195
15:52:00 STEP 1368 H= 342:00 +CPU= 69.432
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001368
15:52:53 STEP 1369 H= 342:15 +CPU= 50.815
15:53:46 STEP 1370 H= 342:30 +CPU= 50.409
15:54:38 STEP 1371 H= 342:45 +CPU= 50.237
15:55:32 STEP 1372 H= 343:00 +CPU= 51.644
15:56:29 STEP 1373 H= 343:15 +CPU= 54.608
15:57:26 STEP 1374 H= 343:30 +CPU= 55.262
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:58:41 STEP 1375 H= 343:45 +CPU= 52.375
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:59:56 STEP 1376 H= 344:00 +CPU= 51.968
16:00:57 STEP 1377 H= 344:15 +CPU= 58.605
16:01:57 STEP 1378 H= 344:30 +CPU= 57.868
16:02:41 STEP 1379 H= 344:45 +CPU= 43.290
16:03:59 STEP 1380 H= 345:00 +CPU= 74.099
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001380
16:05:00 STEP 1381 H= 345:15 +CPU= 57.849
16:06:03 STEP 1382 H= 345:30 +CPU= 60.691
16:06:56 STEP 1383 H= 345:45 +CPU= 51.258
16:07:59 STEP 1384 H= 346:00 +CPU= 60.438
16:08:57 STEP 1385 H= 346:15 +CPU= 55.770
16:09:57 STEP 1386 H= 346:30 +CPU= 55.752
16:10:59 STEP 1387 H= 346:45 +CPU= 59.152
16:11:57 STEP 1388 H= 347:00 +CPU= 56.120
16:12:53 STEP 1389 H= 347:15 +CPU= 52.856
16:13:50 STEP 1390 H= 347:30 +CPU= 54.708
16:14:48 STEP 1391 H= 347:45 +CPU= 54.563
16:16:02 STEP 1392 H= 348:00 +CPU= 70.599
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001392
16:17:01 STEP 1393 H= 348:15 +CPU= 56.479
16:18:03 STEP 1394 H= 348:30 +CPU= 58.750
16:19:04 STEP 1395 H= 348:45 +CPU= 58.314
16:19:59 STEP 1396 H= 349:00 +CPU= 53.505
16:20:58 STEP 1397 H= 349:15 +CPU= 56.490
16:21:57 STEP 1398 H= 349:30 +CPU= 55.763
16:23:01 STEP 1399 H= 349:45 +CPU= 61.436
16:23:57 STEP 1400 H= 350:00 +CPU= 53.248
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
16:25:14 STEP 1401 H= 350:15 +CPU= 54.898
16:26:12 STEP 1402 H= 350:30 +CPU= 56.345
16:27:14 STEP 1403 H= 350:45 +CPU= 60.767
16:28:16 STEP 1404 H= 351:00 +CPU= 60.998
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001404
16:29:14 STEP 1405 H= 351:15 +CPU= 54.080
16:30:14 STEP 1406 H= 351:30 +CPU= 56.945
16:31:09 STEP 1407 H= 351:45 +CPU= 53.774
16:32:05 STEP 1408 H= 352:00 +CPU= 53.957
16:32:59 STEP 1409 H= 352:15 +CPU= 51.441
16:33:58 STEP 1410 H= 352:30 +CPU= 56.592
16:34:50 STEP 1411 H= 352:45 +CPU= 50.501
16:35:48 STEP 1412 H= 353:00 +CPU= 55.368
16:36:49 STEP 1413 H= 353:15 +CPU= 58.099
16:37:45 STEP 1414 H= 353:30 +CPU= 54.167
16:38:39 STEP 1415 H= 353:45 +CPU= 51.444
16:39:44 STEP 1416 H= 354:00 +CPU= 62.505
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001416
16:40:33 STEP 1417 H= 354:15 +CPU= 47.047
16:41:21 STEP 1418 H= 354:30 +CPU= 46.290
16:42:08 STEP 1419 H= 354:45 +CPU= 46.398
16:42:51 STEP 1420 H= 355:00 +CPU= 41.404
16:43:37 STEP 1421 H= 355:15 +CPU= 45.064
16:44:23 STEP 1422 H= 355:30 +CPU= 43.888
16:45:08 STEP 1423 H= 355:45 +CPU= 43.779
16:45:53 STEP 1424 H= 356:00 +CPU= 44.267
16:46:34 STEP 1425 H= 356:15 +CPU= 39.390
16:47:23 STEP 1426 H= 356:30 +CPU= 47.351
16:48:03 STEP 1427 H= 356:45 +CPU= 38.473
16:48:57 STEP 1428 H= 357:00 +CPU= 51.666
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001428
16:49:34 STEP 1429 H= 357:15 +CPU= 36.457
16:50:16 STEP 1430 H= 357:30 +CPU= 40.480
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
16:51:12 STEP 1431 H= 357:45 +CPU= 34.885
16:51:54 STEP 1432 H= 358:00 +CPU= 40.448
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
16:53:08 STEP 1433 H= 358:15 +CPU= 31.697
16:53:43 STEP 1434 H= 358:30 +CPU= 34.469
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
16:54:36 STEP 1435 H= 358:45 +CPU= 32.012
16:55:05 STEP 1436 H= 359:00 +CPU= 28.751
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
16:55:57 STEP 1437 H= 359:15 +CPU= 29.716
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
16:56:46 STEP 1438 H= 359:30 +CPU= 27.529
16:57:16 STEP 1439 H= 359:45 +CPU= 29.450
16:57:58 STEP 1440 H= 360:00 +CPU= 40.972
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01
DDH------------------------------------------------------------------------
I I
I TIME = 360.000H DDH * Diagnostic Var., AREA GLOBAL I
I I
I-------------------------------------------------------------------------I
I VARIABLE I Initial value I Current value I
I-------------------------------------------------------------------------I
I OMEGA (P/S) I 0.3343675304E-21 I -0.2542305194E-08 I
ICloud fractionI 0.0000000000E+00 I 0.6925013163E-02 I
I Relat. Hum. I 0.1119449071E+00 I 0.1939551622E+00 I
I PASS 01 I 0.0000000000E+00 I 0.6251922495E+02 I
DDH------------------------------------------------------------------------
MAXGPFV : MAX. VALUE = 0.000000000000000E+000
MAXGPFV : MAX. VALUE = 0.000000000000000E+000
NSTEP = 1440 SCAN2M_HPOS P
IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH =
ICMGGh7zg+001440 MODE=a
IO-STREAM CLOSED - ICMGGh7zg+001440
MPI-TASK: 1 - 326523617 BYTES IN 7 RECORDS TRANSFERRED IN 0.0010 SECONDS326523.6 Mbytes/s, TOTAL TIME= 0.0193( 5.2%)
16:57:58 STEP 1440 H= 360:00 +CPU= 40.972
END CNT3
NSTEP = 1440 CNT0 000000000 29.528 29.528 30.086 0.981 0 0 0 0 0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ 34/ 1069125708 WRITTEN 8508/************
-TASK-OPENED-OPEN-RECS IN -KBYTE IN -RECS OUT-KBYTE OUT-WALL -WALL IN-WALL
OU-TOT IN -TOT OUT
1 153 0 34 1044068 8508 ************ 39.4 4.0 35.4 6.7 70.9
===-=== START OF TIMING STATISTICS ===-===
STATS FOR ALL TASKS
NUM ROUTINE CALLS MEAN(ms) MAX(ms) FRAC(%) UNBAL(%)
0 CNT0 - COMPLETE EXECUTION 1 ********* ********* 100.00 0.00
1 CNT4 - FORWARD INTEGRATION 1 ********* ********* 99.84 0.00
8 SCAN2M - GRID-POINT DYNAMICS 313 13584.7 13584.7 22.23 0.00
9 SPCM - SPECTRAL COMP. 288 3101.1 3101.1 4.67 0.00
10 SCAN2M - PHYSICS 289 26784.2 26784.2 40.46 0.00
11 IOPACK - OUTPUT P.P. RESULTS 24 2317.0 2317.0 0.29 0.00
12 SPNORM - SPECTRAL NORM COMP. 13 140.8 140.8 0.01 0.00
17 GRIDFPOS IN CNT4 24 74.9 74.9 0.01 0.00
27 RESTART FILES - WRITING 6 9263.3 9263.3 0.29 0.00
28 RESTART FILES - READING 1 30424.3 30424.3 0.16 0.00
29 SU4FPOS IN CNT4 24 0.5 0.5 0.00 0.00
30 DYNFPOS IN CNT4 24 11949.5 11949.5 1.50 0.00
31 POSDDH IN STEPO 2 14.0 14.0 0.00 0.00
37 CPGLAG - SL COMPUTATIONS 289 13244.5 13244.5 20.01 0.00
39 SU0YOMB 1 295.6 295.6 0.00 0.00
51 SCAN2M - SL COMM. PART 1 289 58.5 58.5 0.09 0.00
54 SPCM - M TO S/S TO M TRANSP. 288 1473.6 1473.6 2.22 0.00
55 SPCIMPF - S TO M/M TO S TRANSP. 288 170.7 170.7 0.26 0.00
56 SPNORM - SPECTRAL NORM COMM. 13 3.5 3.5 0.00 0.00
102 LTINV_CTL - INVERSE LEGENDRE TRANSFORM 628 930.1 930.1 3.05 0.00
103 LTDIR_CTL - DIRECT LEGENDRE TRANSFORM 600 469.6 469.6 1.47 0.00
106 FTDIR_CTL - DIRECT FOURIER TRANSFORM 600 188.0 188.0 0.59 0.00
107 FTINV_CTL - INVERSE FOURIER TRANSFORM 628 270.3 270.3 0.89 0.00
140 SULEG - COMP. OF LEGENDRE POL. 1 23.6 23.6 0.00 0.00
152 LTINV_CTL - M TO L TRANSPOSITION 628 205.9 205.9 0.68 0.00
153 LTDIR_CTL - L TO M TRANSPOSITION 600 124.1 124.1 0.39 0.00
157 FTINV_CTL - L TO G TRANSPOSITION 628 211.9 211.9 0.70 0.00
158 FTDIR_CTL - G TO L TRANSPOSITION 600 108.0 108.0 0.34 0.00
400 GSTATS 34304 0.0 0.0 0.00 0.00
401 GSTATS HOOK 31868 0.0 0.0 0.00 0.00
TOTAL MEASURED IMBALANCE = 0.0 SECONDS, 0.0 PERCENT
TOTAL WALLCLOCK TIME 19131.2 CPU TIME 17477.7 VECTOR TIME 17477.7
===-=== END OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY 67.9
*** END CNT0 ***
------------------------------------------------
Moving to projects directory: /var/lib/boinc/slots/12/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc/slots/12/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc/slots/12/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc/slots/12/NODE.001_01
Adding to the zip: /var/lib/boinc/slots/12/ifs.stat
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209510/ICMUAh7zg+001440
Zipping up the final file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a23n_2016092300_15_991_12209510_0_r1349836205_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
17:01:26 (8745): called boinc_finish(0)
</stderr_txt>
]]>
