<core_client_version>7.22.0</core_client_version>
<![CDATA[
<stderr_txt>
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/24/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/24/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_39824f94fb5b1cff1f31fd0c7183ce8a to: /var/lib/boinc/slots/24/oifs_43r3_bl_a264_2016092300_15_991_12209599.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/24/oifs_43r3_bl_a264_2016092300_15_991_12209599.zip
ic_ancil_file: ic_ancil_12209599
ifsdata_file: ifsdata_12209599
climate_data_file: clim_data_12209599
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc/slots/24/ic_ancil_12209599.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/24/ic_ancil_12209599.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_1398d613559245ad1f8ee418811e98c7 to: /var/lib/boinc/slots/24/ifsdata/ifsdata_12209599.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/24/ifsdata/ifsdata_12209599.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/24/159l_2/clim_data_12209599.zip
Unzipping the climate data zip file: /var/lib/boinc/slots/24/159l_2/clim_data_12209599.zip
Checking for progress XML file: /var/lib/boinc/slots/24/progress_file_12209599.xml
Opened progress file ok : /var/lib/boinc/slots/24/progress_file_12209599.xml
-- Model is restarting --
Adjusting last_iter, 1152, to previous model restart step.
Creating progress file: /var/lib/boinc/slots/24/progress_file_12209599.xml
last_cpu_time: 76494
upload_file_number: 11
last_iter: 1153
last_upload: 950400
model_completed: 0
total_length_of_simulation: 1296000
result_base_name: oifs_43r3_bl_a264_2016092300_15_991_12209599_0_r1407154274
The child process has been launched with process id: 4884
Executing the command: /var/lib/boinc/slots/24/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:112521:1676456721:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2091] fp = 0x30e4a00
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:112521:1676456721:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:112521:1676456721:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:112521:1676456721:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:112521:1676456721:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:112521:1676456721:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:112521:1676456721:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:112521:1676456721:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:112521:1676456721:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:112521:1676456721:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:112521:1676456721:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:112521:1676456721:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:112521:1676456721:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:112521:1676456721:0.000] [ignore_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:112521:1676456721:0.000] [restore_default_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:112521:1676456721:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:112521:1676456721:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f520 (old at (nil))
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:112521:1676456721:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:112521:1676456721:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f520 (old at (nil))
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:112521:1676456721:0.000] [trapfpe_treatment@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:112521:1676456721:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:112521:1676456721:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:112521:1676456721:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f520 (old at (nil))
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:112521:1676456721:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:112521:1676456721:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:112521:1676456721:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:112521:1676456721:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f520 (old at (nil))
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:112521:1676456721:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f520 (old at (nil))
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:112521:1676456721:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f520 (old at (nil))
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:112521:1676456721:0.000] [catch_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMUAh7zg+001140
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a264_2016092300_15_991_12209599_0_r1407154274_11.zip
Uploading the intermediate file: upload_file_11.zip
11:26:00 STEP 1152 H= 288:00 +CPU= 29.151
Moving to projects directory: /var/lib/boinc/slots/24/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc/slots/24/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc/slots/24/ICMUAh7zg+001152
11:26:32 STEP 1153 H= 288:15 +CPU= 31.331
11:27:06 STEP 1154 H= 288:30 +CPU= 33.005
11:27:35 STEP 1155 H= 288:45 +CPU= 29.171
11:28:07 STEP 1156 H= 289:00 +CPU= 31.947
11:29:15 STEP 1157 H= 289:15 +CPU= 61.901
11:30:38 STEP 1158 H= 289:30 +CPU= 70.710
11:32:00 STEP 1159 H= 289:45 +CPU= 69.235
11:33:20 STEP 1160 H= 290:00 +CPU= 70.334
11:34:40 STEP 1161 H= 290:15 +CPU= 67.185
11:35:56 STEP 1162 H= 290:30 +CPU= 70.845
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:113634:1676457394:673.097] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1538] Received signal#15 (SIGTERM) :: 4032MB (heap), 4850MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:113634:1676457394:673.121] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:113634:1676457394:673.121] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x81f0c0 (old at (nil))
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:113634:1676457394:673.121] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1617] Signal#15 was caused by unrecognized si_code [memaddr=0x1], nsigs = 1
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:113634:1676457394:673.121] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#15, nsigs = 1
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:113634:1676457394:673.121] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3843] 4032 MB (maxheap), 4850 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:113634:1676457394:673.121] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : MASTER
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:113634:1676457394:673.121] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : CNT0
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:113634:1676457394:673.121] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : CNT1
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:113634:1676457394:673.121] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : CNT2
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:113634:1676457394:673.121] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : CNT3
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:113634:1676457394:673.121] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : CNT4
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:113634:1676457394:673.121] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : STEPO
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:113634:1676457394:673.121] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : SCAN2M
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:113634:1676457394:673.121] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : GP_MODEL_HEAP
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:113634:1676457394:673.121] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : GP_MODEL
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:113634:1676457394:673.121] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : EC_PHYS_DRV
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:113634:1676457394:673.121] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : >OMP-PHYSICS (1001)
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:113634:1676457394:673.121] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : EC_PHYS
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:113634:1676457394:673.121] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : CALLPAR
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:113634:1676457394:673.121] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : CLOUD_LAYER
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:113634:1676457394:673.121] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] : CLOUDSC
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:113635:1676457395:674.123] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#15, nsigs = 1
[EC_DRHOOK:antares:1:1:4884:4884] [20230215:113635:1676457395:674.123] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x401140 for signal#15, nsigs = 1
forrtl: error (78): process killed (SIGTERM)
Image PC Routine Line Source
oifs_43r3_model.e 000000000081FCF1 Unknown Unknown Unknown
oifs_43r3_model.e 0000000001D8BB20 Unknown Unknown Unknown
oifs_43r3_model.e 00000000011E7324 cloudsc_ 1083 cloudsc.F90
oifs_43r3_model.e 00000000011D9EE7 cloud_layer_ 131 cloud_layer.F90
oifs_43r3_model.e 000000000116955B callpar_ 1011 callpar.F90
oifs_43r3_model.e 00000000010B682F ec_phys_ 670 ec_phys.F90
oifs_43r3_model.e 00000000010A915C ec_phys_drv_ 599 ec_phys_drv.F90
oifs_43r3_model.e 0000000000E680C3 gp_model_ 613 gp_model.F90
oifs_43r3_model.e 00000000015C1E62 gp_model_heap_ 74 gp_model_heap.F90
oifs_43r3_model.e 00000000015AC40E scan2m_ 535 scan2m.F90
oifs_43r3_model.e 00000000006620B4 stepo_ 327 stepo.F90
oifs_43r3_model.e 00000000004A0E7C cnt4_ 1133 cnt4.F90
oifs_43r3_model.e 000000000049DC29 cnt3_ 267 cnt3.F90
oifs_43r3_model.e 000000000049CE72 cnt2_ 88 cnt2.F90
oifs_43r3_model.e 000000000049CD68 cnt1_ 92 cnt1.F90
oifs_43r3_model.e 00000000004078AD cnt0_ 146 cnt0.F90
oifs_43r3_model.e 000000000040276F MAIN__ 96 master.F90
oifs_43r3_model.e 000000000040270D Unknown Unknown Unknown
oifs_43r3_model.e 0000000001D8287A Unknown Unknown Unknown
oifs_43r3_model.e 0000000001D840D7 Unknown Unknown Unknown
oifs_43r3_model.e 00000000004025E5 Unknown Unknown Unknown
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.11_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a264
(argv4) batchid: 991
(argv5) wuid: 12209599
(argv6) fclen: 15
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/24
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.11
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/24/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/24/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_39824f94fb5b1cff1f31fd0c7183ce8a to: /var/lib/boinc/slots/24/oifs_43r3_bl_a264_2016092300_15_991_12209599.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/24/oifs_43r3_bl_a264_2016092300_15_991_12209599.zip
ic_ancil_file: ic_ancil_12209599
ifsdata_file: ifsdata_12209599
climate_data_file: clim_data_12209599
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc/slots/24/ic_ancil_12209599.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/24/ic_ancil_12209599.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_1398d613559245ad1f8ee418811e98c7 to: /var/lib/boinc/slots/24/ifsdata/ifsdata_12209599.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/24/ifsdata/ifsdata_12209599.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/24/159l_2/clim_data_12209599.zip
Unzipping the climate data zip file: /var/lib/boinc/slots/24/159l_2/clim_data_12209599.zip
Checking for progress XML file: /var/lib/boinc/slots/24/progress_file_12209599.xml
Opened progress file ok : /var/lib/boinc/slots/24/progress_file_12209599.xml
-- Model is restarting --
Adjusting last_iter, 1163, to previous model restart step.
Creating progress file: /var/lib/boinc/slots/24/progress_file_12209599.xml
last_cpu_time: 77097
upload_file_number: 12
last_iter: 1153
last_upload: 1037700
model_completed: 0
total_length_of_simulation: 1296000
result_base_name: oifs_43r3_bl_a264_2016092300_15_991_12209599_0_r1407154274
The child process has been launched with process id: 8770
Executing the command: /var/lib/boinc/slots/24/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:antares:1:1:8770:8770] [20230215:113907:1676457547:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2091] fp = 0x30e4a00
[EC_DRHOOK:antares:1:1:8770:8770] [20230215:113907:1676457547:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:antares:1:1:8770:8770] [20230215:113907:1676457547:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:antares:1:1:8770:8770] [20230215:113907:1676457547:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:antares:1:1:8770:8770] [20230215:113907:1676457547:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:antares:1:1:8770:8770] [20230215:113907:1676457547:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:antares:1:1:8770:8770] [20230215:113907:1676457547:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:antares:1:1:8770:8770] [20230215:113907:1676457547:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:antares:1:1:8770:8770] [20230215:113907:1676457547:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:antares:1:1:8770:8770] [20230215:113907:1676457547:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:antares:1:1:8770:8770] [20230215:113907:1676457547:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:antares:1:1:8770:8770] [20230215:113907:1676457547:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:antares:1:1:8770:8770] [20230215:113907:1676457547:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:antares:1:1:8770:8770] [20230215:113907:1676457547:0.000] [ignore_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:antares:1:1:8770:8770] [20230215:113907:1676457547:0.000] [restore_default_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:antares:1:1:8770:8770] [20230215:113907:1676457547:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:antares:1:1:8770:8770] [20230215:113907:1676457547:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f520 (old at (nil))
[EC_DRHOOK:antares:1:1:8770:8770] [20230215:113907:1676457547:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:antares:1:1:8770:8770] [20230215:113907:1676457547:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f520 (old at (nil))
[EC_DRHOOK:antares:1:1:8770:8770] [20230215:113907:1676457547:0.000] [trapfpe_treatment@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:antares:1:1:8770:8770] [20230215:113907:1676457547:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:antares:1:1:8770:8770] [20230215:113907:1676457547:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:antares:1:1:8770:8770] [20230215:113907:1676457547:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f520 (old at (nil))
[EC_DRHOOK:antares:1:1:8770:8770] [20230215:113907:1676457547:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:antares:1:1:8770:8770] [20230215:113907:1676457547:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:antares:1:1:8770:8770] [20230215:113907:1676457547:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:antares:1:1:8770:8770] [20230215:113907:1676457547:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f520 (old at (nil))
[EC_DRHOOK:antares:1:1:8770:8770] [20230215:113907:1676457547:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f520 (old at (nil))
[EC_DRHOOK:antares:1:1:8770:8770] [20230215:113907:1676457547:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f520 (old at (nil))
[EC_DRHOOK:antares:1:1:8770:8770] [20230215:113907:1676457547:0.000] [catch_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:40:24 STEP 1152 H= 288:00 +CPU= 44.998
11:40:56 STEP 1153 H= 288:15 +CPU= 30.412
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:42:09 STEP 1154 H= 288:30 +CPU= 49.655
11:43:09 STEP 1155 H= 288:45 +CPU= 56.805
11:44:08 STEP 1156 H= 289:00 +CPU= 54.943
11:44:59 STEP 1157 H= 289:15 +CPU= 48.844
11:45:54 STEP 1158 H= 289:30 +CPU= 53.641
11:46:51 STEP 1159 H= 289:45 +CPU= 55.035
11:47:41 STEP 1160 H= 290:00 +CPU= 49.583
11:48:32 STEP 1161 H= 290:15 +CPU= 49.928
11:49:34 STEP 1162 H= 290:30 +CPU= 58.902
11:50:26 STEP 1163 H= 290:45 +CPU= 50.721
11:51:30 STEP 1164 H= 291:00 +CPU= 60.727
Moving to projects directory: /var/lib/boinc/slots/24/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc/slots/24/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc/slots/24/ICMUAh7zg+001164
11:52:22 STEP 1165 H= 291:15 +CPU= 51.116
11:53:20 STEP 1166 H= 291:30 +CPU= 56.303
11:54:14 STEP 1167 H= 291:45 +CPU= 53.094
11:55:10 STEP 1168 H= 292:00 +CPU= 54.197
11:56:07 STEP 1169 H= 292:15 +CPU= 55.869
11:57:03 STEP 1170 H= 292:30 +CPU= 54.933
11:58:00 STEP 1171 H= 292:45 +CPU= 55.225
11:59:00 STEP 1172 H= 293:00 +CPU= 59.240
11:59:57 STEP 1173 H= 293:15 +CPU= 55.831
12:00:49 STEP 1174 H= 293:30 +CPU= 50.136
12:01:42 STEP 1175 H= 293:45 +CPU= 52.691
12:02:52 STEP 1176 H= 294:00 +CPU= 68.164
Moving to projects directory: /var/lib/boinc/slots/24/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc/slots/24/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc/slots/24/ICMUAh7zg+001176
12:03:50 STEP 1177 H= 294:15 +CPU= 56.804
12:04:45 STEP 1178 H= 294:30 +CPU= 54.030
12:05:40 STEP 1179 H= 294:45 +CPU= 53.204
12:06:35 STEP 1180 H= 295:00 +CPU= 54.100
12:07:29 STEP 1181 H= 295:15 +CPU= 52.449
12:08:25 STEP 1182 H= 295:30 +CPU= 54.506
12:09:19 STEP 1183 H= 295:45 +CPU= 53.483
12:10:13 STEP 1184 H= 296:00 +CPU= 53.084
12:11:09 STEP 1185 H= 296:15 +CPU= 54.498
12:12:04 STEP 1186 H= 296:30 +CPU= 54.031
12:12:58 STEP 1187 H= 296:45 +CPU= 52.908
12:14:04 STEP 1188 H= 297:00 +CPU= 63.581
Moving to projects directory: /var/lib/boinc/slots/24/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc/slots/24/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc/slots/24/ICMUAh7zg+001188
12:14:59 STEP 1189 H= 297:15 +CPU= 54.631
12:15:54 STEP 1190 H= 297:30 +CPU= 53.398
12:16:51 STEP 1191 H= 297:45 +CPU= 55.576
12:17:49 STEP 1192 H= 298:00 +CPU= 56.354
12:18:45 STEP 1193 H= 298:15 +CPU= 54.804
12:19:42 STEP 1194 H= 298:30 +CPU= 55.717
12:20:37 STEP 1195 H= 298:45 +CPU= 54.126
12:21:34 STEP 1196 H= 299:00 +CPU= 54.745
12:22:29 STEP 1197 H= 299:15 +CPU= 53.315
12:23:22 STEP 1198 H= 299:30 +CPU= 51.775
12:24:18 STEP 1199 H= 299:45 +CPU= 54.053
12:25:35 STEP 1200 H= 300:00 +CPU= 74.460
Moving to projects directory: /var/lib/boinc/slots/24/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc/slots/24/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc/slots/24/ICMUAh7zg+001200
12:26:36 STEP 1201 H= 300:15 +CPU= 57.875
12:27:34 STEP 1202 H= 300:30 +CPU= 55.579
12:28:36 STEP 1203 H= 300:45 +CPU= 58.403
12:29:34 STEP 1204 H= 301:00 +CPU= 55.668
12:30:33 STEP 1205 H= 301:15 +CPU= 56.933
12:31:30 STEP 1206 H= 301:30 +CPU= 55.612
12:32:33 STEP 1207 H= 301:45 +CPU= 60.197
12:33:32 STEP 1208 H= 302:00 +CPU= 56.510
12:34:28 STEP 1209 H= 302:15 +CPU= 53.393
12:35:25 STEP 1210 H= 302:30 +CPU= 54.761
12:36:19 STEP 1211 H= 302:45 +CPU= 51.400
12:37:30 STEP 1212 H= 303:00 +CPU= 68.114
Moving to projects directory: /var/lib/boinc/slots/24/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc/slots/24/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc/slots/24/ICMUAh7zg+001212
12:38:23 STEP 1213 H= 303:15 +CPU= 50.638
12:39:17 STEP 1214 H= 303:30 +CPU= 52.645
12:40:15 STEP 1215 H= 303:45 +CPU= 55.995
12:41:12 STEP 1216 H= 304:00 +CPU= 55.115
12:42:12 STEP 1217 H= 304:15 +CPU= 58.240
12:43:12 STEP 1218 H= 304:30 +CPU= 57.998
12:44:22 STEP 1219 H= 304:45 +CPU= 66.948
12:45:34 STEP 1220 H= 305:00 +CPU= 69.333
12:46:46 STEP 1221 H= 305:15 +CPU= 68.727
12:47:59 STEP 1222 H= 305:30 +CPU= 70.234
12:49:09 STEP 1223 H= 305:45 +CPU= 67.405
12:50:38 STEP 1224 H= 306:00 +CPU= 85.067
Moving to projects directory: /var/lib/boinc/slots/24/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc/slots/24/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc/slots/24/ICMUAh7zg+001224
12:51:51 STEP 1225 H= 306:15 +CPU= 70.547
12:53:06 STEP 1226 H= 306:30 +CPU= 72.508
12:54:18 STEP 1227 H= 306:45 +CPU= 68.862
12:55:32 STEP 1228 H= 307:00 +CPU= 72.313
12:56:45 STEP 1229 H= 307:15 +CPU= 67.543
12:57:59 STEP 1230 H= 307:30 +CPU= 69.161
12:59:13 STEP 1231 H= 307:45 +CPU= 67.046
13:00:28 STEP 1232 H= 308:00 +CPU= 70.421
13:01:41 STEP 1233 H= 308:15 +CPU= 68.257
13:02:55 STEP 1234 H= 308:30 +CPU= 67.298
13:04:12 STEP 1235 H= 308:45 +CPU= 69.915
13:05:43 STEP 1236 H= 309:00 +CPU= 85.481
Moving to projects directory: /var/lib/boinc/slots/24/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc/slots/24/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc/slots/24/ICMUAh7zg+001236
13:06:56 STEP 1237 H= 309:15 +CPU= 68.581
13:08:14 STEP 1238 H= 309:30 +CPU= 72.574
13:09:29 STEP 1239 H= 309:45 +CPU= 70.442
13:10:47 STEP 1240 H= 310:00 +CPU= 73.200
13:12:00 STEP 1241 H= 310:15 +CPU= 69.068
13:13:16 STEP 1242 H= 310:30 +CPU= 70.164
13:14:32 STEP 1243 H= 310:45 +CPU= 69.781
13:15:48 STEP 1244 H= 311:00 +CPU= 68.936
13:17:08 STEP 1245 H= 311:15 +CPU= 70.840
13:18:25 STEP 1246 H= 311:30 +CPU= 67.115
13:19:43 STEP 1247 H= 311:45 +CPU= 67.531
13:21:25 STEP 1248 H= 312:00 +CPU= 89.667
Moving to projects directory: /var/lib/boinc/slots/24/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc/slots/24/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc/slots/24/ICMUAh7zg+001248
13:22:37 STEP 1249 H= 312:15 +CPU= 67.302
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMUAh7zg+001236
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMUAh7zg+001248
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a264_2016092300_15_991_12209599_0_r1407154274_12.zip
Uploading the intermediate file: upload_file_12.zip
13:23:48 STEP 1250 H= 312:30 +CPU= 64.941
13:24:59 STEP 1251 H= 312:45 +CPU= 66.170
13:26:10 STEP 1252 H= 313:00 +CPU= 67.272
13:27:20 STEP 1253 H= 313:15 +CPU= 65.713
13:28:32 STEP 1254 H= 313:30 +CPU= 67.502
13:29:42 STEP 1255 H= 313:45 +CPU= 65.265
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:31:12 STEP 1256 H= 314:00 +CPU= 65.798
13:32:22 STEP 1257 H= 314:15 +CPU= 64.514
13:41:14 STEP 1258 H= 314:30 +CPU=142.806
13:42:28 STEP 1259 H= 314:45 +CPU= 70.524
13:43:56 STEP 1260 H= 315:00 +CPU= 84.917
Moving to projects directory: /var/lib/boinc/slots/24/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc/slots/24/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc/slots/24/ICMUAh7zg+001260
13:45:11 STEP 1261 H= 315:15 +CPU= 71.767
13:46:27 STEP 1262 H= 315:30 +CPU= 73.294
13:47:38 STEP 1263 H= 315:45 +CPU= 68.701
13:48:47 STEP 1264 H= 316:00 +CPU= 66.734
13:50:02 STEP 1265 H= 316:15 +CPU= 71.541
13:51:16 STEP 1266 H= 316:30 +CPU= 71.131
13:52:29 STEP 1267 H= 316:45 +CPU= 68.821
13:53:45 STEP 1268 H= 317:00 +CPU= 72.998
13:54:53 STEP 1269 H= 317:15 +CPU= 65.502
13:56:07 STEP 1270 H= 317:30 +CPU= 71.030
13:57:17 STEP 1271 H= 317:45 +CPU= 66.672
13:58:50 STEP 1272 H= 318:00 +CPU= 88.774
Moving to projects directory: /var/lib/boinc/slots/24/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc/slots/24/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc/slots/24/ICMUAh7zg+001272
14:00:03 STEP 1273 H= 318:15 +CPU= 70.004
14:01:14 STEP 1274 H= 318:30 +CPU= 68.017
14:02:26 STEP 1275 H= 318:45 +CPU= 69.254
14:03:43 STEP 1276 H= 319:00 +CPU= 72.880
14:04:59 STEP 1277 H= 319:15 +CPU= 71.390
14:06:12 STEP 1278 H= 319:30 +CPU= 69.521
14:07:24 STEP 1279 H= 319:45 +CPU= 69.474
14:08:38 STEP 1280 H= 320:00 +CPU= 70.729
14:09:54 STEP 1281 H= 320:15 +CPU= 71.180
14:11:06 STEP 1282 H= 320:30 +CPU= 69.061
14:12:16 STEP 1283 H= 320:45 +CPU= 67.257
14:13:45 STEP 1284 H= 321:00 +CPU= 85.115
Moving to projects directory: /var/lib/boinc/slots/24/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc/slots/24/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc/slots/24/ICMUAh7zg+001284
14:15:02 STEP 1285 H= 321:15 +CPU= 72.536
14:16:12 STEP 1286 H= 321:30 +CPU= 68.393
14:17:29 STEP 1287 H= 321:45 +CPU= 72.520
14:18:40 STEP 1288 H= 322:00 +CPU= 68.591
14:19:57 STEP 1289 H= 322:15 +CPU= 72.662
14:21:09 STEP 1290 H= 322:30 +CPU= 69.011
14:22:21 STEP 1291 H= 322:45 +CPU= 68.505
14:23:34 STEP 1292 H= 323:00 +CPU= 68.623
14:24:51 STEP 1293 H= 323:15 +CPU= 72.598
14:26:04 STEP 1294 H= 323:30 +CPU= 68.508
14:27:16 STEP 1295 H= 323:45 +CPU= 68.737
14:28:49 STEP 1296 H= 324:00 +CPU= 89.471
Moving to projects directory: /var/lib/boinc/slots/24/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc/slots/24/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc/slots/24/ICMUAh7zg+001296
14:30:00 STEP 1297 H= 324:15 +CPU= 67.394
14:31:17 STEP 1298 H= 324:30 +CPU= 66.915
14:32:33 STEP 1299 H= 324:45 +CPU= 67.580
14:33:48 STEP 1300 H= 325:00 +CPU= 70.377
14:35:03 STEP 1301 H= 325:15 +CPU= 69.375
14:36:17 STEP 1302 H= 325:30 +CPU= 68.719
14:37:35 STEP 1303 H= 325:45 +CPU= 72.432
14:38:50 STEP 1304 H= 326:00 +CPU= 69.494
14:40:07 STEP 1305 H= 326:15 +CPU= 70.909
14:41:26 STEP 1306 H= 326:30 +CPU= 71.952
14:42:39 STEP 1307 H= 326:45 +CPU= 67.308
14:44:12 STEP 1308 H= 327:00 +CPU= 84.975
Moving to projects directory: /var/lib/boinc/slots/24/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc/slots/24/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc/slots/24/ICMUAh7zg+001308
14:45:28 STEP 1309 H= 327:15 +CPU= 69.695
14:46:46 STEP 1310 H= 327:30 +CPU= 69.296
14:48:05 STEP 1311 H= 327:45 +CPU= 71.068
14:49:23 STEP 1312 H= 328:00 +CPU= 70.110
14:50:41 STEP 1313 H= 328:15 +CPU= 70.334
14:51:56 STEP 1314 H= 328:30 +CPU= 68.791
14:53:03 STEP 1315 H= 328:45 +CPU= 64.691
14:54:11 STEP 1316 H= 329:00 +CPU= 65.786
14:55:19 STEP 1317 H= 329:15 +CPU= 65.664
14:56:27 STEP 1318 H= 329:30 +CPU= 64.582
14:57:34 STEP 1319 H= 329:45 +CPU= 64.545
14:58:52 STEP 1320 H= 330:00 +CPU= 74.488
Moving to projects directory: /var/lib/boinc/slots/24/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc/slots/24/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc/slots/24/ICMUAh7zg+001320
14:59:55 STEP 1321 H= 330:15 +CPU= 61.135
15:01:01 STEP 1322 H= 330:30 +CPU= 63.836
15:02:04 STEP 1323 H= 330:45 +CPU= 61.420
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:03:30 STEP 1324 H= 331:00 +CPU= 63.045
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:05:02 STEP 1325 H= 331:15 +CPU= 65.917
15:06:12 STEP 1326 H= 331:30 +CPU= 67.097
15:07:24 STEP 1327 H= 331:45 +CPU= 68.041
15:08:39 STEP 1328 H= 332:00 +CPU= 71.282
15:09:49 STEP 1329 H= 332:15 +CPU= 67.343
15:11:04 STEP 1330 H= 332:30 +CPU= 70.749
15:12:17 STEP 1331 H= 332:45 +CPU= 69.150
15:13:48 STEP 1332 H= 333:00 +CPU= 86.851
Moving to projects directory: /var/lib/boinc/slots/24/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc/slots/24/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc/slots/24/ICMUAh7zg+001332
15:15:04 STEP 1333 H= 333:15 +CPU= 71.240
15:16:15 STEP 1334 H= 333:30 +CPU= 68.332
15:17:31 STEP 1335 H= 333:45 +CPU= 71.403
15:18:47 STEP 1336 H= 334:00 +CPU= 73.744
15:20:03 STEP 1337 H= 334:15 +CPU= 70.677
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:21:35 STEP 1338 H= 334:30 +CPU= 67.581
15:22:50 STEP 1339 H= 334:45 +CPU= 73.903
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:24:15 STEP 1340 H= 335:00 +CPU= 62.412
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:25:42 STEP 1341 H= 335:15 +CPU= 64.397
15:26:45 STEP 1342 H= 335:30 +CPU= 61.621
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:28:10 STEP 1343 H= 335:45 +CPU= 62.289
15:29:35 STEP 1344 H= 336:00 +CPU= 84.204
Moving to projects directory: /var/lib/boinc/slots/24/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc/slots/24/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc/slots/24/ICMUAh7zg+001344
15:30:32 STEP 1345 H= 336:15 +CPU= 55.170
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMUAh7zg+001332
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMUAh7zg+001344
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a264_2016092300_15_991_12209599_0_r1407154274_13.zip
Uploading the intermediate file: upload_file_13.zip
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:31:50 STEP 1346 H= 336:30 +CPU= 55.157
15:32:47 STEP 1347 H= 336:45 +CPU= 55.664
15:33:42 STEP 1348 H= 337:00 +CPU= 53.353
15:34:40 STEP 1349 H= 337:15 +CPU= 57.201
15:35:37 STEP 1350 H= 337:30 +CPU= 54.981
15:36:34 STEP 1351 H= 337:45 +CPU= 54.514
15:37:33 STEP 1352 H= 338:00 +CPU= 56.353
15:38:33 STEP 1353 H= 338:15 +CPU= 56.984
15:39:37 STEP 1354 H= 338:30 +CPU= 61.501
15:40:35 STEP 1355 H= 338:45 +CPU= 55.436
15:41:46 STEP 1356 H= 339:00 +CPU= 67.682
Moving to projects directory: /var/lib/boinc/slots/24/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc/slots/24/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc/slots/24/ICMUAh7zg+001356
15:42:42 STEP 1357 H= 339:15 +CPU= 53.774
15:43:38 STEP 1358 H= 339:30 +CPU= 54.194
15:44:36 STEP 1359 H= 339:45 +CPU= 53.711
15:45:39 STEP 1360 H= 340:00 +CPU= 60.820
15:46:34 STEP 1361 H= 340:15 +CPU= 53.007
15:47:35 STEP 1362 H= 340:30 +CPU= 59.356
15:48:33 STEP 1363 H= 340:45 +CPU= 56.488
15:49:34 STEP 1364 H= 341:00 +CPU= 59.247
15:50:34 STEP 1365 H= 341:15 +CPU= 57.149
15:51:35 STEP 1366 H= 341:30 +CPU= 57.585
15:52:36 STEP 1367 H= 341:45 +CPU= 58.456
15:53:44 STEP 1368 H= 342:00 +CPU= 65.395
Moving to projects directory: /var/lib/boinc/slots/24/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc/slots/24/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc/slots/24/ICMUAh7zg+001368
15:54:41 STEP 1369 H= 342:15 +CPU= 54.857
15:55:40 STEP 1370 H= 342:30 +CPU= 57.122
15:56:35 STEP 1371 H= 342:45 +CPU= 52.563
15:57:34 STEP 1372 H= 343:00 +CPU= 55.269
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:59:12 STEP 1373 H= 343:15 +CPU= 54.317
16:00:11 STEP 1374 H= 343:30 +CPU= 56.210
16:01:09 STEP 1375 H= 343:45 +CPU= 55.874
16:02:06 STEP 1376 H= 344:00 +CPU= 55.361
16:02:58 STEP 1377 H= 344:15 +CPU= 49.836
16:04:00 STEP 1378 H= 344:30 +CPU= 59.724
16:05:02 STEP 1379 H= 344:45 +CPU= 59.221
16:06:20 STEP 1380 H= 345:00 +CPU= 74.641
Moving to projects directory: /var/lib/boinc/slots/24/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc/slots/24/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc/slots/24/ICMUAh7zg+001380
16:07:22 STEP 1381 H= 345:15 +CPU= 59.058
16:08:24 STEP 1382 H= 345:30 +CPU= 59.307
16:09:21 STEP 1383 H= 345:45 +CPU= 54.107
16:10:18 STEP 1384 H= 346:00 +CPU= 53.624
16:11:18 STEP 1385 H= 346:15 +CPU= 57.378
16:12:13 STEP 1386 H= 346:30 +CPU= 52.695
16:13:09 STEP 1387 H= 346:45 +CPU= 54.329
16:14:06 STEP 1388 H= 347:00 +CPU= 54.360
16:15:02 STEP 1389 H= 347:15 +CPU= 52.625
16:16:00 STEP 1390 H= 347:30 +CPU= 54.809
16:16:54 STEP 1391 H= 347:45 +CPU= 52.517
16:18:19 STEP 1392 H= 348:00 +CPU= 80.976
Moving to projects directory: /var/lib/boinc/slots/24/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc/slots/24/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc/slots/24/ICMUAh7zg+001392
16:19:14 STEP 1393 H= 348:15 +CPU= 53.763
16:20:13 STEP 1394 H= 348:30 +CPU= 55.863
16:21:08 STEP 1395 H= 348:45 +CPU= 53.414
16:22:09 STEP 1396 H= 349:00 +CPU= 58.367
16:23:12 STEP 1397 H= 349:15 +CPU= 60.214
16:24:15 STEP 1398 H= 349:30 +CPU= 59.871
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
16:25:32 STEP 1399 H= 349:45 +CPU= 54.007
16:26:29 STEP 1400 H= 350:00 +CPU= 56.048
16:27:30 STEP 1401 H= 350:15 +CPU= 59.718
16:28:25 STEP 1402 H= 350:30 +CPU= 52.797
16:29:21 STEP 1403 H= 350:45 +CPU= 53.546
16:30:26 STEP 1404 H= 351:00 +CPU= 63.019
Moving to projects directory: /var/lib/boinc/slots/24/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc/slots/24/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc/slots/24/ICMUAh7zg+001404
16:31:20 STEP 1405 H= 351:15 +CPU= 52.520
16:32:19 STEP 1406 H= 351:30 +CPU= 56.800
16:33:15 STEP 1407 H= 351:45 +CPU= 53.594
16:34:17 STEP 1408 H= 352:00 +CPU= 58.819
16:35:18 STEP 1409 H= 352:15 +CPU= 59.083
16:36:18 STEP 1410 H= 352:30 +CPU= 56.626
16:37:17 STEP 1411 H= 352:45 +CPU= 56.951
16:38:19 STEP 1412 H= 353:00 +CPU= 58.344
16:39:11 STEP 1413 H= 353:15 +CPU= 50.707
16:40:07 STEP 1414 H= 353:30 +CPU= 52.444
16:40:57 STEP 1415 H= 353:45 +CPU= 48.603
16:41:53 STEP 1416 H= 354:00 +CPU= 54.891
Moving to projects directory: /var/lib/boinc/slots/24/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc/slots/24/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc/slots/24/ICMUAh7zg+001416
16:42:44 STEP 1417 H= 354:15 +CPU= 49.345
16:43:22 STEP 1418 H= 354:30 +CPU= 35.904
16:43:57 STEP 1419 H= 354:45 +CPU= 33.722
16:44:41 STEP 1420 H= 355:00 +CPU= 42.615
16:45:22 STEP 1421 H= 355:15 +CPU= 39.990
16:46:11 STEP 1422 H= 355:30 +CPU= 47.738
16:46:57 STEP 1423 H= 355:45 +CPU= 45.208
16:47:49 STEP 1424 H= 356:00 +CPU= 50.109
16:48:35 STEP 1425 H= 356:15 +CPU= 44.120
16:49:16 STEP 1426 H= 356:30 +CPU= 39.523
16:50:00 STEP 1427 H= 356:45 +CPU= 42.884
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
16:51:07 STEP 1428 H= 357:00 +CPU= 45.380
Moving to projects directory: /var/lib/boinc/slots/24/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc/slots/24/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc/slots/24/ICMUAh7zg+001428
16:51:48 STEP 1429 H= 357:15 +CPU= 39.328
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
16:53:08 STEP 1430 H= 357:30 +CPU= 37.805
16:53:44 STEP 1431 H= 357:45 +CPU= 36.179
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
16:54:39 STEP 1432 H= 358:00 +CPU= 32.406
16:55:11 STEP 1433 H= 358:15 +CPU= 31.258
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
16:55:58 STEP 1434 H= 358:30 +CPU= 25.541
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
16:56:49 STEP 1435 H= 358:45 +CPU= 30.063
16:57:20 STEP 1436 H= 359:00 +CPU= 30.399
16:57:52 STEP 1437 H= 359:15 +CPU= 31.736
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
16:58:43 STEP 1438 H= 359:30 +CPU= 29.922
16:59:16 STEP 1439 H= 359:45 +CPU= 32.245
16:59:54 STEP 1440 H= 360:00 +CPU= 38.328
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01
DDH------------------------------------------------------------------------
I I
I TIME = 360.000H DDH * Diagnostic Var., AREA GLOBAL I
I I
I-------------------------------------------------------------------------I
I VARIABLE I Initial value I Current value I
I-------------------------------------------------------------------------I
I OMEGA (P/S) I -0.7291994062E-21 I 0.5658604912E-05 I
ICloud fractionI 0.0000000000E+00 I 0.2359914572E-01 I
I Relat. Hum. I 0.1195819385E+00 I 0.2715709214E+00 I
I PASS 01 I 0.0000000000E+00 I 0.5438174370E+03 I
DDH------------------------------------------------------------------------
MAXGPFV : MAX. VALUE = 0.000000000000000E+000
MAXGPFV : MAX. VALUE = 0.000000000000000E+000
NSTEP = 1440 SCAN2M_HPOS P
IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH =
ICMGGh7zg+001440 MODE=a
IO-STREAM CLOSED - ICMGGh7zg+001440
MPI-TASK: 1 - 297827041 BYTES IN 7 RECORDS TRANSFERRED IN 0.0003 SECONDS992756.8 Mbytes/s, TOTAL TIME= 0.0103( 2.9%)
16:59:54 STEP 1440 H= 360:00 +CPU= 38.328
END CNT3
NSTEP = 1440 CNT0 000000000 26.938 26.938 27.264 0.988 0 0 0 0 0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ 34/ 1069125708 WRITTEN 8508/************
-TASK-OPENED-OPEN-RECS IN -KBYTE IN -RECS OUT-KBYTE OUT-WALL -WALL IN-WALL
OU-TOT IN -TOT OUT
1 153 0 34 1044068 8508 ************ 37.0 4.1 32.9 6.9 69.3
===-=== START OF TIMING STATISTICS ===-===
STATS FOR ALL TASKS
NUM ROUTINE CALLS MEAN(ms) MAX(ms) FRAC(%) UNBAL(%)
0 CNT0 - COMPLETE EXECUTION 1 ********* ********* 100.00 0.00
1 CNT4 - FORWARD INTEGRATION 1 ********* ********* 99.84 0.00
8 SCAN2M - GRID-POINT DYNAMICS 313 13131.4 13131.4 21.35 0.00
9 SPCM - SPECTRAL COMP. 288 3056.2 3056.2 4.57 0.00
10 SCAN2M - PHYSICS 289 27126.4 27126.4 40.73 0.00
11 IOPACK - OUTPUT P.P. RESULTS 24 2200.8 2200.8 0.27 0.00
12 SPNORM - SPECTRAL NORM COMP. 13 141.4 141.4 0.01 0.00
17 GRIDFPOS IN CNT4 24 63.4 63.4 0.01 0.00
27 RESTART FILES - WRITING 6 8800.0 8800.0 0.27 0.00
28 RESTART FILES - READING 1 31140.4 31140.4 0.16 0.00
29 SU4FPOS IN CNT4 24 0.6 0.6 0.00 0.00
30 DYNFPOS IN CNT4 24 11906.0 11906.0 1.48 0.00
31 POSDDH IN STEPO 2 5.0 5.0 0.00 0.00
37 CPGLAG - SL COMPUTATIONS 289 13918.3 13918.3 20.90 0.00
39 SU0YOMB 1 301.8 301.8 0.00 0.00
51 SCAN2M - SL COMM. PART 1 289 57.3 57.3 0.09 0.00
54 SPCM - M TO S/S TO M TRANSP. 288 1435.5 1435.5 2.15 0.00
55 SPCIMPF - S TO M/M TO S TRANSP. 288 168.8 168.8 0.25 0.00
56 SPNORM - SPECTRAL NORM COMM. 13 4.9 4.9 0.00 0.00
102 LTINV_CTL - INVERSE LEGENDRE TRANSFORM 628 882.7 882.7 2.88 0.00
103 LTDIR_CTL - DIRECT LEGENDRE TRANSFORM 600 501.6 501.6 1.56 0.00
106 FTDIR_CTL - DIRECT FOURIER TRANSFORM 600 182.6 182.6 0.57 0.00
107 FTINV_CTL - INVERSE FOURIER TRANSFORM 628 261.5 261.5 0.85 0.00
140 SULEG - COMP. OF LEGENDRE POL. 1 22.9 22.9 0.00 0.00
152 LTINV_CTL - M TO L TRANSPOSITION 628 204.2 204.2 0.67 0.00
153 LTDIR_CTL - L TO M TRANSPOSITION 600 120.5 120.5 0.38 0.00
157 FTINV_CTL - L TO G TRANSPOSITION 628 209.5 209.5 0.68 0.00
158 FTDIR_CTL - G TO L TRANSPOSITION 600 106.8 106.8 0.33 0.00
400 GSTATS 34304 0.0 0.0 0.00 0.00
401 GSTATS HOOK 31868 0.0 0.0 0.00 0.00
TOTAL MEASURED IMBALANCE = 0.0 SECONDS, 0.0 PERCENT
TOTAL WALLCLOCK TIME 19247.9 CPU TIME 17593.5 VECTOR TIME 17593.5
===-=== END OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY 67.4
*** END CNT0 ***
------------------------------------------------
Moving to projects directory: /var/lib/boinc/slots/24/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc/slots/24/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc/slots/24/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc/slots/24/NODE.001_01
Adding to the zip: /var/lib/boinc/slots/24/ifs.stat
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12209599/ICMUAh7zg+001440
Zipping up the final file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a264_2016092300_15_991_12209599_0_r1407154274_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
17:03:22 (8729): called boinc_finish(0)
</stderr_txt>
]]>
