<core_client_version>8.0.2</core_client_version>
<![CDATA[
<stderr_txt>
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMUAh7zg+001704
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMGGh7zg+001716
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMSHh7zg+001716
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMUAh7zg+001716
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMGGh7zg+001728
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMSHh7zg+001728
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMUAh7zg+001728
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a292_2016092300_20_1018_12291245_1_r1871567991_17.zip
Uploading the intermediate file: upload_file_17.zip
13:16:57 STEP 1730 H= 432:30 +CPU= 16.809
13:17:14 STEP 1731 H= 432:45 +CPU= 16.782
13:17:33 STEP 1732 H= 433:00 +CPU= 17.703
13:17:52 STEP 1733 H= 433:15 +CPU= 17.105
13:18:10 STEP 1734 H= 433:30 +CPU= 17.007
13:18:28 STEP 1735 H= 433:45 +CPU= 17.170
13:18:47 STEP 1736 H= 434:00 +CPU= 17.731
13:19:05 STEP 1737 H= 434:15 +CPU= 17.141
13:19:23 STEP 1738 H= 434:30 +CPU= 17.193
13:19:42 STEP 1739 H= 434:45 +CPU= 17.094
13:20:05 STEP 1740 H= 435:00 +CPU= 21.903
Moving to projects directory: /var/lib/boinc/slots/16/ICMGGh7zg+001740
Moving to projects directory: /var/lib/boinc/slots/16/ICMSHh7zg+001740
Moving to projects directory: /var/lib/boinc/slots/16/ICMUAh7zg+001740
13:20:23 STEP 1741 H= 435:15 +CPU= 16.964
13:20:41 STEP 1742 H= 435:30 +CPU= 17.058
13:20:59 STEP 1743 H= 435:45 +CPU= 17.295
13:21:18 STEP 1744 H= 436:00 +CPU= 17.337
13:21:36 STEP 1745 H= 436:15 +CPU= 17.094
13:21:54 STEP 1746 H= 436:30 +CPU= 17.011
13:22:12 STEP 1747 H= 436:45 +CPU= 16.954
13:22:30 STEP 1748 H= 437:00 +CPU= 17.697
13:22:50 STEP 1749 H= 437:15 +CPU= 17.448
13:23:08 STEP 1750 H= 437:30 +CPU= 16.976
13:23:26 STEP 1751 H= 437:45 +CPU= 16.879
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:24:10 STEP 1752 H= 438:00 +CPU= 21.898
Moving to projects directory: /var/lib/boinc/slots/16/ICMGGh7zg+001752
Moving to projects directory: /var/lib/boinc/slots/16/ICMSHh7zg+001752
Moving to projects directory: /var/lib/boinc/slots/16/ICMUAh7zg+001752
13:24:31 STEP 1753 H= 438:15 +CPU= 18.808
13:24:51 STEP 1754 H= 438:30 +CPU= 19.125
13:25:10 STEP 1755 H= 438:45 +CPU= 18.095
13:25:30 STEP 1756 H= 439:00 +CPU= 18.389
13:25:49 STEP 1757 H= 439:15 +CPU= 17.737
13:26:07 STEP 1758 H= 439:30 +CPU= 17.569
13:26:26 STEP 1759 H= 439:45 +CPU= 18.134
13:26:45 STEP 1760 H= 440:00 +CPU= 17.581
13:27:03 STEP 1761 H= 440:15 +CPU= 16.838
13:27:20 STEP 1762 H= 440:30 +CPU= 16.861
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:28:00 STEP 1763 H= 440:45 +CPU= 17.712
13:28:24 STEP 1764 H= 441:00 +CPU= 23.019
Moving to projects directory: /var/lib/boinc/slots/16/ICMGGh7zg+001764
Moving to projects directory: /var/lib/boinc/slots/16/ICMSHh7zg+001764
Moving to projects directory: /var/lib/boinc/slots/16/ICMUAh7zg+001764
13:28:44 STEP 1765 H= 441:15 +CPU= 18.162
13:29:02 STEP 1766 H= 441:30 +CPU= 17.750
13:29:20 STEP 1767 H= 441:45 +CPU= 17.308
13:29:39 STEP 1768 H= 442:00 +CPU= 17.823
13:29:57 STEP 1769 H= 442:15 +CPU= 17.142
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:30:57 STEP 1770 H= 442:30 +CPU= 16.781
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a292
(argv4) batchid: 1018
(argv5) wuid: 12291245
(argv6) fclen: 20
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/16
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.13
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/16/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/16/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_fa0da6e7ed1138d0df65bc66867e5123 to: /var/lib/boinc/slots/16/oifs_43r3_bl_a292_2016092300_20_1018_12291245.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/16/oifs_43r3_bl_a292_2016092300_20_1018_12291245.zip
ic_ancil_file: ic_ancil_12291245
ifsdata_file: ifsdata_12291245
climate_data_file: clim_data_12291245
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc/slots/16/ic_ancil_12291245.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/16/ic_ancil_12291245.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_9c224d3481a74235bef68e883eabdefd to: /var/lib/boinc/slots/16/ifsdata/ifsdata_12291245.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/16/ifsdata/ifsdata_12291245.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/16/159l_2/clim_data_12291245.zip
Unzipping the climate data zip file: /var/lib/boinc/slots/16/159l_2/clim_data_12291245.zip
Checking for progress XML file: /var/lib/boinc/slots/16/progress_file_12291245.xml
Opened progress file ok : /var/lib/boinc/slots/16/progress_file_12291245.xml
-- Model is restarting --
Adjusting last_iter, 1771, to previous model restart step.
Creating progress file: /var/lib/boinc/slots/16/progress_file_12291245.xml
last_cpu_time: 38896
upload_file_number: 18
last_iter: 1729
last_upload: 1556100
model_completed: 0
total_length_of_simulation: 1728000
result_base_name: oifs_43r3_bl_a292_2016092300_20_1018_12291245_1_r1871567991
The child process has been launched with process id: 31264
Executing the command: /var/lib/boinc/slots/16/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:etam-komp:1:1:31264:31264] [20240614:133206:1718364726:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440
[EC_DRHOOK:etam-komp:1:1:31264:31264] [20240614:133206:1718364726:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:etam-komp:1:1:31264:31264] [20240614:133206:1718364726:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:etam-komp:1:1:31264:31264] [20240614:133206:1718364726:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:etam-komp:1:1:31264:31264] [20240614:133206:1718364726:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:etam-komp:1:1:31264:31264] [20240614:133206:1718364726:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:etam-komp:1:1:31264:31264] [20240614:133206:1718364726:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:etam-komp:1:1:31264:31264] [20240614:133206:1718364726:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:etam-komp:1:1:31264:31264] [20240614:133206:1718364726:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:etam-komp:1:1:31264:31264] [20240614:133206:1718364726:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:etam-komp:1:1:31264:31264] [20240614:133206:1718364726:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:etam-komp:1:1:31264:31264] [20240614:133206:1718364726:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:etam-komp:1:1:31264:31264] [20240614:133206:1718364726:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:etam-komp:1:1:31264:31264] [20240614:133206:1718364726:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:etam-komp:1:1:31264:31264] [20240614:133206:1718364726:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:etam-komp:1:1:31264:31264] [20240614:133206:1718364726:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:etam-komp:1:1:31264:31264] [20240614:133206:1718364726:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:etam-komp:1:1:31264:31264] [20240614:133206:1718364726:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:etam-komp:1:1:31264:31264] [20240614:133206:1718364726:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:etam-komp:1:1:31264:31264] [20240614:133206:1718364726:0.000] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:etam-komp:1:1:31264:31264] [20240614:133206:1718364726:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:etam-komp:1:1:31264:31264] [20240614:133206:1718364726:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:etam-komp:1:1:31264:31264] [20240614:133206:1718364726:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:etam-komp:1:1:31264:31264] [20240614:133206:1718364726:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:etam-komp:1:1:31264:31264] [20240614:133206:1718364726:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:etam-komp:1:1:31264:31264] [20240614:133206:1718364726:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:etam-komp:1:1:31264:31264] [20240614:133206:1718364726:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:etam-komp:1:1:31264:31264] [20240614:133206:1718364726:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:etam-komp:1:1:31264:31264] [20240614:133206:1718364726:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:etam-komp:1:1:31264:31264] [20240614:133206:1718364726:0.000] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:33:13 STEP 1728 H= 432:00 +CPU= 19.163
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:33:53 STEP 1729 H= 432:15 +CPU= 18.779
13:34:13 STEP 1730 H= 432:30 +CPU= 18.421
13:34:32 STEP 1731 H= 432:45 +CPU= 18.488
13:34:52 STEP 1732 H= 433:00 +CPU= 19.524
13:35:12 STEP 1733 H= 433:15 +CPU= 18.529
13:35:32 STEP 1734 H= 433:30 +CPU= 18.723
13:35:52 STEP 1735 H= 433:45 +CPU= 18.968
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:36:52 STEP 1736 H= 434:00 +CPU= 17.681
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:37:30 STEP 1737 H= 434:15 +CPU= 16.445
13:37:47 STEP 1738 H= 434:30 +CPU= 16.567
13:38:04 STEP 1739 H= 434:45 +CPU= 16.955
13:38:25 STEP 1740 H= 435:00 +CPU= 20.751
Moving to projects directory: /var/lib/boinc/slots/16/ICMGGh7zg+001740
Moving to projects directory: /var/lib/boinc/slots/16/ICMSHh7zg+001740
Moving to projects directory: /var/lib/boinc/slots/16/ICMUAh7zg+001740
13:38:42 STEP 1741 H= 435:15 +CPU= 16.650
13:39:01 STEP 1742 H= 435:30 +CPU= 18.048
13:39:19 STEP 1743 H= 435:45 +CPU= 17.590
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:39:58 STEP 1744 H= 436:00 +CPU= 17.394
13:40:15 STEP 1745 H= 436:15 +CPU= 16.614
13:40:32 STEP 1746 H= 436:30 +CPU= 16.880
13:40:50 STEP 1747 H= 436:45 +CPU= 17.374
13:41:08 STEP 1748 H= 437:00 +CPU= 18.122
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:41:47 STEP 1749 H= 437:15 +CPU= 17.438
13:42:05 STEP 1750 H= 437:30 +CPU= 17.698
13:42:24 STEP 1751 H= 437:45 +CPU= 18.109
13:42:47 STEP 1752 H= 438:00 +CPU= 22.243
Moving to projects directory: /var/lib/boinc/slots/16/ICMGGh7zg+001752
Moving to projects directory: /var/lib/boinc/slots/16/ICMSHh7zg+001752
Moving to projects directory: /var/lib/boinc/slots/16/ICMUAh7zg+001752
13:43:06 STEP 1753 H= 438:15 +CPU= 18.510
13:43:26 STEP 1754 H= 438:30 +CPU= 18.957
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:44:04 STEP 1755 H= 438:45 +CPU= 17.090
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:44:44 STEP 1756 H= 439:00 +CPU= 17.845
13:45:03 STEP 1757 H= 439:15 +CPU= 18.785
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:45:43 STEP 1758 H= 439:30 +CPU= 18.063
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:46:20 STEP 1759 H= 439:45 +CPU= 15.866
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:46:59 STEP 1760 H= 440:00 +CPU= 17.207
13:47:17 STEP 1761 H= 440:15 +CPU= 17.373
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:47:55 STEP 1762 H= 440:30 +CPU= 16.170
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:48:34 STEP 1763 H= 440:45 +CPU= 16.948
13:48:56 STEP 1764 H= 441:00 +CPU= 21.622
Moving to projects directory: /var/lib/boinc/slots/16/ICMGGh7zg+001764
Moving to projects directory: /var/lib/boinc/slots/16/ICMSHh7zg+001764
Moving to projects directory: /var/lib/boinc/slots/16/ICMUAh7zg+001764
13:49:13 STEP 1765 H= 441:15 +CPU= 16.543
13:49:31 STEP 1766 H= 441:30 +CPU= 17.232
13:49:50 STEP 1767 H= 441:45 +CPU= 18.142
13:50:10 STEP 1768 H= 442:00 +CPU= 19.359
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:51:08 STEP 1769 H= 442:15 +CPU= 16.015
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:51:46 STEP 1770 H= 442:30 +CPU= 15.288
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:52:22 STEP 1771 H= 442:45 +CPU= 14.842
13:52:38 STEP 1772 H= 443:00 +CPU= 16.618
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:53:16 STEP 1773 H= 443:15 +CPU= 16.594
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:53:55 STEP 1774 H= 443:30 +CPU= 17.379
13:54:17 STEP 1775 H= 443:45 +CPU= 20.331
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:55:04 STEP 1776 H= 444:00 +CPU= 25.654
Moving to projects directory: /var/lib/boinc/slots/16/ICMGGh7zg+001776
Moving to projects directory: /var/lib/boinc/slots/16/ICMSHh7zg+001776
Moving to projects directory: /var/lib/boinc/slots/16/ICMUAh7zg+001776
13:55:23 STEP 1777 H= 444:15 +CPU= 18.017
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:56:02 STEP 1778 H= 444:30 +CPU= 17.029
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:56:40 STEP 1779 H= 444:45 +CPU= 17.480
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:57:39 STEP 1780 H= 445:00 +CPU= 15.949
13:57:55 STEP 1781 H= 445:15 +CPU= 15.973
13:58:12 STEP 1782 H= 445:30 +CPU= 16.743
13:58:29 STEP 1783 H= 445:45 +CPU= 16.506
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
13:59:06 STEP 1784 H= 446:00 +CPU= 16.623
13:59:23 STEP 1785 H= 446:15 +CPU= 16.037
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:00:00 STEP 1786 H= 446:30 +CPU= 15.874
14:00:18 STEP 1787 H= 446:45 +CPU= 17.485
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:01:03 STEP 1788 H= 447:00 +CPU= 23.013
Moving to projects directory: /var/lib/boinc/slots/16/ICMGGh7zg+001788
Moving to projects directory: /var/lib/boinc/slots/16/ICMSHh7zg+001788
Moving to projects directory: /var/lib/boinc/slots/16/ICMUAh7zg+001788
14:01:20 STEP 1789 H= 447:15 +CPU= 16.693
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:01:58 STEP 1790 H= 447:30 +CPU= 16.945
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:02:37 STEP 1791 H= 447:45 +CPU= 17.735
14:02:56 STEP 1792 H= 448:00 +CPU= 19.016
14:03:14 STEP 1793 H= 448:15 +CPU= 17.548
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:03:52 STEP 1794 H= 448:30 +CPU= 16.247
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:04:32 STEP 1795 H= 448:45 +CPU= 18.298
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:05:14 STEP 1796 H= 449:00 +CPU= 19.597
14:05:35 STEP 1797 H= 449:15 +CPU= 19.261
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:06:16 STEP 1798 H= 449:30 +CPU= 19.703
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:07:17 STEP 1799 H= 449:45 +CPU= 17.854
14:07:38 STEP 1800 H= 450:00 +CPU= 20.463
Moving to projects directory: /var/lib/boinc/slots/16/ICMGGh7zg+001800
Moving to projects directory: /var/lib/boinc/slots/16/ICMSHh7zg+001800
Moving to projects directory: /var/lib/boinc/slots/16/ICMUAh7zg+001800
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:08:15 STEP 1801 H= 450:15 +CPU= 15.816
14:08:31 STEP 1802 H= 450:30 +CPU= 16.219
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:09:09 STEP 1803 H= 450:45 +CPU= 16.092
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:10:07 STEP 1804 H= 451:00 +CPU= 15.722
14:10:22 STEP 1805 H= 451:15 +CPU= 15.606
14:10:38 STEP 1806 H= 451:30 +CPU= 15.404
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:11:15 STEP 1807 H= 451:45 +CPU= 15.474
14:11:32 STEP 1808 H= 452:00 +CPU= 16.974
14:11:49 STEP 1809 H= 452:15 +CPU= 16.425
14:12:04 STEP 1810 H= 452:30 +CPU= 15.538
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:12:44 STEP 1811 H= 452:45 +CPU= 18.088
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:13:51 STEP 1812 H= 453:00 +CPU= 24.266
Moving to projects directory: /var/lib/boinc/slots/16/ICMGGh7zg+001812
Moving to projects directory: /var/lib/boinc/slots/16/ICMSHh7zg+001812
Moving to projects directory: /var/lib/boinc/slots/16/ICMUAh7zg+001812
14:14:11 STEP 1813 H= 453:15 +CPU= 18.857
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:15:09 STEP 1814 H= 453:30 +CPU= 15.990
14:15:27 STEP 1815 H= 453:45 +CPU= 17.408
14:15:45 STEP 1816 H= 454:00 +CPU= 17.943
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:16:45 STEP 1817 H= 454:15 +CPU= 16.571
14:17:04 STEP 1818 H= 454:30 +CPU= 18.483
14:17:23 STEP 1819 H= 454:45 +CPU= 18.560
14:17:43 STEP 1820 H= 455:00 +CPU= 19.492
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:18:26 STEP 1821 H= 455:15 +CPU= 20.375
14:18:48 STEP 1822 H= 455:30 +CPU= 20.351
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:19:29 STEP 1823 H= 455:45 +CPU= 19.672
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:20:56 STEP 1824 H= 456:00 +CPU= 23.276
Moving to projects directory: /var/lib/boinc/slots/16/ICMGGh7zg+001824
Moving to projects directory: /var/lib/boinc/slots/16/ICMSHh7zg+001824
Moving to projects directory: /var/lib/boinc/slots/16/ICMUAh7zg+001824
14:21:13 STEP 1825 H= 456:15 +CPU= 16.409
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMGGh7zg+001740
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMSHh7zg+001740
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMUAh7zg+001740
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMGGh7zg+001752
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMSHh7zg+001752
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMUAh7zg+001752
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMGGh7zg+001764
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMSHh7zg+001764
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMUAh7zg+001764
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMGGh7zg+001776
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMSHh7zg+001776
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMUAh7zg+001776
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMGGh7zg+001788
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMSHh7zg+001788
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMUAh7zg+001788
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMGGh7zg+001800
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMSHh7zg+001800
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMUAh7zg+001800
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMGGh7zg+001812
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMSHh7zg+001812
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMUAh7zg+001812
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMGGh7zg+001824
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMSHh7zg+001824
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMUAh7zg+001824
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a292_2016092300_20_1018_12291245_1_r1871567991_18.zip
Uploading the intermediate file: upload_file_18.zip
14:21:27 STEP 1826 H= 456:30 +CPU= 14.307
14:21:39 STEP 1827 H= 456:45 +CPU= 11.508
14:21:54 STEP 1828 H= 457:00 +CPU= 14.853
14:22:10 STEP 1829 H= 457:15 +CPU= 15.860
14:22:26 STEP 1830 H= 457:30 +CPU= 15.971
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:23:04 STEP 1831 H= 457:45 +CPU= 16.542
14:23:22 STEP 1832 H= 458:00 +CPU= 18.159
14:23:40 STEP 1833 H= 458:15 +CPU= 17.537
14:23:58 STEP 1834 H= 458:30 +CPU= 17.505
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:24:36 STEP 1835 H= 458:45 +CPU= 17.102
14:25:00 STEP 1836 H= 459:00 +CPU= 23.121
Moving to projects directory: /var/lib/boinc/slots/16/ICMGGh7zg+001836
Moving to projects directory: /var/lib/boinc/slots/16/ICMSHh7zg+001836
Moving to projects directory: /var/lib/boinc/slots/16/ICMUAh7zg+001836
14:25:17 STEP 1837 H= 459:15 +CPU= 16.423
14:25:34 STEP 1838 H= 459:30 +CPU= 16.969
14:25:51 STEP 1839 H= 459:45 +CPU= 16.465
14:26:09 STEP 1840 H= 460:00 +CPU= 17.742
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:26:46 STEP 1841 H= 460:15 +CPU= 15.852
14:27:03 STEP 1842 H= 460:30 +CPU= 16.911
14:27:20 STEP 1843 H= 460:45 +CPU= 16.653
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:27:58 STEP 1844 H= 461:00 +CPU= 16.613
14:28:14 STEP 1845 H= 461:15 +CPU= 16.386
14:28:32 STEP 1846 H= 461:30 +CPU= 17.760
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:29:10 STEP 1847 H= 461:45 +CPU= 16.101
14:29:30 STEP 1848 H= 462:00 +CPU= 20.034
Moving to projects directory: /var/lib/boinc/slots/16/ICMGGh7zg+001848
Moving to projects directory: /var/lib/boinc/slots/16/ICMSHh7zg+001848
Moving to projects directory: /var/lib/boinc/slots/16/ICMUAh7zg+001848
14:29:47 STEP 1849 H= 462:15 +CPU= 16.288
14:30:03 STEP 1850 H= 462:30 +CPU= 16.151
14:30:19 STEP 1851 H= 462:45 +CPU= 15.958
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:30:57 STEP 1852 H= 463:00 +CPU= 16.620
14:31:14 STEP 1853 H= 463:15 +CPU= 16.857
14:31:31 STEP 1854 H= 463:30 +CPU= 16.862
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:32:29 STEP 1855 H= 463:45 +CPU= 15.733
14:32:46 STEP 1856 H= 464:00 +CPU= 16.338
14:33:02 STEP 1857 H= 464:15 +CPU= 15.545
14:33:17 STEP 1858 H= 464:30 +CPU= 15.637
14:33:33 STEP 1859 H= 464:45 +CPU= 15.577
14:33:53 STEP 1860 H= 465:00 +CPU= 19.680
Moving to projects directory: /var/lib/boinc/slots/16/ICMGGh7zg+001860
Moving to projects directory: /var/lib/boinc/slots/16/ICMSHh7zg+001860
Moving to projects directory: /var/lib/boinc/slots/16/ICMUAh7zg+001860
14:34:09 STEP 1861 H= 465:15 +CPU= 15.693
14:34:25 STEP 1862 H= 465:30 +CPU= 15.993
14:34:42 STEP 1863 H= 465:45 +CPU= 16.607
14:35:02 STEP 1864 H= 466:00 +CPU= 19.144
14:35:23 STEP 1865 H= 466:15 +CPU= 19.418
14:35:43 STEP 1866 H= 466:30 +CPU= 18.814
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:36:27 STEP 1867 H= 466:45 +CPU= 20.532
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:37:07 STEP 1868 H= 467:00 +CPU= 19.159
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:37:47 STEP 1869 H= 467:15 +CPU= 17.960
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:38:24 STEP 1870 H= 467:30 +CPU= 16.376
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:39:21 STEP 1871 H= 467:45 +CPU= 14.776
14:39:44 STEP 1872 H= 468:00 +CPU= 22.605
Moving to projects directory: /var/lib/boinc/slots/16/ICMGGh7zg+001872
Moving to projects directory: /var/lib/boinc/slots/16/ICMSHh7zg+001872
Moving to projects directory: /var/lib/boinc/slots/16/ICMUAh7zg+001872
Quit request received from BOINC client, ending the child process
>>> Printing last 70 lines from file: NODE.001_01
GPNORM ICE WATER AVERAGE MINIMUM MAXIMUM
AVE 0.596405906703570E-10 0.000000000000000E+00 0.141687287426002E-04
GPNORM SNOW AVERAGE MINIMUM MAXIMUM
AVE 0.285738551214967E-10 0.000000000000000E+00 0.115504098524959E-04
GPNORM RAIN AVERAGE MINIMUM MAXIMUM
AVE 0.318180490110824E-09 0.000000000000000E+00 0.123309418051188E-04
GPNORM CLOUD FRACTION AVERAGE MINIMUM MAXIMUM
AVE 0.109044514573258E-02 0.000000000000000E+00 0.100000000000000E+01
GPNORM CLW AVERAGE MINIMUM MAXIMUM
AVE 0.176995516104482E-06 0.000000000000000E+00 0.390904477300099E-03
GPNORM CIW AVERAGE MINIMUM MAXIMUM
AVE 0.729613364370118E-10 0.000000000000000E+00 0.279902538981586E-04
GPNORM CC AVERAGE MINIMUM MAXIMUM
AVE 0.108577902191074E-02 0.000000000000000E+00 0.100000000000000E+01
GPNORM RFL AVERAGE MINIMUM MAXIMUM
AVE 0.150475339850700E-08 0.000000000000000E+00 0.593837425466093E-04
GPNORM SFL AVERAGE MINIMUM MAXIMUM
AVE 0.332192122171923E-10 0.000000000000000E+00 0.739354328933428E-05
GPNORM CRFL AVERAGE MINIMUM MAXIMUM
AVE 0.146909639401095E-08 0.000000000000000E+00 0.138910328176722E-03
GPNORM CSFL AVERAGE MINIMUM MAXIMUM
AVE 0.672528214930096E-11 0.000000000000000E+00 0.881205252191982E-05
GPNORM PFRC AVERAGE MINIMUM MAXIMUM
AVE 0.163961649726811E-02 0.000000000000000E+00 0.100000000000000E+01
NSTEP = 1872 STEPO F00000000
CREATE RESTART FILE ./srf00191200.0001
IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH =
./srf00191200.0001 MODE=w
IO-STREAM CLOSED - ./srf00191200.0001
MPI-TASK: 1 - ************ BYTES IN 46 RECORDS TRANSFERRED IN 1.1272 SECONDS******** Mbytes/s, TOTAL TIME= 1.4198(79.4%)
CREATE RESTART CONTROL FILE ./rcf
WRRESF: DELETED PREVIOUS RESTART FILE OK: ./srf00190000.0001
MAXGPFV : MAX. VALUE = 0.000000000000000E+000
MAXGPFV : MAX. VALUE = 0.000000000000000E+000
NSTEP = 1872 SCAN2M_HPOS P
IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH =
ICMGGh7zg+001872 MODE=w
IO-STREAM CLOSED - ICMGGh7zg+001872
MPI-TASK: 1 - 573472356 BYTES IN 6 RECORDS TRANSFERRED IN 0.0003 SECONDS******** Mbytes/s, TOTAL TIME= 0.0055( 5.5%)
NSTEP = 1872 STEPO 0AA000000
IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH =
./ICMSHh7zg+001872 MODE=w
IO-STREAM CLOSED - ./ICMSHh7zg+001872
MPI-TASK: 1 - 707399250 BYTES IN 202 RECORDS TRANSFERRED IN 0.0058 SECONDS121965.4 Mbytes/s, TOTAL TIME= 0.1606( 3.6%)
IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH =
./ICMUAh7zg+001872 MODE=w
IO-STREAM CLOSED - ./ICMUAh7zg+001872
MPI-TASK: 1 - 9175557696 BYTES IN 125 RECORDS TRANSFERRED IN 0.0034 SECONDS******** Mbytes/s, TOTAL TIME= 0.1200( 2.8%)
STEPO_FPOS WAS : B00000F00E
IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH =
./ICMUAh7zg+001872 MODE=a
IO-STREAM CLOSED - ./ICMUAh7zg+001872
MPI-TASK: 1 - 10 BYTES IN 2 RECORDS TRANSFERRED IN 0.0001 SECONDS 0.1 Mbytes/s, TOTAL TIME= 0.0029( 3.4%)
STEPO_FPOS WAS : V00000000Y
IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH =
./ICMUAh7zg+001872 MODE=a
IO-STREAM CLOSED - ./ICMUAh7zg+001872
MPI-TASK: 1 - 564892627 BYTES IN 4 RECORDS TRANSFERRED IN 0.0002 SECONDS******** Mbytes/s, TOTAL TIME= 0.0037( 5.4%)
STEPO_FPOS WAS : T00000000M
NSTEP = 1872 STEPO 0AAA00AAA
MAXGPFV : MAX. VALUE = 0.000000000000000E+000
MAXGPFV : MAX. VALUE = 0.000000000000000E+000
NSTEP = 1872 SCAN2M_HPOS P
IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH =
ICMGGh7zg+001872 MODE=a
IO-STREAM CLOSED - ICMGGh7zg+001872
MPI-TASK: 1 - 573472356 BYTES IN 7 RECORDS TRANSFERRED IN 0.0004 SECONDS******** Mbytes/s, TOTAL TIME= 0.0070( 5.7%)
14:39:44 STEP 1872 H= 468:00 +CPU= 22.605
NSTEP = 1873 STEPO 0AAA00AAA
------------------------------------------------
CNT0 not found; string returned was: 'STEPO'
>>> Printing last 8 lines from file: ifs.stat
14:39:21 F00000000 STEPO 1872 14.879 14.879 57.097 42:13 67:15 0.18362626218346E-06 2GB 0MB
14:39:23 0AA000000 STEPO 1872 1.577 1.577 1.590 42:15 67:16 0.18362626218346E-06 2GB 0MB
14:39:24 FULLPOS-B DYNFPOS 1872 0.752 0.752 0.762 42:15 67:17 0.18362626218346E-06 2GB 0MB
14:39:26 FULLPOS-V DYNFPOS 1872 1.928 1.928 1.963 42:17 67:19 0.18362626218346E-06 2GB 0MB
14:39:26 FULLPOS-T DYNFPOS 1872 0.397 0.397 0.404 42:18 67:19 0.18362626218346E-06 2GB 0MB
14:39:27 0AAA00AAA STEPO 1872 0.390 0.390 0.393 42:18 67:20 0.18362626218346E-06 2GB 0MB
14:39:44 0AAA00AAA STEPO 1873 17.458 17.458 17.865 42:36 67:38 0.18362626218346E-06 2GB 0MB
------------------------------------------------
>>> Printing last 11 lines from file: rcf
CSTEP = " 1872",
CTIME = "00191200 ",
NSTEPLPP = 201, 202, 49, 228226, 228227, 2*0, 1860, 2*0,
IPRGPNSRES = 1,
IPRGPEWRES = 1,
IPRTRWRES = 1,
IPRTRVRES = 1,
GMASS0 = 0.000000000000000E+000,
GMASSI = 0.000000000000000E+000
/
------------------------------------------------
>>> Printing last 8 lines from file: /var/lib/boinc/slots/16/progress_file_12291245.xml
<running_values>
<last_cpu_time>41455.280000</last_cpu_time>
<upload_file_number>19</upload_file_number>
<last_iter>1873</last_iter>
<last_upload>1642500</last_upload>
<model_completed>0</model_completed>
</running_values>
------------------------------------------------
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a292
(argv4) batchid: 1018
(argv5) wuid: 12291245
(argv6) fclen: 20
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/16
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.13
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245
..mkdir for temp folder for results failed
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/16/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/16/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_fa0da6e7ed1138d0df65bc66867e5123 to: /var/lib/boinc/slots/16/oifs_43r3_bl_a292_2016092300_20_1018_12291245.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/16/oifs_43r3_bl_a292_2016092300_20_1018_12291245.zip
ic_ancil_file: ic_ancil_12291245
ifsdata_file: ifsdata_12291245
climate_data_file: clim_data_12291245
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc/slots/16/ic_ancil_12291245.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/16/ic_ancil_12291245.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_9c224d3481a74235bef68e883eabdefd to: /var/lib/boinc/slots/16/ifsdata/ifsdata_12291245.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/16/ifsdata/ifsdata_12291245.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/16/159l_2/clim_data_12291245.zip
Unzipping the climate data zip file: /var/lib/boinc/slots/16/159l_2/clim_data_12291245.zip
Checking for progress XML file: /var/lib/boinc/slots/16/progress_file_12291245.xml
Opened progress file ok : /var/lib/boinc/slots/16/progress_file_12291245.xml
-- Model is restarting --
Adjusting last_iter, 1873, to previous model restart step.
Creating progress file: /var/lib/boinc/slots/16/progress_file_12291245.xml
last_cpu_time: 41455
upload_file_number: 19
last_iter: 1873
last_upload: 1642500
model_completed: 0
total_length_of_simulation: 1728000
result_base_name: oifs_43r3_bl_a292_2016092300_20_1018_12291245_1_r1871567991
The child process has been launched with process id: 32685
Executing the command: /var/lib/boinc/slots/16/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:etam-komp:1:1:32685:32685] [20240614:144120:1718368880:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440
[EC_DRHOOK:etam-komp:1:1:32685:32685] [20240614:144120:1718368880:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:etam-komp:1:1:32685:32685] [20240614:144120:1718368880:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:etam-komp:1:1:32685:32685] [20240614:144120:1718368880:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:etam-komp:1:1:32685:32685] [20240614:144120:1718368880:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:etam-komp:1:1:32685:32685] [20240614:144120:1718368880:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:etam-komp:1:1:32685:32685] [20240614:144120:1718368880:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:etam-komp:1:1:32685:32685] [20240614:144120:1718368880:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:etam-komp:1:1:32685:32685] [20240614:144120:1718368880:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:etam-komp:1:1:32685:32685] [20240614:144120:1718368880:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:etam-komp:1:1:32685:32685] [20240614:144120:1718368880:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:etam-komp:1:1:32685:32685] [20240614:144120:1718368880:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:etam-komp:1:1:32685:32685] [20240614:144120:1718368880:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:etam-komp:1:1:32685:32685] [20240614:144120:1718368880:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:etam-komp:1:1:32685:32685] [20240614:144120:1718368880:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:etam-komp:1:1:32685:32685] [20240614:144120:1718368880:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:etam-komp:1:1:32685:32685] [20240614:144120:1718368880:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:etam-komp:1:1:32685:32685] [20240614:144120:1718368880:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:etam-komp:1:1:32685:32685] [20240614:144120:1718368880:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:etam-komp:1:1:32685:32685] [20240614:144120:1718368880:0.000] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:etam-komp:1:1:32685:32685] [20240614:144120:1718368880:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:etam-komp:1:1:32685:32685] [20240614:144120:1718368880:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:etam-komp:1:1:32685:32685] [20240614:144120:1718368880:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:etam-komp:1:1:32685:32685] [20240614:144120:1718368880:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:etam-komp:1:1:32685:32685] [20240614:144120:1718368880:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:etam-komp:1:1:32685:32685] [20240614:144120:1718368880:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:etam-komp:1:1:32685:32685] [20240614:144120:1718368880:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:etam-komp:1:1:32685:32685] [20240614:144120:1718368880:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:etam-komp:1:1:32685:32685] [20240614:144120:1718368880:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:etam-komp:1:1:32685:32685] [20240614:144120:1718368880:0.000] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
14:41:49 STEP 1872 H= 468:00 +CPU= 21.570
14:42:09 STEP 1873 H= 468:15 +CPU= 18.994
14:42:29 STEP 1874 H= 468:30 +CPU= 19.525
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:43:31 STEP 1875 H= 468:45 +CPU= 18.388
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:44:30 STEP 1876 H= 469:00 +CPU= 17.009
14:44:47 STEP 1877 H= 469:15 +CPU= 16.885
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:45:26 STEP 1878 H= 469:30 +CPU= 17.565
14:45:43 STEP 1879 H= 469:45 +CPU= 16.542
14:46:00 STEP 1880 H= 470:00 +CPU= 17.069
14:46:17 STEP 1881 H= 470:15 +CPU= 16.268
14:46:34 STEP 1882 H= 470:30 +CPU= 17.314
14:46:53 STEP 1883 H= 470:45 +CPU= 18.595
14:47:16 STEP 1884 H= 471:00 +CPU= 22.403
Moving to projects directory: /var/lib/boinc/slots/16/ICMGGh7zg+001884
Moving to projects directory: /var/lib/boinc/slots/16/ICMSHh7zg+001884
Moving to projects directory: /var/lib/boinc/slots/16/ICMUAh7zg+001884
14:47:34 STEP 1885 H= 471:15 +CPU= 17.315
14:47:51 STEP 1886 H= 471:30 +CPU= 16.587
14:48:08 STEP 1887 H= 471:45 +CPU= 16.945
14:48:26 STEP 1888 H= 472:00 +CPU= 17.656
14:48:43 STEP 1889 H= 472:15 +CPU= 16.939
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:49:20 STEP 1890 H= 472:30 +CPU= 15.842
14:49:36 STEP 1891 H= 472:45 +CPU= 15.853
14:49:53 STEP 1892 H= 473:00 +CPU= 16.213
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:50:29 STEP 1893 H= 473:15 +CPU= 15.386
14:50:46 STEP 1894 H= 473:30 +CPU= 15.778
14:51:02 STEP 1895 H= 473:45 +CPU= 15.706
14:51:22 STEP 1896 H= 474:00 +CPU= 20.042
Moving to projects directory: /var/lib/boinc/slots/16/ICMGGh7zg+001896
Moving to projects directory: /var/lib/boinc/slots/16/ICMSHh7zg+001896
Moving to projects directory: /var/lib/boinc/slots/16/ICMUAh7zg+001896
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:51:58 STEP 1897 H= 474:15 +CPU= 15.246
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:52:35 STEP 1898 H= 474:30 +CPU= 15.149
14:52:50 STEP 1899 H= 474:45 +CPU= 15.219
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:53:30 STEP 1900 H= 475:00 +CPU= 17.061
14:53:51 STEP 1901 H= 475:15 +CPU= 20.639
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:54:31 STEP 1902 H= 475:30 +CPU= 18.572
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:55:12 STEP 1903 H= 475:45 +CPU= 20.082
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:55:51 STEP 1904 H= 476:00 +CPU= 17.603
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:56:31 STEP 1905 H= 476:15 +CPU= 18.209
14:56:49 STEP 1906 H= 476:30 +CPU= 17.765
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:57:27 STEP 1907 H= 476:45 +CPU= 16.301
14:57:47 STEP 1908 H= 477:00 +CPU= 20.079
Moving to projects directory: /var/lib/boinc/slots/16/ICMGGh7zg+001908
Moving to projects directory: /var/lib/boinc/slots/16/ICMSHh7zg+001908
Moving to projects directory: /var/lib/boinc/slots/16/ICMUAh7zg+001908
14:58:03 STEP 1909 H= 477:15 +CPU= 15.754
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:59:03 STEP 1910 H= 477:30 +CPU= 16.942
14:59:20 STEP 1911 H= 477:45 +CPU= 16.692
14:59:39 STEP 1912 H= 478:00 +CPU= 17.871
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:00:18 STEP 1913 H= 478:15 +CPU= 16.780
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:00:58 STEP 1914 H= 478:30 +CPU= 18.453
15:01:19 STEP 1915 H= 478:45 +CPU= 20.407
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:02:19 STEP 1916 H= 479:00 +CPU= 16.623
15:02:36 STEP 1917 H= 479:15 +CPU= 16.200
15:02:52 STEP 1918 H= 479:30 +CPU= 15.942
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
15:03:29 STEP 1919 H= 479:45 +CPU= 15.782
15:03:50 STEP 1920 H= 480:00 +CPU= 21.033
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01
DDH------------------------------------------------------------------------
I I
I TIME = 480.000H DDH * Diagnostic Var., AREA GLOBAL I
I I
I-------------------------------------------------------------------------I
I VARIABLE I Initial value I Current value I
I-------------------------------------------------------------------------I
I OMEGA (P/S) I -0.3805285787E-21 I 0.2308577327E-06 I
ICloud fractionI 0.0000000000E+00 I 0.1244510810E-02 I
I Relat. Hum. I 0.1291825896E-02 I 0.6219363799E-01 I
I PASS 01 I 0.0000000000E+00 I 0.1736482152E+02 I
DDH------------------------------------------------------------------------
MAXGPFV : MAX. VALUE = 0.000000000000000E+000
MAXGPFV : MAX. VALUE = 0.000000000000000E+000
NSTEP = 1920 SCAN2M_HPOS P
IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH =
ICMGGh7zg+001920 MODE=a
IO-STREAM CLOSED - ICMGGh7zg+001920
MPI-TASK: 1 - 1105571428 BYTES IN 7 RECORDS TRANSFERRED IN 0.0004 SECONDS******** Mbytes/s, TOTAL TIME= 0.0077( 5.2%)
15:03:50 STEP 1920 H= 480:00 +CPU= 21.033
END CNT3
NSTEP = 1920 CNT0 000000000 15.473 15.473 15.767 0.981 0 0 0 0 0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ 46/ 1069125708 WRITTEN 1430/************
-TASK-OPENED-OPEN-RECS IN -KBYTE IN -RECS OUT-KBYTE OUT-WALL -WALL IN-WALL
OU-TOT IN -TOT OUT
1 28 0 46 1044068 1430 ************ 6.3 5.1 1.3 5.6 2.8
===-=== START OF TIMING STATISTICS ===-===
STATS FOR ALL TASKS
NUM ROUTINE CALLS MEAN(ms) MAX(ms) FRAC(%) UNBAL(%)
0 CNT0 - COMPLETE EXECUTION 1 1350616.6 1350616.6 100.00 0.00
1 CNT4 - FORWARD INTEGRATION 1 1343972.9 1343972.9 99.51 0.00
8 SCAN2M - GRID-POINT DYNAMICS 53 3519.1 3519.1 13.81 0.00
9 SPCM - SPECTRAL COMP. 48 1451.3 1451.3 5.16 0.00
10 SCAN2M - PHYSICS 49 14366.5 14366.5 52.12 0.00
11 IOPACK - OUTPUT P.P. RESULTS 4 444.6 444.6 0.13 0.00
12 SPNORM - SPECTRAL NORM COMP. 3 28.3 28.3 0.01 0.00
17 GRIDFPOS IN CNT4 4 18.8 18.8 0.01 0.00
27 RESTART FILES - WRITING 1 1775.6 1775.6 0.13 0.00
28 RESTART FILES - READING 1 6286.6 6286.6 0.47 0.00
29 SU4FPOS IN CNT4 4 0.0 0.0 0.00 0.00
30 DYNFPOS IN CNT4 4 3798.7 3798.7 1.13 0.00
31 POSDDH IN STEPO 1 1.1 1.1 0.00 0.00
37 CPGLAG - SL COMPUTATIONS 49 5379.9 5379.9 19.52 0.00
39 SU0YOMB 1 233.1 233.1 0.02 0.00
51 SCAN2M - SL COMM. PART 1 49 14.9 14.9 0.05 0.00
54 SPCM - M TO S/S TO M TRANSP. 48 678.3 678.3 2.41 0.00
55 SPCIMPF - S TO M/M TO S TRANSP. 48 35.6 35.6 0.13 0.00
56 SPNORM - SPECTRAL NORM COMM. 3 0.1 0.1 0.00 0.00
102 LTINV_CTL - INVERSE LEGENDRE TRANSFORM 108 237.1 237.1 1.90 0.00
103 LTDIR_CTL - DIRECT LEGENDRE TRANSFORM 100 151.8 151.8 1.12 0.00
106 FTDIR_CTL - DIRECT FOURIER TRANSFORM 100 51.4 51.4 0.38 0.00
107 FTINV_CTL - INVERSE FOURIER TRANSFORM 108 88.0 88.0 0.70 0.00
140 SULEG - COMP. OF LEGENDRE POL. 1 32.1 32.1 0.00 0.00
152 LTINV_CTL - M TO L TRANSPOSITION 108 26.8 26.8 0.21 0.00
153 LTDIR_CTL - L TO M TRANSPOSITION 100 16.3 16.3 0.12 0.00
157 FTINV_CTL - L TO G TRANSPOSITION 108 60.1 60.1 0.48 0.00
158 FTDIR_CTL - G TO L TRANSPOSITION 100 30.5 30.5 0.23 0.00
400 GSTATS 6667 0.0 0.0 0.00 0.00
401 GSTATS HOOK 6149 0.0 0.0 0.00 0.00
TOTAL MEASURED IMBALANCE = 0.0 SECONDS, 0.0 PERCENT
TOTAL WALLCLOCK TIME 1350.6 CPU TIME 861.4 VECTOR TIME 861.4
===-=== END OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY 1285.7
*** END CNT0 ***
------------------------------------------------
Moving to projects directory: /var/lib/boinc/slots/16/ICMGGh7zg+001920
Moving to projects directory: /var/lib/boinc/slots/16/ICMSHh7zg+001920
Moving to projects directory: /var/lib/boinc/slots/16/ICMUAh7zg+001920
Adding to the zip: /var/lib/boinc/slots/16/NODE.001_01
Adding to the zip: /var/lib/boinc/slots/16/ifs.stat
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMGGh7zg+001536
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMSHh7zg+001536
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMUAh7zg+001536
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMGGh7zg+001836
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMSHh7zg+001836
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMUAh7zg+001836
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMGGh7zg+001848
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMSHh7zg+001848
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMUAh7zg+001848
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMGGh7zg+001860
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMSHh7zg+001860
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMUAh7zg+001860
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMGGh7zg+001872
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMSHh7zg+001872
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMUAh7zg+001872
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMGGh7zg+001884
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMSHh7zg+001884
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMUAh7zg+001884
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMGGh7zg+001896
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMSHh7zg+001896
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMUAh7zg+001896
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMGGh7zg+001908
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMSHh7zg+001908
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMUAh7zg+001908
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMGGh7zg+001920
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMSHh7zg+001920
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12291245/ICMUAh7zg+001920
Zipping up the final file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a292_2016092300_20_1018_12291245_1_r1871567991_19.zip
Uploading the final file: upload_file_19.zip
Uploading trickle at timestep: 1727100
15:07:19 (32681): called boinc_finish(0)
</stderr_txt>
]]>
