climateprediction.net home page
Task 22448607

Task 22448607

Name oifs_43r3_bl_a1i3_2016092300_20_1018_12290274_1
Workunit 12290274
Created 13 Jun 2024, 21:13:15 UTC
Sent 14 Jun 2024, 6:34:15 UTC
Report deadline 13 Aug 2024, 6:34:15 UTC
Received 14 Jun 2024, 8:06:48 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1541000
Run time 20 min 27 sec
CPU time 19 min 19 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 4.91 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,009.75 MB
Peak swap size 5,981.07 MB
Peak disk usage 1,268.55 MB
Stderr
<core_client_version>8.0.2</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a1i3
(argv4) batchid: 1018
(argv5) wuid: 12290274
(argv6) fclen: 20
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/3
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.13
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12290274
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/3/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/3/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_f3f524e31697495ab1fd08d147ff7ac6 to: /var/lib/boinc-client/slots/3/oifs_43r3_bl_a1i3_2016092300_20_1018_12290274.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/3/oifs_43r3_bl_a1i3_2016092300_20_1018_12290274.zip
ic_ancil_file: ic_ancil_12290274
ifsdata_file: ifsdata_12290274
climate_data_file: clim_data_12290274
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc-client/slots/3/ic_ancil_12290274.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/3/ic_ancil_12290274.zip
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_91a1b206cee66d77f0a40caf55608398 to: /var/lib/boinc-client/slots/3/ifsdata/ifsdata_12290274.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/3/ifsdata/ifsdata_12290274.zip
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/3/159l_2/clim_data_12290274.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/3/159l_2/clim_data_12290274.zip
Checking for progress XML file: /var/lib/boinc-client/slots/3/progress_file_12290274.xml
Creating progress file: /var/lib/boinc-client/slots/3/progress_file_12290274.xml
last_cpu_time: 0
upload_file_number: 0
last_iter: 0
last_upload: 0
model_completed: 0
total_length_of_simulation: 1728000
result_base_name: oifs_43r3_bl_a1i3_2016092300_20_1018_12290274_1_r121391226
The child process has been launched with process id: 16267
Executing the command: /var/lib/boinc-client/slots/3/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:003921:1718350761:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:003921:1718350761:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:003921:1718350761:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:003921:1718350761:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:003921:1718350761:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:003921:1718350761:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:003921:1718350761:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:003921:1718350761:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:003921:1718350761:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:003921:1718350761:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:003921:1718350761:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:003921:1718350761:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:003921:1718350761:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:003921:1718350761:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:003921:1718350761:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:003921:1718350761:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:003921:1718350761:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:003921:1718350761:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:003921:1718350761:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:003921:1718350761:0.000] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:003921:1718350761:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:003921:1718350761:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:003921:1718350761:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:003921:1718350761:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:003921:1718350761:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:003921:1718350761:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:003921:1718350761:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:003921:1718350761:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:003921:1718350761:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:003921:1718350761:0.001] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  00:39:42 STEP    0 H=   0:00 +CPU= 17.116
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000000
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000000
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000000
  00:39:56 STEP    1 H=   0:15 +CPU= 13.939
  00:40:10 STEP    2 H=   0:30 +CPU= 13.799
  00:40:24 STEP    3 H=   0:45 +CPU= 13.846
  00:40:38 STEP    4 H=   1:00 +CPU= 14.030
  00:40:52 STEP    5 H=   1:15 +CPU= 13.965
  00:41:05 STEP    6 H=   1:30 +CPU= 13.659
  00:41:19 STEP    7 H=   1:45 +CPU= 13.932
  00:41:33 STEP    8 H=   2:00 +CPU= 14.069
  00:41:47 STEP    9 H=   2:15 +CPU= 14.079
  00:42:01 STEP   10 H=   2:30 +CPU= 14.030
  00:42:15 STEP   11 H=   2:45 +CPU= 13.764
  00:42:33 STEP   12 H=   3:00 +CPU= 17.531
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000012
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000012
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000012
  00:42:47 STEP   13 H=   3:15 +CPU= 13.870
  00:43:00 STEP   14 H=   3:30 +CPU= 13.779
  00:43:15 STEP   15 H=   3:45 +CPU= 14.261
  00:43:29 STEP   16 H=   4:00 +CPU= 13.913
  00:43:42 STEP   17 H=   4:15 +CPU= 13.672
  00:43:56 STEP   18 H=   4:30 +CPU= 14.124
  00:44:10 STEP   19 H=   4:45 +CPU= 13.823
  00:44:24 STEP   20 H=   5:00 +CPU= 14.187
  00:44:38 STEP   21 H=   5:15 +CPU= 13.934
  00:44:52 STEP   22 H=   5:30 +CPU= 13.823
  00:45:07 STEP   23 H=   5:45 +CPU= 14.300
  00:45:24 STEP   24 H=   6:00 +CPU= 17.579
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000024
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000024
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000024
  00:45:39 STEP   25 H=   6:15 +CPU= 14.308
  00:45:53 STEP   26 H=   6:30 +CPU= 14.269
  00:46:07 STEP   27 H=   6:45 +CPU= 14.003
  00:46:21 STEP   28 H=   7:00 +CPU= 14.319
  00:46:35 STEP   29 H=   7:15 +CPU= 13.465
  00:46:49 STEP   30 H=   7:30 +CPU= 13.988
  00:47:03 STEP   31 H=   7:45 +CPU= 14.316
  00:47:17 STEP   32 H=   8:00 +CPU= 14.171
  00:47:31 STEP   33 H=   8:15 +CPU= 13.830
  00:47:45 STEP   34 H=   8:30 +CPU= 14.083
  00:47:59 STEP   35 H=   8:45 +CPU= 14.197
  00:48:17 STEP   36 H=   9:00 +CPU= 17.819
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000036
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000036
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000036
  00:48:31 STEP   37 H=   9:15 +CPU= 14.112
  00:48:45 STEP   38 H=   9:30 +CPU= 14.093
  00:48:59 STEP   39 H=   9:45 +CPU= 13.688
  00:49:13 STEP   40 H=  10:00 +CPU= 13.891
  00:49:27 STEP   41 H=  10:15 +CPU= 13.962
  00:49:41 STEP   42 H=  10:30 +CPU= 14.449
  00:49:56 STEP   43 H=  10:45 +CPU= 14.628
  00:50:10 STEP   44 H=  11:00 +CPU= 14.394
  00:50:25 STEP   45 H=  11:15 +CPU= 14.123
  00:50:39 STEP   46 H=  11:30 +CPU= 14.048
  00:50:53 STEP   47 H=  11:45 +CPU= 14.192
  00:51:12 STEP   48 H=  12:00 +CPU= 18.976
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000048
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000048
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000048
  00:51:26 STEP   49 H=  12:15 +CPU= 13.937
  00:51:40 STEP   50 H=  12:30 +CPU= 14.080
  00:51:54 STEP   51 H=  12:45 +CPU= 14.318
  00:52:09 STEP   52 H=  13:00 +CPU= 14.339
  00:52:23 STEP   53 H=  13:15 +CPU= 14.396
  00:52:37 STEP   54 H=  13:30 +CPU= 13.809
  00:52:51 STEP   55 H=  13:45 +CPU= 14.048
  00:53:05 STEP   56 H=  14:00 +CPU= 14.224
  00:53:19 STEP   57 H=  14:15 +CPU= 13.794
  00:53:33 STEP   58 H=  14:30 +CPU= 13.889
  00:53:47 STEP   59 H=  14:45 +CPU= 14.071
  00:54:05 STEP   60 H=  15:00 +CPU= 17.926
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000060
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000060
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000060
  00:54:19 STEP   61 H=  15:15 +CPU= 14.346
  00:54:34 STEP   62 H=  15:30 +CPU= 14.242
  00:54:48 STEP   63 H=  15:45 +CPU= 14.242
  00:55:02 STEP   64 H=  16:00 +CPU= 14.611
  00:55:17 STEP   65 H=  16:15 +CPU= 14.447
  00:55:31 STEP   66 H=  16:30 +CPU= 13.720
  00:55:44 STEP   67 H=  16:45 +CPU= 13.846
  00:55:59 STEP   68 H=  17:00 +CPU= 14.486
  00:56:13 STEP   69 H=  17:15 +CPU= 14.236
  00:56:27 STEP   70 H=  17:30 +CPU= 14.245
  00:56:42 STEP   71 H=  17:45 +CPU= 14.385
  00:57:00 STEP   72 H=  18:00 +CPU= 17.713
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000072
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000072
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000072
  00:57:14 STEP   73 H=  18:15 +CPU= 14.264
  00:57:28 STEP   74 H=  18:30 +CPU= 14.532
  00:57:43 STEP   75 H=  18:45 +CPU= 14.270
  00:57:57 STEP   76 H=  19:00 +CPU= 14.672
  00:58:12 STEP   77 H=  19:15 +CPU= 14.107
  00:58:25 STEP   78 H=  19:30 +CPU= 13.887
  00:58:40 STEP   79 H=  19:45 +CPU= 14.098
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005841:1718351921:1159.636] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1538] Received signal#8 (SIGFPE) :: 3990MB (heap), 5025MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005841:1718351921:1159.636] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005841:1718351921:1159.636] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x820890 (old at (nil))
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005841:1718351921:1159.636] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1617] Signal#8 was caused by floating-point divide by zero [memaddr=0xcc70b3], nsigs = 1
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005841:1718351921:1159.636] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#8, nsigs = 1
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005841:1718351921:1159.636] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3843] 3990 MB (maxheap), 5025 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005841:1718351921:1159.636] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :  MASTER 
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005841:1718351921:1159.636] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :   CNT0 
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005841:1718351921:1159.636] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :    CNT1 
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005841:1718351921:1159.636] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :     CNT2 
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005841:1718351921:1159.636] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :      CNT3 
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005841:1718351921:1159.636] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :       CNT4 
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005841:1718351921:1159.636] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :        STEPO 
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005841:1718351921:1159.636] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :         SCAN2M 
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005841:1718351921:1159.636] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :          GP_MODEL_HEAP 
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005841:1718351921:1159.636] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :           GP_MODEL 
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005841:1718351921:1159.636] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :            CPG_DRV 
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005841:1718351921:1159.636] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :             >OMP-CPG                  (1025) 
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005841:1718351921:1159.636] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :              CPG 
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005841:1718351921:1159.636] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :               CPG_DIA 
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005841:1718351921:1159.636] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] :                GPRH 
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005842:1718351922:1160.636] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/var/lib/boinc-client/slots/3/oifs_43r3_model.exe' : sigcontextptr=0x7ffd93a5b890
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005842:1718351922:1160.636] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 21) with addr2line-cmd
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005842:1718351922:1160.636] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:302] /usr/bin/addr2line -fs -e '/var/lib/boinc-client/slots/3/oifs_43r3_model.exe' 0x83a8f3 0x83aef9 0x1dd5490 0xcc70b3 0xcbe7ec 0xc2519f 0xc22238 0xbcc914 0x12c5002 0xbacbae 0x688153 0x4cd1dc 0x4b5d85 0x4b4f52 0x49d638 0x406fbd 0x401e7f 0x401e12 0x1dcc34a 0x1dcdbe7 0x401cd5
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005842:1718351922:1160.636] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [0]: [0x83a8f3] : ??() at ??:0
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005842:1718351922:1160.636] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [1]: [0x83aef9] : ??() at ??:0
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005842:1718351922:1160.636] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [2]: [0x1dd5490] : ??() at ??:0
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005842:1718351922:1160.636] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [3]: [0xcc70b3] : ??() at ??:0
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005842:1718351922:1160.636] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [4]: [0xcbe7ec] : ??() at ??:0
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005842:1718351922:1160.636] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [5]: [0xc2519f] : ??() at ??:0
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005842:1718351922:1160.636] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [6]: [0xc22238] : ??() at ??:0
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005842:1718351922:1160.636] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [7]: [0xbcc914] : ??() at ??:0
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005842:1718351922:1160.636] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [8]: [0x12c5002] : ??() at ??:0
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005842:1718351922:1160.636] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [9]: [0xbacbae] : ??() at ??:0
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005842:1718351922:1160.636] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [10]: [0x688153] : ??() at ??:0
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005842:1718351922:1160.636] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [11]: [0x4cd1dc] : ??() at ??:0
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005842:1718351922:1160.636] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [12]: [0x4b5d85] : ??() at ??:0
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005842:1718351922:1160.636] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [13]: [0x4b4f52] : ??() at ??:0
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005842:1718351922:1160.636] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [14]: [0x49d638] : ??() at ??:0
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005842:1718351922:1160.636] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [15]: [0x406fbd] : ??() at ??:0
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005842:1718351922:1160.636] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [16]: [0x401e7f] : ??() at ??:0
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005842:1718351922:1160.636] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [17]: [0x401e12] : ??() at ??:0
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005842:1718351922:1160.636] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [18]: [0x1dcc34a] : ??() at ??:0
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005842:1718351922:1160.636] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [19]: [0x1dcdbe7] : ??() at ??:0
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005842:1718351922:1160.636] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [20]: [0x401cd5] : ??() at ??:0
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005842:1718351922:1160.636] [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s)
 Process            1  thread            1  calling linux_trbk from intel_trbk()
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/var/lib/boinc-client/slots/3/oifs_43r3_model.exe' : sigcontextptr=0x7ffd93a5b7a0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 22) with addr2line-cmd
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:302] /usr/bin/addr2line -fs -e '/var/lib/boinc-client/slots/3/oifs_43r3_model.exe' 0x83a8f3 0x83aef9 0x822540 0x1dd5490 0xcc70b3 0xcbe7ec 0xc2519f 0xc22238 0xbcc914 0x12c5002 0xbacbae 0x688153 0x4cd1dc 0x4b5d85 0x4b4f52 0x49d638 0x406fbd 0x401e7f 0x401e12 0x1dcc34a 0x1dcdbe7 0x401cd5
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [0]: [0x83a8f3] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [1]: [0x83aef9] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [2]: [0x822540] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [3]: [0x1dd5490] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [4]: [0xcc70b3] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [5]: [0xcbe7ec] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [6]: [0xc2519f] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [7]: [0xc22238] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [8]: [0xbcc914] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [9]: [0x12c5002] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [10]: [0xbacbae] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [11]: [0x688153] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [12]: [0x4cd1dc] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [13]: [0x4b5d85] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [14]: [0x4b4f52] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [15]: [0x49d638] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [16]: [0x406fbd] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [17]: [0x401e7f] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [18]: [0x401e12] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [19]: [0x1dcc34a] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [20]: [0x1dcdbe7] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:319] [21]: [0x401cd5] : ??() at ??:0
  [LinuxTraceBack@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s)
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005842:1718351922:1160.660] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#8, nsigs = 1
[EC_DRHOOK:Rig-05:1:1:16267:16267] [20240614:005842:1718351922:1160.660] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1cf8da0 for signal#8, nsigs = 1
forrtl: error (73): floating divide by zero
Image              PC                Routine            Line        Source             
oifs_43r3_model.e  0000000001CF935B  Unknown               Unknown  Unknown
oifs_43r3_model.e  00000000008214C1  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DD5490  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000000CC70B3  gprh_                     146  gprh.F90
oifs_43r3_model.e  0000000000CBE7EC  cpg_dia_                  600  cpg_dia.F90
oifs_43r3_model.e  0000000000C2519F  cpg_                      718  cpg.F90
oifs_43r3_model.e  0000000000C22238  cpg_drv_                  351  cpg_drv.F90
oifs_43r3_model.e  0000000000BCC914  gp_model_                 419  gp_model.F90
oifs_43r3_model.e  00000000012C5002  gp_model_heap_             74  gp_model_heap.F90
oifs_43r3_model.e  0000000000BACBAE  scan2m_                   535  scan2m.F90
oifs_43r3_model.e  0000000000688153  stepo_                    327  stepo.F90
oifs_43r3_model.e  00000000004CD1DC  cnt4_                    1133  cnt4.F90
oifs_43r3_model.e  00000000004B5D85  cnt3_                     267  cnt3.F90
oifs_43r3_model.e  00000000004B4F52  cnt2_                      88  cnt2.F90
oifs_43r3_model.e  000000000049D638  cnt1_                      92  cnt1.F90
oifs_43r3_model.e  0000000000406FBD  cnt0_                     146  cnt0.F90
oifs_43r3_model.e  0000000000401E7F  MAIN__                     96  master.F90
oifs_43r3_model.e  0000000000401E12  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCC34A  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DCDBE7  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000000401CD5  Unknown               Unknown  Unknown
..The child process has been killed with signal: 6
>>> Printing last 70 lines from file: NODE.001_01

         AVE   0.157817421306348E-07 0.000000000000000E+00 0.224753691566600E-06
 GPNORM CC                   AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.111565953167118E+00 0.000000000000000E+00 0.100000000000000E+01
 GPNORM RFL                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00
 GPNORM SFL                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.453172265176471E-10 0.000000000000000E+00 0.830606887105525E-09
 GPNORM CRFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00
 GPNORM CSFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00
 GPNORM PFRC                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.820591564085912E-02 0.000000000000000E+00 0.100000000000000E+01
 NSTEP =    72 STEPO   A00000000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =    72 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+000072 MODE=w
 IO-STREAM CLOSED - ICMGGh7zg+000072
 MPI-TASK:   1 -    306050212 BYTES IN      6 RECORDS TRANSFERRED IN    0.0001 SECONDS******** Mbytes/s, TOTAL TIME=    0.0047( 2.1%)
 NSTEP =    72 STEPO   0AA000000
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMSHh7zg+000072 MODE=w
 IO-STREAM CLOSED - ./ICMSHh7zg+000072
 MPI-TASK:   1 -    707399250 BYTES IN    202 RECORDS TRANSFERRED IN    0.0044 SECONDS160772.6 Mbytes/s, TOTAL TIME=    0.1324( 3.3%)
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000072 MODE=w
 IO-STREAM CLOSED - ./ICMUAh7zg+000072
 MPI-TASK:   1 -   4896803392 BYTES IN    125 RECORDS TRANSFERRED IN    0.0025 SECONDS******** Mbytes/s, TOTAL TIME=    0.0945( 2.6%)
 STEPO_FPOS WAS : B00000F00E
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000072 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+000072
 MPI-TASK:   1 -           10 BYTES IN      2 RECORDS TRANSFERRED IN    0.0000 SECONDS     0.0 Mbytes/s, TOTAL TIME=    0.0023( 0.0%)
 STEPO_FPOS WAS : V00000000Y
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000072 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+000072
 MPI-TASK:   1 -    297470483 BYTES IN      4 RECORDS TRANSFERRED IN    0.0002 SECONDS******** Mbytes/s, TOTAL TIME=    0.0037( 5.4%)
 STEPO_FPOS WAS : T00000000M
 NSTEP =    72 STEPO   0AAA00AAA
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =    72 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+000072 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+000072
 MPI-TASK:   1 -    306050212 BYTES IN      7 RECORDS TRANSFERRED IN    0.0002 SECONDS******** Mbytes/s, TOTAL TIME=    0.0056( 3.6%)
 00:57:00 STEP   72 H=  18:00 +CPU= 17.713
 NSTEP =    73 STEPO   0AAA00AAA
 00:57:14 STEP   73 H=  18:15 +CPU= 14.264
 NSTEP =    74 STEPO   0AAA00AAA
 00:57:28 STEP   74 H=  18:30 +CPU= 14.532
ISTEP=      75 RSOLINC= 1361.4482 RI0= 1365.0000 ZI0= 1361.4482 RIP0= 1361.4482
ISTEP=      75 ZI0= 1361.4482 ZSEASON= 1.000000000 REA=149597870000.00 RDEASO=149597870000.00
 NSTEP =    75 STEPO   0AAA00AAA
 00:57:43 STEP   75 H=  18:45 +CPU= 14.270
 NSTEP =    76 STEPO   0AAA00AAA
 00:57:57 STEP   76 H=  19:00 +CPU= 14.672
 NSTEP =    77 STEPO   0AAA00AAA
 00:58:12 STEP   77 H=  19:15 +CPU= 14.107
 NSTEP =    78 STEPO   0AAA00AAA
 00:58:25 STEP   78 H=  19:30 +CPU= 13.887
 NSTEP =    79 STEPO   0AAA00AAA
 00:58:40 STEP   79 H=  19:45 +CPU= 14.098
ISTEP=      80 RSOLINC= 1361.4482 RI0= 1365.0000 ZI0= 1361.4482 RIP0= 1361.4482
ISTEP=      80 ZI0= 1361.4482 ZSEASON= 1.000000000 REA=149597870000.00 RDEASO=149597870000.00
 NSTEP =    80 STEPO   0AAA00AAA
------------------------------------------------
CNT0 not found; string returned was: 'STEPO'
>>> Printing last 8 lines from file: ifs.stat

 00:57:14 0AAA00AAA STEPO       74    14.264   14.264   14.290     17:51     17:52 0.11910408611906E-06       2GB       0MB
 00:57:28 0AAA00AAA STEPO       75    14.532   14.532   14.554     18:06     18:07 0.11910408611906E-06       2GB       0MB
 00:57:43 0AAA00AAA STEPO       76    14.271   14.271   14.293     18:20     18:21 0.11910408611906E-06       2GB       0MB
 00:57:57 0AAA00AAA STEPO       77    14.673   14.673   14.694     18:35     18:36 0.11910408611906E-06       2GB       0MB
 00:58:12 0AAA00AAA STEPO       78    14.107   14.107   14.128     18:49     18:50 0.11910408611906E-06       2GB       0MB
 00:58:25 0AAA00AAA STEPO       79    13.887   13.887   13.907     19:03     19:04 0.11910408611906E-06       2GB       0MB
 00:58:40 0AAA00AAA STEPO       80    14.098   14.098   14.113     19:17     19:18 0.11910408611906E-06       2GB       0MB
------------------------------------------------
>>> Printing last 11 lines from file: rcf

 CSTEP   = "      48",
 CTIME   = "00001200      ",
 NSTEPLPP        =         201,         202,          49,      228226,      228227, 2*0,          36, 2*0,
 IPRGPNSRES      =           1,
 IPRGPEWRES      =           1,
 IPRTRWRES       =           1,
 IPRTRVRES       =           1,
 GMASS0  =  0.000000000000000E+000,
 GMASSI  =  0.000000000000000E+000
 /
------------------------------------------------
>>> Printing last 8 lines from file: /var/lib/boinc-client/slots/3/progress_file_12290274.xml

<running_values>
  <last_cpu_time>1158.350000</last_cpu_time>
  <upload_file_number>0</upload_file_number>
  <last_iter>80</last_iter>
  <last_upload>0</last_upload>
  <model_completed>0</model_completed>
</running_values>
------------------------------------------------
..Failed, model did not complete successfully

</stderr_txt>
]]>
No trickles!


©2024 climateprediction.net