climateprediction.net home page
Task 22309868

Task 22309868

Name oifs_43r3_bl_a281_2016092300_15_991_12209668_0
Workunit 12209668
Created 13 Feb 2023, 17:18:50 UTC
Sent 13 Feb 2023, 17:31:41 UTC
Report deadline 14 Apr 2023, 17:31:41 UTC
Received 13 Feb 2023, 18:42:05 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1523209
Run time 14 min 52 sec
CPU time 14 min 52 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 7.27 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.11
x86_64-pc-linux-gnu
Peak working set size 5,032.84 MB
Peak swap size 5,930.79 MB
Peak disk usage 1,294.64 MB
Stderr
<core_client_version>7.22.0</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.11_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a281
(argv4) batchid: 991
(argv5) wuid: 12209668
(argv6) fclen: 15
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /home/aldevaran/slots/2
Project directory is: /home/aldevaran/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.11
Location of temp folder: /home/aldevaran/projects/climateprediction.net/oifs_43r3_bl_12209668
Copying: /home/aldevaran/projects/climateprediction.net/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip to: /home/aldevaran/slots/2/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /home/aldevaran/slots/2/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_5755e4bfb18bab1a27a3e6a3c43fbbf4 to: /home/aldevaran/slots/2/oifs_43r3_bl_a281_2016092300_15_991_12209668.zip
Unzipping the namelist zip file: /home/aldevaran/slots/2/oifs_43r3_bl_a281_2016092300_15_991_12209668.zip
ic_ancil_file: ic_ancil_12209668
ifsdata_file: ifsdata_12209668
climate_data_file: clim_data_12209668
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /home/aldevaran/slots/2/ic_ancil_12209668.zip
Unzipping the IC ancils zip file: /home/aldevaran/slots/2/ic_ancil_12209668.zip
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_ad4877234b5b376e7e6184f1381fd4a4 to: /home/aldevaran/slots/2/ifsdata/ifsdata_12209668.zip
Unzipping the ifsdata_zip file: /home/aldevaran/slots/2/ifsdata/ifsdata_12209668.zip
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /home/aldevaran/slots/2/159l_2/clim_data_12209668.zip
Unzipping the climate data zip file: /home/aldevaran/slots/2/159l_2/clim_data_12209668.zip
Checking for progress XML file: /home/aldevaran/slots/2/progress_file_12209668.xml
Creating progress file: /home/aldevaran/slots/2/progress_file_12209668.xml
last_cpu_time: 0
upload_file_number: 0
last_iter: 0
last_upload: 0
model_completed: 0
total_length_of_simulation: 1296000
result_base_name: oifs_43r3_bl_a281_2016092300_15_991_12209668_0_r2014865356
The child process has been launched with process id: 1299
Executing the command: /home/aldevaran/slots/2/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:184824:1676310504:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2091] fp = 0x30e4a00
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:184824:1676310504:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:184824:1676310504:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:184824:1676310504:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:184824:1676310504:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:184824:1676310504:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:184824:1676310504:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:184824:1676310504:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:184824:1676310504:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:184824:1676310504:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:184824:1676310504:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:184824:1676310504:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:184824:1676310504:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:184824:1676310504:0.000] [ignore_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:184824:1676310504:0.000] [restore_default_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:184824:1676310504:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:184824:1676310504:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f520 (old at (nil))
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:184824:1676310504:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:184824:1676310504:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f520 (old at (nil))
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:184824:1676310504:0.000] [trapfpe_treatment@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:184824:1676310504:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:184824:1676310504:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:184824:1676310504:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f520 (old at (nil))
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:184824:1676310504:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:184824:1676310504:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:184824:1676310504:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:184824:1676310504:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f520 (old at (nil))
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:184824:1676310504:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f520 (old at (nil))
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:184824:1676310504:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f520 (old at (nil))
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:184824:1676310504:0.000] [catch_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  18:48:49 STEP    0 H=   0:00 +CPU= 21.530
Moving to projects directory: /home/aldevaran/slots/2/ICMGGh7zg+000000
Moving to projects directory: /home/aldevaran/slots/2/ICMSHh7zg+000000
Moving to projects directory: /home/aldevaran/slots/2/ICMUAh7zg+000000
  18:49:06 STEP    1 H=   0:15 +CPU= 16.824
  18:49:24 STEP    2 H=   0:30 +CPU= 16.978
  18:49:40 STEP    3 H=   0:45 +CPU= 16.220
  18:49:58 STEP    4 H=   1:00 +CPU= 16.851
  18:50:14 STEP    5 H=   1:15 +CPU= 16.244
  18:50:30 STEP    6 H=   1:30 +CPU= 15.251
  18:50:45 STEP    7 H=   1:45 +CPU= 14.766
  18:51:01 STEP    8 H=   2:00 +CPU= 15.294
  18:51:16 STEP    9 H=   2:15 +CPU= 15.035
  18:51:31 STEP   10 H=   2:30 +CPU= 15.178
  18:51:47 STEP   11 H=   2:45 +CPU= 15.055
  18:52:06 STEP   12 H=   3:00 +CPU= 18.757
Moving to projects directory: /home/aldevaran/slots/2/ICMGGh7zg+000012
Moving to projects directory: /home/aldevaran/slots/2/ICMSHh7zg+000012
Moving to projects directory: /home/aldevaran/slots/2/ICMUAh7zg+000012
  18:52:21 STEP   13 H=   3:15 +CPU= 15.074
  18:52:37 STEP   14 H=   3:30 +CPU= 15.209
  18:52:53 STEP   15 H=   3:45 +CPU= 15.479
  18:53:09 STEP   16 H=   4:00 +CPU= 15.752
  18:53:24 STEP   17 H=   4:15 +CPU= 15.007
  18:53:40 STEP   18 H=   4:30 +CPU= 15.236
  18:53:56 STEP   19 H=   4:45 +CPU= 15.070
  18:54:12 STEP   20 H=   5:00 +CPU= 15.634
  18:54:28 STEP   21 H=   5:15 +CPU= 15.759
  18:54:44 STEP   22 H=   5:30 +CPU= 15.536
  18:54:59 STEP   23 H=   5:45 +CPU= 14.962
  18:55:18 STEP   24 H=   6:00 +CPU= 19.047
Moving to projects directory: /home/aldevaran/slots/2/ICMGGh7zg+000024
Moving to projects directory: /home/aldevaran/slots/2/ICMSHh7zg+000024
Moving to projects directory: /home/aldevaran/slots/2/ICMUAh7zg+000024
  18:55:35 STEP   25 H=   6:15 +CPU= 15.810
  18:55:51 STEP   26 H=   6:30 +CPU= 15.825
  18:56:08 STEP   27 H=   6:45 +CPU= 16.818
  18:56:25 STEP   28 H=   7:00 +CPU= 16.765
  18:56:44 STEP   29 H=   7:15 +CPU= 17.911
  18:57:01 STEP   30 H=   7:30 +CPU= 16.334
  18:57:18 STEP   31 H=   7:45 +CPU= 16.563
  18:57:35 STEP   32 H=   8:00 +CPU= 16.624
  18:57:53 STEP   33 H=   8:15 +CPU= 17.387
  18:58:11 STEP   34 H=   8:30 +CPU= 17.605
  18:58:28 STEP   35 H=   8:45 +CPU= 16.451
  18:58:50 STEP   36 H=   9:00 +CPU= 21.459
Moving to projects directory: /home/aldevaran/slots/2/ICMGGh7zg+000036
Moving to projects directory: /home/aldevaran/slots/2/ICMSHh7zg+000036
Moving to projects directory: /home/aldevaran/slots/2/ICMUAh7zg+000036
  18:59:07 STEP   37 H=   9:15 +CPU= 16.735
  18:59:24 STEP   38 H=   9:30 +CPU= 17.007
  18:59:42 STEP   39 H=   9:45 +CPU= 16.921
  19:00:00 STEP   40 H=  10:00 +CPU= 17.678
  19:00:17 STEP   41 H=  10:15 +CPU= 16.989
  19:00:34 STEP   42 H=  10:30 +CPU= 16.699
  19:00:52 STEP   43 H=  10:45 +CPU= 17.412
  19:01:10 STEP   44 H=  11:00 +CPU= 17.055
  19:01:27 STEP   45 H=  11:15 +CPU= 16.899
  19:01:45 STEP   46 H=  11:30 +CPU= 17.541
  19:02:03 STEP   47 H=  11:45 +CPU= 17.169
  19:02:28 STEP   48 H=  12:00 +CPU= 24.101
Moving to projects directory: /home/aldevaran/slots/2/ICMGGh7zg+000048
Moving to projects directory: /home/aldevaran/slots/2/ICMSHh7zg+000048
Moving to projects directory: /home/aldevaran/slots/2/ICMUAh7zg+000048
  19:02:45 STEP   49 H=  12:15 +CPU= 16.766
  19:03:03 STEP   50 H=  12:30 +CPU= 17.501
  19:03:20 STEP   51 H=  12:45 +CPU= 17.259
  19:03:38 STEP   52 H=  13:00 +CPU= 17.141
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190340:1676311420:915.875] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1538] Received signal#8 (SIGFPE) :: 3940MB (heap), 5066MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190340:1676311420:915.875] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190340:1676311420:915.875] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x81f0c0 (old at (nil))
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190340:1676311420:915.875] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1617] Signal#8 was caused by floating-point overflow [memaddr=0x1cc4a8f], nsigs = 1
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190340:1676311420:915.875] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#8, nsigs = 1
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190340:1676311420:915.875] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3843] 3940 MB (maxheap), 5066 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190340:1676311420:915.875] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :  MASTER 
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190340:1676311420:915.878] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :   CNT0 
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190340:1676311420:915.878] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :    CNT1 
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190340:1676311420:915.878] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :     CNT2 
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190340:1676311420:915.878] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :      CNT3 
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190340:1676311420:915.879] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :       CNT4 
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190340:1676311420:915.879] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :        STEPO 
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190340:1676311420:915.879] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :         SCAN2M 
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190340:1676311420:915.879] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :          GP_MODEL_HEAP 
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190340:1676311420:915.879] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :           GP_MODEL 
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190340:1676311420:915.879] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :            CPG_DRV 
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190340:1676311420:915.879] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :             >OMP-CPG                  (1025) 
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190340:1676311420:915.879] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :              CPG 
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190340:1676311420:915.879] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :               CPG_DIA 
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190340:1676311420:915.879] [c_drhook_print_@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:3897] :                GPRH 
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190341:1676311421:916.880] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/home/aldevaran/slots/2/oifs_43r3_model.exe' : sigcontextptr=0x7fff2ddb0d90
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190341:1676311421:916.880] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 22) with plain hex-dump
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190341:1676311421:916.880] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [0]: [0x838803] : 0x838803
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190341:1676311421:916.880] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [1]: [0x838e09] : 0x838e09
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190341:1676311421:916.880] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [2]: [0x1d8bb20] : 0x1d8bb20
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190341:1676311421:916.880] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [3]: [0x1cc4a8f] : 0x1cc4a8f
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190341:1676311421:916.880] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [4]: [0x144b066] : 0x144b066
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190341:1676311421:916.880] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [5]: [0x143e1ec] : 0x143e1ec
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190341:1676311421:916.880] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [6]: [0x1435fbf] : 0x1435fbf
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190341:1676311421:916.880] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [7]: [0x1433058] : 0x1433058
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190341:1676311421:916.880] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [8]: [0xe5f4b8] : 0xe5f4b8
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190341:1676311421:916.880] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [9]: [0x15c1e62] : 0x15c1e62
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190341:1676311421:916.880] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [10]: [0x15ac40e] : 0x15ac40e
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190341:1676311421:916.880] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [11]: [0x6620b4] : 0x6620b4
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190341:1676311421:916.880] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [12]: [0x4a0e7c] : 0x4a0e7c
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190341:1676311421:916.880] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [13]: [0x49dc29] : 0x49dc29
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190341:1676311421:916.880] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [14]: [0x49ce72] : 0x49ce72
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190341:1676311421:916.880] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [15]: [0x49cd68] : 0x49cd68
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190341:1676311421:916.880] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [16]: [0x4078ad] : 0x4078ad
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190341:1676311421:916.880] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [17]: [0x40276f] : 0x40276f
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190341:1676311421:916.880] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [18]: [0x40270d] : 0x40270d
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190341:1676311421:916.880] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [19]: [0x1d8287a] : 0x1d8287a
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190341:1676311421:916.880] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [20]: [0x1d840d7] : 0x1d840d7
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190341:1676311421:916.880] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [21]: [0x4025e5] : 0x4025e5
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190341:1676311421:916.880] [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s)
 Process            1  thread            1  calling linux_trbk from intel_trbk()
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:240] Backtrace(s) for program '/home/aldevaran/slots/2/oifs_43r3_model.exe' : sigcontextptr=0x7fff2ddb0ca0
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:277] Backtrace (size = 23) with plain hex-dump
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [0]: [0x838803] : 0x838803
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [1]: [0x838e09] : 0x838e09
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [2]: [0x820d70] : 0x820d70
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [3]: [0x1d8bb20] : 0x1d8bb20
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [4]: [0x1cc4a8f] : 0x1cc4a8f
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [5]: [0x144b066] : 0x144b066
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [6]: [0x143e1ec] : 0x143e1ec
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [7]: [0x1435fbf] : 0x1435fbf
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [8]: [0x1433058] : 0x1433058
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [9]: [0xe5f4b8] : 0xe5f4b8
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [10]: [0x15c1e62] : 0x15c1e62
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [11]: [0x15ac40e] : 0x15ac40e
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [12]: [0x6620b4] : 0x6620b4
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [13]: [0x4a0e7c] : 0x4a0e7c
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [14]: [0x49dc29] : 0x49dc29
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [15]: [0x49ce72] : 0x49ce72
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [16]: [0x49cd68] : 0x49cd68
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [17]: [0x4078ad] : 0x4078ad
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [18]: [0x40276f] : 0x40276f
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [19]: [0x40270d] : 0x40270d
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [20]: [0x1d8287a] : 0x1d8287a
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [21]: [0x1d840d7] : 0x1d840d7
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:340] [22]: [0x4025e5] : 0x4025e5
  [LinuxTraceBack@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/utilities/linuxtrbk.c:370] End of backtrace(s)
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190341:1676311421:916.890] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#8, nsigs = 1
[EC_DRHOOK:aldevaran-desktop:1:1:1299:1299] [20230213:190341:1676311421:916.890] [signal_drhook@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x401140 for signal#8, nsigs = 1
forrtl: error (72): floating overflow
Image              PC                Routine            Line        Source             
oifs_43r3_model.e  000000000081FCF1  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001D8BB20  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001CC4A8F  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000144B066  gprh_                     128  gprh.F90
oifs_43r3_model.e  000000000143E1EC  cpg_dia_                  600  cpg_dia.F90
oifs_43r3_model.e  0000000001435FBF  cpg_                      718  cpg.F90
oifs_43r3_model.e  0000000001433058  cpg_drv_                  351  cpg_drv.F90
oifs_43r3_model.e  0000000000E5F4B8  gp_model_                 419  gp_model.F90
oifs_43r3_model.e  00000000015C1E62  gp_model_heap_             74  gp_model_heap.F90
oifs_43r3_model.e  00000000015AC40E  scan2m_                   535  scan2m.F90
oifs_43r3_model.e  00000000006620B4  stepo_                    327  stepo.F90
oifs_43r3_model.e  00000000004A0E7C  cnt4_                    1133  cnt4.F90
oifs_43r3_model.e  000000000049DC29  cnt3_                     267  cnt3.F90
oifs_43r3_model.e  000000000049CE72  cnt2_                      88  cnt2.F90
oifs_43r3_model.e  000000000049CD68  cnt1_                      92  cnt1.F90
oifs_43r3_model.e  00000000004078AD  cnt0_                     146  cnt0.F90
oifs_43r3_model.e  000000000040276F  MAIN__                     96  master.F90
oifs_43r3_model.e  000000000040270D  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001D8287A  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001D840D7  Unknown               Unknown  Unknown
oifs_43r3_model.e  00000000004025E5  Unknown               Unknown  Unknown
..The child process has been killed with signal: 6
>>> Printing last 70 lines from file: NODE.001_01

         AVE   0.255079891903225E-05 0.000000000000000E+00 0.103799465456340E-01
 GPNORM CIW                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.940965572136804E-05 0.000000000000000E+00 0.149014462132628E-01
 GPNORM CC                   AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.258034695057593E+00 0.000000000000000E+00 0.100000000000000E+01
 GPNORM RFL                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.269479180630289E-04 0.000000000000000E+00 0.242512910950806E-01
 GPNORM SFL                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.466643657473374E-05 0.000000000000000E+00 0.628372661628169E-02
 GPNORM CRFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.413970893290044E-04 0.000000000000000E+00 0.195725051308907E-01
 GPNORM CSFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.225297169698812E-04 0.000000000000000E+00 0.111186729708358E-01
 GPNORM PFRC                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.218483772931207E+00 0.000000000000000E+00 0.100000000000000E+01
 NSTEP =    48 STEPO   F00000000
 CREATE RESTART FILE ./srf00001200.0001                                                                                                                                                                                                                                              
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./srf00001200.0001 MODE=w
 IO-STREAM CLOSED - ./srf00001200.0001
 MPI-TASK:   1 - ************ BYTES IN     34 RECORDS TRANSFERRED IN    1.6151 SECONDS******** Mbytes/s, TOTAL TIME=    2.1806(74.1%)
 CREATE RESTART CONTROL FILE ./rcf                                                                                                                   
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =    48 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+000048 MODE=w
 IO-STREAM CLOSED - ICMGGh7zg+000048
 MPI-TASK:   1 -    300568394 BYTES IN      6 RECORDS TRANSFERRED IN    0.0002 SECONDS******** Mbytes/s, TOTAL TIME=    0.0060( 3.3%)
 NSTEP =    48 STEPO   0AA000000
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMSHh7zg+000048 MODE=a
 IO-STREAM CLOSED - ./ICMSHh7zg+000048
 MPI-TASK:   1 -    707765250 BYTES IN    202 RECORDS TRANSFERRED IN    0.0092 SECONDS 76931.0 Mbytes/s, TOTAL TIME=    0.1728( 5.3%)
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000048 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+000048
 MPI-TASK:   1 -   4809094295 BYTES IN    125 RECORDS TRANSFERRED IN    0.0061 SECONDS788376.1 Mbytes/s, TOTAL TIME=    0.1781( 3.4%)
 STEPO_FPOS WAS : B00000F00E
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000048 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+000048
 MPI-TASK:   1 -    291994761 BYTES IN      2 RECORDS TRANSFERRED IN    0.0001 SECONDS******** Mbytes/s, TOTAL TIME=    0.0030( 3.3%)
 STEPO_FPOS WAS : V00000000Y
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000048 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+000048
 MPI-TASK:   1 -    300568394 BYTES IN      4 RECORDS TRANSFERRED IN    0.0003 SECONDS******** Mbytes/s, TOTAL TIME=    0.0051( 5.9%)
 STEPO_FPOS WAS : T00000000M
 NSTEP =    48 STEPO   0AAA00AAA
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =    48 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+000048 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+000048
 MPI-TASK:   1 -    300568385 BYTES IN      7 RECORDS TRANSFERRED IN    0.0006 SECONDS500947.3 Mbytes/s, TOTAL TIME=    0.0079( 7.6%)
 19:02:28 STEP   48 H=  12:00 +CPU= 24.101
 NSTEP =    49 STEPO   0AAA00AAA
 19:02:45 STEP   49 H=  12:15 +CPU= 16.766
ISTEP=      50 RSOLINC= 1361.4482 RI0= 1365.0000 ZI0= 1361.4482 RIP0= 1361.4482
ISTEP=      50 ZI0= 1361.4482 ZSEASON= 1.000000000 REA=149597870000.00 RDEASO=149597870000.00
 NSTEP =    50 STEPO   0AAA00AAA
 19:03:03 STEP   50 H=  12:30 +CPU= 17.501
 NSTEP =    51 STEPO   0AAA00AAA
 19:03:20 STEP   51 H=  12:45 +CPU= 17.259
 NSTEP =    52 STEPO   0AAA00AAA
 19:03:38 STEP   52 H=  13:00 +CPU= 17.141
 NSTEP =    53 STEPO   0AAA00AAA
------------------------------------------------
CNT0 not found; string returned was: 'STEPO'
>>> Printing last 8 lines from file: ifs.stat

 19:02:09 FULLPOS-T DYNFPOS     48     0.419    0.419    0.428     13:23     13:44 0.48975583934071E-04       2GB       0MB
 19:02:09 0AAA00AAA STEPO       48     0.403    0.403    0.410     13:23     13:45 0.48975583934071E-04       2GB       0MB
 19:02:28 0AAA00AAA STEPO       49    17.824   17.824   18.352     13:41     14:03 0.48975583934071E-04       2GB       0MB
 19:02:45 0AAA00AAA STEPO       50    16.767   16.767   17.156     13:58     14:20 0.48975583934071E-04       2GB       0MB
 19:03:03 0AAA00AAA STEPO       51    17.501   17.501   17.937     14:16     14:38 0.48975583934071E-04       2GB       0MB
 19:03:20 0AAA00AAA STEPO       52    17.259   17.259   17.661     14:33     14:56 0.48975583934071E-04       2GB       0MB
 19:03:38 0AAA00AAA STEPO       53    17.141   17.141   17.496     14:50     15:13 0.48975583934071E-04       2GB       0MB
------------------------------------------------
>>> Printing last 11 lines from file: rcf

 CSTEP   = "      48",
 CTIME   = "00001200      ",
 NSTEPLPP        =         201,         202,          49,      228226,      228227, 2*0,          36, 2*0,
 IPRGPNSRES      =           1,
 IPRGPEWRES      =           1,
 IPRTRWRES       =           1,
 IPRTRVRES       =           1,
 GMASS0  =  0.000000000000000E+000,
 GMASSI  =  0.000000000000000E+000
 /
------------------------------------------------
>>> Printing last 8 lines from file: /home/aldevaran/slots/2/progress_file_12209668.xml

<running_values>
  <last_cpu_time>887.090000</last_cpu_time>
  <upload_file_number>0</upload_file_number>
  <last_iter>52</last_iter>
  <last_upload>0</last_upload>
  <model_completed>0</model_completed>
</running_values>
------------------------------------------------
..Failed, model did not complete successfully

</stderr_txt>
]]>
No trickles!


©2024 climateprediction.net