climateprediction.net home page
Task 22309061

Task 22309061

Name oifs_43r3_bl_a1m6_2016092300_15_991_12208881_0
Workunit 12208881
Created 13 Feb 2023, 15:52:02 UTC
Sent 14 Feb 2023, 2:32:35 UTC
Report deadline 15 Apr 2023, 2:32:35 UTC
Received 14 Feb 2023, 4:34:05 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1525874
Run time 48 min 19 sec
CPU time 46 min 42 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 5.19 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.11
x86_64-pc-linux-gnu
Peak working set size 5,051.57 MB
Peak swap size 5,930.79 MB
Peak disk usage 1,343.76 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.11_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a1m6
(argv4) batchid: 991
(argv5) wuid: 12208881
(argv6) fclen: 15
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/25
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.11
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208881
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/25/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/25/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_e1381118abbedaa5125a52fc3747e787 to: /var/lib/boinc-client/slots/25/oifs_43r3_bl_a1m6_2016092300_15_991_12208881.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/25/oifs_43r3_bl_a1m6_2016092300_15_991_12208881.zip
ic_ancil_file: ic_ancil_12208881
ifsdata_file: ifsdata_12208881
climate_data_file: clim_data_12208881
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc-client/slots/25/ic_ancil_12208881.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/25/ic_ancil_12208881.zip
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_7c277eba44c24bdc8c04a77cf23e23f6 to: /var/lib/boinc-client/slots/25/ifsdata/ifsdata_12208881.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/25/ifsdata/ifsdata_12208881.zip
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/25/159l_2/clim_data_12208881.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/25/159l_2/clim_data_12208881.zip
Checking for progress XML file: /var/lib/boinc-client/slots/25/progress_file_12208881.xml
Creating progress file: /var/lib/boinc-client/slots/25/progress_file_12208881.xml
last_cpu_time: 0
upload_file_number: 0
last_iter: 0
last_upload: 0
model_completed: 0
total_length_of_simulation: 1296000
result_base_name: oifs_43r3_bl_a1m6_2016092300_15_991_12208881_0_r1058674788
The child process has been launched with process id: 159443
Executing the command: /var/lib/boinc-client/slots/25/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:nosncomp01:1:1:159443:159443] [20230214:031303:1676344383:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2091] fp = 0x30e4a00
[EC_DRHOOK:nosncomp01:1:1:159443:159443] [20230214:031303:1676344383:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:nosncomp01:1:1:159443:159443] [20230214:031303:1676344383:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:nosncomp01:1:1:159443:159443] [20230214:031303:1676344383:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:nosncomp01:1:1:159443:159443] [20230214:031303:1676344383:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:nosncomp01:1:1:159443:159443] [20230214:031303:1676344383:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:nosncomp01:1:1:159443:159443] [20230214:031303:1676344383:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:nosncomp01:1:1:159443:159443] [20230214:031303:1676344383:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:nosncomp01:1:1:159443:159443] [20230214:031303:1676344383:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:nosncomp01:1:1:159443:159443] [20230214:031303:1676344383:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:nosncomp01:1:1:159443:159443] [20230214:031303:1676344383:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:nosncomp01:1:1:159443:159443] [20230214:031303:1676344383:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:nosncomp01:1:1:159443:159443] [20230214:031303:1676344383:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:nosncomp01:1:1:159443:159443] [20230214:031303:1676344383:0.000] [ignore_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:nosncomp01:1:1:159443:159443] [20230214:031303:1676344383:0.000] [restore_default_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:nosncomp01:1:1:159443:159443] [20230214:031303:1676344383:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:nosncomp01:1:1:159443:159443] [20230214:031303:1676344383:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f520 (old at (nil))
[EC_DRHOOK:nosncomp01:1:1:159443:159443] [20230214:031303:1676344383:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:nosncomp01:1:1:159443:159443] [20230214:031303:1676344383:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f520 (old at (nil))
[EC_DRHOOK:nosncomp01:1:1:159443:159443] [20230214:031303:1676344383:0.000] [trapfpe_treatment@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:nosncomp01:1:1:159443:159443] [20230214:031303:1676344383:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:nosncomp01:1:1:159443:159443] [20230214:031303:1676344383:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:nosncomp01:1:1:159443:159443] [20230214:031303:1676344383:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f520 (old at (nil))
[EC_DRHOOK:nosncomp01:1:1:159443:159443] [20230214:031303:1676344383:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:nosncomp01:1:1:159443:159443] [20230214:031303:1676344383:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:nosncomp01:1:1:159443:159443] [20230214:031303:1676344383:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:nosncomp01:1:1:159443:159443] [20230214:031303:1676344383:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f520 (old at (nil))
[EC_DRHOOK:nosncomp01:1:1:159443:159443] [20230214:031303:1676344383:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f520 (old at (nil))
[EC_DRHOOK:nosncomp01:1:1:159443:159443] [20230214:031303:1676344383:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f520 (old at (nil))
[EC_DRHOOK:nosncomp01:1:1:159443:159443] [20230214:031303:1676344383:0.000] [catch_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  03:13:38 STEP    0 H=   0:00 +CPU= 30.029
Moving to projects directory: /var/lib/boinc-client/slots/25/ICMGGh7zg+000000
Moving to projects directory: /var/lib/boinc-client/slots/25/ICMSHh7zg+000000
Moving to projects directory: /var/lib/boinc-client/slots/25/ICMUAh7zg+000000
  03:14:02 STEP    1 H=   0:15 +CPU= 23.725
  03:14:26 STEP    2 H=   0:30 +CPU= 24.278
  03:14:50 STEP    3 H=   0:45 +CPU= 23.867
  03:15:16 STEP    4 H=   1:00 +CPU= 25.037
  03:15:40 STEP    5 H=   1:15 +CPU= 24.112
  03:16:04 STEP    6 H=   1:30 +CPU= 23.786
  03:16:28 STEP    7 H=   1:45 +CPU= 24.268
  03:16:54 STEP    8 H=   2:00 +CPU= 24.897
  03:17:16 STEP    9 H=   2:15 +CPU= 22.657
  03:17:40 STEP   10 H=   2:30 +CPU= 23.289
  03:18:03 STEP   11 H=   2:45 +CPU= 23.120
  03:18:34 STEP   12 H=   3:00 +CPU= 30.158
Moving to projects directory: /var/lib/boinc-client/slots/25/ICMGGh7zg+000012
Moving to projects directory: /var/lib/boinc-client/slots/25/ICMSHh7zg+000012
Moving to projects directory: /var/lib/boinc-client/slots/25/ICMUAh7zg+000012
  03:18:59 STEP   13 H=   3:15 +CPU= 24.363
  03:19:23 STEP   14 H=   3:30 +CPU= 23.731
  03:19:47 STEP   15 H=   3:45 +CPU= 23.985
  03:20:11 STEP   16 H=   4:00 +CPU= 24.473
  03:20:36 STEP   17 H=   4:15 +CPU= 24.404
  03:21:00 STEP   18 H=   4:30 +CPU= 24.061
  03:21:25 STEP   19 H=   4:45 +CPU= 24.105
  03:21:50 STEP   20 H=   5:00 +CPU= 24.551
  03:22:15 STEP   21 H=   5:15 +CPU= 24.912
  03:22:40 STEP   22 H=   5:30 +CPU= 24.683
  03:23:04 STEP   23 H=   5:45 +CPU= 23.589
  03:23:35 STEP   24 H=   6:00 +CPU= 30.973
Moving to projects directory: /var/lib/boinc-client/slots/25/ICMGGh7zg+000024
Moving to projects directory: /var/lib/boinc-client/slots/25/ICMSHh7zg+000024
Moving to projects directory: /var/lib/boinc-client/slots/25/ICMUAh7zg+000024
  03:23:58 STEP   25 H=   6:15 +CPU= 22.813
  03:24:24 STEP   26 H=   6:30 +CPU= 24.299
  03:24:48 STEP   27 H=   6:45 +CPU= 23.998
  03:25:13 STEP   28 H=   7:00 +CPU= 24.618
  03:25:39 STEP   29 H=   7:15 +CPU= 25.098
  03:26:03 STEP   30 H=   7:30 +CPU= 23.630
  03:26:27 STEP   31 H=   7:45 +CPU= 24.048
  03:26:52 STEP   32 H=   8:00 +CPU= 24.824
  03:27:17 STEP   33 H=   8:15 +CPU= 24.917
  03:27:41 STEP   34 H=   8:30 +CPU= 23.738
  03:28:06 STEP   35 H=   8:45 +CPU= 24.449
  03:28:37 STEP   36 H=   9:00 +CPU= 30.590
Moving to projects directory: /var/lib/boinc-client/slots/25/ICMGGh7zg+000036
Moving to projects directory: /var/lib/boinc-client/slots/25/ICMSHh7zg+000036
Moving to projects directory: /var/lib/boinc-client/slots/25/ICMUAh7zg+000036
  03:29:01 STEP   37 H=   9:15 +CPU= 23.903
  03:29:26 STEP   38 H=   9:30 +CPU= 24.698
  03:29:50 STEP   39 H=   9:45 +CPU= 23.664
  03:30:16 STEP   40 H=  10:00 +CPU= 24.945
  03:30:43 STEP   41 H=  10:15 +CPU= 26.620
  03:31:08 STEP   42 H=  10:30 +CPU= 24.752
  03:31:33 STEP   43 H=  10:45 +CPU= 24.801
  03:31:59 STEP   44 H=  11:00 +CPU= 25.346
  03:32:24 STEP   45 H=  11:15 +CPU= 24.654
  03:32:51 STEP   46 H=  11:30 +CPU= 26.065
  03:33:22 STEP   47 H=  11:45 +CPU= 29.560
  03:34:04 STEP   48 H=  12:00 +CPU= 40.998
Moving to projects directory: /var/lib/boinc-client/slots/25/ICMGGh7zg+000048
Moving to projects directory: /var/lib/boinc-client/slots/25/ICMSHh7zg+000048
Moving to projects directory: /var/lib/boinc-client/slots/25/ICMUAh7zg+000048
  03:34:33 STEP   49 H=  12:15 +CPU= 28.169
  03:34:59 STEP   50 H=  12:30 +CPU= 25.679
  03:35:24 STEP   51 H=  12:45 +CPU= 24.319
  03:35:49 STEP   52 H=  13:00 +CPU= 24.999
  03:36:15 STEP   53 H=  13:15 +CPU= 25.347
  03:36:41 STEP   54 H=  13:30 +CPU= 25.390
  03:37:06 STEP   55 H=  13:45 +CPU= 24.492
  03:37:33 STEP   56 H=  14:00 +CPU= 26.055
  03:37:58 STEP   57 H=  14:15 +CPU= 24.616
  03:38:29 STEP   58 H=  14:30 +CPU= 30.105
  03:39:00 STEP   59 H=  14:45 +CPU= 30.032
  03:39:33 STEP   60 H=  15:00 +CPU= 32.672
Moving to projects directory: /var/lib/boinc-client/slots/25/ICMGGh7zg+000060
Moving to projects directory: /var/lib/boinc-client/slots/25/ICMSHh7zg+000060
Moving to projects directory: /var/lib/boinc-client/slots/25/ICMUAh7zg+000060
  03:39:58 STEP   61 H=  15:15 +CPU= 25.079
  03:40:24 STEP   62 H=  15:30 +CPU= 24.898
  03:40:50 STEP   63 H=  15:45 +CPU= 25.418
  03:41:16 STEP   64 H=  16:00 +CPU= 25.795
  03:41:40 STEP   65 H=  16:15 +CPU= 24.195
  03:42:07 STEP   66 H=  16:30 +CPU= 25.948
  03:42:36 STEP   67 H=  16:45 +CPU= 28.328
  03:43:04 STEP   68 H=  17:00 +CPU= 27.440
  03:43:31 STEP   69 H=  17:15 +CPU= 26.948
  03:43:58 STEP   70 H=  17:30 +CPU= 26.905
  03:44:26 STEP   71 H=  17:45 +CPU= 27.131
  03:45:01 STEP   72 H=  18:00 +CPU= 34.462
Moving to projects directory: /var/lib/boinc-client/slots/25/ICMGGh7zg+000072
Moving to projects directory: /var/lib/boinc-client/slots/25/ICMSHh7zg+000072
Moving to projects directory: /var/lib/boinc-client/slots/25/ICMUAh7zg+000072
  03:45:27 STEP   73 H=  18:15 +CPU= 26.163
  03:45:54 STEP   74 H=  18:30 +CPU= 26.676
  03:46:21 STEP   75 H=  18:45 +CPU= 26.273
  03:46:49 STEP   76 H=  19:00 +CPU= 28.028
  03:47:16 STEP   77 H=  19:15 +CPU= 26.661
  03:47:43 STEP   78 H=  19:30 +CPU= 26.322
  03:48:11 STEP   79 H=  19:45 +CPU= 26.725
  03:48:40 STEP   80 H=  20:00 +CPU= 28.191
  03:49:07 STEP   81 H=  20:15 +CPU= 27.168
  03:49:35 STEP   82 H=  20:30 +CPU= 27.483
  03:50:04 STEP   83 H=  20:45 +CPU= 28.292
  03:50:43 STEP   84 H=  21:00 +CPU= 37.197
Moving to projects directory: /var/lib/boinc-client/slots/25/ICMGGh7zg+000084
Moving to projects directory: /var/lib/boinc-client/slots/25/ICMSHh7zg+000084
Moving to projects directory: /var/lib/boinc-client/slots/25/ICMUAh7zg+000084
  03:51:12 STEP   85 H=  21:15 +CPU= 28.731
  03:51:43 STEP   86 H=  21:30 +CPU= 30.178
  03:52:14 STEP   87 H=  21:45 +CPU= 30.964
  03:52:44 STEP   88 H=  22:00 +CPU= 29.804
  03:53:13 STEP   89 H=  22:15 +CPU= 28.778
  03:53:43 STEP   90 H=  22:30 +CPU= 29.314
  03:54:12 STEP   91 H=  22:45 +CPU= 29.211
  03:54:43 STEP   92 H=  23:00 +CPU= 30.302
  03:55:12 STEP   93 H=  23:15 +CPU= 28.568
  03:55:41 STEP   94 H=  23:30 +CPU= 28.489
  03:56:10 STEP   95 H=  23:45 +CPU= 28.508
  03:56:51 STEP   96 H=  24:00 +CPU= 40.177
Moving to projects directory: /var/lib/boinc-client/slots/25/ICMGGh7zg+000096
Moving to projects directory: /var/lib/boinc-client/slots/25/ICMSHh7zg+000096
Moving to projects directory: /var/lib/boinc-client/slots/25/ICMUAh7zg+000096
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208881/ICMGGh7zg+000000
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208881/ICMSHh7zg+000000
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208881/ICMUAh7zg+000000
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208881/ICMGGh7zg+000012
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208881/ICMSHh7zg+000012
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208881/ICMUAh7zg+000012
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208881/ICMGGh7zg+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208881/ICMSHh7zg+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208881/ICMUAh7zg+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208881/ICMGGh7zg+000036
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208881/ICMSHh7zg+000036
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208881/ICMUAh7zg+000036
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208881/ICMGGh7zg+000048
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208881/ICMSHh7zg+000048
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208881/ICMUAh7zg+000048
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208881/ICMGGh7zg+000060
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208881/ICMSHh7zg+000060
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208881/ICMUAh7zg+000060
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208881/ICMGGh7zg+000072
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208881/ICMSHh7zg+000072
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208881/ICMUAh7zg+000072
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208881/ICMGGh7zg+000084
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208881/ICMSHh7zg+000084
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12208881/ICMUAh7zg+000084
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1m6_2016092300_15_991_12208881_0_r1058674788_0.zip
Uploading the intermediate file: upload_file_0.zip
  03:57:21 STEP   97 H=  24:15 +CPU= 29.408
  03:57:51 STEP   98 H=  24:30 +CPU= 29.420
  03:58:21 STEP   99 H=  24:45 +CPU= 29.632
  03:58:50 STEP  100 H=  25:00 +CPU= 29.232
  03:59:21 STEP  101 H=  25:15 +CPU= 29.829
  03:59:49 STEP  102 H=  25:30 +CPU= 27.571
  04:00:16 STEP  103 H=  25:45 +CPU= 26.926
..The child process has been killed with signal: 9
>>> Printing last 70 lines from file: NODE.001_01

 GPNORM SFL                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.331833746776605E-07 0.000000000000000E+00 0.192658233925724E-04
 GPNORM CRFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.132266076281209E-07 0.000000000000000E+00 0.112426825142656E-03
 GPNORM CSFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.105084624938604E-06 0.000000000000000E+00 0.165105014882688E-03
 GPNORM PFRC                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.182015289397012E-01 0.000000000000000E+00 0.100000000000000E+01
 NSTEP =    96 STEPO   F00000000
 CREATE RESTART FILE ./srf00010000.0001                                                                                                                                                                                                                                              
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./srf00010000.0001 MODE=w
 IO-STREAM CLOSED - ./srf00010000.0001
 MPI-TASK:   1 - ************ BYTES IN     34 RECORDS TRANSFERRED IN    2.2659 SECONDS******** Mbytes/s, TOTAL TIME=    3.1348(72.3%)
 CREATE RESTART CONTROL FILE ./rcf                                                                                                                   
 WRRESF: DELETED PREVIOUS RESTART FILE OK: ./srf00001200.0001
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =    96 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+000096 MODE=w
 IO-STREAM CLOSED - ICMGGh7zg+000096
 MPI-TASK:   1 -    313420122 BYTES IN      6 RECORDS TRANSFERRED IN    0.0003 SECONDS******** Mbytes/s, TOTAL TIME=    0.0184( 1.6%)
 NSTEP =    96 STEPO   0AA000000
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMSHh7zg+000096 MODE=a
 IO-STREAM CLOSED - ./ICMSHh7zg+000096
 MPI-TASK:   1 -    707765250 BYTES IN    202 RECORDS TRANSFERRED IN    0.0097 SECONDS 72965.5 Mbytes/s, TOTAL TIME=    0.2885( 3.4%)
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000096 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+000096
 MPI-TASK:   1 -   5014721943 BYTES IN    125 RECORDS TRANSFERRED IN    0.0044 SECONDS******** Mbytes/s, TOTAL TIME=    0.1921( 2.3%)
 STEPO_FPOS WAS : B00000F00E
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000096 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+000096
 MPI-TASK:   1 -    304846489 BYTES IN      2 RECORDS TRANSFERRED IN    0.0002 SECONDS******** Mbytes/s, TOTAL TIME=    0.0047( 4.3%)
 STEPO_FPOS WAS : V00000000Y
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000096 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+000096
 MPI-TASK:   1 -    313420122 BYTES IN      4 RECORDS TRANSFERRED IN    0.0004 SECONDS783550.3 Mbytes/s, TOTAL TIME=    0.0087( 4.6%)
 STEPO_FPOS WAS : T00000000M
 NSTEP =    96 STEPO   0AAA00AAA
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =    96 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+000096 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+000096
 MPI-TASK:   1 -    313420113 BYTES IN      7 RECORDS TRANSFERRED IN    0.0004 SECONDS783550.3 Mbytes/s, TOTAL TIME=    0.0125( 3.2%)
 03:56:51 STEP   96 H=  24:00 +CPU= 40.177
 NSTEP =    97 STEPO   0AAA00AAA
 03:57:21 STEP   97 H=  24:15 +CPU= 29.408
 NSTEP =    98 STEPO   0AAA00AAA
 03:57:51 STEP   98 H=  24:30 +CPU= 29.420
 NSTEP =    99 STEPO   0AAA00AAA
 03:58:21 STEP   99 H=  24:45 +CPU= 29.632
ISTEP=     100 RSOLINC= 1361.4482 RI0= 1365.0000 ZI0= 1361.4482 RIP0= 1361.4482
ISTEP=     100 ZI0= 1361.4482 ZSEASON= 1.000000000 REA=149597870000.00 RDEASO=149597870000.00
 NSTEP =   100 STEPO   0AAA00AAA
 03:58:50 STEP  100 H=  25:00 +CPU= 29.232
 NSTEP =   101 STEPO   0AAA00AAA
 03:59:21 STEP  101 H=  25:15 +CPU= 29.829
 NSTEP =   102 STEPO   0AAA00AAA
 03:59:49 STEP  102 H=  25:30 +CPU= 27.571
 NSTEP =   103 STEPO   0AAA00AAA
 04:00:16 STEP  103 H=  25:45 +CPU= 26.926
 NSTEP =   104 STEPO   0AAA00AAA
------------------------------------------------
CNT0 not found; string returned was: 'STEPO'
>>> Printing last 8 lines from file: ifs.stat

 03:57:21 0AAA00AAA STEPO       98    29.408   29.408   29.797     43:34     44:17 0.99126888770578E-06       2GB       0MB
 03:57:51 0AAA00AAA STEPO       99    29.420   29.420   30.145     44:03     44:48 0.99126888770578E-06       2GB       0MB
 03:58:21 0AAA00AAA STEPO      100    29.632   29.632   29.854     44:33     45:17 0.99126888770578E-06       2GB       0MB
 03:58:50 0AAA00AAA STEPO      101    29.232   29.232   29.692     45:02     45:47 0.99126888770578E-06       2GB       0MB
 03:59:21 0AAA00AAA STEPO      102    29.831   29.831   30.692     45:32     46:18 0.99126888770578E-06       2GB       0MB
 03:59:49 0AAA00AAA STEPO      103    27.571   27.571   27.725     46:00     46:46 0.99126888770578E-06       2GB       0MB
 04:00:16 0AAA00AAA STEPO      104    26.926   26.926   27.170     46:26     47:13 0.99126888770578E-06       2GB       0MB
------------------------------------------------
>>> Printing last 11 lines from file: rcf

 CSTEP   = "      96",
 CTIME   = "00010000      ",
 NSTEPLPP        =         201,         202,          49,      228226,      228227, 2*0,          84, 2*0,
 IPRGPNSRES      =           1,
 IPRGPEWRES      =           1,
 IPRTRWRES       =           1,
 IPRTRVRES       =           1,
 GMASS0  =  0.000000000000000E+000,
 GMASSI  =  0.000000000000000E+000
 /
------------------------------------------------
>>> Printing last 8 lines from file: /var/lib/boinc-client/slots/25/progress_file_12208881.xml

<running_values>
  <last_cpu_time>2801.400000</last_cpu_time>
  <upload_file_number>1</upload_file_number>
  <last_iter>104</last_iter>
  <last_upload>86400</last_upload>
  <model_completed>0</model_completed>
</running_values>
------------------------------------------------
..Failed, model did not complete successfully

</stderr_txt>
]]>
No trickles!


©2024 climateprediction.net