climateprediction.net home page
Task 22246106

Task 22246106

Name oifs_43r3_ps_1026_2021050100_123_946_12164115_0
Workunit 12164115
Created 29 Nov 2022, 10:22:31 UTC
Sent 29 Nov 2022, 10:29:10 UTC
Report deadline 29 Dec 2022, 10:29:10 UTC
Received 29 Nov 2022, 13:19:50 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1536307
Run time 12 min 16 sec
CPU time 10 min 42 sec
Validate state Invalid
Credit 241.92
Device peak FLOPS 1.00 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.01
x86_64-pc-linux-gnu
Peak working set size 4,313.78 MB
Peak swap size 4,974.33 MB
Peak disk usage 1,200.42 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.01_x86_64-pc-linux-gnu
(argv1) start_date: 2021050100
(argv2) exptid: hpi1
(argv3) unique_member_id: 1026
(argv4) batchid: 946
(argv5) wuid: 12164115
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/14
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.01
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164115
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/14/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/14/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_d5e5247935eddbc4e8d9b7257972b48b to: /var/lib/boinc-client/slots/14/oifs_43r3_ps_1026_2021050100_123_946_12164115.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/14/oifs_43r3_ps_1026_2021050100_123_946_12164115.zip
ic_ancil_file: ic_ancil_12164115
ifsdata_file: ifsdata_12164115
climate_data_file: clim_data_12164115
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
Copying IC ancils from: ../../projects/climateprediction.net/jf_82fb1834331ba7a484b8720b7c60b5ba to: /var/lib/boinc-client/slots/14/ic_ancil_12164115.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/14/ic_ancil_12164115.zip
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_2202be291ce9da843fae5857adabe45c to: /var/lib/boinc-client/slots/14/ifsdata/ifsdata_12164115.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/14/ifsdata/ifsdata_12164115.zip
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/14/159l_2/clim_data_12164115.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/14/159l_2/clim_data_12164115.zip
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_1026_2021050100_123_946_12164115_0_r589769021
The child process has been launched with process id: 5779
Executing the command: /var/lib/boinc-client/slots/14/./master.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:Desktop:1:1:5779:5779] [20221129:102945:1669717785:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:Desktop:1:1:5779:5779] [20221129:102945:1669717785:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:Desktop:1:1:5779:5779] [20221129:102945:1669717785:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:Desktop:1:1:5779:5779] [20221129:102945:1669717785:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:Desktop:1:1:5779:5779] [20221129:102945:1669717785:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:Desktop:1:1:5779:5779] [20221129:102945:1669717785:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:Desktop:1:1:5779:5779] [20221129:102945:1669717785:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:Desktop:1:1:5779:5779] [20221129:102945:1669717785:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:Desktop:1:1:5779:5779] [20221129:102945:1669717785:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:Desktop:1:1:5779:5779] [20221129:102945:1669717785:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:Desktop:1:1:5779:5779] [20221129:102945:1669717785:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:Desktop:1:1:5779:5779] [20221129:102945:1669717785:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:Desktop:1:1:5779:5779] [20221129:102945:1669717785:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:Desktop:1:1:5779:5779] [20221129:102945:1669717785:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:Desktop:1:1:5779:5779] [20221129:102945:1669717785:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:Desktop:1:1:5779:5779] [20221129:102945:1669717785:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Desktop:1:1:5779:5779] [20221129:102945:1669717785:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:Desktop:1:1:5779:5779] [20221129:102945:1669717785:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Desktop:1:1:5779:5779] [20221129:102945:1669717785:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:Desktop:1:1:5779:5779] [20221129:102945:1669717785:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:Desktop:1:1:5779:5779] [20221129:102945:1669717785:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Desktop:1:1:5779:5779] [20221129:102945:1669717785:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Desktop:1:1:5779:5779] [20221129:102945:1669717785:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:Desktop:1:1:5779:5779] [20221129:102945:1669717785:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Desktop:1:1:5779:5779] [20221129:102945:1669717785:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Desktop:1:1:5779:5779] [20221129:102945:1669717785:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:Desktop:1:1:5779:5779] [20221129:102945:1669717785:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:Desktop:1:1:5779:5779] [20221129:102945:1669717785:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:Desktop:1:1:5779:5779] [20221129:102945:1669717785:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:Desktop:1:1:5779:5779] [20221129:102945:1669717785:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  10:30:02 STEP    0 H=   0:00 +CPU= 16.114
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGhpi1+000000
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHhpi1+000000
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAhpi1+000000
  10:30:11 STEP    1 H=   1:00 +CPU=  9.044
  10:30:20 STEP    2 H=   2:00 +CPU=  8.617
  10:30:33 STEP    3 H=   3:00 +CPU= 13.154
  10:30:42 STEP    4 H=   4:00 +CPU=  9.556
  10:30:52 STEP    5 H=   5:00 +CPU=  9.540
  10:31:07 STEP    6 H=   6:00 +CPU= 14.600
  10:31:15 STEP    7 H=   7:00 +CPU=  8.839
  10:31:24 STEP    8 H=   8:00 +CPU=  8.149
  10:31:38 STEP    9 H=   9:00 +CPU= 14.211
  10:31:46 STEP   10 H=  10:00 +CPU=  8.413
  10:31:56 STEP   11 H=  11:00 +CPU=  9.622
  10:32:13 STEP   12 H=  12:00 +CPU= 17.198
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGhpi1+000012
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHhpi1+000012
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAhpi1+000012
  10:32:22 STEP   13 H=  13:00 +CPU=  8.699
  10:32:31 STEP   14 H=  14:00 +CPU=  9.300
  10:32:45 STEP   15 H=  15:00 +CPU= 14.333
  10:32:54 STEP   16 H=  16:00 +CPU=  8.980
  10:33:03 STEP   17 H=  17:00 +CPU=  8.612
  10:33:16 STEP   18 H=  18:00 +CPU= 13.415
  10:33:26 STEP   19 H=  19:00 +CPU=  9.036
  10:33:35 STEP   20 H=  20:00 +CPU=  9.210
  10:33:48 STEP   21 H=  21:00 +CPU= 12.986
  10:33:57 STEP   22 H=  22:00 +CPU=  8.954
  10:34:06 STEP   23 H=  23:00 +CPU=  8.873
  10:34:23 STEP   24 H=  24:00 +CPU= 17.010
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGhpi1+000024
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHhpi1+000024
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAhpi1+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164115/ICMGGhpi1+000000
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164115/ICMSHhpi1+000000
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164115/ICMUAhpi1+000000
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164115/ICMGGhpi1+000012
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164115/ICMSHhpi1+000012
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164115/ICMUAhpi1+000012
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_1026_2021050100_123_946_12164115_0_r589769021_0.zip
Uploading the intermediate file: upload_file_0.zip
  10:34:31 STEP   25 H=  25:00 +CPU=  7.980
  10:34:40 STEP   26 H=  26:00 +CPU=  9.296
Uploading trickle at timestep: 86400
  10:34:53 STEP   27 H=  27:00 +CPU= 13.459
  10:35:02 STEP   28 H=  28:00 +CPU=  8.801
  10:35:11 STEP   29 H=  29:00 +CPU=  9.181
  10:35:25 STEP   30 H=  30:00 +CPU= 13.784
  10:35:33 STEP   31 H=  31:00 +CPU=  8.132
  10:35:42 STEP   32 H=  32:00 +CPU=  9.058
  10:35:56 STEP   33 H=  33:00 +CPU= 13.740
  10:36:05 STEP   34 H=  34:00 +CPU=  8.447
  10:36:13 STEP   35 H=  35:00 +CPU=  8.865
  10:36:28 STEP   36 H=  36:00 +CPU= 14.107
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGhpi1+000036
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHhpi1+000036
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAhpi1+000036
  10:36:36 STEP   37 H=  37:00 +CPU=  8.883
  10:36:46 STEP   38 H=  38:00 +CPU=  9.493
  10:36:59 STEP   39 H=  39:00 +CPU= 12.877
  10:37:07 STEP   40 H=  40:00 +CPU=  7.769
  10:37:16 STEP   41 H=  41:00 +CPU=  9.008
  10:37:29 STEP   42 H=  42:00 +CPU= 13.210
  10:37:37 STEP   43 H=  43:00 +CPU=  7.806
  10:37:45 STEP   44 H=  44:00 +CPU=  7.998
  10:37:57 STEP   45 H=  45:00 +CPU= 12.721
  10:38:05 STEP   46 H=  46:00 +CPU=  7.940
  10:38:13 STEP   47 H=  47:00 +CPU=  8.048
  10:38:29 STEP   48 H=  48:00 +CPU= 16.081
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMGGhpi1+000048
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMSHhpi1+000048
Moving to projects directory: /var/lib/boinc-client/slots/14/ICMUAhpi1+000048
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164115/ICMGGhpi1+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164115/ICMSHhpi1+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164115/ICMUAhpi1+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164115/ICMGGhpi1+000036
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164115/ICMSHhpi1+000036
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12164115/ICMUAhpi1+000036
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_1026_2021050100_123_946_12164115_0_r589769021_1.zip
Uploading the intermediate file: upload_file_1.zip
  10:38:38 STEP   49 H=  49:00 +CPU=  8.293
  10:38:47 STEP   50 H=  50:00 +CPU=  9.636
Uploading trickle at timestep: 172800
  10:39:02 STEP   51 H=  51:00 +CPU= 14.570
  10:39:11 STEP   52 H=  52:00 +CPU=  8.609
  10:39:19 STEP   53 H=  53:00 +CPU=  7.987
  10:39:32 STEP   54 H=  54:00 +CPU= 13.510
  10:39:40 STEP   55 H=  55:00 +CPU=  7.688
  10:39:49 STEP   56 H=  56:00 +CPU=  8.921
  10:40:01 STEP   57 H=  57:00 +CPU= 12.465
  10:40:10 STEP   58 H=  58:00 +CPU=  8.525
  10:40:19 STEP   59 H=  59:00 +CPU=  9.208
The child process terminated with status: 0
..Failed, model did not complete successfully

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 15:00:55 1536307 22246106 oifs_43r3_ps_1026_2021050100_123_946_12164115_0 172,800 529 0.0031
09 May 2023 15:00:55 1536307 22246106 oifs_43r3_ps_1026_2021050100_123_946_12164115_0 86,400 279 0.0032


©2024 climateprediction.net