climateprediction.net home page
Task 22245095

Task 22245095

Name oifs_43r3_ps_0063_2021050100_123_945_12163152_0
Workunit 12163152
Created 28 Nov 2022, 19:21:47 UTC
Sent 28 Nov 2022, 19:33:29 UTC
Report deadline 28 Dec 2022, 19:33:29 UTC
Received 8 Dec 2022, 4:43:20 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1523442
Run time 22 min 20 sec
CPU time 17 min 15 sec
Validate state Invalid
Credit 241.92
Device peak FLOPS 5.86 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.01
x86_64-pc-linux-gnu
Peak working set size 4,253.14 MB
Peak swap size 4,974.12 MB
Peak disk usage 1,206.62 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.01_x86_64-pc-linux-gnu
(argv1) start_date: 2021050100
(argv2) exptid: hpi1
(argv3) unique_member_id: 0063
(argv4) batchid: 945
(argv5) wuid: 12163152
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/7
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.01
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163152
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/7/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/7/oifs_43r3_ps_app_1.01_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_bead493e53b4e9ce6949827b4164730b to: /var/lib/boinc-client/slots/7/oifs_43r3_ps_0063_2021050100_123_945_12163152.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/7/oifs_43r3_ps_0063_2021050100_123_945_12163152.zip
ic_ancil_file: ic_ancil_12163152
ifsdata_file: ifsdata_12163152
climate_data_file: clim_data_12163152
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
Copying IC ancils from: ../../projects/climateprediction.net/jf_7cd9c14e582025aea719d563da24f4f0 to: /var/lib/boinc-client/slots/7/ic_ancil_12163152.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/7/ic_ancil_12163152.zip
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_5f7c9391e2e65e5dfff8f4bf41b0b5e8 to: /var/lib/boinc-client/slots/7/ifsdata/ifsdata_12163152.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/7/ifsdata/ifsdata_12163152.zip
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/7/159l_2/clim_data_12163152.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/7/159l_2/clim_data_12163152.zip
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0063_2021050100_123_945_12163152_0_r1717255186
The child process has been launched with process id: 118784
Executing the command: /var/lib/boinc-client/slots/7/./master.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:B5:1:1:118784:118784] [20221208:042809:1670470089:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:B5:1:1:118784:118784] [20221208:042809:1670470089:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:B5:1:1:118784:118784] [20221208:042809:1670470089:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:B5:1:1:118784:118784] [20221208:042809:1670470089:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:B5:1:1:118784:118784] [20221208:042809:1670470089:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:B5:1:1:118784:118784] [20221208:042809:1670470089:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:B5:1:1:118784:118784] [20221208:042809:1670470089:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:B5:1:1:118784:118784] [20221208:042809:1670470089:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:B5:1:1:118784:118784] [20221208:042809:1670470089:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:B5:1:1:118784:118784] [20221208:042809:1670470089:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:B5:1:1:118784:118784] [20221208:042809:1670470089:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:B5:1:1:118784:118784] [20221208:042809:1670470089:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:B5:1:1:118784:118784] [20221208:042809:1670470089:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:B5:1:1:118784:118784] [20221208:042809:1670470089:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:B5:1:1:118784:118784] [20221208:042809:1670470089:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:B5:1:1:118784:118784] [20221208:042809:1670470089:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:B5:1:1:118784:118784] [20221208:042809:1670470089:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:B5:1:1:118784:118784] [20221208:042809:1670470089:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:B5:1:1:118784:118784] [20221208:042809:1670470089:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:B5:1:1:118784:118784] [20221208:042809:1670470089:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:B5:1:1:118784:118784] [20221208:042809:1670470089:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:B5:1:1:118784:118784] [20221208:042809:1670470089:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:B5:1:1:118784:118784] [20221208:042809:1670470089:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:B5:1:1:118784:118784] [20221208:042809:1670470089:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:B5:1:1:118784:118784] [20221208:042809:1670470089:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:B5:1:1:118784:118784] [20221208:042809:1670470089:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:B5:1:1:118784:118784] [20221208:042809:1670470089:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:B5:1:1:118784:118784] [20221208:042809:1670470089:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:B5:1:1:118784:118784] [20221208:042809:1670470089:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:B5:1:1:118784:118784] [20221208:042809:1670470089:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  04:28:39 STEP    0 H=   0:00 +CPU= 27.770
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhpi1+000000
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhpi1+000000
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhpi1+000000
  04:28:58 STEP    1 H=   1:00 +CPU= 18.898
  04:29:15 STEP    2 H=   2:00 +CPU= 16.746
  04:29:41 STEP    3 H=   3:00 +CPU= 25.753
  04:29:58 STEP    4 H=   4:00 +CPU= 16.628
  04:30:14 STEP    5 H=   5:00 +CPU= 16.216
  04:30:40 STEP    6 H=   6:00 +CPU= 26.226
  04:30:57 STEP    7 H=   7:00 +CPU= 16.181
  04:31:13 STEP    8 H=   8:00 +CPU= 16.644
  04:31:39 STEP    9 H=   9:00 +CPU= 25.493
  04:31:56 STEP   10 H=  10:00 +CPU= 16.614
  04:32:12 STEP   11 H=  11:00 +CPU= 16.115
  04:32:40 STEP   12 H=  12:00 +CPU= 28.149
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhpi1+000012
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhpi1+000012
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhpi1+000012
  04:32:56 STEP   13 H=  13:00 +CPU= 16.024
  04:33:13 STEP   14 H=  14:00 +CPU= 16.489
  04:33:38 STEP   15 H=  15:00 +CPU= 25.380
  04:33:55 STEP   16 H=  16:00 +CPU= 16.471
  04:34:11 STEP   17 H=  17:00 +CPU= 16.065
  04:34:37 STEP   18 H=  18:00 +CPU= 25.559
  04:34:52 STEP   19 H=  19:00 +CPU= 15.551
  04:35:08 STEP   20 H=  20:00 +CPU= 15.878
  04:35:33 STEP   21 H=  21:00 +CPU= 24.587
  04:35:51 STEP   22 H=  22:00 +CPU= 17.368
  04:36:58 STEP   23 H=  23:00 +CPU= 18.168
  04:41:05 STEP   24 H=  24:00 +CPU= 33.168
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhpi1+000024
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhpi1+000024
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhpi1+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163152/ICMGGhpi1+000000
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163152/ICMSHhpi1+000000
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163152/ICMUAhpi1+000000
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163152/ICMGGhpi1+000012
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163152/ICMSHhpi1+000012
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163152/ICMUAhpi1+000012
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0063_2021050100_123_945_12163152_0_r1717255186_0.zip
Uploading the intermediate file: upload_file_0.zip
  04:41:45 STEP   25 H=  25:00 +CPU= 17.046
Uploading trickle at timestep: 86400
  04:42:35 STEP   26 H=  26:00 +CPU= 16.433
  04:43:03 STEP   27 H=  27:00 +CPU= 25.911
  04:43:22 STEP   28 H=  28:00 +CPU= 17.468
  04:43:39 STEP   29 H=  29:00 +CPU= 17.405
  04:44:08 STEP   30 H=  30:00 +CPU= 27.965
  04:44:25 STEP   31 H=  31:00 +CPU= 16.980
  04:44:43 STEP   32 H=  32:00 +CPU= 17.931
  04:45:11 STEP   33 H=  33:00 +CPU= 27.419
  04:45:28 STEP   34 H=  34:00 +CPU= 17.415
  04:45:46 STEP   35 H=  35:00 +CPU= 17.437
  04:46:17 STEP   36 H=  36:00 +CPU= 29.809
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhpi1+000036
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhpi1+000036
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhpi1+000036
  04:46:34 STEP   37 H=  37:00 +CPU= 16.480
  04:46:55 STEP   38 H=  38:00 +CPU= 17.192
  04:47:26 STEP   39 H=  39:00 +CPU= 26.793
  04:47:44 STEP   40 H=  40:00 +CPU= 18.106
  04:48:04 STEP   41 H=  41:00 +CPU= 17.283
  04:48:33 STEP   42 H=  42:00 +CPU= 28.145
  04:48:51 STEP   43 H=  43:00 +CPU= 17.694
  04:49:09 STEP   44 H=  44:00 +CPU= 17.732
  04:49:36 STEP   45 H=  45:00 +CPU= 27.632
  04:49:55 STEP   46 H=  46:00 +CPU= 18.187
  04:50:13 STEP   47 H=  47:00 +CPU= 17.848
  04:50:49 STEP   48 H=  48:00 +CPU= 32.179
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMGGhpi1+000048
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMSHhpi1+000048
Moving to projects directory: /var/lib/boinc-client/slots/7/ICMUAhpi1+000048
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163152/ICMGGhpi1+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163152/ICMSHhpi1+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163152/ICMUAhpi1+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163152/ICMGGhpi1+000036
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163152/ICMSHhpi1+000036
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12163152/ICMUAhpi1+000036
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0063_2021050100_123_945_12163152_0_r1717255186_1.zip
Uploading the intermediate file: upload_file_1.zip
  04:51:07 STEP   49 H=  49:00 +CPU= 17.327
Uploading trickle at timestep: 172800
The child process terminated with status: 0
..Failed, model did not complete successfully

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 15:37:06 1523442 22245095 oifs_43r3_ps_0063_2021050100_123_945_12163152_0 172,800 1,023 0.0059
09 May 2023 15:37:04 1523442 22245095 oifs_43r3_ps_0063_2021050100_123_945_12163152_0 86,400 512 0.0059


©2024 climateprediction.net