climateprediction.net home page
Task 21765952

Task 21765952

Name hadcm3s_gf59_190012_240_844_011910805_0
Workunit 11910805
Created 17 Oct 2019, 22:06:34 UTC
Sent 18 Oct 2019, 16:03:57 UTC
Report deadline 29 Sep 2020, 21:23:57 UTC
Received 29 Nov 2019, 17:00:17 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1473844
Run time 7 days 3 hours 12 min 46 sec
CPU time 2 days 10 hours 10 min 37 sec
Validate state Invalid
Credit 5,287.68
Device peak FLOPS 4.77 GFLOPS
Application version UK Met Office HadCM3 short v8.36
i686-pc-linux-gnu
Peak working set size 171.86 MB
Peak swap size 214.81 MB
Peak disk usage 193.45 MB
Stderr
<core_client_version>7.14.2</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
11:03:35 (1256173): called boinc_finish(193)
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (20 frames):
../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80bc177]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ed7b40]
/usr/lib32/libc.so.6(getenv+0xa2)[0xf79e7b22]
/usr/lib32/libc.so.6(+0xba56d)[0xf7a6b56d]
/usr/lib32/libc.so.6(+0xba92e)[0xf7a6b92e]
/usr/lib32/libc.so.6(localtime_r+0x1b)[0xf7a6994b]
../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x80b7632]
../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x80b7d80]
../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x80b7e71]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7ed7b40]
linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7ed7b29]
/usr/lib32/libc.so.6(nanosleep+0x5b)[0xf7a7bedb]
/usr/lib32/libc.so.6(usleep+0x45)[0xf7aae865]
../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x80cead5]
../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x804f747]
../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x804fe7a]
../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x80515bd]
../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x80517bd]
/usr/lib32/libc.so.6(__libc_start_main+0xf9)[0xf79cffa9]
../../projects/climateprediction.net/hadcm3s_8.36_i686-pc-linux-gnu[0x804c7a1]

Exiting...
MainError:	11:39:49 PM	No files match the supplied pattern.
MainError:	11:39:49 PM	No files match the supplied pattern.
MainError:	11:33:20 AM	No files match the supplied pattern.
MainError:	11:33:20 AM	No files match the supplied pattern.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
MainError:	06:49:40 AM	No files match the supplied pattern.
MainError:	06:49:40 AM	No files match the supplied pattern.
MainError:	03:55:41 PM	No files match the supplied pattern.
MainError:	03:55:41 PM	No files match the supplied pattern.
MainError:	11:29:27 PM	No files match the supplied pattern.
MainError:	11:29:27 PM	No files match the supplied pattern.
MainError:	08:35:41 AM	No files match the supplied pattern.
MainError:	08:35:41 AM	No files match the supplied pattern.
MainError:	09:12:03 PM	No files match the supplied pattern.
MainError:	09:12:03 PM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	09:50:05 AM	No files match the supplied pattern.
MainError:	09:50:06 AM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received: Software termination signal from kill 
Signal 15 received: Abnormal termination triggered by abort call
Signal 15 received, exiting...
21:11:09 (425607): called boinc_finish(193)
Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=425607, selfPID=425607, iMonCtr=1
MainError:	09:08:01 PM	No files match the supplied pattern.
MainError:	09:08:01 PM	No files match the supplied pattern.
MainError:	04:17:50 AM	No files match the supplied pattern.
MainError:	04:17:50 AM	No files match the supplied pattern.
MainError:	11:27:19 AM	No files match the supplied pattern.
MainError:	11:27:19 AM	No files match the supplied pattern.
Signal 8 received: Floating point exception
Signal 8 received: Segment violation
Signal 8 received: Software termination signal from kill 
Signal 8 received: Abnormal termination triggered by abort call
Signal 8 received, exiting...
21:59:26 (25923): called boinc_finish(193)
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25918, iMonCtr=1
Model crash detected, will try to restart...
MainError:	07:36:05 PM	No files match the supplied pattern.
MainError:	07:36:05 PM	No files match the supplied pattern.
MainError:	03:02:13 AM	No files match the supplied pattern.
MainError:	03:02:13 AM	No files match the supplied pattern.
MainError:	11:50:39 AM	No files match the supplied pattern.
MainError:	11:50:39 AM	No files match the supplied pattern.
MainError:	09:54:22 PM	No files match the supplied pattern.
MainError:	09:54:22 PM	No files match the supplied pattern.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
MainError:	06:59:35 AM	No files match the supplied pattern.
MainError:	06:59:35 AM	No files match the supplied pattern.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
MainError:	03:32:34 PM	No files match the supplied pattern.
MainError:	03:32:34 PM	No files match the supplied pattern.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Sorry, too many model crashes! :-(
23:59:27 (25918): called boinc_finish(22)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
29 Nov 2019 15:36:44 1473844 21765952 hadcm3s_gf59_190012_240_844_011910805_0 440,640 214,083 0.4858
29 Nov 2019 07:04:46 1473844 21765952 hadcm3s_gf59_190012_240_844_011910805_0 414,720 220,148 0.5308
28 Nov 2019 22:01:32 1473844 21765952 hadcm3s_gf59_190012_240_844_011910805_0 388,800 321,882 0.8279
28 Nov 2019 12:16:44 1473844 21765952 hadcm3s_gf59_190012_240_844_011910805_0 362,880 286,272 0.7889
28 Nov 2019 03:57:47 1473844 21765952 hadcm3s_gf59_190012_240_844_011910805_0 336,960 255,757 0.7590
27 Nov 2019 20:32:20 1473844 21765952 hadcm3s_gf59_190012_240_844_011910805_0 311,040 229,197 0.7369
27 Nov 2019 12:28:08 1473844 21765952 hadcm3s_gf59_190012_240_844_011910805_0 285,120 260,926 0.9151
27 Nov 2019 05:16:57 1473844 21765952 hadcm3s_gf59_190012_240_844_011910805_0 259,200 235,295 0.9078
26 Nov 2019 22:05:54 1473844 21765952 hadcm3s_gf59_190012_240_844_011910805_0 233,280 209,643 0.8987
26 Nov 2019 12:44:37 1473844 21765952 hadcm3s_gf59_190012_240_844_011910805_0 207,360 183,308 0.8840
25 Nov 2019 21:14:37 1473844 21765952 hadcm3s_gf59_190012_240_844_011910805_0 181,440 150,307 0.8284
25 Nov 2019 08:36:03 1473844 21765952 hadcm3s_gf59_190012_240_844_011910805_0 155,520 111,215 0.7151
24 Nov 2019 23:31:01 1473844 21765952 hadcm3s_gf59_190012_240_844_011910805_0 129,600 78,851 0.6084
23 Nov 2019 16:00:16 1473844 21765952 hadcm3s_gf59_190012_240_844_011910805_0 103,680 46,477 0.4483
23 Nov 2019 06:54:34 1473844 21765952 hadcm3s_gf59_190012_240_844_011910805_0 77,760 14,429 0.1856
22 Nov 2019 11:36:56 1473844 21765952 hadcm3s_gf59_190012_240_844_011910805_0 51,840 84,333 1.6268
21 Nov 2019 23:42:48 1473844 21765952 hadcm3s_gf59_190012_240_844_011910805_0 25,920 42,028 1.6215


©2024 climateprediction.net