Task 16029024

Name	hadcm3n_u0cv_2020_40_008391659_2
Workunit	8542518
Created	21 Sep 2013, 0:45:36 UTC
Sent	21 Sep 2013, 1:00:14 UTC
Report deadline	21 Dec 2013, 8:27:25 UTC
Received	16 Oct 2013, 23:12:15 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1216821
Run time	20 days 13 hours 3 min 15 sec
CPU time	19 days 17 hours 58 min 23 sec
Validate state	Invalid
Credit	9,642.24
Device peak FLOPS	1.22 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.6.41</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGABRT: abort called Stack trace (9 frames): /home/huo/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xb772e400] [0xb772e424] /lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xb75541df] /lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xb7557825] /home/huo/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /home/huo/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /home/huo/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xb753f4d3] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=19915, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /home/huo/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xb771a400] [0xb771a424] /lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xb75401df] /lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xb7543825] /home/huo/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /home/huo/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /home/huo/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xb752b4d3] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=19915, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /home/huo/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xb778d400] [0xb778d424] /lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xb75b31df] /lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xb75b6825] /home/huo/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /home/huo/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /home/huo/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xb759e4d3] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=19915, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /home/huo/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xb7785400] [0xb7785424] /lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xb75ab1df] /lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xb75ae825] /home/huo/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /home/huo/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /home/huo/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xb75964d3] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=19915, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /home/huo/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xb76f0400] [0xb76f0424] /lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xb75161df] /lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xb7519825] /home/huo/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /home/huo/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /home/huo/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xb75014d3] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=19915, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /home/huo/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xb76f4400] [0xb76f4424] /lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xb751a1df] /lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xb751d825] /home/huo/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /home/huo/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /home/huo/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xb75054d3] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=19915, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
16 Oct 2013 16:34:56	1216821	16029024	hadcm3n_u0cv_2020_40_008391659_2	803,520	1,695,912	2.1106
15 Oct 2013 18:14:18	1216821	16029024	hadcm3n_u0cv_2020_40_008391659_2	777,600	1,638,032	2.1065
15 Oct 2013 01:11:52	1216821	16029024	hadcm3n_u0cv_2020_40_008391659_2	751,680	1,578,848	2.1004
13 Oct 2013 07:59:02	1216821	16029024	hadcm3n_u0cv_2020_40_008391659_2	725,760	1,518,504	2.0923
12 Oct 2013 14:59:47	1216821	16029024	hadcm3n_u0cv_2020_40_008391659_2	699,840	1,459,143	2.0850
11 Oct 2013 22:59:46	1216821	16029024	hadcm3n_u0cv_2020_40_008391659_2	673,920	1,401,186	2.0792
11 Oct 2013 04:27:47	1216821	16029024	hadcm3n_u0cv_2020_40_008391659_2	648,000	1,343,331	2.0730
09 Oct 2013 17:26:27	1216821	16029024	hadcm3n_u0cv_2020_40_008391659_2	622,080	1,285,137	2.0659
08 Oct 2013 12:34:11	1216821	16029024	hadcm3n_u0cv_2020_40_008391659_2	596,160	1,227,082	2.0583
07 Oct 2013 20:10:59	1216821	16029024	hadcm3n_u0cv_2020_40_008391659_2	570,240	1,170,075	2.0519
06 Oct 2013 05:27:41	1216821	16029024	hadcm3n_u0cv_2020_40_008391659_2	544,320	1,113,894	2.0464
05 Oct 2013 14:27:05	1216821	16029024	hadcm3n_u0cv_2020_40_008391659_2	518,400	1,058,914	2.0427
04 Oct 2013 22:34:12	1216821	16029024	hadcm3n_u0cv_2020_40_008391659_2	492,480	1,004,380	2.0394
04 Oct 2013 06:55:23	1216821	16029024	hadcm3n_u0cv_2020_40_008391659_2	466,560	950,790	2.0379
03 Oct 2013 15:34:38	1216821	16029024	hadcm3n_u0cv_2020_40_008391659_2	440,640	898,917	2.0400
03 Oct 2013 00:17:05	1216821	16029024	hadcm3n_u0cv_2020_40_008391659_2	414,720	847,002	2.0423
30 Sep 2013 21:05:24	1216821	16029024	hadcm3n_u0cv_2020_40_008391659_2	388,800	792,843	2.0392
30 Sep 2013 05:53:51	1216821	16029024	hadcm3n_u0cv_2020_40_008391659_2	362,880	740,331	2.0402
29 Sep 2013 14:31:14	1216821	16029024	hadcm3n_u0cv_2020_40_008391659_2	336,960	687,021	2.0389
28 Sep 2013 23:25:50	1216821	16029024	hadcm3n_u0cv_2020_40_008391659_2	311,040	634,979	2.0415