Task 10938813

Name	hadsm3dhet2_jj2i_006587708_8
Workunit	6791081
Created	15 Mar 2010, 11:48:56 UTC
Sent	29 Oct 2010, 6:21:56 UTC
Report deadline	11 Oct 2011, 11:41:56 UTC
Received	7 Dec 2010, 17:12:00 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1108574
Run time
CPU time	14 days 7 hours 44 min
Validate state	Invalid
Credit	2,282.60
Device peak FLOPS	0.84 GFLOPS
Application version	UK Met Office HadSM3 Slab Model v6.08 i686-pc-linux-gnu
Stderr	<core_client_version>6.2.12</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Stack trace (12 frames): /var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b] [0x4001a400] /var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x81fb130] /var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x835353f] /var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x84bdf85] /var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x80bc6df] /var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c8b1e] /var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86fd1e3] /var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886] /var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f] /lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe5)[0x40074685] /var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6163, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Stack trace (13 frames): /var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b] [0x4001a400] /var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x81fdb99] /var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x81f9d28] /var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x85f5b2c] /var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x84bffd8] /var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x80bc6df] /var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c8b1e] /var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86fd1e3] /var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886] /var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f] /lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe5)[0x40074685] /var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6163, iMonCtr=1 Model crash detected, will try to restart... Model crashed: Ҋ Model crashed: Ҋ CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Stack trace (14 frames): /var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b] [0x4001a400] /var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x853915e] /var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8537d84] /var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x80cc55f] /var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x80eb011] /var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x80e38c7] /var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x80bd042] /var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c8b1e] /var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86fd1e3] /var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0886] /var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f] /lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe5)[0x40074685] /var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7107, iMonCtr=1 Model crash detected, will try to restart... Model crashed: Ҋ SIGSEGV: segmentation violation Stack trace (8 frames): /var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b] [0x4001a400] /var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x8265c60] /var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x85ec0a2] /var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86c0712] /var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x86feb0f] /lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe5)[0x40074685] /var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu(pthread_mutex_unlock+0x111)[0x804bb31] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7107, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Stack trace (3 frames): /var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x876060b] [0x4001a400] /var/lib/boinc-client/projects/climateprediction.net/hadsm3_um_6.08_i686-pc-linux-gnu[0x81e1c66] Exiting... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7107, iMonCtr=1 Model crash detected, will try to restart... forrtl: severe (24): end-of-file during read, unit 22, file /var/lib/boinc-client/projects/climateprediction.net/hadsm3dhet2_jj2i_006587708/datain/ancil/ctldata/STASHmaster/STASHmaster_A Image PC Routine Line Source hadsm3_um_6.08_i6 087C31CC Unknown Unknown Unknown hadsm3_um_6.08_i6 087C0D75 Unknown Unknown Unknown hadsm3_um_6.08_i6 087A2FD3 Unknown Unknown Unknown hadsm3_um_6.08_i6 0877238E Unknown Unknown Unknown hadsm3_um_6.08_i6 08781C29 Unknown Unknown Unknown hadsm3_um_6.08_i6 0827292D Unknown Unknown Unknown hadsm3_um_6.08_i6 086F73A3 Unknown Unknown Unknown hadsm3_um_6.08_i6 086C0886 Unknown Unknown Unknown hadsm3_um_6.08_i6 086FEB0F Unknown Unknown Unknown Unknown 40074685 Unknown Unknown Unknown hadsm3_um_6.08_i6 0804BB31 Unknown Unknown Unknown CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7107, iMonCtr=1 Model crash detected, will try to restart... SIGSEGV: segmentation violation Stack trace (3 frames): [0x80a1fb7] [0x805d018] [0x8108308] Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Dec 2010 10:56:48	1108574	10938813	hadsm3dhet2_jj2i_006587708_8	248,446	1,216,231	4.8954
06 Dec 2010 23:49:04	1108574	10938813	hadsm3dhet2_jj2i_006587708_8	237,644	1,176,637	4.9513
06 Dec 2010 08:50:27	1108574	10938813	hadsm3dhet2_jj2i_006587708_8	226,842	1,134,059	4.9993
03 Dec 2010 09:16:39	1108574	10938813	hadsm3dhet2_jj2i_006587708_8	216,040	1,088,482	5.0383
02 Dec 2010 09:28:41	1108574	10938813	hadsm3dhet2_jj2i_006587708_8	205,238	1,041,157	5.0729
30 Nov 2010 18:00:42	1108574	10938813	hadsm3dhet2_jj2i_006587708_8	194,436	986,174	5.0720
29 Nov 2010 16:32:12	1108574	10938813	hadsm3dhet2_jj2i_006587708_8	183,634	931,537	5.0728
26 Nov 2010 13:22:47	1108574	10938813	hadsm3dhet2_jj2i_006587708_8	172,832	876,982	5.0742
25 Nov 2010 10:56:23	1108574	10938813	hadsm3dhet2_jj2i_006587708_8	162,030	821,456	5.0698
24 Nov 2010 09:43:47	1108574	10938813	hadsm3dhet2_jj2i_006587708_8	151,228	768,880	5.0842
23 Nov 2010 07:03:26	1108574	10938813	hadsm3dhet2_jj2i_006587708_8	140,426	713,168	5.0786
19 Nov 2010 19:00:12	1108574	10938813	hadsm3dhet2_jj2i_006587708_8	129,624	658,648	5.0812
18 Nov 2010 17:09:40	1108574	10938813	hadsm3dhet2_jj2i_006587708_8	118,822	602,871	5.0737
17 Nov 2010 14:58:10	1108574	10938813	hadsm3dhet2_jj2i_006587708_8	108,020	546,695	5.0611
16 Nov 2010 12:25:09	1108574	10938813	hadsm3dhet2_jj2i_006587708_8	97,218	491,261	5.0532
15 Nov 2010 10:53:45	1108574	10938813	hadsm3dhet2_jj2i_006587708_8	86,416	436,346	5.0494
12 Nov 2010 09:18:07	1108574	10938813	hadsm3dhet2_jj2i_006587708_8	75,614	383,294	5.0691
08 Nov 2010 20:30:50	1108574	10938813	hadsm3dhet2_jj2i_006587708_8	64,812	328,413	5.0672
05 Nov 2010 15:28:37	1108574	10938813	hadsm3dhet2_jj2i_006587708_8	54,010	274,028	5.0737
04 Nov 2010 13:32:15	1108574	10938813	hadsm3dhet2_jj2i_006587708_8	43,208	218,680	5.0611