Task 13069783

Name	hadcm3n_o026_1900_40_007195409_2
Workunit	7393689
Created	4 Jul 2011, 11:11:48 UTC
Sent	4 Jul 2011, 11:39:23 UTC
Report deadline	3 Oct 2011, 19:06:34 UTC
Received	17 Aug 2011, 7:02:52 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	878131
Run time	5 days 16 hours 30 min 59 sec
CPU time	5 days 13 hours 39 min 51 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.96 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.10.56</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... * glibc detected * ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08190c68 *** ======= Backtrace: ========= /lib/libc.so.6(+0x6de2b)[0xf7464e2b] /lib/libc.so.6(+0x6ebab)[0xf7465bab] /lib/libc.so.6(cfree+0x6d)[0xf7469a6d] /usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0xf765b6e1] /usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0xf765b73d] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/libc.so.6(__libc_start_main+0xfe)[0xf740dc2e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] ======= Memory map: ======== 08048000-080e3000 r-xp 00000000 08:04 12206205 /home/dc/BOINC/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e3000-080e4000 rwxp 0009b000 08:04 12206205 /home/dc/BOINC/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e4000-081a1000 rwxp 00000000 00:00 0 [heap] f6e00000-f6e21000 rwxp 00000000 00:00 0 f6e21000-f6f00000 ---p 00000000 00:00 0 f6f7a000-f73f5000 rwxs 00000000 08:04 12271740 /home/dc/BOINC/slots/1/130795 f73f5000-f73f7000 rwxp 00000000 00:00 0 f73f7000-f755d000 r-xp 00000000 08:03 2485941 /lib/libc-2.11.3.so f755d000-f755e000 ---p 00166000 08:03 2485941 /lib/libc-2.11.3.so f755e000-f7560000 r-xp 00166000 08:03 2485941 /lib/libc-2.11.3.so f7560000-f7561000 rwxp 00168000 08:03 2485941 /lib/libc-2.11.3.so f7561000-f7564000 rwxp 00000000 00:00 0 f7564000-f7580000 r-xp 00000000 08:03 2489478 /lib/libgcc_s.so.1 f7580000-f7581000 r-xp 0001b000 08:03 2489478 /lib/libgcc_s.so.1 f7581000-f7582000 rwxp 0001c000 08:03 2489478 /lib/libgcc_s.so.1 f7582000-f7583000 rwxp 00000000 00:00 0 f7583000-f75ab000 r-xp 00000000 08:03 2486019 /lib/libm-2.11.3.so f75ab000-f75ac000 r-xp 00027000 08:03 2486019 /lib/libm-2.11.3.so f75ac000-f75ad000 rwxp 00028000 08:03 2486019 /lib/libm-2.11.3.so f75ad000-f7690000 r-xp 00000000 08:03 924954 /usr/lib/libstdc++.so.6.0.14 f7690000-f7694000 r-xp 000e2000 08:03 924954 /usr/lib/libstdc++.so.6.0.14 f7694000-f7695000 rwxp 000e6000 08:03 924954 /usr/lib/libstdc++.so.6.0.14 f7695000-f769c000 rwxp 00000000 00:00 0 f769c000-f769f000 r-xp 00000000 08:03 2486165 /lib/libdl-2.11.3.so f769f000-f76a0000 r-xp 00002000 08:03 2486165 /lib/libdl-2.11.3.so f76a0000-f76a1000 rwxp 00003000 08:03 2486165 /lib/libdl-2.11.3.so f76a1000-f76b8000 r-xp 00000000 08:03 2486160 /lib/libpthread-2.11.3.so f76b8000-f76b9000 r-xp 00016000 08:03 2486160 /lib/libpthread-2.11.3.so f76b9000-f76ba000 rwxp 00017000 08:03 2486160 /lib/libpthread-2.11.3.so f76ba000-f76bc000 rwxp 00000000 00:00 0 f76d7000-f76d8000 rwxp 00000000 00:00 0 f76d8000-f76d9000 ---p 00000000 00:00 0 f76d9000-f76dc000 rwxp 00000000 00:00 0 f76dc000-f76de000 rwxs 00000000 08:04 12271649 /home/dc/BOINC/slots/1/boinc_mmap_file f76de000-f76df000 rwxp 00000000 00:00 0 f76df000-f76fe000 r-xp 00000000 08:03 2485944 /lib/ld-2.11.3.so f76fe000-f76ff000 r-xp 0001e000 08:03 2485944 /lib/ld-2.11.3.so f76ff000-f7700000 rwxp 0001f000 08:03 2485944 /lib/ld-2.11.3.so ffea3000-fff14000 rw-p 00000000 00:00 0 [stack] ffffe000-fffff000 r-xp 00000000 00:00 0 [vdso] SIGABRT: abort called Stack trace (19 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xffffe400] [0xffffe430] /lib/libc.so.6(gsignal+0x4f)[0xf74228df] /lib/libc.so.6(abort+0x180)[0xf7424220] /lib/libc.so.6(+0x67e07)[0xf745ee07] /lib/libc.so.6(+0x6de2b)[0xf7464e2b] /lib/libc.so.6(+0x6ebab)[0xf7465bab] /lib/libc.so.6(cfree+0x6d)[0xf7469a6d] /usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0xf765b6e1] /usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0xf765b73d] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/libc.so.6(__libc_start_main+0xfe)[0xf740dc2e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
17 Aug 2011 07:05:43	878131	13069783	hadcm3n_o026_1900_40_007195409_2	259,200	481,186	1.8564
16 Aug 2011 18:54:29	878131	13069783	hadcm3n_o026_1900_40_007195409_2	233,280	434,849	1.8641
16 Aug 2011 04:30:44	878131	13069783	hadcm3n_o026_1900_40_007195409_2	207,360	388,100	1.8716
12 Aug 2011 13:49:14	878131	13069783	hadcm3n_o026_1900_40_007195409_2	181,440	339,708	1.8723
07 Jul 2011 23:10:23	878131	13069783	hadcm3n_o026_1900_40_007195409_2	155,520	291,290	1.8730
07 Jul 2011 16:09:47	878131	13069783	hadcm3n_o026_1900_40_007195409_2	129,600	242,882	1.8741
07 Jul 2011 16:09:47	878131	13069783	hadcm3n_o026_1900_40_007195409_2	103,680	194,319	1.8742
07 Jul 2011 16:09:47	878131	13069783	hadcm3n_o026_1900_40_007195409_2	77,760	145,941	1.8768
05 Jul 2011 15:32:03	878131	13069783	hadcm3n_o026_1900_40_007195409_2	51,840	97,370	1.8783
05 Jul 2011 01:20:21	878131	13069783	hadcm3n_o026_1900_40_007195409_2	25,920	48,425	1.8682