Task 13362221

Name	hadcm3n_o3aa_1940_40_007448798_0
Workunit	7646301
Created	9 Sep 2011, 22:11:57 UTC
Sent	14 Sep 2011, 18:45:49 UTC
Report deadline	15 Dec 2011, 2:13:00 UTC
Received	7 Oct 2011, 16:07:59 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1090910
Run time	5 days 2 hours 5 min
CPU time	4 days 23 hours 49 min 44 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.43 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... * glibc detected * ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x0831ec70 *** ======= Backtrace: ========= /lib/libc.so.6(+0x6c501)[0x7d5501] /lib/libc.so.6(+0x6dd70)[0x7d6d70] /lib/libc.so.6(cfree+0x6d)[0x7d9e5d] /usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0xc93441] /usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0xc9349d] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/libc.so.6(__libc_start_main+0xe7)[0x77fce7] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] ======= Memory map: ======== 00506000-0051b000 r-xp 00000000 08:06 246502 /lib/libpthread-2.12.1.so 0051b000-0051c000 ---p 00015000 08:06 246502 /lib/libpthread-2.12.1.so 0051c000-0051d000 r--p 00015000 08:06 246502 /lib/libpthread-2.12.1.so 0051d000-0051e000 rw-p 00016000 08:06 246502 /lib/libpthread-2.12.1.so 0051e000-00520000 rw-p 00000000 00:00 0 005f4000-005f5000 r-xp 00000000 00:00 0 [vdso] 00769000-008c0000 r-xp 00000000 08:06 246213 /lib/libc-2.12.1.so 008c0000-008c2000 r--p 00157000 08:06 246213 /lib/libc-2.12.1.so 008c2000-008c3000 rw-p 00159000 08:06 246213 /lib/libc-2.12.1.so 008c3000-008c6000 rw-p 00000000 00:00 0 00be9000-00cc8000 r-xp 00000000 08:06 32817 /usr/lib/libstdc++.so.6.0.14 00cc8000-00ccc000 r--p 000de000 08:06 32817 /usr/lib/libstdc++.so.6.0.14 00ccc000-00ccd000 rw-p 000e2000 08:06 32817 /usr/lib/libstdc++.so.6.0.14 00ccd000-00cd4000 rw-p 00000000 00:00 0 00d2f000-00d31000 r-xp 00000000 08:06 246216 /lib/libdl-2.12.1.so 00d31000-00d32000 r--p 00001000 08:06 246216 /lib/libdl-2.12.1.so 00d32000-00d33000 rw-p 00002000 08:06 246216 /lib/libdl-2.12.1.so 00d70000-00d8a000 r-xp 00000000 08:06 245823 /lib/libgcc_s.so.1 00d8a000-00d8b000 r--p 00019000 08:06 245823 /lib/libgcc_s.so.1 00d8b000-00d8c000 rw-p 0001a000 08:06 245823 /lib/libgcc_s.so.1 00ec7000-00ee3000 r-xp 00000000 08:06 246188 /lib/ld-2.12.1.so 00ee3000-00ee4000 r--p 0001b000 08:06 246188 /lib/ld-2.12.1.so 00ee4000-00ee5000 rw-p 0001c000 08:06 246188 /lib/ld-2.12.1.so 00f0d000-00f31000 r-xp 00000000 08:06 246217 /lib/libm-2.12.1.so 00f31000-00f32000 r--p 00023000 08:06 246217 /lib/libm-2.12.1.so 00f32000-00f33000 rw-p 00024000 08:06 246217 /lib/libm-2.12.1.so 08048000-080e3000 r-xp 00000000 08:06 369089 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e3000-080e4000 rw-p 0009b000 08:06 369089 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e4000-0813b000 rw-p 00000000 00:00 0 082c9000-0832e000 rw-p 00000000 00:00 0 [heap] b7200000-b7221000 rw-p 00000000 00:00 0 b7221000-b7300000 ---p 00000000 00:00 0 b731c000-b7797000 rw-s 00000000 08:06 5283907 /var/lib/boinc-client/slots/1/137590 b7797000-b779b000 rw-p 00000000 00:00 0 b77b4000-b77b5000 rw-p 00000000 00:00 0 b77b5000-b77b6000 ---p 00000000 00:00 0 b77b6000-b77b9000 rw-p 00000000 00:00 0 b77b9000-b77bb000 rw-s 00000000 08:06 5283888 /var/lib/boinc-client/slots/1/boinc_mmap_file b77bb000-b77bd000 rw-p 00000000 00:00 0 bff06000-bff75000 rw-p 00000000 00:00 0 [stack] SIGABRT: abort called Stack trace (19 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0x5f4400] [0x5f4416] /lib/libc.so.6(gsignal+0x51)[0x793941] /lib/libc.so.6(abort+0x182)[0x796e42] /lib/libc.so.6(+0x62305)[0x7cb305] /lib/libc.so.6(+0x6c501)[0x7d5501] /lib/libc.so.6(+0x6dd70)[0x7d6d70] /lib/libc.so.6(cfree+0x6d)[0x7d9e5d] /usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0xc93441] /usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0xc9349d] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/libc.so.6(__libc_start_main+0xe7)[0x77fce7] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Oct 2011 16:05:37	1090910	13362221	hadcm3n_o3aa_1940_40_007448798_0	259,200	431,372	1.6642
07 Oct 2011 16:05:37	1090910	13362221	hadcm3n_o3aa_1940_40_007448798_0	233,280	387,301	1.6602
07 Oct 2011 16:05:37	1090910	13362221	hadcm3n_o3aa_1940_40_007448798_0	207,360	343,162	1.6549
07 Oct 2011 16:05:37	1090910	13362221	hadcm3n_o3aa_1940_40_007448798_0	181,440	299,910	1.6529
07 Oct 2011 16:05:37	1090910	13362221	hadcm3n_o3aa_1940_40_007448798_0	155,520	258,163	1.6600
07 Oct 2011 16:05:37	1090910	13362221	hadcm3n_o3aa_1940_40_007448798_0	129,600	215,853	1.6655
07 Oct 2011 16:05:37	1090910	13362221	hadcm3n_o3aa_1940_40_007448798_0	103,680	173,468	1.6731
16 Sep 2011 07:50:23	1090910	13362221	hadcm3n_o3aa_1940_40_007448798_0	77,760	129,936	1.6710
15 Sep 2011 19:27:30	1090910	13362221	hadcm3n_o3aa_1940_40_007448798_0	51,840	86,542	1.6694
15 Sep 2011 06:57:46	1090910	13362221	hadcm3n_o3aa_1940_40_007448798_0	25,920	43,115	1.6634