climateprediction.net home page
Task 13517842

Task 13517842

Name hadcm3n_o0ok_1940_40_007446850_2
Workunit 7644353
Created 25 Oct 2011, 17:15:49 UTC
Sent 25 Oct 2011, 17:15:56 UTC
Report deadline 25 Jan 2012, 0:43:07 UTC
Received 15 Nov 2011, 16:38:54 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1137791
Run time 14 days 1 hours 46 min 30 sec
CPU time 13 days 13 hours 48 min 36 sec
Validate state Invalid
Credit 6,220.80
Device peak FLOPS 2.10 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.12.33</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
14:36:58 (14085): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:38:19 (14889): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:42:31 (14911): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:44:03 (14940): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:45:30 (14962): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:46:55 (14987): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:48:15 (15009): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:49:52 (15031): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:51:28 (15054): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:52:55 (15075): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:54:15 (15100): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:55:56 (15122): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:57:33 (15144): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:58:58 (15166): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
21:08:57 (2833): No heartbeat from core client for 30 sec - exiting
21:09:03 (2833): No heartbeat from core client for 30 sec - exiting
21:09:04 (2833): No heartbeat from core client for 30 sec - exiting
21:09:05 (2833): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:09:08 (2833): No heartbeat from core client for 30 sec - exiting
21:09:10 (2833): No heartbeat from core client for 30 sec - exiting
21:09:11 (2833):Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09c456b0 ***
======= Backtrace: =========
/lib32/libc.so.6(+0x6eb72)[0xf747bb72]
/lib32/libc.so.6(+0x6f812)[0xf747c812]
/lib32/libc.so.6(cfree+0x6d)[0xf747f8cd]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x1f)[0xf767cbaf]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1b)[0xf767cc0b]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xf3)[0xf74260f3]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:11 656690                             /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:11 656690                             /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
09bf0000-09c55000 rw-p 00000000 00:00 0                                  [heap]
f6e00000-f6e21000 rw-p 00000000 00:00 0 
f6e21000-f6f00000 ---p 00000000 00:00 0 
f6f8f000-f740a000 rw-s 00000000 08:11 656458                             /var/lib/boinc-client/slots/0/136860
f740a000-f740d000 rw-p 00000000 00:00 0 
f740d000-f7580000 r-xp 00000000 08:11 1707725                            /lib32/libc-2.13.so
f7580000-f7581000 ---p 00173000 08:11 1707725                            /lib32/libc-2.13.so
f7581000-f7583000 r--p 00173000 08:11 1707725                            /lib32/libc-2.13.so
f7583000-f7584000 rw-p 00175000 08:11 1707725                            /lib32/libc-2.13.so
f7584000-f7587000 rw-p 00000000 00:00 0 
f7587000-f75a3000 r-xp 00000000 08:11 405814                             /usr/lib32/libgcc_s.so.1
f75a3000-f75a4000 r--p 0001b000 08:11 405814                             /usr/lib32/libgcc_s.so.1
f75a4000-f75a5000 rw-p 0001c000 08:11 405814                             /usr/lib32/libgcc_s.so.1
f75a5000-f75cd000 r-xp 00000000 08:11 1707740                            /lib32/libm-2.13.so
f75cd000-f75ce000 r--p 00028000 08:11 1707740                            /lib32/libm-2.13.so
f75ce000-f75cf000 rw-p 00029000 08:11 1707740                            /lib32/libm-2.13.so
f75cf000-f76ad000 r-xp 00000000 08:11 405030                             /usr/lib32/libstdc++.so.6.0.16
f76ad000-f76ae000 ---p 000de000 08:11 405030                             /usr/lib32/libstdc++.so.6.0.16
f76ae000-f76b2000 r--p 000de000 08:11 405030                             /usr/lib32/libstdc++.so.6.0.16
f76b2000-f76b3000 rw-p 000e2000 08:11 405030                             /usr/lib32/libstdc++.so.6.0.16
f76b3000-f76bb000 rw-p 00000000 00:00 0 
f76bb000-f76be000 r-xp 00000000 08:11 1707727                            /lib32/libdl-2.13.so
f76be000-f76bf000 r--p 00002000 08:11 1707727                            /lib32/libdl-2.13.so
f76bf000-f76c0000 rw-p 00003000 08:11 1707727                            /lib32/libdl-2.13.so
f76c0000-f76d7000 r-xp 00000000 08:11 1707737                            /lib32/libpthread-2.13.so
f76d7000-f76d8000 r--p 00016000 08:11 1707737                            /lib32/libpthread-2.13.so
f76d8000-f76d9000 rw-p 00017000 08:11 1707737                            /lib32/libpthread-2.13.so
f76d9000-f76db000 rw-p 00000000 00:00 0 
f76f9000-f76fa000 rw-p 00000000 00:00 0 
f76fa000-f76fb000 ---p 00000000 00:00 0 
f76fb000-f76fe000 rw-p 00000000 00:00 0 
f76fe000-f7700000 rw-s 00000000 08:11 656455                             /var/lib/boinc-client/slots/0/boinc_mmap_file
f7700000-f7702000 rw-p 00000000 00:00 0 
f7702000-f7703000 r-xp 00000000 00:00 0                                  [vdso]
f7703000-f7721000 r-xp 00000000 08:11 3538992                            /lib/i386-linux-gnu/ld-2.13.so
f7721000-f7722000 r--p 0001d000 08:11 3538992                            /lib/i386-linux-gnu/ld-2.13.so
f7722000-f7723000 rw-p 0001e000 08:11 3538992                            /lib/i386-linux-gnu/ld-2.13.so
ffebc000-fff2c000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf7702400]
[0xf7702425]
/lib32/libc.so.6(gsignal+0x4f)[0xf743ac4f]
/lib32/libc.so.6(abort+0x175)[0xf743e175]
/lib32/libc.so.6(+0x63e8c)[0xf7470e8c]
/lib32/libc.so.6(+0x6eb72)[0xf747bb72]
/lib32/libc.so.6(+0x6f812)[0xf747c812]
/lib32/libc.so.6(cfree+0x6d)[0xf747f8cd]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x1f)[0xf767cbaf]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1b)[0xf767cc0b]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xf3)[0xf74260f3]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
15 Nov 2011 16:48:39 1137791 13517842 hadcm3n_o0ok_1940_40_007446850_2 518,400 1,172,907 2.2626
15 Nov 2011 16:48:40 1137791 13517842 hadcm3n_o0ok_1940_40_007446850_2 492,480 1,115,449 2.2650
15 Nov 2011 16:48:41 1137791 13517842 hadcm3n_o0ok_1940_40_007446850_2 466,560 1,058,207 2.2681
09 Nov 2011 10:28:11 1137791 13517842 hadcm3n_o0ok_1940_40_007446850_2 440,640 1,000,893 2.2715
08 Nov 2011 09:59:22 1137791 13517842 hadcm3n_o0ok_1940_40_007446850_2 414,720 943,629 2.2753
07 Nov 2011 08:43:29 1137791 13517842 hadcm3n_o0ok_1940_40_007446850_2 388,800 886,313 2.2796
06 Nov 2011 05:52:13 1137791 13517842 hadcm3n_o0ok_1940_40_007446850_2 362,880 828,931 2.2843
05 Nov 2011 07:07:45 1137791 13517842 hadcm3n_o0ok_1940_40_007446850_2 336,960 771,662 2.2901
04 Nov 2011 11:42:55 1137791 13517842 hadcm3n_o0ok_1940_40_007446850_2 311,040 711,844 2.2886
03 Nov 2011 18:57:13 1137791 13517842 hadcm3n_o0ok_1940_40_007446850_2 285,120 651,836 2.2862
03 Nov 2011 01:13:25 1137791 13517842 hadcm3n_o0ok_1940_40_007446850_2 259,200 591,836 2.2833
02 Nov 2011 08:04:46 1137791 13517842 hadcm3n_o0ok_1940_40_007446850_2 233,280 531,829 2.2798
01 Nov 2011 15:03:56 1137791 13517842 hadcm3n_o0ok_1940_40_007446850_2 207,360 472,089 2.2767
31 Oct 2011 22:00:22 1137791 13517842 hadcm3n_o0ok_1940_40_007446850_2 181,440 412,306 2.2724
31 Oct 2011 19:33:30 1137791 13517842 hadcm3n_o0ok_1940_40_007446850_2 155,520 352,510 2.2667
31 Oct 2011 19:07:22 1137791 13517842 hadcm3n_o0ok_1940_40_007446850_2 129,600 292,697 2.2585
31 Oct 2011 18:41:37 1137791 13517842 hadcm3n_o0ok_1940_40_007446850_2 103,680 232,961 2.2469
31 Oct 2011 18:15:00 1137791 13517842 hadcm3n_o0ok_1940_40_007446850_2 77,760 174,571 2.2450
31 Oct 2011 17:16:20 1137791 13517842 hadcm3n_o0ok_1940_40_007446850_2 51,840 116,659 2.2504
31 Oct 2011 16:44:56 1137791 13517842 hadcm3n_o0ok_1940_40_007446850_2 25,920 58,448 2.2549


©2024 climateprediction.net