climateprediction.net home page
Task 13419568

Task 13419568

Name hadcm3n_u0f1_1980_40_007460258_2
Workunit 7657761
Created 25 Sep 2011, 2:25:42 UTC
Sent 25 Sep 2011, 2:31:29 UTC
Report deadline 25 Dec 2011, 9:58:40 UTC
Received 1 Nov 2011, 19:46:58 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1171595
Run time 12 days 22 hours 15 min 6 sec
CPU time 12 days 18 hours 16 min 13 sec
Validate state Invalid
Credit 9,331.20
Device peak FLOPS 2.72 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
03:07:15 (30942): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:11:38 (7575): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:14:19 (7585): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
23:05:27 (2653): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
15:09:21 (1415): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:09:28 (1415): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
07:29:05 (1646): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:29:06 (1646): No heartbeat from core client for 30 sec - exiting
07:29:07 (1646): No heartbeat from core client for 30 sec - exiting
07:29:08 (1646): No heartbeat from core client for 30 sec - exiting
07:29:09 (1646): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
07:31:11 (21818): No heartbeat from core client for 30 sec - exiting
07:31:12 (21818): No heartbeat from core client for 30 sec - exiting
07:31:13 (21818): No heartbeat from core client for 30 sec - exiting
07:31:14 (21818): No heartbeat from core client for 30 sec - exiting
07:31:15 (21818): No heartbeat from core client for 30 sec - exiting
07:31:16 (21818): No heartbeat from core client for 30 sec - exiting
07:31:17 (21818): No heartbeat from core client for 30 sec - exiting
07:31:18 (21818): No heartbeat from core client for 30 sec - exiting
07:31:19 (21818): No heartbeat from core client for 30 sec - exiting
07:31:21 (21818): No heartbeat from core client for 30 sec - exiting
07:31:22 (21818): No heartbeat from core client for 30 sec - exiting
07:31:23 (21818): No heartbeat from core client for 30 sec - exiting
07:31:24 (21818): No heartbeat from core client for 30 sec - exiting
07:31:25 (21818): No heartbeat from core client for 30 sec - exiting
07:31:26 (21818): No heartbeat from core client for 30 sec - exiting
07:31:27 (21818): No heartbeat from core client for 30 sec - exiting
07:31:28 (21818): No heartbeat from core client for 30 sec - exiting
07:31:29 (21818): No heartbeat from core client for 30 sec - exiting
07:31:30 (21818): No heartbeat from core client for 30 sec - exiting
07:31:31 (21818): No heartbeat from core client for 30 sec - exiting
07:31:32 (21818): No heartbeat from core client for 30 sec - exiting
07:31:33 (21818): No heartbeat from core client for 30 sec - exiting
07:31:34 (21818): No heartbeat from core client for 30 sec - exiting
07:31:36 (21818): No heartbeat from core client for 30 sec - exiting
07:31:37 (21818): No heartbeat from core client for 30 sec - exiting
07:31:38 (21818): No heartbeat from core client for 30 sec - exiting
07:31:39 (21818): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
08:12:31 (26050): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x091401c8 ***
======= Backtrace: =========
/lib/libc.so.6(+0x6c501)[0x944501]
/lib/libc.so.6(+0x6dd70)[0x945d70]
/lib/libc.so.6(cfree+0x6d)[0x948e5d]
/usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0x2d6441]
/usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0x2d649d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/libc.so.6(__libc_start_main+0xe7)[0x8eece7]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
0022c000-0030b000 r-xp 00000000 08:01 43781711   /usr/lib/libstdc++.so.6.0.14
0030b000-0030f000 r--p 000de000 08:01 43781711   /usr/lib/libstdc++.so.6.0.14
0030f000-00310000 rw-p 000e2000 08:01 43781711   /usr/lib/libstdc++.so.6.0.14
00310000-00317000 rw-p 00000000 00:00 0 
003e6000-00402000 r-xp 00000000 08:01 42991992   /lib/ld-2.12.1.so
00402000-00403000 r--p 0001b000 08:01 42991992   /lib/ld-2.12.1.so
00403000-00404000 rw-p 0001c000 08:01 42991992   /lib/ld-2.12.1.so
00673000-00688000 r-xp 00000000 08:01 42992015   /lib/libpthread-2.12.1.so
00688000-00689000 ---p 00015000 08:01 42992015   /lib/libpthread-2.12.1.so
00689000-0068a000 r--p 00015000 08:01 42992015   /lib/libpthread-2.12.1.so
0068a000-0068b000 rw-p 00016000 08:01 42992015   /lib/libpthread-2.12.1.so
0068b000-0068d000 rw-p 00000000 00:00 0 
007d9000-007fd000 r-xp 00000000 08:01 42992002   /lib/libm-2.12.1.so
007fd000-007fe000 r--p 00023000 08:01 42992002   /lib/libm-2.12.1.so
007fe000-007ff000 rw-p 00024000 08:01 42992002   /lib/libm-2.12.1.so
00889000-0088b000 r-xp 00000000 08:01 42992001   /lib/libdl-2.12.1.so
0088b000-0088c000 r--p 00001000 08:01 42992001   /lib/libdl-2.12.1.so
0088c000-0088d000 rw-p 00002000 08:01 42992001   /lib/libdl-2.12.1.so
008d8000-00a2f000 r-xp 00000000 08:01 42991995   /lib/libc-2.12.1.so
00a2f000-00a31000 r--p 00157000 08:01 42991995   /lib/libc-2.12.1.so
00a31000-00a32000 rw-p 00159000 08:01 42991995   /lib/libc-2.12.1.so
00a32000-00a35000 rw-p 00000000 00:00 0 
00c97000-00cb1000 r-xp 00000000 08:01 42991693   /lib/libgcc_s.so.1
00cb1000-00cb2000 r--p 00019000 08:01 42991693   /lib/libgcc_s.so.1
00cb2000-00cb3000 rw-p 0001a000 08:01 42991693   /lib/libgcc_s.so.1
00f7e000-00f7f000 r-xp 00000000 00:00 0          [vdso]
08048000-080e3000 r-xp 00000000 08:01 38541683   /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:01 38541683   /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
090ea000-0914e000 rw-p 00000000 00:00 0          [heap]
b7200000-b7221000 rw-p 00000000 00:00 0 
b7221000-b7300000 ---p 00000000 00:00 0 
b730f000-b778a000 rw-s 00000000 08:01 38542220   /var/lib/boinc-client/slots/3/133580
b778a000-b778e000 rw-p 00000000 00:00 0 
b7796000-b7797000 rw-p 00000000 00:00 0 
b7797000-b7798000 ---p 00000000 00:00 0 
b7798000-b779b000 rw-p 00000000 00:00 0 
b779b000-b779d000 rw-s 00000000 08:01 38542129   /var/lib/boinc-client/slots/3/boinc_mmap_file
b779d000-b779f000 rw-p 00000000 00:00 0 
bfdc7000-bfe36000 rw-p 00000000 00:00 0          [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf7e400]
[0xf7e416]
/lib/libc.so.6(gsignal+0x51)[0x902941]
/lib/libc.so.6(abort+0x182)[0x905e42]
/lib/libc.so.6(+0x62305)[0x93a305]
/lib/libc.so.6(+0x6c501)[0x944501]
/lib/libc.so.6(+0x6dd70)[0x945d70]
/lib/libc.so.6(cfree+0x6d)[0x948e5d]
/usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0x2d6441]
/usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0x2d649d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/libc.so.6(__libc_start_main+0xe7)[0x8eece7]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
01 Nov 2011 19:52:41 1171595 13419568 hadcm3n_u0f1_1980_40_007460258_2 777,600 1,102,569 1.4179
01 Nov 2011 08:59:49 1171595 13419568 hadcm3n_u0f1_1980_40_007460258_2 751,680 1,064,503 1.4162
31 Oct 2011 22:32:16 1171595 13419568 hadcm3n_u0f1_1980_40_007460258_2 725,760 1,026,334 1.4142
31 Oct 2011 19:43:42 1171595 13419568 hadcm3n_u0f1_1980_40_007460258_2 699,840 988,025 1.4118
31 Oct 2011 19:29:08 1171595 13419568 hadcm3n_u0f1_1980_40_007460258_2 673,920 949,880 1.4095
31 Oct 2011 19:11:21 1171595 13419568 hadcm3n_u0f1_1980_40_007460258_2 648,000 911,634 1.4068
31 Oct 2011 18:55:15 1171595 13419568 hadcm3n_u0f1_1980_40_007460258_2 622,080 875,042 1.4066
31 Oct 2011 18:38:54 1171595 13419568 hadcm3n_u0f1_1980_40_007460258_2 596,160 838,921 1.4072
31 Oct 2011 18:19:46 1171595 13419568 hadcm3n_u0f1_1980_40_007460258_2 570,240 803,370 1.4088
31 Oct 2011 18:19:46 1171595 13419568 hadcm3n_u0f1_1980_40_007460258_2 544,320 767,900 1.4108
31 Oct 2011 18:19:46 1171595 13419568 hadcm3n_u0f1_1980_40_007460258_2 518,400 732,464 1.4129
31 Oct 2011 18:19:46 1171595 13419568 hadcm3n_u0f1_1980_40_007460258_2 492,480 697,011 1.4153
31 Oct 2011 18:19:46 1171595 13419568 hadcm3n_u0f1_1980_40_007460258_2 466,560 661,638 1.4181
31 Oct 2011 18:19:46 1171595 13419568 hadcm3n_u0f1_1980_40_007460258_2 440,640 626,231 1.4212
31 Oct 2011 18:19:46 1171595 13419568 hadcm3n_u0f1_1980_40_007460258_2 414,720 590,868 1.4247
31 Oct 2011 18:19:46 1171595 13419568 hadcm3n_u0f1_1980_40_007460258_2 388,800 555,456 1.4286
31 Oct 2011 18:19:46 1171595 13419568 hadcm3n_u0f1_1980_40_007460258_2 362,880 520,072 1.4332
31 Oct 2011 18:19:46 1171595 13419568 hadcm3n_u0f1_1980_40_007460258_2 336,960 484,029 1.4365
30 Sep 2011 10:58:12 1171595 13419568 hadcm3n_u0f1_1980_40_007460258_2 311,040 447,748 1.4395
30 Sep 2011 00:33:13 1171595 13419568 hadcm3n_u0f1_1980_40_007460258_2 285,120 410,601 1.4401


©2024 climateprediction.net