climateprediction.net home page
Task 13413025

Task 13413025

Name hadcm3n_u5pj_1980_40_007460515_2
Workunit 7658018
Created 23 Sep 2011, 1:08:00 UTC
Sent 23 Sep 2011, 19:05:17 UTC
Report deadline 24 Dec 2011, 2:32:28 UTC
Received 30 Nov 2011, 0:00:20 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1152902
Run time 49 days 13 hours 29 min 15 sec
CPU time 48 days 21 hours 5 min 1 sec
Validate state Invalid
Credit 12,441.60
Device peak FLOPS 1.13 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.12.33</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
12:29:07 (1555): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:30:55 (6544): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:33:53 (6553): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:36:39 (6561): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:39:57 (6571): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:42:45 (6579): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:45:26 (6587): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:48:38 (6596): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:51:12 (6605): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:54:18 (6614): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:57:05 (6622): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:00:18 (6633): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:03:00 (6641): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:05:43 (6650): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:08:09 (6658): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:11:17 (6666): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:14:35 (6675): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:17:57 (6686): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:21:09 (6709): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:41:59 (6746): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:12:44 (1355): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:14:16 (1938): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:16:43 (1946): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:19:13 (2004): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:21:51 (2527): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:24:44 (3067): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:27:41 (4252): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:30:53 (4324): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:34:01 (4403): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:37:09 (4475): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:40:00 (4484): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:43:19 (4493): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:46:25 (4501): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:49:43 (4510): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:52:16 (4521): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:55:37 (4529): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:58:46 (4538): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:01:13 (4546): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:04:16 (4555): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:07:32 (4566): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:10:14 (4602): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
14:36:59 (4633): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
17:24:07 (1351): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
13:35:33 (1349): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:42:17 (1763): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:48:41 (1771): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:56:18 (1780): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:03:22 (1789): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:09:36 (1798): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:17:25 (1807): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:23:48 (1865): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:24:24 (2444): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:54:04 (1089): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x0a155148 ***
======= Backtrace: =========
/lib/i386-linux-gnu/libc.so.6(+0x6ebc2)[0x300bc2]
/lib/i386-linux-gnu/libc.so.6(+0x6f862)[0x301862]
/lib/i386-linux-gnu/libc.so.6(cfree+0x6d)[0x30494d]
/usr/lib/i386-linux-gnu/libstdc++.so.6(_ZdlPv+0x1f)[0x1bd80f]
/usr/lib/i386-linux-gnu/libstdc++.so.6(_ZdaPv+0x1b)[0x1bd86b]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x2ab113]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
00110000-001ee000 r-xp 00000000 08:01 132339     /usr/lib/i386-linux-gnu/libstdc++.so.6.0.16
001ee000-001ef000 ---p 000de000 08:01 132339     /usr/lib/i386-linux-gnu/libstdc++.so.6.0.16
001ef000-001f3000 r--p 000de000 08:01 132339     /usr/lib/i386-linux-gnu/libstdc++.so.6.0.16
001f3000-001f4000 rw-p 000e2000 08:01 132339     /usr/lib/i386-linux-gnu/libstdc++.so.6.0.16
001f4000-001fb000 rw-p 00000000 00:00 0 
001fb000-00223000 r-xp 00000000 08:01 6337       /lib/i386-linux-gnu/libm-2.13.so
00223000-00224000 r--p 00028000 08:01 6337       /lib/i386-linux-gnu/libm-2.13.so
00224000-00225000 rw-p 00029000 08:01 6337       /lib/i386-linux-gnu/libm-2.13.so
0028d000-00290000 r-xp 00000000 08:01 6336       /lib/i386-linux-gnu/libdl-2.13.so
00290000-00291000 r--p 00002000 08:01 6336       /lib/i386-linux-gnu/libdl-2.13.so
00291000-00292000 rw-p 00003000 08:01 6336       /lib/i386-linux-gnu/libdl-2.13.so
00292000-00408000 r-xp 00000000 08:01 5634       /lib/i386-linux-gnu/libc-2.13.so
00408000-0040a000 r--p 00176000 08:01 5634       /lib/i386-linux-gnu/libc-2.13.so
0040a000-0040b000 rw-p 00178000 08:01 5634       /lib/i386-linux-gnu/libc-2.13.so
0040b000-0040e000 rw-p 00000000 00:00 0 
00546000-0055d000 r-xp 00000000 08:01 7460       /lib/i386-linux-gnu/libpthread-2.13.so
0055d000-0055e000 r--p 00016000 08:01 7460       /lib/i386-linux-gnu/libpthread-2.13.so
0055e000-0055f000 rw-p 00017000 08:01 7460       /lib/i386-linux-gnu/libpthread-2.13.so
0055f000-00561000 rw-p 00000000 00:00 0 
00734000-00750000 r-xp 00000000 08:01 5578       /lib/i386-linux-gnu/libgcc_s.so.1
00750000-00751000 r--p 0001b000 08:01 5578       /lib/i386-linux-gnu/libgcc_s.so.1
00751000-00752000 rw-p 0001c000 08:01 5578       /lib/i386-linux-gnu/libgcc_s.so.1
008f2000-00910000 r-xp 00000000 08:01 4664       /lib/i386-linux-gnu/ld-2.13.so
00910000-00911000 r--p 0001d000 08:01 4664       /lib/i386-linux-gnu/ld-2.13.so
00911000-00912000 rw-p 0001e000 08:01 4664       /lib/i386-linux-gnu/ld-2.13.so
00b5f000-00b60000 r-xp 00000000 00:00 0          [vdso]
08048000-080e3000 r-xp 00000000 08:01 131499     /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:01 131499     /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
0a0ff000-0a163000 rw-p 00000000 00:00 0          [heap]
b7100000-b7121000 rw-p 00000000 00:00 0 
b7121000-b7200000 ---p 00000000 00:00 0 
b72d9000-b7754000 rw-s 00000000 08:01 139901     /var/lib/boinc-client/slots/2/136850
b7754000-b7758000 rw-p 00000000 00:00 0 
b7762000-b7763000 rw-p 00000000 00:00 0 
b7763000-b7764000 ---p 00000000 00:00 0 
b7764000-b7767000 rw-p 00000000 00:00 0 
b7767000-b7769000 rw-s 00000000 08:01 137667     /var/lib/boinc-client/slots/2/boinc_mmap_file
b7769000-b776b000 rw-p 00000000 00:00 0 
bf7b0000-bf820000 rw-p 00000000 00:00 0          [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xb5f400]
[0xb5f416]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0x2bfc8f]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0x2c32b5]
/lib/i386-linux-gnu/libc.so.6(+0x63dfc)[0x2f5dfc]
/lib/i386-linux-gnu/libc.so.6(+0x6ebc2)[0x300bc2]
/lib/i386-linux-gnu/libc.so.6(+0x6f862)[0x301862]
/lib/i386-linux-gnu/libc.so.6(cfree+0x6d)[0x30494d]
/usr/lib/i386-linux-gnu/libstdc++.so.6(_ZdlPv+0x1f)[0x1bd80f]
/usr/lib/i386-linux-gnu/libstdc++.so.6(_ZdaPv+0x1b)[0x1bd86b]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x2ab113]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
30 Nov 2011 00:03:54 1152902 13413025 hadcm3n_u5pj_1980_40_007460515_2 1,036,800 4,223,088 4.0732
26 Nov 2011 13:20:42 1152902 13413025 hadcm3n_u5pj_1980_40_007460515_2 1,010,880 4,116,165 4.0719
25 Nov 2011 09:06:03 1152902 13413025 hadcm3n_u5pj_1980_40_007460515_2 984,960 4,009,093 4.0703
24 Nov 2011 02:04:49 1152902 13413025 hadcm3n_u5pj_1980_40_007460515_2 959,040 3,900,997 4.0676
19 Nov 2011 21:19:56 1152902 13413025 hadcm3n_u5pj_1980_40_007460515_2 933,120 3,793,620 4.0655
18 Nov 2011 10:29:38 1152902 13413025 hadcm3n_u5pj_1980_40_007460515_2 907,200 3,686,463 4.0636
18 Nov 2011 10:29:38 1152902 13413025 hadcm3n_u5pj_1980_40_007460515_2 881,280 3,579,309 4.0615
18 Nov 2011 10:29:38 1152902 13413025 hadcm3n_u5pj_1980_40_007460515_2 855,360 3,473,040 4.0603
18 Nov 2011 10:29:38 1152902 13413025 hadcm3n_u5pj_1980_40_007460515_2 829,440 3,367,465 4.0599
04 Nov 2011 23:28:29 1152902 13413025 hadcm3n_u5pj_1980_40_007460515_2 803,520 3,261,578 4.0591
03 Nov 2011 22:27:43 1152902 13413025 hadcm3n_u5pj_1980_40_007460515_2 777,600 3,156,209 4.0589
01 Nov 2011 08:49:21 1152902 13413025 hadcm3n_u5pj_1980_40_007460515_2 751,680 3,050,956 4.0588
01 Nov 2011 08:49:21 1152902 13413025 hadcm3n_u5pj_1980_40_007460515_2 725,760 2,946,009 4.0592
01 Nov 2011 08:49:21 1152902 13413025 hadcm3n_u5pj_1980_40_007460515_2 699,840 2,841,063 4.0596
31 Oct 2011 17:25:55 1152902 13413025 hadcm3n_u5pj_1980_40_007460515_2 673,920 2,736,028 4.0599
31 Oct 2011 17:22:15 1152902 13413025 hadcm3n_u5pj_1980_40_007460515_2 648,000 2,631,297 4.0606
31 Oct 2011 17:22:15 1152902 13413025 hadcm3n_u5pj_1980_40_007460515_2 622,080 2,526,665 4.0616
31 Oct 2011 17:22:14 1152902 13413025 hadcm3n_u5pj_1980_40_007460515_2 596,160 2,422,027 4.0627
31 Oct 2011 17:22:14 1152902 13413025 hadcm3n_u5pj_1980_40_007460515_2 570,240 2,316,831 4.0629
31 Oct 2011 17:22:14 1152902 13413025 hadcm3n_u5pj_1980_40_007460515_2 544,320 2,211,610 4.0631


©2024 climateprediction.net