climateprediction.net home page
Task 13398677

Task 13398677

Name hadcm3n_y9ui_1940_40_007456792_1
Workunit 7654295
Created 19 Sep 2011, 2:36:50 UTC
Sent 19 Sep 2011, 9:47:51 UTC
Report deadline 19 Dec 2011, 17:15:02 UTC
Received 25 Oct 2011, 14:44:33 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1169531
Run time 25 days 19 hours 53 min 55 sec
CPU time 24 days 21 hours 50 min 32 sec
Validate state Invalid
Credit 9,331.20
Device peak FLOPS 2.12 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.59</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
17:04:34 (7383): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
CPDN Monitor - Quit request from BOINC...

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
06:42:07 (24720): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:42:48 (11101): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x089b0a00 ***
======= Backtrace: =========
/lib32/libc.so.6(+0x6b511)[0xf7548511]
/lib32/libc.so.6(+0x6ce1b)[0xf7549e1b]
/lib32/libc.so.6(cfree+0x6d)[0xf754cf8d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf7726841]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf772689d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe7)[0xf74f3e37]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:01 9699330                            /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:01 9699330                            /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
0895b000-089c1000 rw-p 00000000 00:00 0                                  [heap]
f6f00000-f6f21000 rw-p 00000000 00:00 0 
f6f21000-f7000000 ---p 00000000 00:00 0 
f705f000-f74da000 rw-s 00000000 08:01 9700462                            /var/lib/boinc-client/slots/4/138695
f74da000-f74dd000 rw-p 00000000 00:00 0 
f74dd000-f7633000 r-xp 00000000 08:01 25952261                           /lib32/libc-2.13.so
f7633000-f7634000 ---p 00156000 08:01 25952261                           /lib32/libc-2.13.so
f7634000-f7636000 r--p 00156000 08:01 25952261                           /lib32/libc-2.13.so
f7636000-f7637000 rw-p 00158000 08:01 25952261                           /lib32/libc-2.13.so
f7637000-f763a000 rw-p 00000000 00:00 0 
f763a000-f7654000 r-xp 00000000 08:01 22553600                           /usr/lib32/libgcc_s.so.1
f7654000-f7655000 r--p 00019000 08:01 22553600                           /usr/lib32/libgcc_s.so.1
f7655000-f7656000 rw-p 0001a000 08:01 22553600                           /usr/lib32/libgcc_s.so.1
f7656000-f767a000 r-xp 00000000 08:01 25952265                           /lib32/libm-2.13.so
f767a000-f767b000 r--p 00023000 08:01 25952265                           /lib32/libm-2.13.so
f767b000-f767c000 rw-p 00024000 08:01 25952265                           /lib32/libm-2.13.so
f767c000-f775b000 r-xp 00000000 08:01 22546959                           /usr/lib32/libstdc++.so.6.0.14
f775b000-f775f000 r--p 000de000 08:01 22546959                           /usr/lib32/libstdc++.so.6.0.14
f775f000-f7760000 rw-p 000e2000 08:01 22546959                           /usr/lib32/libstdc++.so.6.0.14
f7760000-f7767000 rw-p 00000000 00:00 0 
f7767000-f7769000 r-xp 00000000 08:01 25952264                           /lib32/libdl-2.13.so
f7769000-f776a000 r--p 00001000 08:01 25952264                           /lib32/libdl-2.13.so
f776a000-f776b000 rw-p 00002000 08:01 25952264                           /lib32/libdl-2.13.so
f776b000-f7780000 r-xp 00000000 08:01 25952275                           /lib32/libpthread-2.13.so
f7780000-f7781000 r--p 00014000 08:01 25952275                           /lib32/libpthread-2.13.so
f7781000-f7782000 rw-p 00015000 08:01 25952275                           /lib32/libpthread-2.13.so
f7782000-f7785000 rw-p 00000000 00:00 0 
f779e000-f779f000 rw-p 00000000 00:00 0 
f779f000-f77a0000 ---p 00000000 00:00 0 
f77a0000-f77a3000 rw-p 00000000 00:00 0 
f77a3000-f77a5000 rw-s 00000000 08:01 9700371                            /var/lib/boinc-client/slots/4/boinc_mmap_file
f77a5000-f77a6000 rw-p 00000000 00:00 0 
f77a6000-f77a7000 r-xp 00000000 00:00 0                                  [vdso]
f77a7000-f77c3000 r-xp 00000000 08:01 25952258                           /lib32/ld-2.13.so
f77c3000-f77c4000 r--p 0001b000 08:01 25952258                           /lib32/ld-2.13.so
f77c4000-f77c5000 rw-p 0001c000 08:01 25952258                           /lib32/ld-2.13.so
ffa90000-ffb00000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf77a6400]
[0xf77a6430]
/lib32/libc.so.6(gsignal+0x51)[0xf7507ea1]
/lib32/libc.so.6(abort+0x17e)[0xf750b2ce]
/lib32/libc.so.6(+0x61277)[0xf753e277]
/lib32/libc.so.6(+0x6b511)[0xf7548511]
/lib32/libc.so.6(+0x6ce1b)[0xf7549e1b]
/lib32/libc.so.6(cfree+0x6d)[0xf754cf8d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf7726841]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf772689d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe7)[0xf74f3e37]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
31 Oct 2011 12:49:44 1169531 13398677 hadcm3n_y9ui_1940_40_007456792_1 777,600 2,152,225 2.7678
31 Oct 2011 12:49:46 1169531 13398677 hadcm3n_y9ui_1940_40_007456792_1 751,680 2,084,686 2.7734
31 Oct 2011 12:49:44 1169531 13398677 hadcm3n_y9ui_1940_40_007456792_1 725,760 2,020,106 2.7834
31 Oct 2011 12:49:44 1169531 13398677 hadcm3n_y9ui_1940_40_007456792_1 699,840 1,954,955 2.7934
31 Oct 2011 12:49:46 1169531 13398677 hadcm3n_y9ui_1940_40_007456792_1 673,920 1,889,731 2.8041
31 Oct 2011 12:49:44 1169531 13398677 hadcm3n_y9ui_1940_40_007456792_1 648,000 1,824,179 2.8151
18 Oct 2011 18:24:34 1169531 13398677 hadcm3n_y9ui_1940_40_007456792_1 622,080 1,756,051 2.8229
17 Oct 2011 23:03:48 1169531 13398677 hadcm3n_y9ui_1940_40_007456792_1 596,160 1,688,907 2.8330
17 Oct 2011 03:56:39 1169531 13398677 hadcm3n_y9ui_1940_40_007456792_1 570,240 1,622,852 2.8459
16 Oct 2011 07:51:06 1169531 13398677 hadcm3n_y9ui_1940_40_007456792_1 544,320 1,556,479 2.8595
15 Oct 2011 10:43:44 1169531 13398677 hadcm3n_y9ui_1940_40_007456792_1 518,400 1,491,343 2.8768
14 Oct 2011 13:33:46 1169531 13398677 hadcm3n_y9ui_1940_40_007456792_1 492,480 1,425,062 2.8936
12 Oct 2011 08:24:54 1169531 13398677 hadcm3n_y9ui_1940_40_007456792_1 466,560 1,358,154 2.9110
09 Oct 2011 21:53:59 1169531 13398677 hadcm3n_y9ui_1940_40_007456792_1 440,640 1,291,425 2.9308
04 Oct 2011 20:47:22 1169531 13398677 hadcm3n_y9ui_1940_40_007456792_1 388,800 1,141,362 2.9356
03 Oct 2011 18:32:13 1169531 13398677 hadcm3n_y9ui_1940_40_007456792_1 362,880 1,064,762 2.9342
02 Oct 2011 15:06:20 1169531 13398677 hadcm3n_y9ui_1940_40_007456792_1 336,960 988,584 2.9338
01 Oct 2011 17:06:12 1169531 13398677 hadcm3n_y9ui_1940_40_007456792_1 311,040 912,390 2.9334
30 Sep 2011 19:13:07 1169531 13398677 hadcm3n_y9ui_1940_40_007456792_1 285,120 835,991 2.9321
29 Sep 2011 17:05:18 1169531 13398677 hadcm3n_y9ui_1940_40_007456792_1 259,200 759,695 2.9309


©2024 climateprediction.net