climateprediction.net home page
Task 15446911

Task 15446911

Name hadcm3n_zhku_1880_40_008248434_1
Workunit 8403558
Created 21 Nov 2012, 14:03:36 UTC
Sent 21 Nov 2012, 14:03:37 UTC
Report deadline 20 Feb 2013, 21:30:48 UTC
Received 20 Jan 2013, 7:01:50 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1143634
Run time 16 days 11 hours 44 min 24 sec
CPU time 16 days 11 hours 44 min 24 sec
Validate state Invalid
Credit 6,220.80
Device peak FLOPS 1.92 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.2.14</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
03:36:38 (31907): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
Error: Input file: dataout/zhkuko.pj95c10 is not a valid UM file.
Error converting file to netcdf: dataout/zhkuko.pj95c10
Error: Input file: dataout/zhkuko.pi95c10 is not a valid UM file.
Error converting file to netcdf: dataout/zhkuko.pi95c10
Error: Input file: dataout/zhkuko.pf95c10 is not a valid UM file.
Error converting file to netcdf: dataout/zhkuko.pf95c10
Error: Input file: dataout/zhkuka.ph95c10 is not a valid UM file.
Error converting file to netcdf: dataout/zhkuka.ph95c10
Error: Input file: dataout/zhkuka.pg95c10 is not a valid UM file.
Error converting file to netcdf: dataout/zhkuka.pg95c10
Error: Input file: dataout/zhkuka.pe95c10 is not a valid UM file.
Error converting file to netcdf: dataout/zhkuka.pe95c10
Error: Input file: dataout/zhkuka.pd95c10 is not a valid UM file.
Error converting file to netcdf: dataout/zhkuka.pd95c10
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
*** glibc detected *** hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08d9b038 ***
======= Backtrace: =========
/lib/i686/cmov/libc.so.6[0xb755d764]
/lib/i686/cmov/libc.so.6(cfree+0x96)[0xb755f966]
/usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0xb77352e1]
/usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0xb773533d]
hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/i686/cmov/libc.so.6(__libc_start_main+0xe5)[0xb7505455]
hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 09:00 17358858   /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 09:00 17358858   /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 080e4000 00:00 0 
08d45000-08dab000 rw-p 08d45000 00:00 0          [heap]
b6f00000-b6f21000 rw-p b6f00000 00:00 0 
b6f21000-b7000000 ---p b6f21000 00:00 0 
b706e000-b74e9000 rw-s 00000000 09:00 19318807   /var/lib/boinc-client/slots/4/140295
b74e9000-b74ea000 ---p b74e9000 00:00 0 
b74ea000-b74ef000 rw-p b74ea000 00:00 0 
b74ef000-b7644000 r-xp 00000000 09:00 27362121   /lib/i686/cmov/libc-2.7.so
b7644000-b7645000 r--p 00155000 09:00 27362121   /lib/i686/cmov/libc-2.7.so
b7645000-b7647000 rw-p 00156000 09:00 27362121   /lib/i686/cmov/libc-2.7.so
b7647000-b764a000 rw-p b7647000 00:00 0 
b764a000-b7656000 r-xp 00000000 09:00 27353128   /lib/libgcc_s.so.1
b7656000-b7657000 rw-p 0000b000 09:00 27353128   /lib/libgcc_s.so.1
b7657000-b767b000 r-xp 00000000 09:00 27361310   /lib/i686/cmov/libm-2.7.so
b767b000-b767d000 rw-p 00023000 09:00 27361310   /lib/i686/cmov/libm-2.7.so
b767d000-b7760000 r-xp 00000000 09:00 12509454   /usr/lib/libstdc++.so.6.0.10
b7760000-b7763000 r--p 000e2000 09:00 12509454   /usr/lib/libstdc++.so.6.0.10
b7763000-b7765000 rw-p 000e5000 09:00 12509454   /usr/lib/libstdc++.so.6.0.10
b7765000-b776c000 rw-p b7765000 00:00 0 
b776c000-b776e000 r-xp 00000000 09:00 27361318   /lib/i686/cmov/libdl-2.7.so
b776e000-b7770000 rw-p 00001000 09:00 27361318   /lib/i686/cmov/libdl-2.7.so
b7770000-b7785000 r-xp 00000000 09:00 27361314   /lib/i686/cmov/libpthread-2.7.so
b7785000-b7787000 rw-p 00014000 09:00 27361314   /lib/i686/cmov/libpthread-2.7.so
b7787000-b7789000 rw-p b7787000 00:00 0 
b778a000-b778b000 rw-p b778a000 00:00 0 
b778b000-b778d000 rw-s 00000000 09:00 19318829   /var/lib/boinc-client/slots/4/boinc_mmap_file
b778d000-b778f000 rw-p b778d000 00:00 0 
b778f000-b7790000 r-xp b778f000 00:00 0          [vdso]
b7790000-b77aa000 r-xp 00000000 09:00 27353189   /lib/ld-2.7.so
b77aa000-b77ac000 rw-p 0001a000 09:00 27353189   /lib/ld-2.7.so
bfb25000-bfb94000 rw-p bff90000 00:00 0          [stack]
SIGABRT: abort called
Stack trace (18 frames):
hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xb778f400]
[0xb778f424]
/lib/i686/cmov/libc.so.6(gsignal+0x50)[0xb751a640]
/lib/i686/cmov/libc.so.6(abort+0x188)[0xb751c018]
/lib/i686/cmov/libc.so.6[0xb755748d]
/lib/i686/cmov/libc.so.6[0xb755d764]
/lib/i686/cmov/libc.so.6(cfree+0x96)[0xb755f966]
/usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0xb77352e1]
/usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0xb773533d]
hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/i686/cmov/libc.so.6(__libc_start_main+0xe5)[0xb7505455]
hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
20 Jan 2013 07:04:22 1143634 15446911 hadcm3n_zhku_1880_40_008248434_1 518,400 1,424,660 2.7482
18 Jan 2013 21:47:28 1143634 15446911 hadcm3n_zhku_1880_40_008248434_1 492,480 1,356,010 2.7534
16 Jan 2013 22:12:08 1143634 15446911 hadcm3n_zhku_1880_40_008248434_1 466,560 1,285,109 2.7544
15 Jan 2013 10:33:56 1143634 15446911 hadcm3n_zhku_1880_40_008248434_1 440,640 1,215,717 2.7590
13 Jan 2013 17:41:01 1143634 15446911 hadcm3n_zhku_1880_40_008248434_1 414,720 1,145,626 2.7624
12 Jan 2013 09:09:18 1143634 15446911 hadcm3n_zhku_1880_40_008248434_1 388,800 1,076,466 2.7687
10 Jan 2013 23:52:44 1143634 15446911 hadcm3n_zhku_1880_40_008248434_1 362,880 1,007,893 2.7775
09 Jan 2013 02:53:59 1143634 15446911 hadcm3n_zhku_1880_40_008248434_1 336,960 938,014 2.7838
07 Jan 2013 10:26:23 1143634 15446911 hadcm3n_zhku_1880_40_008248434_1 311,040 868,624 2.7926
03 Jan 2013 02:44:41 1143634 15446911 hadcm3n_zhku_1880_40_008248434_1 285,120 796,496 2.7935
29 Dec 2012 07:15:04 1143634 15446911 hadcm3n_zhku_1880_40_008248434_1 259,200 723,851 2.7926
23 Dec 2012 09:33:14 1143634 15446911 hadcm3n_zhku_1880_40_008248434_1 233,280 651,341 2.7921
17 Dec 2012 04:38:57 1143634 15446911 hadcm3n_zhku_1880_40_008248434_1 207,360 579,044 2.7925
13 Dec 2012 20:56:38 1143634 15446911 hadcm3n_zhku_1880_40_008248434_1 181,440 506,852 2.7935
01 Dec 2012 18:30:14 1143634 15446911 hadcm3n_zhku_1880_40_008248434_1 155,520 434,227 2.7921
30 Nov 2012 21:58:47 1143634 15446911 hadcm3n_zhku_1880_40_008248434_1 129,600 361,909 2.7925
30 Nov 2012 01:40:19 1143634 15446911 hadcm3n_zhku_1880_40_008248434_1 103,680 289,462 2.7919
29 Nov 2012 05:21:48 1143634 15446911 hadcm3n_zhku_1880_40_008248434_1 77,760 216,970 2.7903
28 Nov 2012 08:51:50 1143634 15446911 hadcm3n_zhku_1880_40_008248434_1 51,840 144,501 2.7874
27 Nov 2012 12:29:24 1143634 15446911 hadcm3n_zhku_1880_40_008248434_1 25,920 72,267 2.7881


©2024 climateprediction.net