climateprediction.net home page
Task 13597508

Task 13597508

Name hadcm3n_yg3a_1980_40_007534724_2
Workunit 7731956
Created 5 Nov 2011, 6:15:11 UTC
Sent 5 Nov 2011, 6:19:18 UTC
Report deadline 4 Feb 2012, 13:46:29 UTC
Received 16 Dec 2011, 22:50:20 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1143633
Run time 24 days 19 hours 39 min 38 sec
CPU time 24 days 19 hours 39 min 38 sec
Validate state Invalid
Credit 9,331.20
Device peak FLOPS 1.93 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.2.14</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
Error: Input file: dataout/yg3ako.pji1c10 is not a valid UM file.
Error converting file to netcdf: dataout/yg3ako.pji1c10
Error: Input file: dataout/yg3ako.pii1c10 is not a valid UM file.
Error converting file to netcdf: dataout/yg3ako.pii1c10
Error: Input file: dataout/yg3ako.pfi1c10 is not a valid UM file.
Error converting file to netcdf: dataout/yg3ako.pfi1c10
Error: Input file: dataout/yg3aka.phi1c10 is not a valid UM file.
Error converting file to netcdf: dataout/yg3aka.phi1c10
Error: Input file: dataout/yg3aka.pgi1c10 is not a valid UM file.
Error converting file to netcdf: dataout/yg3aka.pgi1c10
Error: Input file: dataout/yg3aka.pei1c10 is not a valid UM file.
Error converting file to netcdf: dataout/yg3aka.pei1c10
Error: Input file: dataout/yg3aka.pdi1c10 is not a valid UM file.
Error converting file to netcdf: dataout/yg3aka.pdi1c10
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
*** glibc detected *** hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (!prev): 0x086562f0 ***
======= Backtrace: =========
/lib/i686/cmov/libc.so.6[0xb7590764]
/lib/i686/cmov/libc.so.6(cfree+0x96)[0xb7592966]
/usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0xb77682e1]
/usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0xb776833d]
hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/i686/cmov/libc.so.6(__libc_start_main+0xe5)[0xb7538455]
hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 09:00 1998871    /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 09:00 1998871    /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 080e4000 00:00 0 
08592000-08692000 rw-p 08592000 00:00 0          [heap]
b6f00000-b6f21000 rw-p b6f00000 00:00 0 
b6f21000-b7000000 ---p b6f21000 00:00 0 
b70a1000-b751c000 rw-s 00000000 09:00 3326762    /var/lib/boinc-client/slots/4/136245
b751c000-b751d000 ---p b751c000 00:00 0 
b751d000-b7522000 rw-p b751d000 00:00 0 
b7522000-b7677000 r-xp 00000000 09:00 893027     /lib/i686/cmov/libc-2.7.so
b7677000-b7678000 r--p 00155000 09:00 893027     /lib/i686/cmov/libc-2.7.so
b7678000-b767a000 rw-p 00156000 09:00 893027     /lib/i686/cmov/libc-2.7.so
b767a000-b767d000 rw-p b767a000 00:00 0 
b767d000-b7689000 r-xp 00000000 09:00 884774     /lib/libgcc_s.so.1
b7689000-b768a000 rw-p 0000b000 09:00 884774     /lib/libgcc_s.so.1
b768a000-b76ae000 r-xp 00000000 09:00 892996     /lib/i686/cmov/libm-2.7.so
b76ae000-b76b0000 rw-p 00023000 09:00 892996     /lib/i686/cmov/libm-2.7.so
b76b0000-b7793000 r-xp 00000000 09:00 3948705    /usr/lib/libstdc++.so.6.0.10
b7793000-b7796000 r--p 000e2000 09:00 3948705    /usr/lib/libstdc++.so.6.0.10
b7796000-b7798000 rw-p 000e5000 09:00 3948705    /usr/lib/libstdc++.so.6.0.10
b7798000-b779f000 rw-p b7798000 00:00 0 
b779f000-b77a1000 r-xp 00000000 09:00 893018     /lib/i686/cmov/libdl-2.7.so
b77a1000-b77a3000 rw-p 00001000 09:00 893018     /lib/i686/cmov/libdl-2.7.so
b77a3000-b77b8000 r-xp 00000000 09:00 893002     /lib/i686/cmov/libpthread-2.7.so
b77b8000-b77ba000 rw-p 00014000 09:00 893002     /lib/i686/cmov/libpthread-2.7.so
b77ba000-b77bc000 rw-p b77ba000 00:00 0 
b77bd000-b77be000 rw-p b77bd000 00:00 0 
b77be000-b77c0000 rw-s 00000000 09:00 3326760    /var/lib/boinc-client/slots/4/boinc_mmap_file
b77c0000-b77c2000 rw-p b77c0000 00:00 0 
b77c2000-b77c3000 r-xp b77c2000 00:00 0          [vdso]
b77c3000-b77dd000 r-xp 00000000 09:00 885607     /lib/ld-2.7.so
b77dd000-b77df000 rw-p 0001a000 09:00 885607     /lib/ld-2.7.so
bf81b000-bf88a000 rw-p bff90000 00:00 0          [stack]
SIGABRT: abort called
Stack trace (18 frames):
hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xb77c2400]
[0xb77c2424]
/lib/i686/cmov/libc.so.6(gsignal+0x50)[0xb754d640]
/lib/i686/cmov/libc.so.6(abort+0x188)[0xb754f018]
/lib/i686/cmov/libc.so.6[0xb758a48d]
/lib/i686/cmov/libc.so.6[0xb7590764]
/lib/i686/cmov/libc.so.6(cfree+0x96)[0xb7592966]
/usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0xb77682e1]
/usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0xb776833d]
hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/i686/cmov/libc.so.6(__libc_start_main+0xe5)[0xb7538455]
hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
16 Dec 2011 22:51:10 1143633 13597508 hadcm3n_yg3a_1980_40_007534724_2 777,600 2,144,371 2.7577
14 Dec 2011 21:10:43 1143633 13597508 hadcm3n_yg3a_1980_40_007534724_2 751,680 2,072,475 2.7571
13 Dec 2011 06:55:17 1143633 13597508 hadcm3n_yg3a_1980_40_007534724_2 725,760 2,000,397 2.7563
11 Dec 2011 23:55:58 1143633 13597508 hadcm3n_yg3a_1980_40_007534724_2 699,840 1,926,307 2.7525
10 Dec 2011 14:37:23 1143633 13597508 hadcm3n_yg3a_1980_40_007534724_2 673,920 1,852,965 2.7495
09 Dec 2011 07:42:21 1143633 13597508 hadcm3n_yg3a_1980_40_007534724_2 648,000 1,782,970 2.7515
07 Dec 2011 12:53:08 1143633 13597508 hadcm3n_yg3a_1980_40_007534724_2 622,080 1,710,552 2.7497
06 Dec 2011 04:28:28 1143633 13597508 hadcm3n_yg3a_1980_40_007534724_2 596,160 1,639,859 2.7507
04 Dec 2011 12:55:54 1143633 13597508 hadcm3n_yg3a_1980_40_007534724_2 570,240 1,567,400 2.7487
03 Dec 2011 00:14:03 1143633 13597508 hadcm3n_yg3a_1980_40_007534724_2 544,320 1,497,090 2.7504
01 Dec 2011 12:42:24 1143633 13597508 hadcm3n_yg3a_1980_40_007534724_2 518,400 1,425,839 2.7505
30 Nov 2011 00:24:00 1143633 13597508 hadcm3n_yg3a_1980_40_007534724_2 492,480 1,354,386 2.7501
27 Nov 2011 14:37:14 1143633 13597508 hadcm3n_yg3a_1980_40_007534724_2 466,560 1,282,037 2.7479
26 Nov 2011 05:48:54 1143633 13597508 hadcm3n_yg3a_1980_40_007534724_2 440,640 1,211,992 2.7505
25 Nov 2011 09:11:04 1143633 13597508 hadcm3n_yg3a_1980_40_007534724_2 414,720 1,138,043 2.7441
24 Nov 2011 12:32:38 1143633 13597508 hadcm3n_yg3a_1980_40_007534724_2 388,800 1,064,114 2.7369
23 Nov 2011 15:59:01 1143633 13597508 hadcm3n_yg3a_1980_40_007534724_2 362,880 990,795 2.7304
22 Nov 2011 20:39:04 1143633 13597508 hadcm3n_yg3a_1980_40_007534724_2 336,960 921,882 2.7359
22 Nov 2011 01:17:00 1143633 13597508 hadcm3n_yg3a_1980_40_007534724_2 311,040 852,662 2.7413
21 Nov 2011 05:17:36 1143633 13597508 hadcm3n_yg3a_1980_40_007534724_2 285,120 781,529 2.7411


©2024 climateprediction.net