climateprediction.net home page
Task 13383674

Task 13383674

Name hadcm3n_p3mz_1940_40_007420449_2
Workunit 7618084
Created 13 Sep 2011, 14:30:30 UTC
Sent 13 Sep 2011, 14:42:57 UTC
Report deadline 13 Dec 2011, 22:10:08 UTC
Received 12 Oct 2011, 15:03:56 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1155314
Run time 12 days 2 hours 32 min 31 sec
CPU time 11 days 21 hours 21 min 45 sec
Validate state Invalid
Credit 6,220.80
Device peak FLOPS 2.55 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.59</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
Error: Input file: dataout/p3mzko.pje5c10 is not a valid UM file.
Error converting file to netcdf: dataout/p3mzko.pje5c10
Error: Input file: dataout/p3mzko.pie5c10 is not a valid UM file.
Error converting file to netcdf: dataout/p3mzko.pie5c10
Error: Input file: dataout/p3mzko.pfe5c10 is not a valid UM file.
Error converting file to netcdf: dataout/p3mzko.pfe5c10
Error: Input file: dataout/p3mzka.phe5c10 is not a valid UM file.
Error converting file to netcdf: dataout/p3mzka.phe5c10
Error: Input file: dataout/p3mzka.pge5c10 is not a valid UM file.
Error converting file to netcdf: dataout/p3mzka.pge5c10
Error: Input file: dataout/p3mzka.pee5c10 is not a valid UM file.
Error converting file to netcdf: dataout/p3mzka.pee5c10
Error: Input file: dataout/p3mzka.pde5c10 is not a valid UM file.
Error converting file to netcdf: dataout/p3mzka.pde5c10
CPDN Monitor - Quit request from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
CPDN Monitor - Quit request from BOINC...

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (!prev): 0x09f48f00 ***
======= Backtrace: =========
/lib32/libc.so.6(+0x6b511)[0xf74c4511]
/lib32/libc.so.6(+0x6ce1b)[0xf74c5e1b]
/lib32/libc.so.6(cfree+0x6d)[0xf74c8f8d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf76a2841]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf76a289d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe7)[0xf746fe37]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:01 1050082                            /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:01 1050082                            /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
09e85000-09f85000 rw-p 00000000 00:00 0                                  [heap]
f6e00000-f6e21000 rw-p 00000000 00:00 0 
f6e21000-f6f00000 ---p 00000000 00:00 0 
f6fdb000-f7456000 rw-s 00000000 08:01 1063067                            /var/lib/boinc-client/slots/2/137355
f7456000-f7459000 rw-p 00000000 00:00 0 
f7459000-f75af000 r-xp 00000000 08:01 2359304                            /lib32/libc-2.13.so
f75af000-f75b0000 ---p 00156000 08:01 2359304                            /lib32/libc-2.13.so
f75b0000-f75b2000 r--p 00156000 08:01 2359304                            /lib32/libc-2.13.so
f75b2000-f75b3000 rw-p 00158000 08:01 2359304                            /lib32/libc-2.13.so
f75b3000-f75b6000 rw-p 00000000 00:00 0 
f75b6000-f75d0000 r-xp 00000000 08:01 275673                             /usr/lib32/libgcc_s.so.1
f75d0000-f75d1000 r--p 00019000 08:01 275673                             /usr/lib32/libgcc_s.so.1
f75d1000-f75d2000 rw-p 0001a000 08:01 275673                             /usr/lib32/libgcc_s.so.1
f75d2000-f75f6000 r-xp 00000000 08:01 2359308                            /lib32/libm-2.13.so
f75f6000-f75f7000 r--p 00023000 08:01 2359308                            /lib32/libm-2.13.so
f75f7000-f75f8000 rw-p 00024000 08:01 2359308                            /lib32/libm-2.13.so
f75f8000-f76d7000 r-xp 00000000 08:01 275676                             /usr/lib32/libstdc++.so.6.0.14
f76d7000-f76db000 r--p 000de000 08:01 275676                             /usr/lib32/libstdc++.so.6.0.14
f76db000-f76dc000 rw-p 000e2000 08:01 275676                             /usr/lib32/libstdc++.so.6.0.14
f76dc000-f76e3000 rw-p 00000000 00:00 0 
f76e3000-f76e5000 r-xp 00000000 08:01 2359307                            /lib32/libdl-2.13.so
f76e5000-f76e6000 r--p 00001000 08:01 2359307                            /lib32/libdl-2.13.so
f76e6000-f76e7000 rw-p 00002000 08:01 2359307                            /lib32/libdl-2.13.so
f76e7000-f76fc000 r-xp 00000000 08:01 2359318                            /lib32/libpthread-2.13.so
f76fc000-f76fd000 r--p 00014000 08:01 2359318                            /lib32/libpthread-2.13.so
f76fd000-f76fe000 rw-p 00015000 08:01 2359318                            /lib32/libpthread-2.13.so
f76fe000-f7701000 rw-p 00000000 00:00 0 
f771e000-f771f000 rw-p 00000000 00:00 0 
f771f000-f7720000 ---p 00000000 00:00 0 
f7720000-f7723000 rw-p 00000000 00:00 0 
f7723000-f7725000 rw-s 00000000 08:01 1064696                            /var/lib/boinc-client/slots/2/boinc_mmap_file
f7725000-f7726000 rw-p 00000000 00:00 0 
f7726000-f7727000 r-xp 00000000 00:00 0                                  [vdso]
f7727000-f7743000 r-xp 00000000 08:01 2359301                            /lib32/ld-2.13.so
f7743000-f7744000 r--p 0001b000 08:01 2359301                            /lib32/ld-2.13.so
f7744000-f7745000 rw-p 0001c000 08:01 2359301                            /lib32/ld-2.13.so
ffdfb000-ffe6a000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf7726400]
[0xf7726430]
/lib32/libc.so.6(gsignal+0x51)[0xf7483ea1]
/lib32/libc.so.6(abort+0x17e)[0xf74872ce]
/lib32/libc.so.6(+0x61277)[0xf74ba277]
/lib32/libc.so.6(+0x6b511)[0xf74c4511]
/lib32/libc.so.6(+0x6ce1b)[0xf74c5e1b]
/lib32/libc.so.6(cfree+0x6d)[0xf74c8f8d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf76a2841]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf76a289d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe7)[0xf746fe37]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
12 Oct 2011 15:05:59 1155314 13383674 hadcm3n_p3mz_1940_40_007420449_2 518,400 1,027,299 1.9817
11 Oct 2011 22:46:08 1155314 13383674 hadcm3n_p3mz_1940_40_007420449_2 492,480 976,147 1.9821
11 Oct 2011 06:08:23 1155314 13383674 hadcm3n_p3mz_1940_40_007420449_2 466,560 925,757 1.9842
10 Oct 2011 16:49:25 1155314 13383674 hadcm3n_p3mz_1940_40_007420449_2 440,640 876,519 1.9892
10 Oct 2011 01:52:23 1155314 13383674 hadcm3n_p3mz_1940_40_007420449_2 414,720 827,066 1.9943
09 Oct 2011 11:54:24 1155314 13383674 hadcm3n_p3mz_1940_40_007420449_2 388,800 777,202 1.9990
08 Oct 2011 21:10:49 1155314 13383674 hadcm3n_p3mz_1940_40_007420449_2 362,880 724,658 1.9970
08 Oct 2011 06:15:00 1155314 13383674 hadcm3n_p3mz_1940_40_007420449_2 336,960 671,519 1.9929
07 Oct 2011 15:19:31 1155314 13383674 hadcm3n_p3mz_1940_40_007420449_2 311,040 618,218 1.9876
06 Oct 2011 17:56:47 1155314 13383674 hadcm3n_p3mz_1940_40_007420449_2 285,120 565,501 1.9834
05 Oct 2011 22:08:09 1155314 13383674 hadcm3n_p3mz_1940_40_007420449_2 259,200 513,559 1.9813
05 Oct 2011 08:50:11 1155314 13383674 hadcm3n_p3mz_1940_40_007420449_2 233,280 464,236 1.9900
04 Oct 2011 18:34:11 1155314 13383674 hadcm3n_p3mz_1940_40_007420449_2 207,360 414,894 2.0008
04 Oct 2011 05:13:20 1155314 13383674 hadcm3n_p3mz_1940_40_007420449_2 181,440 365,350 2.0136
03 Oct 2011 15:26:21 1155314 13383674 hadcm3n_p3mz_1940_40_007420449_2 155,520 314,642 2.0232
25 Sep 2011 21:26:59 1155314 13383674 hadcm3n_p3mz_1940_40_007420449_2 103,680 211,199 2.0370
21 Sep 2011 01:01:45 1155314 13383674 hadcm3n_p3mz_1940_40_007420449_2 77,760 158,584 2.0394
14 Sep 2011 23:16:25 1155314 13383674 hadcm3n_p3mz_1940_40_007420449_2 51,840 106,413 2.0527
14 Sep 2011 06:18:54 1155314 13383674 hadcm3n_p3mz_1940_40_007420449_2 25,920 53,473 2.0630


©2024 climateprediction.net