Task 12926108

Name	hadcm3n_o5y1_1940_40_007266414_0
Workunit	7464654
Created	2 Jun 2011, 19:27:00 UTC
Sent	2 Jun 2011, 19:27:11 UTC
Report deadline	2 Sep 2011, 2:54:22 UTC
Received	24 Jun 2011, 10:46:46 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	857716
Run time	9 days 14 hours 46 min 3 sec
CPU time	8 days 20 hours 25 min 52 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	3.18 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.12.26</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:11:17 (20919): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Error: Input file: dataout/o5y1ko.pje8c10 is not a valid UM file. Error converting file to netcdf: dataout/o5y1ko.pje8c10 Error: Input file: dataout/o5y1ko.pie8c10 is not a valid UM file. Error converting file to netcdf: dataout/o5y1ko.pie8c10 Error: Input file: dataout/o5y1ko.pfe8c10 is not a valid UM file. Error converting file to netcdf: dataout/o5y1ko.pfe8c10 Error: Input file: dataout/o5y1ka.phe8c10 is not a valid UM file. Error converting file to netcdf: dataout/o5y1ka.phe8c10 Error: Input file: dataout/o5y1ka.pge8c10 is not a valid UM file. Error converting file to netcdf: dataout/o5y1ka.pge8c10 Error: Input file: dataout/o5y1ka.pee8c10 is not a valid UM file. Error converting file to netcdf: dataout/o5y1ka.pee8c10 Error: Input file: dataout/o5y1ka.pde8c10 is not a valid UM file. Error converting file to netcdf: dataout/o5y1ka.pde8c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(279,0xa0979540) malloc: * error for object 0x3800e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(279,0xa0979540) malloc: * error for object 0x380f404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(279,0xa0979540) malloc: * error for object 0x3813404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(279,0xa0979540) malloc: * error for object 0x3813400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.7 build 10J869 Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish hadcm3n_6.07_i686-apple-darwin(262,0xa0979540) malloc: * error for object 0x2024e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(262,0xa0979540) malloc: * error for object 0x2025c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(262,0xa0979540) malloc: * error for object 0x2025c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(262,0xa0979540) malloc: * error for object 0x2025c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(262,0xa0979540) malloc: * error for object 0x2025c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(262,0xa0979540) malloc: * error for object 0x2025c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(262,0xa0979540) malloc: * error for object 0x2025c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(262,0xa0979540) malloc: * error for object 0x2025c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(262,0xa0979540) malloc: * error for object 0x2025c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(262,0xa0979540) malloc: * error for object 0x2025c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(262,0xa0979540) malloc: * error for object 0x2025c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 06:31:01 (283): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:31:02 (283): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 3 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
24 Jun 2011 02:07:50	857716	12926108	hadcm3n_o5y1_1940_40_007266414_0	518,400	751,332	1.4493
23 Jun 2011 14:23:46	857716	12926108	hadcm3n_o5y1_1940_40_007266414_0	492,480	714,607	1.4510
22 Jun 2011 15:23:31	857716	12926108	hadcm3n_o5y1_1940_40_007266414_0	466,560	673,702	1.4440
21 Jun 2011 13:53:07	857716	12926108	hadcm3n_o5y1_1940_40_007266414_0	440,640	635,882	1.4431
20 Jun 2011 14:53:29	857716	12926108	hadcm3n_o5y1_1940_40_007266414_0	414,720	595,827	1.4367
20 Jun 2011 01:12:12	857716	12926108	hadcm3n_o5y1_1940_40_007266414_0	388,800	558,679	1.4369
20 Jun 2011 01:12:12	857716	12926108	hadcm3n_o5y1_1940_40_007266414_0	362,880	521,582	1.4373
20 Jun 2011 01:12:12	857716	12926108	hadcm3n_o5y1_1940_40_007266414_0	336,960	482,948	1.4333
19 Jun 2011 22:03:16	857716	12926108	hadcm3n_o5y1_1940_40_007266414_0	311,040	445,408	1.4320
17 Jun 2011 03:21:22	857716	12926108	hadcm3n_o5y1_1940_40_007266414_0	285,120	407,846	1.4304
16 Jun 2011 13:42:01	857716	12926108	hadcm3n_o5y1_1940_40_007266414_0	259,200	369,820	1.4268
15 Jun 2011 14:14:16	857716	12926108	hadcm3n_o5y1_1940_40_007266414_0	233,280	328,233	1.4070
14 Jun 2011 12:28:06	857716	12926108	hadcm3n_o5y1_1940_40_007266414_0	207,360	289,042	1.3939
13 Jun 2011 21:12:13	857716	12926108	hadcm3n_o5y1_1940_40_007266414_0	181,440	252,447	1.3914
12 Jun 2011 04:52:51	857716	12926108	hadcm3n_o5y1_1940_40_007266414_0	155,520	216,973	1.3951
11 Jun 2011 03:37:48	857716	12926108	hadcm3n_o5y1_1940_40_007266414_0	129,600	179,656	1.3862
10 Jun 2011 01:59:02	857716	12926108	hadcm3n_o5y1_1940_40_007266414_0	103,680	143,429	1.3834
09 Jun 2011 11:46:33	857716	12926108	hadcm3n_o5y1_1940_40_007266414_0	77,760	106,557	1.3703
08 Jun 2011 15:51:14	857716	12926108	hadcm3n_o5y1_1940_40_007266414_0	51,840	70,608	1.3620
07 Jun 2011 18:02:27	857716	12926108	hadcm3n_o5y1_1940_40_007266414_0	25,920	35,421	1.3666