Task 15938799

Name	hadcm3n_n319_1880_40_008409095_1
Workunit	8559951
Created	24 Aug 2013, 19:25:03 UTC
Sent	24 Aug 2013, 19:25:05 UTC
Report deadline	24 Nov 2013, 2:52:16 UTC
Received	11 Sep 2013, 20:20:01 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1290100
Run time	11 days 7 hours 8 min 45 sec
CPU time	9 days 3 hours 20 min 36 sec
Validate state	Invalid
Credit	9,642.24
Device peak FLOPS	3.24 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(81064,0xac38f2c0) malloc: * error for object 0x13a0e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(81064,0xac38f2c0) malloc: * error for object 0xb8b804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(81064,0xac38f2c0) malloc: * error for object 0x13a0e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(81064,0xac38f2c0) malloc: * error for object 0x2397204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(81064,0xac38f2c0) malloc: * error for object 0x2ba6c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(81064,0xac38f2c0) malloc: * error for object 0x13a0e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(81064,0xac38f2c0) malloc: * error for object 0x13bc404: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(81064,0xac38f2c0) malloc: * error for object 0x13bc400: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(81064,0xac38f2c0) malloc: * error for object 0x23b2804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(81064,0xac38f2c0) malloc: * error for object 0x23b2800: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(81064,0xac38f2c0) malloc: * error for object 0xb8b804: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(81064,0xac38f2c0) malloc: * error for object 0x13a0e04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(81064,0xac38f2c0) malloc: * error for object 0x138c604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(81064,0xac38f2c0) malloc: * error for object 0x138c600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(81064,0xac38f2c0) malloc: * error for object 0xb6b604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(81064,0xac38f2c0) malloc: * error for object 0xb6b600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(81064,0xac38f2c0) malloc: * error for object 0xb6b604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(81064,0xac38f2c0) malloc: * error for object 0xb6b600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(81064,0xac38f2c0) malloc: * error for object 0xb6b604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(81064,0xac38f2c0) malloc: * error for object 0xb6b600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(81064,0xac38f2c0) malloc: * error for object 0xb6b604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(81064,0xac38f2c0) malloc: * error for object 0xb6b600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(81064,0xac38f2c0) malloc: * error for object 0xb6b604: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(81064,0xac38f2c0) malloc: * error for object 0xb6b600: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Error: Input file: dataout/n319ko.pja2c10 is not a valid UM file. Error converting file to netcdf: dataout/n319ko.pja2c10 Error: Input file: dataout/n319ko.pia2c10 is not a valid UM file. Error converting file to netcdf: dataout/n319ko.pia2c10 Error: Input file: dataout/n319ko.pfa2c10 is not a valid UM file. Error converting file to netcdf: dataout/n319ko.pfa2c10 Error: Input file: dataout/n319ka.pha2c10 is not a valid UM file. Error converting file to netcdf: dataout/n319ka.pha2c10 Error: Input file: dataout/n319ka.pga2c10 is not a valid UM file. Error converting file to netcdf: dataout/n319ka.pga2c10 Error: Input file: dataout/n319ka.pea2c10 is not a valid UM file. Error converting file to netcdf: dataout/n319ka.pea2c10 Error: Input file: dataout/n319ka.pda2c10 is not a valid UM file. Error converting file to netcdf: dataout/n319ka.pda2c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(1775,0xac38f2c0) malloc: * error for object 0x2c23204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1775,0xac38f2c0) malloc: * error for object 0x2c23200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1775,0xac38f2c0) malloc: * error for object 0x2bf9004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1775,0xac38f2c0) malloc: * error for object 0x2bf9000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1775,0xac38f2c0) malloc: * error for object 0x2bf9004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1775,0xac38f2c0) malloc: * error for object 0x2bf9000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1775,0xac38f2c0) malloc: * error for object 0x2bf9004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1775,0xac38f2c0) malloc: * error for object 0x2bf9000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1775,0xac38f2c0) malloc: * error for object 0x2bf9004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1775,0xac38f2c0) malloc: * error for object 0x2bf9000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1775,0xac38f2c0) malloc: * error for object 0x2bf9004: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(1775,0xac38f2c0) malloc: * error for object 0x2bf9000: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 3 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
10 Sep 2013 20:57:39	1290100	15938799	hadcm3n_n319_1880_40_008409095_1	803,520	769,525	0.9577
10 Sep 2013 01:26:14	1290100	15938799	hadcm3n_n319_1880_40_008409095_1	777,600	744,089	0.9569
09 Sep 2013 16:47:49	1290100	15938799	hadcm3n_n319_1880_40_008409095_1	751,680	718,861	0.9563
09 Sep 2013 08:38:04	1290100	15938799	hadcm3n_n319_1880_40_008409095_1	725,760	693,664	0.9558
09 Sep 2013 00:11:11	1290100	15938799	hadcm3n_n319_1880_40_008409095_1	699,840	668,362	0.9550
08 Sep 2013 03:25:03	1290100	15938799	hadcm3n_n319_1880_40_008409095_1	673,920	642,986	0.9541
07 Sep 2013 18:26:59	1290100	15938799	hadcm3n_n319_1880_40_008409095_1	648,000	617,975	0.9537
06 Sep 2013 22:31:35	1290100	15938799	hadcm3n_n319_1880_40_008409095_1	622,080	593,459	0.9540
06 Sep 2013 02:39:22	1290100	15938799	hadcm3n_n319_1880_40_008409095_1	596,160	569,166	0.9547
05 Sep 2013 04:07:02	1290100	15938799	hadcm3n_n319_1880_40_008409095_1	570,240	544,876	0.9555
04 Sep 2013 19:34:58	1290100	15938799	hadcm3n_n319_1880_40_008409095_1	544,320	520,304	0.9559
03 Sep 2013 21:36:34	1290100	15938799	hadcm3n_n319_1880_40_008409095_1	518,400	495,319	0.9555
02 Sep 2013 21:30:46	1290100	15938799	hadcm3n_n319_1880_40_008409095_1	492,480	470,150	0.9547
02 Sep 2013 01:01:00	1290100	15938799	hadcm3n_n319_1880_40_008409095_1	466,560	445,007	0.9538
01 Sep 2013 17:12:42	1290100	15938799	hadcm3n_n319_1880_40_008409095_1	440,640	419,885	0.9529
31 Aug 2013 22:20:48	1290100	15938799	hadcm3n_n319_1880_40_008409095_1	414,720	394,780	0.9519
31 Aug 2013 13:27:05	1290100	15938799	hadcm3n_n319_1880_40_008409095_1	388,800	369,659	0.9508
31 Aug 2013 04:53:11	1290100	15938799	hadcm3n_n319_1880_40_008409095_1	362,880	344,515	0.9494
30 Aug 2013 19:57:54	1290100	15938799	hadcm3n_n319_1880_40_008409095_1	336,960	319,409	0.9479
30 Aug 2013 11:09:26	1290100	15938799	hadcm3n_n319_1880_40_008409095_1	311,040	294,237	0.9460