Task 13553060

Name	hadcm3n_ygpb_1900_40_007523680_1
Workunit	7721155
Created	28 Oct 2011, 13:23:36 UTC
Sent	31 Oct 2011, 9:31:04 UTC
Report deadline	30 Jan 2012, 16:58:15 UTC
Received	4 Dec 2011, 10:01:44 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1146948
Run time	20 days 8 hours 43 min 17 sec
CPU time	19 days 17 hours 11 min 10 sec
Validate state	Invalid
Credit	9,020.16
Device peak FLOPS	2.42 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.10.59</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Error: Input file: dataout/ygpbko.pja7c10 is not a valid UM file. Error converting file to netcdf: dataout/ygpbko.pja7c10 Error: Input file: dataout/ygpbko.pia7c10 is not a valid UM file. Error converting file to netcdf: dataout/ygpbko.pia7c10 Error: Input file: dataout/ygpbko.pfa7c10 is not a valid UM file. Error converting file to netcdf: dataout/ygpbko.pfa7c10 Error: Input file: dataout/ygpbka.pha7c10 is not a valid UM file. Error converting file to netcdf: dataout/ygpbka.pha7c10 Error: Input file: dataout/ygpbka.pga7c10 is not a valid UM file. Error converting file to netcdf: dataout/ygpbka.pga7c10 Error: Input file: dataout/ygpbka.pea7c10 is not a valid UM file. Error converting file to netcdf: dataout/ygpbka.pea7c10 Error: Input file: dataout/ygpbka.pda7c10 is not a valid UM file. Error converting file to netcdf: dataout/ygpbka.pda7c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:24:02 (1842): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:24:03 (1842): No heartbeat from core client for 30 sec - exiting 10:24:04 (1842): No heartbeat from core client for 30 sec - exiting 10:24:05 (1842): No heartbeat from core client for 30 sec - exiting 10:24:06 (1842): No heartbeat from core client for 30 sec - exiting 10:24:07 (1842): No heartbeat from core client for 30 sec - exiting 10:24:08 (1842): No heartbeat from core client for 30 sec - exiting 10:24:09 (1842): No heartbeat from core client for 30 sec - exiting 10:24:10 (1842): No heartbeat from core client for 30 sec - exiting 08:47:19 (14670): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:47:32 (14670): No heartbeat from core client for 30 sec - exiting 08:47:33 (14670): No heartbeat from core client for 30 sec - exiting 08:47:34 (14670): No heartbeat from core client for 30 sec - exiting 08:47:35 (14670): No heartbeat from core client for 30 sec - exiting 08:47:36 (14670): No heartbeat from core client for 30 sec - exiting 08:47:37 (14670): No heartbeat from core client for 30 sec - exiting 08:47:38 (14670): No heartbeat from core client for 30 sec - exiting 08:47:39 (14670): No heartbeat from core client for 30 sec - exiting 08:47:40 (14670): No heartbeat from core client for 30 sec - exiting 08:47:41 (14670): No heartbeat from core client for 30 sec - exiting 08:47:42 (14670): No heartbeat from core client for 30 sec - exiting 08:47:43 (14670): No heartbeat from core client for 30 sec - exiting 08:47:44 (14670): No heartbeat from core client for 30 sec - exiting 08:47:45 (14670): No heartbeat from core client for 30 sec - exiting 08:47:46 (14670): No heartbeat from core client for 30 sec - exiting 08:47:47 (14670): No heartbeat from core client for 30 sec - exiting 08:47:48 (14670): No heartbeat from core client for 30 sec - exiting 08:47:49 (14670): No heartbeat from core client for 30 sec - exiting 08:47:50 (14670): No heartbeat from core client for 30 sec - exiting 08:47:51 (14670): No heartbeat from core client for 30 sec - exiting 08:47:52 (14670): No heartbeat from core client for 30 sec - exiting 08:47:53 (14670): No heartbeat from core client for 30 sec - exiting 08:47:54 (14670): No heartbeat from core client for 30 sec - exiting 08:47:55 (14670): No heartbeat from core client for 30 sec - exiting 08:47:56 (14670): No heartbeat from core client for 30 sec - exiting 08:47:57 (14670): No heartbeat from core client for 30 sec - exiting 08:47:58 (14670): No heartbeat from core client for 30 sec - exiting 08:47:59 (14670): No heartbeat from core client for 30 sec - exiting 08:48:00 (14670): No heartbeat from core client for 30 sec - exiting 08:48:01 (14670): No heartbeat from core client for 30 sec - exiting 08:48:02 (14670): No heartbeat from core client for 30 sec - exiting 08:48:03 (14670): No heartbeat from core client for 30 sec - exiting 08:48:04 (14670): No heartbeat from core client for 30 sec - exiting 08:48:05 (14670): No heartbeat from core client for 30 sec - exiting 08:48:06 (14670): No heartbeat from core client for 30 sec - exiting 08:48:07 (14670): No heartbeat from core client for 30 sec - exiting 08:48:08 (14670): No heartbeat from core client for 30 sec - exiting 08:48:09 (14670): No heartbeat from core client for 30 sec - exiting 08:48:10 (14670): No heartbeat from core client for 30 sec - exiting 08:48:11 (14670): No heartbeat from core client for 30 sec - exiting 08:48:12 (14670): No heartbeat from core client for 30 sec - exiting 08:48:13 (14670): No heartbeat from core client for 30 sec - exiting 08:48:14 (14670): No heartbeat from core client for 30 sec - exiting 08:48:15 (14670): No heartbeat from core client for 30 sec - exiting 08:48:16 (14670): No heartbeat from core client for 30 sec - exiting 08:48:17 (14670): No heartbeat from core client for 30 sec - exiting 08:48:18 (14670): No heartbeat from core client for 30 sec - exiting 08:48:19 (14670): No heartbeat from core client for 30 sec - exiting 08:48:20 (14670): No heartbeat from core client for 30 sec - exiting 08:48:21 (14670): No heartbeat from core client for 30 sec - exiting 08:48:22 (14670): No heartbeat from core client for 30 sec - exiting 08:48:23 (14670): No heartbeat from core client for 30 sec - exiting 08:48:24 (14670): No heartbeat from core client for 30 sec - exiting 08:48:25 (14670): No heartbeat from core client for 30 sec - exiting 08:48:26 (14670): No heartbeat from core client for 30 sec - exiting 08:48:27 (14670): No heartbeat from core client for 30 sec - exiting 08:48:28 (14670): No heartbeat from core client for 30 sec - exiting 08:48:59 (14670): No heartbeat from core client for 30 sec - exiting 08:49:00 (14670): No heartbeat from core client for 30 sec - exiting 08:49:01 (14670): No heartbeat from core client for 30 sec - exiting 08:49:02 (14670): No heartbeat from core client for 30 sec - exiting 08:49:03 (14670): No heartbeat from core client for 30 sec - exiting 08:49:04 (14670): No heartbeat from core client for 30 sec - exiting 08:49:05 (14670): No heartbeat from core client for 30 sec - exiting 08:49:06 (14670): No heartbeat from core client for 30 sec - exiting 08:49:07 (14670): No heartbeat from core client for 30 sec - exiting 08:49:08 (14670): No heartbeat from core client for 30 sec - exiting 08:49:09 (14670): No heartbeat from core client for 30 sec - exiting 08:49:10 (14670): No heartbeat from core client for 30 sec - exiting 08:49:11 (14670): No heartbeat from core client for 30 sec - exiting 08:49:12 (14670): No heartbeat from core client for 30 sec - exiting 08:49:13 (14670): No heartbeat from core client for 30 sec - exiting 08:49:14 (14670): No heartbeat from core client for 30 sec - exiting 08:49:15 (14670): No heartbeat from core client for 30 sec - exiting 08:49:16 (14670): No heartbeat from core client for 30 sec - exiting 08:49:17 (14670): No heartbeat from core client for 30 sec - exiting 08:49:18 (14670): No heartbeat from core client for 30 sec - exiting 08:49:19 (14670): No heartbeat from core client for 30 sec - exiting 08:49:20 (14670): No heartbeat from core client for 30 sec - exiting 08:49:21 (14670): No heartbeat from core client for 30 sec - exiting 08:49:22 (14670): No heartbeat from core client for 30 sec - exiting 08:49:23 (14670): No heartbeat from core client for 30 sec - exiting 08:49:24 (14670): No heartbeat from core client for 30 sec - exiting 08:49:25 (14670): No heartbeat from core client for 30 sec - exiting 08:49:26 (14670): No heartbeat from core client for 30 sec - exiting 08:49:27 (14670): No heartbeat from core client for 30 sec - exiting 08:49:28 (14670): No heartbeat from core client for 30 sec - exiting 08:49:29 (14670): No heartbeat from core client for 30 sec - exiting 08:49:30 (14670): No heartbeat from core client for 30 sec - exiting 08:49:31 (14670): No heartbeat from core client for 30 sec - exiting 08:49:32 (14670): No heartbeat from core client for 30 sec - exiting 08:49:33 (14670): No heartbeat from core client for 30 sec - exiting 08:49:34 (14670): No heartbeat from core client for 30 sec - exiting 08:49:35 (14670): No heartbeat from core client for 30 sec - exiting 08:49:36 (14670): No heartbeat from core client for 30 sec - exiting 08:49:37 (14670): No heartbeat from core client for 30 sec - exiting 08:49:38 (14670): No heartbeat from core client for 30 sec - exiting 08:49:39 (14670): No heartbeat from core client for 30 sec - exiting 08:49:40 (14670): No heartbeat from core client for 30 sec - exiting 08:49:41 (14670): No heartbeat from core client for 30 sec - exiting 08:49:42 (14670): No heartbeat from core client for 30 sec - exiting 08:49:43 (14670): No heartbeat from core client for 30 sec - exiting 08:49:44 (14670): No heartbeat from core client for 30 sec - exiting 08:49:45 (14670): No heartbeat from core client for 30 sec - exiting 08:49:46 (14670): No heartbeat from core client for 30 sec - exiting 08:49:47 (14670): No heartbeat from core client for 30 sec - exiting 08:49:48 (14670): No heartbeat from core client for 30 sec - exiting 08:49:49 (14670): No heartbeat from core client for 30 sec - exiting 08:49:50 (14670): No heartbeat from core client for 30 sec - exiting 08:49:51 (14670): No heartbeat from core client for 30 sec - exiting 08:49:52 (14670): No heartbeat from core client for 30 sec - exiting 08:49:53 (14670): No heartbeat from core client for 30 sec - exiting 08:49:54 (14670): No heartbeat from core client for 30 sec - exiting 08:49:55 (14670): No heartbeat from core client for 30 sec - exiting 08:49:56 (14670): No heartbeat from core client for 30 sec - exiting 08:49:57 (14670): No heartbeat from core client for 30 sec - exiting 08:49:58 (14670): No heartbeat from core client for 30 sec - exiting 08:49:59 (14670): No heartbeat from core client for 30 sec - exiting 08:50:00 (14670): No heartbeat from core client for 30 sec - exiting 08:50:01 (14670): No heartbeat from core client for 30 sec - exiting 08:50:02 (14670): No heartbeat from core client for 30 sec - exiting 08:50:03 (14670): No heartbeat from core client for 30 sec - exiting 08:50:04 (14670): No heartbeat from core client for 30 sec - exiting 08:50:05 (14670): No heartbeat from core client for 30 sec - exiting 08:50:06 (14670): No heartbeat from core client for 30 sec - exiting 08:50:07 (14670): No heartbeat from core client for 30 sec - exiting 08:50:08 (14670): No heartbeat from core client for 30 sec - exiting 08:50:09 (14670): No heartbeat from core client for 30 sec - exiting 08:50:10 (14670): No heartbeat from core client for 30 sec - exiting 08:50:11 (14670): No heartbeat from core client for 30 sec - exiting 08:50:12 (14670): No heartbeat from core client for 30 sec - exiting 08:50:13 (14670): No heartbeat from core client for 30 sec - exiting 08:50:14 (14670): No heartbeat from core client for 30 sec - exiting 08:50:15 (14670): No heartbeat from core client for 30 sec - exiting 08:50:16 (14670): No heartbeat from core client for 30 sec - exiting 08:50:17 (14670): No heartbeat from core client for 30 sec - exiting 08:50:18 (14670): No heartbeat from core client for 30 sec - exiting 08:50:19 (14670): No heartbeat from core client for 30 sec - exiting 08:50:20 (14670): No heartbeat from core client for 30 sec - exiting 08:50:21 (14670): No heartbeat from core client for 30 sec - exiting 08:50:22 (14670): No heartbeat from core client for 30 sec - exiting 08:50:23 (14670): No heartbeat from core client for 30 sec - exiting 08:50:24 (14670): No heartbeat from core client for 30 sec - exiting 08:50:25 (14670): No heartbeat from core client for 30 sec - exiting 08:50:26 (14670): No heartbeat from core client for 30 sec - exiting 08:50:27 (14670): No heartbeat from core client for 30 sec - exiting 08:50:28 (14670): No heartbeat from core client for 30 sec - exiting 08:50:29 (14670): No heartbeat from core client for 30 sec - exiting 08:50:30 (14670): No heartbeat from core client for 30 sec - exiting 08:50:31 (14670): No heartbeat from core client for 30 sec - exiting 08:50:32 (14670): No heartbeat from core client for 30 sec - exiting 08:50:33 (14670): No heartbeat from core client for 30 sec - exiting 08:50:34 (14670): No heartbeat from core client for 30 sec - exiting 08:50:35 (14670): No heartbeat from core client for 30 sec - exiting 08:50:36 (14670): No heartbeat from core client for 30 sec - exiting 08:50:37 (14670): No heartbeat from core client for 30 sec - exiting 08:50:38 (14670): No heartbeat from core client for 30 sec - exiting 08:50:39 (14670): No heartbeat from core client for 30 sec - exiting 08:50:40 (14670): No heartbeat from core client for 30 sec - exiting 08:50:41 (14670): No heartbeat from core client for 30 sec - exiting 08:50:42 (14670): No heartbeat from core client for 30 sec - exiting 08:50:43 (14670): No heartbeat from core client for 30 sec - exiting 08:50:44 (14670): No heartbeat from core client for 30 sec - exiting 08:50:45 (14670): No heartbeat from core client for 30 sec - exiting 08:50:46 (14670): No heartbeat from core client for 30 sec - exiting 08:50:47 (14670): No heartbeat from core client for 30 sec - exiting 08:50:48 (14670): No heartbeat from core client for 30 sec - exiting 08:50:49 (14670): No heartbeat from core client for 30 sec - exiting 08:50:50 (14670): No heartbeat from core client for 30 sec - exiting 08:50:51 (14670): No heartbeat from core client for 30 sec - exiting 08:50:52 (14670): No heartbeat from core client for 30 sec - exiting 08:50:53 (14670): No heartbeat from core client for 30 sec - exiting 08:50:54 (14670): No heartbeat from core client for 30 sec - exiting 08:50:55 (14670): No heartbeat from core client for 30 sec - exiting 08:50:56 (14670): No heartbeat from core client for 30 sec - exiting 08:50:57 (14670): No heartbeat from core client for 30 sec - exiting 08:50:58 (14670): No heartbeat from core client for 30 sec - exiting 08:50:59 (14670): No heartbeat from core client for 30 sec - exiting 08:51:00 (14670): No heartbeat from core client for 30 sec - exiting 08:51:01 (14670): No heartbeat from core client for 30 sec - exiting 08:51:02 (14670): No heartbeat from core client for 30 sec - exiting 08:51:03 (14670): No heartbeat from core client for 30 sec - exiting 08:51:04 (14670): No heartbeat from core client for 30 sec - exiting 08:51:05 (14670): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 08:58:27 (25072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 11:00:02 (12626): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... SIGABRT: abort called Stack trace (10 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf77b3400] [0xf77b3430] /lib32/libc.so.6(gsignal+0x51)[0xf7618ea1] /lib32/libc.so.6(abort+0x17e)[0xf761c2ce] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib32/libc.so.6(__libc_start_main+0xe7)[0xf7604e37] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=15224, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (10 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf76f9400] [0xf76f9430] /lib32/libc.so.6(gsignal+0x51)[0xf755eea1] /lib32/libc.so.6(abort+0x17e)[0xf75622ce] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib32/libc.so.6(__libc_start_main+0xe7)[0xf754ae37] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=15224, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (10 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf774e400] [0xf774e430] /lib32/libc.so.6(gsignal+0x51)[0xf75b3ea1] /lib32/libc.so.6(abort+0x17e)[0xf75b72ce] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib32/libc.so.6(__libc_start_main+0xe7)[0xf759fe37] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=15224, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (10 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf7770400] [0xf7770430] /lib32/libc.so.6(gsignal+0x51)[0xf75d5ea1] /lib32/libc.so.6(abort+0x17e)[0xf75d92ce] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib32/libc.so.6(__libc_start_main+0xe7)[0xf75c1e37] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=15224, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (10 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf7738400] [0xf7738430] /lib32/libc.so.6(gsignal+0x51)[0xf759dea1] /lib32/libc.so.6(abort+0x17e)[0xf75a12ce] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib32/libc.so.6(__libc_start_main+0xe7)[0xf7589e37] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=15224, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (10 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf77b8400] [0xf77b8430] /lib32/libc.so.6(gsignal+0x51)[0xf761dea1] /lib32/libc.so.6(abort+0x17e)[0xf76212ce] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib32/libc.so.6(__libc_start_main+0xe7)[0xf7609e37] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=15224, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
03 Dec 2011 19:25:48	1146948	13553060	hadcm3n_ygpb_1900_40_007523680_1	751,680	1,651,433	2.1970
03 Dec 2011 02:54:54	1146948	13553060	hadcm3n_ygpb_1900_40_007523680_1	725,760	1,594,676	2.1972
02 Dec 2011 09:37:13	1146948	13553060	hadcm3n_ygpb_1900_40_007523680_1	699,840	1,538,048	2.1977
01 Dec 2011 17:53:50	1146948	13553060	hadcm3n_ygpb_1900_40_007523680_1	673,920	1,481,482	2.1983
30 Nov 2011 23:52:33	1146948	13553060	hadcm3n_ygpb_1900_40_007523680_1	648,000	1,423,023	2.1960
30 Nov 2011 06:46:02	1146948	13553060	hadcm3n_ygpb_1900_40_007523680_1	622,080	1,364,732	2.1938
29 Nov 2011 14:22:15	1146948	13553060	hadcm3n_ygpb_1900_40_007523680_1	596,160	1,306,674	2.1918
28 Nov 2011 20:56:39	1146948	13553060	hadcm3n_ygpb_1900_40_007523680_1	570,240	1,249,035	2.1904
28 Nov 2011 04:59:28	1146948	13553060	hadcm3n_ygpb_1900_40_007523680_1	544,320	1,192,020	2.1899
27 Nov 2011 12:51:48	1146948	13553060	hadcm3n_ygpb_1900_40_007523680_1	518,400	1,134,908	2.1893
26 Nov 2011 20:41:39	1146948	13553060	hadcm3n_ygpb_1900_40_007523680_1	492,480	1,078,239	2.1894
26 Nov 2011 04:28:34	1146948	13553060	hadcm3n_ygpb_1900_40_007523680_1	466,560	1,021,673	2.1898
25 Nov 2011 12:26:56	1146948	13553060	hadcm3n_ygpb_1900_40_007523680_1	440,640	965,077	2.1902
24 Nov 2011 20:26:32	1146948	13553060	hadcm3n_ygpb_1900_40_007523680_1	414,720	908,320	2.1902
24 Nov 2011 03:50:18	1146948	13553060	hadcm3n_ygpb_1900_40_007523680_1	388,800	851,192	2.1893
23 Nov 2011 11:42:49	1146948	13553060	hadcm3n_ygpb_1900_40_007523680_1	362,880	794,671	2.1899
22 Nov 2011 19:28:22	1146948	13553060	hadcm3n_ygpb_1900_40_007523680_1	336,960	737,578	2.1889
21 Nov 2011 05:32:38	1146948	13553060	hadcm3n_ygpb_1900_40_007523680_1	311,040	681,432	2.1908
15 Nov 2011 17:17:36	1146948	13553060	hadcm3n_ygpb_1900_40_007523680_1	285,120	624,878	2.1916
15 Nov 2011 17:17:35	1146948	13553060	hadcm3n_ygpb_1900_40_007523680_1	259,200	568,102	2.1918