Task 13599579

Name	hadcm3n_ylzf_1980_40_007535678_1
Workunit	7732910
Created	5 Nov 2011, 10:05:18 UTC
Sent	8 Nov 2011, 16:06:51 UTC
Report deadline	7 Feb 2012, 23:34:02 UTC
Received	24 Dec 2011, 2:07:27 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1078510
Run time	8 days 7 hours 29 min 56 sec
CPU time	7 days 18 hours 2 min 19 sec
Validate state	Invalid
Credit	2,488.32
Device peak FLOPS	1.47 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.10.59</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:20:15 (7673): No heartbeat from core client for 30 sec - exiting 09:20:45 (7673): No heartbeat from core client for 30 sec - exiting 09:20:52 (7673): No heartbeat from core client for 30 sec - exiting 09:20:53 (7673): No heartbeat from core client for 30 sec - exiting 09:20:54 (7673): No heartbeat from core client for 30 sec - exiting 09:20:55 (7673): No heartbeat from core client for 30 sec - exiting 09:20:56 (7673): No heartbeat from core client for 30 sec - exiting 09:20:57 (7673): No heartbeat from core client for 30 sec - exiting 09:20:58 (7673): No heartbeat from core client for 30 sec - exiting 09:21:01 (7673): No heartbeat from core client for 30 sec - exiting 09:21:02 (7673): No heartbeat from core client for 30 sec - exiting 09:21:03 (7673): No heartbeat from core client for 30 sec - exiting 09:21:04 (7673): No heartbeat from core client for 30 sec - exiting 09:21:05 (7673): No heartbeat from core client for 30 sec - exiting 09:21:06 (7673): No heartbeat from core client for 30 sec - exiting 09:21:07 (7673): No heartbeat from core client for 30 sec - exiting 09:21:08 (7673): No heartbeat from core client for 30 sec - exiting 09:21:09 (7673): No heartbeat from core client for 30 sec - exiting 09:21:10 (7673): No heartbeat from core client for 30 sec - exiting 09:21:11 (7673): No heartbeat from core client for 30 sec - exiting 09:21:12 (7673): No heartbeat from core client for 30 sec - exiting 09:21:13 (7673): No heartbeat from core client for 30 sec - exiting 09:21:14 (7673): No heartbeat from core client for 30 sec - exiting 09:21:15 (7673): No heartbeat from core client for 30 sec - exiting 09:21:16 (7673): No heartbeat from core client for 30 sec - exiting 09:21:17 (7673): No heartbeat from core client for 30 sec - exiting 09:21:18 (7673): No heartbeat from core client for 30 sec - exiting 09:21:19 (7673): No heartbeat from core client for 30 sec - exiting 09:21:20 (7673): No heartbeat from core client for 30 sec - exiting 09:21:21 (7673): No heartbeat from core client for 30 sec - exiting 09:21:22 (7673): No heartbeat from core client for 30 sec - exiting 09:21:23 (7673): No heartbeat from core client for 30 sec - exiting 09:21:24 (7673): No heartbeat from core client for 30 sec - exiting 09:21:25 (7673): No heartbeat from core client for 30 sec - exiting 09:21:26 (7673): No heartbeat from core client for 30 sec - exiting 09:21:27 (7673): No heartbeat from core client for 30 sec - exiting 09:21:28 (7673): No heartbeat from core client for 30 sec - exiting 09:21:29 (7673): No heartbeat from core client for 30 sec - exiting 09:21:30 (7673): No heartbeat from core client for 30 sec - exiting 09:21:31 (7673): No heartbeat from core client for 30 sec - exiting 09:21:32 (7673): No heartbeat from core client for 30 sec - exiting 09:21:33 (7673): No heartbeat from core client for 30 sec - exiting 09:21:34 (7673): No heartbeat from core client for 30 sec - exiting 09:21:35 (7673): No heartbeat from core client for 30 sec - exiting 09:21:36 (7673): No heartbeat from core client for 30 sec - exiting 09:21:37 (7673): No heartbeat from core client for 30 sec - exiting 09:21:38 (7673): No heartbeat from core client for 30 sec - exiting 09:21:39 (7673): No heartbeat from core client for 30 sec - exiting 09:21:40 (7673): No heartbeat from core client for 30 sec - exiting 09:21:41 (7673): No heartbeat from core client for 30 sec - exiting 09:21:42 (7673): No heartbeat from core client for 30 sec - exiting 09:21:43 (7673): No heartbeat from core client for 30 sec - exiting 09:21:44 (7673): No heartbeat from core client for 30 sec - exiting 09:21:45 (7673): No heartbeat from core client for 30 sec - exiting 09:21:46 (7673): No heartbeat from core client for 30 sec - exiting 09:21:47 (7673): No heartbeat from core client for 30 sec - exiting 09:21:48 (7673): No heartbeat from core client for 30 sec - exiting 09:21:51 (7673): No heartbeat from core client for 30 sec - exiting 09:21:52 (7673): No heartbeat from core client for 30 sec - exiting 09:21:53 (7673): No heartbeat from core client for 30 sec - exiting 09:21:54 (7673): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:21:57 (7673): No heartbeat from core client for 30 sec - exiting 09:21:58 (7673): No heartbeat from core client for 30 sec - exiting 09:21:59 (7673): No heartbeat from core client for 30 sec - exiting 09:22:00 (7673): No heartbeat from core client for 30 sec - exiting 09:22:01 (7673): No heartbeat from core client for 30 sec - exiting 09:22:02 (7673): No heartbeat from core client for 30 sec - exiting 09:22:03 (7673): No heartbeat from core client for 30 sec - exiting 09:22:08 (7673): No heartbeat from core client for 30 sec - exiting 09:22:09 (7673): No heartbeat from core client for 30 sec - exiting 09:22:10 (7673): No heartbeat from core client for 30 sec - exiting 09:22:11 (7673): No heartbeat from core client for 30 sec - exiting 09:22:12 (7673): No heartbeat from core client for 30 sec - exiting 09:22:13 (7673): No heartbeat from core client for 30 sec - exiting 09:22:14 (7673): No heartbeat from core client for 30 sec - exiting 09:22:15 (7673): No heartbeat from core client for 30 sec - exiting 09:22:16 (7673): No heartbeat from core client for 30 sec - exiting 09:22:17 (7673): No heartbeat from core client for 30 sec - exiting 09:22:18 (7673): No heartbeat from core client for 30 sec - exiting 09:22:19 (7673): No heartbeat from core client for 30 sec - exiting 09:22:20 (7673): No heartbeat from core client for 30 sec - exiting 09:22:21 (7673): No heartbeat from core client for 30 sec - exiting 09:22:22 (7673): No heartbeat from core client for 30 sec - exiting 09:22:23 (7673): No heartbeat from core client for 30 sec - exiting 09:22:24 (7673): No heartbeat from core client for 30 sec - exiting 09:22:25 (7673): No heartbeat from core client for 30 sec - exiting 09:22:26 (7673): No heartbeat from core client for 30 sec - exiting 09:22:27 (7673): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... 14:54:49 (8996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=15190, selfPID=15190, iMonCtr=1 08:00:05 (16217): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:00:17 (9748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:57:09 (15818): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:01:28 (16532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:01:52 (16532): No heartbeat from core client for 30 sec - exiting 15:01:53 (16532): No heartbeat from core client for 30 sec - exiting 15:01:54 (16532): No heartbeat from core client for 30 sec - exiting 15:01:55 (16532): No heartbeat from core client for 30 sec - exiting 15:01:56 (16532): No heartbeat from core client for 30 sec - exiting 15:01:57 (16532): No heartbeat from core client for 30 sec - exiting 15:01:58 (16532): No heartbeat from core client for 30 sec - exiting 15:01:59 (16532): No heartbeat from core client for 30 sec - exiting 15:02:00 (16532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=16604, selfPID=16604, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:44:58 (31489): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:16:32 (32438): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:02:44 (870): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:11:22 (4879): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:41:37 (9977): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:58:51 (11149): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:11:27 (11428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:24:02 (3244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:24:06 (3244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:07:49 (7259): No heartbeat from core client for 30 sec - exiting 09:07:52 (7259): No heartbeat from core client for 30 sec - exiting 09:07:54 (7259): No heartbeat from core client for 30 sec - exiting 09:07:55 (7259): No heartbeat from core client for 30 sec - exiting 09:07:56 (7259): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:08:41 (4779): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:58:16 (5593): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:42:01 (5695): No heartbeat from core client for 30 sec - exiting 18:42:05 (5695): No heartbeat from core client for 30 sec - exiting 18:42:06 (5695): No heartbeat from core client for 30 sec - exiting 18:42:07 (5695): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:42:08 (5695): No heartbeat from core client for 30 sec - exiting 18:42:09 (5695): No heartbeat from core client for 30 sec - exiting 18:42:10 (5695): No heartbeat from core client for 30 sec - exiting 18:42:11 (5695): No heartbeat from core client for 30 sec - exiting 18:42:12 (5695): No heartbeat from core client for 30 sec - exiting 18:42:13 (5695): No heartbeat from core client for 30 sec - exiting 18:42:14 (5695): No heartbeat from core client for 30 sec - exiting 18:42:15 (5695): No heartbeat from core client for 30 sec - exiting 18:42:16 (5695): No heartbeat from core client for 30 sec - exiting 18:42:17 (5695): No heartbeat from core client for 30 sec - exiting 18:42:18 (5695): No heartbeat from core client for 30 sec - exiting 18:42:19 (5695): No heartbeat from core client for 30 sec - exiting 08:54:18 (6492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 BUFFIN: Read Failed: Numerical result out of range BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 BUFFIN: Read Failed: Numerical result out of range BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 BUFFIN: Read Failed: Numerical result out of range BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 BUFFIN: Read Failed: Numerical result out of range BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 BUFFIN: Read Failed: Numerical result out of range BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Invalid argument BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 BUFFIN: Read Failed: Numerical result out of range BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 Dec 2011 01:09:13	1078510	13599579	hadcm3n_ylzf_1980_40_007535678_1	207,360	666,056	3.2121
15 Dec 2011 03:48:01	1078510	13599579	hadcm3n_ylzf_1980_40_007535678_1	181,440	582,613	3.2111
08 Dec 2011 03:11:25	1078510	13599579	hadcm3n_ylzf_1980_40_007535678_1	155,520	498,410	3.2048
01 Dec 2011 23:39:29	1078510	13599579	hadcm3n_ylzf_1980_40_007535678_1	129,600	414,728	3.2001
26 Nov 2011 01:57:52	1078510	13599579	hadcm3n_ylzf_1980_40_007535678_1	103,680	330,705	3.1897
17 Nov 2011 00:31:16	1078510	13599579	hadcm3n_ylzf_1980_40_007535678_1	77,760	247,414	3.1818
15 Nov 2011 21:08:56	1078510	13599579	hadcm3n_ylzf_1980_40_007535678_1	51,840	165,314	3.1889
09 Nov 2011 19:32:23	1078510	13599579	hadcm3n_ylzf_1980_40_007535678_1	25,920	82,855	3.1966