Task 14290691

Name	hadcm3n_ycsl_1940_40_007833829_1
Workunit	7988941
Created	19 Mar 2012, 13:36:56 UTC
Sent	19 Mar 2012, 13:42:05 UTC
Report deadline	18 Jun 2012, 21:09:16 UTC
Received	25 Apr 2012, 19:23:09 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1065226
Run time	5 days 12 hours 22 min 40 sec
CPU time	3 days 20 hours 48 min 59 sec
Validate state	Invalid
Credit	1,244.16
Device peak FLOPS	1.49 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> 20:54:07 (1656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:54:08 (1656): No heartbeat from core client for 30 sec - exiting Ocean Restart file copy failed on ycslko.dae0cf0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Ocean Restart file copy failed on ycslko.dae1590 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Ocean Restart file copy failed on ycslko.dae1750 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Ocean Restart file copy failed on ycslko.dae1860 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Ocean Restart file copy failed on ycslko.dae19e0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Ocean Restart file copy failed on ycslko.dae1ci0 Ocean Restart file copy failed on ycslko.dae1cl0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Ocean Restart file copy failed on ycslko.dae2210 Ocean Restart file copy failed on ycslko.dae2240 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Ocean Restart file copy failed on ycslko.dae2330 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Ocean Restart file copy failed on ycslko.dae2590 Ocean Restart file copy failed on ycslko.dae27g0 Ocean Restart file copy failed on ycslko.dae29l0 Atmos Hold Restart file rename failed on atmos_restart.hold Ocean Restart file copy failed on ycslko.dae31k0 Ocean Restart file copy failed on ycslko.dae31p0 15:33:31 (5160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:33:32 (5160): No heartbeat from core client for 30 sec - exiting 15:33:33 (5160): No heartbeat from core client for 30 sec - exiting 15:33:34 (5160): No heartbeat from core client for 30 sec - exiting 15:33:35 (5160): No heartbeat from core client for 30 sec - exiting 15:33:36 (5160): No heartbeat from core client for 30 sec - exiting 15:33:38 (5160): No heartbeat from core client for 30 sec - exiting 15:33:39 (5160): No heartbeat from core client for 30 sec - exiting 15:33:40 (5160): No heartbeat from core client for 30 sec - exiting 15:33:41 (5160): No heartbeat from core client for 30 sec - exiting 15:33:42 (5160): No heartbeat from core client for 30 sec - exiting 15:33:43 (5160): No heartbeat from core client for 30 sec - exiting 15:33:44 (5160): No heartbeat from core client for 30 sec - exiting 15:33:45 (5160): No heartbeat from core client for 30 sec - exiting 15:33:46 (5160): No heartbeat from core client for 30 sec - exiting 15:33:47 (5160): No heartbeat from core client for 30 sec - exiting 15:33:48 (5160): No heartbeat from core client for 30 sec - exiting 15:33:49 (5160): No heartbeat from core client for 30 sec - exiting 15:33:50 (5160): No heartbeat from core client for 30 sec - exiting 15:33:51 (5160): No heartbeat from core client for 30 sec - exiting 15:33:52 (5160): No heartbeat from core client for 30 sec - exiting 15:33:53 (5160): No heartbeat from core client for 30 sec - exiting 15:33:54 (5160): No heartbeat from core client for 30 sec - exiting 15:33:55 (5160): No heartbeat from core client for 30 sec - exiting 15:33:56 (5160): No heartbeat from core client for 30 sec - exiting 15:33:57 (5160): No heartbeat from core client for 30 sec - exiting 15:34:56 (5160): No heartbeat from core client for 30 sec - exiting 15:34:57 (5160): No heartbeat from core client for 30 sec - exiting 15:34:58 (5160): No heartbeat from core client for 30 sec - exiting 15:34:59 (5160): No heartbeat from core client for 30 sec - exiting 15:35:00 (5160): No heartbeat from core client for 30 sec - exiting 15:35:01 (5160): No heartbeat from core client for 30 sec - exiting 15:35:02 (5160): No heartbeat from core client for 30 sec - exiting 15:35:03 (5160): No heartbeat from core client for 30 sec - exiting 15:35:04 (5160): No heartbeat from core client for 30 sec - exiting 15:35:05 (5160): No heartbeat from core client for 30 sec - exiting 15:35:06 (5160): No heartbeat from core client for 30 sec - exiting 15:35:07 (5160): No heartbeat from core client for 30 sec - exiting 15:35:08 (5160): No heartbeat from core client for 30 sec - exiting 15:35:09 (5160): No heartbeat from core client for 30 sec - exiting 15:35:10 (5160): No heartbeat from core client for 30 sec - exiting 15:35:11 (5160): No heartbeat from core client for 30 sec - exiting 15:35:12 (5160): No heartbeat from core client for 30 sec - exiting 15:35:13 (5160): No heartbeat from core client for 30 sec - exiting 15:35:14 (5160): No heartbeat from core client for 30 sec - exiting 15:35:15 (5160): No heartbeat from core client for 30 sec - exiting 15:35:16 (5160): No heartbeat from core client for 30 sec - exiting 15:35:17 (5160): No heartbeat from core client for 30 sec - exiting 15:35:18 (5160): No heartbeat from core client for 30 sec - exiting 15:35:19 (5160): No heartbeat from core client for 30 sec - exiting 15:35:20 (5160): No heartbeat from core client for 30 sec - exiting 15:35:21 (5160): No heartbeat from core client for 30 sec - exiting 15:35:22 (5160): No heartbeat from core client for 30 sec - exiting 15:35:23 (5160): No heartbeat from core client for 30 sec - exiting 15:35:24 (5160): No heartbeat from core client for 30 sec - exiting 15:35:25 (5160): No heartbeat from core client for 30 sec - exiting 15:35:26 (5160): No heartbeat from core client for 30 sec - exiting 15:35:27 (5160): No heartbeat from core client for 30 sec - exiting Ocean Restart file copy failed on ycslko.dae33u0 Ocean Restart file copy failed on ycslko.dae34a0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Ocean Restart file copy failed on ycslko.dae3570 Ocean Restart file copy failed on ycslko.dae35u0 CPDN Monitor - Quit request from BOINC... Ocean Restart file copy failed on ycslko.dae36c0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Ocean Restart file copy failed on ycslko.dae37m0 Ocean Restart file copy failed on ycslko.dae37q0 CPDN Monitor - Quit request from BOINC... Ocean Restart file copy failed on ycslko.dae3880 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Ocean Restart file copy failed on ycslko.dae3a70 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Ocean Restart file copy failed on ycslko.dae3bu0 No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1852, selfPID=1852, iMonCtr=1 Ocean Restart file copy failed on ycslko.dae3cq0 CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold Ocean Restart file copy failed on ycslko.dae42p0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Ocean Restart file copy failed on ycslko.dae43k0 Ocean Restart file copy failed on ycslko.dae43s0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Ocean Restart file copy failed on ycslko.dae44j0 Ocean Restart file copy failed on ycslko.dae44r0 CPDN Monitor - Quit request from BOINC... Ocean Restart file copy failed on ycslko.dae45o0 Ocean Restart file copy failed on ycslko.dae45u0 Ocean Restart file copy failed on ycslko.dae4640 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Ocean Restart file copy failed on ycslko.dae4710 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Ocean Restart file copy failed on ycslko.dae4980 CPDN Monitor - Quit request from BOINC... Ocean Restart file copy failed on ycslko.dae49j0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Ocean Restart file copy failed on ycslko.dae5180 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:25:18 (1612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:25:27 (1612): No heartbeat from core client for 30 sec - exiting 05:25:35 (1612): No heartbeat from core client for 30 sec - exiting 05:25:36 (1612): No heartbeat from core client for 30 sec - exiting 05:25:44 (1612): No heartbeat from core client for 30 sec - exiting 05:26:01 (1612): No heartbeat from core client for 30 sec - exiting 05:26:06 (1612): No heartbeat from core client for 30 sec - exiting 05:27:11 (1612): No heartbeat from core client for 30 sec - exiting 05:27:29 (1612): No heartbeat from core client for 30 sec - exiting 05:27:34 (1612): No heartbeat from core client for 30 sec - exiting 05:28:04 (1612): No heartbeat from core client for 30 sec - exiting 05:28:06 (1612): No heartbeat from core client for 30 sec - exiting 05:28:07 (1612): No heartbeat from core client for 30 sec - exiting 05:28:10 (1612): No heartbeat from core client for 30 sec - exiting 05:28:11 (1612): No heartbeat from core client for 30 sec - exiting 05:28:19 (1612): No heartbeat from core client for 30 sec - exiting 05:28:47 (1612): No heartbeat from core client for 30 sec - exiting 05:28:54 (1612): No heartbeat from core client for 30 sec - exiting 05:29:01 (1612): No heartbeat from core client for 30 sec - exiting 05:29:08 (1612): No heartbeat from core client for 30 sec - exiting 05:29:09 (1612): No heartbeat from core client for 30 sec - exiting 05:29:10 (1612): No heartbeat from core client for 30 sec - exiting 05:29:11 (1612): No heartbeat from core client for 30 sec - exiting 05:29:12 (1612): No heartbeat from core client for 30 sec - exiting 05:29:14 (1612): No heartbeat from core client for 30 sec - exiting 05:29:15 (1612): No heartbeat from core client for 30 sec - exiting 05:29:16 (1612): No heartbeat from core client for 30 sec - exiting 05:29:17 (1612): No heartbeat from core client for 30 sec - exiting 05:29:18 (1612): No heartbeat from core client for 30 sec - exiting 05:29:19 (1612): No heartbeat from core client for 30 sec - exiting 05:29:20 (1612): No heartbeat from core client for 30 sec - exiting 05:29:30 (1612): No heartbeat from core client for 30 sec - exiting 05:29:31 (1612): No heartbeat from core client for 30 sec - exiting 05:29:32 (1612): No heartbeat from core client for 30 sec - exiting 05:29:33 (1612): No heartbeat from core client for 30 sec - exiting 05:29:34 (1612): No heartbeat from core client for 30 sec - exiting 05:29:35 (1612): No heartbeat from core client for 30 sec - exiting 05:29:36 (1612): No heartbeat from core client for 30 sec - exiting 05:29:37 (1612): No heartbeat from core client for 30 sec - exiting 05:29:38 (1612): No heartbeat from core client for 30 sec - exiting 05:29:39 (1612): No heartbeat from core client for 30 sec - exiting 05:29:40 (1612): No heartbeat from core client for 30 sec - exiting 05:29:41 (1612): No heartbeat from core client for 30 sec - exiting 05:29:42 (1612): No heartbeat from core client for 30 sec - exiting 05:29:43 (1612): No heartbeat from core client for 30 sec - exiting 05:29:44 (1612): No heartbeat from core client for 30 sec - exiting 05:29:45 (1612): No heartbeat from core client for 30 sec - exiting 05:29:46 (1612): No heartbeat from core client for 30 sec - exiting 05:29:47 (1612): No heartbeat from core client for 30 sec - exiting 05:29:48 (1612): No heartbeat from core client for 30 sec - exiting 05:29:49 (1612): No heartbeat from core client for 30 sec - exiting 05:29:50 (1612): No heartbeat from core client for 30 sec - exiting 05:29:51 (1612): No heartbeat from core client for 30 sec - exiting 05:29:52 (1612): No heartbeat from core client for 30 sec - exiting 05:29:53 (1612): No heartbeat from core client for 30 sec - exiting 05:29:54 (1612): No heartbeat from core client for 30 sec - exiting 05:29:55 (1612): No heartbeat from core client for 30 sec - exiting 05:29:56 (1612): No heartbeat from core client for 30 sec - exiting 05:29:57 (1612): No heartbeat from core client for 30 sec - exiting 05:29:58 (1612): No heartbeat from core client for 30 sec - exiting 05:29:59 (1612): No heartbeat from core client for 30 sec - exiting 05:30:00 (1612): No heartbeat from core client for 30 sec - exiting 05:30:01 (1612): No heartbeat from core client for 30 sec - exiting 05:30:02 (1612): No heartbeat from core client for 30 sec - exiting 05:30:03 (1612): No heartbeat from core client for 30 sec - exiting 05:30:04 (1612): No heartbeat from core client for 30 sec - exiting 05:30:05 (1612): No heartbeat from core client for 30 sec - exiting 05:30:06 (1612): No heartbeat from core client for 30 sec - exiting 05:30:07 (1612): No heartbeat from core client for 30 sec - exiting 05:30:08 (1612): No heartbeat from core client for 30 sec - exiting 05:30:09 (1612): No heartbeat from core client for 30 sec - exiting 05:30:10 (1612): No heartbeat from core client for 30 sec - exiting 05:30:11 (1612): No heartbeat from core client for 30 sec - exiting 05:30:12 (1612): No heartbeat from core client for 30 sec - exiting 05:30:13 (1612): No heartbeat from core client for 30 sec - exiting 05:30:14 (1612): No heartbeat from core client for 30 sec - exiting 05:30:15 (1612): No heartbeat from core client for 30 sec - exiting 05:30:16 (1612): No heartbeat from core client for 30 sec - exiting 05:30:17 (1612): No heartbeat from core client for 30 sec - exiting 05:30:18 (1612): No heartbeat from core client for 30 sec - exiting 05:30:19 (1612): No heartbeat from core client for 30 sec - exiting 05:30:20 (1612): No heartbeat from core client for 30 sec - exiting 05:30:21 (1612): No heartbeat from core client for 30 sec - exiting 05:30:22 (1612): No heartbeat from core client for 30 sec - exiting 05:30:23 (1612): No heartbeat from core client for 30 sec - exiting 05:30:24 (1612): No heartbeat from core client for 30 sec - exiting 05:30:25 (1612): No heartbeat from core client for 30 sec - exiting 05:30:26 (1612): No heartbeat from core client for 30 sec - exiting 05:30:27 (1612): No heartbeat from core client for 30 sec - exiting 05:30:28 (1612): No heartbeat from core client for 30 sec - exiting 05:30:29 (1612): No heartbeat from core client for 30 sec - exiting 05:30:30 (1612): No heartbeat from core client for 30 sec - exiting 05:30:31 (1612): No heartbeat from core client for 30 sec - exiting 05:30:32 (1612): No heartbeat from core client for 30 sec - exiting 05:30:33 (1612): No heartbeat from core client for 30 sec - exiting 05:30:34 (1612): No heartbeat from core client for 30 sec - exiting 05:30:35 (1612): No heartbeat from core client for 30 sec - exiting 05:30:36 (1612): No heartbeat from core client for 30 sec - exiting 05:30:37 (1612): No heartbeat from core client for 30 sec - exiting 05:30:38 (1612): No heartbeat from core client for 30 sec - exiting 05:30:39 (1612): No heartbeat from core client for 30 sec - exiting 05:30:40 (1612): No heartbeat from core client for 30 sec - exiting 05:30:41 (1612): No heartbeat from core client for 30 sec - exiting 05:30:42 (1612): No heartbeat from core client for 30 sec - exiting 05:30:43 (1612): No heartbeat from core client for 30 sec - exiting 05:30:44 (1612): No heartbeat from core client for 30 sec - exiting 05:30:45 (1612): No heartbeat from core client for 30 sec - exiting 05:30:46 (1612): No heartbeat from core client for 30 sec - exiting 05:40:40 (4116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:40:41 (4116): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 05:52:40 (4116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:53:17 (4116): No heartbeat from core client for 30 sec - exiting 05:55:44 (4116): No heartbeat from core client for 30 sec - exiting 05:55:46 (4116): No heartbeat from core client for 30 sec - exiting 05:55:47 (4116): No heartbeat from core client for 30 sec - exiting 05:55:48 (4116): No heartbeat from core client for 30 sec - exiting 05:55:49 (4116): No heartbeat from core client for 30 sec - exiting 05:55:50 (4116): No heartbeat from core client for 30 sec - exiting 05:55:51 (4116): No heartbeat from core client for 30 sec - exiting 05:55:52 (4116): No heartbeat from core client for 30 sec - exiting 05:55:53 (4116): No heartbeat from core client for 30 sec - exiting 05:55:54 (4116): No heartbeat from core client for 30 sec - exiting 05:55:55 (4116): No heartbeat from core client for 30 sec - exiting 05:55:56 (4116): No heartbeat from core client for 30 sec - exiting 05:55:57 (4116): No heartbeat from core client for 30 sec - exiting 05:55:58 (4116): No heartbeat from core client for 30 sec - exiting 05:55:59 (4116): No heartbeat from core client for 30 sec - exiting 05:56:00 (4116): No heartbeat from core client for 30 sec - exiting 05:56:09 (4116): No heartbeat from core client for 30 sec - exiting 05:56:10 (4116): No heartbeat from core client for 30 sec - exiting 05:56:11 (4116): No heartbeat from core client for 30 sec - exiting 05:56:12 (4116): No heartbeat from core client for 30 sec - exiting 05:56:13 (4116): No heartbeat from core client for 30 sec - exiting 05:56:14 (4116): No heartbeat from core client for 30 sec - exiting 05:56:15 (4116): No heartbeat from core client for 30 sec - exiting 05:56:16 (4116): No heartbeat from core client for 30 sec - exiting 05:56:17 (4116): No heartbeat from core client for 30 sec - exiting 05:56:18 (4116): No heartbeat from core client for 30 sec - exiting 05:56:19 (4116): No heartbeat from core client for 30 sec - exiting 05:56:20 (4116): No heartbeat from core client for 30 sec - exiting 05:56:21 (4116): No heartbeat from core client for 30 sec - exiting 05:56:22 (4116): No heartbeat from core client for 30 sec - exiting 05:56:23 (4116): No heartbeat from core client for 30 sec - exiting 05:56:24 (4116): No heartbeat from core client for 30 sec - exiting 05:56:25 (4116): No heartbeat from core client for 30 sec - exiting 05:56:26 (4116): No heartbeat from core client for 30 sec - exiting 05:56:27 (4116): No heartbeat from core client for 30 sec - exiting 05:56:28 (4116): No heartbeat from core client for 30 sec - exiting 05:56:29 (4116): No heartbeat from core client for 30 sec - exiting 05:56:30 (4116): No heartbeat from core client for 30 sec - exiting 05:56:31 (4116): No heartbeat from core client for 30 sec - exiting 05:56:32 (4116): No heartbeat from core client for 30 sec - exiting 05:56:33 (4116): No heartbeat from core client for 30 sec - exiting 05:56:34 (4116): No heartbeat from core client for 30 sec - exiting 05:56:35 (4116): No heartbeat from core client for 30 sec - exiting 05:56:36 (4116): No heartbeat from core client for 30 sec - exiting 05:56:37 (4116): No heartbeat from core client for 30 sec - exiting 05:56:38 (4116): No heartbeat from core client for 30 sec - exiting 05:56:39 (4116): No heartbeat from core client for 30 sec - exiting 05:56:40 (4116): No heartbeat from core client for 30 sec - exiting 05:56:41 (4116): No heartbeat from core client for 30 sec - exiting 05:56:42 (4116): No heartbeat from core client for 30 sec - exiting 05:56:43 (4116): No heartbeat from core client for 30 sec - exiting 05:56:44 (4116): No heartbeat from core client for 30 sec - exiting 05:56:45 (4116): No heartbeat from core client for 30 sec - exiting 05:56:46 (4116): No heartbeat from core client for 30 sec - exiting 05:56:47 (4116): No heartbeat from core client for 30 sec - exiting 05:56:48 (4116): No heartbeat from core client for 30 sec - exiting 05:56:49 (4116): No heartbeat from core client for 30 sec - exiting 05:56:50 (4116): No heartbeat from core client for 30 sec - exiting 05:56:51 (4116): No heartbeat from core client for 30 sec - exiting 05:56:52 (4116): No heartbeat from core client for 30 sec - exiting 05:57:25 (4116): No heartbeat from core client for 30 sec - exiting 05:57:26 (4116): No heartbeat from core client for 30 sec - exiting 06:13:00 (4756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:13:03 (4756): No heartbeat from core client for 30 sec - exiting 06:13:34 (4756): No heartbeat from core client for 30 sec - exiting 06:13:57 (4756): No heartbeat from core client for 30 sec - exiting 06:14:33 (4756): No heartbeat from core client for 30 sec - exiting 06:14:35 (4756): No heartbeat from core client for 30 sec - exiting 06:14:36 (4756): No heartbeat from core client for 30 sec - exiting 06:14:37 (4756): No heartbeat from core client for 30 sec - exiting 06:14:38 (4756): No heartbeat from core client for 30 sec - exiting 06:14:39 (4756): No heartbeat from core client for 30 sec - exiting 06:14:40 (4756): No heartbeat from core client for 30 sec - exiting 06:14:41 (4756): No heartbeat from core client for 30 sec - exiting 06:14:42 (4756): No heartbeat from core client for 30 sec - exiting 06:14:43 (4756): No heartbeat from core client for 30 sec - exiting 06:14:44 (4756): No heartbeat from core client for 30 sec - exiting 06:14:45 (4756): No heartbeat from core client for 30 sec - exiting 06:14:46 (4756): No heartbeat from core client for 30 sec - exiting 06:14:48 (4756): No heartbeat from core client for 30 sec - exiting 06:14:49 (4756): No heartbeat from core client for 30 sec - exiting 06:14:50 (4756): No heartbeat from core client for 30 sec - exiting 06:14:51 (4756): No heartbeat from core client for 30 sec - exiting 06:14:52 (4756): No heartbeat from core client for 30 sec - exiting 06:14:53 (4756): No heartbeat from core client for 30 sec - exiting 06:14:54 (4756): No heartbeat from core client for 30 sec - exiting 06:14:55 (4756): No heartbeat from core client for 30 sec - exiting 06:14:56 (4756): No heartbeat from core client for 30 sec - exiting 06:14:57 (4756): No heartbeat from core client for 30 sec - exiting 06:14:58 (4756): No heartbeat from core client for 30 sec - exiting 06:14:59 (4756): No heartbeat from core client for 30 sec - exiting 06:15:00 (4756): No heartbeat from core client for 30 sec - exiting Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6072, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6072, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6072, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6072, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1576, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1576, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
30 Mar 2012 13:21:28	1065226	14290691	hadcm3n_ycsl_1940_40_007833829_1	103,680	306,729	2.9584
28 Mar 2012 20:36:06	1065226	14290691	hadcm3n_ycsl_1940_40_007833829_1	77,760	230,229	2.9608
27 Mar 2012 06:01:42	1065226	14290691	hadcm3n_ycsl_1940_40_007833829_1	51,840	153,812	2.9671
25 Mar 2012 18:31:46	1065226	14290691	hadcm3n_ycsl_1940_40_007833829_1	25,920	76,842	2.9646