Task 15610162

Name	hadcm3n_4j73_1940_40_008303478_1
Workunit	8454613
Created	16 Feb 2013, 9:37:49 UTC
Sent	16 Feb 2013, 9:37:57 UTC
Report deadline	18 May 2013, 17:05:08 UTC
Received	14 Mar 2013, 19:11:47 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1244591
Run time	6 days 3 hours 55 min 31 sec
CPU time	5 days 16 hours 31 min 55 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.48 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> Het apparaat herkent de opdracht niet. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4948, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4948, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2636, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4752, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:52:26 (4716): No heartbeat from core client for 30 sec - exiting 17:52:27 (4716): No heartbeat from core client for 30 sec - exiting 17:52:28 (4716): No heartbeat from core client for 30 sec - exiting 17:52:29 (4716): No heartbeat from core client for 30 sec - exiting 17:52:30 (4716): No heartbeat from core client for 30 sec - exiting 17:52:31 (4716): No heartbeat from core client for 30 sec - exiting 17:52:32 (4716): No heartbeat from core client for 30 sec - exiting 17:52:33 (4716): No heartbeat from core client for 30 sec - exiting 17:52:35 (4716): No heartbeat from core client for 30 sec - exiting 17:52:36 (4716): No heartbeat from core client for 30 sec - exiting 17:52:37 (4716): No heartbeat from core client for 30 sec - exiting 17:52:38 (4716): No heartbeat from core client for 30 sec - exiting 17:52:39 (4716): No heartbeat from core client for 30 sec - exiting 17:52:40 (4716): No heartbeat from core client for 30 sec - exiting 17:52:41 (4716): No heartbeat from core client for 30 sec - exiting 17:52:42 (4716): No heartbeat from core client for 30 sec - exiting 17:52:43 (4716): No heartbeat from core client for 30 sec - exiting 17:52:44 (4716): No heartbeat from core client for 30 sec - exiting 17:52:45 (4716): No heartbeat from core client for 30 sec - exiting 17:52:47 (4716): No heartbeat from core client for 30 sec - exiting 17:52:48 (4716): No heartbeat from core client for 30 sec - exiting 17:52:49 (4716): No heartbeat from core client for 30 sec - exiting 17:52:50 (4716): No heartbeat from core client for 30 sec - exiting 17:52:51 (4716): No heartbeat from core client for 30 sec - exiting 17:52:52 (4716): No heartbeat from core client for 30 sec - exiting 17:52:53 (4716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:30:59 (4420): No heartbeat from core client for 30 sec - exiting 17:31:01 (4420): No heartbeat from core client for 30 sec - exiting 17:31:02 (4420): No heartbeat from core client for 30 sec - exiting 17:31:03 (4420): No heartbeat from core client for 30 sec - exiting 17:31:04 (4420): No heartbeat from core client for 30 sec - exiting 17:31:05 (4420): No heartbeat from core client for 30 sec - exiting 17:31:06 (4420): No heartbeat from core client for 30 sec - exiting 17:31:07 (4420): No heartbeat from core client for 30 sec - exiting 17:31:08 (4420): No heartbeat from core client for 30 sec - exiting 17:31:09 (4420): No heartbeat from core client for 30 sec - exiting 17:31:10 (4420): No heartbeat from core client for 30 sec - exiting 17:31:11 (4420): No heartbeat from core client for 30 sec - exiting 17:31:13 (4420): No heartbeat from core client for 30 sec - exiting 17:31:14 (4420): No heartbeat from core client for 30 sec - exiting 17:31:15 (4420): No heartbeat from core client for 30 sec - exiting 17:31:16 (4420): No heartbeat from core client for 30 sec - exiting 17:31:17 (4420): No heartbeat from core client for 30 sec - exiting 17:31:18 (4420): No heartbeat from core client for 30 sec - exiting 17:31:19 (4420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:17:30 (4496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:58:23 (6252): No heartbeat from core client for 30 sec - exiting 20:58:24 (6252): No heartbeat from core client for 30 sec - exiting 20:58:25 (6252): No heartbeat from core client for 30 sec - exiting 20:58:26 (6252): No heartbeat from core client for 30 sec - exiting 20:58:27 (6252): No heartbeat from core client for 30 sec - exiting 20:58:28 (6252): No heartbeat from core client for 30 sec - exiting 20:58:29 (6252): No heartbeat from core client for 30 sec - exiting 20:58:30 (6252): No heartbeat from core client for 30 sec - exiting 20:58:31 (6252): No heartbeat from core client for 30 sec - exiting 20:58:32 (6252): No heartbeat from core client for 30 sec - exiting 20:58:33 (6252): No heartbeat from core client for 30 sec - exiting 20:58:34 (6252): No heartbeat from core client for 30 sec - exiting 20:58:35 (6252): No heartbeat from core client for 30 sec - exiting 20:58:36 (6252): No heartbeat from core client for 30 sec - exiting 20:58:37 (6252): No heartbeat from core client for 30 sec - exiting 20:58:38 (6252): No heartbeat from core client for 30 sec - exiting 20:58:39 (6252): No heartbeat from core client for 30 sec - exiting 20:58:40 (6252): No heartbeat from core client for 30 sec - exiting 20:58:41 (6252): No heartbeat from core client for 30 sec - exiting 20:58:42 (6252): No heartbeat from core client for 30 sec - exiting 20:58:43 (6252): No heartbeat from core client for 30 sec - exiting 20:58:44 (6252): No heartbeat from core client for 30 sec - exiting 20:58:45 (6252): No heartbeat from core client for 30 sec - exiting 20:58:46 (6252): No heartbeat from core client for 30 sec - exiting 20:58:47 (6252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:58:48 (6252): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 03:01:26 (7048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:29:52 (7892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 21:34:10 (5456): No heartbeat from core client for 30 sec - exiting 21:34:11 (5456): No heartbeat from core client for 30 sec - exiting 21:34:12 (5456): No heartbeat from core client for 30 sec - exiting 21:34:13 (5456): No heartbeat from core client for 30 sec - exiting 21:34:14 (5456): No heartbeat from core client for 30 sec - exiting 21:34:15 (5456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:51:10 (5116): No heartbeat from core client for 30 sec - exiting 08:51:12 (5116): No heartbeat from core client for 30 sec - exiting 08:51:13 (5116): No heartbeat from core client for 30 sec - exiting 08:51:14 (5116): No heartbeat from core client for 30 sec - exiting 08:51:15 (5116): No heartbeat from core client for 30 sec - exiting 08:51:16 (5116): No heartbeat from core client for 30 sec - exiting 08:51:17 (5116): No heartbeat from core client for 30 sec - exiting 08:51:18 (5116): No heartbeat from core client for 30 sec - exiting 08:51:19 (5116): No heartbeat from core client for 30 sec - exiting 08:51:20 (5116): No heartbeat from core client for 30 sec - exiting 08:51:21 (5116): No heartbeat from core client for 30 sec - exiting 08:51:22 (5116): No heartbeat from core client for 30 sec - exiting 08:51:24 (5116): No heartbeat from core client for 30 sec - exiting 08:51:25 (5116): No heartbeat from core client for 30 sec - exiting 08:51:26 (5116): No heartbeat from core client for 30 sec - exiting 08:51:27 (5116): No heartbeat from core client for 30 sec - exiting 08:51:28 (5116): No heartbeat from core client for 30 sec - exiting 08:51:29 (5116): No heartbeat from core client for 30 sec - exiting 08:51:30 (5116): No heartbeat from core client for 30 sec - exiting 08:51:31 (5116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:41:11 (4484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:44:45 (6296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:45:47 (6568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:51:53 (872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:58:00 (1080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:17:54 (4896): No heartbeat from core client for 30 sec - exiting 16:17:56 (4896): No heartbeat from core client for 30 sec - exiting 16:17:57 (4896): No heartbeat from core client for 30 sec - exiting 16:17:58 (4896): No heartbeat from core client for 30 sec - exiting 16:17:59 (4896): No heartbeat from core client for 30 sec - exiting 16:18:00 (4896): No heartbeat from core client for 30 sec - exiting 16:18:01 (4896): No heartbeat from core client for 30 sec - exiting 16:18:02 (4896): No heartbeat from core client for 30 sec - exiting 16:18:03 (4896): No heartbeat from core client for 30 sec - exiting 16:18:04 (4896): No heartbeat from core client for 30 sec - exiting 16:18:05 (4896): No heartbeat from core client for 30 sec - exiting 16:18:07 (4896): No heartbeat from core client for 30 sec - exiting 16:18:08 (4896): No heartbeat from core client for 30 sec - exiting 16:18:09 (4896): No heartbeat from core client for 30 sec - exiting 16:18:10 (4896): No heartbeat from core client for 30 sec - exiting 16:18:11 (4896): No heartbeat from core client for 30 sec - exiting 16:18:12 (4896): No heartbeat from core client for 30 sec - exiting 16:18:13 (4896): No heartbeat from core client for 30 sec - exiting 16:18:14 (4896): No heartbeat from core client for 30 sec - exiting 16:18:15 (4896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5588, iMonCtr=1 Model crash detected, will try to restart... 16:27:38 (2824): No heartbeat from core client for 30 sec - exiting 16:27:39 (2824): No heartbeat from core client for 30 sec - exiting 16:27:40 (2824): No heartbeat from core client for 30 sec - exiting 16:27:41 (2824): No heartbeat from core client for 30 sec - exiting 16:27:42 (2824): No heartbeat from core client for 30 sec - exiting 16:27:43 (2824): No heartbeat from core client for 30 sec - exiting 16:27:45 (2824): No heartbeat from core client for 30 sec - exiting 16:27:46 (2824): No heartbeat from core client for 30 sec - exiting 16:27:47 (2824): No heartbeat from core client for 30 sec - exiting 16:27:48 (2824): No heartbeat from core client for 30 sec - exiting 16:27:49 (2824): No heartbeat from core client for 30 sec - exiting 16:27:50 (2824): No heartbeat from core client for 30 sec - exiting 16:27:51 (2824): No heartbeat from core client for 30 sec - exiting 16:27:52 (2824): No heartbeat from core client for 30 sec - exiting 16:27:53 (2824): No heartbeat from core client for 30 sec - exiting 16:27:54 (2824): No heartbeat from core client for 30 sec - exiting 16:27:55 (2824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:27:57 (2824): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:47:42 (6016): No heartbeat from core client for 30 sec - exiting 18:47:43 (6016): No heartbeat from core client for 30 sec - exiting 18:47:44 (6016): No heartbeat from core client for 30 sec - exiting 18:47:45 (6016): No heartbeat from core client for 30 sec - exiting 18:47:46 (6016): No heartbeat from core client for 30 sec - exiting 18:47:47 (6016): No heartbeat from core client for 30 sec - exiting 18:47:48 (6016): No heartbeat from core client for 30 sec - exiting 18:47:49 (6016): No heartbeat from core client for 30 sec - exiting 18:47:50 (6016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
08 Mar 2013 19:09:48	1244591	15610162	hadcm3n_4j73_1940_40_008303478_1	259,200	471,332	1.8184
03 Mar 2013 22:20:12	1244591	15610162	hadcm3n_4j73_1940_40_008303478_1	233,280	426,131	1.8267
02 Mar 2013 15:25:42	1244591	15610162	hadcm3n_4j73_1940_40_008303478_1	207,360	382,106	1.8427
01 Mar 2013 22:38:47	1244591	15610162	hadcm3n_4j73_1940_40_008303478_1	181,440	335,349	1.8483
24 Feb 2013 03:13:12	1244591	15610162	hadcm3n_4j73_1940_40_008303478_1	155,520	287,794	1.8505
23 Feb 2013 09:52:21	1244591	15610162	hadcm3n_4j73_1940_40_008303478_1	129,600	240,080	1.8525
22 Feb 2013 19:23:01	1244591	15610162	hadcm3n_4j73_1940_40_008303478_1	103,680	192,289	1.8546
20 Feb 2013 18:01:37	1244591	15610162	hadcm3n_4j73_1940_40_008303478_1	77,760	143,174	1.8412
17 Feb 2013 13:55:18	1244591	15610162	hadcm3n_4j73_1940_40_008303478_1	51,840	95,755	1.8471
17 Feb 2013 00:05:14	1244591	15610162	hadcm3n_4j73_1940_40_008303478_1	25,920	48,290	1.8630