Task 15896291

Name	hadcm3n_3kt8_1980_40_008398051_2
Workunit	8548907
Created	18 Jul 2013, 16:43:33 UTC
Sent	18 Jul 2013, 16:50:57 UTC
Report deadline	18 Oct 2013, 0:18:08 UTC
Received	20 Oct 2013, 20:55:36 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1263465
Run time	16 days 7 hours 1 min 12 sec
CPU time	13 days 11 hours 19 min 2 sec
Validate state	Invalid
Credit	5,287.68
Device peak FLOPS	1.72 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... 17:46:00 (4296): No heartbeat from core client for 30 sec - exiting 17:46:01 (4296): No heartbeat from core client for 30 sec - exiting 17:46:02 (4296): No heartbeat from core client for 30 sec - exiting 17:46:03 (4296): No heartbeat from core client for 30 sec - exiting 17:46:04 (4296): No heartbeat from core client for 30 sec - exiting 17:46:05 (4296): No heartbeat from core client for 30 sec - exiting 17:46:06 (4296): No heartbeat from core client for 30 sec - exiting 17:46:07 (4296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:46:18 (5076): No heartbeat from core client for 30 sec - exiting 20:46:20 (5076): No heartbeat from core client for 30 sec - exiting 20:46:21 (5076): No heartbeat from core client for 30 sec - exiting 20:46:22 (5076): No heartbeat from core client for 30 sec - exiting 20:46:23 (5076): No heartbeat from core client for 30 sec - exiting 20:46:24 (5076): No heartbeat from core client for 30 sec - exiting 20:46:25 (5076): No heartbeat from core client for 30 sec - exiting 20:46:26 (5076): No heartbeat from core client for 30 sec - exiting 20:46:27 (5076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:46:28 (5076): No heartbeat from core client for 30 sec - exiting 20:46:29 (5076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4348, iMonCtr=1 Model crash detected, will try to restart... 10:48:57 (5100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:02:00 (4968): No heartbeat from core client for 30 sec - exiting 20:02:01 (4968): No heartbeat from core client for 30 sec - exiting 20:02:02 (4968): No heartbeat from core client for 30 sec - exiting 20:02:03 (4968): No heartbeat from core client for 30 sec - exiting 20:02:04 (4968): No heartbeat from core client for 30 sec - exiting 20:02:05 (4968): No heartbeat from core client for 30 sec - exiting 20:02:07 (4968): No heartbeat from core client for 30 sec - exiting 20:02:08 (4968): No heartbeat from core client for 30 sec - exiting 20:02:09 (4968): No heartbeat from core client for 30 sec - exiting 20:02:10 (4968): No heartbeat from core client for 30 sec - exiting 20:02:11 (4968): No heartbeat from core client for 30 sec - exiting 20:02:12 (4968): No heartbeat from core client for 30 sec - exiting 20:02:13 (4968): No heartbeat from core client for 30 sec - exiting 20:02:14 (4968): No heartbeat from core client for 30 sec - exiting 20:02:15 (4968): No heartbeat from core client for 30 sec - exiting 20:02:16 (4968): No heartbeat from core client for 30 sec - exiting 20:02:17 (4968): No heartbeat from core client for 30 sec - exiting 20:02:19 (4968): No heartbeat from core client for 30 sec - exiting 20:02:20 (4968): No heartbeat from core client for 30 sec - exiting 20:02:21 (4968): No heartbeat from core client for 30 sec - exiting 20:02:22 (4968): No heartbeat from core client for 30 sec - exiting 20:02:23 (4968): No heartbeat from core client for 30 sec - exiting 20:02:24 (4968): No heartbeat from core client for 30 sec - exiting 20:02:25 (4968): No heartbeat from core client for 30 sec - exiting 20:02:26 (4968): No heartbeat from core client for 30 sec - exiting 20:02:27 (4968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1636, iMonCtr=1 Model crash detected, will try to restart... 21:32:25 (4656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:16:34 (4992): No heartbeat from core client for 30 sec - exiting 10:16:35 (4992): No heartbeat from core client for 30 sec - exiting 10:16:36 (4992): No heartbeat from core client for 30 sec - exiting 10:16:37 (4992): No heartbeat from core client for 30 sec - exiting 10:16:38 (4992): No heartbeat from core client for 30 sec - exiting 10:16:39 (4992): No heartbeat from core client for 30 sec - exiting 10:16:40 (4992): No heartbeat from core client for 30 sec - exiting 10:16:41 (4992): No heartbeat from core client for 30 sec - exiting 10:16:42 (4992): No heartbeat from core client for 30 sec - exiting 10:16:44 (4992): No heartbeat from core client for 30 sec - exiting 10:16:45 (4992): No heartbeat from core client for 30 sec - exiting 10:16:46 (4992): No heartbeat from core client for 30 sec - exiting 10:16:47 (4992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:16:48 (4992): No heartbeat from core client for 30 sec - exiting 10:16:49 (4992): No heartbeat from core client for 30 sec - exiting 10:16:50 (4992): No heartbeat from core client for 30 sec - exiting 10:16:51 (4992): No heartbeat from core client for 30 sec - exiting 10:16:52 (4992): No heartbeat from core client for 30 sec - exiting 10:16:53 (4992): No heartbeat from core client for 30 sec - exiting 10:16:55 (4992): No heartbeat from core client for 30 sec - exiting 10:16:56 (4992): No heartbeat from core client for 30 sec - exiting 10:16:57 (4992): No heartbeat from core client for 30 sec - exiting 10:16:58 (4992): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4284, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=480, iMonCtr=1 Model crash detected, will try to restart... 20:59:57 (1196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3364, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2316, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:31:00 (2900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4140, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5340, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:54:13 (4564): No heartbeat from core client for 30 sec - exiting 15:54:14 (4564): No heartbeat from core client for 30 sec - exiting 15:54:15 (4564): No heartbeat from core client for 30 sec - exiting 15:54:16 (4564): No heartbeat from core client for 30 sec - exiting 15:54:17 (4564): No heartbeat from core client for 30 sec - exiting 15:54:18 (4564): No heartbeat from core client for 30 sec - exiting 15:54:19 (4564): No heartbeat from core client for 30 sec - exiting 15:54:20 (4564): No heartbeat from core client for 30 sec - exiting 15:54:22 (4564): No heartbeat from core client for 30 sec - exiting 15:54:23 (4564): No heartbeat from core client for 30 sec - exiting 15:54:24 (4564): No heartbeat from core client for 30 sec - exiting 15:54:25 (4564): No heartbeat from core client for 30 sec - exiting 15:54:26 (4564): No heartbeat from core client for 30 sec - exiting 15:54:27 (4564): No heartbeat from core client for 30 sec - exiting 15:54:28 (4564): No heartbeat from core client for 30 sec - exiting 15:54:29 (4564): No heartbeat from core client for 30 sec - exiting 15:54:31 (4564): No heartbeat from core client for 30 sec - exiting 15:54:32 (4564): No heartbeat from core client for 30 sec - exiting 15:54:33 (4564): No heartbeat from core client for 30 sec - exiting 15:54:34 (4564): No heartbeat from core client for 30 sec - exiting 15:54:35 (4564): No heartbeat from core client for 30 sec - exiting 15:54:36 (4564): No heartbeat from core client for 30 sec - exiting 15:54:37 (4564): No heartbeat from core client for 30 sec - exiting 15:54:38 (4564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:56:37 (4548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:46:47 (4828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1688, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4060, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1196, iMonCtr=1 Model crash detected, will try to restart... 12:04:21 (3464): No heartbeat from core client for 30 sec - exiting 12:04:23 (3464): No heartbeat from core client for 30 sec - exiting 12:04:24 (3464): No heartbeat from core client for 30 sec - exiting 12:04:25 (3464): No heartbeat from core client for 30 sec - exiting 12:04:26 (3464): No heartbeat from core client for 30 sec - exiting 12:04:27 (3464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=544, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=544, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 20:24:05 (4356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:52:17 (1616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4828, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 10:49:10 (4120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:03:32 (4820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3848, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=652, iMonCtr=1 Model crash detected, will try to restart... 19:15:17 (2176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:33:31 (4288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:27:44 (4932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:23:38 (872): No heartbeat from core client for 30 sec - exiting 18:23:39 (872): No heartbeat from core client for 30 sec - exiting 18:23:40 (872): No heartbeat from core client for 30 sec - exiting 18:23:41 (872): No heartbeat from core client for 30 sec - exiting 18:23:42 (872): No heartbeat from core client for 30 sec - exiting 18:23:43 (872): No heartbeat from core client for 30 sec - exiting 18:23:44 (872): No heartbeat from core client for 30 sec - exiting 18:23:46 (872): No heartbeat from core client for 30 sec - exiting 18:23:47 (872): No heartbeat from core client for 30 sec - exiting 18:23:48 (872): No heartbeat from core client for 30 sec - exiting 18:23:49 (872): No heartbeat from core client for 30 sec - exiting 18:23:50 (872): No heartbeat from core client for 30 sec - exiting 18:23:51 (872): No heartbeat from core client for 30 sec - exiting 18:23:52 (872): No heartbeat from core client for 30 sec - exiting 18:23:53 (872): No heartbeat from core client for 30 sec - exiting 18:23:54 (872): No heartbeat from core client for 30 sec - exiting 18:23:56 (872): No heartbeat from core client for 30 sec - exiting 18:23:57 (872): No heartbeat from core client for 30 sec - exiting 18:23:58 (872): No heartbeat from core client for 30 sec - exiting 18:23:59 (872): No heartbeat from core client for 30 sec - exiting 18:24:00 (872): No heartbeat from core client for 30 sec - exiting 18:24:01 (872): No heartbeat from core client for 30 sec - exiting 18:24:02 (872): No heartbeat from core client for 30 sec - exiting 18:24:03 (872): No heartbeat from core client for 30 sec - exiting 18:24:04 (872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:12:40 (5044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4544, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:17:34 (3100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:19:51 (4036): No heartbeat from core client for 30 sec - exiting 08:19:52 (4036): No heartbeat from core client for 30 sec - exiting 08:19:53 (4036): No heartbeat from core client for 30 sec - exiting 08:19:54 (4036): No heartbeat from core client for 30 sec - exiting 08:19:55 (4036): No heartbeat from core client for 30 sec - exiting 08:19:56 (4036): No heartbeat from core client for 30 sec - exiting 08:19:57 (4036): No heartbeat from core client for 30 sec - exiting 08:19:58 (4036): No heartbeat from core client for 30 sec - exiting 08:19:59 (4036): No heartbeat from core client for 30 sec - exiting 08:20:00 (4036): No heartbeat from core client for 30 sec - exiting 08:20:01 (4036): No heartbeat from core client for 30 sec - exiting 08:20:02 (4036): No heartbeat from core client for 30 sec - exiting 08:20:03 (4036): No heartbeat from core client for 30 sec - exiting 08:20:04 (4036): No heartbeat from core client for 30 sec - exiting 08:20:05 (4036): No heartbeat from core client for 30 sec - exiting 08:20:06 (4036): No heartbeat from core client for 30 sec - exiting 08:20:07 (4036): No heartbeat from core client for 30 sec - exiting 08:20:08 (4036): No heartbeat from core client for 30 sec - exiting 08:20:09 (4036): No heartbeat from core client for 30 sec - exiting 08:20:10 (4036): No heartbeat from core client for 30 sec - exiting 08:20:11 (4036): No heartbeat from core client for 30 sec - exiting 08:20:12 (4036): No heartbeat from core client for 30 sec - exiting 08:20:13 (4036): No heartbeat from core client for 30 sec - exiting 08:20:14 (4036): No heartbeat from core client for 30 sec - exiting 08:20:15 (4036): No heartbeat from core client for 30 sec - exiting 08:20:16 (4036): No heartbeat from core client for 30 sec - exiting 08:20:17 (4036): No heartbeat from core client for 30 sec - exiting 08:20:18 (4036): No heartbeat from core client for 30 sec - exiting 08:20:19 (4036): No heartbeat from core client for 30 sec - exiting 08:20:20 (4036): No heartbeat from core client for 30 sec - exiting 08:20:21 (4036): No heartbeat from core client for 30 sec - exiting 08:20:22 (4036): No heartbeat from core client for 30 sec - exiting 08:20:23 (4036): No heartbeat from core client for 30 sec - exiting 08:20:24 (4036): No heartbeat from core client for 30 sec - exiting 08:20:25 (4036): No heartbeat from core client for 30 sec - exiting 08:20:26 (4036): No heartbeat from core client for 30 sec - exiting 08:20:27 (4036): No heartbeat from core client for 30 sec - exiting 08:20:28 (4036): No heartbeat from core client for 30 sec - exiting 08:20:29 (4036): No heartbeat from core client for 30 sec - exiting 08:20:30 (4036): No heartbeat from core client for 30 sec - exiting 08:20:31 (4036): No heartbeat from core client for 30 sec - exiting 08:20:32 (4036): No heartbeat from core client for 30 sec - exiting 08:20:33 (4036): No heartbeat from core client for 30 sec - exiting 08:20:34 (4036): No heartbeat from core client for 30 sec - exiting 08:20:35 (4036): No heartbeat from core client for 30 sec - exiting 08:20:36 (4036): No heartbeat from core client for 30 sec - exiting 08:20:37 (4036): No heartbeat from core client for 30 sec - exiting 08:20:38 (4036): No heartbeat from core client for 30 sec - exiting 08:20:39 (4036): No heartbeat from core client for 30 sec - exiting 08:20:40 (4036): No heartbeat from core client for 30 sec - exiting 08:20:41 (4036): No heartbeat from core client for 30 sec - exiting 08:20:42 (4036): No heartbeat from core client for 30 sec - exiting 08:20:43 (4036): No heartbeat from core client for 30 sec - exiting 08:20:44 (4036): No heartbeat from core client for 30 sec - exiting 08:20:45 (4036): No heartbeat from core client for 30 sec - exiting 08:20:46 (4036): No heartbeat from core client for 30 sec - exiting 08:20:47 (4036): No heartbeat from core client for 30 sec - exiting 08:20:48 (4036): No heartbeat from core client for 30 sec - exiting 08:20:49 (4036): No heartbeat from core client for 30 sec - exiting 08:20:50 (4036): No heartbeat from core client for 30 sec - exiting 08:20:51 (4036): No heartbeat from core client for 30 sec - exiting 08:20:52 (4036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:21:24 (4036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4332, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6128, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5996, iMonCtr=1 Model crash detected, will try to restart... 19:15:38 (2892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:40:37 (3972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 10:48:30 (3340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:45:48 (5012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1332, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2564, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2564, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2564, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3672, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3672, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3672, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
17 Oct 2013 18:13:59	1263465	15896291	hadcm3n_3kt8_1980_40_008398051_2	440,640	1,111,365	2.5222
12 Oct 2013 14:44:17	1263465	15896291	hadcm3n_3kt8_1980_40_008398051_2	414,720	1,044,948	2.5196
07 Oct 2013 18:14:16	1263465	15896291	hadcm3n_3kt8_1980_40_008398051_2	388,800	979,175	2.5185
30 Sep 2013 19:59:41	1263465	15896291	hadcm3n_3kt8_1980_40_008398051_2	362,880	913,671	2.5178
25 Sep 2013 19:52:06	1263465	15896291	hadcm3n_3kt8_1980_40_008398051_2	336,960	846,863	2.5132
15 Sep 2013 23:13:07	1263465	15896291	hadcm3n_3kt8_1980_40_008398051_2	311,040	780,939	2.5107
13 Sep 2013 20:43:43	1263465	15896291	hadcm3n_3kt8_1980_40_008398051_2	285,120	725,442	2.5443
08 Sep 2013 15:13:58	1263465	15896291	hadcm3n_3kt8_1980_40_008398051_2	259,200	657,704	2.5374
06 Sep 2013 10:52:45	1263465	15896291	hadcm3n_3kt8_1980_40_008398051_2	233,280	591,596	2.5360
02 Sep 2013 20:45:23	1263465	15896291	hadcm3n_3kt8_1980_40_008398051_2	207,360	526,343	2.5383
27 Aug 2013 19:44:07	1263465	15896291	hadcm3n_3kt8_1980_40_008398051_2	181,440	459,936	2.5349
23 Aug 2013 10:38:18	1263465	15896291	hadcm3n_3kt8_1980_40_008398051_2	155,520	393,680	2.5314
20 Aug 2013 21:06:50	1263465	15896291	hadcm3n_3kt8_1980_40_008398051_2	129,600	327,709	2.5286
16 Aug 2013 22:02:33	1263465	15896291	hadcm3n_3kt8_1980_40_008398051_2	103,680	264,362	2.5498
16 Aug 2013 16:46:18	1263465	15896291	hadcm3n_3kt8_1980_40_008398051_2	77,760	199,429	2.5647
16 Aug 2013 16:46:18	1263465	15896291	hadcm3n_3kt8_1980_40_008398051_2	51,840	132,732	2.5604
26 Jul 2013 09:46:26	1263465	15896291	hadcm3n_3kt8_1980_40_008398051_2	25,920	67,685	2.6113