Task 12671312

Name	hadam3p_saf_2d53_1974_1_007146714_1
Workunit	7331494
Created	16 Mar 2011, 21:30:06 UTC
Sent	16 Mar 2011, 22:09:11 UTC
Report deadline	27 Feb 2012, 3:29:11 UTC
Received	5 Apr 2011, 21:00:32 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1099591
Run time	1 days 7 hours 23 min 37 sec
CPU time	1 days 4 hours 25 min 22 sec
Validate state	Invalid
Credit	562.19
Device peak FLOPS	2.37 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Southern Africa v6.08 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5300, selfPID=5316, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5300, selfPID=5300, iMonCtr=1 Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5772, iMonCtr=2 Model crash detected, will try to restart... 07:43:20 (5556): No heartbeat from core client for 30 sec - exiting 07:43:21 (5556): No heartbeat from core client for 30 sec - exiting 07:43:22 (5556): No heartbeat from core client for 30 sec - exiting 07:43:23 (5556): No heartbeat from core client for 30 sec - exiting 07:43:24 (5556): No heartbeat from core client for 30 sec - exiting 07:43:25 (5556): No heartbeat from core client for 30 sec - exiting 07:43:26 (5556): No heartbeat from core client for 30 sec - exiting 07:43:27 (5556): No heartbeat from core client for 30 sec - exiting 07:43:28 (5556): No heartbeat from core client for 30 sec - exiting 07:43:29 (5556): No heartbeat from core client for 30 sec - exiting 07:43:30 (5556): No heartbeat from core client for 30 sec - exiting 07:43:31 (5556): No heartbeat from core client for 30 sec - exiting 07:43:32 (5556): No heartbeat from core client for 30 sec - exiting 07:43:33 (5556): No heartbeat from core client for 30 sec - exiting 07:43:34 (5556): No heartbeat from core client for 30 sec - exiting 07:43:35 (5556): No heartbeat from core client for 30 sec - exiting 07:43:36 (5556): No heartbeat from core client for 30 sec - exiting 07:43:37 (5556): No heartbeat from core client for 30 sec - exiting 07:43:38 (5556): No heartbeat from core client for 30 sec - exiting 07:43:39 (5556): No heartbeat from core client for 30 sec - exiting 07:43:40 (5556): No heartbeat from core client for 30 sec - exiting 07:43:41 (5556): No heartbeat from core client for 30 sec - exiting 07:43:42 (5556): No heartbeat from core client for 30 sec - exiting 07:43:43 (5556): No heartbeat from core client for 30 sec - exiting 07:43:44 (5556): No heartbeat from core client for 30 sec - exiting 07:43:45 (5556): No heartbeat from core client for 30 sec - exiting 07:43:46 (5556): No heartbeat from core client for 30 sec - exiting 07:43:47 (5556): No heartbeat from core client for 30 sec - exiting 07:43:48 (5556): No heartbeat from core client for 30 sec - exiting 07:43:50 (5556): No heartbeat from core client for 30 sec - exiting 07:43:51 (5556): No heartbeat from core client for 30 sec - exiting 07:43:52 (5556): No heartbeat from core client for 30 sec - exiting 07:43:53 (5556): No heartbeat from core client for 30 sec - exiting 07:43:54 (5556): No heartbeat from core client for 30 sec - exiting 07:43:55 (5556): No heartbeat from core client for 30 sec - exiting 07:43:56 (5556): No heartbeat from core client for 30 sec - exiting 07:43:57 (5556): No heartbeat from core client for 30 sec - exiting 07:43:58 (5556): No heartbeat from core client for 30 sec - exiting 07:43:59 (5556): No heartbeat from core client for 30 sec - exiting 07:44:00 (5556): No heartbeat from core client for 30 sec - exiting 07:44:01 (5556): No heartbeat from core client for 30 sec - exiting 07:44:02 (5556): No heartbeat from core client for 30 sec - exiting 07:44:03 (5556): No heartbeat from core client for 30 sec - exiting 07:44:04 (5556): No heartbeat from core client for 30 sec - exiting 07:44:05 (5556): No heartbeat from core client for 30 sec - exiting 07:44:06 (5556): No heartbeat from core client for 30 sec - exiting 07:44:07 (5556): No heartbeat from core client for 30 sec - exiting 07:44:08 (5556): No heartbeat from core client for 30 sec - exiting 07:44:09 (5556): No heartbeat from core client for 30 sec - exiting 07:44:10 (5556): No heartbeat from core client for 30 sec - exiting 07:44:11 (5556): No heartbeat from core client for 30 sec - exiting 07:44:12 (5556): No heartbeat from core client for 30 sec - exiting 07:44:13 (5556): No heartbeat from core client for 30 sec - exiting 07:44:14 (5556): No heartbeat from core client for 30 sec - exiting 07:44:15 (5556): No heartbeat from core client for 30 sec - exiting 07:44:16 (5556): No heartbeat from core client for 30 sec - exiting 07:44:17 (5556): No heartbeat from core client for 30 sec - exiting 07:44:18 (5556): No heartbeat from core client for 30 sec - exiting 07:44:19 (5556): No heartbeat from core client for 30 sec - exiting 07:44:20 (5556): No heartbeat from core client for 30 sec - exiting 07:44:21 (5556): No heartbeat from core client for 30 sec - exiting 07:44:22 (5556): No heartbeat from core client for 30 sec - exiting 07:44:23 (5556): No heartbeat from core client for 30 sec - exiting 07:44:24 (5556): No heartbeat from core client for 30 sec - exiting 07:44:25 (5556): No heartbeat from core client for 30 sec - exiting 07:44:26 (5556): No heartbeat from core client for 30 sec - exiting 07:44:27 (5556): No heartbeat from core client for 30 sec - exiting 07:44:28 (5556): No heartbeat from core client for 30 sec - exiting 07:44:29 (5556): No heartbeat from core client for 30 sec - exiting 07:44:30 (5556): No heartbeat from core client for 30 sec - exiting 07:44:31 (5556): No heartbeat from core client for 30 sec - exiting 07:44:32 (5556): No heartbeat from core client for 30 sec - exiting 07:44:33 (5556): No heartbeat from core client for 30 sec - exiting 07:44:34 (5556): No heartbeat from core client for 30 sec - exiting 07:44:35 (5556): No heartbeat from core client for 30 sec - exiting 07:44:36 (5556): No heartbeat from core client for 30 sec - exiting 07:44:37 (5556): No heartbeat from core client for 30 sec - exiting 07:44:38 (5556): No heartbeat from core client for 30 sec - exiting 07:44:39 (5556): No heartbeat from core client for 30 sec - exiting 07:44:40 (5556): No heartbeat from core client for 30 sec - exiting 07:44:41 (5556): No heartbeat from core client for 30 sec - exiting 07:44:42 (5556): No heartbeat from core client for 30 sec - exiting 07:44:43 (5556): No heartbeat from core client for 30 sec - exiting 07:44:44 (5556): No heartbeat from core client for 30 sec - exiting 07:44:45 (5556): No heartbeat from core client for 30 sec - exiting 07:44:46 (5556): No heartbeat from core client for 30 sec - exiting 07:44:47 (5556): No heartbeat from core client for 30 sec - exiting 07:44:48 (5556): No heartbeat from core client for 30 sec - exiting 07:44:49 (5556): No heartbeat from core client for 30 sec - exiting 07:44:50 (5556): No heartbeat from core client for 30 sec - exiting 07:44:51 (5556): No heartbeat from core client for 30 sec - exiting 07:44:52 (5556): No heartbeat from core client for 30 sec - exiting 07:44:53 (5556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5428, selfPID=5024, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5428, selfPID=5428, iMonCtr=1 17:14:45 (4696): No heartbeat from core client for 30 sec - exiting 17:14:46 (4696): No heartbeat from core client for 30 sec - exiting 17:14:47 (4696): No heartbeat from core client for 30 sec - exiting 17:14:48 (4696): No heartbeat from core client for 30 sec - exiting 17:14:49 (4696): No heartbeat from core client for 30 sec - exiting 17:14:50 (4696): No heartbeat from core client for 30 sec - exiting 17:14:51 (4696): No heartbeat from core client for 30 sec - exiting 17:14:52 (4696): No heartbeat from core client for 30 sec - exiting 17:14:53 (4696): No heartbeat from core client for 30 sec - exiting 17:14:54 (4696): No heartbeat from core client for 30 sec - exiting 17:14:55 (4696): No heartbeat from core client for 30 sec - exiting 17:14:56 (4696): No heartbeat from core client for 30 sec - exiting 17:14:57 (4696): No heartbeat from core client for 30 sec - exiting 17:14:58 (4696): No heartbeat from core client for 30 sec - exiting 17:14:59 (4696): No heartbeat from core client for 30 sec - exiting 17:15:00 (4696): No heartbeat from core client for 30 sec - exiting 17:15:01 (4696): No heartbeat from core client for 30 sec - exiting 17:15:02 (4696): No heartbeat from core client for 30 sec - exiting 17:15:03 (4696): No heartbeat from core client for 30 sec - exiting 17:15:04 (4696): No heartbeat from core client for 30 sec - exiting 17:15:05 (4696): No heartbeat from core client for 30 sec - exiting 17:15:06 (4696): No heartbeat from core client for 30 sec - exiting 17:15:07 (4696): No heartbeat from core client for 30 sec - exiting 17:15:08 (4696): No heartbeat from core client for 30 sec - exiting 17:15:09 (4696): No heartbeat from core client for 30 sec - exiting 17:15:10 (4696): No heartbeat from core client for 30 sec - exiting 17:15:11 (4696): No heartbeat from core client for 30 sec - exiting 17:15:12 (4696): No heartbeat from core client for 30 sec - exiting 17:15:13 (4696): No heartbeat from core client for 30 sec - exiting 17:15:14 (4696): No heartbeat from core client for 30 sec - exiting 17:15:15 (4696): No heartbeat from core client for 30 sec - exiting 17:15:16 (4696): No heartbeat from core client for 30 sec - exiting 17:15:17 (4696): No heartbeat from core client for 30 sec - exiting 17:15:18 (4696): No heartbeat from core client for 30 sec - exiting 17:15:19 (4696): No heartbeat from core client for 30 sec - exiting 17:15:20 (4696): No heartbeat from core client for 30 sec - exiting 17:15:21 (4696): No heartbeat from core client for 30 sec - exiting 17:15:22 (4696): No heartbeat from core client for 30 sec - exiting 17:15:23 (4696): No heartbeat from core client for 30 sec - exiting 17:15:24 (4696): No heartbeat from core client for 30 sec - exiting 17:15:25 (4696): No heartbeat from core client for 30 sec - exiting 17:15:26 (4696): No heartbeat from core client for 30 sec - exiting 17:15:27 (4696): No heartbeat from core client for 30 sec - exiting 17:15:28 (4696): No heartbeat from core client for 30 sec - exiting 17:15:29 (4696): No heartbeat from core client for 30 sec - exiting 17:15:30 (4696): No heartbeat from core client for 30 sec - exiting 17:15:31 (4696): No heartbeat from core client for 30 sec - exiting 17:15:32 (4696): No heartbeat from core client for 30 sec - exiting 17:15:33 (4696): No heartbeat from core client for 30 sec - exiting 17:15:34 (4696): No heartbeat from core client for 30 sec - exiting 17:15:35 (4696): No heartbeat from core client for 30 sec - exiting 17:15:36 (4696): No heartbeat from core client for 30 sec - exiting 17:15:37 (4696): No heartbeat from core client for 30 sec - exiting 17:15:38 (4696): No heartbeat from core client for 30 sec - exiting 17:15:39 (4696): No heartbeat from core client for 30 sec - exiting 17:15:40 (4696): No heartbeat from core client for 30 sec - exiting 17:15:41 (4696): No heartbeat from core client for 30 sec - exiting 17:15:42 (4696): No heartbeat from core client for 30 sec - exiting 17:15:43 (4696): No heartbeat from core client for 30 sec - exiting 17:15:44 (4696): No heartbeat from core client for 30 sec - exiting 17:15:45 (4696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6376, selfPID=6600, iMonCtr=1 Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 CPDN Monitor - Quit request from BOINC... No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6464, selfPID=6464, iMonCtr=1 No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6464, selfPID=6864, iMonCtr=1 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6524, selfPID=6324, iMonCtr=1 Model crash detected, will try to restart... 15:59:38 (6016): No heartbeat from core client for 30 sec - exiting 15:59:39 (6016): No heartbeat from core client for 30 sec - exiting 15:59:40 (6016): No heartbeat from core client for 30 sec - exiting 15:59:41 (6016): No heartbeat from core client for 30 sec - exiting 15:59:42 (6016): No heartbeat from core client for 30 sec - exiting 15:59:43 (6016): No heartbeat from core client for 30 sec - exiting 15:59:44 (6016): No heartbeat from core client for 30 sec - exiting 15:59:45 (6016): No heartbeat from core client for 30 sec - exiting 15:59:46 (6016): No heartbeat from core client for 30 sec - exiting 15:59:47 (6016): No heartbeat from core client for 30 sec - exiting 15:59:48 (6016): No heartbeat from core client for 30 sec - exiting 15:59:49 (6016): No heartbeat from core client for 30 sec - exiting 15:59:50 (6016): No heartbeat from core client for 30 sec - exiting 15:59:51 (6016): No heartbeat from core client for 30 sec - exiting 15:59:52 (6016): No heartbeat from core client for 30 sec - exiting 15:59:53 (6016): No heartbeat from core client for 30 sec - exiting 15:59:54 (6016): No heartbeat from core client for 30 sec - exiting 15:59:55 (6016): No heartbeat from core client for 30 sec - exiting 15:59:56 (6016): No heartbeat from core client for 30 sec - exiting 15:59:57 (6016): No heartbeat from core client for 30 sec - exiting 15:59:58 (6016): No heartbeat from core client for 30 sec - exiting 15:59:59 (6016): No heartbeat from core client for 30 sec - exiting 16:00:00 (6016): No heartbeat from core client for 30 sec - exiting 16:00:01 (6016): No heartbeat from core client for 30 sec - exiting 16:00:02 (6016): No heartbeat from core client for 30 sec - exiting 16:00:03 (6016): No heartbeat from core client for 30 sec - exiting 16:00:04 (6016): No heartbeat from core client for 30 sec - exiting 16:00:05 (6016): No heartbeat from core client for 30 sec - exiting 16:00:06 (6016): No heartbeat from core client for 30 sec - exiting 16:00:07 (6016): No heartbeat from core client for 30 sec - exiting 16:00:08 (6016): No heartbeat from core client for 30 sec - exiting 16:00:09 (6016): No heartbeat from core client for 30 sec - exiting 16:00:10 (6016): No heartbeat from core client for 30 sec - exiting 16:00:11 (6016): No heartbeat from core client for 30 sec - exiting 16:00:12 (6016): No heartbeat from core client for 30 sec - exiting 16:00:13 (6016): No heartbeat from core client for 30 sec - exiting 16:00:14 (6016): No heartbeat from core client for 30 sec - exiting 16:00:15 (6016): No heartbeat from core client for 30 sec - exiting 16:00:16 (6016): No heartbeat from core client for 30 sec - exiting 16:00:17 (6016): No heartbeat from core client for 30 sec - exiting 16:00:18 (6016): No heartbeat from core client for 30 sec - exiting 16:00:19 (6016): No heartbeat from core client for 30 sec - exiting 16:00:20 (6016): No heartbeat from core client for 30 sec - exiting 16:00:21 (6016): No heartbeat from core client for 30 sec - exiting 16:00:22 (6016): No heartbeat from core client for 30 sec - exiting 16:00:23 (6016): No heartbeat from core client for 30 sec - exiting 16:00:24 (6016): No heartbeat from core client for 30 sec - exiting 16:00:25 (6016): No heartbeat from core client for 30 sec - exiting 16:00:26 (6016): No heartbeat from core client for 30 sec - exiting 16:00:27 (6016): No heartbeat from core client for 30 sec - exiting 16:00:28 (6016): No heartbeat from core client for 30 sec - exiting 16:00:29 (6016): No heartbeat from core client for 30 sec - exiting 16:00:30 (6016): No heartbeat from core client for 30 sec - exiting 16:00:31 (6016): No heartbeat from core client for 30 sec - exiting 16:00:32 (6016): No heartbeat from core client for 30 sec - exiting 16:00:33 (6016): No heartbeat from core client for 30 sec - exiting 16:00:34 (6016): No heartbeat from core client for 30 sec - exiting 16:00:35 (6016): No heartbeat from core client for 30 sec - exiting 16:00:36 (6016): No heartbeat from core client for 30 sec - exiting 16:00:37 (6016): No heartbeat from core client for 30 sec - exiting 16:00:38 (6016): No heartbeat from core client for 30 sec - exiting 16:00:39 (6016): No heartbeat from core client for 30 sec - exiting 16:00:40 (6016): No heartbeat from core client for 30 sec - exiting 16:00:41 (6016): No heartbeat from core client for 30 sec - exiting 16:00:42 (6016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:00:43 (6016): No heartbeat from core client for 30 sec - exiting 16:00:44 (6016): No heartbeat from core client for 30 sec - exiting 16:00:45 (6016): No heartbeat from core client for 30 sec - exiting 16:00:46 (6016): No heartbeat from core client for 30 sec - exiting 16:00:47 (6016): No heartbeat from core client for 30 sec - exiting 16:00:48 (6016): No heartbeat from core client for 30 sec - exiting 16:00:49 (6016): No heartbeat from core client for 30 sec - exiting Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1156, selfPID=2236, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1156, selfPID=1156, iMonCtr=1 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2056, selfPID=2056, iMonCtr=1 No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2056, selfPID=3504, iMonCtr=1 CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5620, selfPID=5620, iMonCtr=1 No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5620, selfPID=5728, iMonCtr=1 16:04:46 (4896): No heartbeat from core client for 30 sec - exiting 16:04:47 (4896): No heartbeat from core client for 30 sec - exiting 16:04:48 (4896): No heartbeat from core client for 30 sec - exiting 16:04:49 (4896): No heartbeat from core client for 30 sec - exiting 16:04:50 (4896): No heartbeat from core client for 30 sec - exiting 16:04:51 (4896): No heartbeat from core client for 30 sec - exiting 16:04:52 (4896): No heartbeat from core client for 30 sec - exiting 16:04:53 (4896): No heartbeat from core client for 30 sec - exiting 16:04:54 (4896): No heartbeat from core client for 30 sec - exiting 16:04:55 (4896): No heartbeat from core client for 30 sec - exiting 16:04:56 (4896): No heartbeat from core client for 30 sec - exiting 16:04:57 (4896): No heartbeat from core client for 30 sec - exiting 16:04:58 (4896): No heartbeat from core client for 30 sec - exiting 16:04:59 (4896): No heartbeat from core client for 30 sec - exiting 16:05:00 (4896): No heartbeat from core client for 30 sec - exiting 16:05:01 (4896): No heartbeat from core client for 30 sec - exiting 16:05:02 (4896): No heartbeat from core client for 30 sec - exiting 16:05:03 (4896): No heartbeat from core client for 30 sec - exiting 16:05:04 (4896): No heartbeat from core client for 30 sec - exiting 16:05:05 (4896): No heartbeat from core client for 30 sec - exiting 16:05:06 (4896): No heartbeat from core client for 30 sec - exiting 16:05:07 (4896): No heartbeat from core client for 30 sec - exiting 16:05:08 (4896): No heartbeat from core client for 30 sec - exiting 16:05:09 (4896): No heartbeat from core client for 30 sec - exiting 16:05:10 (4896): No heartbeat from core client for 30 sec - exiting 16:05:11 (4896): No heartbeat from core client for 30 sec - exiting 16:05:12 (4896): No heartbeat from core client for 30 sec - exiting 16:05:13 (4896): No heartbeat from core client for 30 sec - exiting 16:05:14 (4896): No heartbeat from core client for 30 sec - exiting 16:05:15 (4896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:05:16 (4896): No heartbeat from core client for 30 sec - exiting 16:05:17 (4896): No heartbeat from core client for 30 sec - exiting No Process Handle Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1960, selfPID=4848, iMonCtr=1 No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1960, selfPID=1960, iMonCtr=1 Suspended CPDN Monitor - Suspend request from BOINC... 16:18:58 (5116): No heartbeat from core client for 30 sec - exiting 16:18:59 (5116): No heartbeat from core client for 30 sec - exiting 16:19:00 (5116): No heartbeat from core client for 30 sec - exiting 16:19:01 (5116): No heartbeat from core client for 30 sec - exiting 16:19:02 (5116): No heartbeat from core client for 30 sec - exiting 16:19:03 (5116): No heartbeat from core client for 30 sec - exiting 16:19:04 (5116): No heartbeat from core client for 30 sec - exiting 16:19:05 (5116): No heartbeat from core client for 30 sec - exiting 16:19:06 (5116): No heartbeat from core client for 30 sec - exiting 16:19:07 (5116): No heartbeat from core client for 30 sec - exiting 16:19:08 (5116): No heartbeat from core client for 30 sec - exiting 16:19:09 (5116): No heartbeat from core client for 30 sec - exiting 16:19:10 (5116): No heartbeat from core client for 30 sec - exiting 16:19:11 (5116): No heartbeat from core client for 30 sec - exiting 16:19:12 (5116): No heartbeat from core client for 30 sec - exiting 16:19:13 (5116): No heartbeat from core client for 30 sec - exiting 16:19:14 (5116): No heartbeat from core client for 30 sec - exiting 16:19:15 (5116): No heartbeat from core client for 30 sec - exiting 16:19:16 (5116): No heartbeat from core client for 30 sec - exiting 16:19:17 (5116): No heartbeat from core client for 30 sec - exiting 16:19:18 (5116): No heartbeat from core client for 30 sec - exiting 16:19:19 (5116): No heartbeat from core client for 30 sec - exiting 16:19:20 (5116): No heartbeat from core client for 30 sec - exiting 16:19:21 (5116): No heartbeat from core client for 30 sec - exiting 16:19:22 (5116): No heartbeat from core client for 30 sec - exiting 16:19:23 (5116): No heartbeat from core client for 30 sec - exiting 16:19:24 (5116): No heartbeat from core client for 30 sec - exiting 16:19:25 (5116): No heartbeat from core client for 30 sec - exiting 16:19:26 (5116): No heartbeat from core client for 30 sec - exiting 16:19:27 (5116): No heartbeat from core client for 30 sec - exiting 16:19:28 (5116): No heartbeat from core client for 30 sec - exiting 16:19:29 (5116): No heartbeat from core client for 30 sec - exiting 16:19:30 (5116): No heartbeat from core client for 30 sec - exiting 16:19:31 (5116): No heartbeat from core client for 30 sec - exiting 16:19:32 (5116): No heartbeat from core client for 30 sec - exiting 16:19:33 (5116): No heartbeat from core client for 30 sec - exiting 16:19:34 (5116): No heartbeat from core client for 30 sec - exiting 16:19:35 (5116): No heartbeat from core client for 30 sec - exiting 16:19:36 (5116): No heartbeat from core client for 30 sec - exiting 16:19:37 (5116): No heartbeat from core client for 30 sec - exiting 16:19:38 (5116): No heartbeat from core client for 30 sec - exiting 16:19:39 (5116): No heartbeat from core client for 30 sec - exiting 16:19:40 (5116): No heartbeat from core client for 30 sec - exiting 16:19:41 (5116): No heartbeat from core client for 30 sec - exiting 16:19:42 (5116): No heartbeat from core client for 30 sec - exiting 16:19:43 (5116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 forrtl: Access is denied. Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3208, selfPID=3208, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3208, selfPID=908, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... No Process Handle Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5916, iMonCtr=2 16:59:07 (908): called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_saf_2d53_1974_1_007146714_1_4.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_2d53_1974_1_007146714_1_5.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_2d53_1974_1_007146714_1_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_2d53_1974_1_007146714_1_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_2d53_1974_1_007146714_1_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_2d53_1974_1_007146714_1_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_2d53_1974_1_007146714_1_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_2d53_1974_1_007146714_1_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_2d53_1974_1_007146714_1_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
04 Apr 2011 23:45:03	1099591	12671312	hadam3p_saf_2d53_1974_1_007146714_1	34,656	90,841	2.6212
02 Apr 2011 19:54:00	1099591	12671312	hadam3p_saf_2d53_1974_1_007146714_1	23,136	60,926	2.6334
01 Apr 2011 01:20:08	1099591	12671312	hadam3p_saf_2d53_1974_1_007146714_1	11,616	30,648	2.6384