Task 12320596

Name	hadam3p_saf_2149_1968_1_007033537_0
Workunit	7236853
Created	25 Nov 2010, 10:10:01 UTC
Sent	2 Jan 2011, 6:35:05 UTC
Report deadline	15 Dec 2011, 11:55:05 UTC
Received	11 Feb 2011, 12:42:15 UTC
Server state	Over
Outcome	Didn't need
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1125909
Run time	27 days 9 hours 53 min 5 sec
CPU time	20 days 21 hours 56 min 26 sec
Validate state	Initial
Credit	2,244.15
Device peak FLOPS	0.67 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Southern Africa v6.08 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> 10:35:24 (3064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:35:25 (3064): No heartbeat from core client for 30 sec - exiting 10:35:26 (3064): No heartbeat from core client for 30 sec - exiting 10:35:27 (3064): No heartbeat from core client for 30 sec - exiting 15:17:45 (2516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:17:47 (2516): No heartbeat from core client for 30 sec - exiting 15:17:48 (2516): No heartbeat from core client for 30 sec - exiting 15:17:49 (2516): No heartbeat from core client for 30 sec - exiting 15:17:50 (2516): No heartbeat from core client for 30 sec - exiting 15:17:51 (2516): No heartbeat from core client for 30 sec - exiting 22:37:34 (3328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:37:40 (3328): No heartbeat from core client for 30 sec - exiting 22:37:48 (3164): Can't acquire lockfile (32) - waiting 35s 20:42:30 (3164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:40:12 (348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:40:13 (348): No heartbeat from core client for 30 sec - exiting 21:40:14 (348): No heartbeat from core client for 30 sec - exiting 21:40:15 (348): No heartbeat from core client for 30 sec - exiting 21:40:16 (348): No heartbeat from core client for 30 sec - exiting 21:40:17 (348): No heartbeat from core client for 30 sec - exiting 21:06:38 (3100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:06:41 (3100): No heartbeat from core client for 30 sec - exiting 21:06:42 (3100): No heartbeat from core client for 30 sec - exiting 21:06:43 (3100): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4584, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3824, iMonCtr=2 04:40:10 (3568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:40:11 (3568): No heartbeat from core client for 30 sec - exiting 04:40:12 (3568): No heartbeat from core client for 30 sec - exiting 04:40:13 (3568): No heartbeat from core client for 30 sec - exiting 04:40:14 (3568): No heartbeat from core client for 30 sec - exiting 04:40:15 (3568): No heartbeat from core client for 30 sec - exiting 03:09:54 (896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:09:55 (896): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3540, selfPID=1336, iMonCtr=1 Model crash detected, will try to restart... 20:22:52 (2464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:22:54 (2464): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2852, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2504, iMonCtr=2 Model crash detected, will try to restart... 10:03:11 (3520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:03:12 (3520): No heartbeat from core client for 30 sec - exiting 10:03:14 (3520): No heartbeat from core client for 30 sec - exiting 10:03:15 (3520): No heartbeat from core client for 30 sec - exiting 10:03:16 (3520): No heartbeat from core client for 30 sec - exiting 10:03:17 (3520): No heartbeat from core client for 30 sec - exiting 10:01:54 (2624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:01:55 (2624): No heartbeat from core client for 30 sec - exiting 10:07:16 (1596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1080, selfPID=1080, iMonCtr=2 10:08:45 (3688): No heartbeat from core client for 30 sec - exiting 10:08:46 (3688): No heartbeat from core client for 30 sec - exiting 10:08:47 (3688): No heartbeat from core client for 30 sec - exiting 10:08:48 (3688): No heartbeat from core client for 30 sec - exiting 10:08:49 (3688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1220, selfPID=1220, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3644, selfPID=3644, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:24:19 (2012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:24:20 (2012): No heartbeat from core client for 30 sec - exiting 14:13:17 (804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:13:18 (804): No heartbeat from core client for 30 sec - exiting 14:13:19 (804): No heartbeat from core client for 30 sec - exiting 14:40:26 (2376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:03:16 (2760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:03:18 (2760): No heartbeat from core client for 30 sec - exiting 00:03:19 (2760): No heartbeat from core client for 30 sec - exiting 00:43:52 (2972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:43:54 (2972): No heartbeat from core client for 30 sec - exiting 00:43:55 (2972): No heartbeat from core client for 30 sec - exiting 00:43:56 (2972): No heartbeat from core client for 30 sec - exiting 00:55:37 (2596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:55:39 (2596): No heartbeat from core client for 30 sec - exiting 00:55:40 (2596): No heartbeat from core client for 30 sec - exiting 02:12:49 (3756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:12:53 (3756): No heartbeat from core client for 30 sec - exiting 02:12:54 (3756): No heartbeat from core client for 30 sec - exiting 02:12:55 (3756): No heartbeat from core client for 30 sec - exiting 02:12:56 (3756): No heartbeat from core client for 30 sec - exiting 02:12:58 (3756): No heartbeat from core client for 30 sec - exiting 02:12:59 (3756): No heartbeat from core client for 30 sec - exiting 02:24:57 (2016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:25:02 (2016): No heartbeat from core client for 30 sec - exiting 02:25:03 (2016): No heartbeat from core client for 30 sec - exiting 02:25:04 (2016): No heartbeat from core client for 30 sec - exiting 02:25:05 (2016): No heartbeat from core client for 30 sec - exiting 02:25:06 (2016): No heartbeat from core client for 30 sec - exiting 02:25:07 (2016): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4040, iMonCtr=2 Model crash detected, will try to restart... 16:13:45 (3228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:13:46 (3228): No heartbeat from core client for 30 sec - exiting 16:13:47 (3228): No heartbeat from core client for 30 sec - exiting 16:13:48 (3228): No heartbeat from core client for 30 sec - exiting 16:13:49 (3228): No heartbeat from core client for 30 sec - exiting 16:13:50 (3228): No heartbeat from core client for 30 sec - exiting 17:40:33 (3992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:40:34 (3992): No heartbeat from core client for 30 sec - exiting 17:40:35 (3992): No heartbeat from core client for 30 sec - exiting 17:40:36 (3992): No heartbeat from core client for 30 sec - exiting 17:40:37 (3992): No heartbeat from core client for 30 sec - exiting 22:32:55 (2568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:32:56 (2568): No heartbeat from core client for 30 sec - exiting 03:11:28 (3172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:11:30 (3172): No heartbeat from core client for 30 sec - exiting 03:11:31 (3172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2856, selfPID=2856, iMonCtr=2 20:41:51 (260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2820, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 05:56:25 (1968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:56:26 (1968): No heartbeat from core client for 30 sec - exiting 05:56:27 (1968): No heartbeat from core client for 30 sec - exiting 05:56:28 (1968): No heartbeat from core client for 30 sec - exiting 05:56:29 (1968): No heartbeat from core client for 30 sec - exiting 05:56:30 (1968): No heartbeat from core client for 30 sec - exiting 0Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3708, selfPID=3420, iMonCtr=1 19:07:38 (3552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:13:24 (3676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:13:25 (3676): No heartbeat from core client for 30 sec - exiting 20:13:26 (3676): No heartbeat from core client for 30 sec - exiting 20:13:27 (3676): No heartbeat from core client for 30 sec - exiting 20:13:28 (3676): No heartbeat from core client for 30 sec - exiting 20:13:29 (3676): No heartbeat from core client for 30 sec - exiting 20:14:59 (3148): No heartbeat from core client for 30 sec - exiting 20:15:00 (3148): No heartbeat from core client for 30 sec - exiting 20:15:01 (3148): No heartbeat from core client for 30 sec - exiting 20:15:02 (3148): No heartbeat from core client for 30 sec - exiting 20:15:03 (3148): No heartbeat from core client for 30 sec - exiting 20:15:04 (3148): No heartbeat from core client for 30 sec - exiting 20:15:05 (3148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2228, selfPID=2228, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1168, selfPID=1168, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4452, iMonCtr=2 Model crash detected, will try to restart... 20:05:39 (3980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:05:40 (3980): No heartbeat from core client for 30 sec - exiting 20:05:41 (3980): No heartbeat from core client for 30 sec - exiting 20:05:42 (3980): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 22:27:19 (2604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:27:21 (2604): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1292, iMonCtr=2 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 12:33:13 (3376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:33:14 (3376): No heartbeat from core client for 30 sec - exiting 12:33:15 (3376): No heartbeat from core client for 30 sec - exiting Leaving CPDN_Main::Monitor... 15:38:36 (2740): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
11 Feb 2011 12:44:07	1125909	12320596	hadam3p_saf_2149_1968_1_007033537_0	138,340	1,803,995	13.0403
11 Feb 2011 12:44:07	1125909	12320596	hadam3p_saf_2149_1968_1_007033537_0	138,336	1,801,538	13.0229
09 Feb 2011 13:01:27	1125909	12320596	hadam3p_saf_2149_1968_1_007033537_0	126,816	1,656,394	13.0614
06 Feb 2011 21:36:41	1125909	12320596	hadam3p_saf_2149_1968_1_007033537_0	115,296	1,512,517	13.1186
04 Feb 2011 06:37:36	1125909	12320596	hadam3p_saf_2149_1968_1_007033537_0	103,776	1,361,096	13.1157
25 Jan 2011 23:41:43	1125909	12320596	hadam3p_saf_2149_1968_1_007033537_0	92,256	1,216,266	13.1836
20 Jan 2011 19:58:35	1125909	12320596	hadam3p_saf_2149_1968_1_007033537_0	80,736	1,070,772	13.2626
17 Jan 2011 12:17:14	1125909	12320596	hadam3p_saf_2149_1968_1_007033537_0	69,216	916,874	13.2466
15 Jan 2011 12:46:11	1125909	12320596	hadam3p_saf_2149_1968_1_007033537_0	57,696	764,753	13.2549
12 Jan 2011 14:09:01	1125909	12320596	hadam3p_saf_2149_1968_1_007033537_0	46,176	613,513	13.2864
09 Jan 2011 22:54:56	1125909	12320596	hadam3p_saf_2149_1968_1_007033537_0	34,656	462,721	13.3518
07 Jan 2011 15:47:13	1125909	12320596	hadam3p_saf_2149_1968_1_007033537_0	23,136	310,711	13.4298
05 Jan 2011 06:25:16	1125909	12320596	hadam3p_saf_2149_1968_1_007033537_0	11,616	154,687	13.3167