Task 13163193

Name	hadam3p_pnw_2vas_1965_1_007363155_2
Workunit	7560585
Created	28 Jul 2011, 1:06:47 UTC
Sent	28 Jul 2011, 1:12:41 UTC
Report deadline	9 Jul 2012, 6:32:41 UTC
Received	6 Sep 2011, 23:07:08 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1081795
Run time	6 days 12 hours 32 min 3 sec
CPU time	5 days 11 hours 44 min 24 sec
Validate state	Workunit error - check skipped
Credit	3,005.88
Device peak FLOPS	1.99 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>6.12.33</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2068, selfPID=4200, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3584, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 3 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6404, iMonCtr=2 Model crash detected, will try to restart... 23:59:41 (2036): No heartbeat from core client for 30 sec - exiting 23:59:42 (2036): No heartbeat from core client for 30 sec - exiting 23:59:43 (2036): No heartbeat from core client for 30 sec - exiting 23:59:44 (2036): No heartbeat from core client for 30 sec - exiting 23:59:45 (2036): No heartbeat from core client for 30 sec - exiting 23:59:46 (2036): No heartbeat from core client for 30 sec - exiting 23:59:47 (2036): No heartbeat from core client for 30 sec - exiting 23:59:48 (2036): No heartbeat from core client for 30 sec - exiting 23:59:50 (2036): No heartbeat from core client for 30 sec - exiting 23:59:51 (2036): No heartbeat from core client for 30 sec - exiting 23:59:52 (2036): No heartbeat from core client for 30 sec - exiting 23:59:53 (2036): No heartbeat from core client for 30 sec - exiting 23:59:54 (2036): No heartbeat from core client for 30 sec - exiting 23:59:55 (2036): No heartbeat from core client for 30 sec - exiting 23:59:56 (2036): No heartbeat from core client for 30 sec - exiting 23:59:57 (2036): No heartbeat from core client for 30 sec - exiting 23:59:58 (2036): No heartbeat from core client for 30 sec - exiting 23:59:59 (2036): No heartbeat from core client for 30 sec - exiting 00:00:00 (2036): No heartbeat from core client for 30 sec - exiting 00:00:02 (2036): No heartbeat from core client for 30 sec - exiting 00:00:03 (2036): No heartbeat from core client for 30 sec - exiting 00:00:04 (2036): No heartbeat from core client for 30 sec - exiting 00:00:05 (2036): No heartbeat from core client for 30 sec - exiting 00:00:06 (2036): No heartbeat from core client for 30 sec - exiting 00:00:07 (2036): No heartbeat from core client for 30 sec - exiting 00:00:08 (2036): No heartbeat from core client for 30 sec - exiting 00:00:09 (2036): No heartbeat from core client for 30 sec - exiting 00:00:10 (2036): No heartbeat from core client for 30 sec - exiting 00:00:11 (2036): No heartbeat from core client for 30 sec - exiting 00:00:13 (2036): No heartbeat from core client for 30 sec - exiting 00:00:14 (2036): No heartbeat from core client for 30 sec - exiting 00:00:15 (2036): No heartbeat from core client for 30 sec - exiting 00:00:16 (2036): No heartbeat from core client for 30 sec - exiting 00:00:17 (2036): No heartbeat from core client for 30 sec - exiting 00:00:18 (2036): No heartbeat from core client for 30 sec - exiting 00:00:19 (2036): No heartbeat from core client for 30 sec - exiting 00:00:20 (2036): No heartbeat from core client for 30 sec - exiting 00:00:21 (2036): No heartbeat from core client for 30 sec - exiting 00:00:22 (2036): No heartbeat from core client for 30 sec - exiting 00:00:23 (2036): No heartbeat from core client for 30 sec - exiting 00:00:25 (2036): No heartbeat from core client for 30 sec - exiting 00:00:26 (2036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:11:31 (5984): No heartbeat from core client for 30 sec - exiting 20:11:32 (5984): No heartbeat from core client for 30 sec - exiting 20:11:33 (5984): No heartbeat from core client for 30 sec - exiting 20:11:34 (5984): No heartbeat from core client for 30 sec - exiting 20:11:35 (5984): No heartbeat from core client for 30 sec - exiting 20:11:36 (5984): No heartbeat from core client for 30 sec - exiting 20:11:38 (5984): No heartbeat from core client for 30 sec - exiting 20:11:39 (5984): No heartbeat from core client for 30 sec - exiting 20:11:40 (5984): No heartbeat from core client for 30 sec - exiting 20:11:42 (5984): No heartbeat from core client for 30 sec - exiting 20:11:43 (5984): No heartbeat from core client for 30 sec - exiting 20:11:44 (5984): No heartbeat from core client for 30 sec - exiting 20:11:45 (5984): No heartbeat from core client for 30 sec - exiting 20:11:46 (5984): No heartbeat from core client for 30 sec - exiting 20:11:47 (5984): No heartbeat from core client for 30 sec - exiting 20:11:48 (5984): No heartbeat from core client for 30 sec - exiting 20:11:49 (5984): No heartbeat from core client for 30 sec - exiting 20:11:50 (5984): No heartbeat from core client for 30 sec - exiting 20:11:51 (5984): No heartbeat from core client for 30 sec - exiting 20:11:53 (5984): No heartbeat from core client for 30 sec - exiting 20:11:54 (5984): No heartbeat from core client for 30 sec - exiting 20:11:55 (5984): No heartbeat from core client for 30 sec - exiting 20:11:56 (5984): No heartbeat from core client for 30 sec - exiting 20:11:57 (5984): No heartbeat from core client for 30 sec - exiting 20:11:58 (5984): No heartbeat from core client for 30 sec - exiting 20:11:59 (5984): No heartbeat from core client for 30 sec - exiting 20:12:00 (5984): No heartbeat from core client for 30 sec - exiting 20:12:01 (5984): No heartbeat from core client for 30 sec - exiting 20:12:02 (5984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting,19:20:39 (1144): No heartbeat from core client for 30 sec - exiting 19:20:40 (1144): No heartbeat from core client for 30 sec - exiting 19:20:41 (1144): No heartbeat from core client for 30 sec - exiting 19:20:42 (1144): No heartbeat from core client for 30 sec - exiting 19:20:43 (1144): No heartbeat from core client for 30 sec - exiting 19:20:44 (1144): No heartbeat from core client for 30 sec - exiting 19:20:45 (1144): No heartbeat from core client for 30 sec - exiting 19:20:46 (1144): No heartbeat from core client for 30 sec - exiting 19:20:48 (1144): No heartbeat from core client for 30 sec - exiting 19:20:49 (1144): No heartbeat from core client for 30 sec - exiting 19:20:50 (1144): No heartbeat from core client for 30 sec - exiting 19:20:51 (1144): No heartbeat from core client for 30 sec - exiting 19:20:52 (1144): No heartbeat from core client for 30 sec - exiting 19:20:53 (1144): No heartbeat from core client for 30 sec - exiting 19:20:54 (1144): No heartbeat from core client for 30 sec - exiting 19:20:55 (1144): No heartbeat from core client for 30 sec - exiting 19:20:56 (1144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4080, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4000, iMonCtr=2 Model crash detected, will try to restart... 18:04:32 (5444): No heartbeat from core client for 30 sec - exiting 18:04:33 (5444): No heartbeat from core client for 30 sec - exiting 18:04:34 (5444): No heartbeat from core client for 30 sec - exiting 18:04:36 (5444): No heartbeat from core client for 30 sec - exiting 18:04:37 (5444): No heartbeat from core client for 30 sec - exiting 18:04:38 (5444): No heartbeat from core client for 30 sec - exiting 18:04:39 (5444): No heartbeat from core client for 30 sec - exiting 18:04:40 (5444): No heartbeat from core client for 30 sec - exiting 18:04:41 (5444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:29:53 (5924): No heartbeat from core client for 30 sec - exiting 22:29:54 (5924): No heartbeat from core client for 30 sec - exiting 22:29:55 (5924): No heartbeat from core client for 30 sec - exiting 22:29:56 (5924): No heartbeat from core client for 30 sec - exiting 22:29:57 (5924): No heartbeat from core client for 30 sec - exiting 22:29:58 (5924): No heartbeat from core client for 30 sec - exiting 22:29:59 (5924): No heartbeat from core client for 30 sec - exiting 22:30:01 (5924): No heartbeat from core client for 30 sec - exiting 22:30:02 (5924): No heartbeat from core client for 30 sec - exiting 22:30:03 (5924): No heartbeat from core client for 30 sec - exiting 22:30:04 (5924): No heartbeat from core client for 30 sec - exiting 22:30:05 (5924): No heartbeat from core client for 30 sec - exiting 22:30:06 (5924): No heartbeat from core client for 30 sec - exiting 22:30:07 (5924): No heartbeat from core client for 30 sec - exiting 22:30:08 (5924): No heartbeat from core client for 30 sec - exiting 22:30:09 (5924): No heartbeat from core client for 30 sec - exiting 22:30:10 (5924): No heartbeat from core client for 30 sec - exiting 22:30:12 (5924): No heartbeat from core client for 30 sec - exiting 22:30:13 (5924): No heartbeat from core client for 30 sec - exiting 22:30:14 (5924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5712, iMonCtr=2 16:05:45 (4900): No heartbeat from core client for 30 sec - exiting 16:05:46 (4900): No heartbeat from core client for 30 sec - exiting 16:05:47 (4900): No heartbeat from core client for 30 sec - exiting 16:05:48 (4900): No heartbeat from core client for 30 sec - exiting 16:05:49 (4900): No heartbeat from core client for 30 sec - exiting 16:05:50 (4900): No heartbeat from core client for 30 sec - exiting 16:05:52 (4900): No heartbeat from core client for 30 sec - exiting 16:05:53 (4900): No heartbeat from core client for 30 sec - exiting 16:05:54 (4900): No heartbeat from core client for 30 sec - exiting 16:05:55 (4900): No heartbeat from core client for 30 sec - exiting 16:05:56 (4900): No heartbeat from core client for 30 sec - exiting 16:05:57 (4900): No heartbeat from core client for 30 sec - exiting 16:05:58 (4900): No heartbeat from core client for 30 sec - exiting 16:05:59 (4900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:24:47 (5572): No heartbeat from core client for 30 sec - exiting 00:24:48 (5572): No heartbeat from core client for 30 sec - exiting 00:24:49 (5572): No heartbeat from core client for 30 sec - exiting 00:24:51 (5572): No heartbeat from core client for 30 sec - exiting 00:24:52 (5572): No heartbeat from core client for 30 sec - exiting 00:24:53 (5572): No heartbeat from core client for 30 sec - exiting 00:24:54 (5572): No heartbeat from core client for 30 sec - exiting 00:24:55 (5572): No heartbeat from core client for 30 sec - exiting 00:24:56 (5572): No heartbeat from core client for 30 sec - exiting 00:24:57 (5572): No heartbeat from core client for 30 sec - exiting 00:24:58 (5572): No heartbeat from core client for 30 sec - exiting 00:24:59 (5572): No heartbeat from core client for 30 sec - exiting 00:25:00 (5572): No heartbeat from core client for 30 sec - exiting 00:25:02 (5572): No heartbeat from core client for 30 sec - exiting 00:25:03 (5572): No heartbeat from core client for 30 sec - exiting 00:25:04 (5572): No heartbeat from core client for 30 sec - exiting 00:25:05 (5572): No heartbeat from core client for 30 sec - exiting 00:25:06 (5572): No heartbeat from core client for 30 sec - exiting 00:25:07 (5572): No heartbeat from core client for 30 sec - exiting 00:25:08 (5572): No heartbeat from core client for 30 sec - exiting 00:25:09 (5572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:04:38 (1048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:34:50 (5452): No heartbeat from core client for 30 sec - exiting 20:34:51 (5452): No heartbeat from core client for 30 sec - exiting 20:34:52 (5452): No heartbeat from core client for 30 sec - exiting 20:34:53 (5452): No heartbeat from core client for 30 sec - exiting 20:34:54 (5452): No heartbeat from core client for 30 sec - exiting 20:34:55 (5452): No heartbeat from core client for 30 sec - exiting 20:34:57 (5452): No heartbeat from core client for 30 sec - exiting 20:34:58 (5452): No heartbeat from core client for 30 sec - exiting 20:34:59 (5452): No heartbeat from core client for 30 sec - exiting 20:35:00 (5452): No heartbeat from core client for 30 sec - exiting 20:35:01 (5452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4080, iMonCtr=2 Model crash detected, will try to restart... 10:41:35 (5740): No heartbeat from core client for 30 sec - exiting 10:41:36 (5740): No heartbeat from core client for 30 sec - exiting 10:41:37 (5740): No heartbeat from core client for 30 sec - exiting 10:41:38 (5740): No heartbeat from core client for 30 sec - exiting 10:41:39 (5740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:40:38 (2100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5356, selfPID=5356, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2180, iMonCtr=2 Model crash detected, will try to restart... 16:06:02 (4128): No heartbeat from core client for 30 sec - exiting 16:06:03 (4128): No heartbeat from core client for 30 sec - exiting 16:06:04 (4128): No heartbeat from core client for 30 sec - exiting 16:06:05 (4128): No heartbeat from core client for 30 sec - exiting 16:06:06 (4128): No heartbeat from core client for 30 sec - exiting 16:06:07 (4128): No heartbeat from core client for 30 sec - exiting 16:06:08 (4128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:28:41 (3772): No heartbeat from core client for 30 sec - exiting 14:28:42 (3772): No heartbeat from core client for 30 sec - exiting 14:28:43 (3772): No heartbeat from core client for 30 sec - exiting 14:28:44 (3772): No heartbeat from core client for 30 sec - exiting 14:28:45 (3772): No heartbeat from core client for 30 sec - exiting 14:28:46 (3772): No heartbeat from core client for 30 sec - exiting 14:28:47 (3772): No heartbeat from core client for 30 sec - exiting 14:28:48 (3772): No heartbeat from core client for 30 sec - exiting 14:28:49 (3772): No heartbeat from core client for 30 sec - exiting 14:28:51 (3772): No heartbeat from core client for 30 sec - exiting 14:28:52 (3772): No heartbeat from core client for 30 sec - exiting 14:28:53 (3772): No heartbeat from core client for 30 sec - exiting 14:28:54 (3772): No heartbeat from core client for 30 sec - exiting 14:28:55 (3772): No heartbeat from core client for 30 sec - exiting 14:28:56 (3772): No heartbeat from core client for 30 sec - exiting 14:28:57 (3772): No heartbeat from core client for 30 sec - exiting 14:28:58 (3772): No heartbeat from core client for 30 sec - exiting 14:28:59 (3772): No heartbeat from core client for 30 sec - exiting 14:29:00 (3772): No heartbeat from core client for 30 sec - exiting 14:29:02 (3772): No heartbeat from core client for 30 sec - exiting 14:29:03 (3772): No heartbeat from core client for 30 sec - exiting 14:29:04 (3772): No heartbeat from core client for 30 sec - exiting 14:29:06 (3772): No heartbeat from core client for 30 sec - exiting 14:29:07 (3772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Sep 2011 00:26:33	1081795	13163193	hadam3p_pnw_2vas_1965_1_007363155_2	138,336	473,429	3.4223
03 Sep 2011 22:14:02	1081795	13163193	hadam3p_pnw_2vas_1965_1_007363155_2	126,816	435,772	3.4363
31 Aug 2011 04:04:11	1081795	13163193	hadam3p_pnw_2vas_1965_1_007363155_2	115,296	397,394	3.4467
23 Aug 2011 06:00:27	1081795	13163193	hadam3p_pnw_2vas_1965_1_007363155_2	103,776	358,821	3.4576
19 Aug 2011 09:40:12	1081795	13163193	hadam3p_pnw_2vas_1965_1_007363155_2	92,256	321,878	3.4890
18 Aug 2011 05:57:43	1081795	13163193	hadam3p_pnw_2vas_1965_1_007363155_2	80,736	283,818	3.5154
16 Aug 2011 07:46:48	1081795	13163193	hadam3p_pnw_2vas_1965_1_007363155_2	69,216	243,920	3.5240
09 Aug 2011 04:06:28	1081795	13163193	hadam3p_pnw_2vas_1965_1_007363155_2	57,696	201,705	3.4960
07 Aug 2011 18:01:06	1081795	13163193	hadam3p_pnw_2vas_1965_1_007363155_2	46,176	161,593	3.4995
05 Aug 2011 08:18:15	1081795	13163193	hadam3p_pnw_2vas_1965_1_007363155_2	34,656	121,784	3.5141
04 Aug 2011 02:42:29	1081795	13163193	hadam3p_pnw_2vas_1965_1_007363155_2	23,136	81,307	3.5143
01 Aug 2011 14:46:49	1081795	13163193	hadam3p_pnw_2vas_1965_1_007363155_2	11,616	41,221	3.5486