Task 13209326

Name	hadam3p_pnw_367j_1965_1_007394500_0
Workunit	7591930
Created	6 Aug 2011, 16:20:49 UTC
Sent	6 Aug 2011, 16:43:38 UTC
Report deadline	18 Jul 2012, 22:03:38 UTC
Received	5 Sep 2011, 15:46:45 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1041747
Run time	5 days 23 hours 24 min 5 sec
CPU time	5 days 6 hours 56 min 58 sec
Validate state	Workunit error - check skipped
Credit	3,005.88
Device peak FLOPS	2.30 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6540, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 19:28:39 (5644): No heartbeat from core client for 30 sec - exiting 19:28:40 (5644): No heartbeat from core client for 30 sec - exiting 19:28:41 (5644): No heartbeat from core client for 30 sec - exiting 19:28:42 (5644): No heartbeat from core client for 30 sec - exiting 19:28:43 (5644): No heartbeat from core client for 30 sec - exiting 19:28:44 (5644): No heartbeat from core client for 30 sec - exiting 19:28:45 (5644): No heartbeat from core client for 30 sec - exiting 19:28:46 (5644): No heartbeat from core client for 30 sec - exiting 19:28:47 (5644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4180, selfPID=7792, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 1 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5320, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6304, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4244, selfPID=5200, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 2 17:56:19 (5968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:06:40 (7428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:05:25 (4476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:05:27 (4476): No heartbeat from core client for 30 sec - exiting 18:05:28 (4476): No heartbeat from core client for 30 sec - exiting 18:05:29 (4476): No heartbeat from core client for 30 sec - exiting 18:05:30 (4476): No heartbeat from core client for 30 sec - exiting 18:05:31 (4476): No heartbeat from core client for 30 sec - exiting 18:05:32 (4476): No heartbeat from core client for 30 sec - exiting Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7760, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5060, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 3 17:48:16 (1564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8608, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8620, selfPID=8112, iMonCtr=1 Model crash detected, will try to restart... 12:36:26 (5764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5824, iMonCtr=2 Model crash detected, will try to restart... GCobal Worker:: CoDNtrprllcer:: Cs DNotprrucesin i, nxit rngnn bnget exl ti 1, c becktVIDl 0, 1, lfPIDkPID=0, selfPID=36666,0,iMiMnCnttr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 5 GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2188, selfPID=4560, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 6 16:52:16 (3952): No heartbeat from core client for 30 sec - exiting 16:52:17 (3952): No heartbeat from core client for 30 sec - exiting 16:52:18 (3952): No heartbeat from core client for 30 sec - exiting 16:52:19 (3952): No heartbeat from core client for 30 sec - exiting 16:52:20 (3952): No heartbeat from core client for 30 sec - exiting 16:52:21 (3952): No heartbeat from core client for 30 sec - exiting 16:52:22 (3952): No heartbeat from core client for 30 sec - exiting 16:52:23 (3952): No heartbeat from core client for 30 sec - exiting 16:52:24 (3952): No heartbeat from core client for 30 sec - exiting 16:52:25 (3952): No heartbeat from core client for 30 sec - exiting 16:52:26 (3952): No heartbeat from core client for 30 sec - exiting 16:52:27 (3952): No heartbeat from core client for 30 sec - exiting 16:52:28 (3952): No heartbeat from core client for 30 sec - exiting 16:52:29 (3952): No heartbeat from core client for 30 sec - exiting 16:52:30 (3952): No heartbeat from core client for 30 sec - exiting 16:52:31 (3952): No heartbeat from core client for 30 sec - exiting 16:52:32 (3952): No heartbeat from core client for 30 sec - exiting 16:52:33 (3952): No heartbeat from core client for 30 sec - exiting 16:52:34 (3952): No heartbeat from core client for 30 sec - exiting 16:52:35 (3952): No heartbeat from core client for 30 sec - exiting 16:52:36 (3952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:21:11 (2792): No heartbeat from core client for 30 sec - exiting 12:21:13 (2792): No heartbeat from core client for 30 sec - exiting 12:21:14 (2792): No heartbeat from core client for 30 sec - exiting 12:21:15 (2792): No heartbeat from core client for 30 sec - exiting 12:21:16 (2792): No heartbeat from core client for 30 sec - exiting 12:21:17 (2792): No heartbeat from core client for 30 sec - exiting 12:21:18 (2792): No heartbeat from core client for 30 sec - exiting 12:21:19 (2792): No heartbeat from core client for 30 sec - exiting 12:21:20 (2792): No heartbeat from core client for 30 sec - exiting 12:21:21 (2792): No heartbeat from core client for 30 sec - exiting 12:21:22 (2792): No heartbeat from core client for 30 sec - exiting 12:21:23 (2792): No heartbeat from core client for 30 sec - exiting 12:21:24 (2792): No heartbeat from core client for 30 sec - exiting 12:21:25 (2792): No heartbeat from core client for 30 sec - exiting 12:21:26 (2792): No heartbeat from core client for 30 sec - exiting 12:21:27 (2792): No heartbeat from core client for 30 sec - exiting 12:21:28 (2792): No heartbeat from core client for 30 sec - exiting 12:21:29 (2792): No heartbeat from core client for 30 sec - exiting 12:21:30 (2792): No heartbeat from core client for 30 sec - exiting 12:21:31 (2792): No heartbeat from core client for 30 sec - exiting 12:21:32 (2792): No heartbeat from core client for 30 sec - exiting 12:21:33 (2792): No heartbeat from core client for 30 sec - exiting 12:21:34 (2792): No heartbeat from core client for 30 sec - exiting 12:21:35 (2792): No heartbeat from core client for 30 sec - exiting 12:21:36 (2792): No heartbeat from core client for 30 sec - exiting 12:21:37 (2792): No heartbeat from core client for 30 sec - exiting 12:21:38 (2792): No heartbeat from core client for 30 sec - exiting 12:21:39 (2792): No heartbeat from core client for 30 sec - exiting 12:21:40 (2792): No heartbeat from core client for 30 sec - exiting 12:21:41 (2792): No heartbeat from core client for 30 sec - exiting 12:21:42 (2792): No heartbeat from core client for 30 sec - exiting 12:21:43 (2792): No heartbeat from core client for 30 sec - exiting 12:21:44 (2792): No heartbeat from core client for 30 sec - exiting 12:21:45 (2792): No heartbeat from core client for 30 sec - exiting 12:21:46 (2792): No heartbeat from core client for 30 sec - exiting 12:21:47 (2792): No heartbeat from core client for 30 sec - exiting 12:21:48 (2792): No heartbeat from core client for 30 sec - exiting 12:21:49 (2792): No heartbeat from core client for 30 sec - exiting 12:21:50 (2792): No heartbeat from core client for 30 sec - exiting 12:21:51 (2792): No heartbeat from core client for 30 sec - exiting 12:21:52 (2792): No heartbeat from core client for 30 sec - exiting 12:21:53 (2792): No heartbeat from core client for 30 sec - exiting 12:21:54 (2792): No heartbeat from core client for 30 sec - exiting 12:21:55 (2792): No heartbeat from core client for 30 sec - exiting 12:21:56 (2792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4388, selfPID=4388, iMonCtr=2 GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2628, iMonCtr=2 Model crash detected, will try to restart... lobal Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5716, iMonCtr=2 Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 7 GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5932, iMonCtr=2 Model crash detected, will try to restart... 09:17:44 (4620): No heartbeat from core client for 30 sec - exiting 09:17:46 (4620): No heartbeat from core client for 30 sec - exiting 09:17:47 (4620): No heartbeat from core client for 30 sec - exiting 09:17:48 (4620): No heartbeat from core client for 30 sec - exiting 09:17:49 (4620): No heartbeat from core client for 30 sec - exiting 09:17:50 (4620): No heartbeat from core client for 30 sec - exiting 09:17:51 (4620): No heartbeat from core client for 30 sec - exiting 09:17:52 (4620): No heartbeat from core client for 30 sec - exiting 09:17:53 (4620): No heartbeat from core client for 30 sec - exiting 09:17:54 (4620): No heartbeat from core client for 30 sec - exiting 09:17:55 (4620): No heartbeat from core client for 30 sec - exiting 09:17:56 (4620): No heartbeat from core client for 30 sec - exiting 09:17:57 (4620): No heartbeat from core client for 30 sec - exiting 09:17:58 (4620): No heartbeat from core client for 30 sec - exiting 09:17:59 (4620): No heartbeat from core client for 30 sec - exiting 09:18:00 (4620): No heartbeat from core client for 30 sec - exiting 09:18:01 (4620): No heartbeat from core client for 30 sec - exiting 09:18:02 (4620): No heartbeat from core client for 30 sec - exiting 09:18:03 (4620): No heartbeat from core client for 30 sec - exiting 09:18:04 (4620): No heartbeat from core client for 30 sec - exiting 09:18:05 (4620): No heartbeat from core client for 30 sec - exiting 09:18:06 (4620): No heartbeat from core client for 30 sec - exiting 09:18:07 (4620): No heartbeat from core client for 30 sec - exiting 09:18:08 (4620): No heartbeat from core client for 30 sec - exiting 09:18:09 (4620): No heartbeat from core client for 30 sec - exiting 09:18:10 (4620): No heartbeat from core client for 30 sec - exiting 09:18:11 (4620): No heartbeat from core client for 30 sec - exiting 09:18:12 (4620): No heartbeat from core client for 30 sec - exiting 09:18:13 (4620): No heartbeat from core client for 30 sec - exiting 09:18:14 (4620): No heartbeat from core client for 30 sec - exiting 09:18:15 (4620): No heartbeat from core client for 30 sec - exiting 09:18:16 (4620): No heartbeat from core client for 30 sec - exiting 09:18:17 (4620): No heartbeat from core client for 30 sec - exiting 09:18:18 (4620): No heartbeat from core client for 30 sec - exiting 09:18:19 (4620): No heartbeat from core client for 30 sec - exiting 09:18:20 (4620): No heartbeat from core client for 30 sec - exiting 09:18:21 (4620): No heartbeat from core client for 30 sec - exiting 09:18:22 (4620): No heartbeat from core client for 30 sec - exiting 09:18:23 (4620): No heartbeat from core client for 30 sec - exiting 09:18:24 (4620): No heartbeat from core client for 30 sec - exiting 09:18:25 (4620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:35:30 (5892): No heartbeat from core client for 30 sec - exiting 12:35:31 (5892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7368, iMonCtr=2 Model crash detected, will try to restart... 13:03:31 (6008): No heartbeat from core client for 30 sec - exiting 13:03:32 (6008): No heartbeat from core client for 30 sec - exiting 13:03:33 (6008): No heartbeat from core client for 30 sec - exiting 13:03:34 (6008): No heartbeat from core client for 30 sec - exiting 13:03:35 (6008): No heartbeat from core client for 30 sec - exiting 13:03:36 (6008): No heartbeat from core client for 30 sec - exiting 13:03:37 (6008): No heartbeat from core client for 30 sec - exiting 13:03:38 (6008): No heartbeat from core client for 30 sec - exiting 13:03:39 (6008): No heartbeat from core client for 30 sec - exiting 13:03:40 (6008): No heartbeat from core client for 30 sec - exiting 13:03:41 (6008): No heartbeat from core client for 30 sec - exiting 13:03:42 (6008): No heartbeat from core client for 30 sec - exiting 13:03:43 (6008): No heartbeat from core client for 30 sec - exiting 13:03:44 (6008): No heartbeat from core client for 30 sec - exiting 13:03:45 (6008): No heartbeat from core client for 30 sec - exiting 13:03:46 (6008): No heartbeat from core client for 30 sec - exiting 13:03:47 (6008): No heartbeat from core client for 30 sec - exiting 13:03:48 (6008): No heartbeat from core client for 30 sec - exiting 13:03:49 (6008): No heartbeat from core client for 30 sec - exiting 13:03:50 (6008): No heartbeat from core client for 30 sec - exiting 13:03:51 (6008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:48:04 (5152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:54:46 (5428): No heartbeat from core client for 30 sec - exiting 10:54:47 (5428): No heartbeat from core client for 30 sec - exiting 10:54:48 (5428): No heartbeat from core client for 30 sec - exiting 10:54:49 (5428): No heartbeat from core client for 30 sec - exiting 10:54:50 (5428): No heartbeat from core client for 30 sec - exiting 10:54:51 (5428): No heartbeat from core client for 30 sec - exiting 10:54:52 (5428): No heartbeat from core client for 30 sec - exiting 10:54:53 (5428): No heartbeat from core client for 30 sec - exiting 10:54:54 (5428): No heartbeat from core client for 30 sec - exiting 10:54:55 (5428): No heartbeat from core client for 30 sec - exiting 10:54:56 (5428): No heartbeat from core client for 30 sec - exiting 10:54:57 (5428): No heartbeat from core client for 30 sec - exiting 10:54:58 (5428): No heartbeat from core client for 30 sec - exiting 10:54:59 (5428): No heartbeat from core client for 30 sec - exiting 10:55:00 (5428): No heartbeat from core client for 30 sec - exiting 10:55:01 (5428): No heartbeat from core client for 30 sec - exiting 10:55:02 (5428): No heartbeat from core client for 30 sec - exiting 10:55:03 (5428): No heartbeat from core client for 30 sec - exiting 10:55:04 (5428): No heartbeat from core client for 30 sec - exiting 10:55:05 (5428): No heartbeat from core client for 30 sec - exiting 10:55:06 (5428): No heartbeat from core client for 30 sec - exiting 10:55:07 (5428): No heartbeat from core client for 30 sec - exiting 10:55:08 (5428): No heartbeat from core client for 30 sec - exiting 10:55:09 (5428): No heartbeat from core client for 30 sec - exiting 10:55:10 (5428): No heartbeat from core client for 30 sec - exiting 10:55:11 (5428): No heartbeat from core client for 30 sec - exiting 10:55:12 (5428): No heartbeat from core client for 30 sec - exiting 10:55:13 (5428): No heartbeat from core client for 30 sec - exiting 10:55:14 (5428): No heartbeat from core client for 30 sec - exiting 10:55:15 (5428): No heartbeat from core client for 30 sec - exiting 10:55:46 (5428): No heartbeat from core client for 30 sec - exiting 10:55:47 (5428): No heartbeat from core client for 30 sec - exiting 10:55:48 (5428): No heartbeat from core client for 30 sec - exiting 10:55:49 (5428): No heartbeat from core client for 30 sec - exiting 10:55:50 (5428): No heartbeat from core client for 30 sec - exiting 10:55:51 (5428): No heartbeat from core client for 30 sec - exiting 10:55:52 (5428): No heartbeat from core client for 30 sec - exiting 10:55:53 (5428): No heartbeat from core client for 30 sec - exiting 10:55:54 (5428): No heartbeat from core client for 30 sec - exiting 10:55:55 (5428): No heartbeat from core client for 30 sec - exiting 10:55:56 (5428): No heartbeat from core client for 30 sec - exiting 10:55:57 (5428): No heartbeat from core client for 30 sec - exiting 10:55:58 (5428): No heartbeat from core client for 30 sec - exiting 10:55:59 (5428): No heartbeat from core client for 30 sec - exiting 10:56:00 (5428): No heartbeat from core client for 30 sec - exiting 10:56:01 (5428): No heartbeat from core client for 30 sec - exiting 10:56:02 (5428): No heartbeat from core client for 30 sec - exiting 10:56:03 (5428): No heartbeat from core client for 30 sec - exiting 10:56:04 (5428): No heartbeat from core client for 30 sec - exiting 10:56:05 (5428): No heartbeat from core client for 30 sec - exiting 10:56:06 (5428): No heartbeat from core client for 30 sec - exiting 10:56:07 (5428): No heartbeat from core client for 30 sec - exiting 10:56:08 (5428): No heartbeat from core client for 30 sec - exiting 10:56:09 (5428): No heartbeat from core client for 30 sec - exiting 10:56:10 (5428): No heartbeat from core client for 30 sec - exiting 10:56:11 (5428): No heartbeat from core client for 30 sec - exiting 10:56:12 (5428): No heartbeat from core client for 30 sec - exiting 10:56:13 (5428): No heartbeat from core client for 30 sec - exiting 10:56:14 (5428): No heartbeat from core client for 30 sec - exiting 10:56:15 (5428): No heartbeat from core client for 30 sec - exiting 10:56:16 (5428): No heartbeat from core client for 30 sec - exiting 10:56:17 (5428): No heartbeat from core client for 30 sec - exiting 10:56:18 (5428): No heartbeat from core client for 30 sec - exiting 10:56:19 (5428): No heartbeat from core client for 30 sec - exiting 10:56:20 (5428): No heartbeat from core client for 30 sec - exiting 10:56:21 (5428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:05:06 (5592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4968, selfPID=3532, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 11 CPDN Monitor - Quit request from BOINC... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
05 Sep 2011 13:59:12	1041747	13209326	hadam3p_pnw_367j_1965_1_007394500_0	138,336	456,200	3.2978
03 Sep 2011 15:21:42	1041747	13209326	hadam3p_pnw_367j_1965_1_007394500_0	126,816	419,127	3.3050
02 Sep 2011 17:11:52	1041747	13209326	hadam3p_pnw_367j_1965_1_007394500_0	115,296	382,608	3.3185
01 Sep 2011 13:15:59	1041747	13209326	hadam3p_pnw_367j_1965_1_007394500_0	103,776	345,829	3.3325
31 Aug 2011 12:05:56	1041747	13209326	hadam3p_pnw_367j_1965_1_007394500_0	92,256	309,123	3.3507
30 Aug 2011 10:35:08	1041747	13209326	hadam3p_pnw_367j_1965_1_007394500_0	80,736	271,993	3.3689
28 Aug 2011 12:57:41	1041747	13209326	hadam3p_pnw_367j_1965_1_007394500_0	69,216	234,015	3.3809
27 Aug 2011 13:44:52	1041747	13209326	hadam3p_pnw_367j_1965_1_007394500_0	57,696	196,935	3.4133
26 Aug 2011 13:54:18	1041747	13209326	hadam3p_pnw_367j_1965_1_007394500_0	46,176	158,230	3.4267
24 Aug 2011 17:19:13	1041747	13209326	hadam3p_pnw_367j_1965_1_007394500_0	34,659	119,185	3.4388
24 Aug 2011 16:17:09	1041747	13209326	hadam3p_pnw_367j_1965_1_007394500_0	34,656	118,723	3.4258
22 Aug 2011 14:16:11	1041747	13209326	hadam3p_pnw_367j_1965_1_007394500_0	23,136	78,690	3.4012
20 Aug 2011 20:12:31	1041747	13209326	hadam3p_pnw_367j_1965_1_007394500_0	11,616	39,553	3.4050