Task 13156504

Name	hadam3p_pnw_35jo_1990_1_007368882_0
Workunit	7566312
Created	24 Jul 2011, 10:26:35 UTC
Sent	26 Jul 2011, 18:58:58 UTC
Report deadline	8 Jul 2012, 0:18:58 UTC
Received	1 Aug 2011, 9:42:10 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-177 (0xFFFFFF4F) ERR_RSC_LIMIT_EXCEEDED
Computer ID	933499
Run time	3 days 23 hours 51 min 22 sec
CPU time	3 days 20 hours 9 min 56 sec
Validate state	Invalid
Credit	2,255.06
Device peak FLOPS	2.31 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>6.12.33</core_client_version> <![CDATA[ <message> Maximum elapsed time exceeded </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:20:15 (6740): No heartbeat from core client for 30 sec - exiting 14:20:16 (6740): No heartbeat from core client for 30 sec - exiting 14:20:17 (6740): No heartbeat from core client for 30 sec - exiting 14:20:18 (6740): No heartbeat from core client for 30 sec - exiting 14:20:19 (6740): No heartbeat from core client for 30 sec - exiting 14:20:20 (6740): No heartbeat from core client for 30 sec - exiting 14:20:21 (6740): No heartbeat from core client for 30 sec - exiting 14:20:22 (6740): No heartbeat from core client for 30 sec - exiting 14:20:23 (6740): No heartbeat from core client for 30 sec - exiting 14:20:24 (6740): No heartbeat from core client for 30 sec - exiting 14:20:25 (6740): No heartbeat from core client for 30 sec - exiting 14:20:26 (6740): No heartbeat from core client for 30 sec - exiting 14:20:27 (6740): No heartbeat from core client for 30 sec - exiting 14:20:28 (6740): No heartbeat from core client for 30 sec - exiting 14:20:29 (6740): No heartbeat from core client for 30 sec - exiting 14:20:30 (6740): No heartbeat from core client for 30 sec - exiting 14:20:31 (6740): No heartbeat from core client for 30 sec - exiting 14:20:32 (6740): No heartbeat from core client for 30 sec - exiting 14:20:33 (6740): No heartbeat from core client for 30 sec - exiting 14:20:34 (6740): No heartbeat from core client for 30 sec - exiting 14:20:35 (6740): No heartbeat from core client for 30 sec - exiting 14:20:36 (6740): No heartbeat from core client for 30 sec - exiting 14:20:37 (6740): No heartbeat from core client for 30 sec - exiting 14:20:38 (6740): No heartbeat from core client for 30 sec - exiting 14:20:39 (6740): No heartbeat from core client for 30 sec - exiting 14:20:40 (6740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7648, selfPID=7648, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 19:01:06 (4432): No heartbeat from core client for 30 sec - exiting 19:01:07 (4432): No heartbeat from core client for 30 sec - exiting 19:01:08 (4432): No heartbeat from core client for 30 sec - exiting 19:01:09 (4432): No heartbeat from core client for 30 sec - exiting 19:01:10 (4432): No heartbeat from core client for 30 sec - exiting 19:01:11 (4432): No heartbeat from core client for 30 sec - exiting 19:01:12 (4432): No heartbeat from core client for 30 sec - exiting 19:01:13 (4432): No heartbeat from core client for 30 sec - exiting 19:01:14 (4432): No heartbeat from core client for 30 sec - exiting 19:01:15 (4432): No heartbeat from core client for 30 sec - exiting 19:01:16 (4432): No heartbeat from core client for 30 sec - exiting 19:01:17 (4432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 23:01:19 (7008): No heartbeat from core client for 30 sec - exiting 23:14:52 (4668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:11:18 (7288): No heartbeat from core client for 30 sec - exiting 12:11:19 (7288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4904, selfPID=4904, iMonCtr=2 12:11:20 (7288): No heartbeat from core client for 30 sec - exiting 12:12:16 (6436): No heartbeat from core client for 30 sec - exiting 12:12:17 (6436): No heartbeat from core client for 30 sec - exiting 12:12:18 (6436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:11:23 (6848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:12:15 (476): No heartbeat from core client for 30 sec - exiting 13:12:16 (476): No heartbeat from core client for 30 sec - exiting 13:12:17 (476): No heartbeat from core client for 30 sec - exiting 13:12:18 (476): No heartbeat from core client for 30 sec - exiting 13:12:19 (476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:11:21 (4592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:11:30 (5288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:11:31 (5288): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:39:00 (7068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:11:53 (6752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:11:54 (6752): No heartbeat from core client for 30 sec - exiting 16:13:42 (6480): No heartbeat from core client for 30 sec - exiting 16:13:43 (6480): No heartbeat from core client for 30 sec - exiting 16:13:44 (6480): No heartbeat from core client for 30 sec - exiting 16:13:45 (6480): No heartbeat from core client for 30 sec - exiting 16:13:46 (6480): No heartbeat from core client for 30 sec - exiting 16:13:47 (6480): No heartbeat from core client for 30 sec - exiting 16:13:48 (6480): No heartbeat from core client for 30 sec - exiting 16:13:49 (6480): No heartbeat from core client for 30 sec - exiting 16:13:50 (6480): No heartbeat from core client for 30 sec - exiting 16:13:51 (6480): No heartbeat from core client for 30 sec - exiting 16:13:52 (6480): No heartbeat from core client for 30 sec - exiting 16:13:53 (6480): No heartbeat from core client for 30 sec - exiting 16:13:54 (6480): No heartbeat from core client for 30 sec - exiting 16:13:55 (6480): No heartbeat from core client for 30 sec - exiting 16:13:56 (6480): No heartbeat from core client for 30 sec - exiting 16:13:57 (6480): No heartbeat from core client for 30 sec - exiting 16:13:58 (6480): No heartbeat from core client for 30 sec - exiting 16:13:59 (6480): No heartbeat from core client for 30 sec - exiting 16:14:00 (6480): No heartbeat from core client for 30 sec - exiting 16:14:01 (6480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:22:51 (484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6260, selfPID=6260, iMonCtr=2 16:24:18 (6820): No heartbeat from core client for 30 sec - exiting 16:24:19 (6820): No heartbeat from core client for 30 sec - exiting 16:24:20 (6820): No heartbeat from core client for 30 sec - exiting 16:24:21 (6820): No heartbeat from core client for 30 sec - exiting 16:24:22 (6820): No heartbeat from core client for 30 sec - exiting 16:24:23 (6820): No heartbeat from core client for 30 sec - exiting 16:24:24 (6820): No heartbeat from core client for 30 sec - exiting 16:24:25 (6820): No heartbeat from core client for 30 sec - exiting 16:24:26 (6820): No heartbeat from core client for 30 sec - exiting 16:24:27 (6820): No heartbeat from core client for 30 sec - exiting 16:24:28 (6820): No heartbeat from core client for 30 sec - exiting 16:24:29 (6820): No heartbeat from core client for 30 sec - exiting 16:24:30 (6820): No heartbeat from core client for 30 sec - exiting 16:24:31 (6820): No heartbeat from core client for 30 sec - exiting 16:24:32 (6820): No heartbeat from core client for 30 sec - exiting 16:24:33 (6820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:33:13 (6940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:33:14 (6940): No heartbeat from core client for 30 sec - exiting 17:33:57 (2856): No heartbeat from core client for 30 sec - exiting 17:33:58 (2856): No heartbeat from core client for 30 sec - exiting 17:33:59 (2856): No heartbeat from core client for 30 sec - exiting 17:34:00 (2856): No heartbeat from core client for 30 sec - exiting 17:34:01 (2856): No heartbeat from core client for 30 sec - exiting 17:34:02 (2856): No heartbeat from core client for 30 sec - exiting 17:34:03 (2856): No heartbeat from core client for 30 sec - exiting 17:34:04 (2856): No heartbeat from core client for 30 sec - exiting 17:34:05 (2856): No heartbeat from core client for 30 sec - exiting 17:34:06 (2856): No heartbeat from core client for 30 sec - exiting 17:34:07 (2856): No heartbeat from core client for 30 sec - exiting 17:34:08 (2856): No heartbeat from core client for 30 sec - exiting 17:34:09 (2856): No heartbeat from core client for 30 sec - exiting 17:34:10 (2856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Abort request from BOINC... Regional yearly means requires 12 input files got 9 Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
31 Jul 2011 20:26:54	933499	13156504	hadam3p_pnw_35jo_1990_1_007368882_0	103,782	316,967	3.0542
31 Jul 2011 19:28:47	933499	13156504	hadam3p_pnw_35jo_1990_1_007368882_0	103,776	316,558	3.0504
31 Jul 2011 08:37:50	933499	13156504	hadam3p_pnw_35jo_1990_1_007368882_0	92,256	282,669	3.0640
30 Jul 2011 03:34:08	933499	13156504	hadam3p_pnw_35jo_1990_1_007368882_0	80,736	248,235	3.0747
29 Jul 2011 17:42:07	933499	13156504	hadam3p_pnw_35jo_1990_1_007368882_0	69,216	212,966	3.0768
29 Jul 2011 07:04:47	933499	13156504	hadam3p_pnw_35jo_1990_1_007368882_0	57,696	177,934	3.0840
28 Jul 2011 20:25:00	933499	13156504	hadam3p_pnw_35jo_1990_1_007368882_0	46,176	142,543	3.0869
28 Jul 2011 10:00:40	933499	13156504	hadam3p_pnw_35jo_1990_1_007368882_0	34,656	107,382	3.0985
28 Jul 2011 00:14:55	933499	13156504	hadam3p_pnw_35jo_1990_1_007368882_0	23,139	71,813	3.1035
27 Jul 2011 23:12:11	933499	13156504	hadam3p_pnw_35jo_1990_1_007368882_0	23,136	71,385	3.0855
27 Jul 2011 09:16:36	933499	13156504	hadam3p_pnw_35jo_1990_1_007368882_0	11,616	35,728	3.0758