Task 18387418

Name	hadam3p_pnw_e4ty_2011_1_009815787_0
Workunit	9871731
Created	28 Apr 2015, 9:22:10 UTC
Sent	28 Apr 2015, 11:12:27 UTC
Report deadline	9 Apr 2016, 16:32:27 UTC
Received	13 May 2015, 21:14:12 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
Computer ID	804413
Run time	3 days 6 hours 57 min 51 sec
CPU time	3 days 6 hours 57 min 51 sec
Validate state	Invalid
Credit	2,509.66
Device peak FLOPS	2.99 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v7.22 windows_intelx86
Stderr	<core_client_version>6.2.19</core_client_version> <![CDATA[ <message> too many exit(0)s </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 19:39:22 (3188): No heartbeat from client for 30 sec - exiting 19:39:22 (3188): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:41:11 (4856): No heartbeat from client for 30 sec - exiting 19:41:11 (4856): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:43:01 (4316): No heartbeat from client for 30 sec - exiting 19:43:01 (4316): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:44:50 (3500): No heartbeat from client for 30 sec - exiting 19:44:50 (3500): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:46:38 (3476): No heartbeat from client for 30 sec - exiting 19:46:38 (3476): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2076, selfPID=2076, iMonCtr=2 19:48:28 (4876): No heartbeat from client for 30 sec - exiting 19:48:28 (4876): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:50:16 (4580): No heartbeat from client for 30 sec - exiting 19:50:16 (4580): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:52:05 (4844): No heartbeat from client for 30 sec - exiting 19:52:05 (4844): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:53:54 (4160): No heartbeat from client for 30 sec - exiting 19:53:54 (4160): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:55:43 (4368): No heartbeat from client for 30 sec - exiting 19:55:43 (4368): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:57:32 (4884): No heartbeat from client for 30 sec - exiting 19:57:32 (4884): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:59:21 (4964): No heartbeat from client for 30 sec - exiting 19:59:21 (4964): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:01:10 (2632): No heartbeat from client for 30 sec - exiting 20:01:10 (2632): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:02:58 (3264): No heartbeat from client for 30 sec - exiting 20:02:58 (3264): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:04:48 (4712): No heartbeat from client for 30 sec - exiting 20:04:48 (4712): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:10:15 (5000): No heartbeat from client for 30 sec - exiting 20:10:15 (5000): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:12:04 (3644): No heartbeat from client for 30 sec - exiting 20:12:04 (3644): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:15:31 (4360): No heartbeat from client for 30 sec - exiting 20:15:31 (4360): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:16:32 (4868): No heartbeat from client for 30 sec - exiting 20:16:32 (4868): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:17:20 (2188): No heartbeat from client for 30 sec - exiting 20:17:20 (2188): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:18:20 (4608): No heartbeat from client for 30 sec - exiting 20:18:20 (4608): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:20:09 (4196): No heartbeat from client for 30 sec - exiting 20:20:09 (4196): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4656, selfPID=4656, iMonCtr=2 20:21:58 (4528): No heartbeat from client for 30 sec - exiting 20:21:58 (4528): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:22:59 (4176): No heartbeat from client for 30 sec - exiting 20:22:59 (4176): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:23:47 (4720): No heartbeat from client for 30 sec - exiting 20:23:47 (4720): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:24:48 (4352): No heartbeat from client for 30 sec - exiting 20:24:48 (4352): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:25:36 (4940): No heartbeat from client for 30 sec - exiting 20:25:36 (4940): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:28:26 (4960): No heartbeat from client for 30 sec - exiting 20:28:26 (4960): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:30:14 (2532): No heartbeat from client for 30 sec - exiting 20:30:14 (2532): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:31:15 (4240): No heartbeat from client for 30 sec - exiting 20:31:15 (4240): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:32:04 (5212): No heartbeat from client for 30 sec - exiting 20:32:04 (5212): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:33:53 (5496): No heartbeat from client for 30 sec - exiting 20:33:53 (5496): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:34:53 (2808): No heartbeat from client for 30 sec - exiting 20:34:53 (2808): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:36:42 (5140): No heartbeat from client for 30 sec - exiting 20:36:42 (5140): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:38:31 (5736): No heartbeat from client for 30 sec - exiting 20:38:31 (5736): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5964, selfPID=5964, iMonCtr=2 20:39:32 (5780): No heartbeat from client for 30 sec - exiting 20:39:32 (5780): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:40:20 (5564): No heartbeat from client for 30 sec - exiting 20:40:20 (5564): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:41:21 (6008): No heartbeat from client for 30 sec - exiting 20:41:21 (6008): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:42:09 (5460): No heartbeat from client for 30 sec - exiting 20:42:09 (5460): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:43:10 (5776): No heartbeat from client for 30 sec - exiting 20:43:10 (5776): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:44:59 (5968): No heartbeat from client for 30 sec - exiting 20:44:59 (5968): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3096, selfPID=3096, iMonCtr=2 20:46:48 (5148): No heartbeat from client for 30 sec - exiting 20:46:48 (5148): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:47:48 (5548): No heartbeat from client for 30 sec - exiting 20:47:48 (5548): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:48:37 (5308): No heartbeat from client for 30 sec - exiting 20:48:37 (5308): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:49:37 (3004): No heartbeat from client for 30 sec - exiting 20:49:37 (3004): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:50:25 (5416): No heartbeat from client for 30 sec - exiting 20:50:25 (5416): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5816, selfPID=5816, iMonCtr=2 20:51:26 (3752): No heartbeat from client for 30 sec - exiting 20:51:26 (3752): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6108, selfPID=6108, iMonCtr=2 20:53:15 (6024): No heartbeat from client for 30 sec - exiting 20:53:15 (6024): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:55:03 (5964): No heartbeat from client for 30 sec - exiting 20:55:03 (5964): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:56:52 (3120): No heartbeat from client for 30 sec - exiting 20:56:52 (3120): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:57:53 (5128): No heartbeat from client for 30 sec - exiting 20:57:53 (5128): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:58:41 (6124): No heartbeat from client for 30 sec - exiting 20:58:41 (6124): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:59:42 (5652): No heartbeat from client for 30 sec - exiting 20:59:42 (5652): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:01:31 (5608): No heartbeat from client for 30 sec - exiting 21:01:31 (5608): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:03:19 (4216): No heartbeat from client for 30 sec - exiting 21:03:19 (4216): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:05:09 (3096): No heartbeat from client for 30 sec - exiting 21:05:09 (3096): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:06:10 (5724): No heartbeat from client for 30 sec - exiting 21:06:10 (5724): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:06:58 (5804): No heartbeat from client for 30 sec - exiting 21:06:58 (5804): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:07:59 (5152): No heartbeat from client for 30 sec - exiting 21:07:59 (5152): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:09:47 (5400): No heartbeat from client for 30 sec - exiting 21:09:47 (5400): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:11:36 (6112): No heartbeat from client for 30 sec - exiting 21:11:36 (6112): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:12:37 (6224): No heartbeat from client for 30 sec - exiting 21:12:37 (6224): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:13:25 (6516): No heartbeat from client for 30 sec - exiting 21:13:25 (6516): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6668, selfPID=6668, iMonCtr=2 21:14:25 (6804): No heartbeat from client for 30 sec - exiting 21:14:25 (6804): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:15:15 (5236): No heartbeat from client for 30 sec - exiting 21:15:15 (5236): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:16:15 (6464): No heartbeat from client for 30 sec - exiting 21:16:15 (6464): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6732, selfPID=6732, iMonCtr=2 21:18:03 (6716): No heartbeat from client for 30 sec - exiting 21:18:03 (6716): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:19:53 (6796): No heartbeat from client for 30 sec - exiting 21:19:53 (6796): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:20:53 (6504): No heartbeat from client for 30 sec - exiting 21:20:53 (6504): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:22:42 (6620): No heartbeat from client for 30 sec - exiting 21:22:42 (6620): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:24:31 (7128): No heartbeat from client for 30 sec - exiting 21:24:31 (7128): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:26:20 (6368): No heartbeat from client for 30 sec - exiting 21:26:20 (6368): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:28:09 (6496): No heartbeat from client for 30 sec - exiting 21:28:09 (6496): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:29:10 (6432): No heartbeat from client for 30 sec - exiting 21:29:10 (6432): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6584, selfPID=6584, iMonCtr=2 21:29:57 (4840): No heartbeat from client for 30 sec - exiting 21:29:57 (4840): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6460, selfPID=6460, iMonCtr=2 21:30:59 (6740): No heartbeat from client for 30 sec - exiting 21:30:59 (6740): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:31:47 (6148): No heartbeat from client for 30 sec - exiting 21:31:47 (6148): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:32:48 (6328): No heartbeat from client for 30 sec - exiting 21:32:48 (6328): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:34:37 (6752): No heartbeat from client for 30 sec - exiting 21:34:37 (6752): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:36:25 (6448): No heartbeat from client for 30 sec - exiting 21:36:25 (6448): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:37:26 (5656): No heartbeat from client for 30 sec - exiting 21:37:26 (5656): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:38:15 (6696): No heartbeat from client for 30 sec - exiting 21:38:15 (6696): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:40:03 (6292): No heartbeat from client for 30 sec - exiting 21:40:03 (6292): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:42:53 (6888): No heartbeat from client for 30 sec - exiting 21:42:53 (6888): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:44:42 (4208): No heartbeat from client for 30 sec - exiting 21:44:42 (4208): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:45:42 (6168): No heartbeat from client for 30 sec - exiting 21:45:42 (6168): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:46:31 (7080): No heartbeat from client for 30 sec - exiting 21:46:31 (7080): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:47:31 (5800): No heartbeat from client for 30 sec - exiting 21:47:31 (5800): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:48:20 (7072): No heartbeat from client for 30 sec - exiting 21:48:20 (7072): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:49:20 (5796): No heartbeat from client for 30 sec - exiting 21:49:20 (5796): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:51:09 (6220): No heartbeat from client for 30 sec - exiting 21:51:09 (6220): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:52:58 (7052): No heartbeat from client for 30 sec - exiting 21:52:58 (7052): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:53:59 (7428): No heartbeat from client for 30 sec - exiting 21:53:59 (7428): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7612, selfPID=7612, iMonCtr=2 21:55:36 (7812): No heartbeat from client for 30 sec - exiting 21:55:36 (7812): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:56:26 (8188): No heartbeat from client for 30 sec - exiting 21:56:26 (8188): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:57:25 (7016): No heartbeat from client for 30 sec - exiting 21:57:25 (7016): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:59:15 (7884): No heartbeat from client for 30 sec - exiting 21:59:15 (7884): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8080, selfPID=8080, iMonCtr=2 22:01:03 (8164): No heartbeat from client for 30 sec - exiting 22:01:03 (8164): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:02:42 (6972): No heartbeat from client for 30 sec - exiting 22:02:42 (6972): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:03:41 (6764): No heartbeat from client for 30 sec - exiting 22:03:41 (6764): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:04:30 (8168): No heartbeat from client for 30 sec - exiting 22:04:30 (8168): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8012, selfPID=8012, iMonCtr=2 </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
13 May 2015 21:15:05	804413	18387418	hadam3p_pnw_e4ty_2011_1_009815787_0	115,499	279,510	2.4200
13 May 2015 21:15:04	804413	18387418	hadam3p_pnw_e4ty_2011_1_009815787_0	103,979	252,109	2.4246
12 May 2015 09:59:44	804413	18387418	hadam3p_pnw_e4ty_2011_1_009815787_0	92,459	224,661	2.4298
12 May 2015 08:59:19	804413	18387418	hadam3p_pnw_e4ty_2011_1_009815787_0	80,939	197,220	2.4366
12 May 2015 08:59:19	804413	18387418	hadam3p_pnw_e4ty_2011_1_009815787_0	69,419	169,635	2.4436
12 May 2015 08:59:19	804413	18387418	hadam3p_pnw_e4ty_2011_1_009815787_0	57,899	141,617	2.4459
11 May 2015 02:18:35	804413	18387418	hadam3p_pnw_e4ty_2011_1_009815787_0	46,379	113,468	2.4465
10 May 2015 18:25:45	804413	18387418	hadam3p_pnw_e4ty_2011_1_009815787_0	34,859	85,283	2.4465
10 May 2015 10:34:26	804413	18387418	hadam3p_pnw_e4ty_2011_1_009815787_0	23,339	57,034	2.4437
10 May 2015 02:46:17	804413	18387418	hadam3p_pnw_e4ty_2011_1_009815787_0	11,819	28,739	2.4316