Task 16298749

Name	hadam3p_eu_a0m7_2013_1_008517140_0
Workunit	8664652
Created	3 Mar 2014, 11:33:44 UTC
Sent	3 Mar 2014, 11:35:12 UTC
Report deadline	13 Feb 2015, 16:55:12 UTC
Received	10 Mar 2014, 21:37:25 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
Computer ID	1314929
Run time	2 days 8 hours 1 min 10 sec
CPU time	2 days 5 hours 57 min 12 sec
Validate state	Invalid
Credit	1,988.94
Device peak FLOPS	3.57 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>7.2.33</core_client_version> <![CDATA[ <message> too many exit(0)s </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7232, selfPID=8028, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:56:45 (6000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:56:46 (6000): No heartbeat from core client for 30 sec - exiting 09:58:23 (6640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:58:24 (6640): No heartbeat from core client for 30 sec - exiting 09:59:59 (4684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:00:00 (4684): No heartbeat from core client for 30 sec - exiting 10:01:39 (6248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:01:40 (6248): No heartbeat from core client for 30 sec - exiting 10:03:15 (6116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:03:16 (6116): No heartbeat from core client for 30 sec - exiting 10:04:54 (720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:04:55 (720): No heartbeat from core client for 30 sec - exiting 10:06:30 (4604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:06:31 (4604): No heartbeat from core client for 30 sec - exiting 10:08:08 (6676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:08:09 (6676): No heartbeat from core client for 30 sec - exiting 10:09:48 (5052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:09:49 (5052): No heartbeat from core client for 30 sec - exiting 10:11:25 (3456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:11:26 (3456): No heartbeat from core client for 30 sec - exiting 10:12:57 (6108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:12:58 (6108): No heartbeat from core client for 30 sec - exiting 10:14:29 (140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:14:30 (140): No heartbeat from core client for 30 sec - exiting 10:16:05 (6616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:16:06 (6616): No heartbeat from core client for 30 sec - exiting 10:17:44 (1488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:17:45 (1488): No heartbeat from core client for 30 sec - exiting 10:19:19 (5308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:19:20 (5308): No heartbeat from core client for 30 sec - exiting 10:20:54 (6716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:20:55 (6716): No heartbeat from core client for 30 sec - exiting 10:22:30 (5160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:22:31 (5160): No heartbeat from core client for 30 sec - exiting 10:24:07 (3004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:24:08 (3004): No heartbeat from core client for 30 sec - exiting 10:25:43 (1268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:25:44 (1268): No heartbeat from core client for 30 sec - exiting 10:27:19 (6328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:27:20 (6328): No heartbeat from core client for 30 sec - exiting 10:28:53 (7012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:28:54 (7012): No heartbeat from core client for 30 sec - exiting 10:30:29 (6648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:30:30 (6648): No heartbeat from core client for 30 sec - exiting 10:32:04 (6952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:32:05 (6952): No heartbeat from core client for 30 sec - exiting 10:33:41 (3304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:33:42 (3304): No heartbeat from core client for 30 sec - exiting 10:35:15 (4252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:35:16 (4252): No heartbeat from core client for 30 sec - exiting 10:36:49 (6796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:36:50 (6796): No heartbeat from core client for 30 sec - exiting 10:38:25 (5776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:38:26 (5776): No heartbeat from core client for 30 sec - exiting 10:40:00 (4296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:40:01 (4296): No heartbeat from core client for 30 sec - exiting 10:41:36 (5444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:41:37 (5444): No heartbeat from core client for 30 sec - exiting 10:43:12 (6588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:43:13 (6588): No heartbeat from core client for 30 sec - exiting 10:44:49 (2996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:44:50 (2996): No heartbeat from core client for 30 sec - exiting 10:46:24 (6924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:46:25 (6924): No heartbeat from core client for 30 sec - exiting 10:47:59 (6780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:48:00 (6780): No heartbeat from core client for 30 sec - exiting 10:49:36 (6592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:49:37 (6592): No heartbeat from core client for 30 sec - exiting 10:51:13 (6836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:51:14 (6836): No heartbeat from core client for 30 sec - exiting 10:52:49 (5992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:52:50 (5992): No heartbeat from core client for 30 sec - exiting 10:54:23 (6328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:54:24 (6328): No heartbeat from core client for 30 sec - exiting 10:56:00 (6928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:56:01 (6928): No heartbeat from core client for 30 sec - exiting 10:57:37 (6860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:57:38 (6860): No heartbeat from core client for 30 sec - exiting 10:59:13 (3548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:59:14 (3548): No heartbeat from core client for 30 sec - exiting 11:00:49 (6408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:00:50 (6408): No heartbeat from core client for 30 sec - exiting 11:02:25 (6152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:02:26 (6152): No heartbeat from core client for 30 sec - exiting 11:04:06 (4948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:04:07 (4948): No heartbeat from core client for 30 sec - exiting 11:05:43 (3976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:05:44 (3976): No heartbeat from core client for 30 sec - exiting 11:07:19 (4984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:07:20 (4984): No heartbeat from core client for 30 sec - exiting 11:08:56 (5792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:08:57 (5792): No heartbeat from core client for 30 sec - exiting 11:10:33 (1760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:10:34 (1760): No heartbeat from core client for 30 sec - exiting 11:12:07 (6012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:12:08 (6012): No heartbeat from core client for 30 sec - exiting 11:13:42 (6428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:13:43 (6428): No heartbeat from core client for 30 sec - exiting 11:15:20 (4008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:15:21 (4008): No heartbeat from core client for 30 sec - exiting 11:16:56 (4080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:16:57 (4080): No heartbeat from core client for 30 sec - exiting 11:18:30 (6092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:18:31 (6092): No heartbeat from core client for 30 sec - exiting 11:20:06 (6672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:20:07 (6672): No heartbeat from core client for 30 sec - exiting 11:21:41 (6040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:21:42 (6040): No heartbeat from core client for 30 sec - exiting 11:23:18 (3892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:23:19 (3892): No heartbeat from core client for 30 sec - exiting 11:24:54 (7128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:24:55 (7128): No heartbeat from core client for 30 sec - exiting 11:26:29 (6692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:26:30 (6692): No heartbeat from core client for 30 sec - exiting 11:28:08 (204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:28:09 (204): No heartbeat from core client for 30 sec - exiting 11:29:42 (4776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:29:43 (4776): No heartbeat from core client for 30 sec - exiting 11:31:20 (5116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:31:21 (5116): No heartbeat from core client for 30 sec - exiting 11:33:02 (6124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:33:03 (6124): No heartbeat from core client for 30 sec - exiting 11:34:45 (4656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:34:46 (4656): No heartbeat from core client for 30 sec - exiting 11:36:32 (6536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:36:33 (6536): No heartbeat from core client for 30 sec - exiting 11:38:15 (6380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:38:16 (6380): No heartbeat from core client for 30 sec - exiting 11:39:57 (7060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:39:58 (7060): No heartbeat from core client for 30 sec - exiting 11:41:35 (6124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:41:36 (6124): No heartbeat from core client for 30 sec - exiting 11:43:14 (5948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:43:15 (5948): No heartbeat from core client for 30 sec - exiting 11:44:51 (6788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:44:52 (6788): No heartbeat from core client for 30 sec - exiting 11:46:31 (4688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:46:32 (4688): No heartbeat from core client for 30 sec - exiting 11:48:08 (6616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:48:09 (6616): No heartbeat from core client for 30 sec - exiting 11:49:49 (6752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:49:50 (6752): No heartbeat from core client for 30 sec - exiting 11:51:31 (5588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:51:33 (5588): No heartbeat from core client for 30 sec - exiting 11:53:11 (6076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:53:12 (6076): No heartbeat from core client for 30 sec - exiting 11:54:50 (3300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:54:52 (3300): No heartbeat from core client for 30 sec - exiting 11:56:30 (1396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:56:31 (1396): No heartbeat from core client for 30 sec - exiting 11:58:07 (6572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:58:08 (6572): No heartbeat from core client for 30 sec - exiting 11:59:46 (6740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:59:47 (6740): No heartbeat from core client for 30 sec - exiting 12:01:24 (6736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:01:25 (6736): No heartbeat from core client for 30 sec - exiting 12:03:09 (4948): No heartbeat from core client for 30 sec - exiting 12:03:10 (4948): No heartbeat from core client for 30 sec - exiting 12:03:11 (4948): No heartbeat from core client for 30 sec - exiting 12:03:12 (4948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:03:14 (4948): No heartbeat from core client for 30 sec - exiting 12:04:59 (6744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:05:01 (6744): No heartbeat from core client for 30 sec - exiting 12:06:45 (5536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:06:46 (5536): No heartbeat from core client for 30 sec - exiting 12:08:28 (6420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:08:29 (6420): No heartbeat from core client for 30 sec - exiting 12:10:10 (6792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:10:11 (6792): No heartbeat from core client for 30 sec - exiting 12:11:53 (1772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:11:54 (1772): No heartbeat from core client for 30 sec - exiting 12:13:37 (6736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:13:38 (6736): No heartbeat from core client for 30 sec - exiting 12:15:20 (3880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:15:22 (3880): No heartbeat from core client for 30 sec - exiting 12:17:04 (6556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:17:05 (6556): No heartbeat from core client for 30 sec - exiting 12:18:46 (6800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:18:47 (6800): No heartbeat from core client for 30 sec - exiting 12:20:30 (5528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:20:31 (5528): No heartbeat from core client for 30 sec - exiting 12:22:15 (7124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:22:16 (7124): No heartbeat from core client for 30 sec - exiting 12:23:58 (4020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:23:59 (4020): No heartbeat from core client for 30 sec - exiting 12:25:42 (1488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:25:43 (1488): No heartbeat from core client for 30 sec - exiting 12:27:24 (1144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:27:26 (1144): No heartbeat from core client for 30 sec - exiting 12:29:06 (6432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:29:07 (6432): No heartbeat from core client for 30 sec - exiting 12:30:48 (5184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:30:49 (5184): No heartbeat from core client for 30 sec - exiting 12:32:32 (2144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:32:33 (2144): No heartbeat from core client for 30 sec - exiting 12:34:15 (6228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:34:18 (6228): No heartbeat from core client for 30 sec - exiting 12:36:14 (6328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:36:15 (6328): No heartbeat from core client for 30 sec - exiting 12:38:03 (6236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:38:04 (6236): No heartbeat from core client for 30 sec - exiting 12:39:52 (4876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:39:53 (4876): No heartbeat from core client for 30 sec - exiting 12:41:37 (2008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:41:38 (2008): No heartbeat from core client for 30 sec - exiting </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
09 Mar 2014 23:22:05	1314929	16298749	hadam3p_eu_a0m7_2013_1_008517140_0	115,296	189,865	1.6468
09 Mar 2014 01:13:33	1314929	16298749	hadam3p_eu_a0m7_2013_1_008517140_0	103,776	171,380	1.6514
08 Mar 2014 13:41:52	1314929	16298749	hadam3p_eu_a0m7_2013_1_008517140_0	92,256	152,393	1.6518
06 Mar 2014 11:39:36	1314929	16298749	hadam3p_eu_a0m7_2013_1_008517140_0	80,736	134,133	1.6614
05 Mar 2014 21:03:48	1314929	16298749	hadam3p_eu_a0m7_2013_1_008517140_0	69,216	115,952	1.6752
05 Mar 2014 15:13:15	1314929	16298749	hadam3p_eu_a0m7_2013_1_008517140_0	57,696	97,830	1.6956
04 Mar 2014 22:15:16	1314929	16298749	hadam3p_eu_a0m7_2013_1_008517140_0	46,176	79,108	1.7132
04 Mar 2014 17:12:27	1314929	16298749	hadam3p_eu_a0m7_2013_1_008517140_0	34,656	59,438	1.7151
03 Mar 2014 23:42:32	1314929	16298749	hadam3p_eu_a0m7_2013_1_008517140_0	23,136	38,350	1.6576
03 Mar 2014 18:00:56	1314929	16298749	hadam3p_eu_a0m7_2013_1_008517140_0	11,616	18,165	1.5638