Task 16716608

Name	hadam3p_eu_n3mj_2013_1_008799195_0
Workunit	8945173
Created	7 Jul 2014, 15:16:59 UTC
Sent	4 Aug 2014, 8:08:29 UTC
Report deadline	17 Jul 2015, 13:28:29 UTC
Received	16 Sep 2014, 8:16:46 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	197 (0x000000C5) EXIT_TIME_LIMIT_EXCEEDED
Computer ID	1277339
Run time	29 days 4 hours 23 min 24 sec
CPU time	8 hours 28 min 36 sec
Validate state	Invalid
Credit	200.38
Device peak FLOPS	3.01 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <message> Maximum elapsed time exceeded </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 07:31:08 (5484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:31:10 (5484): No heartbeat from core client for 30 sec - exiting 07:31:11 (5484): No heartbeat from core client for 30 sec - exiting 07:31:12 (5484): No heartbeat from core client for 30 sec - exiting 07:31:13 (5484): No heartbeat from core client for 30 sec - exiting 07:31:14 (5484): No heartbeat from core client for 30 sec - exiting 07:31:15 (5484): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:40:41 (9696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:40:45 (9696): No heartbeat from core client for 30 sec - exiting 23:40:46 (9696): No heartbeat from core client for 30 sec - exiting 23:40:47 (9696): No heartbeat from core client for 30 sec - exiting 23:40:48 (9696): No heartbeat from core client for 30 sec - exiting 23:40:49 (9696): No heartbeat from core client for 30 sec - exiting 23:40:50 (9696): No heartbeat from core client for 30 sec - exiting 23:40:51 (9696): No heartbeat from core client for 30 sec - exiting 23:40:52 (9696): No heartbeat from core client for 30 sec - exiting 23:40:53 (9696): No heartbeat from core client for 30 sec - exiting 23:40:54 (9696): No heartbeat from core client for 30 sec - exiting 23:40:55 (9696): No heartbeat from core client for 30 sec - exiting 23:40:56 (9696): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 15:34:38 (6888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:34:40 (6888): No heartbeat from core client for 30 sec - exiting 15:34:41 (6888): No heartbeat from core client for 30 sec - exiting 15:34:42 (6888): No heartbeat from core client for 30 sec - exiting 15:34:43 (6888): No heartbeat from core client for 30 sec - exiting 15:34:44 (6888): No heartbeat from core client for 30 sec - exiting 15:34:45 (6888): No heartbeat from core client for 30 sec - exiting 15:34:46 (6888): No heartbeat from core client for 30 sec - exiting 15:34:47 (6888): No heartbeat from core client for 30 sec - exiting 15:34:48 (6888): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11120, selfPID=9168, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4940, selfPID=11228, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:12:17 (8880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:31:17 (1340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:31:18 (1340): No heartbeat from core client for 30 sec - exiting 00:31:19 (1340): No heartbeat from core client for 30 sec - exiting 00:31:20 (1340): No heartbeat from core client for 30 sec - exiting 00:31:21 (1340): No heartbeat from core client for 30 sec - exiting 00:31:22 (1340): No heartbeat from core client for 30 sec - exiting 00:31:23 (1340): No heartbeat from core client for 30 sec - exiting 00:31:24 (1340): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:57:12 (4944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:20:38 (7772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:48:46 (8800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:48:48 (8800): No heartbeat from core client for 30 sec - exiting 00:48:49 (8800): No heartbeat from core client for 30 sec - exiting 00:48:50 (8800): No heartbeat from core client for 30 sec - exiting 00:48:51 (8800): No heartbeat from core client for 30 sec - exiting 00:48:52 (8800): No heartbeat from core client for 30 sec - exiting 00:48:53 (8800): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:53:06 (12156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:53:13 (12156): No heartbeat from core client for 30 sec - exiting 08:53:14 (12156): No heartbeat from core client for 30 sec - exiting 08:53:15 (12156): No heartbeat from core client for 30 sec - exiting 08:53:16 (12156): No heartbeat from core client for 30 sec - exiting 08:53:17 (12156): No heartbeat from core client for 30 sec - exiting 08:53:18 (12156): No heartbeat from core client for 30 sec - exiting 08:53:19 (12156): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:34:13 (6104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:34:15 (6104): No heartbeat from core client for 30 sec - exiting 08:34:16 (6104): No heartbeat from core client for 30 sec - exiting 08:34:17 (6104): No heartbeat from core client for 30 sec - exiting 08:34:18 (6104): No heartbeat from core client for 30 sec - exiting 08:34:19 (6104): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:45:58 (9792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:57:45 (10600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:57:47 (10600): No heartbeat from core client for 30 sec - exiting 10:57:48 (10600): No heartbeat from core client for 30 sec - exiting 10:57:49 (10600): No heartbeat from core client for 30 sec - exiting 10:57:50 (10600): No heartbeat from core client for 30 sec - exiting 10:57:51 (10600): No heartbeat from core client for 30 sec - exiting 10:57:52 (10600): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:45:26 (7796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:45:28 (7796): No heartbeat from core client for 30 sec - exiting 00:45:29 (7796): No heartbeat from core client for 30 sec - exiting 00:45:30 (7796): No heartbeat from core client for 30 sec - exiting 00:45:31 (7796): No heartbeat from core client for 30 sec - exiting 00:45:32 (7796): No heartbeat from core client for 30 sec - exiting 00:45:33 (7796): No heartbeat from core client for 30 sec - exiting 00:45:34 (7796): No heartbeat from core client for 30 sec - exiting 00:45:35 (7796): No heartbeat from core client for 30 sec - exiting 00:45:36 (7796): No heartbeat from core client for 30 sec - exiting 00:45:37 (7796): No heartbeat from core client for 30 sec - exiting 00:45:38 (7796): No heartbeat from core client for 30 sec - exiting 00:45:39 (7796): No heartbeat from core client for 30 sec - exiting 00:45:40 (7796): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:40:44 (5188): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 08:40:47 (5188): No heartbeat from core client for 30 sec - exiting 08:40:48 (5188): No heartbeat from core client for 30 sec - exiting 08:40:49 (5188): No heartbeat from core client for 30 sec - exiting 08:40:50 (5188): No heartbeat from core client for 30 sec - exiting 08:40:51 (5188): No heartbeat from core client for 30 sec - exiting 08:40:52 (5188): No heartbeat from core client for 30 sec - exiting 08:40:53 (5188): No heartbeat from core client for 30 sec - exiting 08:40:54 (5188): No heartbeat from core client for 30 sec - exiting 08:40:55 (5188): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 22:49:22 (9436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:49:24 (9436): No heartbeat from core client for 30 sec - exiting 22:49:25 (9436): No heartbeat from core client for 30 sec - exiting 22:49:26 (9436): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:07:51 (3548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:07:53 (3548): No heartbeat from core client for 30 sec - exiting 00:07:55 (3548): No heartbeat from core client for 30 sec - exiting 00:07:56 (3548): No heartbeat from core client for 30 sec - exiting 00:07:57 (3548): No heartbeat from core client for 30 sec - exiting 00:07:58 (3548): No heartbeat from core client for 30 sec - exiting 00:07:59 (3548): No heartbeat from core client for 30 sec - exiting 00:08:00 (3548): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:38:08 (7868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:27:47 (10440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:27:49 (10440): No heartbeat from core client for 30 sec - exiting 08:27:50 (10440): No heartbeat from core client for 30 sec - exiting 08:27:51 (10440): No heartbeat from core client for 30 sec - exiting 08:27:52 (10440): No heartbeat from core client for 30 sec - exiting 08:27:53 (10440): No heartbeat from core client for 30 sec - exiting 08:27:54 (10440): No heartbeat from core client for 30 sec - exiting 08:27:55 (10440): No heartbeat from core client for 30 sec - exiting 08:27:56 (10440): No heartbeat from core client for 30 sec - exiting 08:27:57 (10440): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:44:51 (12040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:44:53 (12040): No heartbeat from core client for 30 sec - exiting 14:44:54 (12040): No heartbeat from core client for 30 sec - exiting 14:44:55 (12040): No heartbeat from core client for 30 sec - exiting 14:44:56 (12040): No heartbeat from core client for 30 sec - exiting 14:44:57 (12040): No heartbeat from core client for 30 sec - exiting 14:44:58 (12040): No heartbeat from core client for 30 sec - exiting 14:44:59 (12040): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 18:09:26 (9880): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:10:11 (4752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:10:13 (4752): No heartbeat from core client for 30 sec - exiting 16:10:14 (4752): No heartbeat from core client for 30 sec - exiting 16:10:15 (4752): No heartbeat from core client for 30 sec - exiting 16:10:16 (4752): No heartbeat from core client for 30 sec - exiting 16:10:17 (4752): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Abort request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
04 Sep 2014 02:29:41	1277339	16716608	hadam3p_eu_n3mj_2013_1_008799195_0	11,616	20,763	1.7874