Task 15492649

Name	hadcm3n_39lo_1940_40_008263833_0
Workunit	8418957
Created	21 Dec 2012, 6:42:23 UTC
Sent	21 Dec 2012, 6:53:25 UTC
Report deadline	22 Mar 2013, 14:20:36 UTC
Received	25 Jan 2013, 6:29:47 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1247067
Run time	6 days 23 hours 58 min 56 sec
CPU time	6 days 4 hours 54 min 11 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.45 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:44:27 (6168): No heartbeat from core client for 30 sec - exiting 12:44:28 (6168): No heartbeat from core client for 30 sec - exiting 12:44:29 (6168): No heartbeat from core client for 30 sec - exiting 12:44:30 (6168): No heartbeat from core client for 30 sec - exiting 12:44:31 (6168): No heartbeat from core client for 30 sec - exiting 12:44:32 (6168): No heartbeat from core client for 30 sec - exiting 12:44:33 (6168): No heartbeat from core client for 30 sec - exiting 12:44:34 (6168): No heartbeat from core client for 30 sec - exiting 12:44:35 (6168): No heartbeat from core client for 30 sec - exiting 12:44:36 (6168): No heartbeat from core client for 30 sec - exiting 12:44:37 (6168): No heartbeat from core client for 30 sec - exiting 12:44:38 (6168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:02:21 (2492): No heartbeat from core client for 30 sec - exiting 12:02:22 (2492): No heartbeat from core client for 30 sec - exiting 12:02:23 (2492): No heartbeat from core client for 30 sec - exiting 12:02:24 (2492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:04:31 (22868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:33:56 (89928): No heartbeat from core client for 30 sec - exiting 16:33:57 (89928): No heartbeat from core client for 30 sec - exiting 16:33:58 (89928): No heartbeat from core client for 30 sec - exiting 16:33:59 (89928): No heartbeat from core client for 30 sec - exiting 16:34:00 (89928): No heartbeat from core client for 30 sec - exiting 16:34:01 (89928): No heartbeat from core client for 30 sec - exiting 16:34:02 (89928): No heartbeat from core client for 30 sec - exiting 16:34:03 (89928): No heartbeat from core client for 30 sec - exiting 16:34:04 (89928): No heartbeat from core client for 30 sec - exiting 16:34:05 (89928): No heartbeat from core client for 30 sec - exiting 16:34:06 (89928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:36:13 (107096): No heartbeat from core client for 30 sec - exiting 21:36:14 (107096): No heartbeat from core client for 30 sec - exiting 21:36:15 (107096): No heartbeat from core client for 30 sec - exiting 21:36:16 (107096): No heartbeat from core client for 30 sec - exiting 21:36:17 (107096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 11:26:02 (158956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:38:47 (9016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 15:19:54 (9020): No heartbeat from core client for 30 sec - exiting 15:19:55 (9020): No heartbeat from core client for 30 sec - exiting 15:19:56 (9020): No heartbeat from core client for 30 sec - exiting 15:19:57 (9020): No heartbeat from core client for 30 sec - exiting 15:19:58 (9020): No heartbeat from core client for 30 sec - exiting 15:19:59 (9020): No heartbeat from core client for 30 sec - exiting 15:20:00 (9020): No heartbeat from core client for 30 sec - exiting 15:20:01 (9020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 23:05:04 (6772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 12:14:30 (7272): No heartbeat from core client for 30 sec - exiting 12:14:31 (7272): No heartbeat from core client for 30 sec - exiting 12:14:32 (7272): No heartbeat from core client for 30 sec - exiting 12:14:33 (7272): No heartbeat from core client for 30 sec - exiting 12:14:34 (7272): No heartbeat from core client for 30 sec - exiting 12:14:35 (7272): No heartbeat from core client for 30 sec - exiting 12:14:36 (7272): No heartbeat from core client for 30 sec - exiting 12:14:37 (7272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:54:19 (4220): No heartbeat from core client for 30 sec - exiting 12:54:21 (4220): No heartbeat from core client for 30 sec - exiting 12:54:22 (4220): No heartbeat from core client for 30 sec - exiting 12:54:23 (4220): No heartbeat from core client for 30 sec - exiting 12:54:24 (4220): No heartbeat from core client for 30 sec - exiting 12:54:25 (4220): No heartbeat from core client for 30 sec - exiting 12:54:26 (4220): No heartbeat from core client for 30 sec - exiting 12:54:27 (4220): No heartbeat from core client for 30 sec - exiting 12:54:28 (4220): No heartbeat from core client for 30 sec - exiting 12:54:29 (4220): No heartbeat from core client for 30 sec - exiting 12:54:30 (4220): No heartbeat from core client for 30 sec - exiting 12:54:31 (4220): No heartbeat from core client for 30 sec - exiting 12:54:32 (4220): No heartbeat from core client for 30 sec - exiting 12:54:33 (4220): No heartbeat from core client for 30 sec - exiting 12:54:34 (4220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 22:30:43 (2468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9376, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:04:44 (3000): No heartbeat from core client for 30 sec - exiting 18:04:45 (3000): No heartbeat from core client for 30 sec - exiting 18:04:46 (3000): No heartbeat from core client for 30 sec - exiting 18:04:47 (3000): No heartbeat from core client for 30 sec - exiting 18:04:48 (3000): No heartbeat from core client for 30 sec - exiting 18:04:49 (3000): No heartbeat from core client for 30 sec - exiting 18:04:50 (3000): No heartbeat from core client for 30 sec - exiting 18:04:51 (3000): No heartbeat from core client for 30 sec - exiting 18:04:52 (3000): No heartbeat from core client for 30 sec - exiting 18:04:53 (3000): No heartbeat from core client for 30 sec - exiting 18:04:54 (3000): No heartbeat from core client for 30 sec - exiting 18:04:55 (3000): No heartbeat from core client for 30 sec - exiting 18:04:56 (3000): No heartbeat from core client for 30 sec - exiting 18:04:57 (3000): No heartbeat from core client for 30 sec - exiting 18:04:58 (3000): No heartbeat from core client for 30 sec - exiting 18:04:59 (3000): No heartbeat from core client for 30 sec - exiting 18:05:00 (3000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 13:27:54 (3780): No heartbeat from core client for 30 sec - exiting 13:27:55 (3780): No heartbeat from core client for 30 sec - exiting 13:27:56 (3780): No heartbeat from core client for 30 sec - exiting 13:27:57 (3780): No heartbeat from core client for 30 sec - exiting 13:27:58 (3780): No heartbeat from core client for 30 sec - exiting 13:27:59 (3780): No heartbeat from core client for 30 sec - exiting 13:28:00 (3780): No heartbeat from core client for 30 sec - exiting 13:28:01 (3780): No heartbeat from core client for 30 sec - exiting 13:28:02 (3780): No heartbeat from core client for 30 sec - exiting 13:28:03 (3780): No heartbeat from core client for 30 sec - exiting 13:28:04 (3780): No heartbeat from core client for 30 sec - exiting 13:28:05 (3780): No heartbeat from core client for 30 sec - exiting 13:28:06 (3780): No heartbeat from core client for 30 sec - exiting 13:28:07 (3780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:04:14 (9616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 11:30:17 (12744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 14:52:41 (11836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:26:30 (9996): No heartbeat from core client for 30 sec - exiting 19:26:31 (9996): No heartbeat from core client for 30 sec - exiting 19:26:32 (9996): No heartbeat from core client for 30 sec - exiting 19:26:33 (9996): No heartbeat from core client for 30 sec - exiting 19:26:34 (9996): No heartbeat from core client for 30 sec - exiting 19:26:35 (9996): No heartbeat from core client for 30 sec - exiting 19:26:36 (9996): No heartbeat from core client for 30 sec - exiting 19:26:37 (9996): No heartbeat from core client for 30 sec - exiting 19:26:38 (9996): No heartbeat from core client for 30 sec - exiting 19:26:39 (9996): No heartbeat from core client for 30 sec - exiting 19:26:40 (9996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:26:38 (12864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
24 Jan 2013 14:30:27	1247067	15492649	hadcm3n_39lo_1940_40_008263833_0	259,200	536,043	2.0681
21 Jan 2013 16:10:55	1247067	15492649	hadcm3n_39lo_1940_40_008263833_0	233,280	485,245	2.0801
19 Jan 2013 13:00:13	1247067	15492649	hadcm3n_39lo_1940_40_008263833_0	207,360	429,265	2.0701
12 Jan 2013 16:20:49	1247067	15492649	hadcm3n_39lo_1940_40_008263833_0	181,440	379,392	2.0910
07 Jan 2013 10:51:27	1247067	15492649	hadcm3n_39lo_1940_40_008263833_0	155,520	325,619	2.0937
05 Jan 2013 08:25:39	1247067	15492649	hadcm3n_39lo_1940_40_008263833_0	129,600	281,129	2.1692
03 Jan 2013 02:34:32	1247067	15492649	hadcm3n_39lo_1940_40_008263833_0	103,680	225,188	2.1720
30 Dec 2012 13:35:29	1247067	15492649	hadcm3n_39lo_1940_40_008263833_0	77,760	166,045	2.1354
27 Dec 2012 06:43:58	1247067	15492649	hadcm3n_39lo_1940_40_008263833_0	51,840	105,351	2.0322
24 Dec 2012 05:01:55	1247067	15492649	hadcm3n_39lo_1940_40_008263833_0	25,920	52,824	2.0380