Task 12834960

Name	hadcm3n_p7nv_1900_40_007227515_0
Workunit	7425755
Created	26 Apr 2011, 15:40:21 UTC
Sent	26 Apr 2011, 16:37:51 UTC
Report deadline	27 Jul 2011, 0:05:02 UTC
Received	22 May 2011, 14:21:40 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1104094
Run time	18 days 0 hours 28 min 2 sec
CPU time	10 days 6 hours 44 min 32 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	1.59 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2608, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:27:38 (8692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:27:40 (8692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:08:26 (6736): No heartbeat from core client for 30 sec - exiting 18:08:28 (6736): No heartbeat from core client for 30 sec - exiting 18:08:29 (6736): No heartbeat from core client for 30 sec - exiting 18:08:30 (6736): No heartbeat from core client for 30 sec - exiting 18:08:31 (6736): No heartbeat from core client for 30 sec - exiting 18:08:32 (6736): No heartbeat from core client for 30 sec - exiting 18:08:33 (6736): No heartbeat from core client for 30 sec - exiting 18:08:34 (6736): No heartbeat from core client for 30 sec - exiting 18:08:35 (6736): No heartbeat from core client for 30 sec - exiting 18:08:36 (6736): No heartbeat from core client for 30 sec - exiting 18:08:37 (6736): No heartbeat from core client for 30 sec - exiting 18:08:38 (6736): No heartbeat from core client for 30 sec - exiting 18:08:39 (6736): No heartbeat from core client for 30 sec - exiting 18:08:40 (6736): No heartbeat from core client for 30 sec - exiting 18:08:41 (6736): No heartbeat from core client for 30 sec - exiting 18:08:42 (6736): No heartbeat from core client for 30 sec - exiting 18:08:43 (6736): No heartbeat from core client for 30 sec - exiting 18:08:44 (6736): No heartbeat from core client for 30 sec - exiting 18:08:45 (6736): No heartbeat from core client for 30 sec - exiting 18:08:46 (6736): No heartbeat from core client for 30 sec - exiting 18:08:47 (6736): No heartbeat from core client for 30 sec - exiting 18:08:48 (6736): No heartbeat from core client for 30 sec - exiting 18:08:49 (6736): No heartbeat from core client for 30 sec - exiting 18:08:50 (6736): No heartbeat from core client for 30 sec - exiting 18:08:51 (6736): No heartbeat from core client for 30 sec - exiting 18:08:52 (6736): No heartbeat from core client for 30 sec - exiting 18:08:53 (6736): No heartbeat from core client for 30 sec - exiting 18:08:54 (6736): No heartbeat from core client for 30 sec - exiting 18:08:55 (6736): No heartbeat from core client for 30 sec - exiting 18:08:56 (6736): No heartbeat from core client for 30 sec - exiting 18:08:57 (6736): No heartbeat from core client for 30 sec - exiting 18:08:58 (6736): No heartbeat from core client for 30 sec - exiting 18:08:59 (6736): No heartbeat from core client for 30 sec - exiting 18:09:00 (6736): No heartbeat from core client for 30 sec - exiting 18:09:01 (6736): No heartbeat from core client for 30 sec - exiting 18:09:02 (6736): No heartbeat from core client for 30 sec - exiting 18:09:03 (6736): No heartbeat from core client for 30 sec - exiting 18:09:04 (6736): No heartbeat from core client for 30 sec - exiting 18:09:05 (6736): No heartbeat from core client for 30 sec - exiting 18:09:06 (6736): No heartbeat from core client for 30 sec - exiting 18:09:07 (6736): No heartbeat from core client for 30 sec - exiting 18:09:08 (6736): No heartbeat from core client for 30 sec - exiting 18:09:09 (6736): No heartbeat from core client for 30 sec - exiting 18:09:10 (6736): No heartbeat from core client for 30 sec - exiting 18:09:12 (6736): No heartbeat from core client for 30 sec - exiting 18:09:13 (6736): No heartbeat from core client for 30 sec - exiting 18:09:14 (6736): No heartbeat from core client for 30 sec - exiting 18:09:15 (6736): No heartbeat from core client for 30 sec - exiting 18:09:16 (6736): No heartbeat from core client for 30 sec - exiting 18:09:17 (6736): No heartbeat from core client for 30 sec - exiting 18:09:18 (6736): No heartbeat from core client for 30 sec - exiting 18:09:19 (6736): No heartbeat from core client for 30 sec - exiting 18:09:20 (6736): No heartbeat from core client for 30 sec - exiting 18:09:21 (6736): No heartbeat from core client for 30 sec - exiting 18:09:22 (6736): No heartbeat from core client for 30 sec - exiting 18:09:23 (6736): No heartbeat from core client for 30 sec - exiting 18:09:24 (6736): No heartbeat from core client for 30 sec - exiting 18:09:26 (6736): No heartbeat from core client for 30 sec - exiting 18:09:27 (6736): No heartbeat from core client for 30 sec - exiting 18:09:28 (6736): No heartbeat from core client for 30 sec - exiting 18:09:29 (6736): No heartbeat from core client for 30 sec - exiting 18:09:30 (6736): No heartbeat from core client for 30 sec - exiting 18:09:31 (6736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:09:32 (6736): No heartbeat from core client for 30 sec - exiting 18:09:33 (6736): No heartbeat from core client for 30 sec - exiting 18:09:34 (6736): No heartbeat from core client for 30 sec - exiting 18:09:35 (6736): No heartbeat from core client for 30 sec - exiting 18:09:36 (6736): No heartbeat from core client for 30 sec - exiting 18:09:37 (6736): No heartbeat from core client for 30 sec - exiting 18:09:38 (6736): No heartbeat from core client for 30 sec - exiting 18:09:39 (6736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:48:10 (7924): No heartbeat from core client for 30 sec - exiting 09:48:12 (7924): No heartbeat from core client for 30 sec - exiting 09:48:13 (7924): No heartbeat from core client for 30 sec - exiting 09:48:14 (7924): No heartbeat from core client for 30 sec - exiting 09:48:15 (7924): No heartbeat from core client for 30 sec - exiting 09:48:16 (7924): No heartbeat from core client for 30 sec - exiting 09:48:17 (7924): No heartbeat from core client for 30 sec - exiting 09:48:18 (7924): No heartbeat from core client for 30 sec - exiting 09:48:19 (7924): No heartbeat from core client for 30 sec - exiting 09:48:20 (7924): No heartbeat from core client for 30 sec - exiting 09:48:21 (7924): No heartbeat from core client for 30 sec - exiting 09:48:54 (7924): No heartbeat from core client for 30 sec - exiting 09:48:55 (7924): No heartbeat from core client for 30 sec - exiting 09:48:56 (7924): No heartbeat from core client for 30 sec - exiting 09:48:58 (7924): No heartbeat from core client for 30 sec - exiting 09:48:59 (7924): No heartbeat from core client for 30 sec - exiting 09:49:00 (7924): No heartbeat from core client for 30 sec - exiting 09:49:01 (7924): No heartbeat from core client for 30 sec - exiting 09:49:02 (7924): No heartbeat from core client for 30 sec - exiting 09:49:04 (7924): No heartbeat from core client for 30 sec - exiting 09:49:05 (7924): No heartbeat from core client for 30 sec - exiting 09:49:06 (7924): No heartbeat from core client for 30 sec - exiting 09:49:08 (7924): No heartbeat from core client for 30 sec - exiting 09:49:09 (7924): No heartbeat from core client for 30 sec - exiting 09:49:10 (7924): No heartbeat from core client for 30 sec - exiting 09:49:11 (7924): No heartbeat from core client for 30 sec - exiting 09:49:12 (7924): No heartbeat from core client for 30 sec - exiting 09:49:13 (7924): No heartbeat from core client for 30 sec - exiting 09:49:14 (7924): No heartbeat from core client for 30 sec - exiting 09:49:15 (7924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:12:49 (1104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:07:15 (3132): No heartbeat from core client for 30 sec - exiting 16:07:16 (3132): No heartbeat from core client for 30 sec - exiting 16:07:17 (3132): No heartbeat from core client for 30 sec - exiting 16:07:18 (3132): No heartbeat from core client for 30 sec - exiting 16:07:19 (3132): No heartbeat from core client for 30 sec - exiting 16:07:20 (3132): No heartbeat from core client for 30 sec - exiting 16:07:21 (3132): No heartbeat from core client for 30 sec - exiting 16:07:22 (3132): No heartbeat from core client for 30 sec - exiting 16:07:23 (3132): No heartbeat from core client for 30 sec - exiting 16:07:24 (3132): No heartbeat from core client for 30 sec - exiting 16:07:25 (3132): No heartbeat from core client for 30 sec - exiting 16:07:26 (3132): No heartbeat from core client for 30 sec - exiting 16:07:27 (3132): No heartbeat from core client for 30 sec - exiting 16:07:28 (3132): No heartbeat from core client for 30 sec - exiting 16:07:29 (3132): No heartbeat from core client for 30 sec - exiting 16:07:30 (3132): No heartbeat from core client for 30 sec - exiting 16:07:31 (3132): No heartbeat from core client for 30 sec - exiting 16:07:32 (3132): No heartbeat from core client for 30 sec - exiting 16:07:33 (3132): No heartbeat from core client for 30 sec - exiting 16:07:34 (3132): No heartbeat from core client for 30 sec - exiting 16:07:35 (3132): No heartbeat from core client for 30 sec - exiting 16:07:37 (3132): No heartbeat from core client for 30 sec - exiting 16:07:38 (3132): No heartbeat from core client for 30 sec - exiting 16:07:39 (3132): No heartbeat from core client for 30 sec - exiting 16:07:40 (3132): No heartbeat from core client for 30 sec - exiting 16:07:41 (3132): No heartbeat from core client for 30 sec - exiting 16:07:42 (3132): No heartbeat from core client for 30 sec - exiting 16:07:43 (3132): No heartbeat from core client for 30 sec - exiting 16:07:44 (3132): No heartbeat from core client for 30 sec - exiting 16:07:45 (3132): No heartbeat from core client for 30 sec - exiting 16:07:46 (3132): No heartbeat from core client for 30 sec - exiting 16:07:47 (3132): No heartbeat from core client for 30 sec - exiting 16:07:48 (3132): No heartbeat from core client for 30 sec - exiting 16:07:49 (3132): No heartbeat from core client for 30 sec - exiting 16:07:50 (3132): No heartbeat from core client for 30 sec - exiting 16:07:51 (3132): No heartbeat from core client for 30 sec - exiting 16:07:52 (3132): No heartbeat from core client for 30 sec - exiting 16:07:53 (3132): No heartbeat from core client for 30 sec - exiting 16:07:54 (3132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
22 May 2011 14:22:21	1104094	12834960	hadcm3n_p7nv_1900_40_007227515_0	259,200	888,264	3.4269
21 May 2011 12:55:00	1104094	12834960	hadcm3n_p7nv_1900_40_007227515_0	233,280	805,879	3.4546
20 May 2011 00:41:40	1104094	12834960	hadcm3n_p7nv_1900_40_007227515_0	207,360	723,531	3.4893
17 May 2011 11:01:03	1104094	12834960	hadcm3n_p7nv_1900_40_007227515_0	181,440	632,254	3.4846
15 May 2011 10:23:17	1104094	12834960	hadcm3n_p7nv_1900_40_007227515_0	155,520	542,016	3.4852
12 May 2011 07:57:00	1104094	12834960	hadcm3n_p7nv_1900_40_007227515_0	129,600	454,251	3.5050
10 May 2011 01:46:37	1104094	12834960	hadcm3n_p7nv_1900_40_007227515_0	103,680	362,414	3.4955
06 May 2011 13:50:05	1104094	12834960	hadcm3n_p7nv_1900_40_007227515_0	77,760	273,002	3.5108
02 May 2011 02:11:45	1104094	12834960	hadcm3n_p7nv_1900_40_007227515_0	51,840	182,475	3.5200
29 Apr 2011 09:53:31	1104094	12834960	hadcm3n_p7nv_1900_40_007227515_0	25,920	90,162	3.4785