Task 13664270

Name	hadcm3n_yb4x_1900_40_007520354_4
Workunit	7717829
Created	27 Nov 2011, 2:39:39 UTC
Sent	27 Nov 2011, 2:39:50 UTC
Report deadline	26 Feb 2012, 10:07:01 UTC
Received	3 Jan 2012, 6:03:37 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1107261
Run time	6 days 6 hours 28 min 18 sec
CPU time	6 days 0 hours 2 min 19 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	3.46 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2972, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:14:05 (5776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:04:27 (5552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:09:24 (6044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:10:09 (4532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:20:31 (5424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CCPDN Monitor - Quit request from BOINC... 22:29:20 (5772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:04:33 (4216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:21:00 (2668): No heartbeat from core client for 30 sec - exiting 15:21:01 (2668): No heartbeat from core client for 30 sec - exiting 15:21:02 (2668): No heartbeat from core client for 30 sec - exiting 15:21:03 (2668): No heartbeat from core client for 30 sec - exiting 15:21:04 (2668): No heartbeat from core client for 30 sec - exiting 15:21:05 (2668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:19:52 (4436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:19:53 (4436): No heartbeat from core client for 30 sec - exiting 17:19:54 (4436): No heartbeat from core client for 30 sec - exiting 17:19:55 (4436): No heartbeat from core client for 30 sec - exiting 17:19:56 (4436): No heartbeat from core client for 30 sec - exiting 17:19:57 (4436): No heartbeat from core client for 30 sec - exiting 17:19:58 (4436): No heartbeat from core client for 30 sec - exiting 18:09:23 (5124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5300, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4428, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 08:25:03 (904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1724, iMonCtr=1 Model crash detected, will try to restart... 10:37:25 (3112): No heartbeat from core client for 30 sec - exiting 10:37:26 (3112): No heartbeat from core client for 30 sec - exiting 10:37:27 (3112): No heartbeat from core client for 30 sec - exiting 10:37:29 (3112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5492, iMonCtr=1 Model crash detected, will try to restart... 10:39:39 (5208): No heartbeat from core client for 30 sec - exiting 10:39:40 (5208): No heartbeat from core client for 30 sec - exiting 10:39:41 (5208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1624, iMonCtr=1 Model crash detected, will try to restart... 14:12:43 (5996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:57:45 (3140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:57:46 (3140): No heartbeat from core client for 30 sec - exiting 06:26:24 (5752): No heartbeat from core client for 30 sec - exiting 06:26:25 (5752): No heartbeat from core client for 30 sec - exiting 06:26:26 (5752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5848, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5972, iMonCtr=1 Model crash detected, will try to restart... 05:47:14 (5332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:47:15 (5332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6108, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:13:10 (4204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 21:05:55 (4924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:16:02 (6044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:51:54 (5744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:46:45 (3408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:08:00 (6056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3676, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4212, iMonCtr=1 Model crash detected, will try to restart... 21:13:56 (4972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6036, iMonCtr=1 Model crash detected, will try to restart... 07:02:05 (4488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:33:41 (5128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:45:25 (2320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:45:26 (2320): No heartbeat from core client for 30 sec - exiting 18:45:27 (2320): No heartbeat from core client for 30 sec - exiting 18:45:28 (2320): No heartbeat from core client for 30 sec - exiting 18:45:29 (2320): No heartbeat from core client for 30 sec - exiting 18:45:30 (2320): No heartbeat from core client for 30 sec - exiting 18:45:31 (2320): No heartbeat from core client for 30 sec - exiting 18:45:32 (2320): No heartbeat from core client for 30 sec - exiting 18:46:19 (5944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 10:15:50 (4860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
03 Jan 2012 06:05:39	1107261	13664270	hadcm3n_yb4x_1900_40_007520354_4	518,400	518,538	1.0003
02 Jan 2012 09:50:01	1107261	13664270	hadcm3n_yb4x_1900_40_007520354_4	492,480	492,625	1.0003
31 Dec 2011 14:02:37	1107261	13664270	hadcm3n_yb4x_1900_40_007520354_4	466,560	466,555	1.0000
31 Dec 2011 06:56:00	1107261	13664270	hadcm3n_yb4x_1900_40_007520354_4	440,640	440,634	1.0000
29 Dec 2011 04:27:40	1107261	13664270	hadcm3n_yb4x_1900_40_007520354_4	414,720	414,944	1.0005
27 Dec 2011 13:03:30	1107261	13664270	hadcm3n_yb4x_1900_40_007520354_4	388,800	389,078	1.0007
27 Dec 2011 03:56:24	1107261	13664270	hadcm3n_yb4x_1900_40_007520354_4	362,880	363,007	1.0003
26 Dec 2011 04:04:17	1107261	13664270	hadcm3n_yb4x_1900_40_007520354_4	336,960	337,016	1.0002
24 Dec 2011 09:35:04	1107261	13664270	hadcm3n_yb4x_1900_40_007520354_4	311,040	311,218	1.0006
24 Dec 2011 01:48:39	1107261	13664270	hadcm3n_yb4x_1900_40_007520354_4	285,120	285,007	0.9996
22 Dec 2011 02:41:37	1107261	13664270	hadcm3n_yb4x_1900_40_007520354_4	259,200	259,078	0.9995
21 Dec 2011 06:02:16	1107261	13664270	hadcm3n_yb4x_1900_40_007520354_4	233,280	233,189	0.9996
20 Dec 2011 10:34:10	1107261	13664270	hadcm3n_yb4x_1900_40_007520354_4	207,360	207,336	0.9999
20 Dec 2011 03:06:30	1107261	13664270	hadcm3n_yb4x_1900_40_007520354_4	181,440	181,348	0.9995
17 Dec 2011 11:04:23	1107261	13664270	hadcm3n_yb4x_1900_40_007520354_4	155,520	155,393	0.9992
17 Dec 2011 02:42:22	1107261	13664270	hadcm3n_yb4x_1900_40_007520354_4	129,600	129,540	0.9995
16 Dec 2011 02:29:53	1107261	13664270	hadcm3n_yb4x_1900_40_007520354_4	103,680	103,589	0.9991
14 Dec 2011 11:33:32	1107261	13664270	hadcm3n_yb4x_1900_40_007520354_4	77,760	77,583	0.9977
13 Dec 2011 08:35:46	1107261	13664270	hadcm3n_yb4x_1900_40_007520354_4	51,840	51,642	0.9962
10 Dec 2011 13:17:03	1107261	13664270	hadcm3n_yb4x_1900_40_007520354_4	25,920	25,718	0.9922