Task 12735482

Name	hadcm3n_o1ej_1900_40_007197150_1
Workunit	7395430
Created	28 Mar 2011, 14:00:08 UTC
Sent	1 Apr 2011, 21:35:42 UTC
Report deadline	2 Jul 2011, 5:02:53 UTC
Received	26 Apr 2011, 19:26:30 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	775427
Run time	12 days 16 hours 13 min 53 sec
CPU time	11 days 23 hours 11 min 9 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	2.33 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.60</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9380, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:50:48 (3428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4988, selfPID=4988, iMonCtr=1 CPDN Monitor - Quit request from BOINC... 15:27:21 (5052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:02:19 (9988): No heartbeat from core client for 30 sec - exiting 12:02:20 (9988): No heartbeat from core client for 30 sec - exiting 12:02:21 (9988): No heartbeat from core client for 30 sec - exiting 12:02:22 (9988): No heartbeat from core client for 30 sec - exiting 12:02:23 (9988): No heartbeat from core client for 30 sec - exiting 12:02:24 (9988): No heartbeat from core client for 30 sec - exiting 12:02:25 (9988): No heartbeat from core client for 30 sec - exiting 12:02:26 (9988): No heartbeat from core client for 30 sec - exiting 12:02:27 (9988): No heartbeat from core client for 30 sec - exiting 12:02:28 (9988): No heartbeat from core client for 30 sec - exiting 12:02:29 (9988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:03:00 (8748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:03:01 (8748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:57:06 (6468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:57:07 (6468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:03:09 (4260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:00:52 (560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:31:44 (748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7888, iMonCtr=1 Model crash detected, will try to restart... 10:37:27 (4500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:09:42 (6172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:02:07 (6612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:03:06 (7724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:03:08 (7724): No heartbeat from core client for 30 sec - exiting 16:03:09 (7724): No heartbeat from core client for 30 sec - exiting 21:21:35 (1272): No heartbeat from core client for 30 sec - exiting 21:21:36 (1272): No heartbeat from core client for 30 sec - exiting 21:21:37 (1272): No heartbeat from core client for 30 sec - exiting 21:21:38 (1272): No heartbeat from core client for 30 sec - exiting 21:21:39 (1272): No heartbeat from core client for 30 sec - exiting 21:21:41 (1272): No heartbeat from core client for 30 sec - exiting 21:21:42 (1272): No heartbeat from core client for 30 sec - exiting 21:21:43 (1272): No heartbeat from core client for 30 sec - exiting 21:21:44 (1272): No heartbeat from core client for 30 sec - exiting 21:21:45 (1272): No heartbeat from core client for 30 sec - exiting 21:21:46 (1272): No heartbeat from core client for 30 sec - exiting 21:21:47 (1272): No heartbeat from core client for 30 sec - exiting 21:21:48 (1272): No heartbeat from core client for 30 sec - exiting 21:21:49 (1272): No heartbeat from core client for 30 sec - exiting 21:21:50 (1272): No heartbeat from core client for 30 sec - exiting 21:21:51 (1272): No heartbeat from core client for 30 sec - exiting 21:21:52 (1272): No heartbeat from core client for 30 sec - exiting 21:21:53 (1272): No heartbeat from core client for 30 sec - exiting 21:21:54 (1272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:23:53 (3360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:29:37 (4188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:39:11 (7624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10236, iMonCtr=1 Model crash detected, will try to restart... 15:06:23 (544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:06:24 (544): No heartbeat from core client for 30 sec - exiting 15:14:32 (3796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:07:42 (3132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:07:43 (3132): No heartbeat from core client for 30 sec - exiting 16:07:44 (3132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 17:09:37 (1124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1484, iMonCtr=1 Model crash detected, will try to restart... 07:55:29 (4700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3348, iMonCtr=1 Model crash detected, will try to restart... 21:15:05 (5976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:36:31 (10196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:21:05 (2276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:23:16 (2288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:24:23 (868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2964, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=800, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4792, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 21:02:34 (5752): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:02:35 (5752): No heartbeat from core client for 30 sec - exiting 21:02:36 (5752): No heartbeat from core client for 30 sec - exiting 08:28:07 (2716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
26 Apr 2011 19:29:33	775427	12735482	hadcm3n_o1ej_1900_40_007197150_1	518,400	1,033,862	1.9943
25 Apr 2011 18:11:36	775427	12735482	hadcm3n_o1ej_1900_40_007197150_1	492,480	978,483	1.9868
24 Apr 2011 05:02:17	775427	12735482	hadcm3n_o1ej_1900_40_007197150_1	466,560	926,340	1.9855
23 Apr 2011 08:58:11	775427	12735482	hadcm3n_o1ej_1900_40_007197150_1	440,640	872,891	1.9810
22 Apr 2011 17:29:25	775427	12735482	hadcm3n_o1ej_1900_40_007197150_1	414,720	817,637	1.9715
21 Apr 2011 15:54:33	775427	12735482	hadcm3n_o1ej_1900_40_007197150_1	388,800	763,831	1.9646
20 Apr 2011 18:09:18	775427	12735482	hadcm3n_o1ej_1900_40_007197150_1	362,880	711,893	1.9618
20 Apr 2011 18:09:18	775427	12735482	hadcm3n_o1ej_1900_40_007197150_1	336,960	663,179	1.9681
20 Apr 2011 18:09:17	775427	12735482	hadcm3n_o1ej_1900_40_007197150_1	311,040	613,068	1.9710
20 Apr 2011 18:09:16	775427	12735482	hadcm3n_o1ej_1900_40_007197150_1	285,120	561,400	1.9690
20 Apr 2011 18:09:15	775427	12735482	hadcm3n_o1ej_1900_40_007197150_1	259,200	510,591	1.9699
20 Apr 2011 18:09:13	775427	12735482	hadcm3n_o1ej_1900_40_007197150_1	233,280	458,066	1.9636
20 Apr 2011 18:09:11	775427	12735482	hadcm3n_o1ej_1900_40_007197150_1	207,360	406,715	1.9614
13 Apr 2011 00:00:57	775427	12735482	hadcm3n_o1ej_1900_40_007197150_1	181,440	355,223	1.9578
11 Apr 2011 03:03:21	775427	12735482	hadcm3n_o1ej_1900_40_007197150_1	155,520	303,734	1.9530
10 Apr 2011 01:36:09	775427	12735482	hadcm3n_o1ej_1900_40_007197150_1	129,600	253,086	1.9528
08 Apr 2011 17:29:33	775427	12735482	hadcm3n_o1ej_1900_40_007197150_1	103,680	202,010	1.9484
06 Apr 2011 22:38:46	775427	12735482	hadcm3n_o1ej_1900_40_007197150_1	77,760	152,448	1.9605
05 Apr 2011 20:38:20	775427	12735482	hadcm3n_o1ej_1900_40_007197150_1	51,840	102,375	1.9748
04 Apr 2011 21:45:14	775427	12735482	hadcm3n_o1ej_1900_40_007197150_1	25,920	51,411	1.9834