Task 15793281

Name	hadcm3n_3ch7_1980_40_008364398_1
Workunit	8515257
Created	22 May 2013, 15:20:16 UTC
Sent	22 May 2013, 15:20:27 UTC
Report deadline	21 Aug 2013, 22:47:38 UTC
Received	10 Jul 2013, 19:31:59 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1118452
Run time	21 days 15 hours 34 min 7 sec
CPU time	14 days 8 hours 21 min 45 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	1.63 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> (unknown error) - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:50:36 (34040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:12:18 (30912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 00:22:40 (39868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 07:21:43 (30716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:00:22 (4524): No heartbeat from core client for 30 sec - exiting 09:00:23 (4524): No heartbeat from core client for 30 sec - exiting 09:00:24 (4524): No heartbeat from core client for 30 sec - exiting 09:00:25 (4524): No heartbeat from core client for 30 sec - exiting 09:00:26 (4524): No heartbeat from core client for 30 sec - exiting 09:00:28 (4524): No heartbeat from core client for 30 sec - exiting 09:00:29 (4524): No heartbeat from core client for 30 sec - exiting 09:00:30 (4524): No heartbeat from core client for 30 sec - exiting 09:00:31 (4524): No heartbeat from core client for 30 sec - exiting 09:00:32 (4524): No heartbeat from core client for 30 sec - exiting 09:00:33 (4524): No heartbeat from core client for 30 sec - exiting 09:00:34 (4524): No heartbeat from core client for 30 sec - exiting 09:00:35 (4524): No heartbeat from core client for 30 sec - exiting 09:00:36 (4524): No heartbeat from core client for 30 sec - exiting 09:00:37 (4524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:00:38 (4524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1884, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:44:43 (7120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:18:33 (10908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 06:24:31 (9636): No heartbeat from core client for 30 sec - exiting 06:24:32 (9636): No heartbeat from core client for 30 sec - exiting 06:24:33 (9636): No heartbeat from core client for 30 sec - exiting 06:24:34 (9636): No heartbeat from core client for 30 sec - exiting 06:24:35 (9636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6256, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5416, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:29:14 (7884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:34:40 (1868): No heartbeat from core client for 30 sec - exiting 18:34:41 (1868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:34:42 (1868): No heartbeat from core client for 30 sec - exiting 18:34:43 (1868): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:48:04 (5848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10852, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5160, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 13:10:58 (11136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 14:56:38 (4796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:02:17 (6880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
09 Jul 2013 16:48:30	1118452	15793281	hadcm3n_3ch7_1980_40_008364398_1	518,400	1,239,690	2.3914
07 Jul 2013 16:37:54	1118452	15793281	hadcm3n_3ch7_1980_40_008364398_1	492,480	1,177,922	2.3918
06 Jul 2013 04:10:42	1118452	15793281	hadcm3n_3ch7_1980_40_008364398_1	466,560	1,115,407	2.3907
02 Jul 2013 12:03:47	1118452	15793281	hadcm3n_3ch7_1980_40_008364398_1	440,640	1,053,103	2.3899
02 Jul 2013 10:04:35	1118452	15793281	hadcm3n_3ch7_1980_40_008364398_1	414,720	991,743	2.3914
27 Jun 2013 01:35:59	1118452	15793281	hadcm3n_3ch7_1980_40_008364398_1	388,800	929,531	2.3908
25 Jun 2013 06:20:08	1118452	15793281	hadcm3n_3ch7_1980_40_008364398_1	362,880	868,475	2.3933
23 Jun 2013 09:16:59	1118452	15793281	hadcm3n_3ch7_1980_40_008364398_1	336,960	806,743	2.3942
21 Jun 2013 18:17:25	1118452	15793281	hadcm3n_3ch7_1980_40_008364398_1	311,040	745,029	2.3953
19 Jun 2013 08:21:10	1118452	15793281	hadcm3n_3ch7_1980_40_008364398_1	285,120	682,378	2.3933
17 Jun 2013 03:53:56	1118452	15793281	hadcm3n_3ch7_1980_40_008364398_1	259,200	621,755	2.3987
14 Jun 2013 02:09:23	1118452	15793281	hadcm3n_3ch7_1980_40_008364398_1	233,280	558,438	2.3939
10 Jun 2013 21:52:51	1118452	15793281	hadcm3n_3ch7_1980_40_008364398_1	207,360	491,402	2.3698
08 Jun 2013 12:30:07	1118452	15793281	hadcm3n_3ch7_1980_40_008364398_1	181,440	426,540	2.3509
04 Jun 2013 04:58:07	1118452	15793281	hadcm3n_3ch7_1980_40_008364398_1	155,520	365,645	2.3511
01 Jun 2013 20:03:17	1118452	15793281	hadcm3n_3ch7_1980_40_008364398_1	129,600	304,419	2.3489
31 May 2013 00:48:10	1118452	15793281	hadcm3n_3ch7_1980_40_008364398_1	103,680	243,702	2.3505
29 May 2013 17:56:39	1118452	15793281	hadcm3n_3ch7_1980_40_008364398_1	77,760	183,744	2.3630
27 May 2013 13:50:44	1118452	15793281	hadcm3n_3ch7_1980_40_008364398_1	51,840	122,062	2.3546
25 May 2013 06:21:18	1118452	15793281	hadcm3n_3ch7_1980_40_008364398_1	25,920	60,889	2.3491