Task 13318549

Name	hadcm3n_t6ic_1940_40_007433034_1
Workunit	7630537
Created	31 Aug 2011, 21:04:11 UTC
Sent	31 Aug 2011, 21:07:44 UTC
Report deadline	1 Dec 2011, 4:34:55 UTC
Received	5 Feb 2012, 18:04:39 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1097461
Run time	13 days 15 hours 38 min 55 sec
CPU time	13 days 4 hours 45 min 34 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	3.24 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2908, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3176, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5696, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3324, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6232, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5072, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:38:25 (4136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1356, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4812, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4812, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:27:32 (4380): No heartbeat from core client for 30 sec - exiting 21:27:33 (4380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:27:34 (4380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
02 Feb 2012 20:34:33	1097461	13318549	hadcm3n_t6ic_1940_40_007433034_1	777,600	1,140,330	1.4665
24 Jan 2012 20:41:10	1097461	13318549	hadcm3n_t6ic_1940_40_007433034_1	751,680	1,102,852	1.4672
21 Jan 2012 17:37:44	1097461	13318549	hadcm3n_t6ic_1940_40_007433034_1	725,760	1,067,124	1.4704
09 Jan 2012 21:00:08	1097461	13318549	hadcm3n_t6ic_1940_40_007433034_1	699,840	1,030,212	1.4721
28 Dec 2011 12:10:34	1097461	13318549	hadcm3n_t6ic_1940_40_007433034_1	673,920	993,552	1.4743
20 Dec 2011 11:04:55	1097461	13318549	hadcm3n_t6ic_1940_40_007433034_1	648,000	957,430	1.4775
17 Dec 2011 11:04:24	1097461	13318549	hadcm3n_t6ic_1940_40_007433034_1	622,080	921,120	1.4807
12 Dec 2011 18:32:32	1097461	13318549	hadcm3n_t6ic_1940_40_007433034_1	596,160	883,799	1.4825
04 Dec 2011 15:41:39	1097461	13318549	hadcm3n_t6ic_1940_40_007433034_1	570,240	845,272	1.4823
26 Nov 2011 16:11:21	1097461	13318549	hadcm3n_t6ic_1940_40_007433034_1	544,320	808,077	1.4846
18 Nov 2011 19:59:25	1097461	13318549	hadcm3n_t6ic_1940_40_007433034_1	518,400	771,598	1.4884
17 Nov 2011 01:26:30	1097461	13318549	hadcm3n_t6ic_1940_40_007433034_1	492,480	736,324	1.4951
07 Nov 2011 20:14:09	1097461	13318549	hadcm3n_t6ic_1940_40_007433034_1	466,560	700,003	1.5003
05 Nov 2011 09:33:48	1097461	13318549	hadcm3n_t6ic_1940_40_007433034_1	440,640	663,111	1.5049
02 Nov 2011 14:59:13	1097461	13318549	hadcm3n_t6ic_1940_40_007433034_1	414,720	625,130	1.5074
31 Oct 2011 19:16:28	1097461	13318549	hadcm3n_t6ic_1940_40_007433034_1	388,800	590,222	1.5181
31 Oct 2011 18:46:33	1097461	13318549	hadcm3n_t6ic_1940_40_007433034_1	362,880	553,071	1.5241
31 Oct 2011 15:01:01	1097461	13318549	hadcm3n_t6ic_1940_40_007433034_1	336,960	516,298	1.5322
18 Oct 2011 16:43:59	1097461	13318549	hadcm3n_t6ic_1940_40_007433034_1	311,040	478,451	1.5382
18 Oct 2011 02:14:50	1097461	13318549	hadcm3n_t6ic_1940_40_007433034_1	285,120	437,887	1.5358