Task 13028351

Name	hadcm3n_t7jy_1940_40_007317200_0
Workunit	7514630
Created	29 Jun 2011, 6:51:40 UTC
Sent	29 Jun 2011, 7:04:16 UTC
Report deadline	28 Sep 2011, 14:31:27 UTC
Received	10 Feb 2012, 13:06:45 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1135882
Run time	24 days 19 hours 27 min 22 sec
CPU time	22 days 9 hours 15 min 50 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	2.11 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/t7jyko.pje3c10 Error converting file to netcdf: dataout/t7jyko.pie3c10 Error converting file to netcdf: dataout/t7jyko.pfe3c10 Error converting file to netcdf: dataout/t7jyka.phe3c10 Error converting file to netcdf: dataout/t7jyka.pge3c10 Error converting file to netcdf: dataout/t7jyka.pee3c10 Error converting file to netcdf: dataout/t7jyka.pde3c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4688, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4880, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5092, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5000, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4904, iMonCtr=1 Model crash detected, will try to restart... 12:28:49 (5920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5580, iMonCtr=1 Model crash detected, will try to restart... 22:46:00 (5464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:46:01 (5464): No heartbeat from core client for 30 sec - exiting 22:46:02 (5464): No heartbeat from core client for 30 sec - exiting 22:46:03 (5464): No heartbeat from core client for 30 sec - exiting 22:46:04 (5464): No heartbeat from core client for 30 sec - exiting 22:46:05 (5464): No heartbeat from core client for 30 sec - exiting 22:46:06 (5464): No heartbeat from core client for 30 sec - exiting 22:46:07 (5464): No heartbeat from core client for 30 sec - exiting 22:46:08 (5464): No heartbeat from core client for 30 sec - exiting 22:46:09 (5464): No heartbeat from core client for 30 sec - exiting 22:46:10 (5464): No heartbeat from core client for 30 sec - exiting 22:46:11 (5464): No heartbeat from core client for 30 sec - exiting 22:46:12 (5464): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5748, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3220, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5392, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
10 Feb 2012 13:07:58	1135882	13028351	hadcm3n_t7jy_1940_40_007317200_0	1,036,800	1,934,146	1.8655
06 Feb 2012 10:20:57	1135882	13028351	hadcm3n_t7jy_1940_40_007317200_0	1,010,880	1,885,843	1.8655
20 Jan 2012 09:04:53	1135882	13028351	hadcm3n_t7jy_1940_40_007317200_0	984,960	1,837,817	1.8659
03 Jan 2012 18:37:43	1135882	13028351	hadcm3n_t7jy_1940_40_007317200_0	959,040	1,792,449	1.8690
29 Dec 2011 10:59:33	1135882	13028351	hadcm3n_t7jy_1940_40_007317200_0	933,120	1,744,284	1.8693
23 Dec 2011 16:47:55	1135882	13028351	hadcm3n_t7jy_1940_40_007317200_0	907,200	1,695,870	1.8693
13 Dec 2011 12:32:32	1135882	13028351	hadcm3n_t7jy_1940_40_007317200_0	881,280	1,646,920	1.8688
28 Nov 2011 16:02:31	1135882	13028351	hadcm3n_t7jy_1940_40_007317200_0	855,360	1,597,842	1.8680
19 Nov 2011 19:39:11	1135882	13028351	hadcm3n_t7jy_1940_40_007317200_0	829,440	1,550,084	1.8688
15 Nov 2011 20:43:33	1135882	13028351	hadcm3n_t7jy_1940_40_007317200_0	803,520	1,502,685	1.8701
31 Oct 2011 17:41:38	1135882	13028351	hadcm3n_t7jy_1940_40_007317200_0	777,600	1,454,651	1.8707
31 Oct 2011 16:35:29	1135882	13028351	hadcm3n_t7jy_1940_40_007317200_0	751,680	1,406,765	1.8715
12 Oct 2011 11:07:37	1135882	13028351	hadcm3n_t7jy_1940_40_007317200_0	725,760	1,358,193	1.8714
01 Oct 2011 18:48:13	1135882	13028351	hadcm3n_t7jy_1940_40_007317200_0	699,840	1,309,554	1.8712
20 Sep 2011 10:04:12	1135882	13028351	hadcm3n_t7jy_1940_40_007317200_0	673,920	1,261,929	1.8725
19 Sep 2011 09:08:04	1135882	13028351	hadcm3n_t7jy_1940_40_007317200_0	648,000	1,213,624	1.8729
11 Sep 2011 19:25:37	1135882	13028351	hadcm3n_t7jy_1940_40_007317200_0	622,080	1,164,384	1.8718
10 Sep 2011 15:57:47	1135882	13028351	hadcm3n_t7jy_1940_40_007317200_0	596,160	1,117,063	1.8738
29 Aug 2011 14:32:03	1135882	13028351	hadcm3n_t7jy_1940_40_007317200_0	570,240	1,068,842	1.8744
25 Aug 2011 14:27:58	1135882	13028351	hadcm3n_t7jy_1940_40_007317200_0	544,320	1,021,806	1.8772