Task 13029402

Name	hadcm3n_t7cn_1940_40_007317092_2
Workunit	7514522
Created	29 Jun 2011, 12:34:08 UTC
Sent	29 Jun 2011, 12:45:18 UTC
Report deadline	28 Sep 2011, 20:12:29 UTC
Received	20 Jul 2011, 14:44:35 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1140992
Run time	11 days 13 hours 2 min 47 sec
CPU time	10 days 20 hours 13 min 25 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	1.50 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.33</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... 19:32:44 (24560): No heartbeat from core client for 30 sec - exiting 19:32:45 (24560): No heartbeat from core client for 30 sec - exiting 19:32:46 (24560): No heartbeat from core client for 30 sec - exiting 19:32:47 (24560): No heartbeat from core client for 30 sec - exiting 19:32:48 (24560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 10:48:25 (6920): No heartbeat from core client for 30 sec - exiting 10:48:26 (6920): No heartbeat from core client for 30 sec - exiting 10:48:27 (6920): No heartbeat from core client for 30 sec - exiting 10:48:28 (6920): No heartbeat from core client for 30 sec - exiting 10:48:29 (6920): No heartbeat from core client for 30 sec - exiting 10:48:30 (6920): No heartbeat from core client for 30 sec - exiting 10:48:31 (6920): No heartbeat from core client for 30 sec - exiting 10:48:32 (6920): No heartbeat from core client for 30 sec - exiting 10:48:33 (6920): No heartbeat from core client for 30 sec - exiting 10:48:34 (6920): No heartbeat from core client for 30 sec - exiting 10:48:35 (6920): No heartbeat from core client for 30 sec - exiting 10:48:36 (6920): No heartbeat from core client for 30 sec - exiting 10:48:37 (6920): No heartbeat from core client for 30 sec - exiting 10:48:38 (6920): No heartbeat from core client for 30 sec - exiting 10:48:39 (6920): No heartbeat from core client for 30 sec - exiting 10:48:40 (6920): No heartbeat from core client for 30 sec - exiting 10:48:41 (6920): No heartbeat from core client for 30 sec - exiting 10:48:42 (6920): No heartbeat from core client for 30 sec - exiting 10:48:43 (6920): No heartbeat from core client for 30 sec - exiting 10:48:44 (6920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:02:20 (8888): No heartbeat from core client for 30 sec - exiting 16:02:21 (8888): No heartbeat from core client for 30 sec - exiting 16:02:22 (8888): No heartbeat from core client for 30 sec - exiting 16:02:23 (8888): No heartbeat from core client for 30 sec - exiting 16:02:24 (8888): No heartbeat from core client for 30 sec - exiting 16:02:25 (8888): No heartbeat from core client for 30 sec - exiting 16:02:26 (8888): No heartbeat from core client for 30 sec - exiting 16:02:27 (8888): No heartbeat from core client for 30 sec - exiting 16:02:28 (8888): No heartbeat from core client for 30 sec - exiting 16:02:29 (8888): No heartbeat from core client for 30 sec - exiting 16:02:30 (8888): No heartbeat from core client for 30 sec - exiting 16:02:31 (8888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:11:44 (9184): No heartbeat from core client for 30 sec - exiting 05:11:45 (9184): No heartbeat from core client for 30 sec - exiting 05:11:46 (9184): No heartbeat from core client for 30 sec - exiting 05:11:47 (9184): No heartbeat from core client for 30 sec - exiting 05:11:48 (9184): No heartbeat from core client for 30 sec - exiting 05:11:49 (9184): No heartbeat from core client for 30 sec - exiting 05:11:50 (9184): No heartbeat from core client for 30 sec - exiting 05:11:51 (9184): No heartbeat from core client for 30 sec - exiting 05:11:52 (9184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=22964, selfPID=22964, iMonCtr=1 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/t7cnko.pje2c10 Error converting file to netcdf: dataout/t7cnko.pie2c10 Error converting file to netcdf: dataout/t7cnko.pfe2c10 Error converting file to netcdf: dataout/t7cnka.phe2c10 Error converting file to netcdf: dataout/t7cnka.pge2c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:14:38 (30188): No heartbeat from core client for 30 sec - exiting 12:14:39 (30188): No heartbeat from core client for 30 sec - exiting 12:14:40 (30188): No heartbeat from core client for 30 sec - exiting 12:14:41 (30188): No heartbeat from core client for 30 sec - exiting 12:14:42 (30188): No heartbeat from core client for 30 sec - exiting 12:14:43 (30188): No heartbeat from core client for 30 sec - exiting 12:14:44 (30188): No heartbeat from core client for 30 sec - exiting 12:14:45 (30188): No heartbeat from core client for 30 sec - exiting 12:14:46 (30188): No heartbeat from core client for 30 sec - exiting 12:14:47 (30188): No heartbeat from core client for 30 sec - exiting 12:14:48 (30188): No heartbeat from core client for 30 sec - exiting 12:14:49 (30188): No heartbeat from core client for 30 sec - exiting 12:14:50 (30188): No heartbeat from core client for 30 sec - exiting 12:14:51 (30188): No heartbeat from core client for 30 sec - exiting 12:14:52 (30188): No heartbeat from core client for 30 sec - exiting 12:14:53 (30188): No heartbeat from core client for 30 sec - exiting 12:14:54 (30188): No heartbeat from core client for 30 sec - exiting 12:14:55 (30188): No heartbeat from core client for 30 sec - exiting 12:14:56 (30188): No heartbeat from core client for 30 sec - exiting 12:14:57 (30188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:36:52 (25284): No heartbeat from core client for 30 sec - exiting 07:36:53 (25284): No heartbeat from core client for 30 sec - exiting 07:36:54 (25284): No heartbeat from core client for 30 sec - exiting 07:36:55 (25284): No heartbeat from core client for 30 sec - exiting 07:36:56 (25284): No heartbeat from core client for 30 sec - exiting 07:36:57 (25284): No heartbeat from core client for 30 sec - exiting 07:36:58 (25284): No heartbeat from core client for 30 sec - exiting 07:36:59 (25284): No heartbeat from core client for 30 sec - exiting 07:37:00 (25284): No heartbeat from core client for 30 sec - exiting 07:37:01 (25284): No heartbeat from core client for 30 sec - exiting 07:37:02 (25284): No heartbeat from core client for 30 sec - exiting 07:37:03 (25284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 13:05:54 (23604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 09:32:40 (5192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 Jul 2011 18:59:25	1140992	13029402	hadcm3n_t7cn_1940_40_007317092_2	259,200	936,793	3.6142
25 Jul 2011 17:44:37	1140992	13029402	hadcm3n_t7cn_1940_40_007317092_2	233,280	851,168	3.6487
25 Jul 2011 16:06:07	1140992	13029402	hadcm3n_t7cn_1940_40_007317092_2	207,360	763,045	3.6798
25 Jul 2011 13:25:07	1140992	13029402	hadcm3n_t7cn_1940_40_007317092_2	181,440	673,320	3.7110
25 Jul 2011 13:25:07	1140992	13029402	hadcm3n_t7cn_1940_40_007317092_2	155,520	582,538	3.7457
25 Jul 2011 13:25:06	1140992	13029402	hadcm3n_t7cn_1940_40_007317092_2	129,600	487,891	3.7646
08 Jul 2011 15:47:24	1140992	13029402	hadcm3n_t7cn_1940_40_007317092_2	103,680	391,174	3.7729
05 Jul 2011 22:16:55	1140992	13029402	hadcm3n_t7cn_1940_40_007317092_2	77,760	293,454	3.7738
04 Jul 2011 06:52:05	1140992	13029402	hadcm3n_t7cn_1940_40_007317092_2	51,840	193,469	3.7320
01 Jul 2011 19:16:38	1140992	13029402	hadcm3n_t7cn_1940_40_007317092_2	25,920	95,028	3.6662