Task 13601786

Name	hadcm3n_u663_1980_40_007536571_1
Workunit	7733803
Created	5 Nov 2011, 12:56:43 UTC
Sent	8 Nov 2011, 9:00:06 UTC
Report deadline	7 Feb 2012, 16:27:17 UTC
Received	19 Nov 2011, 20:01:06 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1145832
Run time	6 days 15 hours 25 min 3 sec
CPU time	6 days 12 hours 42 min 39 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.53 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3788, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:12:18 (3916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:17:17 (1216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:58:19 (8156): No heartbeat from core client for 30 sec - exiting 11:58:20 (8156): No heartbeat from core client for 30 sec - exiting 11:58:21 (8156): No heartbeat from core client for 30 sec - exiting 11:58:22 (8156): No heartbeat from core client for 30 sec - exiting 11:58:23 (8156): No heartbeat from core client for 30 sec - exiting 11:58:24 (8156): No heartbeat from core client for 30 sec - exiting 11:58:25 (8156): No heartbeat from core client for 30 sec - exiting 11:58:26 (8156): No heartbeat from core client for 30 sec - exiting 11:58:27 (8156): No heartbeat from core client for 30 sec - exiting 11:58:28 (8156): No heartbeat from core client for 30 sec - exiting 11:58:29 (8156): No heartbeat from core client for 30 sec - exiting 11:58:30 (8156): No heartbeat from core client for 30 sec - exiting 11:58:31 (8156): No heartbeat from core client for 30 sec - exiting 11:58:32 (8156): No heartbeat from core client for 30 sec - exiting 11:58:33 (8156): No heartbeat from core client for 30 sec - exiting 11:58:34 (8156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:58:35 (8156): No heartbeat from core client for 30 sec - exiting 11:58:36 (8156): No heartbeat from core client for 30 sec - exiting 11:58:37 (8156): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 12:37:55 (5424): No heartbeat from core client for 30 sec - exiting 12:37:56 (5424): No heartbeat from core client for 30 sec - exiting 12:37:57 (5424): No heartbeat from core client for 30 sec - exiting 12:37:58 (5424): No heartbeat from core client for 30 sec - exiting 12:37:59 (5424): No heartbeat from core client for 30 sec - exiting 12:38:00 (5424): No heartbeat from core client for 30 sec - exiting 12:38:01 (5424): No heartbeat from core client for 30 sec - exiting 12:38:02 (5424): No heartbeat from core client for 30 sec - exiting 12:38:03 (5424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/u663ko.pji9c10 Error converting file to netcdf: dataout/u663ko.pii9c10 Error converting file to netcdf: dataout/u663ko.pfi9c10 Error converting file to netcdf: dataout/u663ka.phi9c10 Error converting file to netcdf: dataout/u663ka.pgi9c10 Error converting file to netcdf: dataout/u663ka.pei9c10 Error converting file to netcdf: dataout/u663ka.pdi9c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77663A93 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6476, selfPID=6476, iMonCtr=1 Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77663A93 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
19 Nov 2011 13:19:59	1145832	13601786	hadcm3n_u663_1980_40_007536571_1	259,200	539,239	2.0804
18 Nov 2011 20:29:42	1145832	13601786	hadcm3n_u663_1980_40_007536571_1	233,280	485,211	2.0800
17 Nov 2011 16:00:16	1145832	13601786	hadcm3n_u663_1980_40_007536571_1	207,360	432,300	2.0848
16 Nov 2011 08:34:51	1145832	13601786	hadcm3n_u663_1980_40_007536571_1	181,440	376,792	2.0767
15 Nov 2011 17:18:14	1145832	13601786	hadcm3n_u663_1980_40_007536571_1	155,520	321,656	2.0683
15 Nov 2011 17:18:14	1145832	13601786	hadcm3n_u663_1980_40_007536571_1	129,600	269,576	2.0801
15 Nov 2011 17:18:14	1145832	13601786	hadcm3n_u663_1980_40_007536571_1	103,680	221,496	2.1363
15 Nov 2011 17:18:14	1145832	13601786	hadcm3n_u663_1980_40_007536571_1	77,760	171,641	2.2073
10 Nov 2011 02:43:53	1145832	13601786	hadcm3n_u663_1980_40_007536571_1	51,840	116,531	2.2479
09 Nov 2011 08:55:19	1145832	13601786	hadcm3n_u663_1980_40_007536571_1	25,920	58,326	2.2502