Task 13450474

Name	hadcm3n_o3cs_1900_40_007439662_4
Workunit	7637165
Created	30 Sep 2011, 1:30:38 UTC
Sent	30 Sep 2011, 1:31:28 UTC
Report deadline	30 Dec 2011, 8:58:39 UTC
Received	7 Nov 2011, 23:59:32 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1102379
Run time	11 days 14 hours 57 min 24 sec
CPU time	11 days 4 hours 48 min 19 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	2.92 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.60</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4276, iMonCtr=1 Model crash detected, will try to restart... 07:53:51 (3572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:54:52 (3684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4268, iMonCtr=1 Model crash detected, will try to restart... 00:01:57 (3900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:02:36 (3168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:27:04 (4804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:46:59 (3740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:48:43 (3680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:49:43 (1372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3988, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3668, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3708, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3580, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77483A93 read attempt to address 0x40B5135B Engaging BOINC Windows Runtime Debugger... Signal 11 received, exiting... Called boinc_finish Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77863A93 read attempt to address 0x40B5135B Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Nov 2011 02:23:10	1102379	13450474	hadcm3n_o3cs_1900_40_007439662_4	518,400	942,206	1.8175
05 Nov 2011 17:10:10	1102379	13450474	hadcm3n_o3cs_1900_40_007439662_4	492,480	895,274	1.8179
04 Nov 2011 16:09:17	1102379	13450474	hadcm3n_o3cs_1900_40_007439662_4	466,560	848,456	1.8185
02 Nov 2011 17:21:17	1102379	13450474	hadcm3n_o3cs_1900_40_007439662_4	440,640	802,601	1.8214
01 Nov 2011 17:11:43	1102379	13450474	hadcm3n_o3cs_1900_40_007439662_4	414,720	756,795	1.8248
31 Oct 2011 20:06:47	1102379	13450474	hadcm3n_o3cs_1900_40_007439662_4	388,800	711,337	1.8296
31 Oct 2011 17:19:05	1102379	13450474	hadcm3n_o3cs_1900_40_007439662_4	362,880	665,835	1.8349
31 Oct 2011 16:33:59	1102379	13450474	hadcm3n_o3cs_1900_40_007439662_4	336,960	619,864	1.8396
31 Oct 2011 16:33:59	1102379	13450474	hadcm3n_o3cs_1900_40_007439662_4	311,040	571,973	1.8389
18 Oct 2011 21:11:47	1102379	13450474	hadcm3n_o3cs_1900_40_007439662_4	285,120	524,478	1.8395
17 Oct 2011 17:33:49	1102379	13450474	hadcm3n_o3cs_1900_40_007439662_4	259,200	476,851	1.8397
17 Oct 2011 03:46:21	1102379	13450474	hadcm3n_o3cs_1900_40_007439662_4	233,280	429,031	1.8391
15 Oct 2011 17:30:39	1102379	13450474	hadcm3n_o3cs_1900_40_007439662_4	207,360	381,410	1.8394
14 Oct 2011 02:38:51	1102379	13450474	hadcm3n_o3cs_1900_40_007439662_4	181,440	333,893	1.8402
13 Oct 2011 01:11:49	1102379	13450474	hadcm3n_o3cs_1900_40_007439662_4	155,520	286,078	1.8395
12 Oct 2011 03:15:06	1102379	13450474	hadcm3n_o3cs_1900_40_007439662_4	129,600	238,259	1.8384
11 Oct 2011 04:56:29	1102379	13450474	hadcm3n_o3cs_1900_40_007439662_4	103,680	190,639	1.8387
08 Oct 2011 21:51:32	1102379	13450474	hadcm3n_o3cs_1900_40_007439662_4	77,760	143,039	1.8395
06 Oct 2011 10:04:33	1102379	13450474	hadcm3n_o3cs_1900_40_007439662_4	51,840	95,539	1.8430
05 Oct 2011 23:54:43	1102379	13450474	hadcm3n_o3cs_1900_40_007439662_4	25,920	47,952	1.8500