Task 13326230

Name	hadcm3n_t7ho_1940_40_007436234_0
Workunit	7633737
Created	1 Sep 2011, 19:24:28 UTC
Sent	1 Sep 2011, 19:31:44 UTC
Report deadline	2 Dec 2011, 2:58:55 UTC
Received	29 Sep 2011, 15:24:01 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1041608
Run time	8 days 1 hours 29 min 17 sec
CPU time	7 days 12 hours 37 min 49 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	1.84 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:44:44 (5724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:44:46 (5724): No heartbeat from core client for 30 sec - exiting 12:44:47 (5724): No heartbeat from core client for 30 sec - exiting 12:44:48 (5724): No heartbeat from core client for 30 sec - exiting 12:44:49 (5724): No heartbeat from core client for 30 sec - exiting 12:44:50 (5724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:05:56 (5900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:05:57 (5900): No heartbeat from core client for 30 sec - exiting 18:05:58 (5900): No heartbeat from core client for 30 sec - exiting 18:05:59 (5900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 15:01:33 (6200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2664, iMonCtr=1 Model crash detected, will try to restart... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5860, iMonCtr=1 Model crash detected, will try to restart... 18:26:22 (5940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:26:25 (5940): No heartbeat from core client for 30 sec - exiting 18:26:26 (5940): No heartbeat from core client for 30 sec - exiting 18:26:27 (5940): No heartbeat from core client for 30 sec - exiting 18:26:28 (5940): No heartbeat from core client for 30 sec - exiting 18:26:29 (5940): No heartbeat from core client for 30 sec - exiting 18:26:31 (5940): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 10:35:24 (3604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:35:26 (3604): No heartbeat from core client for 30 sec - exiting 10:35:27 (3604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:15:56 (1544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:55:05 (7872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:01:49 (1416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:09:31 (7756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5176, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5668, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 18:14:44 (5684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:14:48 (5684): No heartbeat from core client for 30 sec - exiting 18:14:49 (5684): No heartbeat from core client for 30 sec - exiting 18:14:50 (5684): No heartbeat from core client for 30 sec - exiting 18:14:51 (5684): No heartbeat from core client for 30 sec - exiting 18:14:52 (5684): No heartbeat from core client for 30 sec - exiting 18:14:53 (5684): No heartbeat from core client for 30 sec - exiting 18:14:54 (5684): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5724, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=320, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5632, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4644, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5852, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... Called boinc_finish Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77457249 read attempt to address 0x43425583 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 Sep 2011 15:21:39	1041608	13326230	hadcm3n_t7ho_1940_40_007436234_0	259,200	650,250	2.5087
26 Sep 2011 17:54:58	1041608	13326230	hadcm3n_t7ho_1940_40_007436234_0	233,280	581,726	2.4937
25 Sep 2011 11:32:25	1041608	13326230	hadcm3n_t7ho_1940_40_007436234_0	207,360	514,150	2.4795
22 Sep 2011 20:13:19	1041608	13326230	hadcm3n_t7ho_1940_40_007436234_0	181,440	446,299	2.4598
20 Sep 2011 19:16:22	1041608	13326230	hadcm3n_t7ho_1940_40_007436234_0	155,520	380,265	2.4451
17 Sep 2011 18:29:54	1041608	13326230	hadcm3n_t7ho_1940_40_007436234_0	129,600	312,620	2.4122
13 Sep 2011 20:37:07	1041608	13326230	hadcm3n_t7ho_1940_40_007436234_0	103,680	252,548	2.4358
11 Sep 2011 18:19:04	1041608	13326230	hadcm3n_t7ho_1940_40_007436234_0	77,760	185,639	2.3873
10 Sep 2011 09:01:07	1041608	13326230	hadcm3n_t7ho_1940_40_007436234_0	51,840	132,394	2.5539
04 Sep 2011 17:11:23	1041608	13326230	hadcm3n_t7ho_1940_40_007436234_0	25,920	67,057	2.5871