Task 13541047

Name	hadcm3n_yexd_1900_40_007517684_1
Workunit	7715159
Created	28 Oct 2011, 12:53:37 UTC
Sent	21 Nov 2011, 14:06:53 UTC
Report deadline	20 Feb 2012, 21:34:04 UTC
Received	18 Dec 2011, 22:39:17 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1134605
Run time	11 days 6 hours 47 min 31 sec
CPU time	11 days 4 hours 14 min 2 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	2.74 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10348, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:22:32 (920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:24:22 (1040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:26:20 (1576): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 12:38:44 (5184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:38:48 (5184): No heartbeat from core client for 30 sec - exiting 12:38:49 (5184): No heartbeat from core client for 30 sec - exiting 12:38:50 (5184): No heartbeat from core client for 30 sec - exiting 12:38:51 (5184): No heartbeat from core client for 30 sec - exiting 12:38:52 (5184): No heartbeat from core client for 30 sec - exiting 12:38:53 (5184): No heartbeat from core client for 30 sec - exiting 12:38:54 (5184): No heartbeat from core client for 30 sec - exiting 12:38:55 (5184): No heartbeat from core client for 30 sec - exiting 12:38:56 (5184): No heartbeat from core client for 30 sec - exiting 12:38:57 (5184): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 12:54:42 (1212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:54:43 (1212): No heartbeat from core client for 30 sec - exiting 12:54:44 (1212): No heartbeat from core client for 30 sec - exiting 12:56:33 (8276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:45:31 (8428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:47:58 (768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:48:47 (4220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:46:40 (8068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:06:43 (6232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:07:01 (6232): No heartbeat from core client for 30 sec - exiting 17:07:02 (6232): No heartbeat from core client for 30 sec - exiting 17:07:03 (6232): No heartbeat from core client for 30 sec - exiting 17:07:04 (6232): No heartbeat from core client for 30 sec - exiting 17:07:05 (6232): No heartbeat from core client for 30 sec - exiting 17:07:06 (6232): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 17:27:00 (6916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:27:01 (6916): No heartbeat from core client for 30 sec - exiting 17:27:02 (6916): No heartbeat from core client for 30 sec - exiting 17:27:03 (6916): No heartbeat from core client for 30 sec - exiting 17:27:04 (6916): No heartbeat from core client for 30 sec - exiting 17:27:05 (6916): No heartbeat from core client for 30 sec - exiting 17:27:06 (6916): No heartbeat from core client for 30 sec - exiting 17:27:07 (6916): No heartbeat from core client for 30 sec - exiting 17:27:08 (6916): No heartbeat from core client for 30 sec - exiting 17:27:09 (6916): No heartbeat from core client for 30 sec - exiting 17:27:10 (6916): No heartbeat from core client for 30 sec - exiting 17:28:01 (4436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:29:14 (9120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:08:01 (5808): No heartbeat from core client for 30 sec - exiting 20:08:02 (5808): No heartbeat from core client for 30 sec - exiting 20:08:03 (5808): No heartbeat from core client for 30 sec - exiting 20:08:04 (5808): No heartbeat from core client for 30 sec - exiting 20:08:05 (5808): No heartbeat from core client for 30 sec - exiting 20:08:06 (5808): No heartbeat from core client for 30 sec - exiting 20:08:08 (5808): No heartbeat from core client for 30 sec - exiting 20:08:09 (5808): No heartbeat from core client for 30 sec - exiting 20:08:10 (5808): No heartbeat from core client for 30 sec - exiting 20:08:11 (5808): No heartbeat from core client for 30 sec - exiting 20:08:12 (5808): No heartbeat from core client for 30 sec - exiting 20:08:13 (5808): No heartbeat from core client for 30 sec - exiting 20:08:14 (5808): No heartbeat from core client for 30 sec - exiting 20:08:15 (5808): No heartbeat from core client for 30 sec - exiting 20:08:16 (5808): No heartbeat from core client for 30 sec - exiting 20:08:17 (5808): No heartbeat from core client for 30 sec - exiting 20:08:19 (5808): No heartbeat from core client for 30 sec - exiting 20:08:20 (5808): No heartbeat from core client for 30 sec - exiting 20:08:21 (5808): No heartbeat from core client for 30 sec - exiting 20:08:22 (5808): No heartbeat from core client for 30 sec - exiting 20:08:23 (5808): No heartbeat from core client for 30 sec - exiting 20:08:24 (5808): No heartbeat from core client for 30 sec - exiting 20:08:25 (5808): No heartbeat from core client for 30 sec - exiting 20:08:26 (5808): No heartbeat from core client for 30 sec - exiting 20:08:27 (5808): No heartbeat from core client for 30 sec - exiting 20:08:28 (5808): No heartbeat from core client for 30 sec - exiting 20:08:30 (5808): No heartbeat from core client for 30 sec - exiting 20:08:31 (5808): No heartbeat from core client for 30 sec - exiting 20:08:32 (5808): No heartbeat from core client for 30 sec - exiting 20:08:33 (5808): No heartbeat from core client for 30 sec - exiting 20:08:34 (5808): No heartbeat from core client for 30 sec - exiting 20:08:36 (5808): No heartbeat from core client for 30 sec - exiting 20:08:37 (5808): No heartbeat from core client for 30 sec - exiting 20:08:38 (5808): No heartbeat from core client for 30 sec - exiting 20:08:39 (5808): No heartbeat from core client for 30 sec - exiting 20:08:40 (5808): No heartbeat from core client for 30 sec - exiting 20:08:41 (5808): No heartbeat from core client for 30 sec - exiting 20:08:43 (5808): No heartbeat from core client for 30 sec - exiting 20:08:44 (5808): No heartbeat from core client for 30 sec - exiting 20:08:45 (5808): No heartbeat from core client for 30 sec - exiting 20:08:46 (5808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:08:47 (5808): No heartbeat from core client for 30 sec - exiting 20:12:24 (6476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77D67B04 read attempt to address 0x435EE0AE Engaging BOINC Windows Runtime Debugger... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6788, selfPID=6788, iMonCtr=1 Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77D5E046 read attempt to address 0x42C3DC10 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
18 Dec 2011 21:39:56	1134605	13541047	hadcm3n_yexd_1900_40_007517684_1	518,400	964,306	1.8602
18 Dec 2011 07:47:19	1134605	13541047	hadcm3n_yexd_1900_40_007517684_1	492,480	915,442	1.8588
17 Dec 2011 15:40:25	1134605	13541047	hadcm3n_yexd_1900_40_007517684_1	466,560	866,290	1.8568
17 Dec 2011 01:37:04	1134605	13541047	hadcm3n_yexd_1900_40_007517684_1	440,640	816,093	1.8521
16 Dec 2011 09:56:48	1134605	13541047	hadcm3n_yexd_1900_40_007517684_1	414,720	766,936	1.8493
15 Dec 2011 13:31:46	1134605	13541047	hadcm3n_yexd_1900_40_007517684_1	388,800	718,707	1.8485
12 Dec 2011 17:21:21	1134605	13541047	hadcm3n_yexd_1900_40_007517684_1	362,880	669,019	1.8436
11 Dec 2011 14:13:11	1134605	13541047	hadcm3n_yexd_1900_40_007517684_1	336,960	618,346	1.8351
07 Dec 2011 07:10:33	1134605	13541047	hadcm3n_yexd_1900_40_007517684_1	311,040	568,441	1.8275
06 Dec 2011 19:30:12	1134605	13541047	hadcm3n_yexd_1900_40_007517684_1	285,120	530,656	1.8612
06 Dec 2011 10:05:21	1134605	13541047	hadcm3n_yexd_1900_40_007517684_1	259,200	496,831	1.9168
05 Dec 2011 07:40:40	1134605	13541047	hadcm3n_yexd_1900_40_007517684_1	233,280	455,415	1.9522
04 Dec 2011 04:13:52	1134605	13541047	hadcm3n_yexd_1900_40_007517684_1	207,360	404,215	1.9493
03 Dec 2011 13:07:15	1134605	13541047	hadcm3n_yexd_1900_40_007517684_1	181,440	354,503	1.9538
02 Dec 2011 20:52:23	1134605	13541047	hadcm3n_yexd_1900_40_007517684_1	155,520	304,132	1.9556
01 Dec 2011 20:33:27	1134605	13541047	hadcm3n_yexd_1900_40_007517684_1	129,600	253,296	1.9544
30 Nov 2011 20:30:46	1134605	13541047	hadcm3n_yexd_1900_40_007517684_1	103,680	202,836	1.9564
29 Nov 2011 23:58:52	1134605	13541047	hadcm3n_yexd_1900_40_007517684_1	77,760	153,331	1.9718
29 Nov 2011 07:10:46	1134605	13541047	hadcm3n_yexd_1900_40_007517684_1	51,840	102,625	1.9796
28 Nov 2011 08:05:21	1134605	13541047	hadcm3n_yexd_1900_40_007517684_1	25,920	51,534	1.9882