Task 15636773

Name	hadcm3n_n255_1920_40_008321533_0
Workunit	8472668
Created	24 Feb 2013, 19:48:56 UTC
Sent	24 Feb 2013, 19:52:08 UTC
Report deadline	27 May 2013, 3:19:19 UTC
Received	12 Mar 2013, 18:42:13 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1007182
Run time	5 days 8 hours 28 min 1 sec
CPU time	5 days 2 hours 58 min 58 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.33 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:58:01 (8352): No heartbeat from core client for 30 sec - exiting 08:58:02 (8352): No heartbeat from core client for 30 sec - exiting 08:58:03 (8352): No heartbeat from core client for 30 sec - exiting 08:58:04 (8352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:56:57 (9380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:59:00 (8544): No heartbeat from core client for 30 sec - exiting 18:59:01 (8544): No heartbeat from core client for 30 sec - exiting 18:59:02 (8544): No heartbeat from core client for 30 sec - exiting 18:59:03 (8544): No heartbeat from core client for 30 sec - exiting 18:59:04 (8544): No heartbeat from core client for 30 sec - exiting 18:59:05 (8544): No heartbeat from core client for 30 sec - exiting 18:59:06 (8544): No heartbeat from core client for 30 sec - exiting 18:59:07 (8544): No heartbeat from core client for 30 sec - exiting 18:59:08 (8544): No heartbeat from core client for 30 sec - exiting 18:59:09 (8544): No heartbeat from core client for 30 sec - exiting 18:59:10 (8544): No heartbeat from core client for 30 sec - exiting 18:59:11 (8544): No heartbeat from core client for 30 sec - exiting 18:59:12 (8544): No heartbeat from core client for 30 sec - exiting 18:59:13 (8544): No heartbeat from core client for 30 sec - exiting 18:59:14 (8544): No heartbeat from core client for 30 sec - exiting 18:59:15 (8544): No heartbeat from core client for 30 sec - exiting 18:59:16 (8544): No heartbeat from core client for 30 sec - exiting 18:59:17 (8544): No heartbeat from core client for 30 sec - exiting 18:59:18 (8544): No heartbeat from core client for 30 sec - exiting 18:59:19 (8544): No heartbeat from core client for 30 sec - exiting 18:59:20 (8544): No heartbeat from core client for 30 sec - exiting 18:59:21 (8544): No heartbeat from core client for 30 sec - exiting 18:59:22 (8544): No heartbeat from core client for 30 sec - exiting 18:59:23 (8544): No heartbeat from core client for 30 sec - exiting 18:59:24 (8544): No heartbeat from core client for 30 sec - exiting 18:59:25 (8544): No heartbeat from core client for 30 sec - exiting 18:59:26 (8544): No heartbeat from core client for 30 sec - exiting 18:59:27 (8544): No heartbeat from core client for 30 sec - exiting 18:59:28 (8544): No heartbeat from core client for 30 sec - exiting 18:59:29 (8544): No heartbeat from core client for 30 sec - exiting 18:59:30 (8544): No heartbeat from core client for 30 sec - exiting 18:59:31 (8544): No heartbeat from core client for 30 sec - exiting 18:59:32 (8544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:08:26 (8488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:13:19 (3016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:13:20 (3016): No heartbeat from core client for 30 sec - exiting 16:14:13 (8528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:15:07 (8148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:54:10 (10804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:01:09 (11008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10832, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10832, iMonCtr=1 Model crash detected, will try to restart... 16:04:43 (10832): No heartbeat from core client for 30 sec - exiting 16:04:44 (10832): No heartbeat from core client for 30 sec - exiting 16:04:45 (10832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4048, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4048, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 04:58:13 (2416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 02:58:48 (6828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:58:49 (6828): No heartbeat from core client for 30 sec - exiting 02:58:50 (6828): No heartbeat from core client for 30 sec - exiting 02:58:51 (6828): No heartbeat from core client for 30 sec - exiting 14:29:54 (9864): No heartbeat from core client for 30 sec - exiting 14:29:55 (9864): No heartbeat from core client for 30 sec - exiting 14:29:56 (9864): No heartbeat from core client for 30 sec - exiting 14:29:57 (9864): No heartbeat from core client for 30 sec - exiting 14:29:58 (9864): No heartbeat from core client for 30 sec - exiting 14:29:59 (9864): No heartbeat from core client for 30 sec - exiting 14:30:00 (9864): No heartbeat from core client for 30 sec - exiting 14:30:01 (9864): No heartbeat from core client for 30 sec - exiting 14:30:02 (9864): No heartbeat from core client for 30 sec - exiting 14:30:03 (9864): No heartbeat from core client for 30 sec - exiting 14:30:04 (9864): No heartbeat from core client for 30 sec - exiting 14:30:05 (9864): No heartbeat from core client for 30 sec - exiting 14:30:06 (9864): No heartbeat from core client for 30 sec - exiting 14:30:07 (9864): No heartbeat from core client for 30 sec - exiting 14:30:08 (9864): No heartbeat from core client for 30 sec - exiting 14:30:09 (9864): No heartbeat from core client for 30 sec - exiting 14:30:10 (9864): No heartbeat from core client for 30 sec - exiting 14:30:11 (9864): No heartbeat from core client for 30 sec - exiting 14:30:12 (9864): No heartbeat from core client for 30 sec - exiting 14:30:13 (9864): No heartbeat from core client for 30 sec - exiting 14:30:14 (9864): No heartbeat from core client for 30 sec - exiting 14:30:15 (9864): No heartbeat from core client for 30 sec - exiting 14:30:16 (9864): No heartbeat from core client for 30 sec - exiting 14:30:17 (9864): No heartbeat from core client for 30 sec - exiting 14:30:18 (9864): No heartbeat from core client for 30 sec - exiting 14:30:19 (9864): No heartbeat from core client for 30 sec - exiting 14:30:20 (9864): No heartbeat from core client for 30 sec - exiting 14:30:21 (9864): No heartbeat from core client for 30 sec - exiting 14:30:22 (9864): No heartbeat from core client for 30 sec - exiting 14:30:23 (9864): No heartbeat from core client for 30 sec - exiting 14:30:24 (9864): No heartbeat from core client for 30 sec - exiting 14:30:25 (9864): No heartbeat from core client for 30 sec - exiting 14:30:26 (9864): No heartbeat from core client for 30 sec - exiting 14:30:27 (9864): No heartbeat from core client for 30 sec - exiting 14:30:28 (9864): No heartbeat from core client for 30 sec - exiting 14:30:29 (9864): No heartbeat from core client for 30 sec - exiting 14:30:30 (9864): No heartbeat from core client for 30 sec - exiting 14:30:31 (9864): No heartbeat from core client for 30 sec - exiting 14:30:32 (9864): No heartbeat from core client for 30 sec - exiting 14:30:33 (9864): No heartbeat from core client for 30 sec - exiting 14:30:34 (9864): No heartbeat from core client for 30 sec - exiting 14:30:35 (9864): No heartbeat from core client for 30 sec - exiting 14:30:36 (9864): No heartbeat from core client for 30 sec - exiting 14:30:37 (9864): No heartbeat from core client for 30 sec - exiting 14:30:38 (9864): No heartbeat from core client for 30 sec - exiting 14:30:39 (9864): No heartbeat from core client for 30 sec - exiting 14:31:10 (9864): No heartbeat from core client for 30 sec - exiting 14:31:11 (9864): No heartbeat from core client for 30 sec - exiting 14:31:12 (9864): No heartbeat from core client for 30 sec - exiting 14:31:13 (9864): No heartbeat from core client for 30 sec - exiting 14:31:14 (9864): No heartbeat from core client for 30 sec - exiting 14:31:15 (9864): No heartbeat from core client for 30 sec - exiting 14:31:16 (9864): No heartbeat from core client for 30 sec - exiting 14:31:17 (9864): No heartbeat from core client for 30 sec - exiting 14:31:18 (9864): No heartbeat from core client for 30 sec - exiting 14:31:19 (9864): No heartbeat from core client for 30 sec - exiting 14:31:20 (9864): No heartbeat from core client for 30 sec - exiting 14:31:21 (9864): No heartbeat from core client for 30 sec - exiting 14:31:22 (9864): No heartbeat from core client for 30 sec - exiting 14:31:23 (9864): No heartbeat from core client for 30 sec - exiting 14:31:24 (9864): No heartbeat from core client for 30 sec - exiting 14:31:25 (9864): No heartbeat from core client for 30 sec - exiting 14:31:26 (9864): No heartbeat from core client for 30 sec - exiting 14:31:27 (9864): No heartbeat from core client for 30 sec - exiting 14:31:28 (9864): No heartbeat from core client for 30 sec - exiting 14:31:29 (9864): No heartbeat from core client for 30 sec - exiting 14:31:30 (9864): No heartbeat from core client for 30 sec - exiting 14:31:31 (9864): No heartbeat from core client for 30 sec - exiting 14:31:32 (9864): No heartbeat from core client for 30 sec - exiting 14:31:33 (9864): No heartbeat from core client for 30 sec - exiting 14:31:34 (9864): No heartbeat from core client for 30 sec - exiting 14:31:35 (9864): No heartbeat from core client for 30 sec - exiting 14:31:36 (9864): No heartbeat from core client for 30 sec - exiting 14:31:37 (9864): No heartbeat from core client for 30 sec - exiting 14:31:38 (9864): No heartbeat from core client for 30 sec - exiting 14:31:39 (9864): No heartbeat from core client for 30 sec - exiting 14:31:40 (9864): No heartbeat from core client for 30 sec - exiting 14:31:41 (9864): No heartbeat from core client for 30 sec - exiting 14:31:42 (9864): No heartbeat from core client for 30 sec - exiting 14:31:43 (9864): No heartbeat from core client for 30 sec - exiting 14:31:44 (9864): No heartbeat from core client for 30 sec - exiting 14:31:45 (9864): No heartbeat from core client for 30 sec - exiting 14:31:46 (9864): No heartbeat from core client for 30 sec - exiting 14:31:47 (9864): No heartbeat from core client for 30 sec - exiting 14:31:48 (9864): No heartbeat from core client for 30 sec - exiting 14:31:49 (9864): No heartbeat from core client for 30 sec - exiting 14:31:50 (9864): No heartbeat from core client for 30 sec - exiting 14:31:51 (9864): No heartbeat from core client for 30 sec - exiting 14:31:52 (9864): No heartbeat from core client for 30 sec - exiting 14:31:53 (9864): No heartbeat from core client for 30 sec - exiting 14:31:54 (9864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:31:55 (9864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 23:51:04 (10856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:01:03 (8240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:01:49 (8908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:11:04 (6668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:11:05 (6668): No heartbeat from core client for 30 sec - exiting 00:13:40 (8312): No heartbeat from core client for 30 sec - exiting 00:13:41 (8312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:16:05 (12152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:21:05 (6384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:21:06 (6384): No heartbeat from core client for 30 sec - exiting 00:21:07 (6384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:54:18 (5024): No heartbeat from core client for 30 sec - exiting 07:54:19 (5024): No heartbeat from core client for 30 sec - exiting 07:54:20 (5024): No heartbeat from core client for 30 sec - exiting 07:54:21 (5024): No heartbeat from core client for 30 sec - exiting 07:54:22 (5024): No heartbeat from core client for 30 sec - exiting 07:54:23 (5024): No heartbeat from core client for 30 sec - exiting 07:54:24 (5024): No heartbeat from core client for 30 sec - exiting 07:54:25 (5024): No heartbeat from core client for 30 sec - exiting 07:54:26 (5024): No heartbeat from core client for 30 sec - exiting 07:54:27 (5024): No heartbeat from core client for 30 sec - exiting 07:54:28 (5024): No heartbeat from core client for 30 sec - exiting 07:54:29 (5024): No heartbeat from core client for 30 sec - exiting 07:54:30 (5024): No heartbeat from core client for 30 sec - exiting 07:54:31 (5024): No heartbeat from core client for 30 sec - exiting 07:54:32 (5024): No heartbeat from core client for 30 sec - exiting 07:54:33 (5024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:54:34 (5024): No heartbeat from core client for 30 sec - exiting Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77A25EAB read attempt to address 0x3EB515B0 Engaging BOINC Windows Runtime Debugger... 18:58:11 (7472): No heartbeat from core client for 30 sec - exiting 18:58:12 (7472): No heartbeat from core client for 30 sec - exiting 18:58:13 (7472): No heartbeat from core client for 30 sec - exiting 18:58:14 (7472): No heartbeat from core client for 30 sec - exiting 18:58:15 (7472): No heartbeat from core client for 30 sec - exiting 18:58:16 (7472): No heartbeat from core client for 30 sec - exiting 18:58:17 (7472): No heartbeat from core client for 30 sec - exiting 18:58:18 (7472): No heartbeat from core client for 30 sec - exiting 18:58:19 (7472): No heartbeat from core client for 30 sec - exiting 18:58:20 (7472): No heartbeat from core client for 30 sec - exiting 18:58:21 (7472): No heartbeat from core client for 30 sec - exiting 18:58:22 (7472): No heartbeat from core client for 30 sec - exiting 18:58:23 (7472): No heartbeat from core client for 30 sec - exiting 18:58:24 (7472): No heartbeat from core client for 30 sec - exiting 18:58:25 (7472): No heartbeat from core client for 30 sec - exiting 18:58:26 (7472): No heartbeat from core client for 30 sec - exiting 18:58:27 (7472): No heartbeat from core client for 30 sec - exiting 18:58:28 (7472): No heartbeat from core client for 30 sec - exiting 18:58:29 (7472): No heartbeat from core client for 30 sec - exiting 18:58:30 (7472): No heartbeat from core client for 30 sec - exiting 18:58:31 (7472): No heartbeat from core client for 30 sec - exiting 18:58:32 (7472): No heartbeat from core client for 30 sec - exiting 18:58:33 (7472): No heartbeat from core client for 30 sec - exiting 18:58:34 (7472): No heartbeat from core client for 30 sec - exiting 18:58:35 (7472): No heartbeat from core client for 30 sec - exiting 18:58:36 (7472): No heartbeat from core client for 30 sec - exiting 18:58:37 (7472): No heartbeat from core client for 30 sec - exiting 18:58:38 (7472): No heartbeat from core client for 30 sec - exiting 18:58:39 (7472): No heartbeat from core client for 30 sec - exiting 18:58:40 (7472): No heartbeat from core client for 30 sec - exiting 18:58:41 (7472): No heartbeat from core client for 30 sec - exiting 18:58:42 (7472): No heartbeat from core client for 30 sec - exiting 18:58:43 (7472): No heartbeat from core client for 30 sec - exiting 18:58:44 (7472): No heartbeat from core client for 30 sec - exiting 18:58:45 (7472): No heartbeat from core client for 30 sec - exiting 18:58:46 (7472): No heartbeat from core client for 30 sec - exiting 18:58:47 (7472): No heartbeat from core client for 30 sec - exiting 18:58:48 (7472): No heartbeat from core client for 30 sec - exiting 18:58:49 (7472): No heartbeat from core client for 30 sec - exiting 18:58:50 (7472): No heartbeat from core client for 30 sec - exiting 18:58:51 (7472): No heartbeat from core client for 30 sec - exiting 18:58:52 (7472): No heartbeat from core client for 30 sec - exiting 18:58:53 (7472): No heartbeat from core client for 30 sec - exiting 18:58:54 (7472): No heartbeat from core client for 30 sec - exiting 18:58:55 (7472): No heartbeat from core client for 30 sec - exiting 18:58:56 (7472): No heartbeat from core client for 30 sec - exiting 18:58:57 (7472): No heartbeat from core client for 30 sec - exiting 18:58:58 (7472): No heartbeat from core client for 30 sec - exiting 18:58:59 (7472): No heartbeat from core client for 30 sec - exiting 18:59:00 (7472): No heartbeat from core client for 30 sec - exiting 18:59:01 (7472): No heartbeat from core client for 30 sec - exiting 18:59:02 (7472): No heartbeat from core client for 30 sec - exiting 18:59:03 (7472): No heartbeat from core client for 30 sec - exiting 18:59:04 (7472): No heartbeat from core client for 30 sec - exiting 18:59:05 (7472): No heartbeat from core client for 30 sec - exiting 18:59:06 (7472): No heartbeat from core client for 30 sec - exiting 18:59:07 (7472): No heartbeat from core client for 30 sec - exiting 18:59:08 (7472): No heartbeat from core client for 30 sec - exiting Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x779FE742 read attempt to address 0x3D55C4D3 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
11 Mar 2013 09:03:14	1007182	15636773	hadcm3n_n255_1920_40_008321533_0	259,200	436,081	1.6824
10 Mar 2013 12:02:12	1007182	15636773	hadcm3n_n255_1920_40_008321533_0	233,280	392,578	1.6829
08 Mar 2013 06:30:48	1007182	15636773	hadcm3n_n255_1920_40_008321533_0	207,360	348,747	1.6818
06 Mar 2013 22:36:08	1007182	15636773	hadcm3n_n255_1920_40_008321533_0	181,440	304,994	1.6810
05 Mar 2013 17:43:00	1007182	15636773	hadcm3n_n255_1920_40_008321533_0	155,520	261,492	1.6814
04 Mar 2013 07:08:02	1007182	15636773	hadcm3n_n255_1920_40_008321533_0	129,600	216,963	1.6741
02 Mar 2013 05:06:37	1007182	15636773	hadcm3n_n255_1920_40_008321533_0	103,680	174,186	1.6800
28 Feb 2013 22:49:55	1007182	15636773	hadcm3n_n255_1920_40_008321533_0	77,760	130,673	1.6805
27 Feb 2013 10:52:16	1007182	15636773	hadcm3n_n255_1920_40_008321533_0	51,840	84,963	1.6389
26 Feb 2013 09:50:39	1007182	15636773	hadcm3n_n255_1920_40_008321533_0	25,920	42,147	1.6260