Task 15549172

Name	hadcm3n_n1nl_1880_40_008286295_0
Workunit	8437430
Created	17 Jan 2013, 19:15:30 UTC
Sent	17 Jan 2013, 19:15:40 UTC
Report deadline	19 Apr 2013, 2:42:51 UTC
Received	10 Feb 2013, 20:23:57 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1186467
Run time	7 days 19 hours 16 min 12 sec
CPU time	4 days 20 hours 57 min 47 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.49 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.44</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... 06:37:21 (10028): No heartbeat from core client for 30 sec - exiting 06:37:22 (10028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=15440, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:41:38 (17280): No heartbeat from core client for 30 sec - exiting 04:41:39 (17280): No heartbeat from core client for 30 sec - exiting 04:41:40 (17280): No heartbeat from core client for 30 sec - exiting 04:41:41 (17280): No heartbeat from core client for 30 sec - exiting 04:41:42 (17280): No heartbeat from core client for 30 sec - exiting 04:41:43 (17280): No heartbeat from core client for 30 sec - exiting 04:41:44 (17280): No heartbeat from core client for 30 sec - exiting 04:41:45 (17280): No heartbeat from core client for 30 sec - exiting 04:41:46 (17280): No heartbeat from core client for 30 sec - exiting 04:41:47 (17280): No heartbeat from core client for 30 sec - exiting 04:41:48 (17280): No heartbeat from core client for 30 sec - exiting 04:41:49 (17280): No heartbeat from core client for 30 sec - exiting 04:41:50 (17280): No heartbeat from core client for 30 sec - exiting 04:41:51 (17280): No heartbeat from core client for 30 sec - exiting 04:41:52 (17280): No heartbeat from core client for 30 sec - exiting 04:41:53 (17280): No heartbeat from core client for 30 sec - exiting 04:41:54 (17280): No heartbeat from core client for 30 sec - exiting 04:41:55 (17280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:41:56 (17280): No heartbeat from core client for 30 sec - exiting 04:42:52 (14580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:07:45 (12164): No heartbeat from core client for 30 sec - exiting 04:07:46 (12164): No heartbeat from core client for 30 sec - exiting 04:07:47 (12164): No heartbeat from core client for 30 sec - exiting 04:07:48 (12164): No heartbeat from core client for 30 sec - exiting 04:07:49 (12164): No heartbeat from core client for 30 sec - exiting 04:07:50 (12164): No heartbeat from core client for 30 sec - exiting 04:07:51 (12164): No heartbeat from core client for 30 sec - exiting 04:07:52 (12164): No heartbeat from core client for 30 sec - exiting 04:07:53 (12164): No heartbeat from core client for 30 sec - exiting 04:07:54 (12164): No heartbeat from core client for 30 sec - exiting 04:07:55 (12164): No heartbeat from core client for 30 sec - exiting 04:07:56 (12164): No heartbeat from core client for 30 sec - exiting 04:07:57 (12164): No heartbeat from core client for 30 sec - exiting 04:07:58 (12164): No heartbeat from core client for 30 sec - exiting 04:07:59 (12164): No heartbeat from core client for 30 sec - exiting 04:08:00 (12164): No heartbeat from core client for 30 sec - exiting 04:08:01 (12164): No heartbeat from core client for 30 sec - exiting 04:08:02 (12164): No heartbeat from core client for 30 sec - exiting 04:08:03 (12164): No heartbeat from core client for 30 sec - exiting 04:08:04 (12164): No heartbeat from core client for 30 sec - exiting 04:08:05 (12164): No heartbeat from core client for 30 sec - exiting 04:08:06 (12164): No heartbeat from core client for 30 sec - exiting 04:08:07 (12164): No heartbeat from core client for 30 sec - exiting 04:08:08 (12164): No heartbeat from core client for 30 sec - exiting 04:08:09 (12164): No heartbeat from core client for 30 sec - exiting 04:08:10 (12164): No heartbeat from core client for 30 sec - exiting 04:08:11 (12164): No heartbeat from core client for 30 sec - exiting 04:08:12 (12164): No heartbeat from core client for 30 sec - exiting 04:08:13 (12164): No heartbeat from core client for 30 sec - exiting 04:08:14 (12164): No heartbeat from core client for 30 sec - exiting 04:08:15 (12164): No heartbeat from core client for 30 sec - exiting 04:08:16 (12164): No heartbeat from core client for 30 sec - exiting 04:08:17 (12164): No heartbeat from core client for 30 sec - exiting 04:08:18 (12164): No heartbeat from core client for 30 sec - exiting 04:08:19 (12164): No heartbeat from core client for 30 sec - exiting 04:08:20 (12164): No heartbeat from core client for 30 sec - exiting 04:08:21 (12164): No heartbeat from core client for 30 sec - exiting 04:08:22 (12164): No heartbeat from core client for 30 sec - exiting 04:08:23 (12164): No heartbeat from core client for 30 sec - exiting 04:08:24 (12164): No heartbeat from core client for 30 sec - exiting 04:08:25 (12164): No heartbeat from core client for 30 sec - exiting 04:08:26 (12164): No heartbeat from core client for 30 sec - exiting 04:08:27 (12164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:12:27 (13324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:23:54 (11316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:37:05 (4000): No heartbeat from core client for 30 sec - exiting 06:37:06 (4000): No heartbeat from core client for 30 sec - exiting 06:37:07 (4000): No heartbeat from core client for 30 sec - exiting 06:37:08 (4000): No heartbeat from core client for 30 sec - exiting 06:37:09 (4000): No heartbeat from core client for 30 sec - exiting 06:37:10 (4000): No heartbeat from core client for 30 sec - exiting 06:37:11 (4000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:51:40 (2556): No heartbeat from core client for 30 sec - exiting 06:51:41 (2556): No heartbeat from core client for 30 sec - exiting 06:51:42 (2556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:32:56 (4304): No heartbeat from core client for 30 sec - exiting 17:32:57 (4304): No heartbeat from core client for 30 sec - exiting 17:32:58 (4304): No heartbeat from core client for 30 sec - exiting 17:32:59 (4304): No heartbeat from core client for 30 sec - exiting 17:33:00 (4304): No heartbeat from core client for 30 sec - exiting 17:33:01 (4304): No heartbeat from core client for 30 sec - exiting 17:33:02 (4304): No heartbeat from core client for 30 sec - exiting 17:33:03 (4304): No heartbeat from core client for 30 sec - exiting 17:33:04 (4304): No heartbeat from core client for 30 sec - exiting 17:33:05 (4304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:16:32 (6748): No heartbeat from core client for 30 sec - exiting 03:16:34 (6748): No heartbeat from core client for 30 sec - exiting 03:16:35 (6748): No heartbeat from core client for 30 sec - exiting 03:16:36 (6748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:37:31 (6848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:46:41 (20092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:53:17 (6424): No heartbeat from core client for 30 sec - exiting 04:53:19 (6424): No heartbeat from core client for 30 sec - exiting 04:53:20 (6424): No heartbeat from core client for 30 sec - exiting 04:53:21 (6424): No heartbeat from core client for 30 sec - exiting 04:53:22 (6424): No heartbeat from core client for 30 sec - exiting 04:53:23 (6424): No heartbeat from core client for 30 sec - exiting 04:53:24 (6424): No heartbeat from core client for 30 sec - exiting 04:53:25 (6424): No heartbeat from core client for 30 sec - exiting 04:53:26 (6424): No heartbeat from core client for 30 sec - exiting 04:53:27 (6424): No heartbeat from core client for 30 sec - exiting 04:53:28 (6424): No heartbeat from core client for 30 sec - exiting 04:53:29 (6424): No heartbeat from core client for 30 sec - exiting 04:53:30 (6424): No heartbeat from core client for 30 sec - exiting 04:53:31 (6424): No heartbeat from core client for 30 sec - exiting 04:53:32 (6424): No heartbeat from core client for 30 sec - exiting 04:53:33 (6424): No heartbeat from core client for 30 sec - exiting 04:53:34 (6424): No heartbeat from core client for 30 sec - exiting 04:53:35 (6424): No heartbeat from core client for 30 sec - exiting 04:53:36 (6424): No heartbeat from core client for 30 sec - exiting 04:53:37 (6424): No heartbeat from core client for 30 sec - exiting 04:53:38 (6424): No heartbeat from core client for 30 sec - exiting 04:53:39 (6424): No heartbeat from core client for 30 sec - exiting 04:53:40 (6424): No heartbeat from core client for 30 sec - exiting 04:53:41 (6424): No heartbeat from core client for 30 sec - exiting 04:53:42 (6424): No heartbeat from core client for 30 sec - exiting 04:53:43 (6424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:58:22 (5596): No heartbeat from core client for 30 sec - exiting 01:58:23 (5596): No heartbeat from core client for 30 sec - exiting 01:58:24 (5596): No heartbeat from core client for 30 sec - exiting 01:58:25 (5596): No heartbeat from core client for 30 sec - exiting 01:58:26 (5596): No heartbeat from core client for 30 sec - exiting 01:58:27 (5596): No heartbeat from core client for 30 sec - exiting 01:58:28 (5596): No heartbeat from core client for 30 sec - exiting 01:58:29 (5596): No heartbeat from core client for 30 sec - exiting 01:58:30 (5596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 06:36:33 (2728): No heartbeat from core client for 30 sec - exiting 06:36:34 (2728): No heartbeat from core client for 30 sec - exiting 06:36:35 (2728): No heartbeat from core client for 30 sec - exiting 06:36:36 (2728): No heartbeat from core client for 30 sec - exiting 06:36:37 (2728): No heartbeat from core client for 30 sec - exiting 06:36:38 (2728): No heartbeat from core client for 30 sec - exiting 06:36:39 (2728): No heartbeat from core client for 30 sec - exiting 06:36:40 (2728): No heartbeat from core client for 30 sec - exiting 06:36:41 (2728): No heartbeat from core client for 30 sec - exiting 06:36:42 (2728): No heartbeat from core client for 30 sec - exiting 06:36:43 (2728): No heartbeat from core client for 30 sec - exiting 06:36:44 (2728): No heartbeat from core client for 30 sec - exiting 06:36:45 (2728): No heartbeat from core client for 30 sec - exiting 06:36:46 (2728): No heartbeat from core client for 30 sec - exiting 06:36:47 (2728): No heartbeat from core client for 30 sec - exiting 06:36:48 (2728): No heartbeat from core client for 30 sec - exiting 06:36:49 (2728): No heartbeat from core client for 30 sec - exiting 06:36:50 (2728): No heartbeat from core client for 30 sec - exiting 06:36:51 (2728): No heartbeat from core client for 30 sec - exiting 06:36:52 (2728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:37:35 (8852): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:40:09 (9676): No heartbeat from core client for 30 sec - exiting 06:40:10 (9676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:18:42 (5716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:02:14 (2284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:38:51 (16948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:12:12 (19072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 10:54:01 (16296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:29:07 (6444): No heartbeat from core client for 30 sec - exiting 14:29:08 (6444): No heartbeat from core client for 30 sec - exiting 14:29:09 (6444): No heartbeat from core client for 30 sec - exiting 14:29:10 (6444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:47:01 (1344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:38:05 (5576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:34:29 (11716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, se02:58:29 (4620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:19:13 (5684): No heartbeat from core client for 30 sec - exiting 05:19:14 (5684): No heartbeat from core client for 30 sec - exiting 05:19:15 (5684): No heartbeat from core client for 30 sec - exiting 05:19:17 (5684): No heartbeat from core client for 30 sec - exiting 05:19:18 (5684): No heartbeat from core client for 30 sec - exiting 05:19:19 (5684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:45:51 (8180): No heartbeat from core client for 30 sec - exiting 16:45:52 (8180): No heartbeat from core client for 30 sec - exiting 16:45:53 (8180): No heartbeat from core client for 30 sec - exiting 16:45:54 (8180): No heartbeat from core client for 30 sec - exiting 16:45:55 (8180): No heartbeat from core client for 30 sec - exiting 16:45:56 (8180): No heartbeat from core client for 30 sec - exiting 16:45:57 (8180): No heartbeat from core client for 30 sec - exiting 16:45:58 (8180): No heartbeat from core client for 30 sec - exiting 16:45:59 (8180): No heartbeat from core client for 30 sec - exiting 16:46:00 (8180): No heartbeat from core client for 30 sec - exiting 16:46:01 (8180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:09:38 (10364): No heartbeat from core client for 30 sec - exiting 10:09:39 (10364): No heartbeat from core client for 30 sec - exiting 10:09:40 (10364): No heartbeat from core client for 30 sec - exiting 10:09:41 (10364): No heartbeat from core client for 30 sec - exiting 10:09:42 (10364): No heartbeat from core client for 30 sec - exiting 10:09:43 (10364): No heartbeat from core client for 30 sec - exiting 10:09:44 (10364): No heartbeat from core client for 30 sec - exiting 10:09:45 (10364): No heartbeat from core client for 30 sec - exiting 10:09:46 (10364): No heartbeat from core client for 30 sec - exiting 10:09:47 (10364): No heartbeat from core client for 30 sec - exiting 10:09:48 (10364): No heartbeat from core client for 30 sec - exiting 10:09:50 (10364): No heartbeat from core client for 30 sec - exiting 10:09:51 (10364): No heartbeat from core client for 30 sec - exiting 10:09:52 (10364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:11:31 (6756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x76EFFF2B write attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x76EE3AB3 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
09 Feb 2013 17:51:32	1186467	15549172	hadcm3n_n1nl_1880_40_008286295_0	259,200	407,972	1.5740
07 Feb 2013 08:47:54	1186467	15549172	hadcm3n_n1nl_1880_40_008286295_0	233,280	365,597	1.5672
04 Feb 2013 14:05:30	1186467	15549172	hadcm3n_n1nl_1880_40_008286295_0	207,360	322,575	1.5556
02 Feb 2013 03:44:30	1186467	15549172	hadcm3n_n1nl_1880_40_008286295_0	181,440	280,362	1.5452
31 Jan 2013 17:36:20	1186467	15549172	hadcm3n_n1nl_1880_40_008286295_0	155,520	241,135	1.5505
28 Jan 2013 23:02:50	1186467	15549172	hadcm3n_n1nl_1880_40_008286295_0	129,600	201,120	1.5519
26 Jan 2013 02:43:56	1186467	15549172	hadcm3n_n1nl_1880_40_008286295_0	103,680	161,176	1.5546
24 Jan 2013 17:48:08	1186467	15549172	hadcm3n_n1nl_1880_40_008286295_0	77,760	121,149	1.5580
22 Jan 2013 19:58:44	1186467	15549172	hadcm3n_n1nl_1880_40_008286295_0	51,840	78,516	1.5146
19 Jan 2013 21:57:13	1186467	15549172	hadcm3n_n1nl_1880_40_008286295_0	25,920	38,821	1.4977