Task 16275676

Name	hadcm3n_7h1n_1980_40_008433374_2
Workunit	8584230
Created	24 Jan 2014, 13:27:35 UTC
Sent	24 Jan 2014, 13:27:42 UTC
Report deadline	28 Jul 2023, 18:47:42 UTC
Received	7 Mar 2014, 12:43:23 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1208393
Run time	11 days 4 hours 51 min 10 sec
CPU time	9 days 3 hours 49 min 17 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.13 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.2.33</core_client_version> <![CDATA[ <message> (unknown error) - exit code -1073741819 (0xc0000005) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... 16:20:06 (11108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:49:58 (10192): No heartbeat from core client for 30 sec - exiting 08:49:59 (10192): No heartbeat from core client for 30 sec - exiting 08:50:00 (10192): No heartbeat from core client for 30 sec - exiting 08:50:01 (10192): No heartbeat from core client for 30 sec - exiting 08:50:02 (10192): No heartbeat from core client for 30 sec - exiting 08:50:03 (10192): No heartbeat from core client for 30 sec - exiting 08:50:04 (10192): No heartbeat from core client for 30 sec - exiting 08:50:05 (10192): No heartbeat from core client for 30 sec - exiting 08:50:07 (10192): No heartbeat from core client for 30 sec - exiting 08:50:08 (10192): No heartbeat from core client for 30 sec - exiting 08:50:09 (10192): No heartbeat from core client for 30 sec - exiting 08:50:10 (10192): No heartbeat from core client for 30 sec - exiting 08:50:11 (10192): No heartbeat from core client for 30 sec - exiting 08:50:12 (10192): No heartbeat from core client for 30 sec - exiting 08:50:13 (10192): No heartbeat from core client for 30 sec - exiting 08:50:14 (10192): No heartbeat from core client for 30 sec - exiting 08:50:15 (10192): No heartbeat from core client for 30 sec - exiting 08:50:16 (10192): No heartbeat from core client for 30 sec - exiting 08:50:18 (10192): No heartbeat from core client for 30 sec - exiting 08:50:19 (10192): No heartbeat from core client for 30 sec - exiting 08:50:20 (10192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:07:05 (16080): No heartbeat from core client for 30 sec - exiting 19:07:11 (16080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:35:38 (5068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:55:04 (568): No heartbeat from core client for 30 sec - exiting 08:55:05 (568): No heartbeat from core client for 30 sec - exiting 08:55:06 (568): No heartbeat from core client for 30 sec - exiting 08:55:07 (568): No heartbeat from core client for 30 sec - exiting 08:55:08 (568): No heartbeat from core client for 30 sec - exiting 08:55:09 (568): No heartbeat from core client for 30 sec - exiting 08:55:10 (568): No heartbeat from core client for 30 sec - exiting 08:55:11 (568): No heartbeat from core client for 30 sec - exiting 08:55:12 (568): No heartbeat from core client for 30 sec - exiting 08:55:13 (568): No heartbeat from core client for 30 sec - exiting 08:55:14 (568): No heartbeat from core client for 30 sec - exiting 08:55:15 (568): No heartbeat from core client for 30 sec - exiting 08:55:16 (568): No heartbeat from core client for 30 sec - exiting 08:55:17 (568): No heartbeat from core client for 30 sec - exiting 08:55:18 (568): No heartbeat from core client for 30 sec - exiting 08:55:19 (568): No heartbeat from core client for 30 sec - exiting 08:55:20 (568): No heartbeat from core client for 30 sec - exiting 08:55:22 (568): No heartbeat from core client for 30 sec - exiting 08:55:23 (568): No heartbeat from core client for 30 sec - exiting 08:55:24 (568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:12:15 (10812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:05:22 (9980): No heartbeat from core client for 30 sec - exiting 09:05:23 (9980): No heartbeat from core client for 30 sec - exiting 09:05:24 (9980): No heartbeat from core client for 30 sec - exiting 09:05:25 (9980): No heartbeat from core client for 30 sec - exiting 09:05:26 (9980): No heartbeat from core client for 30 sec - exiting 09:05:27 (9980): No heartbeat from core client for 30 sec - exiting 09:05:28 (9980): No heartbeat from core client for 30 sec - exiting 09:05:29 (9980): No heartbeat from core client for 30 sec - exiting 09:05:30 (9980): No heartbeat from core client for 30 sec - exiting 09:05:31 (9980): No heartbeat from core client for 30 sec - exiting 09:05:32 (9980): No heartbeat from core client for 30 sec - exiting 09:05:34 (9980): No heartbeat from core client for 30 sec - exiting 09:05:35 (9980): No heartbeat from core client for 30 sec - exiting 09:05:36 (9980): No heartbeat from core client for 30 sec - exiting 09:05:37 (9980): No heartbeat from core client for 30 sec - exiting 09:05:38 (9980): No heartbeat from core client for 30 sec - exiting 09:05:39 (9980): No heartbeat from core client for 30 sec - exiting 09:05:40 (9980): No heartbeat from core client for 30 sec - exiting 09:05:41 (9980): No heartbeat from core client for 30 sec - exiting 09:05:42 (9980): No heartbeat from core client for 30 sec - exiting 09:05:43 (9980): No heartbeat from core client for 30 sec - exiting 09:05:44 (9980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:17:04 (1496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4700, iMonCtr=1 Model crash detected, will try to restart... 08:08:51 (6896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:09:47 (6896): No heartbeat from core client for 30 sec - exiting 08:09:48 (6896): No heartbeat from core client for 30 sec - exiting 08:09:49 (6896): No heartbeat from core client for 30 sec - exiting 08:09:50 (6896): No heartbeat from core client for 30 sec - exiting 08:09:51 (6896): No heartbeat from core client for 30 sec - exiting 08:09:52 (6896): No heartbeat from core client for 30 sec - exiting 08:09:53 (6896): No heartbeat from core client for 30 sec - exiting 08:09:54 (6896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:55:55 (2088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:56:08 (2088): No heartbeat from core client for 30 sec - exiting 09:56:09 (2088): No heartbeat from core client for 30 sec - exiting 09:56:10 (2088): No heartbeat from core client for 30 sec - exiting 09:56:13 (2088): No heartbeat from core client for 30 sec - exiting 09:56:14 (2088): No heartbeat from core client for 30 sec - exiting 09:56:15 (2088): No heartbeat from core client for 30 sec - exiting 09:56:16 (2088): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1696, iMonCtr=1 Model crash detected, will try to restart... 16:00:02 (4700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:00:31 (4700): No heartbeat from core client for 30 sec - exiting 16:00:32 (4700): No heartbeat from core client for 30 sec - exiting 16:00:34 (4700): No heartbeat from core client for 30 sec - exiting 16:00:35 (4700): No heartbeat from core client for 30 sec - exiting 16:00:36 (4700): No heartbeat from core client for 30 sec - exiting 16:00:37 (4700): No heartbeat from core client for 30 sec - exiting 16:00:38 (4700): No heartbeat from core client for 30 sec - exiting 16:00:39 (4700): No heartbeat from core client for 30 sec - exiting 16:00:40 (4700): No heartbeat from core client for 30 sec - exiting 16:00:41 (4700): No heartbeat from core client for 30 sec - exiting 16:00:42 (4700): No heartbeat from core client for 30 sec - exiting 16:00:43 (4700): No heartbeat from core client for 30 sec - exiting 16:00:44 (4700): No heartbeat from core client for 30 sec - exiting 16:00:45 (4700): No heartbeat from core client for 30 sec - exiting 16:00:46 (4700): No heartbeat from core client for 30 sec - exiting 16:00:47 (4700): No heartbeat from core client for 30 sec - exiting 16:00:48 (4700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77593AC3 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x76F43AC3 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Mar 2014 22:19:51	1208393	16275676	hadcm3n_7h1n_1980_40_008433374_2	259,200	779,931	3.0090
05 Mar 2014 01:26:15	1208393	16275676	hadcm3n_7h1n_1980_40_008433374_2	233,280	708,551	3.0373
28 Feb 2014 17:51:35	1208393	16275676	hadcm3n_7h1n_1980_40_008433374_2	207,360	640,961	3.0911
26 Feb 2014 15:36:13	1208393	16275676	hadcm3n_7h1n_1980_40_008433374_2	181,440	569,431	3.1384
24 Feb 2014 15:57:53	1208393	16275676	hadcm3n_7h1n_1980_40_008433374_2	155,520	501,019	3.2216
20 Feb 2014 14:22:41	1208393	16275676	hadcm3n_7h1n_1980_40_008433374_2	129,600	430,889	3.3248
16 Feb 2014 02:42:46	1208393	16275676	hadcm3n_7h1n_1980_40_008433374_2	103,680	362,576	3.4971
05 Feb 2014 19:27:38	1208393	16275676	hadcm3n_7h1n_1980_40_008433374_2	77,760	262,399	3.3745
30 Jan 2014 17:07:43	1208393	16275676	hadcm3n_7h1n_1980_40_008433374_2	51,840	163,744	3.1586
26 Jan 2014 23:55:59	1208393	16275676	hadcm3n_7h1n_1980_40_008433374_2	25,920	79,194	3.0553