Task 14403501

Name	hadcm3n_o4zv_2020_40_007857484_4
Workunit	8012596
Created	14 Apr 2012, 19:10:18 UTC
Sent	14 Apr 2012, 19:10:23 UTC
Report deadline	15 Jul 2012, 2:37:34 UTC
Received	18 May 2012, 21:58:15 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1188208
Run time	8 days 7 hours 12 min 13 sec
CPU time	7 days 22 hours 16 min 57 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.22 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3648, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4360, iMonCtr=1 Model crash detected, will try to restart... 00:14:42 (3224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:14:43 (3224): No heartbeat from core client for 30 sec - exiting 00:14:44 (3224): No heartbeat from core client for 30 sec - exiting 00:14:45 (3224): No heartbeat from core client for 30 sec - exiting 00:14:46 (3224): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 19:58:36 (3648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:53:12 (4204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:22:54 (3288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1588, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3744, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:24:15 (3300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:10:23 (3716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4768, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:44:31 (3824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:16:36 (4080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:49:11 (5004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:49:34 (5136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:48:21 (5792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:40:01 (2472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:46:59 (5392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:39:28 (4700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:39:29 (4700): No heartbeat from core client for 30 sec - exiting 09:39:30 (4700): No heartbeat from core client for 30 sec - exiting 09:39:31 (4700): No heartbeat from core client for 30 sec - exiting 09:39:33 (4700): No heartbeat from core client for 30 sec - exiting 09:39:34 (4700): No heartbeat from core client for 30 sec - exiting 09:39:35 (4700): No heartbeat from core client for 30 sec - exiting 09:39:36 (4700): No heartbeat from core client for 30 sec - exiting 09:39:37 (4700): No heartbeat from core client for 30 sec - exiting 09:39:38 (4700): No heartbeat from core client for 30 sec - exiting 09:39:39 (4700): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 11:09:11 (6036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:13:50 (1368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3888, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:34:32 (3492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77123AB3 read attempt to address 0x405148DD Engaging BOINC Windows Runtime Debugger... 22:20:44 (5788): No heartbeat from core client for 30 sec - exiting 22:20:45 (5788): No heartbeat from core client for 30 sec - exiting 22:20:46 (5788): No heartbeat from core client for 30 sec - exiting 22:20:47 (5788): No heartbeat from core client for 30 sec - exiting 22:20:48 (5788): No heartbeat from core client for 30 sec - exiting 22:20:49 (5788): No heartbeat from core client for 30 sec - exiting 22:20:50 (5788): No heartbeat from core client for 30 sec - exiting 22:20:52 (5788): No heartbeat from core client for 30 sec - exiting 22:20:53 (5788): No heartbeat from core client for 30 sec - exiting 22:20:54 (5788): No heartbeat from core client for 30 sec - exiting 22:20:55 (5788): No heartbeat from core client for 30 sec - exiting 22:20:56 (5788): No heartbeat from core client for 30 sec - exiting 22:20:57 (5788): No heartbeat from core client for 30 sec - exiting 22:20:58 (5788): No heartbeat from core client for 30 sec - exiting 22:20:59 (5788): No heartbeat from core client for 30 sec - exiting 22:21:00 (5788): No heartbeat from core client for 30 sec - exiting 22:21:01 (5788): No heartbeat from core client for 30 sec - exiting 22:21:02 (5788): No heartbeat from core client for 30 sec - exiting 22:21:03 (5788): No heartbeat from core client for 30 sec - exiting 22:21:04 (5788): No heartbeat from core client for 30 sec - exiting 22:21:05 (5788): No heartbeat from core client for 30 sec - exiting 22:21:06 (5788): No heartbeat from core client for 30 sec - exiting 22:21:07 (5788): No heartbeat from core client for 30 sec - exiting 22:21:08 (5788): No heartbeat from core client for 30 sec - exiting 22:21:09 (5788): No heartbeat from core client for 30 sec - exiting 22:21:10 (5788): No heartbeat from core client for 30 sec - exiting 22:21:11 (5788): No heartbeat from core client for 30 sec - exiting 22:21:12 (5788): No heartbeat from core client for 30 sec - exiting 22:21:13 (5788): No heartbeat from core client for 30 sec - exiting 22:21:14 (5788): No heartbeat from core client for 30 sec - exiting 22:21:15 (5788): No heartbeat from core client for 30 sec - exiting 22:21:16 (5788): No heartbeat from core client for 30 sec - exiting 22:21:17 (5788): No heartbeat from core client for 30 sec - exiting Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
18 May 2012 02:23:29	1188208	14403501	hadcm3n_o4zv_2020_40_007857484_4	259,200	662,134	2.5545
15 May 2012 23:52:06	1188208	14403501	hadcm3n_o4zv_2020_40_007857484_4	233,280	600,464	2.5740
14 May 2012 20:43:10	1188208	14403501	hadcm3n_o4zv_2020_40_007857484_4	207,360	536,986	2.5896
13 May 2012 15:25:56	1188208	14403501	hadcm3n_o4zv_2020_40_007857484_4	181,440	475,501	2.6207
12 May 2012 16:27:43	1188208	14403501	hadcm3n_o4zv_2020_40_007857484_4	155,520	398,601	2.5630
09 May 2012 15:58:45	1188208	14403501	hadcm3n_o4zv_2020_40_007857484_4	129,600	330,562	2.5506
08 May 2012 05:13:28	1188208	14403501	hadcm3n_o4zv_2020_40_007857484_4	103,680	264,861	2.5546
03 May 2012 14:01:17	1188208	14403501	hadcm3n_o4zv_2020_40_007857484_4	77,760	196,288	2.5243
30 Apr 2012 18:03:04	1188208	14403501	hadcm3n_o4zv_2020_40_007857484_4	51,840	132,242	2.5510
18 Apr 2012 01:08:03	1188208	14403501	hadcm3n_o4zv_2020_40_007857484_4	25,920	67,377	2.5994