Task 16071286

Name	hadcm3n_zdmo_1960_40_008362554_3
Workunit	8513413
Created	21 Oct 2013, 9:13:50 UTC
Sent	21 Oct 2013, 9:14:04 UTC
Report deadline	20 Jan 2014, 16:41:15 UTC
Received	19 Nov 2013, 5:15:20 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1297903
Run time	8 days 10 hours 51 min 56 sec
CPU time	8 days 9 hours 53 min 50 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	2.58 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> (unknown error) - exit code -1073741819 (0xc0000005) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:08:54 (2500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:08:55 (2500): No heartbeat from core client for 30 sec - exiting 09:08:56 (2500): No heartbeat from core client for 30 sec - exiting 09:08:57 (2500): No heartbeat from core client for 30 sec - exiting 09:08:58 (2500): No heartbeat from core client for 30 sec - exiting 09:09:00 (2500): No heartbeat from core client for 30 sec - exiting 09:09:01 (2500): No heartbeat from core client for 30 sec - exiting 09:09:02 (2500): No heartbeat from core client for 30 sec - exiting 09:09:03 (2500): No heartbeat from core client for 30 sec - exiting 09:09:04 (2500): No heartbeat from core client for 30 sec - exiting 09:09:39 (2792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:09:40 (2792): No heartbeat from core client for 30 sec - exiting 09:09:41 (2792): No heartbeat from core client for 30 sec - exiting 09:09:42 (2792): No heartbeat from core client for 30 sec - exiting 09:09:43 (2792): No heartbeat from core client for 30 sec - exiting 09:09:45 (2792): No heartbeat from core client for 30 sec - exiting 09:09:46 (2792): No heartbeat from core client for 30 sec - exiting 09:09:47 (2792): No heartbeat from core client for 30 sec - exiting 09:09:48 (2792): No heartbeat from core client for 30 sec - exiting 09:09:49 (2792): No heartbeat from core client for 30 sec - exiting 09:09:50 (2792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2652, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3008, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3008, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 09:20:52 (3780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:20:53 (3780): No heartbeat from core client for 30 sec - exiting 09:20:54 (3780): No heartbeat from core client for 30 sec - exiting 09:20:55 (3780): No heartbeat from core client for 30 sec - exiting 09:20:56 (3780): No heartbeat from core client for 30 sec - exiting 09:20:57 (3780): No heartbeat from core client for 30 sec - exiting 09:20:58 (3780): No heartbeat from core client for 30 sec - exiting 09:20:59 (3780): No heartbeat from core client for 30 sec - exiting 09:21:00 (3780): No heartbeat from core client for 30 sec - exiting 09:21:01 (3780): No heartbeat from core client for 30 sec - exiting 09:21:02 (3780): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3460, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3348, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x776EFF6B write attempt to address 0xC240F7AC Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x773C3AC3 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
18 Nov 2013 13:54:45	1297903	16071286	hadcm3n_zdmo_1960_40_008362554_3	518,400	723,433	1.3955
15 Nov 2013 13:57:11	1297903	16071286	hadcm3n_zdmo_1960_40_008362554_3	492,480	680,116	1.3810
14 Nov 2013 11:19:05	1297903	16071286	hadcm3n_zdmo_1960_40_008362554_3	466,560	640,712	1.3733
13 Nov 2013 11:21:43	1297903	16071286	hadcm3n_zdmo_1960_40_008362554_3	440,640	607,207	1.3780
12 Nov 2013 13:07:55	1297903	16071286	hadcm3n_zdmo_1960_40_008362554_3	414,720	573,181	1.3821
11 Nov 2013 13:12:59	1297903	16071286	hadcm3n_zdmo_1960_40_008362554_3	388,800	540,292	1.3896
09 Nov 2013 08:30:59	1297903	16071286	hadcm3n_zdmo_1960_40_008362554_3	362,880	506,976	1.3971
08 Nov 2013 05:41:29	1297903	16071286	hadcm3n_zdmo_1960_40_008362554_3	336,960	472,996	1.4037
06 Nov 2013 13:03:04	1297903	16071286	hadcm3n_zdmo_1960_40_008362554_3	311,040	434,792	1.3979
06 Nov 2013 06:26:49	1297903	16071286	hadcm3n_zdmo_1960_40_008362554_3	285,120	396,784	1.3916
02 Nov 2013 08:43:14	1297903	16071286	hadcm3n_zdmo_1960_40_008362554_3	259,200	358,821	1.3843
01 Nov 2013 07:42:04	1297903	16071286	hadcm3n_zdmo_1960_40_008362554_3	233,280	320,630	1.3744
31 Oct 2013 06:18:37	1297903	16071286	hadcm3n_zdmo_1960_40_008362554_3	207,360	282,443	1.3621
30 Oct 2013 06:16:49	1297903	16071286	hadcm3n_zdmo_1960_40_008362554_3	181,440	244,662	1.3484
29 Oct 2013 07:07:00	1297903	16071286	hadcm3n_zdmo_1960_40_008362554_3	155,520	206,655	1.3288
28 Oct 2013 05:49:14	1297903	16071286	hadcm3n_zdmo_1960_40_008362554_3	129,600	168,922	1.3034
25 Oct 2013 06:47:17	1297903	16071286	hadcm3n_zdmo_1960_40_008362554_3	103,680	131,361	1.2670
24 Oct 2013 06:43:07	1297903	16071286	hadcm3n_zdmo_1960_40_008362554_3	77,760	94,889	1.2203
23 Oct 2013 06:30:52	1297903	16071286	hadcm3n_zdmo_1960_40_008362554_3	51,840	63,373	1.2225
22 Oct 2013 09:02:54	1297903	16071286	hadcm3n_zdmo_1960_40_008362554_3	25,920	30,918	1.1928