Task 15824175

Name	hadcm3n_o7q6_1980_40_008388150_0
Workunit	8539009
Created	3 Jun 2013, 12:24:20 UTC
Sent	3 Jun 2013, 12:35:02 UTC
Report deadline	2 Sep 2013, 20:02:13 UTC
Received	24 Jul 2013, 20:02:54 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1284149
Run time	7 days 8 hours 40 min 39 sec
CPU time	6 days 10 hours 33 min 13 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.33 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:04:07 (3848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:04:09 (3848): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:53:23 (2748): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 07:53:26 (2748): No heartbeat from core client for 30 sec - exiting 07:53:27 (2748): No heartbeat from core client for 30 sec - exiting 07:53:28 (2748): No heartbeat from core client for 30 sec - exiting 07:53:29 (2748): No heartbeat from core client for 30 sec - exiting 07:53:31 (2748): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:07:28 (4308): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 06:07:30 (4308): No heartbeat from core client for 30 sec - exiting 06:07:31 (4308): No heartbeat from core client for 30 sec - exiting 06:07:33 (4308): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:15:16 (3128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:15:19 (3128): No heartbeat from core client for 30 sec - exiting 13:15:20 (3128): No heartbeat from core client for 30 sec - exiting 13:15:21 (3128): No heartbeat from core client for 30 sec - exiting 13:15:22 (3128): No heartbeat from core client for 30 sec - exiting 13:15:23 (3128): No heartbeat from core client for 30 sec - exiting 13:18:34 (5252): No heartbeat from core client for 30 sec - exiting 13:18:35 (5252): No heartbeat from core client for 30 sec - exiting 13:18:36 (5252): No heartbeat from core client for 30 sec - exiting 13:18:37 (5252): No heartbeat from core client for 30 sec - exiting 13:18:38 (5252): No heartbeat from core client for 30 sec - exiting 13:18:39 (5252): No heartbeat from core client for 30 sec - exiting 13:18:40 (5252): No heartbeat from core client for 30 sec - exiting 13:18:41 (5252): No heartbeat from core client for 30 sec - exiting 13:18:42 (5252): No heartbeat from core client for 30 sec - exiting 13:18:43 (5252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4448, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4260, iMonCtr=1 Model crash detected, will try to restart... CSuspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4020, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 08:19:18 (4284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2480, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2072, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:25:29 (4364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:26:07 (4708): No heartbeat from core client for 30 sec - exiting 15:26:08 (4708): No heartbeat from core client for 30 sec - exiting 15:26:09 (4708): No heartbeat from core client for 30 sec - exiting 15:26:10 (4708): No heartbeat from core client for 30 sec - exiting 15:26:11 (4708): No heartbeat from core client for 30 sec - exiting 15:26:12 (4708): No heartbeat from core client for 30 sec - exiting 15:26:13 (4708): No heartbeat from core client for 30 sec - exiting 15:26:14 (4708): No heartbeat from core client for 30 sec - exiting 15:26:15 (4708): No heartbeat from core client for 30 sec - exiting 15:26:16 (4708): No heartbeat from core client for 30 sec - exiting 15:26:17 (4708): No heartbeat from core client for 30 sec - exiting 15:26:18 (4708): No heartbeat from core client for 30 sec - exiting 15:26:19 (4708): No heartbeat from core client for 30 sec - exiting 15:26:20 (4708): No heartbeat from core client for 30 sec - exiting 15:26:21 (4708): No heartbeat from core client for 30 sec - exiting 15:26:22 (4708): No heartbeat from core client for 30 sec - exiting 15:26:23 (4708): No heartbeat from core client for 30 sec - exiting 15:26:24 (4708): No heartbeat from core client for 30 sec - exiting 15:26:25 (4708): No heartbeat from core client for 30 sec - exiting 15:26:26 (4708): No heartbeat from core client for 30 sec - exiting 15:26:27 (4708): No heartbeat from core client for 30 sec - exiting 15:26:28 (4708): No heartbeat from core client for 30 sec - exiting 15:26:29 (4708): No heartbeat from core client for 30 sec - exiting 15:26:30 (4708): No heartbeat from core client for 30 sec - exiting 15:26:31 (4708): No heartbeat from core client for 30 sec - exiting 15:26:32 (4708): No heartbeat from core client for 30 sec - exiting 15:26:33 (4708): No heartbeat from core client for 30 sec - exiting 15:26:34 (4708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2176, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6112, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4092, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:29:26 (5792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:27:04 (3460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:37:29 (5320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:37:38 (5320): No heartbeat from core client for 30 sec - exiting 11:37:39 (5320): No heartbeat from core client for 30 sec - exiting 11:37:42 (5320): No heartbeat from core client for 30 sec - exiting 11:37:43 (5320): No heartbeat from core client for 30 sec - exiting 11:37:44 (5320): No heartbeat from core client for 30 sec - exiting 11:37:45 (5320): No heartbeat from core client for 30 sec - exiting 11:37:46 (5320): No heartbeat from core client for 30 sec - exiting 11:37:47 (5320): No heartbeat from core client for 30 sec - exiting 11:39:54 (2572): No heartbeat from core client for 30 sec - exiting 11:39:55 (2572): No heartbeat from core client for 30 sec - exiting 11:39:56 (2572): No heartbeat from core client for 30 sec - exiting 11:39:57 (2572): No heartbeat from core client for 30 sec - exiting 11:39:58 (2572): No heartbeat from core client for 30 sec - exiting 11:39:59 (2572): No heartbeat from core client for 30 sec - exiting 11:40:00 (2572): No heartbeat from core client for 30 sec - exiting 11:40:01 (2572): No heartbeat from core client for 30 sec - exiting 11:40:02 (2572): No heartbeat from core client for 30 sec - exiting 11:40:03 (2572): No heartbeat from core client for 30 sec - exiting 11:40:04 (2572): No heartbeat from core client for 30 sec - exiting 11:40:05 (2572): No heartbeat from core client for 30 sec - exiting 11:40:06 (2572): No heartbeat from core client for 30 sec - exiting 11:40:07 (2572): No heartbeat from core client for 30 sec - exiting 11:40:08 (2572): No heartbeat from core client for 30 sec - exiting 11:40:09 (2572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:02:27 (6008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:18:40 (5780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:18:42 (5780): No heartbeat from core client for 30 sec - exiting 14:09:25 (4908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:04:35 (6016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CSuspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2880, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:49:15 (5448): No heartbeat from core client for 30 sec - exiting 09:49:16 (5448): No heartbeat from core client for 30 sec - exiting 09:49:17 (5448): No heartbeat from core client for 30 sec - exiting 09:49:18 (5448): No heartbeat from core client for 30 sec - exiting 09:49:19 (5448): No heartbeat from core client for 30 sec - exiting 09:49:20 (5448): No heartbeat from core client for 30 sec - exiting 09:49:21 (5448): No heartbeat from core client for 30 sec - exiting 09:49:22 (5448): No heartbeat from core client for 30 sec - exiting 09:49:23 (5448): No heartbeat from core client for 30 sec - exiting 09:49:24 (5448): No heartbeat from core client for 30 sec - exiting 09:49:25 (5448): No heartbeat from core client for 30 sec - exiting 09:49:26 (5448): No heartbeat from core client for 30 sec - exiting 09:49:27 (5448): No heartbeat from core client for 30 sec - exiting 09:49:28 (5448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5792, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:49:47 (3284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77BC7215 read attempt to address 0x431C0121 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77C7B3F5 read attempt to address 0x4371D17B Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 Jul 2013 22:04:21	1284149	15824175	hadcm3n_o7q6_1980_40_008388150_0	259,200	556,498	2.1470
23 Jul 2013 20:20:27	1284149	15824175	hadcm3n_o7q6_1980_40_008388150_0	233,280	499,518	2.1413
23 Jul 2013 19:43:49	1284149	15824175	hadcm3n_o7q6_1980_40_008388150_0	207,360	436,327	2.1042
02 Jul 2013 10:04:57	1284149	15824175	hadcm3n_o7q6_1980_40_008388150_0	181,440	375,591	2.0701
22 Jun 2013 14:58:57	1284149	15824175	hadcm3n_o7q6_1980_40_008388150_0	155,520	310,463	1.9963
17 Jun 2013 21:47:55	1284149	15824175	hadcm3n_o7q6_1980_40_008388150_0	129,600	249,870	1.9280
17 Jun 2013 03:53:57	1284149	15824175	hadcm3n_o7q6_1980_40_008388150_0	103,680	193,842	1.8696
12 Jun 2013 04:03:56	1284149	15824175	hadcm3n_o7q6_1980_40_008388150_0	77,760	143,649	1.8473
08 Jun 2013 16:02:04	1284149	15824175	hadcm3n_o7q6_1980_40_008388150_0	51,840	96,248	1.8566
05 Jun 2013 19:07:08	1284149	15824175	hadcm3n_o7q6_1980_40_008388150_0	25,920	47,818	1.8448