Task 15173027

Name	hadcm3n_o4ou_2060_40_008166605_0
Workunit	8321729
Created	22 Aug 2012, 13:43:51 UTC
Sent	22 Aug 2012, 13:49:34 UTC
Report deadline	21 Nov 2012, 21:16:45 UTC
Received	17 Oct 2012, 8:26:37 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1183496
Run time	17 days 16 hours 45 min 47 sec
CPU time	17 days 10 hours 15 min 40 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	2.29 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> 08:01:53 (4556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5000, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4348, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4792, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1852, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4368, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4584, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CSuspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4984, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5344, iMonCtr=1 Model crash detected, will try to restart... CSuspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1580, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CCPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4700, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3256, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4908, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4908, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4908, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4908, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4908, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4308, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4308, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4308, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4308, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4308, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4396, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1028, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1028, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1028, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=264, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4332, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3184, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6260, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4604, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4604, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4744, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1880, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4500, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4672, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4672, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5220, iMonCtr=1 Model crash detected, will try to restart... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
13 Oct 2012 07:32:14	1183496	15173027	hadcm3n_o4ou_2060_40_008166605_0	1,036,800	1,505,210	1.4518
11 Oct 2012 15:06:49	1183496	15173027	hadcm3n_o4ou_2060_40_008166605_0	1,010,880	1,467,371	1.4516
10 Oct 2012 14:07:12	1183496	15173027	hadcm3n_o4ou_2060_40_008166605_0	984,960	1,430,189	1.4520
09 Oct 2012 12:51:20	1183496	15173027	hadcm3n_o4ou_2060_40_008166605_0	959,040	1,400,765	1.4606
09 Oct 2012 01:59:06	1183496	15173027	hadcm3n_o4ou_2060_40_008166605_0	933,120	1,362,009	1.4596
08 Oct 2012 14:32:13	1183496	15173027	hadcm3n_o4ou_2060_40_008166605_0	907,200	1,321,991	1.4572
07 Oct 2012 16:27:12	1183496	15173027	hadcm3n_o4ou_2060_40_008166605_0	881,280	1,282,806	1.4556
05 Oct 2012 20:08:16	1183496	15173027	hadcm3n_o4ou_2060_40_008166605_0	855,360	1,243,351	1.4536
04 Oct 2012 12:34:00	1183496	15173027	hadcm3n_o4ou_2060_40_008166605_0	829,440	1,205,703	1.4536
03 Oct 2012 11:32:01	1183496	15173027	hadcm3n_o4ou_2060_40_008166605_0	803,520	1,168,235	1.4539
02 Oct 2012 10:27:20	1183496	15173027	hadcm3n_o4ou_2060_40_008166605_0	777,600	1,131,138	1.4547
30 Sep 2012 16:33:18	1183496	15173027	hadcm3n_o4ou_2060_40_008166605_0	751,680	1,093,831	1.4552
28 Sep 2012 12:57:11	1183496	15173027	hadcm3n_o4ou_2060_40_008166605_0	725,760	1,055,787	1.4547
27 Sep 2012 11:24:43	1183496	15173027	hadcm3n_o4ou_2060_40_008166605_0	699,840	1,017,914	1.4545
26 Sep 2012 10:43:52	1183496	15173027	hadcm3n_o4ou_2060_40_008166605_0	673,920	980,319	1.4547
25 Sep 2012 09:18:05	1183496	15173027	hadcm3n_o4ou_2060_40_008166605_0	648,000	942,709	1.4548
24 Sep 2012 08:14:48	1183496	15173027	hadcm3n_o4ou_2060_40_008166605_0	622,080	905,263	1.4552
21 Sep 2012 08:37:49	1183496	15173027	hadcm3n_o4ou_2060_40_008166605_0	596,160	867,792	1.4556
20 Sep 2012 07:31:25	1183496	15173027	hadcm3n_o4ou_2060_40_008166605_0	570,240	830,315	1.4561
19 Sep 2012 07:02:43	1183496	15173027	hadcm3n_o4ou_2060_40_008166605_0	544,320	792,323	1.4556