Task 15498205

Name	hadcm3n_3gwf_1940_40_008268361_0
Workunit	8423485
Created	21 Dec 2012, 23:01:53 UTC
Sent	22 Dec 2012, 0:30:36 UTC
Report deadline	23 Mar 2013, 7:57:47 UTC
Received	9 Feb 2013, 15:10:21 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1259669
Run time	26 days 23 hours 39 min 22 sec
CPU time	24 days 8 hours 36 min 40 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	2.21 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=276, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:46:36 (3368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3080, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1992, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3840, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1000, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x00417B59 read attempt to address 0x43906004 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x777B8851 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_3gwf_1940_40_008268361/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
08 Feb 2013 03:45:09	1259669	15498205	hadcm3n_3gwf_1940_40_008268361_0	777,600	2,102,392	2.7037
06 Feb 2013 04:22:14	1259669	15498205	hadcm3n_3gwf_1940_40_008268361_0	751,680	2,031,399	2.7025
05 Feb 2013 06:56:31	1259669	15498205	hadcm3n_3gwf_1940_40_008268361_0	725,760	1,961,016	2.7020
01 Feb 2013 09:16:55	1259669	15498205	hadcm3n_3gwf_1940_40_008268361_0	699,840	1,892,802	2.7046
30 Jan 2013 20:22:21	1259669	15498205	hadcm3n_3gwf_1940_40_008268361_0	673,920	1,823,680	2.7061
29 Jan 2013 16:15:42	1259669	15498205	hadcm3n_3gwf_1940_40_008268361_0	648,000	1,753,322	2.7057
25 Jan 2013 21:37:34	1259669	15498205	hadcm3n_3gwf_1940_40_008268361_0	622,080	1,683,331	2.7060
24 Jan 2013 20:36:42	1259669	15498205	hadcm3n_3gwf_1940_40_008268361_0	596,160	1,609,550	2.6999
23 Jan 2013 11:13:37	1259669	15498205	hadcm3n_3gwf_1940_40_008268361_0	570,240	1,535,413	2.6926
15 Jan 2013 23:10:08	1259669	15498205	hadcm3n_3gwf_1940_40_008268361_0	544,320	1,461,874	2.6857
13 Jan 2013 18:56:21	1259669	15498205	hadcm3n_3gwf_1940_40_008268361_0	518,400	1,390,533	2.6824
12 Jan 2013 17:51:21	1259669	15498205	hadcm3n_3gwf_1940_40_008268361_0	492,480	1,318,166	2.6766
11 Jan 2013 19:19:48	1259669	15498205	hadcm3n_3gwf_1940_40_008268361_0	466,560	1,249,273	2.6776
10 Jan 2013 15:30:43	1259669	15498205	hadcm3n_3gwf_1940_40_008268361_0	440,640	1,177,354	2.6719
08 Jan 2013 19:05:44	1259669	15498205	hadcm3n_3gwf_1940_40_008268361_0	414,720	1,108,321	2.6725
06 Jan 2013 19:15:37	1259669	15498205	hadcm3n_3gwf_1940_40_008268361_0	388,800	1,041,024	2.6775
04 Jan 2013 15:14:44	1259669	15498205	hadcm3n_3gwf_1940_40_008268361_0	362,880	968,209	2.6681
03 Jan 2013 19:17:13	1259669	15498205	hadcm3n_3gwf_1940_40_008268361_0	336,960	899,741	2.6702
03 Jan 2013 00:09:02	1259669	15498205	hadcm3n_3gwf_1940_40_008268361_0	311,040	832,281	2.6758
01 Jan 2013 09:01:24	1259669	15498205	hadcm3n_3gwf_1940_40_008268361_0	285,120	763,981	2.6795