Task 13119310

Name	hadcm3n_yj6l_1900_40_007357719_1
Workunit	7555149
Created	6 Jul 2011, 14:54:54 UTC
Sent	8 Jul 2011, 22:34:39 UTC
Report deadline	8 Oct 2011, 6:01:50 UTC
Received	20 Sep 2011, 16:41:03 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1157438
Run time	27 days 11 hours 59 min 41 sec
CPU time	26 days 12 hours 0 min 56 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	2.26 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.33</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3028, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 01:07:17 (3024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3104, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 12:51:51 (2900): No heartbeat from core client for 30 sec - exiting 12:51:52 (2900): No heartbeat from core client for 30 sec - exiting 12:51:53 (2900): No heartbeat from core client for 30 sec - exiting 12:51:54 (2900): No heartbeat from core client for 30 sec - exiting 12:51:55 (2900): No heartbeat from core client for 30 sec - exiting 12:51:56 (2900): No heartbeat from core client for 30 sec - exiting 12:51:57 (2900): No heartbeat from core client for 30 sec - exiting 12:51:58 (2900): No heartbeat from core client for 30 sec - exiting 12:51:59 (2900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:28:43 (6128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:44:10 (4312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:05:18 (3216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5932, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2804, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:37:56 (4908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2676, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3652, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2832, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2468, iMonCtr=1 Model crash detected, will try to restart... 23:48:30 (3376): No heartbeat from core client for 30 sec - exiting 23:48:31 (3376): No heartbeat from core client for 30 sec - exiting 23:48:33 (3376): No heartbeat from core client for 30 sec - exiting 23:48:34 (3376): No heartbeat from core client for 30 sec - exiting 23:48:35 (3376): No heartbeat from core client for 30 sec - exiting 23:48:36 (3376): No heartbeat from core client for 30 sec - exiting 23:48:37 (3376): No heartbeat from core client for 30 sec - exiting 23:48:38 (3376): No heartbeat from core client for 30 sec - exiting 23:48:39 (3376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:48:40 (3376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4568, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2580, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4808, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x771EB84B write attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77E871D3 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_yj6l_1900_40_007357719/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
19 Sep 2011 21:09:27	1157438	13119310	hadcm3n_yj6l_1900_40_007357719_1	777,600	2,239,857	2.8805
08 Sep 2011 15:57:04	1157438	13119310	hadcm3n_yj6l_1900_40_007357719_1	751,680	2,129,874	2.8335
01 Sep 2011 00:08:34	1157438	13119310	hadcm3n_yj6l_1900_40_007357719_1	725,760	2,018,117	2.7807
30 Aug 2011 21:23:55	1157438	13119310	hadcm3n_yj6l_1900_40_007357719_1	699,840	1,920,064	2.7436
29 Aug 2011 13:51:18	1157438	13119310	hadcm3n_yj6l_1900_40_007357719_1	673,920	1,816,579	2.6955
28 Aug 2011 04:15:47	1157438	13119310	hadcm3n_yj6l_1900_40_007357719_1	648,000	1,721,654	2.6569
26 Aug 2011 18:46:02	1157438	13119310	hadcm3n_yj6l_1900_40_007357719_1	622,080	1,644,095	2.6429
22 Aug 2011 21:39:22	1157438	13119310	hadcm3n_yj6l_1900_40_007357719_1	596,160	1,556,362	2.6106
18 Aug 2011 16:34:14	1157438	13119310	hadcm3n_yj6l_1900_40_007357719_1	570,240	1,481,131	2.5974
17 Aug 2011 12:08:53	1157438	13119310	hadcm3n_yj6l_1900_40_007357719_1	544,320	1,397,678	2.5678
09 Aug 2011 14:54:43	1157438	13119310	hadcm3n_yj6l_1900_40_007357719_1	518,400	1,315,812	2.5382
09 Aug 2011 04:57:29	1157438	13119310	hadcm3n_yj6l_1900_40_007357719_1	492,480	1,237,255	2.5123
07 Aug 2011 18:16:40	1157438	13119310	hadcm3n_yj6l_1900_40_007357719_1	466,560	1,159,557	2.4853
06 Aug 2011 21:45:39	1157438	13119310	hadcm3n_yj6l_1900_40_007357719_1	440,640	1,086,978	2.4668
04 Aug 2011 03:46:14	1157438	13119310	hadcm3n_yj6l_1900_40_007357719_1	414,720	1,015,752	2.4492
02 Aug 2011 20:49:15	1157438	13119310	hadcm3n_yj6l_1900_40_007357719_1	388,800	945,771	2.4325
27 Jul 2011 12:28:15	1157438	13119310	hadcm3n_yj6l_1900_40_007357719_1	362,880	875,533	2.4127
26 Jul 2011 20:57:27	1157438	13119310	hadcm3n_yj6l_1900_40_007357719_1	336,960	820,261	2.4343
26 Jul 2011 06:00:20	1157438	13119310	hadcm3n_yj6l_1900_40_007357719_1	311,040	766,512	2.4644
25 Jul 2011 23:00:19	1157438	13119310	hadcm3n_yj6l_1900_40_007357719_1	285,120	707,322	2.4808