Task 15905541

Name	hadcm3n_4988_2020_40_008404325_3
Workunit	8555181
Created	24 Jul 2013, 8:27:23 UTC
Sent	24 Jul 2013, 8:36:27 UTC
Report deadline	23 Oct 2013, 16:03:38 UTC
Received	14 Sep 2013, 7:00:40 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1168944
Run time	6 days 16 hours 3 min 55 sec
CPU time	6 days 9 hours 56 min 39 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.09 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> 11:01:15 (4044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3776, iMonCtr=1 Model crash detected, will try to restart... 18:55:42 (3700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:14:30 (3892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2856, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:43:47 (2940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:47:30 (3460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:52:54 (2780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77A23AC3 read attempt to address 0x40F9F14C Engaging BOINC Windows Runtime Debugger... 18:59:07 (1856): No heartbeat from core client for 30 sec - exiting 18:59:08 (1856): No heartbeat from core client for 30 sec - exiting 18:59:09 (1856): No heartbeat from core client for 30 sec - exiting 18:59:10 (1856): No heartbeat from core client for 30 sec - exiting 18:59:11 (1856): No heartbeat from core client for 30 sec - exiting 18:59:12 (1856): No heartbeat from core client for 30 sec - exiting 18:59:13 (1856): No heartbeat from core client for 30 sec - exiting 18:59:14 (1856): No heartbeat from core client for 30 sec - exiting 18:59:15 (1856): No heartbeat from core client for 30 sec - exiting 18:59:16 (1856): No heartbeat from core client for 30 sec - exiting 18:59:18 (1856): No heartbeat from core client for 30 sec - exiting 18:59:19 (1856): No heartbeat from core client for 30 sec - exiting 18:59:20 (1856): No heartbeat from core client for 30 sec - exiting 18:59:21 (1856): No heartbeat from core client for 30 sec - exiting 18:59:22 (1856): No heartbeat from core client for 30 sec - exiting 18:59:23 (1856): No heartbeat from core client for 30 sec - exiting 18:59:24 (1856): No heartbeat from core client for 30 sec - exiting 18:59:25 (1856): No heartbeat from core client for 30 sec - exiting 18:59:26 (1856): No heartbeat from core client for 30 sec - exiting 18:59:27 (1856): No heartbeat from core client for 30 sec - exiting 18:59:28 (1856): No heartbeat from core client for 30 sec - exiting 18:59:30 (1856): No heartbeat from core client for 30 sec - exiting 18:59:31 (1856): No heartbeat from core client for 30 sec - exiting 18:59:32 (1856): No heartbeat from core client for 30 sec - exiting 18:59:33 (1856): No heartbeat from core client for 30 sec - exiting 18:59:34 (1856): No heartbeat from core client for 30 sec - exiting 18:59:35 (1856): No heartbeat from core client for 30 sec - exiting 18:59:36 (1856): No heartbeat from core client for 30 sec - exiting 18:59:37 (1856): No heartbeat from core client for 30 sec - exiting 18:59:38 (1856): No heartbeat from core client for 30 sec - exiting 18:59:39 (1856): No heartbeat from core client for 30 sec - exiting 18:59:40 (1856): No heartbeat from core client for 30 sec - exiting 18:59:42 (1856): No heartbeat from core client for 30 sec - exiting 18:59:43 (1856): No heartbeat from core client for 30 sec - exiting 18:59:44 (1856): No heartbeat from core client for 30 sec - exiting 18:59:45 (1856): No heartbeat from core client for 30 sec - exiting 18:59:46 (1856): No heartbeat from core client for 30 sec - exiting 18:59:47 (1856): No heartbeat from core client for 30 sec - exiting 18:59:48 (1856): No heartbeat from core client for 30 sec - exiting 18:59:49 (1856): No heartbeat from core client for 30 sec - exiting 18:59:50 (1856): No heartbeat from core client for 30 sec - exiting 18:59:51 (1856): No heartbeat from core client for 30 sec - exiting 18:59:52 (1856): No heartbeat from core client for 30 sec - exiting 18:59:54 (1856): No heartbeat from core client for 30 sec - exiting 18:59:55 (1856): No heartbeat from core client for 30 sec - exiting 18:59:56 (1856): No heartbeat from core client for 30 sec - exiting 18:59:57 (1856): No heartbeat from core client for 30 sec - exiting 18:59:58 (1856): No heartbeat from core client for 30 sec - exiting 18:59:59 (1856): No heartbeat from core client for 30 sec - exiting 19:00:00 (1856): No heartbeat from core client for 30 sec - exiting 19:00:01 (1856): No heartbeat from core client for 30 sec - exiting 19:00:02 (1856): No heartbeat from core client for 30 sec - exiting 19:00:03 (1856): No heartbeat from core client for 30 sec - exiting 19:00:04 (1856): No heartbeat from core client for 30 sec - exiting 19:00:06 (1856): No heartbeat from core client for 30 sec - exiting 19:00:07 (1856): No heartbeat from core client for 30 sec - exiting 19:00:08 (1856): No heartbeat from core client for 30 sec - exiting 19:00:09 (1856): No heartbeat from core client for 30 sec - exiting 19:00:10 (1856): No heartbeat from core client for 30 sec - exiting 19:00:11 (1856): No heartbeat from core client for 30 sec - exiting 19:00:12 (1856): No heartbeat from core client for 30 sec - exiting 19:00:13 (1856): No heartbeat from core client for 30 sec - exiting 19:00:14 (1856): No heartbeat from core client for 30 sec - exiting 19:00:15 (1856): No heartbeat from core client for 30 sec - exiting 19:00:16 (1856): No heartbeat from core client for 30 sec - exiting 19:00:18 (1856): No heartbeat from core client for 30 sec - exiting 19:00:19 (1856): No heartbeat from core client for 30 sec - exiting 19:00:20 (1856): No heartbeat from core client for 30 sec - exiting 19:00:21 (1856): No heartbeat from core client for 30 sec - exiting 19:00:22 (1856): No heartbeat from core client for 30 sec - exiting 19:00:23 (1856): No heartbeat from core client for 30 sec - exiting 19:00:24 (1856): No heartbeat from core client for 30 sec - exiting 19:00:25 (1856): No heartbeat from core client for 30 sec - exiting 19:00:26 (1856): No heartbeat from core client for 30 sec - exiting 19:00:27 (1856): No heartbeat from core client for 30 sec - exiting 19:00:28 (1856): No heartbeat from core client for 30 sec - exiting 19:00:30 (1856): No heartbeat from core client for 30 sec - exiting 19:00:31 (1856): No heartbeat from core client for 30 sec - exiting 19:00:32 (1856): No heartbeat from core client for 30 sec - exiting 19:00:33 (1856): No heartbeat from core client for 30 sec - exiting 19:00:34 (1856): No heartbeat from core client for 30 sec - exiting 19:00:35 (1856): No heartbeat from core client for 30 sec - exiting 19:00:36 (1856): No heartbeat from core client for 30 sec - exiting 19:00:37 (1856): No heartbeat from core client for 30 sec - exiting 19:00:38 (1856): No heartbeat from core client for 30 sec - exiting 19:00:39 (1856): No heartbeat from core client for 30 sec - exiting 19:00:41 (1856): No heartbeat from core client for 30 sec - exiting 19:00:42 (1856): No heartbeat from core client for 30 sec - exiting 19:00:43 (1856): No heartbeat from core client for 30 sec - exiting 19:00:44 (1856): No heartbeat from core client for 30 sec - exiting 19:00:45 (1856): No heartbeat from core client for 30 sec - exiting 19:00:46 (1856): No heartbeat from core client for 30 sec - exiting 19:00:47 (1856): No heartbeat from core client for 30 sec - exiting 19:00:48 (1856): No heartbeat from core client for 30 sec - exiting 19:00:49 (1856): No heartbeat from core client for 30 sec - exiting 19:00:50 (1856): No heartbeat from core client for 30 sec - exiting 19:00:51 (1856): No heartbeat from core client for 30 sec - exiting 19:00:53 (1856): No heartbeat from core client for 30 sec - exiting 19:00:54 (1856): No heartbeat from core client for 30 sec - exiting 19:00:55 (1856): No heartbeat from core client for 30 sec - exiting 19:00:56 (1856): No heartbeat from core client for 30 sec - exiting 19:00:57 (1856): No heartbeat from core client for 30 sec - exiting 19:00:58 (1856): No heartbeat from core client for 30 sec - exiting 19:00:59 (1856): No heartbeat from core client for 30 sec - exiting 19:01:00 (1856): No heartbeat from core client for 30 sec - exiting 19:01:01 (1856): No heartbeat from core client for 30 sec - exiting Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77CD3AC3 read attempt to address 0x40F9F14C Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_4988_2020_40_008404325/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
13 Sep 2013 14:17:19	1168944	15905541	hadcm3n_4988_2020_40_008404325_3	259,200	529,999	2.0447
12 Sep 2013 14:41:32	1168944	15905541	hadcm3n_4988_2020_40_008404325_3	233,280	476,725	2.0436
11 Sep 2013 15:42:53	1168944	15905541	hadcm3n_4988_2020_40_008404325_3	207,360	424,469	2.0470
10 Sep 2013 16:41:37	1168944	15905541	hadcm3n_4988_2020_40_008404325_3	181,440	371,466	2.0473
09 Sep 2013 17:23:00	1168944	15905541	hadcm3n_4988_2020_40_008404325_3	155,520	318,820	2.0500
08 Sep 2013 18:04:37	1168944	15905541	hadcm3n_4988_2020_40_008404325_3	129,600	266,290	2.0547
07 Sep 2013 16:26:05	1168944	15905541	hadcm3n_4988_2020_40_008404325_3	103,680	213,671	2.0609
06 Sep 2013 17:35:13	1168944	15905541	hadcm3n_4988_2020_40_008404325_3	77,760	160,727	2.0670
05 Sep 2013 18:41:55	1168944	15905541	hadcm3n_4988_2020_40_008404325_3	51,840	108,683	2.0965
04 Sep 2013 19:50:01	1168944	15905541	hadcm3n_4988_2020_40_008404325_3	25,920	55,773	2.1517