Task 13651378

Name	hadcm3n_yevf_1900_40_007517721_2
Workunit	7715196
Created	21 Nov 2011, 13:58:42 UTC
Sent	21 Nov 2011, 14:06:53 UTC
Report deadline	20 Feb 2012, 21:34:04 UTC
Received	13 Dec 2011, 5:37:00 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1134605
Run time	5 days 11 hours 7 min 10 sec
CPU time	5 days 9 hours 37 min 58 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.74 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:22:33 (6540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:24:22 (2432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:26:20 (1476): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 12:38:44 (9144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:38:48 (9144): No heartbeat from core client for 30 sec - exiting 12:38:49 (9144): No heartbeat from core client for 30 sec - exiting 12:38:50 (9144): No heartbeat from core client for 30 sec - exiting 12:38:51 (9144): No heartbeat from core client for 30 sec - exiting 12:38:52 (9144): No heartbeat from core client for 30 sec - exiting 12:38:53 (9144): No heartbeat from core client for 30 sec - exiting 12:38:54 (9144): No heartbeat from core client for 30 sec - exiting 12:38:55 (9144): No heartbeat from core client for 30 sec - exiting 12:38:56 (9144): No heartbeat from core client for 30 sec - exiting 12:38:57 (9144): No heartbeat from core client for 30 sec - exiting 12:54:42 (7692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:54:45 (7692): No heartbeat from core client for 30 sec - exiting 12:54:46 (7692): No heartbeat from core client for 30 sec - exiting 12:54:47 (7692): No heartbeat from core client for 30 sec - exiting 12:54:48 (7692): No heartbeat from core client for 30 sec - exiting 12:54:49 (7692): No heartbeat from core client for 30 sec - exiting 12:54:50 (7692): No heartbeat from core client for 30 sec - exiting 12:54:51 (7692): No heartbeat from core client for 30 sec - exiting 12:54:52 (7692): No heartbeat from core client for 30 sec - exiting 12:54:53 (7692): No heartbeat from core client for 30 sec - exiting 12:54:54 (7692): No heartbeat from core client for 30 sec - exiting 12:56:33 (7396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:56:34 (7396): No heartbeat from core client for 30 sec - exiting 12:56:35 (7396): No heartbeat from core client for 30 sec - exiting 12:56:36 (7396): No heartbeat from core client for 30 sec - exiting 12:56:37 (7396): No heartbeat from core client for 30 sec - exiting 12:56:38 (7396): No heartbeat from core client for 30 sec - exiting 12:56:39 (7396): No heartbeat from core client for 30 sec - exiting 12:56:40 (7396): No heartbeat from core client for 30 sec - exiting 12:56:41 (7396): No heartbeat from core client for 30 sec - exiting 12:56:42 (7396): No heartbeat from core client for 30 sec - exiting 12:56:43 (7396): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 13:45:31 (684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:47:58 (2652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:48:47 (8756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/yevfko.pja3c10 Error converting file to netcdf: dataout/yevfko.pia3c10 Error converting file to netcdf: dataout/yevfko.pfa3c10 Error converting file to netcdf: dataout/yevfka.pha3c10 Error converting file to netcdf: dataout/yevfka.pga3c10 Error converting file to netcdf: dataout/yevfka.pea3c10 Error converting file to netcdf: dataout/yevfka.pda3c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:46:40 (8184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:06:44 (4232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:07:08 (4232): No heartbeat from core client for 30 sec - exiting 17:07:09 (4232): No heartbeat from core client for 30 sec - exiting 17:07:10 (4232): No heartbeat from core client for 30 sec - exiting 17:07:11 (4232): No heartbeat from core client for 30 sec - exiting 17:07:12 (4232): No heartbeat from core client for 30 sec - exiting 17:07:13 (4232): No heartbeat from core client for 30 sec - exiting 17:07:14 (4232): No heartbeat from core client for 30 sec - exiting 17:07:15 (4232): No heartbeat from core client for 30 sec - exiting 17:07:16 (4232): No heartbeat from core client for 30 sec - exiting 17:07:17 (4232): No heartbeat from core client for 30 sec - exiting 17:27:00 (6724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:29:14 (6916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:08:01 (6252): No heartbeat from core client for 30 sec - exiting 20:08:02 (6252): No heartbeat from core client for 30 sec - exiting 20:08:03 (6252): No heartbeat from core client for 30 sec - exiting 20:08:04 (6252): No heartbeat from core client for 30 sec - exiting 20:08:06 (6252): No heartbeat from core client for 30 sec - exiting 20:08:07 (6252): No heartbeat from core client for 30 sec - exiting 20:08:08 (6252): No heartbeat from core client for 30 sec - exiting 20:08:09 (6252): No heartbeat from core client for 30 sec - exiting 20:08:10 (6252): No heartbeat from core client for 30 sec - exiting 20:08:11 (6252): No heartbeat from core client for 30 sec - exiting 20:08:12 (6252): No heartbeat from core client for 30 sec - exiting 20:08:13 (6252): No heartbeat from core client for 30 sec - exiting 20:08:14 (6252): No heartbeat from core client for 30 sec - exiting 20:08:15 (6252): No heartbeat from core client for 30 sec - exiting 20:08:17 (6252): No heartbeat from core client for 30 sec - exiting 20:08:18 (6252): No heartbeat from core client for 30 sec - exiting 20:08:19 (6252): No heartbeat from core client for 30 sec - exiting 20:08:20 (6252): No heartbeat from core client for 30 sec - exiting 20:08:21 (6252): No heartbeat from core client for 30 sec - exiting 20:08:22 (6252): No heartbeat from core client for 30 sec - exiting 20:08:23 (6252): No heartbeat from core client for 30 sec - exiting 20:08:24 (6252): No heartbeat from core client for 30 sec - exiting 20:08:25 (6252): No heartbeat from core client for 30 sec - exiting 20:08:26 (6252): No heartbeat from core client for 30 sec - exiting 20:08:27 (6252): No heartbeat from core client for 30 sec - exiting 20:08:29 (6252): No heartbeat from core client for 30 sec - exiting 20:08:30 (6252): No heartbeat from core client for 30 sec - exiting 20:08:31 (6252): No heartbeat from core client for 30 sec - exiting 20:08:32 (6252): No heartbeat from core client for 30 sec - exiting 20:08:33 (6252): No heartbeat from core client for 30 sec - exiting 20:08:34 (6252): No heartbeat from core client for 30 sec - exiting 20:08:35 (6252): No heartbeat from core client for 30 sec - exiting 20:08:36 (6252): No heartbeat from core client for 30 sec - exiting 20:08:37 (6252): No heartbeat from core client for 30 sec - exiting 20:08:39 (6252): No heartbeat from core client for 30 sec - exiting 20:08:40 (6252): No heartbeat from core client for 30 sec - exiting 20:08:41 (6252): No heartbeat from core client for 30 sec - exiting 20:08:42 (6252): No heartbeat from core client for 30 sec - exiting 20:08:43 (6252): No heartbeat from core client for 30 sec - exiting 20:08:44 (6252): No heartbeat from core client for 30 sec - exiting 20:08:45 (6252): No heartbeat from core client for 30 sec - exiting 20:08:47 (6252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:12:24 (2140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77927188 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_yevf_1900_40_007517721/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
13 Dec 2011 04:39:29	1134605	13651378	hadcm3n_yevf_1900_40_007517721_2	259,200	466,673	1.8004
11 Dec 2011 19:28:56	1134605	13651378	hadcm3n_yevf_1900_40_007517721_2	233,280	415,761	1.7822
09 Dec 2011 08:02:27	1134605	13651378	hadcm3n_yevf_1900_40_007517721_2	207,360	366,789	1.7689
06 Dec 2011 22:47:13	1134605	13651378	hadcm3n_yevf_1900_40_007517721_2	181,440	323,886	1.7851
06 Dec 2011 14:06:30	1134605	13651378	hadcm3n_yevf_1900_40_007517721_2	155,520	290,325	1.8668
06 Dec 2011 03:28:06	1134605	13651378	hadcm3n_yevf_1900_40_007517721_2	129,600	254,776	1.9659
04 Dec 2011 10:05:16	1134605	13651378	hadcm3n_yevf_1900_40_007517721_2	103,680	203,859	1.9662
03 Dec 2011 11:21:50	1134605	13651378	hadcm3n_yevf_1900_40_007517721_2	77,760	154,153	1.9824
01 Dec 2011 16:28:23	1134605	13651378	hadcm3n_yevf_1900_40_007517721_2	51,840	103,026	1.9874
29 Nov 2011 09:11:48	1134605	13651378	hadcm3n_yevf_1900_40_007517721_2	25,920	51,570	1.9896