Task 13758454

Name	hadcm3n_t4bf_1940_40_007447737_4
Workunit	7645240
Created	10 Dec 2011, 3:29:27 UTC
Sent	10 Dec 2011, 3:29:37 UTC
Report deadline	10 Mar 2012, 10:56:48 UTC
Received	7 Mar 2012, 3:07:33 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1121295
Run time	44 days 4 hours 47 min 11 sec
CPU time	42 days 0 hours 58 min
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	1.99 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5408, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: C I/O Error feof - Unit 62 - Return code = 16 BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/t4bfko.pjg0c10 Error converting file to netcdf: dataout/t4bfko.pig0c10 Error converting file to netcdf: dataout/t4bfko.pfg0c10 Error converting file to netcdf: dataout/t4bfko.pcg0c10 Error converting file to netcdf: dataout/t4bfko.pbg0c10 Error converting file to netcdf: dataout/t4bfko.pag0c10 Error converting file to netcdf: dataout/t4bfka.phg0c10 Error converting file to netcdf: dataout/t4bfka.pgg0c10 Error converting file to netcdf: dataout/t4bfka.peg0c10 Error converting file to netcdf: dataout/t4bfka.pdg0c10 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=43316, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x772F3AB3 read attempt to address 0x402D7BBB Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x772F3AB3 read attempt to address 0x402D7BBB Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_t4bf_1940_40_007447737/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
04 Mar 2012 05:45:22	1121295	13758454	hadcm3n_t4bf_1940_40_007447737_4	1,036,800	3,630,938	3.5021
03 Mar 2012 03:07:55	1121295	13758454	hadcm3n_t4bf_1940_40_007447737_4	1,010,880	3,538,590	3.5005
01 Mar 2012 04:56:51	1121295	13758454	hadcm3n_t4bf_1940_40_007447737_4	984,960	3,442,338	3.4949
28 Feb 2012 07:19:58	1121295	13758454	hadcm3n_t4bf_1940_40_007447737_4	959,040	3,349,913	3.4930
26 Feb 2012 19:16:55	1121295	13758454	hadcm3n_t4bf_1940_40_007447737_4	933,120	3,257,357	3.4908
25 Feb 2012 08:14:53	1121295	13758454	hadcm3n_t4bf_1940_40_007447737_4	907,200	3,161,531	3.4849
23 Feb 2012 10:21:40	1121295	13758454	hadcm3n_t4bf_1940_40_007447737_4	881,280	3,068,757	3.4822
21 Feb 2012 12:36:48	1121295	13758454	hadcm3n_t4bf_1940_40_007447737_4	855,360	2,977,075	3.4805
20 Feb 2012 00:23:27	1121295	13758454	hadcm3n_t4bf_1940_40_007447737_4	829,440	2,884,169	3.4772
18 Feb 2012 20:52:05	1121295	13758454	hadcm3n_t4bf_1940_40_007447737_4	803,520	2,789,386	3.4715
17 Feb 2012 06:27:50	1121295	13758454	hadcm3n_t4bf_1940_40_007447737_4	777,600	2,698,228	3.4699
15 Feb 2012 01:11:10	1121295	13758454	hadcm3n_t4bf_1940_40_007447737_4	751,680	2,606,321	3.4673
13 Feb 2012 00:09:49	1121295	13758454	hadcm3n_t4bf_1940_40_007447737_4	725,760	2,515,070	3.4654
11 Feb 2012 20:44:10	1121295	13758454	hadcm3n_t4bf_1940_40_007447737_4	699,840	2,420,613	3.4588
10 Feb 2012 06:56:18	1121295	13758454	hadcm3n_t4bf_1940_40_007447737_4	673,920	2,326,408	3.4521
08 Feb 2012 08:32:48	1121295	13758454	hadcm3n_t4bf_1940_40_007447737_4	648,000	2,233,918	3.4474
06 Feb 2012 12:25:29	1121295	13758454	hadcm3n_t4bf_1940_40_007447737_4	622,080	2,145,793	3.4494
05 Feb 2012 11:06:54	1121295	13758454	hadcm3n_t4bf_1940_40_007447737_4	596,160	2,058,034	3.4522
30 Jan 2012 09:39:07	1121295	13758454	hadcm3n_t4bf_1940_40_007447737_4	570,240	1,965,945	3.4476
28 Jan 2012 10:39:43	1121295	13758454	hadcm3n_t4bf_1940_40_007447737_4	544,320	1,869,456	3.4345