Task 12927519

Name	hadcm3n_o7ex_1940_40_007267013_0
Workunit	7465253
Created	3 Jun 2011, 0:55:55 UTC
Sent	3 Jun 2011, 0:55:59 UTC
Report deadline	2 Sep 2011, 8:23:10 UTC
Received	27 Jun 2011, 9:49:45 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1147730
Run time	6 days 4 hours 45 min 25 sec
CPU time	5 days 13 hours 47 min 40 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.99 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> - exit code -1073741819 (0xc0000005) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:38:58 (12220): No heartbeat from core client for 30 sec - exiting 14:38:59 (12220): No heartbeat from core client for 30 sec - exiting 14:39:00 (12220): No heartbeat from core client for 30 sec - exiting 14:39:01 (12220): No heartbeat from core client for 30 sec - exiting 14:39:02 (12220): No heartbeat from core client for 30 sec - exiting 14:39:03 (12220): No heartbeat from core client for 30 sec - exiting 14:39:04 (12220): No heartbeat from core client for 30 sec - exiting 14:39:05 (12220): No heartbeat from core client for 30 sec - exiting 14:39:06 (12220): No heartbeat from core client for 30 sec - exiting 14:39:07 (12220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:36:45 (9804): No heartbeat from core client for 30 sec - exiting 16:36:46 (9804): No heartbeat from core client for 30 sec - exiting 16:36:47 (9804): No heartbeat from core client for 30 sec - exiting 16:36:48 (9804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:41:07 (14020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:22:50 (12060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:23:54 (13864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:09:44 (18036): No heartbeat from core client for 30 sec - exiting 22:09:45 (18036): No heartbeat from core client for 30 sec - exiting 22:09:46 (18036): No heartbeat from core client for 30 sec - exiting 22:09:47 (18036): No heartbeat from core client for 30 sec - exiting 22:09:48 (18036): No heartbeat from core client for 30 sec - exiting 22:09:49 (18036): No heartbeat from core client for 30 sec - exiting 22:09:50 (18036): No heartbeat from core client for 30 sec - exiting 22:09:51 (18036): No heartbeat from core client for 30 sec - exiting 22:09:52 (18036): No heartbeat from core client for 30 sec - exiting 22:09:53 (18036): No heartbeat from core client for 30 sec - exiting 22:09:54 (18036): No heartbeat from core client for 30 sec - exiting 22:09:55 (18036): No heartbeat from core client for 30 sec - exiting 22:09:56 (18036): No heartbeat from core client for 30 sec - exiting 22:09:57 (18036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:33:22 (18316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 23:35:05 (14180): No heartbeat from core client for 30 sec - exiting 23:35:06 (14180): No heartbeat from core client for 30 sec - exiting 23:35:07 (14180): No heartbeat from core client for 30 sec - exiting 23:35:08 (14180): No heartbeat from core client for 30 sec - exiting 23:35:09 (14180): No heartbeat from core client for 30 sec - exiting 23:35:10 (14180): No heartbeat from core client for 30 sec - exiting 23:35:11 (14180): No heartbeat from core client for 30 sec - exiting 23:35:12 (14180): No heartbeat from core client for 30 sec - exiting 23:35:13 (14180): No heartbeat from core client for 30 sec - exiting 23:35:14 (14180): No heartbeat from core client for 30 sec - exiting 23:35:15 (14180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 00:54:20 (4144): No heartbeat from core client for 30 sec - exiting 00:54:21 (4144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 03:20:37 (5660): No heartbeat from core client for 30 sec - exiting 03:20:38 (5660): No heartbeat from core client for 30 sec - exiting 03:20:39 (5660): No heartbeat from core client for 30 sec - exiting 03:20:40 (5660): No heartbeat from core client for 30 sec - exiting 03:20:41 (5660): No heartbeat from core client for 30 sec - exiting 03:20:42 (5660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:20:43 (5660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:08:05 (6768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:01:35 (20900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 04:26:41 (7148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 08:17:19 (3588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:55:42 (7588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:09:19 (20836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:28:09 (15100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:12:33 (8032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:27:50 (5524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 01:08:22 (22480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 03:07:40 (7868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 03:57:09 (4296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=21300, selfPID=21300, iMonCtr=1 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o7exko.pje6c10 Error converting file to netcdf: dataout/o7exko.pie6c10 Error converting file to netcdf: dataout/o7exko.pfe6c10 Error converting file to netcdf: dataout/o7exka.phe6c10 Error converting file to netcdf: dataout/o7exka.pge6c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:42:51 (21484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o7exko.pje9c10 Error converting file to netcdf: dataout/o7exko.pie9c10 Error converting file to netcdf: dataout/o7exko.pfe9c10 Error converting file to netcdf: dataout/o7exka.phe9c10 Error converting file to netcdf: dataout/o7exka.pge9c10 Error converting file to netcdf: dataout/o7exka.pee9c10 Error converting file to netcdf: dataout/o7exka.pde9c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x775D7353 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=16784, selfPID=16784, iMonCtr=1 Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x775D3A93 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
27 Jun 2011 04:57:43	1147730	12927519	hadcm3n_o7ex_1940_40_007267013_0	259,200	480,981	1.8556
26 Jun 2011 12:10:46	1147730	12927519	hadcm3n_o7ex_1940_40_007267013_0	233,280	433,684	1.8591
25 Jun 2011 17:57:36	1147730	12927519	hadcm3n_o7ex_1940_40_007267013_0	207,360	386,440	1.8636
24 Jun 2011 18:04:51	1147730	12927519	hadcm3n_o7ex_1940_40_007267013_0	181,440	338,708	1.8668
23 Jun 2011 22:45:05	1147730	12927519	hadcm3n_o7ex_1940_40_007267013_0	155,520	290,777	1.8697
23 Jun 2011 00:44:04	1147730	12927519	hadcm3n_o7ex_1940_40_007267013_0	129,600	241,488	1.8633
21 Jun 2011 15:08:56	1147730	12927519	hadcm3n_o7ex_1940_40_007267013_0	103,680	191,330	1.8454
19 Jun 2011 22:06:55	1147730	12927519	hadcm3n_o7ex_1940_40_007267013_0	77,760	142,338	1.8305
09 Jun 2011 22:27:42	1147730	12927519	hadcm3n_o7ex_1940_40_007267013_0	51,840	93,908	1.8115
07 Jun 2011 13:27:24	1147730	12927519	hadcm3n_o7ex_1940_40_007267013_0	25,920	46,141	1.7801