Task 13618140

Name	hadcm3n_u79c_1980_40_007536611_3
Workunit	7733843
Created	8 Nov 2011, 10:14:49 UTC
Sent	8 Nov 2011, 10:18:53 UTC
Report deadline	7 Feb 2012, 17:46:04 UTC
Received	1 Jan 2012, 9:15:11 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1095299
Run time	6 days 8 hours 44 min 31 sec
CPU time	5 days 11 hours 42 min 24 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	3.01 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8964, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=12452, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:55:28 (8404): No heartbeat from core client for 30 sec - exiting 15:55:29 (8404): No heartbeat from core client for 30 sec - exiting 15:55:30 (8404): No heartbeat from core client for 30 sec - exiting 15:55:31 (8404): No heartbeat from core client for 30 sec - exiting 15:55:32 (8404): No heartbeat from core client for 30 sec - exiting 15:55:33 (8404): No heartbeat from core client for 30 sec - exiting 15:55:34 (8404): No heartbeat from core client for 30 sec - exiting 15:55:35 (8404): No heartbeat from core client for 30 sec - exiting 15:55:36 (8404): No heartbeat from core client for 30 sec - exiting 15:55:37 (8404): No heartbeat from core client for 30 sec - exiting 15:55:38 (8404): No heartbeat from core client for 30 sec - exiting 15:55:39 (8404): No heartbeat from core client for 30 sec - exiting 15:55:40 (8404): No heartbeat from core client for 30 sec - exiting 15:55:41 (8404): No heartbeat from core client for 30 sec - exiting 15:55:42 (8404): No heartbeat from core client for 30 sec - exiting 15:55:43 (8404): No heartbeat from core client for 30 sec - exiting 15:55:44 (8404): No heartbeat from core client for 30 sec - exiting 15:55:45 (8404): No heartbeat from core client for 30 sec - exiting 15:55:46 (8404): No heartbeat from core client for 30 sec - exiting 15:55:47 (8404): No heartbeat from core client for 30 sec - exiting 15:55:48 (8404): No heartbeat from core client for 30 sec - exiting 15:55:49 (8404): No heartbeat from core client for 30 sec - exiting 15:55:50 (8404): No heartbeat from core client for 30 sec - exiting 15:55:51 (8404): No heartbeat from core client for 30 sec - exiting 15:55:52 (8404): No heartbeat from core client for 30 sec - exiting 15:55:53 (8404): No heartbeat from core client for 30 sec - exiting 15:55:54 (8404): No heartbeat from core client for 30 sec - exiting 15:55:55 (8404): No heartbeat from core client for 30 sec - exiting 15:55:56 (8404): No heartbeat from core client for 30 sec - exiting 15:55:57 (8404): No heartbeat from core client for 30 sec - exiting 15:55:58 (8404): No heartbeat from core client for 30 sec - exiting 15:55:59 (8404): No heartbeat from core client for 30 sec - exiting 15:56:00 (8404): No heartbeat from core client for 30 sec - exiting 15:56:01 (8404): No heartbeat from core client for 30 sec - exiting 15:56:02 (8404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:27:34 (14300): No heartbeat from core client for 30 sec - exiting 09:27:35 (14300): No heartbeat from core client for 30 sec - exiting 09:27:36 (14300): No heartbeat from core client for 30 sec - exiting 09:27:37 (14300): No heartbeat from core client for 30 sec - exiting 09:27:38 (14300): No heartbeat from core client for 30 sec - exiting 09:27:39 (14300): No heartbeat from core client for 30 sec - exiting 09:27:40 (14300): No heartbeat from core client for 30 sec - exiting 09:27:41 (14300): No heartbeat from core client for 30 sec - exiting 09:27:42 (14300): No heartbeat from core client for 30 sec - exiting 09:27:43 (14300): No heartbeat from core client for 30 sec - exiting 09:27:44 (14300): No heartbeat from core client for 30 sec - exiting 09:27:45 (14300): No heartbeat from core client for 30 sec - exiting 09:27:46 (14300): No heartbeat from core client for 30 sec - exiting 09:27:47 (14300): No heartbeat from core client for 30 sec - exiting 09:27:48 (14300): No heartbeat from core client for 30 sec - exiting 09:27:49 (14300): No heartbeat from core client for 30 sec - exiting 09:27:50 (14300): No heartbeat from core client for 30 sec - exiting 09:27:51 (14300): No heartbeat from core client for 30 sec - exiting 09:27:52 (14300): No heartbeat from core client for 30 sec - exiting 09:27:53 (14300): No heartbeat from core client for 30 sec - exiting 09:27:54 (14300): No heartbeat from core client for 30 sec - exiting 09:27:55 (14300): No heartbeat from core client for 30 sec - exiting 09:27:56 (14300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:27:26 (376): No heartbeat from core client for 30 sec - exiting 22:27:28 (376): No heartbeat from core client for 30 sec - exiting 22:27:29 (376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:27:30 (376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:36:45 (9816): No heartbeat from core client for 30 sec - exiting 12:36:46 (9816): No heartbeat from core client for 30 sec - exiting 12:36:47 (9816): No heartbeat from core client for 30 sec - exiting 12:36:48 (9816): No heartbeat from core client for 30 sec - exiting 12:36:49 (9816): No heartbeat from core client for 30 sec - exiting 12:36:50 (9816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5884, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77933A93 read attempt to address 0x40C403F2 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\Data\BOINC/projects/climateprediction.net/hadcm3n_u79c_1980_40_007536611/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
01 Jan 2012 01:30:50	1095299	13618140	hadcm3n_u79c_1980_40_007536611_3	259,200	474,141	1.8292
30 Dec 2011 13:22:25	1095299	13618140	hadcm3n_u79c_1980_40_007536611_3	233,280	426,117	1.8266
23 Dec 2011 08:41:16	1095299	13618140	hadcm3n_u79c_1980_40_007536611_3	207,360	377,344	1.8198
15 Dec 2011 11:45:26	1095299	13618140	hadcm3n_u79c_1980_40_007536611_3	181,440	329,761	1.8175
07 Dec 2011 11:42:43	1095299	13618140	hadcm3n_u79c_1980_40_007536611_3	155,520	280,100	1.8011
25 Nov 2011 03:59:44	1095299	13618140	hadcm3n_u79c_1980_40_007536611_3	129,600	230,563	1.7790
15 Nov 2011 18:26:32	1095299	13618140	hadcm3n_u79c_1980_40_007536611_3	103,680	184,197	1.7766
15 Nov 2011 18:26:32	1095299	13618140	hadcm3n_u79c_1980_40_007536611_3	77,760	139,433	1.7931
15 Nov 2011 18:26:32	1095299	13618140	hadcm3n_u79c_1980_40_007536611_3	51,840	92,711	1.7884
15 Nov 2011 18:26:32	1095299	13618140	hadcm3n_u79c_1980_40_007536611_3	25,920	45,898	1.7708