Task 13275225

Name	hadcm3n_t4ta_1980_40_007412246_2
Workunit	7609876
Created	18 Aug 2011, 19:00:13 UTC
Sent	18 Aug 2011, 19:05:18 UTC
Report deadline	18 Nov 2011, 2:32:29 UTC
Received	4 Oct 2011, 11:41:18 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1120191
Run time	8 days 3 hours 33 min 34 sec
CPU time	7 days 9 hours 45 min 13 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.64 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:40:51 (3368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:58:50 (8044): No heartbeat from core client for 30 sec - exiting 02:58:51 (8044): No heartbeat from core client for 30 sec - exiting 02:58:52 (8044): No heartbeat from core client for 30 sec - exiting 02:58:53 (8044): No heartbeat from core client for 30 sec - exiting 02:58:54 (8044): No heartbeat from core client for 30 sec - exiting 02:58:55 (8044): No heartbeat from core client for 30 sec - exiting 02:58:56 (8044): No heartbeat from core client for 30 sec - exiting 02:58:57 (8044): No heartbeat from core client for 30 sec - exiting 02:58:58 (8044): No heartbeat from core client for 30 sec - exiting 02:58:59 (8044): No heartbeat from core client for 30 sec - exiting 02:59:00 (8044): No heartbeat from core client for 30 sec - exiting 02:59:01 (8044): No heartbeat from core client for 30 sec - exiting 02:59:02 (8044): No heartbeat from core client for 30 sec - exiting 02:59:03 (8044): No heartbeat from core client for 30 sec - exiting 02:59:04 (8044): No heartbeat from core client for 30 sec - exiting 02:59:05 (8044): No heartbeat from core client for 30 sec - exiting 02:59:06 (8044): No heartbeat from core client for 30 sec - exiting 02:59:07 (8044): No heartbeat from core client for 30 sec - exiting 02:59:08 (8044): No heartbeat from core client for 30 sec - exiting 02:59:09 (8044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:31:28 (5280): No heartbeat from core client for 30 sec - exiting 09:31:30 (5280): No heartbeat from core client for 30 sec - exiting 09:31:31 (5280): No heartbeat from core client for 30 sec - exiting 09:31:32 (5280): No heartbeat from core client for 30 sec - exiting 09:31:33 (5280): No heartbeat from core client for 30 sec - exiting 09:31:34 (5280): No heartbeat from core client for 30 sec - exiting 09:31:35 (5280): No heartbeat from core client for 30 sec - exiting 09:31:36 (5280): No heartbeat from core client for 30 sec - exiting 09:31:37 (5280): No heartbeat from core client for 30 sec - exiting 09:31:38 (5280): No heartbeat from core client for 30 sec - exiting 09:31:39 (5280): No heartbeat from core client for 30 sec - exiting 09:31:40 (5280): No heartbeat from core client for 30 sec - exiting 09:31:41 (5280): No heartbeat from core client for 30 sec - exiting 09:31:42 (5280): No heartbeat from core client for 30 sec - exiting 09:31:43 (5280): No heartbeat from core client for 30 sec - exiting 09:31:44 (5280): No heartbeat from core client for 30 sec - exiting 09:31:45 (5280): No heartbeat from core client for 30 sec - exiting 09:31:46 (5280): No heartbeat from core client for 30 sec - exiting 09:31:47 (5280): No heartbeat from core client for 30 sec - exiting 09:31:48 (5280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:27:50 (10832): No heartbeat from core client for 30 sec - exiting 09:27:51 (10832): No heartbeat from core client for 30 sec - exiting 09:27:52 (10832): No heartbeat from core client for 30 sec - exiting 09:27:53 (10832): No heartbeat from core client for 30 sec - exiting 09:27:54 (10832): No heartbeat from core client for 30 sec - exiting 09:27:55 (10832): No heartbeat from core client for 30 sec - exiting 09:27:56 (10832): No heartbeat from core client for 30 sec - exiting 09:27:57 (10832): No heartbeat from core client for 30 sec - exiting 09:27:58 (10832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:27:59 (10832): No heartbeat from core client for 30 sec - exiting 09:28:00 (10832): No heartbeat from core client for 30 sec - exiting 09:28:01 (10832): No heartbeat from core client for 30 sec - exiting 09:28:02 (10832): No heartbeat from core client for 30 sec - exiting 09:28:03 (10832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 08:47:41 (10548): No heartbeat from core client for 30 sec - exiting 08:47:43 (10548): No heartbeat from core client for 30 sec - exiting 08:47:44 (10548): No heartbeat from core client for 30 sec - exiting 08:47:45 (10548): No heartbeat from core client for 30 sec - exiting 08:47:46 (10548): No heartbeat from core client for 30 sec - exiting 08:47:47 (10548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:15:30 (7744): Can't acquire lockfile (32) - waiting 35s 15:15:43 (3880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:33:14 (7260): No heartbeat from core client for 30 sec - exiting 13:33:16 (7260): No heartbeat from core client for 30 sec - exiting 13:33:17 (7260): No heartbeat from core client for 30 sec - exiting 13:33:18 (7260): No heartbeat from core client for 30 sec - exiting 13:33:19 (7260): No heartbeat from core client for 30 sec - exiting 13:33:20 (7260): No heartbeat from core client for 30 sec - exiting 13:33:21 (7260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:34:53 (7612): No heartbeat from core client for 30 sec - exiting 09:34:55 (7612): No heartbeat from core client for 30 sec - exiting 09:34:56 (7612): No heartbeat from core client for 30 sec - exiting 09:34:57 (7612): No heartbeat from core client for 30 sec - exiting 09:34:58 (7612): No heartbeat from core client for 30 sec - exiting 09:34:59 (7612): No heartbeat from core client for 30 sec - exiting 09:35:00 (7612): No heartbeat from core client for 30 sec - exiting 09:35:01 (7612): No heartbeat from core client for 30 sec - exiting 09:35:02 (7612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/t4tako.pji4c10 Error converting file to netcdf: dataout/t4tako.pii4c10 Error converting file to netcdf: dataout/t4tako.pfi4c10 Error converting file to netcdf: dataout/t4taka.phi4c10 Error converting file to netcdf: dataout/t4taka.pgi4c10 Error converting file to netcdf: dataout/t4taka.pei4c10 Error converting file to netcdf: dataout/t4taka.pdi4c10 CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/t4tako.pji4c10 Error converting file to netcdf: dataout/t4tako.pii4c10 Error converting file to netcdf: dataout/t4tako.pfi4c10 Error converting file to netcdf: dataout/t4taka.phi4c10 Error converting file to netcdf: dataout/t4taka.pgi4c10 Error converting file to netcdf: dataout/t4taka.pei4c10 Error converting file to netcdf: dataout/t4taka.pdi4c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:37:46 (3508): No heartbeat from core client for 30 sec - exiting 09:37:47 (3508): No heartbeat from core client for 30 sec - exiting 09:37:48 (3508): No heartbeat from core client for 30 sec - exiting 09:37:49 (3508): No heartbeat from core client for 30 sec - exiting 09:37:50 (3508): No heartbeat from core client for 30 sec - exiting 09:37:51 (3508): No heartbeat from core client for 30 sec - exiting 09:37:52 (3508): No heartbeat from core client for 30 sec - exiting 09:37:53 (3508): No heartbeat from core client for 30 sec - exiting 09:37:54 (3508): No heartbeat from core client for 30 sec - exiting 09:37:55 (3508): No heartbeat from core client for 30 sec - exiting 09:37:56 (3508): No heartbeat from core client for 30 sec - exiting 09:37:57 (3508): No heartbeat from core client for 30 sec - exiting 09:37:58 (3508): No heartbeat from core client for 30 sec - exiting 09:37:59 (3508): No heartbeat from core client for 30 sec - exiting 09:38:00 (3508): No heartbeat from core client for 30 sec - exiting 09:38:01 (3508): No heartbeat from core client for 30 sec - exiting 09:38:02 (3508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:12:08 (7820): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:03:16 (7944): No heartbeat from core client for 30 sec - exiting 10:03:17 (7944): No heartbeat from core client for 30 sec - exiting 10:03:18 (7944): No heartbeat from core client for 30 sec - exiting 10:03:19 (7944): No heartbeat from core client for 30 sec - exiting 10:03:20 (7944): No heartbeat from core client for 30 sec - exiting 10:03:21 (7944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:02:25 (2408): No heartbeat from core client for 30 sec - exiting 09:02:26 (2408): No heartbeat from core client for 30 sec - exiting 09:02:27 (2408): No heartbeat from core client for 30 sec - exiting 09:02:28 (2408): No heartbeat from core client for 30 sec - exiting 09:02:29 (2408): No heartbeat from core client for 30 sec - exiting 09:02:30 (2408): No heartbeat from core client for 30 sec - exiting 09:02:31 (2408): No heartbeat from core client for 30 sec - exiting 09:02:32 (2408): No heartbeat from core client for 30 sec - exiting 09:02:33 (2408): No heartbeat from core client for 30 sec - exiting 09:02:34 (2408): No heartbeat from core client for 30 sec - exiting 09:02:35 (2408): No heartbeat from core client for 30 sec - exiting 09:02:36 (2408): No heartbeat from core client for 30 sec - exiting 09:02:37 (2408): No heartbeat from core client for 30 sec - exiting 09:02:38 (2408): No heartbeat from core client for 30 sec - exiting 09:02:39 (2408): No heartbeat from core client for 30 sec - exiting 09:02:40 (2408): No heartbeat from core client for 30 sec - exiting 09:02:41 (2408): No heartbeat from core client for 30 sec - exiting 09:02:42 (2408): No heartbeat from core client for 30 sec - exiting 09:02:43 (2408): No heartbeat from core client for 30 sec - exiting 09:02:44 (2408): No heartbeat from core client for 30 sec - exiting 09:02:45 (2408): No heartbeat from core client for 30 sec - exiting 09:02:46 (2408): No heartbeat from core client for 30 sec - exiting 09:02:47 (2408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:31:02 (7028): Can't acquire lockfile (32) - waiting 35s 11:31:29 (3672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:48:47 (8624): No heartbeat from core client for 30 sec - exiting 21:48:48 (8624): No heartbeat from core client for 30 sec - exiting 21:48:49 (8624): No heartbeat from core client for 30 sec - exiting 21:48:50 (8624): No heartbeat from core client for 30 sec - exiting 21:48:51 (8624): No heartbeat from core client for 30 sec - exiting 21:48:52 (8624): No heartbeat from core client for 30 sec - exiting 21:48:53 (8624): No heartbeat from core client for 30 sec - exiting 21:48:54 (8624): No heartbeat from core client for 30 sec - exiting 21:48:55 (8624): No heartbeat from core client for 30 sec - exiting 21:48:56 (8624): No heartbeat from core client for 30 sec - exiting 21:48:57 (8624): No heartbeat from core client for 30 sec - exiting 21:48:58 (8624): No heartbeat from core client for 30 sec - exiting 21:48:59 (8624): No heartbeat from core client for 30 sec - exiting 21:49:00 (8624): No heartbeat from core client for 30 sec - exiting 21:49:01 (8624): No heartbeat from core client for 30 sec - exiting 21:49:02 (8624): No heartbeat from core client for 30 sec - exiting 21:49:03 (8624): No heartbeat from core client for 30 sec - exiting 21:49:04 (8624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:49:05 (8624): No heartbeat from core client for 30 sec - exiting 21:49:06 (8624): No heartbeat from core client for 30 sec - exiting 21:49:06 (8764): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:28:33 (1336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:20:14 (6436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:41:44 (6924): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:49:06 (8816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:52:08 (7764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:16:13 (6516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6752, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 06:37:33 (6404): No heartbeat from core client for 30 sec - exiting 06:37:34 (6404): No heartbeat from core client for 30 sec - exiting 06:37:35 (6404): No heartbeat from core client for 30 sec - exiting 06:37:36 (6404): No heartbeat from core client for 30 sec - exiting 06:37:37 (6404): No heartbeat from core client for 30 sec - exiting 06:37:38 (6404): No heartbeat from core client for 30 sec - exiting 06:37:39 (6404): No heartbeat from core client for 30 sec - exiting 06:37:40 (6404): No heartbeat from core client for 30 sec - exiting 06:37:41 (6404): No heartbeat from core client for 30 sec - exiting 06:37:42 (6404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7404, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:00:33 (5680): No heartbeat from core client for 30 sec - exiting 08:00:34 (5680): No heartbeat from core client for 30 sec - exiting 08:00:35 (5680): No heartbeat from core client for 30 sec - exiting 08:00:36 (5680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:00:37 (5680): No heartbeat from core client for 30 sec - exiting 08:00:38 (5680): No heartbeat from core client for 30 sec - exiting 08:00:39 (5680): No heartbeat from core client for 30 sec - exiting 08:00:40 (5680): No heartbeat from core client for 30 sec - exiting 08:00:41 (5680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:54:19 (7496): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:29:25 (6508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:29:27 (6508): No heartbeat from core client for 30 sec - exiting 09:29:28 (6508): No heartbeat from core client for 30 sec - exiting 09:29:29 (6508): No heartbeat from core client for 30 sec - exiting 09:29:30 (6508): No heartbeat from core client for 30 sec - exiting 09:29:31 (6508): No heartbeat from core client for 30 sec - exiting 11:22:17 (3384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:31:05 (200636): No heartbeat from core client for 30 sec - exiting 09:31:06 (200636): No heartbeat from core client for 30 sec - exiting 09:31:07 (200636): No heartbeat from core client for 30 sec - exiting 09:31:08 (200636): No heartbeat from core client for 30 sec - exiting 09:31:09 (200636): No heartbeat from core client for 30 sec - exiting 09:31:10 (200636): No heartbeat from core client for 30 sec - exiting 09:31:11 (200636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:31:12 (200636): No heartbeat from core client for 30 sec - exiting 09:31:14 (200636): No heartbeat from core client for 30 sec - exiting 09:31:15 (200636): No heartbeat from core client for 30 sec - exiting 09:31:16 (200636): No heartbeat from core client for 30 sec - exiting 09:31:17 (200636): No heartbeat from core client for 30 sec - exiting 09:31:18 (200636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=191376, selfPID=191376, iMonCtr=1 BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: C I/O Error feof - Unit 62 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/t4tako.pjj0c10 Error converting file to netcdf: dataout/t4tako.pij0c10 Error converting file to netcdf: dataout/t4tako.pfj0c10 Error converting file to netcdf: dataout/t4tako.pcj0c10 Error converting file to netcdf: dataout/t4tako.pbj0c10 Error converting file to netcdf: dataout/t4tako.paj0c10 Error converting file to netcdf: dataout/t4taka.phj0c10 Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=199756, selfPID=199756, iMonCtr=1 BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: C I/O Error feof - Unit 62 - Return code = 16 BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/t4tako.pjj0c10 Error converting file to netcdf: dataout/t4tako.pij0c10 Error converting file to netcdf: dataout/t4tako.pfj0c10 Error converting file to netcdf: dataout/t4tako.pcj0c10 Error converting file to netcdf: dataout/t4tako.pbj0c10 Error converting file to netcdf: dataout/t4tako.paj0c10 Error converting file to netcdf: dataout/t4taka.phj0c10 Error converting file to netcdf: dataout/t4taka.pgj0c10 Error converting file to netcdf: dataout/t4taka.pej0c10 Error converting file to netcdf: dataout/t4taka.pdj0c10 CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: C I/O Error feof - Unit 62 - Return code = 16 BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/t4tako.pjj0c10 Error converting file to netcdf: dataout/t4tako.pij0c10 Error converting file to netcdf: dataout/t4tako.pfj0c10 Error converting file to netcdf: dataout/t4tako.pcj0c10 Error converting file to netcdf: dataout/t4tako.pbj0c10 Error converting file to netcdf: dataout/t4tako.paj0c10 Error converting file to netcdf: dataout/t4taka.phj0c10 Error converting file to netcdf: dataout/t4taka.pgj0c10 Error converting file to netcdf: dataout/t4taka.pej0c10 Error converting file to netcdf: dataout/t4taka.pdj0c10 CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: C I/O Error feof - Unit 62 - Return code = 16 BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/t4tako.pjj0c10 Error converting file to netcdf: dataout/t4tako.pij0c10 Error converting file to netcdf: dataout/t4tako.pfj0c10 Error converting file to netcdf: dataout/t4tako.pcj0c10 Error converting file to netcdf: dataout/t4tako.pbj0c10 Error converting file to netcdf: dataout/t4tako.paj0c10 Error converting file to netcdf: dataout/t4taka.phj0c10 Error converting file to netcdf: dataout/t4taka.pgj0c10 Error converting file to netcdf: dataout/t4taka.pej0c10 Error converting file to netcdf: dataout/t4taka.pdj0c10 Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x775F3232 read attempt to address 0x3E9D14DB Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_t4ta_1980_40_007412246/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
04 Oct 2011 10:38:31	1120191	13275225	hadcm3n_t4ta_1980_40_007412246_2	259,200	639,907	2.4688
29 Sep 2011 17:00:13	1120191	13275225	hadcm3n_t4ta_1980_40_007412246_2	233,280	574,318	2.4619
26 Sep 2011 19:16:55	1120191	13275225	hadcm3n_t4ta_1980_40_007412246_2	207,360	510,731	2.4630
23 Sep 2011 10:04:58	1120191	13275225	hadcm3n_t4ta_1980_40_007412246_2	181,440	460,713	2.5392
20 Sep 2011 14:47:04	1120191	13275225	hadcm3n_t4ta_1980_40_007412246_2	155,520	394,056	2.5338
08 Sep 2011 17:01:55	1120191	13275225	hadcm3n_t4ta_1980_40_007412246_2	129,600	328,619	2.5356
06 Sep 2011 13:02:52	1120191	13275225	hadcm3n_t4ta_1980_40_007412246_2	103,680	262,877	2.5355
01 Sep 2011 15:36:00	1120191	13275225	hadcm3n_t4ta_1980_40_007412246_2	77,760	196,766	2.5304
25 Aug 2011 11:47:03	1120191	13275225	hadcm3n_t4ta_1980_40_007412246_2	51,840	131,659	2.5397
23 Aug 2011 09:35:38	1120191	13275225	hadcm3n_t4ta_1980_40_007412246_2	25,920	66,325	2.5588