Task 13560287

Name	hadcm3n_ygtw_1900_40_007527255_1
Workunit	7724730
Created	28 Oct 2011, 13:49:59 UTC
Sent	28 Oct 2011, 23:40:22 UTC
Report deadline	28 Jan 2012, 7:07:33 UTC
Received	1 Dec 2011, 5:55:52 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1161345
Run time	8 days 23 hours 19 min 8 sec
CPU time	8 days 15 hours 54 min 47 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	2.64 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:32:34 (4572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:38:08 (3420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3972, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:36:40 (3160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/ygtwko.pja1c10 Error converting file to netcdf: dataout/ygtwko.pia1c10 Error converting file to netcdf: dataout/ygtwko.pfa1c10 Error converting file to netcdf: dataout/ygtwka.pha1c10 Error converting file to netcdf: dataout/ygtwka.pga1c10 Error converting file to netcdf: dataout/ygtwka.pea1c10 Error converting file to netcdf: dataout/ygtwka.pda1c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:18:03 (4612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:15:35 (3672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:11:18 (4172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:23:34 (4400): No heartbeat from core client for 30 sec - exiting 19:23:35 (4400): No heartbeat from core client for 30 sec - exiting 19:23:36 (4400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=812, iMonCtr=1 Model crash detected, will try to restart... 08:48:56 (4948): No heartbeat from core client for 30 sec - exiting 08:48:57 (4948): No heartbeat from core client for 30 sec - exiting 08:48:58 (4948): No heartbeat from core client for 30 sec - exiting 08:48:59 (4948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:24:19 (3168): No heartbeat from core client for 30 sec - exiting 18:24:20 (3168): No heartbeat from core client for 30 sec - exiting 18:24:21 (3168): No heartbeat from core client for 30 sec - exiting 18:24:22 (3168): No heartbeat from core client for 30 sec - exiting 18:24:23 (3168): No heartbeat from core client for 30 sec - exiting 18:24:24 (3168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2756, iMonCtr=1 Model crash detected, will try to restart... 10:33:09 (4884): No heartbeat from core client for 30 sec - exiting 10:33:10 (4884): No heartbeat from core client for 30 sec - exiting 10:33:12 (4884): No heartbeat from core client for 30 sec - exiting 10:33:13 (4884): No heartbeat from core client for 30 sec - exiting 10:33:14 (4884): No heartbeat from core client for 30 sec - exiting 10:33:15 (4884): No heartbeat from core client for 30 sec - exiting 10:33:16 (4884): No heartbeat from core client for 30 sec - exiting 10:33:17 (4884): No heartbeat from core client for 30 sec - exiting 10:33:18 (4884): No heartbeat from core client for 30 sec - exiting 10:33:19 (4884): No heartbeat from core client for 30 sec - exiting 10:33:20 (4884): No heartbeat from core client for 30 sec - exiting 10:33:21 (4884): No heartbeat from core client for 30 sec - exiting 10:33:22 (4884): No heartbeat from core client for 30 sec - exiting 10:33:24 (4884): No heartbeat from core client for 30 sec - exiting 10:33:25 (4884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:04:48 (3360): No heartbeat from core client for 30 sec - exiting 09:04:49 (3360): No heartbeat from core client for 30 sec - exiting 09:04:50 (3360): No heartbeat from core client for 30 sec - exiting 09:04:51 (3360): No heartbeat from core client for 30 sec - exiting 09:04:52 (3360): No heartbeat from core client for 30 sec - exiting 09:04:53 (3360): No heartbeat from core client for 30 sec - exiting 09:04:54 (3360): No heartbeat from core client for 30 sec - exiting 09:04:55 (3360): No heartbeat from core client for 30 sec - exiting 09:04:57 (3360): No heartbeat from core client for 30 sec - exiting 09:04:58 (3360): No heartbeat from core client for 30 sec - exiting 09:04:59 (3360): No heartbeat from core client for 30 sec - exiting 09:05:00 (3360): No heartbeat from core client for 30 sec - exiting 09:05:01 (3360): No heartbeat from core client for 30 sec - exiting 09:05:02 (3360): No heartbeat from core client for 30 sec - exiting 09:05:03 (3360): No heartbeat from core client for 30 sec - exiting 09:05:04 (3360): No heartbeat from core client for 30 sec - exiting 09:05:05 (3360): No heartbeat from core client for 30 sec - exiting 09:05:06 (3360): No heartbeat from core client for 30 sec - exiting 09:05:07 (3360): No heartbeat from core client for 30 sec - exiting 09:05:09 (3360): No heartbeat from core client for 30 sec - exiting 09:05:10 (3360): No heartbeat from core client for 30 sec - exiting 09:05:11 (3360): No heartbeat from core client for 30 sec - exiting 09:05:12 (3360): No heartbeat from core client for 30 sec - exiting 09:05:13 (3360): No heartbeat from core client for 30 sec - exiting 09:05:14 (3360): No heartbeat from core client for 30 sec - exiting 09:05:15 (3360): No heartbeat from core client for 30 sec - exiting 09:05:16 (3360): No heartbeat from core client for 30 sec - exiting 09:05:17 (3360): No heartbeat from core client for 30 sec - exiting 09:05:18 (3360): No heartbeat from core client for 30 sec - exiting 09:05:19 (3360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:06:28 (4956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:24:13 (4380): No heartbeat from core client for 30 sec - exiting 10:24:14 (4380): No heartbeat from core client for 30 sec - exiting 10:24:15 (4380): No heartbeat from core client for 30 sec - exiting 10:24:16 (4380): No heartbeat from core client for 30 sec - exiting 10:24:17 (4380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:03:15 (4092): No heartbeat from core client for 30 sec - exiting 10:03:16 (4092): No heartbeat from core client for 30 sec - exiting 10:03:17 (4092): No heartbeat from core client for 30 sec - exiting 10:03:18 (4092): No heartbeat from core client for 30 sec - exiting 10:03:19 (4092): No heartbeat from core client for 30 sec - exiting 10:03:20 (4092): No heartbeat from core client for 30 sec - exiting 10:03:21 (4092): No heartbeat from core client for 30 sec - exiting 10:03:22 (4092): No heartbeat from core client for 30 sec - exiting 10:03:23 (4092): No heartbeat from core client for 30 sec - exiting 10:03:24 (4092): No heartbeat from core client for 30 sec - exiting 10:03:25 (4092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:03:27 (4092): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4620, iMonCtr=1 Model crash detected, will try to restart... 17:57:35 (4180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:59:34 (4648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=232, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... C00:08:09 (3688): Can't acquire lockfile (32) - waiting 35s No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2808, selfPID=2808, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CNo Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2972, selfPID=2972, iMonCtr=1 CPDN Monitor - Quit request from BOINC... C00:10:29 (2036): Can't acquire lockfile (32) - waiting 35s No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2752, selfPID=2752, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CWorker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:02:13 (3972): No heartbeat from core client for 30 sec - exiting 18:02:14 (3972): No heartbeat from core client for 30 sec - exiting 18:02:16 (3972): No heartbeat from core client for 30 sec - exiting 18:02:17 (3972): No heartbeat from core client for 30 sec - exiting 18:02:18 (3972): No heartbeat from core client for 30 sec - exiting 18:02:19 (3972): No heartbeat from core client for 30 sec - exiting 18:02:20 (3972): No heartbeat from core client for 30 sec - exiting 18:02:21 (3972): No heartbeat from core client for 30 sec - exiting 18:02:22 (3972): No heartbeat from core client for 30 sec - exiting 18:02:23 (3972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4540, iMonCtr=1 Model crash detected, will try to restart... 17:56:11 (4356): No heartbeat from core client for 30 sec - exiting 17:56:12 (4356): No heartbeat from core client for 30 sec - exiting 17:56:13 (4356): No heartbeat from core client for 30 sec - exiting 17:56:14 (4356): No heartbeat from core client for 30 sec - exiting 17:56:15 (4356): No heartbeat from core client for 30 sec - exiting 17:56:16 (4356): No heartbeat from core client for 30 sec - exiting 17:56:17 (4356): No heartbeat from core client for 30 sec - exiting 17:56:18 (4356): No heartbeat from core client for 30 sec - exiting 17:56:19 (4356): No heartbeat from core client for 30 sec - exiting 17:56:20 (4356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3256, iMonCtr=1 Model crash detected, will try to restart... 17:33:38 (2324): No heartbeat from core client for 30 sec - exiting 17:33:40 (2324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5068, iMonCtr=1 Model crash detected, will try to restart... 10:08:42 (4480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:27:31 (3964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:53:33 (4760): No heartbeat from core client for 30 sec - exiting 08:53:34 (4760): No heartbeat from core client for 30 sec - exiting 08:53:35 (4760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4752, iMonCtr=1 Model crash detected, will try to restart... 18:24:16 (4888): No heartbeat from core client for 30 sec - exiting 18:24:17 (4888): No heartbeat from core client for 30 sec - exiting 18:24:18 (4888): No heartbeat from core client for 30 sec - exiting 18:24:19 (4888): No heartbeat from core client for 30 sec - exiting 18:24:20 (4888): No heartbeat from core client for 30 sec - exiting 18:24:21 (4888): No heartbeat from core client for 30 sec - exiting 18:24:22 (4888): No heartbeat from core client for 30 sec - exiting 18:24:23 (4888): No heartbeat from core client for 30 sec - exiting 18:24:24 (4888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
30 Nov 2011 09:56:55	1161345	13560287	hadcm3n_ygtw_1900_40_007527255_1	518,400	748,482	1.4438
29 Nov 2011 05:15:00	1161345	13560287	hadcm3n_ygtw_1900_40_007527255_1	492,480	711,852	1.4454
28 Nov 2011 12:16:35	1161345	13560287	hadcm3n_ygtw_1900_40_007527255_1	466,560	674,734	1.4462
27 Nov 2011 03:29:11	1161345	13560287	hadcm3n_ygtw_1900_40_007527255_1	440,640	637,295	1.4463
25 Nov 2011 22:06:34	1161345	13560287	hadcm3n_ygtw_1900_40_007527255_1	414,720	600,239	1.4473
24 Nov 2011 09:51:52	1161345	13560287	hadcm3n_ygtw_1900_40_007527255_1	388,800	561,875	1.4452
23 Nov 2011 08:02:33	1161345	13560287	hadcm3n_ygtw_1900_40_007527255_1	362,880	523,836	1.4436
19 Nov 2011 05:27:48	1161345	13560287	hadcm3n_ygtw_1900_40_007527255_1	336,960	485,385	1.4405
16 Nov 2011 05:58:29	1161345	13560287	hadcm3n_ygtw_1900_40_007527255_1	311,040	447,753	1.4395
16 Nov 2011 05:58:29	1161345	13560287	hadcm3n_ygtw_1900_40_007527255_1	285,120	410,555	1.4399
16 Nov 2011 05:58:29	1161345	13560287	hadcm3n_ygtw_1900_40_007527255_1	259,200	373,427	1.4407
16 Nov 2011 05:58:29	1161345	13560287	hadcm3n_ygtw_1900_40_007527255_1	233,280	336,329	1.4417
16 Nov 2011 05:58:29	1161345	13560287	hadcm3n_ygtw_1900_40_007527255_1	207,360	299,353	1.4436
16 Nov 2011 05:58:29	1161345	13560287	hadcm3n_ygtw_1900_40_007527255_1	181,440	262,223	1.4452
10 Nov 2011 05:22:07	1161345	13560287	hadcm3n_ygtw_1900_40_007527255_1	155,520	224,634	1.4444
09 Nov 2011 08:01:26	1161345	13560287	hadcm3n_ygtw_1900_40_007527255_1	129,600	187,454	1.4464
08 Nov 2011 03:58:55	1161345	13560287	hadcm3n_ygtw_1900_40_007527255_1	103,680	150,151	1.4482
07 Nov 2011 10:09:33	1161345	13560287	hadcm3n_ygtw_1900_40_007527255_1	77,760	113,044	1.4538
05 Nov 2011 00:11:10	1161345	13560287	hadcm3n_ygtw_1900_40_007527255_1	51,840	75,928	1.4647
01 Nov 2011 20:57:01	1161345	13560287	hadcm3n_ygtw_1900_40_007527255_1	25,920	38,511	1.4858