Task 13124343

Name	hadcm3n_yl4i_1900_40_007360236_0
Workunit	7557666
Created	6 Jul 2011, 15:11:23 UTC
Sent	7 Jul 2011, 19:36:15 UTC
Report deadline	7 Oct 2011, 3:03:26 UTC
Received	10 Aug 2011, 15:07:31 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	905504
Run time	15 days 5 hours 40 min 44 sec
CPU time	15 days 5 hours 40 min 44 sec
Validate state	Invalid
Credit	4,354.56
Device peak FLOPS	1.38 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.2.18</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:11:03 (6344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:37:28 (7696): No heartbeat from core client for 30 sec - exiting 18:37:29 (7696): No heartbeat from core client for 30 sec - exiting 18:37:30 (7696): No heartbeat from core client for 30 sec - exiting 18:37:31 (7696): No heartbeat from core client for 30 sec - exiting 18:37:32 (7696): No heartbeat from core client for 30 sec - exiting 18:37:33 (7696): No heartbeat from core client for 30 sec - exiting 18:37:34 (7696): No heartbeat from core client for 30 sec - exiting 18:37:35 (7696): No heartbeat from core client for 30 sec - exiting 18:37:36 (7696): No heartbeat from core client for 30 sec - exiting 18:37:37 (7696): No heartbeat from core client for 30 sec - exiting 18:37:38 (7696): No heartbeat from core client for 30 sec - exiting 18:37:39 (7696): No heartbeat from core client for 30 sec - exiting 18:37:40 (7696): No heartbeat from core client for 30 sec - exiting 18:37:41 (7696): No heartbeat from core client for 30 sec - exiting 18:37:42 (7696): No heartbeat from core client for 30 sec - exiting 18:37:43 (7696): No heartbeat from core client for 30 sec - exiting 18:37:44 (7696): No heartbeat from core client for 30 sec - exiting 18:37:45 (7696): No heartbeat from core client for 30 sec - exiting 18:37:46 (7696): No heartbeat from core client for 30 sec - exiting 18:37:47 (7696): No heartbeat from core client for 30 sec - exiting 18:37:48 (7696): No heartbeat from core client for 30 sec - exiting 18:37:49 (7696): No heartbeat from core client for 30 sec - exiting 18:37:50 (7696): No heartbeat from core client for 30 sec - exiting 18:37:51 (7696): No heartbeat from core client for 30 sec - exiting 18:37:52 (7696): No heartbeat from core client for 30 sec - exiting 18:37:53 (7696): No heartbeat from core client for 30 sec - exiting 18:37:54 (7696): No heartbeat from core client for 30 sec - exiting 18:37:56 (7696): No heartbeat from core client for 30 sec - exiting 18:37:57 (7696): No heartbeat from core client for 30 sec - exiting 18:37:58 (7696): No heartbeat from core client for 30 sec - exiting 18:37:59 (7696): No heartbeat from core client for 30 sec - exiting 18:38:00 (7696): No heartbeat from core client for 30 sec - exiting 18:38:01 (7696): No heartbeat from core client for 30 sec - exiting 18:38:02 (7696): No heartbeat from core client for 30 sec - exiting 18:38:03 (7696): No heartbeat from core client for 30 sec - exiting 18:38:04 (7696): No heartbeat from core client for 30 sec - exiting 18:38:05 (7696): No heartbeat from core client for 30 sec - exiting 18:38:06 (7696): No heartbeat from core client for 30 sec - exiting 18:38:07 (7696): No heartbeat from core client for 30 sec - exiting 18:38:08 (7696): No heartbeat from core client for 30 sec - exiting 18:38:09 (7696): No heartbeat from core client for 30 sec - exiting 18:38:10 (7696): No heartbeat from core client for 30 sec - exiting 18:38:11 (7696): No heartbeat from core client for 30 sec - exiting 18:38:12 (7696): No heartbeat from core client for 30 sec - exiting 18:38:13 (7696): No heartbeat from core client for 30 sec - exiting 18:38:14 (7696): No heartbeat from core client for 30 sec - exiting 18:38:15 (7696): No heartbeat from core client for 30 sec - exiting 18:38:16 (7696): No heartbeat from core client for 30 sec - exiting 18:38:17 (7696): No heartbeat from core client for 30 sec - exiting 18:38:18 (7696): No heartbeat from core client for 30 sec - exiting 18:38:19 (7696): No heartbeat from core client for 30 sec - exiting 18:38:20 (7696): No heartbeat from core client for 30 sec - exiting 18:38:21 (7696): No heartbeat from core client for 30 sec - exiting 18:38:22 (7696): No heartbeat from core client for 30 sec - exiting 18:38:23 (7696): No heartbeat from core client for 30 sec - exiting 18:38:24 (7696): No heartbeat from core client for 30 sec - exiting 18:38:25 (7696): No heartbeat from core client for 30 sec - exiting 18:38:26 (7696): No heartbeat from core client for 30 sec - exiting 18:38:27 (7696): No heartbeat from core client for 30 sec - exiting 18:38:28 (7696): No heartbeat from core client for 30 sec - exiting 18:38:29 (7696): No heartbeat from core client for 30 sec - exiting 18:38:30 (7696): No heartbeat from core client for 30 sec - exiting 18:38:31 (7696): No heartbeat from core client for 30 sec - exiting 18:38:32 (7696): No heartbeat from core client for 30 sec - exiting 18:38:33 (7696): No heartbeat from core client for 30 sec - exiting 18:38:34 (7696): No heartbeat from core client for 30 sec - exiting 18:38:35 (7696): No heartbeat from core client for 30 sec - exiting 18:38:36 (7696): No heartbeat from core client for 30 sec - exiting 18:38:37 (7696): No heartbeat from core client for 30 sec - exiting 18:38:38 (7696): No heartbeat from core client for 30 sec - exiting 18:38:39 (7696): No heartbeat from core client for 30 sec - exiting 18:38:40 (7696): No heartbeat from core client for 30 sec - exiting 18:38:41 (7696): No heartbeat from core client for 30 sec - exiting 18:38:42 (7696): No heartbeat from core client for 30 sec - exiting 18:38:43 (7696): No heartbeat from core client for 30 sec - exiting 18:38:44 (7696): No heartbeat from core client for 30 sec - exiting 18:38:45 (7696): No heartbeat from core client for 30 sec - exiting 18:38:46 (7696): No heartbeat from core client for 30 sec - exiting 18:38:47 (7696): No heartbeat from core client for 30 sec - exiting 18:38:48 (7696): No heartbeat from core client for 30 sec - exiting 18:38:49 (7696): No heartbeat from core client for 30 sec - exiting 18:38:50 (7696): No heartbeat from core client for 30 sec - exiting 18:38:51 (7696): No heartbeat from core client for 30 sec - exiting 18:38:52 (7696): No heartbeat from core client for 30 sec - exiting 18:38:53 (7696): No heartbeat from core client for 30 sec - exiting 18:38:54 (7696): No heartbeat from core client for 30 sec - exiting 18:38:55 (7696): No heartbeat from core client for 30 sec - exiting 18:38:56 (7696): No heartbeat from core client for 30 sec - exiting 18:38:58 (7696): No heartbeat from core client for 30 sec - exiting 18:38:59 (7696): No heartbeat from core client for 30 sec - exiting 18:39:00 (7696): No heartbeat from core client for 30 sec - exiting 18:39:01 (7696): No heartbeat from core client for 30 sec - exiting 18:39:02 (7696): No heartbeat from core client for 30 sec - exiting 18:39:03 (7696): No heartbeat from core client for 30 sec - exiting 18:39:04 (7696): No heartbeat from core client for 30 sec - exiting 18:39:05 (7696): No heartbeat from core client for 30 sec - exiting 18:39:06 (7696): No heartbeat from core client for 30 sec - exiting 18:39:07 (7696): No heartbeat from core client for 30 sec - exiting 18:39:08 (7696): No heartbeat from core client for 30 sec - exiting 18:39:09 (7696): No heartbeat from core client for 30 sec - exiting 18:39:10 (7696): No heartbeat from core client for 30 sec - exiting 18:39:11 (7696): No heartbeat from core client for 30 sec - exiting 18:39:12 (7696): No heartbeat from core client for 30 sec - exiting 18:39:13 (7696): No heartbeat from core client for 30 sec - exiting 18:39:14 (7696): No heartbeat from core client for 30 sec - exiting 18:39:15 (7696): No heartbeat from core client for 30 sec - exiting 18:39:16 (7696): No heartbeat from core client for 30 sec - exiting 18:39:17 (7696): No heartbeat from core client for 30 sec - exiting 18:39:18 (7696): No heartbeat from core client for 30 sec - exiting 18:39:19 (7696): No heartbeat from core client for 30 sec - exiting 18:39:20 (7696): No heartbeat from core client for 30 sec - exiting 18:39:21 (7696): No heartbeat from core client for 30 sec - exiting 18:39:22 (7696): No heartbeat from core client for 30 sec - exiting 18:39:23 (7696): No heartbeat from core client for 30 sec - exiting 18:39:24 (7696): No heartbeat from core client for 30 sec - exiting 18:39:25 (7696): No heartbeat from core client for 30 sec - exiting 18:39:26 (7696): No heartbeat from core client for 30 sec - exiting 18:39:27 (7696): No heartbeat from core client for 30 sec - exiting 18:39:28 (7696): No heartbeat from core client for 30 sec - exiting 18:39:29 (7696): No heartbeat from core client for 30 sec - exiting 18:39:30 (7696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/yl4iko.pja1c10 Error converting file to netcdf: dataout/yl4iko.pia1c10 Error converting file to netcdf: dataout/yl4iko.pfa1c10 Error converting file to netcdf: dataout/yl4ika.pha1c10 Error converting file to netcdf: dataout/yl4ika.pga1c10 Error converting file to netcdf: dataout/yl4ika.pea1c10 Error converting file to netcdf: dataout/yl4ika.pda1c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:04:21 (3076): No heartbeat from core client for 30 sec - exiting 14:04:22 (3076): No heartbeat from core client for 30 sec - exiting 14:04:23 (3076): No heartbeat from core client for 30 sec - exiting 14:04:24 (3076): No heartbeat from core client for 30 sec - exiting 14:04:25 (3076): No heartbeat from core client for 30 sec - exiting 14:04:26 (3076): No heartbeat from core client for 30 sec - exiting 14:04:27 (3076): No heartbeat from core client for 30 sec - exiting 14:04:28 (3076): No heartbeat from core client for 30 sec - exiting 14:04:29 (3076): No heartbeat from core client for 30 sec - exiting 14:04:30 (3076): No heartbeat from core client for 30 sec - exiting 14:04:31 (3076): No heartbeat from core client for 30 sec - exiting 14:04:32 (3076): No heartbeat from core client for 30 sec - exiting 14:04:33 (3076): No heartbeat from core client for 30 sec - exiting 14:04:34 (3076): No heartbeat from core client for 30 sec - exiting 14:04:35 (3076): No heartbeat from core client for 30 sec - exiting 14:04:36 (3076): No heartbeat from core client for 30 sec - exiting 14:04:37 (3076): No heartbeat from core client for 30 sec - exiting 14:04:38 (3076): No heartbeat from core client for 30 sec - exiting 14:04:39 (3076): No heartbeat from core client for 30 sec - exiting 14:04:40 (3076): No heartbeat from core client for 30 sec - exiting 14:04:41 (3076): No heartbeat from core client for 30 sec - exiting 14:04:42 (3076): No heartbeat from core client for 30 sec - exiting 14:04:43 (3076): No heartbeat from core client for 30 sec - exiting 14:04:44 (3076): No heartbeat from core client for 30 sec - exiting 14:04:45 (3076): No heartbeat from core client for 30 sec - exiting 14:04:46 (3076): No heartbeat from core client for 30 sec - exiting 14:04:47 (3076): No heartbeat from core client for 30 sec - exiting 14:04:48 (3076): No heartbeat from core client for 30 sec - exiting 14:04:49 (3076): No heartbeat from core client for 30 sec - exiting 14:04:50 (3076): No heartbeat from core client for 30 sec - exiting 14:04:51 (3076): No heartbeat from core client for 30 sec - exiting 14:04:52 (3076): No heartbeat from core client for 30 sec - exiting 14:04:53 (3076): No heartbeat from core client for 30 sec - exiting 14:04:54 (3076): No heartbeat from core client for 30 sec - exiting 14:04:55 (3076): No heartbeat from core client for 30 sec - exiting 14:04:56 (3076): No heartbeat from core client for 30 sec - exiting 14:04:57 (3076): No heartbeat from core client for 30 sec - exiting 14:04:58 (3076): No heartbeat from core client for 30 sec - exiting 14:04:59 (3076): No heartbeat from core client for 30 sec - exiting 14:05:00 (3076): No heartbeat from core client for 30 sec - exiting 14:05:01 (3076): No heartbeat from core client for 30 sec - exiting 14:05:02 (3076): No heartbeat from core client for 30 sec - exiting 14:05:03 (3076): No heartbeat from core client for 30 sec - exiting 14:05:04 (3076): No heartbeat from core client for 30 sec - exiting 14:05:05 (3076): No heartbeat from core client for 30 sec - exiting 14:05:06 (3076): No heartbeat from core client for 30 sec - exiting 14:05:07 (3076): No heartbeat from core client for 30 sec - exiting 14:05:08 (3076): No heartbeat from core client for 30 sec - exiting 14:05:10 (3076): No heartbeat from core client for 30 sec - exiting 14:05:11 (3076): No heartbeat from core client for 30 sec - exiting 14:05:12 (3076): No heartbeat from core client for 30 sec - exiting 14:05:13 (3076): No heartbeat from core client for 30 sec - exiting 14:05:14 (3076): No heartbeat from core client for 30 sec - exiting 14:05:15 (3076): No heartbeat from core client for 30 sec - exiting 14:05:16 (3076): No heartbeat from core client for 30 sec - exiting 14:05:17 (3076): No heartbeat from core client for 30 sec - exiting 14:05:18 (3076): No heartbeat from core client for 30 sec - exiting 14:05:19 (3076): No heartbeat from core client for 30 sec - exiting 14:05:20 (3076): No heartbeat from core client for 30 sec - exiting 14:05:21 (3076): No heartbeat from core client for 30 sec - exiting 14:05:22 (3076): No heartbeat from core client for 30 sec - exiting 14:05:23 (3076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/yl4iko.pja4c10 Error converting file to netcdf: dataout/yl4iko.pia4c10 Error converting file to netcdf: dataout/yl4iko.pfa4c10 Error converting file to netcdf: dataout/yl4ika.pha4c10 Error converting file to netcdf: dataout/yl4ika.pga4c10 Error converting file to netcdf: dataout/yl4ika.pea4c10 Error converting file to netcdf: dataout/yl4ika.pda4c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:00:24 (2472): No heartbeat from core client for 30 sec - exiting 01:00:25 (2472): No heartbeat from core client for 30 sec - exiting 01:00:26 (2472): No heartbeat from core client for 30 sec - exiting 01:00:27 (2472): No heartbeat from core client for 30 sec - exiting 01:00:28 (2472): No heartbeat from core client for 30 sec - exiting 01:00:29 (2472): No heartbeat from core client for 30 sec - exiting 01:00:30 (2472): No heartbeat from core client for 30 sec - exiting 01:00:31 (2472): No heartbeat from core client for 30 sec - exiting 01:00:32 (2472): No heartbeat from core client for 30 sec - exiting 01:00:33 (2472): No heartbeat from core client for 30 sec - exiting 01:00:34 (2472): No heartbeat from core client for 30 sec - exiting 01:00:35 (2472): No heartbeat from core client for 30 sec - exiting 01:00:36 (2472): No heartbeat from core client for 30 sec - exiting 01:00:37 (2472): No heartbeat from core client for 30 sec - exiting 01:00:38 (2472): No heartbeat from core client for 30 sec - exiting 01:00:39 (2472): No heartbeat from core client for 30 sec - exiting 01:00:40 (2472): No heartbeat from core client for 30 sec - exiting 01:00:41 (2472): No heartbeat from core client for 30 sec - exiting 01:00:43 (2472): No heartbeat from core client for 30 sec - exiting 01:00:44 (2472): No heartbeat from core client for 30 sec - exiting 01:00:45 (2472): No heartbeat from core client for 30 sec - exiting 01:00:46 (2472): No heartbeat from core client for 30 sec - exiting 01:00:47 (2472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3580, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3580, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3580, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3580, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3580, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3580, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Aug 2011 11:20:48	905504	13124343	hadcm3n_yl4i_1900_40_007360236_0	362,880	1,256,420	3.4624
05 Aug 2011 04:53:24	905504	13124343	hadcm3n_yl4i_1900_40_007360236_0	336,960	1,165,047	3.4575
02 Aug 2011 20:23:36	905504	13124343	hadcm3n_yl4i_1900_40_007360236_0	311,040	1,074,370	3.4541
31 Jul 2011 14:23:11	905504	13124343	hadcm3n_yl4i_1900_40_007360236_0	285,120	984,441	3.4527
29 Jul 2011 08:01:26	905504	13124343	hadcm3n_yl4i_1900_40_007360236_0	259,200	894,840	3.4523
27 Jul 2011 02:21:03	905504	13124343	hadcm3n_yl4i_1900_40_007360236_0	233,280	805,991	3.4550
25 Jul 2011 22:19:20	905504	13124343	hadcm3n_yl4i_1900_40_007360236_0	207,360	715,994	3.4529
25 Jul 2011 19:26:47	905504	13124343	hadcm3n_yl4i_1900_40_007360236_0	181,440	626,885	3.4551
25 Jul 2011 18:51:33	905504	13124343	hadcm3n_yl4i_1900_40_007360236_0	155,520	537,509	3.4562
25 Jul 2011 16:40:26	905504	13124343	hadcm3n_yl4i_1900_40_007360236_0	129,600	448,539	3.4609
25 Jul 2011 14:48:32	905504	13124343	hadcm3n_yl4i_1900_40_007360236_0	103,680	358,914	3.4617
25 Jul 2011 12:50:42	905504	13124343	hadcm3n_yl4i_1900_40_007360236_0	77,760	269,399	3.4645
25 Jul 2011 12:50:42	905504	13124343	hadcm3n_yl4i_1900_40_007360236_0	51,840	179,712	3.4667
10 Jul 2011 02:44:33	905504	13124343	hadcm3n_yl4i_1900_40_007360236_0	25,920	89,957	3.4706