Task 15292835

Name	hadcm3n_z89f_1880_40_008200900_2
Workunit	8356024
Created	20 Sep 2012, 9:41:48 UTC
Sent	20 Sep 2012, 9:42:02 UTC
Report deadline	20 Dec 2012, 17:09:13 UTC
Received	14 Oct 2012, 11:32:26 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	25 (0x00000019) Unknown error code
Computer ID	1230200
Run time	6 days 17 hours 18 min 29 sec
CPU time	6 days 14 hours 36 min 29 sec
Validate state	Invalid
Credit	2,488.32
Device peak FLOPS	2.79 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> Das Laufwerk kann einen bestimmten Bereich oder eine bestimmte Spur nicht finden. (0x19) - exit code 25 (0x19) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3684, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 20:40:48 (6012): No heartbeat from core client for 30 sec - exiting 20:40:49 (6012): No heartbeat from core client for 30 sec - exiting 20:40:50 (6012): No heartbeat from core client for 30 sec - exiting 20:40:51 (6012): No heartbeat from core client for 30 sec - exiting 20:40:52 (6012): No heartbeat from core client for 30 sec - exiting 20:40:53 (6012): No heartbeat from core client for 30 sec - exiting 20:40:54 (6012): No heartbeat from core client for 30 sec - exiting 20:40:55 (6012): No heartbeat from core client for 30 sec - exiting 20:40:56 (6012): No heartbeat from core client for 30 sec - exiting 20:40:57 (6012): No heartbeat from core client for 30 sec - exiting 20:40:58 (6012): No heartbeat from core client for 30 sec - exiting 20:40:59 (6012): No heartbeat from core client for 30 sec - exiting 20:41:00 (6012): No heartbeat from core client for 30 sec - exiting 20:41:01 (6012): No heartbeat from core client for 30 sec - exiting 20:41:02 (6012): No heartbeat from core client for 30 sec - exiting 20:41:03 (6012): No heartbeat from core client for 30 sec - exiting 20:41:04 (6012): No heartbeat from core client for 30 sec - exiting 20:41:05 (6012): No heartbeat from core client for 30 sec - exiting 20:41:06 (6012): No heartbeat from core client for 30 sec - exiting 20:41:07 (6012): No heartbeat from core client for 30 sec - exiting 20:41:08 (6012): No heartbeat from core client for 30 sec - exiting 20:41:09 (6012): No heartbeat from core client for 30 sec - exiting 20:41:10 (6012): No heartbeat from core client for 30 sec - exiting 20:41:11 (6012): No heartbeat from core client for 30 sec - exiting 20:41:12 (6012): No heartbeat from core client for 30 sec - exiting 20:41:13 (6012): No heartbeat from core client for 30 sec - exiting 20:41:14 (6012): No heartbeat from core client for 30 sec - exiting 20:41:15 (6012): No heartbeat from core client for 30 sec - exiting 20:41:16 (6012): No heartbeat from core client for 30 sec - exiting 20:41:17 (6012): No heartbeat from core client for 30 sec - exiting 20:41:18 (6012): No heartbeat from core client for 30 sec - exiting 20:41:19 (6012): No heartbeat from core client for 30 sec - exiting 20:41:20 (6012): No heartbeat from core client for 30 sec - exiting 20:41:21 (6012): No heartbeat from core client for 30 sec - exiting 20:41:22 (6012): No heartbeat from core client for 30 sec - exiting 20:41:23 (6012): No heartbeat from core client for 30 sec - exiting 20:41:24 (6012): No heartbeat from core client for 30 sec - exiting 20:41:25 (6012): No heartbeat from core client for 30 sec - exiting 20:41:26 (6012): No heartbeat from core client for 30 sec - exiting 20:41:27 (6012): No heartbeat from core client for 30 sec - exiting 20:41:28 (6012): No heartbeat from core client for 30 sec - exiting 20:41:29 (6012): No heartbeat from core client for 30 sec - exiting 20:41:30 (6012): No heartbeat from core client for 30 sec - exiting 20:41:31 (6012): No heartbeat from core client for 30 sec - exiting 20:41:32 (6012): No heartbeat from core client for 30 sec - exiting 20:41:33 (6012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:33:17 (6532): No heartbeat from core client for 30 sec - exiting 21:33:18 (6532): No heartbeat from core client for 30 sec - exiting 21:33:19 (6532): No heartbeat from core client for 30 sec - exiting 21:33:20 (6532): No heartbeat from core client for 30 sec - exiting 21:33:21 (6532): No heartbeat from core client for 30 sec - exiting 21:33:22 (6532): No heartbeat from core client for 30 sec - exiting 21:33:23 (6532): No heartbeat from core client for 30 sec - exiting 21:33:24 (6532): No heartbeat from core client for 30 sec - exiting 21:33:25 (6532): No heartbeat from core client for 30 sec - exiting 21:33:26 (6532): No heartbeat from core client for 30 sec - exiting 21:33:27 (6532): No heartbeat from core client for 30 sec - exiting 21:33:28 (6532): No heartbeat from core client for 30 sec - exiting 21:33:29 (6532): No heartbeat from core client for 30 sec - exiting 21:33:30 (6532): No heartbeat from core client for 30 sec - exiting 21:33:31 (6532): No heartbeat from core client for 30 sec - exiting 21:33:32 (6532): No heartbeat from core client for 30 sec - exiting 21:33:33 (6532): No heartbeat from core client for 30 sec - exiting 21:33:34 (6532): No heartbeat from core client for 30 sec - exiting 21:33:35 (6532): No heartbeat from core client for 30 sec - exiting 21:33:36 (6532): No heartbeat from core client for 30 sec - exiting 21:33:37 (6532): No heartbeat from core client for 30 sec - exiting 21:33:38 (6532): No heartbeat from core client for 30 sec - exiting 21:33:39 (6532): No heartbeat from core client for 30 sec - exiting 21:33:40 (6532): No heartbeat from core client for 30 sec - exiting 21:33:41 (6532): No heartbeat from core client for 30 sec - exiting 21:33:42 (6532): No heartbeat from core client for 30 sec - exiting 21:33:43 (6532): No heartbeat from core client for 30 sec - exiting 21:33:44 (6532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 10:30:17 (5192): No heartbeat from core client for 30 sec - exiting 10:30:18 (5192): No heartbeat from core client for 30 sec - exiting 10:30:19 (5192): No heartbeat from core client for 30 sec - exiting 10:30:20 (5192): No heartbeat from core client for 30 sec - exiting 10:30:21 (5192): No heartbeat from core client for 30 sec - exiting 10:30:22 (5192): No heartbeat from core client for 30 sec - exiting 10:30:23 (5192): No heartbeat from core client for 30 sec - exiting 10:30:24 (5192): No heartbeat from core client for 30 sec - exiting 10:30:25 (5192): No heartbeat from core client for 30 sec - exiting 10:30:26 (5192): No heartbeat from core client for 30 sec - exiting 10:30:27 (5192): No heartbeat from core client for 30 sec - exiting 10:30:28 (5192): No heartbeat from core client for 30 sec - exiting 10:30:29 (5192): No heartbeat from core client for 30 sec - exiting 10:30:30 (5192): No heartbeat from core client for 30 sec - exiting 10:30:31 (5192): No heartbeat from core client for 30 sec - exiting 10:30:32 (5192): No heartbeat from core client for 30 sec - exiting 10:30:33 (5192): No heartbeat from core client for 30 sec - exiting 10:30:34 (5192): No heartbeat from core client for 30 sec - exiting 10:30:35 (5192): No heartbeat from core client for 30 sec - exiting 10:30:36 (5192): No heartbeat from core client for 30 sec - exiting 10:30:37 (5192): No heartbeat from core client for 30 sec - exiting 10:30:38 (5192): No heartbeat from core client for 30 sec - exiting 10:30:39 (5192): No heartbeat from core client for 30 sec - exiting 10:30:40 (5192): No heartbeat from core client for 30 sec - exiting 10:30:41 (5192): No heartbeat from core client for 30 sec - exiting 10:30:42 (5192): No heartbeat from core client for 30 sec - exiting 10:30:43 (5192): No heartbeat from core client for 30 sec - exiting 10:30:44 (5192): No heartbeat from core client for 30 sec - exiting 10:30:45 (5192): No heartbeat from core client for 30 sec - exiting 10:30:46 (5192): No heartbeat from core client for 30 sec - exiting 10:30:47 (5192): No heartbeat from core client for 30 sec - exiting 10:30:48 (5192): No heartbeat from core client for 30 sec - exiting 10:30:49 (5192): No heartbeat from core client for 30 sec - exiting 10:30:50 (5192): No heartbeat from core client for 30 sec - exiting 10:30:51 (5192): No heartbeat from core client for 30 sec - exiting 10:30:52 (5192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 10:05:13 (1300): No heartbeat from core client for 30 sec - exiting 10:05:14 (1300): No heartbeat from core client for 30 sec - exiting 10:05:15 (1300): No heartbeat from core client for 30 sec - exiting 10:05:16 (1300): No heartbeat from core client for 30 sec - exiting 10:05:17 (1300): No heartbeat from core client for 30 sec - exiting 10:05:18 (1300): No heartbeat from core client for 30 sec - exiting 10:05:19 (1300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:55:31 (6712): No heartbeat from core client for 30 sec - exiting 19:55:32 (6712): No heartbeat from core client for 30 sec - exiting 19:55:33 (6712): No heartbeat from core client for 30 sec - exiting 19:55:34 (6712): No heartbeat from core client for 30 sec - exiting 19:55:35 (6712): No heartbeat from core client for 30 sec - exiting 19:55:36 (6712): No heartbeat from core client for 30 sec - exiting 19:55:37 (6712): No heartbeat from core client for 30 sec - exiting 19:55:38 (6712): No heartbeat from core client for 30 sec - exiting 19:55:39 (6712): No heartbeat from core client for 30 sec - exiting 19:55:40 (6712): No heartbeat from core client for 30 sec - exiting 19:55:41 (6712): No heartbeat from core client for 30 sec - exiting 19:55:42 (6712): No heartbeat from core client for 30 sec - exiting 19:55:43 (6712): No heartbeat from core client for 30 sec - exiting 19:55:44 (6712): No heartbeat from core client for 30 sec - exiting 19:55:45 (6712): No heartbeat from core client for 30 sec - exiting 19:55:46 (6712): No heartbeat from core client for 30 sec - exiting 19:55:47 (6712): No heartbeat from core client for 30 sec - exiting 19:55:48 (6712): No heartbeat from core client for 30 sec - exiting 19:55:49 (6712): No heartbeat from core client for 30 sec - exiting 19:55:50 (6712): No heartbeat from core client for 30 sec - exiting 19:55:51 (6712): No heartbeat from core client for 30 sec - exiting 19:55:52 (6712): No heartbeat from core client for 30 sec - exiting 19:55:53 (6712): No heartbeat from core client for 30 sec - exiting 19:55:54 (6712): No heartbeat from core client for 30 sec - exiting 19:55:55 (6712): No heartbeat from core client for 30 sec - exiting 19:55:56 (6712): No heartbeat from core client for 30 sec - exiting 19:55:57 (6712): No heartbeat from core client for 30 sec - exiting 19:55:58 (6712): No heartbeat from core client for 30 sec - exiting 19:55:59 (6712): No heartbeat from core client for 30 sec - exiting 19:56:00 (6712): No heartbeat from core client for 30 sec - exiting 19:56:01 (6712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:34:47 (7848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:34:48 (7848): No heartbeat from core client for 30 sec - exiting 22:34:49 (7848): No heartbeat from core client for 30 sec - exiting 22:34:50 (7848): No heartbeat from core client for 30 sec - exiting 22:34:51 (7848): No heartbeat from core client for 30 sec - exiting 22:34:52 (7848): No heartbeat from core client for 30 sec - exiting 22:34:53 (7848): No heartbeat from core client for 30 sec - exiting 10:18:53 (6564): No heartbeat from core client for 30 sec - exiting 10:18:54 (6564): No heartbeat from core client for 30 sec - exiting 10:18:55 (6564): No heartbeat from core client for 30 sec - exiting 10:18:56 (6564): No heartbeat from core client for 30 sec - exiting 10:18:57 (6564): No heartbeat from core client for 30 sec - exiting 10:18:58 (6564): No heartbeat from core client for 30 sec - exiting 10:18:59 (6564): No heartbeat from core client for 30 sec - exiting 10:19:00 (6564): No heartbeat from core client for 30 sec - exiting 10:19:01 (6564): No heartbeat from core client for 30 sec - exiting 10:19:02 (6564): No heartbeat from core client for 30 sec - exiting 10:19:03 (6564): No heartbeat from core client for 30 sec - exiting 10:19:04 (6564): No heartbeat from core client for 30 sec - exiting 10:19:05 (6564): No heartbeat from core client for 30 sec - exiting 10:19:06 (6564): No heartbeat from core client for 30 sec - exiting 10:19:07 (6564): No heartbeat from core client for 30 sec - exiting 10:19:08 (6564): No heartbeat from core client for 30 sec - exiting 10:19:09 (6564): No heartbeat from core client for 30 sec - exiting 10:19:10 (6564): No heartbeat from core client for 30 sec - exiting 10:19:11 (6564): No heartbeat from core client for 30 sec - exiting 10:19:12 (6564): No heartbeat from core client for 30 sec - exiting 10:19:13 (6564): No heartbeat from core client for 30 sec - exiting 10:19:14 (6564): No heartbeat from core client for 30 sec - exiting 10:19:15 (6564): No heartbeat from core client for 30 sec - exiting 10:19:16 (6564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 15:44:45 (6192): No heartbeat from core client for 30 sec - exiting 15:44:46 (6192): No heartbeat from core client for 30 sec - exiting 15:44:47 (6192): No heartbeat from core client for 30 sec - exiting 15:44:48 (6192): No heartbeat from core client for 30 sec - exiting 15:44:49 (6192): No heartbeat from core client for 30 sec - exiting 15:44:50 (6192): No heartbeat from core client for 30 sec - exiting 15:44:51 (6192): No heartbeat from core client for 30 sec - exiting 15:44:52 (6192): No heartbeat from core client for 30 sec - exiting 15:44:53 (6192): No heartbeat from core client for 30 sec - exiting 15:44:54 (6192): No heartbeat from core client for 30 sec - exiting 15:44:55 (6192): No heartbeat from core client for 30 sec - exiting 15:44:56 (6192): No heartbeat from core client for 30 sec - exiting 15:44:57 (6192): No heartbeat from core client for 30 sec - exiting 15:44:58 (6192): No heartbeat from core client for 30 sec - exiting 15:44:59 (6192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:16:16 (4568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:46:52 (3188): No heartbeat from core client for 30 sec - exiting 09:46:53 (3188): No heartbeat from core client for 30 sec - exiting 09:46:54 (3188): No heartbeat from core client for 30 sec - exiting 09:46:55 (3188): No heartbeat from core client for 30 sec - exiting 09:46:56 (3188): No heartbeat from core client for 30 sec - exiting 09:46:57 (3188): No heartbeat from core client for 30 sec - exiting 09:46:58 (3188): No heartbeat from core client for 30 sec - exiting 09:46:59 (3188): No heartbeat from core client for 30 sec - exiting 09:47:00 (3188): No heartbeat from core client for 30 sec - exiting 09:47:01 (3188): No heartbeat from core client for 30 sec - exiting 09:47:02 (3188): No heartbeat from core client for 30 sec - exiting 09:47:03 (3188): No heartbeat from core client for 30 sec - exiting 09:47:04 (3188): No heartbeat from core client for 30 sec - exiting 09:47:05 (3188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:47:06 (3188): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 14:50:58 (3972): No heartbeat from core client for 30 sec - exiting 14:50:59 (3972): No heartbeat from core client for 30 sec - exiting 14:51:00 (3972): No heartbeat from core client for 30 sec - exiting 14:51:01 (3972): No heartbeat from core client for 30 sec - exiting 14:51:02 (3972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 18:24:10 (6284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:13:30 (3772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:13:31 (3772): No heartbeat from core client for 30 sec - exiting 19:13:32 (3772): No heartbeat from core client for 30 sec - exiting 19:13:33 (3772): No heartbeat from core client for 30 sec - exiting 19:13:34 (3772): No heartbeat from core client for 30 sec - exiting 19:13:35 (3772): No heartbeat from core client for 30 sec - exiting 19:13:36 (3772): No heartbeat from core client for 30 sec - exiting 19:13:37 (3772): No heartbeat from core client for 30 sec - exiting 19:13:38 (3772): No heartbeat from core client for 30 sec - exiting 19:13:39 (3772): No heartbeat from core client for 30 sec - exiting 19:13:40 (3772): No heartbeat from core client for 30 sec - exiting 09:50:33 (6072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6480, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4344, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4344, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4344, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4344, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4344, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish CPDN Monitor - Quit request from BOINC... 15:40:38 (6120): No heartbeat from core client for 30 sec - exiting 15:40:39 (6120): No heartbeat from core client for 30 sec - exiting 15:40:40 (6120): No heartbeat from core client for 30 sec - exiting 15:40:41 (6120): No heartbeat from core client for 30 sec - exiting 15:40:42 (6120): No heartbeat from core client for 30 sec - exiting 15:40:43 (6120): No heartbeat from core client for 30 sec - exiting 15:40:44 (6120): No heartbeat from core client for 30 sec - exiting 15:40:45 (6120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:14:00 (4376): No heartbeat from core client for 30 sec - exiting 11:14:01 (4376): No heartbeat from core client for 30 sec - exiting 11:14:02 (4376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:01:23 (6176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5748, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6004, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:31:33 (6256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:31:34 (6256): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:24:46 (4840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:24:48 (4840): No heartbeat from core client for 30 sec - exiting 21:24:49 (4840): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
12 Oct 2012 16:11:39	1230200	15292835	hadcm3n_z89f_1880_40_008200900_2	207,360	547,793	2.6417
11 Oct 2012 10:00:54	1230200	15292835	hadcm3n_z89f_1880_40_008200900_2	181,440	504,075	2.7782
10 Oct 2012 10:31:36	1230200	15292835	hadcm3n_z89f_1880_40_008200900_2	155,520	460,307	2.9598
08 Oct 2012 17:17:41	1230200	15292835	hadcm3n_z89f_1880_40_008200900_2	129,600	415,729	3.2078
27 Sep 2012 14:25:23	1230200	15292835	hadcm3n_z89f_1880_40_008200900_2	103,680	180,759	1.7434
26 Sep 2012 08:22:33	1230200	15292835	hadcm3n_z89f_1880_40_008200900_2	77,760	135,665	1.7447
24 Sep 2012 11:20:34	1230200	15292835	hadcm3n_z89f_1880_40_008200900_2	51,840	90,167	1.7393
21 Sep 2012 17:49:28	1230200	15292835	hadcm3n_z89f_1880_40_008200900_2	25,920	45,165	1.7425