Task 16650074

Name	hadcm3n_869p_1980_40_008514628_1
Workunit	8662140
Created	29 May 2014, 0:44:56 UTC
Sent	29 May 2014, 0:45:43 UTC
Report deadline	28 Aug 2014, 8:12:54 UTC
Received	11 Feb 2015, 2:24:23 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1293439
Run time	10 days 4 hours 1 min 42 sec
CPU time	7 days 2 hours 6 min 57 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	1.76 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> (unknown error) - exit code 193 (0xc1) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3316, iMonCtr=1 Model crash detected, will try to restart... 14:57:16 (3520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:07:07 (3816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:07:08 (3816): No heartbeat from core client for 30 sec - exiting 19:07:09 (3816): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 23:22:58 (1200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:37:00 (2432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:19:23 (4052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3524, iMonCtr=1 Model crash detected, will try to restart... 21:14:02 (3948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:38:00 (3580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2928, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:14:36 (3588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:45:17 (4016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4024, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3488, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 10:05:18 (4076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:05:19 (4076): No heartbeat from core client for 30 sec - exiting 10:05:20 (4076): No heartbeat from core client for 30 sec - exiting 10:05:21 (4076): No heartbeat from core client for 30 sec - exiting 10:05:22 (4076): No heartbeat from core client for 30 sec - exiting 10:05:23 (4076): No heartbeat from core client for 30 sec - exiting 10:53:32 (5036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:53:33 (5036): No heartbeat from core client for 30 sec - exiting 10:53:34 (5036): No heartbeat from core client for 30 sec - exiting 10:53:35 (5036): No heartbeat from core client for 30 sec - exiting 10:53:36 (5036): No heartbeat from core client for 30 sec - exiting 10:53:37 (5036): No heartbeat from core client for 30 sec - exiting 11:09:01 (5540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:09:02 (5540): No heartbeat from core client for 30 sec - exiting 11:09:03 (5540): No heartbeat from core client for 30 sec - exiting 11:09:04 (5540): No heartbeat from core client for 30 sec - exiting 11:09:05 (5540): No heartbeat from core client for 30 sec - exiting 11:09:06 (5540): No heartbeat from core client for 30 sec - exiting 12:27:00 (4196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:27:01 (4196): No heartbeat from core client for 30 sec - exiting 12:27:02 (4196): No heartbeat from core client for 30 sec - exiting 12:27:03 (4196): No heartbeat from core client for 30 sec - exiting 12:27:04 (4196): No heartbeat from core client for 30 sec - exiting 12:27:05 (4196): No heartbeat from core client for 30 sec - exiting 12:28:00 (4888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:28:01 (4888): No heartbeat from core client for 30 sec - exiting 12:28:02 (4888): No heartbeat from core client for 30 sec - exiting 12:28:03 (4888): No heartbeat from core client for 30 sec - exiting 12:28:04 (4888): No heartbeat from core client for 30 sec - exiting 12:28:05 (4888): No heartbeat from core client for 30 sec - exiting 12:43:30 (4036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:43:31 (4036): No heartbeat from core client for 30 sec - exiting 12:43:32 (4036): No heartbeat from core client for 30 sec - exiting 12:43:33 (4036): No heartbeat from core client for 30 sec - exiting 12:43:34 (4036): No heartbeat from core client for 30 sec - exiting 12:43:35 (4036): No heartbeat from core client for 30 sec - exiting 10:29:20 (3796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:29:21 (3796): No heartbeat from core client for 30 sec - exiting 10:29:22 (3796): No heartbeat from core client for 30 sec - exiting 10:29:23 (3796): No heartbeat from core client for 30 sec - exiting 10:29:24 (3796): No heartbeat from core client for 30 sec - exiting 11:26:13 (5088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:36:09 (5712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:36:10 (5712): No heartbeat from core client for 30 sec - exiting 11:36:11 (5712): No heartbeat from core client for 30 sec - exiting 11:36:12 (5712): No heartbeat from core client for 30 sec - exiting 11:36:13 (5712): No heartbeat from core client for 30 sec - exiting 11:38:28 (1416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:38:29 (1416): No heartbeat from core client for 30 sec - exiting 11:38:30 (1416): No heartbeat from core client for 30 sec - exiting 11:38:31 (1416): No heartbeat from core client for 30 sec - exiting 11:38:32 (1416): No heartbeat from core client for 30 sec - exiting 11:52:19 (5504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:52:20 (5504): No heartbeat from core client for 30 sec - exiting 11:52:21 (5504): No heartbeat from core client for 30 sec - exiting 11:52:22 (5504): No heartbeat from core client for 30 sec - exiting 11:52:23 (5504): No heartbeat from core client for 30 sec - exiting 11:52:24 (5504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 22:30:29 (4568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:30:30 (4568): No heartbeat from core client for 30 sec - exiting 22:30:31 (4568): No heartbeat from core client for 30 sec - exiting 22:30:32 (4568): No heartbeat from core client for 30 sec - exiting 22:30:33 (4568): No heartbeat from core client for 30 sec - exiting 22:30:34 (4568): No heartbeat from core client for 30 sec - exiting 18:11:35 (3524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CCPDN Monitor - Quit request from BOINC... C20:56:39 (2640): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:53:27 (5880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:53:28 (5880): No heartbeat from core client for 30 sec - exiting 12:53:29 (5880): No heartbeat from core client for 30 sec - exiting 12:53:30 (5880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 17:05:43 (4148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:22:38 (1672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:49:41 (4560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4440, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 17:53:03 (3052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2680, iMonCtr=1 Model crash detected, will try to restart... 11:50:53 (464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3548, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4972, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 18:14:13 (5012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
11 Feb 2015 02:27:46	1293439	16650074	hadcm3n_869p_1980_40_008514628_1	259,200	612,415	2.3627
11 Feb 2015 02:27:46	1293439	16650074	hadcm3n_869p_1980_40_008514628_1	233,280	547,930	2.3488
30 Nov 2014 22:30:10	1293439	16650074	hadcm3n_869p_1980_40_008514628_1	207,360	486,264	2.3450
19 Oct 2014 18:23:09	1293439	16650074	hadcm3n_869p_1980_40_008514628_1	181,440	426,432	2.3503
05 Oct 2014 17:34:19	1293439	16650074	hadcm3n_869p_1980_40_008514628_1	155,520	366,749	2.3582
08 Aug 2014 01:13:29	1293439	16650074	hadcm3n_869p_1980_40_008514628_1	129,600	305,863	2.3601
16 Jul 2014 19:06:24	1293439	16650074	hadcm3n_869p_1980_40_008514628_1	103,680	245,755	2.3703
24 Jun 2014 01:26:15	1293439	16650074	hadcm3n_869p_1980_40_008514628_1	77,760	184,079	2.3673
03 Jun 2014 22:04:04	1293439	16650074	hadcm3n_869p_1980_40_008514628_1	51,840	123,251	2.3775
01 Jun 2014 20:59:32	1293439	16650074	hadcm3n_869p_1980_40_008514628_1	25,920	62,202	2.3998