Task 15450920

Name	hadcm3n_zm1i_1880_40_008250105_1
Workunit	8405229
Created	22 Nov 2012, 3:23:59 UTC
Sent	22 Nov 2012, 3:24:08 UTC
Report deadline	21 Feb 2013, 10:51:19 UTC
Received	13 Dec 2012, 20:10:32 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1235566
Run time	14 days 21 hours 31 min 53 sec
CPU time	13 days 14 hours 25 min 30 sec
Validate state	Invalid
Credit	6,842.88
Device peak FLOPS	2.44 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.6.31</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... 10:01:23 (5088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:01:24 (5088): No heartbeat from core client for 30 sec - exiting 10:01:25 (5088): No heartbeat from core client for 30 sec - exiting 08:20:03 (4456): No heartbeat from core client for 30 sec - exiting 08:20:04 (4456): No heartbeat from core client for 30 sec - exiting 08:20:05 (4456): No heartbeat from core client for 30 sec - exiting 08:20:06 (4456): No heartbeat from core client for 30 sec - exiting 08:20:07 (4456): No heartbeat from core client for 30 sec - exiting 08:20:08 (4456): No heartbeat from core client for 30 sec - exiting 08:20:09 (4456): No heartbeat from core client for 30 sec - exiting 08:20:10 (4456): No heartbeat from core client for 30 sec - exiting 08:20:11 (4456): No heartbeat from core client for 30 sec - exiting 08:20:12 (4456): No heartbeat from core client for 30 sec - exiting 08:20:13 (4456): No heartbeat from core client for 30 sec - exiting 08:20:14 (4456): No heartbeat from core client for 30 sec - exiting 08:20:15 (4456): No heartbeat from core client for 30 sec - exiting 08:20:16 (4456): No heartbeat from core client for 30 sec - exiting 08:20:17 (4456): No heartbeat from core client for 30 sec - exiting 08:20:18 (4456): No heartbeat from core client for 30 sec - exiting 08:20:19 (4456): No heartbeat from core client for 30 sec - exiting 08:20:20 (4456): No heartbeat from core client for 30 sec - exiting 08:20:21 (4456): No heartbeat from core client for 30 sec - exiting 08:20:22 (4456): No heartbeat from core client for 30 sec - exiting 08:20:23 (4456): No heartbeat from core client for 30 sec - exiting 08:20:24 (4456): No heartbeat from core client for 30 sec - exiting 08:20:25 (4456): No heartbeat from core client for 30 sec - exiting 08:20:26 (4456): No heartbeat from core client for 30 sec - exiting 08:20:27 (4456): No heartbeat from core client for 30 sec - exiting 08:20:28 (4456): No heartbeat from core client for 30 sec - exiting 08:20:29 (4456): No heartbeat from core client for 30 sec - exiting 08:20:30 (4456): No heartbeat from core client for 30 sec - exiting 08:20:31 (4456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:20:32 (4456): No heartbeat from core client for 30 sec - exiting 08:20:33 (4456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4464, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4464, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4464, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4464, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4464, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4464, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
13 Dec 2012 20:15:10	1235566	15450920	hadcm3n_zm1i_1880_40_008250105_1	570,240	1,155,875	2.0270
13 Dec 2012 20:15:09	1235566	15450920	hadcm3n_zm1i_1880_40_008250105_1	544,320	1,103,708	2.0277
13 Dec 2012 20:15:09	1235566	15450920	hadcm3n_zm1i_1880_40_008250105_1	518,400	1,048,728	2.0230
13 Dec 2012 20:15:09	1235566	15450920	hadcm3n_zm1i_1880_40_008250105_1	492,480	995,976	2.0224
13 Dec 2012 20:15:09	1235566	15450920	hadcm3n_zm1i_1880_40_008250105_1	466,560	945,443	2.0264
07 Dec 2012 05:51:29	1235566	15450920	hadcm3n_zm1i_1880_40_008250105_1	440,640	894,647	2.0303
06 Dec 2012 12:39:14	1235566	15450920	hadcm3n_zm1i_1880_40_008250105_1	414,720	839,142	2.0234
05 Dec 2012 16:21:04	1235566	15450920	hadcm3n_zm1i_1880_40_008250105_1	388,800	783,632	2.0155
04 Dec 2012 21:41:45	1235566	15450920	hadcm3n_zm1i_1880_40_008250105_1	362,880	726,007	2.0007
04 Dec 2012 08:12:01	1235566	15450920	hadcm3n_zm1i_1880_40_008250105_1	336,960	678,670	2.0141
03 Dec 2012 14:55:43	1235566	15450920	hadcm3n_zm1i_1880_40_008250105_1	311,040	627,569	2.0176
02 Dec 2012 10:33:57	1235566	15450920	hadcm3n_zm1i_1880_40_008250105_1	285,120	569,523	1.9975
01 Dec 2012 16:43:00	1235566	15450920	hadcm3n_zm1i_1880_40_008250105_1	259,200	512,139	1.9758
30 Nov 2012 21:18:12	1235566	15450920	hadcm3n_zm1i_1880_40_008250105_1	233,280	454,261	1.9473
29 Nov 2012 22:09:22	1235566	15450920	hadcm3n_zm1i_1880_40_008250105_1	207,360	395,068	1.9052
29 Nov 2012 05:36:51	1235566	15450920	hadcm3n_zm1i_1880_40_008250105_1	181,440	341,497	1.8821
28 Nov 2012 15:33:23	1235566	15450920	hadcm3n_zm1i_1880_40_008250105_1	155,520	290,889	1.8704
28 Nov 2012 00:39:52	1235566	15450920	hadcm3n_zm1i_1880_40_008250105_1	129,600	239,038	1.8444
27 Nov 2012 09:13:44	1235566	15450920	hadcm3n_zm1i_1880_40_008250105_1	103,680	186,191	1.7958
26 Nov 2012 17:27:56	1235566	15450920	hadcm3n_zm1i_1880_40_008250105_1	77,760	131,834	1.6954