Task 13539670

Name	hadcm3n_yg12_1900_40_007516996_1
Workunit	7714471
Created	28 Oct 2011, 12:50:12 UTC
Sent	22 Nov 2011, 8:26:43 UTC
Report deadline	21 Feb 2012, 15:53:54 UTC
Received	21 Dec 2011, 0:27:24 UTC
Server state	Over
Outcome	Computation error
Client state	Done
Exit status	22 (0x00000016) Unknown error code
Computer ID	546879
Run time	7 days 0 hours 9 min 40 sec
CPU time	7 days 0 hours 9 min 40 sec
Validate state	Invalid
Credit	4,354.56
Device peak FLOPS	2.83 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>5.10.45</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:44:44 (4092): No heartbeat from core client for 30 sec - exiting 06:44:46 (4092): No heartbeat from core client for 30 sec - exiting 06:44:47 (4092): No heartbeat from core client for 30 sec - exiting 06:44:48 (4092): No heartbeat from core client for 30 sec - exiting 06:44:49 (4092): No heartbeat from core client for 30 sec - exiting 06:44:50 (4092): No heartbeat from core client for 30 sec - exiting 06:44:51 (4092): No heartbeat from core client for 30 sec - exiting 06:44:52 (4092): No heartbeat from core client for 30 sec - exiting 06:44:53 (4092): No heartbeat from core client for 30 sec - exiting 06:44:54 (4092): No heartbeat from core client for 30 sec - exiting 06:44:55 (4092): No heartbeat from core client for 30 sec - exiting 06:44:56 (4092): No heartbeat from core client for 30 sec - exiting 06:44:58 (4092): No heartbeat from core client for 30 sec - exiting 06:44:59 (4092): No heartbeat from core client for 30 sec - exiting 06:45:00 (4092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:45:01 (4092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:06:16 (5472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 06:43:23 (3796): No heartbeat from core client for 30 sec - exiting 06:43:24 (3796): No heartbeat from core client for 30 sec - exiting 06:43:25 (3796): No heartbeat from core client for 30 sec - exiting 06:43:26 (3796): No heartbeat from core client for 30 sec - exiting 06:43:28 (3796): No heartbeat from core client for 30 sec - exiting 06:43:29 (3796): No heartbeat from core client for 30 sec - exiting 06:43:30 (3796): No heartbeat from core client for 30 sec - exiting 06:43:31 (3796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:43:32 (3796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 09:34:33 (3812): No heartbeat from core client for 30 sec - exiting 09:34:34 (3812): No heartbeat from core client for 30 sec - exiting 09:34:35 (3812): No heartbeat from core client for 30 sec - exiting 09:34:36 (3812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:37:59 (4484): No heartbeat from core client for 30 sec - exiting 06:38:00 (4484): No heartbeat from core client for 30 sec - exiting 06:38:01 (4484): No heartbeat from core client for 30 sec - exiting 06:38:02 (4484): No heartbeat from core client for 30 sec - exiting 06:38:03 (4484): No heartbeat from core client for 30 sec - exiting 06:38:05 (4484): No heartbeat from core client for 30 sec - exiting 06:38:06 (4484): No heartbeat from core client for 30 sec - exiting 06:38:07 (4484): No heartbeat from core client for 30 sec - exiting 06:38:08 (4484): No heartbeat from core client for 30 sec - exiting 06:38:09 (4484): No heartbeat from core client for 30 sec - exiting 06:38:10 (4484): No heartbeat from core client for 30 sec - exiting 06:38:11 (4484): No heartbeat from core client for 30 sec - exiting 06:38:12 (4484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:38:13 (4484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:15:12 (3704): No heartbeat from core client for 30 sec - exiting 06:15:14 (3704): No heartbeat from core client for 30 sec - exiting 06:15:15 (3704): No heartbeat from core client for 30 sec - exiting 06:15:16 (3704): No heartbeat from core client for 30 sec - exiting 06:15:17 (3704): No heartbeat from core client for 30 sec - exiting 06:15:18 (3704): No heartbeat from core client for 30 sec - exiting 06:15:19 (3704): No heartbeat from core client for 30 sec - exiting 06:15:20 (3704): No heartbeat from core client for 30 sec - exiting 06:15:21 (3704): No heartbeat from core client for 30 sec - exiting 06:15:22 (3704): No heartbeat from core client for 30 sec - exiting 06:15:23 (3704): No heartbeat from core client for 30 sec - exiting 06:15:25 (3704): No heartbeat from core client for 30 sec - exiting 06:15:26 (3704): No heartbeat from core client for 30 sec - exiting 06:15:27 (3704): No heartbeat from core client for 30 sec - exiting 06:15:28 (3704): No heartbeat from core client for 30 sec - exiting 06:15:29 (3704): No heartbeat from core client for 30 sec - exiting 06:15:30 (3704): No heartbeat from core client for 30 sec - exiting 06:15:31 (3704): No heartbeat from core client for 30 sec - exiting 06:15:32 (3704): No heartbeat from core client for 30 sec - exiting 06:15:33 (3704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:38:24 (3540): No heartbeat from core client for 30 sec - exiting 05:38:26 (3540): No heartbeat from core client for 30 sec - exiting 05:38:27 (3540): No heartbeat from core client for 30 sec - exiting 05:38:28 (3540): No heartbeat from core client for 30 sec - exiting 05:38:29 (3540): No heartbeat from core client for 30 sec - exiting 05:38:30 (3540): No heartbeat from core client for 30 sec - exiting 05:38:31 (3540): No heartbeat from core client for 30 sec - exiting 05:38:32 (3540): No heartbeat from core client for 30 sec - exiting 05:38:33 (3540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:38:34 (3540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:32:09 (3528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:32:10 (3528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:37:33 (2252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:18:05 (3604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:31:52 (3040): No heartbeat from core client for 30 sec - exiting 05:31:54 (3040): No heartbeat from core client for 30 sec - exiting 05:31:55 (3040): No heartbeat from core client for 30 sec - exiting 05:31:56 (3040): No heartbeat from core client for 30 sec - exiting 05:31:57 (3040): No heartbeat from core client for 30 sec - exiting 05:31:58 (3040): No heartbeat from core client for 30 sec - exiting 05:31:59 (3040): No heartbeat from core client for 30 sec - exiting 05:32:00 (3040): No heartbeat from core client for 30 sec - exiting 05:32:01 (3040): No heartbeat from core client for 30 sec - exiting 05:32:02 (3040): No heartbeat from core client for 30 sec - exiting 05:32:04 (3040): No heartbeat from core client for 30 sec - exiting 05:32:05 (3040): No heartbeat from core client for 30 sec - exiting 05:32:06 (3040): No heartbeat from core client for 30 sec - exiting 05:32:07 (3040): No heartbeat from core client for 30 sec - exiting 05:32:08 (3040): No heartbeat from core client for 30 sec - exiting 05:32:09 (3040): No heartbeat from core client for 30 sec - exiting 05:32:10 (3040): No heartbeat from core client for 30 sec - exiting 05:32:11 (3040): No heartbeat from core client for 30 sec - exiting 05:32:12 (3040): No heartbeat from core client for 30 sec - exiting 05:32:13 (3040): No heartbeat from core client for 30 sec - exiting 05:32:15 (3040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:32:21 (4544): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4992, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4992, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4992, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4992, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2100, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2100, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
20 Dec 2011 05:06:59	546879	13539670	hadcm3n_yg12_1900_40_007516996_1	362,880	593,128	1.6345
19 Dec 2011 06:27:07	546879	13539670	hadcm3n_yg12_1900_40_007516996_1	336,960	552,149	1.6386
18 Dec 2011 06:17:05	546879	13539670	hadcm3n_yg12_1900_40_007516996_1	311,040	511,454	1.6443
17 Dec 2011 15:30:23	546879	13539670	hadcm3n_yg12_1900_40_007516996_1	285,120	470,104	1.6488
16 Dec 2011 07:26:12	546879	13539670	hadcm3n_yg12_1900_40_007516996_1	259,200	427,559	1.6495
14 Dec 2011 22:11:11	546879	13539670	hadcm3n_yg12_1900_40_007516996_1	233,280	386,129	1.6552
13 Dec 2011 05:24:41	546879	13539670	hadcm3n_yg12_1900_40_007516996_1	207,360	343,774	1.6579
11 Dec 2011 21:55:13	546879	13539670	hadcm3n_yg12_1900_40_007516996_1	181,440	302,963	1.6698
10 Dec 2011 16:47:53	546879	13539670	hadcm3n_yg12_1900_40_007516996_1	155,520	260,124	1.6726
09 Dec 2011 08:57:42	546879	13539670	hadcm3n_yg12_1900_40_007516996_1	129,600	216,970	1.6742
07 Dec 2011 11:12:33	546879	13539670	hadcm3n_yg12_1900_40_007516996_1	103,680	174,242	1.6806
06 Dec 2011 04:08:22	546879	13539670	hadcm3n_yg12_1900_40_007516996_1	77,760	132,057	1.6983
05 Dec 2011 00:03:49	546879	13539670	hadcm3n_yg12_1900_40_007516996_1	51,840	90,396	1.7438
29 Nov 2011 00:03:07	546879	13539670	hadcm3n_yg12_1900_40_007516996_1	25,920	45,707	1.7634