Task 16029754

Name	hadcm3n_79cn_1980_40_008423402_3
Workunit	8574258
Created	21 Sep 2013, 14:24:48 UTC
Sent	21 Sep 2013, 14:30:43 UTC
Report deadline	21 Dec 2013, 21:57:54 UTC
Received	16 Oct 2013, 5:21:12 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1156820
Run time	4 days 20 hours 47 min 11 sec
CPU time	4 days 20 hours 10 min 38 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	3.61 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> Het apparaat herkent de opdracht niet. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:40:10 (5892): No heartbeat from core client for 30 sec - exiting 07:40:11 (5892): No heartbeat from core client for 30 sec - exiting 07:40:12 (5892): No heartbeat from core client for 30 sec - exiting 07:40:13 (5892): No heartbeat from core client for 30 sec - exiting 07:40:14 (5892): No heartbeat from core client for 30 sec - exiting 07:40:15 (5892): No heartbeat from core client for 30 sec - exiting 07:40:16 (5892): No heartbeat from core client for 30 sec - exiting 07:40:17 (5892): No heartbeat from core client for 30 sec - exiting 07:40:18 (5892): No heartbeat from core client for 30 sec - exiting 07:40:19 (5892): No heartbeat from core client for 30 sec - exiting 07:40:20 (5892): No heartbeat from core client for 30 sec - exiting 07:40:21 (5892): No heartbeat from core client for 30 sec - exiting 07:40:22 (5892): No heartbeat from core client for 30 sec - exiting 07:40:23 (5892): No heartbeat from core client for 30 sec - exiting 07:40:24 (5892): No heartbeat from core client for 30 sec - exiting 07:40:25 (5892): No heartbeat from core client for 30 sec - exiting 07:40:26 (5892): No heartbeat from core client for 30 sec - exiting 07:40:27 (5892): No heartbeat from core client for 30 sec - exiting 07:40:28 (5892): No heartbeat from core client for 30 sec - exiting 07:40:29 (5892): No heartbeat from core client for 30 sec - exiting 07:40:30 (5892): No heartbeat from core client for 30 sec - exiting 07:40:31 (5892): No heartbeat from core client for 30 sec - exiting 07:40:32 (5892): No heartbeat from core client for 30 sec - exiting 07:40:33 (5892): No heartbeat from core client for 30 sec - exiting 07:40:34 (5892): No heartbeat from core client for 30 sec - exiting 07:40:35 (5892): No heartbeat from core client for 30 sec - exiting 07:40:36 (5892): No heartbeat from core client for 30 sec - exiting 07:40:37 (5892): No heartbeat from core client for 30 sec - exiting 07:40:38 (5892): No heartbeat from core client for 30 sec - exiting 07:40:39 (5892): No heartbeat from core client for 30 sec - exiting 07:40:40 (5892): No heartbeat from core client for 30 sec - exiting 07:40:41 (5892): No heartbeat from core client for 30 sec - exiting 07:40:42 (5892): No heartbeat from core client for 30 sec - exiting 07:40:43 (5892): No heartbeat from core client for 30 sec - exiting 07:40:44 (5892): No heartbeat from core client for 30 sec - exiting 07:40:45 (5892): No heartbeat from core client for 30 sec - exiting 07:40:46 (5892): No heartbeat from core client for 30 sec - exiting 07:40:47 (5892): No heartbeat from core client for 30 sec - exiting 07:40:48 (5892): No heartbeat from core client for 30 sec - exiting 07:40:49 (5892): No heartbeat from core client for 30 sec - exiting 07:40:50 (5892): No heartbeat from core client for 30 sec - exiting 07:40:51 (5892): No heartbeat from core client for 30 sec - exiting 07:40:52 (5892): No heartbeat from core client for 30 sec - exiting 07:40:53 (5892): No heartbeat from core client for 30 sec - exiting 07:40:54 (5892): No heartbeat from core client for 30 sec - exiting 07:40:55 (5892): No heartbeat from core client for 30 sec - exiting 07:40:56 (5892): No heartbeat from core client for 30 sec - exiting 07:40:57 (5892): No heartbeat from core client for 30 sec - exiting 07:40:58 (5892): No heartbeat from core client for 30 sec - exiting 07:40:59 (5892): No heartbeat from core client for 30 sec - exiting 07:41:00 (5892): No heartbeat from core client for 30 sec - exiting 07:41:01 (5892): No heartbeat from core client for 30 sec - exiting 07:41:02 (5892): No heartbeat from core client for 30 sec - exiting 07:41:03 (5892): No heartbeat from core client for 30 sec - exiting 07:41:04 (5892): No heartbeat from core client for 30 sec - exiting 07:41:05 (5892): No heartbeat from core client for 30 sec - exiting 07:41:06 (5892): No heartbeat from core client for 30 sec - exiting 07:41:07 (5892): No heartbeat from core client for 30 sec - exiting 07:41:08 (5892): No heartbeat from core client for 30 sec - exiting 07:41:09 (5892): No heartbeat from core client for 30 sec - exiting 07:41:10 (5892): No heartbeat from core client for 30 sec - exiting 07:41:11 (5892): No heartbeat from core client for 30 sec - exiting 07:41:12 (5892): No heartbeat from core client for 30 sec - exiting 07:41:13 (5892): No heartbeat from core client for 30 sec - exiting 07:41:14 (5892): No heartbeat from core client for 30 sec - exiting 07:41:15 (5892): No heartbeat from core client for 30 sec - exiting 07:41:16 (5892): No heartbeat from core client for 30 sec - exiting 07:41:17 (5892): No heartbeat from core client for 30 sec - exiting 07:41:18 (5892): No heartbeat from core client for 30 sec - exiting 07:41:19 (5892): No heartbeat from core client for 30 sec - exiting 07:41:20 (5892): No heartbeat from core client for 30 sec - exiting 07:41:21 (5892): No heartbeat from core client for 30 sec - exiting 07:41:22 (5892): No heartbeat from core client for 30 sec - exiting 07:41:23 (5892): No heartbeat from core client for 30 sec - exiting 07:41:24 (5892): No heartbeat from core client for 30 sec - exiting 07:41:25 (5892): No heartbeat from core client for 30 sec - exiting 07:41:26 (5892): No heartbeat from core client for 30 sec - exiting 07:41:27 (5892): No heartbeat from core client for 30 sec - exiting 07:41:28 (5892): No heartbeat from core client for 30 sec - exiting 07:41:29 (5892): No heartbeat from core client for 30 sec - exiting 07:41:30 (5892): No heartbeat from core client for 30 sec - exiting 07:41:31 (5892): No heartbeat from core client for 30 sec - exiting 07:41:32 (5892): No heartbeat from core client for 30 sec - exiting 07:41:33 (5892): No heartbeat from core client for 30 sec - exiting 07:41:34 (5892): No heartbeat from core client for 30 sec - exiting 07:41:35 (5892): No heartbeat from core client for 30 sec - exiting 07:41:36 (5892): No heartbeat from core client for 30 sec - exiting 07:41:37 (5892): No heartbeat from core client for 30 sec - exiting 07:41:38 (5892): No heartbeat from core client for 30 sec - exiting 07:41:39 (5892): No heartbeat from core client for 30 sec - exiting 07:41:40 (5892): No heartbeat from core client for 30 sec - exiting 07:41:41 (5892): No heartbeat from core client for 30 sec - exiting 07:41:42 (5892): No heartbeat from core client for 30 sec - exiting 07:41:43 (5892): No heartbeat from core client for 30 sec - exiting 07:41:44 (5892): No heartbeat from core client for 30 sec - exiting 07:41:45 (5892): No heartbeat from core client for 30 sec - exiting 07:41:46 (5892): No heartbeat from core client for 30 sec - exiting 07:41:47 (5892): No heartbeat from core client for 30 sec - exiting 07:41:48 (5892): No heartbeat from core client for 30 sec - exiting 07:41:49 (5892): No heartbeat from core client for 30 sec - exiting 07:41:50 (5892): No heartbeat from core client for 30 sec - exiting 07:41:51 (5892): No heartbeat from core client for 30 sec - exiting 07:41:52 (5892): No heartbeat from core client for 30 sec - exiting 07:41:53 (5892): No heartbeat from core client for 30 sec - exiting 07:41:54 (5892): No heartbeat from core client for 30 sec - exiting 07:41:55 (5892): No heartbeat from core client for 30 sec - exiting 07:41:56 (5892): No heartbeat from core client for 30 sec - exiting 07:41:57 (5892): No heartbeat from core client for 30 sec - exiting 07:41:58 (5892): No heartbeat from core client for 30 sec - exiting 07:41:59 (5892): No heartbeat from core client for 30 sec - exiting 07:42:00 (5892): No heartbeat from core client for 30 sec - exiting 07:42:01 (5892): No heartbeat from core client for 30 sec - exiting 07:42:02 (5892): No heartbeat from core client for 30 sec - exiting 07:42:03 (5892): No heartbeat from core client for 30 sec - exiting 07:42:04 (5892): No heartbeat from core client for 30 sec - exiting 07:42:05 (5892): No heartbeat from core client for 30 sec - exiting 07:42:06 (5892): No heartbeat from core client for 30 sec - exiting 07:42:07 (5892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:24:32 (6268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:48:45 (3116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:43:48 (6420): No heartbeat from core client for 30 sec - exiting 22:43:49 (6420): No heartbeat from core client for 30 sec - exiting 22:43:50 (6420): No heartbeat from core client for 30 sec - exiting 22:43:51 (6420): No heartbeat from core client for 30 sec - exiting 22:43:52 (6420): No heartbeat from core client for 30 sec - exiting 22:43:53 (6420): No heartbeat from core client for 30 sec - exiting 22:43:54 (6420): No heartbeat from core client for 30 sec - exiting 22:43:55 (6420): No heartbeat from core client for 30 sec - exiting 22:43:56 (6420): No heartbeat from core client for 30 sec - exiting 22:43:57 (6420): No heartbeat from core client for 30 sec - exiting 22:43:58 (6420): No heartbeat from core client for 30 sec - exiting 22:43:59 (6420): No heartbeat from core client for 30 sec - exiting 22:44:00 (6420): No heartbeat from core client for 30 sec - exiting 22:44:01 (6420): No heartbeat from core client for 30 sec - exiting 22:44:02 (6420): No heartbeat from core client for 30 sec - exiting 22:44:03 (6420): No heartbeat from core client for 30 sec - exiting 22:44:04 (6420): No heartbeat from core client for 30 sec - exiting 22:44:05 (6420): No heartbeat from core client for 30 sec - exiting 22:44:06 (6420): No heartbeat from core client for 30 sec - exiting 22:44:07 (6420): No heartbeat from core client for 30 sec - exiting 22:44:08 (6420): No heartbeat from core client for 30 sec - exiting 22:44:09 (6420): No heartbeat from core client for 30 sec - exiting 22:44:10 (6420): No heartbeat from core client for 30 sec - exiting 22:44:11 (6420): No heartbeat from core client for 30 sec - exiting 22:44:12 (6420): No heartbeat from core client for 30 sec - exiting 22:44:13 (6420): No heartbeat from core client for 30 sec - exiting 22:44:14 (6420): No heartbeat from core client for 30 sec - exiting 22:44:15 (6420): No heartbeat from core client for 30 sec - exiting 22:44:16 (6420): No heartbeat from core client for 30 sec - exiting 22:44:17 (6420): No heartbeat from core client for 30 sec - exiting 22:44:18 (6420): No heartbeat from core client for 30 sec - exiting 22:44:19 (6420): No heartbeat from core client for 30 sec - exiting 22:44:20 (6420): No heartbeat from core client for 30 sec - exiting 22:44:21 (6420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:44:22 (6420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:51:21 (3336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:54:14 (4708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:09:20 (5408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:15:49 (2820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:26:42 (5124): No heartbeat from core client for 30 sec - exiting 11:26:43 (5124): No heartbeat from core client for 30 sec - exiting 11:26:44 (5124): No heartbeat from core client for 30 sec - exiting 11:26:45 (5124): No heartbeat from core client for 30 sec - exiting 11:26:46 (5124): No heartbeat from core client for 30 sec - exiting 11:26:47 (5124): No heartbeat from core client for 30 sec - exiting 11:26:48 (5124): No heartbeat from core client for 30 sec - exiting 11:26:49 (5124): No heartbeat from core client for 30 sec - exiting 11:26:50 (5124): No heartbeat from core client for 30 sec - exiting 11:26:51 (5124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2492, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2492, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2492, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2492, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2492, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2492, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 Oct 2013 17:13:26	1156820	16029754	hadcm3n_79cn_1980_40_008423402_3	518,400	410,192	0.7913
15 Oct 2013 10:01:43	1156820	16029754	hadcm3n_79cn_1980_40_008423402_3	492,480	390,484	0.7929
14 Oct 2013 13:04:59	1156820	16029754	hadcm3n_79cn_1980_40_008423402_3	466,560	370,397	0.7939
13 Oct 2013 13:30:53	1156820	16029754	hadcm3n_79cn_1980_40_008423402_3	440,640	350,722	0.7959
12 Oct 2013 13:04:40	1156820	16029754	hadcm3n_79cn_1980_40_008423402_3	414,720	330,401	0.7967
11 Oct 2013 06:08:24	1156820	16029754	hadcm3n_79cn_1980_40_008423402_3	388,800	309,536	0.7961
10 Oct 2013 09:51:48	1156820	16029754	hadcm3n_79cn_1980_40_008423402_3	362,880	288,749	0.7957
09 Oct 2013 13:41:12	1156820	16029754	hadcm3n_79cn_1980_40_008423402_3	336,960	268,282	0.7962
08 Oct 2013 09:04:13	1156820	16029754	hadcm3n_79cn_1980_40_008423402_3	311,040	247,059	0.7943
07 Oct 2013 07:59:41	1156820	16029754	hadcm3n_79cn_1980_40_008423402_3	285,120	226,474	0.7943
05 Oct 2013 13:51:32	1156820	16029754	hadcm3n_79cn_1980_40_008423402_3	259,200	206,634	0.7972
03 Oct 2013 13:03:37	1156820	16029754	hadcm3n_79cn_1980_40_008423402_3	233,280	187,066	0.8019
29 Sep 2013 13:35:55	1156820	16029754	hadcm3n_79cn_1980_40_008423402_3	207,360	166,606	0.8035
28 Sep 2013 18:59:17	1156820	16029754	hadcm3n_79cn_1980_40_008423402_3	181,440	145,409	0.8014
27 Sep 2013 21:35:01	1156820	16029754	hadcm3n_79cn_1980_40_008423402_3	155,520	123,398	0.7935
27 Sep 2013 15:56:50	1156820	16029754	hadcm3n_79cn_1980_40_008423402_3	129,600	103,021	0.7949
27 Sep 2013 06:11:18	1156820	16029754	hadcm3n_79cn_1980_40_008423402_3	103,680	82,832	0.7989
26 Sep 2013 09:52:34	1156820	16029754	hadcm3n_79cn_1980_40_008423402_3	77,760	62,992	0.8101
25 Sep 2013 18:01:19	1156820	16029754	hadcm3n_79cn_1980_40_008423402_3	51,840	42,103	0.8122
25 Sep 2013 09:29:58	1156820	16029754	hadcm3n_79cn_1980_40_008423402_3	25,920	21,178	0.8171