Task 15618082

Name	hadcm3n_zgoa_1880_40_008250889_3
Workunit	8406013
Created	21 Feb 2013, 16:07:37 UTC
Sent	21 Feb 2013, 16:07:43 UTC
Report deadline	23 May 2013, 23:34:54 UTC
Received	5 Apr 2013, 5:24:21 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	521854
Run time	12 days 9 hours 49 min 53 sec
CPU time	11 days 17 hours 57 min 36 sec
Validate state	Invalid
Credit	9,020.16
Device peak FLOPS	3.39 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.60</core_client_version> <![CDATA[ <message> The device does not recognise the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:00:28 (4432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:00:29 (4432): No heartbeat from core client for 30 sec - exiting 23:00:30 (4432): No heartbeat from core client for 30 sec - exiting 23:00:31 (4432): No heartbeat from core client for 30 sec - exiting 23:00:32 (4432): No heartbeat from core client for 30 sec - exiting 23:00:33 (4432): No heartbeat from core client for 30 sec - exiting 23:00:34 (4432): No heartbeat from core client for 30 sec - exiting 23:00:35 (4432): No heartbeat from core client for 30 sec - exiting 23:00:36 (4432): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3360, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3360, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3360, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3360, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3360, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3360, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
05 Apr 2013 03:22:35	521854	15618082	hadcm3n_zgoa_1880_40_008250889_3	751,680	1,009,897	1.3435
04 Apr 2013 14:40:31	521854	15618082	hadcm3n_zgoa_1880_40_008250889_3	725,760	986,601	1.3594
04 Apr 2013 08:20:28	521854	15618082	hadcm3n_zgoa_1880_40_008250889_3	699,840	963,614	1.3769
04 Apr 2013 01:27:53	521854	15618082	hadcm3n_zgoa_1880_40_008250889_3	673,920	941,221	1.3966
03 Apr 2013 23:26:56	521854	15618082	hadcm3n_zgoa_1880_40_008250889_3	648,000	906,062	1.3982
03 Apr 2013 23:26:56	521854	15618082	hadcm3n_zgoa_1880_40_008250889_3	622,080	869,276	1.3974
03 Apr 2013 23:26:56	521854	15618082	hadcm3n_zgoa_1880_40_008250889_3	596,160	831,832	1.3953
01 Apr 2013 13:16:04	521854	15618082	hadcm3n_zgoa_1880_40_008250889_3	570,240	794,893	1.3940
01 Apr 2013 03:22:33	521854	15618082	hadcm3n_zgoa_1880_40_008250889_3	544,320	759,489	1.3953
31 Mar 2013 15:45:42	521854	15618082	hadcm3n_zgoa_1880_40_008250889_3	518,400	721,882	1.3925
31 Mar 2013 04:43:05	521854	15618082	hadcm3n_zgoa_1880_40_008250889_3	492,480	684,121	1.3891
30 Mar 2013 13:25:56	521854	15618082	hadcm3n_zgoa_1880_40_008250889_3	466,560	647,856	1.3886
29 Mar 2013 17:43:20	521854	15618082	hadcm3n_zgoa_1880_40_008250889_3	440,640	610,284	1.3850
29 Mar 2013 06:14:47	521854	15618082	hadcm3n_zgoa_1880_40_008250889_3	414,720	573,092	1.3819
27 Mar 2013 08:47:21	521854	15618082	hadcm3n_zgoa_1880_40_008250889_3	388,800	535,288	1.3768
26 Mar 2013 20:49:12	521854	15618082	hadcm3n_zgoa_1880_40_008250889_3	362,880	497,281	1.3704
25 Mar 2013 03:20:54	521854	15618082	hadcm3n_zgoa_1880_40_008250889_3	336,960	462,176	1.3716
24 Mar 2013 13:23:29	521854	15618082	hadcm3n_zgoa_1880_40_008250889_3	311,040	427,922	1.3758
23 Mar 2013 20:16:13	521854	15618082	hadcm3n_zgoa_1880_40_008250889_3	285,120	392,400	1.3763
20 Mar 2013 14:40:20	521854	15618082	hadcm3n_zgoa_1880_40_008250889_3	259,200	355,371	1.3710