Task 13263397

Name	hadcm3n_o1x0_1980_40_007411358_2
Workunit	7608988
Created	16 Aug 2011, 19:31:47 UTC
Sent	16 Aug 2011, 19:32:03 UTC
Report deadline	16 Nov 2011, 2:59:14 UTC
Received	31 Jan 2012, 8:15:30 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	817088
Run time	164 days 8 hours 57 min 57 sec
CPU time	26 days 20 hours 7 min 40 sec
Validate state	Invalid
Credit	5,287.68
Device peak FLOPS	1.46 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITHEAD: I/O error tmp/pipe_dummy 2048 BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 10:09:34 (696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 forrtl: There is not enough space on the disk. Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2560, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 Sep 2011 12:52:33	817088	13263397	hadcm3n_o1x0_1980_40_007411358_2	440,640	2,268,084	5.1472
13 Sep 2011 21:50:36	817088	13263397	hadcm3n_o1x0_1980_40_007411358_2	414,720	2,129,820	5.1356
12 Sep 2011 06:58:02	817088	13263397	hadcm3n_o1x0_1980_40_007411358_2	388,800	1,991,937	5.1233
10 Sep 2011 16:02:50	817088	13263397	hadcm3n_o1x0_1980_40_007411358_2	362,880	1,853,567	5.1079
09 Sep 2011 01:45:42	817088	13263397	hadcm3n_o1x0_1980_40_007411358_2	336,960	1,717,454	5.0969
07 Sep 2011 18:46:18	817088	13263397	hadcm3n_o1x0_1980_40_007411358_2	311,040	1,608,120	5.1701
06 Sep 2011 06:20:55	817088	13263397	hadcm3n_o1x0_1980_40_007411358_2	285,120	1,479,612	5.1894
04 Sep 2011 19:21:32	817088	13263397	hadcm3n_o1x0_1980_40_007411358_2	259,200	1,356,248	5.2324
03 Sep 2011 08:19:13	817088	13263397	hadcm3n_o1x0_1980_40_007411358_2	233,280	1,233,008	5.2855
31 Aug 2011 08:25:38	817088	13263397	hadcm3n_o1x0_1980_40_007411358_2	207,360	1,116,188	5.3829
29 Aug 2011 18:15:18	817088	13263397	hadcm3n_o1x0_1980_40_007411358_2	181,440	981,497	5.4095
28 Aug 2011 00:35:37	817088	13263397	hadcm3n_o1x0_1980_40_007411358_2	155,520	835,663	5.3733
26 Aug 2011 07:11:54	817088	13263397	hadcm3n_o1x0_1980_40_007411358_2	129,600	689,274	5.3185
24 Aug 2011 13:31:21	817088	13263397	hadcm3n_o1x0_1980_40_007411358_2	103,680	542,368	5.2312
22 Aug 2011 20:19:49	817088	13263397	hadcm3n_o1x0_1980_40_007411358_2	77,760	395,366	5.0844
21 Aug 2011 04:35:42	817088	13263397	hadcm3n_o1x0_1980_40_007411358_2	51,840	256,745	4.9526
19 Aug 2011 15:25:48	817088	13263397	hadcm3n_o1x0_1980_40_007411358_2	25,920	125,685	4.8490