Task 13740353

Name	hadcm3n_o1if_1900_40_007439052_2
Workunit	7636555
Created	6 Dec 2011, 23:06:33 UTC
Sent	7 Dec 2011, 9:25:15 UTC
Report deadline	7 Mar 2012, 16:52:26 UTC
Received	3 Jan 2012, 8:50:57 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1118950
Run time	4 days 20 hours 52 min 51 sec
CPU time	4 days 5 hours 28 min 24 sec
Validate state	Invalid
Credit	1,555.20
Device peak FLOPS	1.73 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> El dispositivo no reconoce el comando. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:22:56 (452): No heartbeat from core client for 30 sec - exiting 00:22:57 (452): No heartbeat from core client for 30 sec - exiting 00:22:58 (452): No heartbeat from core client for 30 sec - exiting 00:22:59 (452): No heartbeat from core client for 30 sec - exiting 00:23:00 (452): No heartbeat from core client for 30 sec - exiting 00:23:01 (452): No heartbeat from core client for 30 sec - exiting 00:23:02 (452): No heartbeat from core client for 30 sec - exiting 00:23:03 (452): No heartbeat from core client for 30 sec - exiting 00:23:04 (452): No heartbeat from core client for 30 sec - exiting 00:23:05 (452): No heartbeat from core client for 30 sec - exiting 00:23:06 (452): No heartbeat from core client for 30 sec - exiting 00:23:07 (452): No heartbeat from core client for 30 sec - exiting 00:23:08 (452): No heartbeat from core client for 30 sec - exiting 00:23:09 (452): No heartbeat from core client for 30 sec - exiting 00:23:10 (452): No heartbeat from core client for 30 sec - exiting 00:23:11 (452): No heartbeat from core client for 30 sec - exiting 00:23:12 (452): No heartbeat from core client for 30 sec - exiting 00:23:13 (452): No heartbeat from core client for 30 sec - exiting 00:23:14 (452): No heartbeat from core client for 30 sec - exiting 00:23:15 (452): No heartbeat from core client for 30 sec - exiting 00:23:16 (452): No heartbeat from core client for 30 sec - exiting 00:23:17 (452): No heartbeat from core client for 30 sec - exiting 00:23:18 (452): No heartbeat from core client for 30 sec - exiting 00:23:19 (452): No heartbeat from core client for 30 sec - exiting 00:23:20 (452): No heartbeat from core client for 30 sec - exiting 00:23:21 (452): No heartbeat from core client for 30 sec - exiting 00:23:22 (452): No heartbeat from core client for 30 sec - exiting 00:23:23 (452): No heartbeat from core client for 30 sec - exiting 00:23:24 (452): No heartbeat from core client for 30 sec - exiting 00:23:25 (452): No heartbeat from core client for 30 sec - exiting 00:23:26 (452): No heartbeat from core client for 30 sec - exiting 00:23:27 (452): No heartbeat from core client for 30 sec - exiting 00:23:28 (452): No heartbeat from core client for 30 sec - exiting 00:23:29 (452): No heartbeat from core client for 30 sec - exiting 00:23:30 (452): No heartbeat from core client for 30 sec - exiting 00:23:31 (452): No heartbeat from core client for 30 sec - exiting 00:23:32 (452): No heartbeat from core client for 30 sec - exiting 00:23:33 (452): No heartbeat from core client for 30 sec - exiting 00:23:34 (452): No heartbeat from core client for 30 sec - exiting 00:23:35 (452): No heartbeat from core client for 30 sec - exiting 00:23:36 (452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... 19:34:24 (5060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4824, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 Dec 2011 22:26:40	1118950	13740353	hadcm3n_o1if_1900_40_007439052_2	129,600	314,875	2.4296
29 Dec 2011 15:56:06	1118950	13740353	hadcm3n_o1if_1900_40_007439052_2	103,680	251,714	2.4278
19 Dec 2011 17:14:47	1118950	13740353	hadcm3n_o1if_1900_40_007439052_2	77,760	189,332	2.4348
17 Dec 2011 15:00:18	1118950	13740353	hadcm3n_o1if_1900_40_007439052_2	51,840	126,875	2.4474
16 Dec 2011 17:24:15	1118950	13740353	hadcm3n_o1if_1900_40_007439052_2	25,920	63,610	2.4541