Task 15457470

Name	hadcm3n_zdz2_1880_40_008252587_0
Workunit	8407711
Created	23 Nov 2012, 14:36:09 UTC
Sent	23 Nov 2012, 14:36:11 UTC
Report deadline	22 Feb 2013, 22:03:22 UTC
Received	17 Dec 2012, 17:34:32 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1239578
Run time	14 days 3 hours 19 min 48 sec
CPU time	13 days 5 hours 10 min 19 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	3.27 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:05:04 (4864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7980, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4848, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4848, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 19:03:58 (10232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
17 Dec 2012 07:59:31	1239578	15457470	hadcm3n_zdz2_1880_40_008252587_0	777,600	1,113,369	1.4318
16 Dec 2012 19:39:22	1239578	15457470	hadcm3n_zdz2_1880_40_008252587_0	751,680	1,078,431	1.4347
16 Dec 2012 06:34:08	1239578	15457470	hadcm3n_zdz2_1880_40_008252587_0	725,760	1,042,980	1.4371
15 Dec 2012 19:35:07	1239578	15457470	hadcm3n_zdz2_1880_40_008252587_0	699,840	1,007,991	1.4403
15 Dec 2012 08:43:34	1239578	15457470	hadcm3n_zdz2_1880_40_008252587_0	673,920	970,281	1.4398
14 Dec 2012 09:35:49	1239578	15457470	hadcm3n_zdz2_1880_40_008252587_0	648,000	932,832	1.4396
14 Dec 2012 09:35:49	1239578	15457470	hadcm3n_zdz2_1880_40_008252587_0	622,080	896,014	1.4404
14 Dec 2012 09:35:49	1239578	15457470	hadcm3n_zdz2_1880_40_008252587_0	596,160	858,767	1.4405
14 Dec 2012 09:35:49	1239578	15457470	hadcm3n_zdz2_1880_40_008252587_0	570,240	821,282	1.4402
05 Dec 2012 20:34:06	1239578	15457470	hadcm3n_zdz2_1880_40_008252587_0	544,320	784,856	1.4419
05 Dec 2012 06:24:00	1239578	15457470	hadcm3n_zdz2_1880_40_008252587_0	518,400	747,850	1.4426
04 Dec 2012 14:38:32	1239578	15457470	hadcm3n_zdz2_1880_40_008252587_0	492,480	709,400	1.4405
03 Dec 2012 20:02:42	1239578	15457470	hadcm3n_zdz2_1880_40_008252587_0	466,560	670,911	1.4380
03 Dec 2012 05:33:44	1239578	15457470	hadcm3n_zdz2_1880_40_008252587_0	440,640	632,929	1.4364
02 Dec 2012 15:19:51	1239578	15457470	hadcm3n_zdz2_1880_40_008252587_0	414,720	595,502	1.4359
02 Dec 2012 03:32:40	1239578	15457470	hadcm3n_zdz2_1880_40_008252587_0	388,800	557,792	1.4347
01 Dec 2012 14:52:38	1239578	15457470	hadcm3n_zdz2_1880_40_008252587_0	362,880	520,783	1.4351
01 Dec 2012 03:10:05	1239578	15457470	hadcm3n_zdz2_1880_40_008252587_0	336,960	483,139	1.4338
30 Nov 2012 14:08:55	1239578	15457470	hadcm3n_zdz2_1880_40_008252587_0	311,040	445,795	1.4332
30 Nov 2012 02:30:30	1239578	15457470	hadcm3n_zdz2_1880_40_008252587_0	285,120	408,340	1.4322