Task 13352591

Name	hadcm3n_o68j_1940_40_007444007_3
Workunit	7641510
Created	9 Sep 2011, 10:01:19 UTC
Sent	9 Sep 2011, 10:01:52 UTC
Report deadline	9 Dec 2011, 17:29:03 UTC
Received	23 Sep 2011, 4:52:23 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1150260
Run time	6 days 20 hours 22 min 35 sec
CPU time	6 days 11 hours 32 min 13 sec
Validate state	Invalid
Credit	7,776.00
Device peak FLOPS	3.42 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1280, iMonCtr=1 Model crash detected, will try to restart... 12:33:56 (852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:34:40 (6212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:53:37 (4124): No heartbeat from core client for 30 sec - exiting 12:53:38 (4124): No heartbeat from core client for 30 sec - exiting 12:53:39 (4124): No heartbeat from core client for 30 sec - exiting 12:53:40 (4124): No heartbeat from core client for 30 sec - exiting 12:53:42 (4124): No heartbeat from core client for 30 sec - exiting 12:53:43 (4124): No heartbeat from core client for 30 sec - exiting 12:53:44 (4124): No heartbeat from core client for 30 sec - exiting 12:53:45 (4124): No heartbeat from core client for 30 sec - exiting 12:53:46 (4124): No heartbeat from core client for 30 sec - exiting 12:53:47 (4124): No heartbeat from core client for 30 sec - exiting 12:53:48 (4124): No heartbeat from core client for 30 sec - exiting 12:53:49 (4124): No heartbeat from core client for 30 sec - exiting 12:53:50 (4124): No heartbeat from core client for 30 sec - exiting 12:53:51 (4124): No heartbeat from core client for 30 sec - exiting 12:53:53 (4124): No heartbeat from core client for 30 sec - exiting 12:53:54 (4124): No heartbeat from core client for 30 sec - exiting 12:53:55 (4124): No heartbeat from core client for 30 sec - exiting 12:53:56 (4124): No heartbeat from core client for 30 sec - exiting 12:53:57 (4124): No heartbeat from core client for 30 sec - exiting 12:53:58 (4124): No heartbeat from core client for 30 sec - exiting 12:53:59 (4124): No heartbeat from core client for 30 sec - exiting 12:54:00 (4124): No heartbeat from core client for 30 sec - exiting 12:54:01 (4124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3856, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3728, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED. tmp/pipe_dummy 2048 Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED. tmp/pipe_dummy 2048 Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED. tmp/pipe_dummy 2048 Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED. tmp/pipe_dummy 2048 Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED. tmp/pipe_dummy 2048 Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
22 Sep 2011 17:12:20	1150260	13352591	hadcm3n_o68j_1940_40_007444007_3	648,000	558,639	0.8621
22 Sep 2011 10:19:02	1150260	13352591	hadcm3n_o68j_1940_40_007444007_3	622,080	536,498	0.8624
21 Sep 2011 17:27:09	1150260	13352591	hadcm3n_o68j_1940_40_007444007_3	596,160	514,194	0.8625
21 Sep 2011 09:57:22	1150260	13352591	hadcm3n_o68j_1940_40_007444007_3	570,240	491,408	0.8618
20 Sep 2011 16:52:31	1150260	13352591	hadcm3n_o68j_1940_40_007444007_3	544,320	469,284	0.8621
20 Sep 2011 10:59:41	1150260	13352591	hadcm3n_o68j_1940_40_007444007_3	518,400	447,460	0.8632
19 Sep 2011 17:45:58	1150260	13352591	hadcm3n_o68j_1940_40_007444007_3	492,480	426,093	0.8652
19 Sep 2011 10:24:29	1150260	13352591	hadcm3n_o68j_1940_40_007444007_3	466,560	404,707	0.8674
19 Sep 2011 04:15:11	1150260	13352591	hadcm3n_o68j_1940_40_007444007_3	440,640	383,474	0.8703
19 Sep 2011 00:37:32	1150260	13352591	hadcm3n_o68j_1940_40_007444007_3	414,720	362,071	0.8730
15 Sep 2011 10:08:40	1150260	13352591	hadcm3n_o68j_1940_40_007444007_3	388,800	341,114	0.8774
14 Sep 2011 15:53:50	1150260	13352591	hadcm3n_o68j_1940_40_007444007_3	362,880	317,612	0.8753
14 Sep 2011 08:58:06	1150260	13352591	hadcm3n_o68j_1940_40_007444007_3	336,960	294,111	0.8728
13 Sep 2011 15:04:52	1150260	13352591	hadcm3n_o68j_1940_40_007444007_3	311,040	270,216	0.8688
13 Sep 2011 08:18:55	1150260	13352591	hadcm3n_o68j_1940_40_007444007_3	285,120	246,169	0.8634
12 Sep 2011 14:43:24	1150260	13352591	hadcm3n_o68j_1940_40_007444007_3	259,200	223,109	0.8608
12 Sep 2011 09:16:37	1150260	13352591	hadcm3n_o68j_1940_40_007444007_3	233,280	201,485	0.8637
12 Sep 2011 02:17:08	1150260	13352591	hadcm3n_o68j_1940_40_007444007_3	207,360	179,507	0.8657
11 Sep 2011 19:51:40	1150260	13352591	hadcm3n_o68j_1940_40_007444007_3	181,440	157,488	0.8680
11 Sep 2011 14:23:59	1150260	13352591	hadcm3n_o68j_1940_40_007444007_3	155,520	135,039	0.8683