Task 11748178

Name	famous_v96z_999_200_006697681_4
Workunit	6900934
Created	26 Aug 2010, 16:29:23 UTC
Sent	7 Dec 2010, 21:42:51 UTC
Report deadline	9 Mar 2011, 5:10:02 UTC
Received	17 Dec 2010, 18:07:20 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1077167
Run time	4 days 17 hours 12 min 57 sec
CPU time	4 days 10 hours 57 min 25 sec
Validate state	Invalid
Credit	2,964.72
Device peak FLOPS	2.80 GFLOPS
Application version	UK Met Office FAMOUS v6.11 windows_intelx86
Stderr	<core_client_version>6.10.56</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... 19:39:25 (7404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:04:15 (4124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:01:58 (13140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:08:56 (11500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:39:43 (9432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 04:38:35 (11848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:24:08 (11360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:43:57 (11652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:51:16 (856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:17:02 (11272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:25:04 (13000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:25:05 (13000): No heartbeat from core client for 30 sec - exiting 08:25:06 (13000): No heartbeat from core client for 30 sec - exiting 08:25:07 (13000): No heartbeat from core client for 30 sec - exiting 08:25:08 (13000): No heartbeat from core client for 30 sec - exiting 08:32:02 (12204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:23:57 (12768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:10:04 (10540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:14:11 (13216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:44:29 (12016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 13:24:25 (9948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2664, selfPID=2664, iMonCtr=1 20:52:57 (14152): No heartbeat from core client for 30 sec - exiting 20:53:02 (14152): No heartbeat from core client for 30 sec - exiting 20:53:03 (14152): No heartbeat from core client for 30 sec - exiting 20:53:04 (14152): No heartbeat from core client for 30 sec - exiting 20:53:05 (14152): No heartbeat from core client for 30 sec - exiting 20:53:06 (14152): No heartbeat from core client for 30 sec - exiting 20:53:07 (14152): No heartbeat from core client for 30 sec - exiting 20:53:08 (14152): No heartbeat from core client for 30 sec - exiting 20:53:09 (14152): No heartbeat from core client for 30 sec - exiting 20:53:10 (14152): No heartbeat from core client for 30 sec - exiting 20:53:11 (14152): No heartbeat from core client for 30 sec - exiting 20:53:12 (14152): No heartbeat from core client for 30 sec - exiting 20:53:13 (14152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 23:21:38 (11104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:07:30 (3864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:05:06 (5236): No heartbeat from core client for 30 sec - exiting 10:05:07 (5236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 11:16:19 (6036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 CPDN Monitor - Quit request from BOINC... 13:23:31 (5408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:23:35 (5408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3368, selfPID=3368, iMonCtr=1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:18:11 (5736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:19:08 (6864): No heartbeat from core client for 30 sec - exiting 04:19:09 (6864): No heartbeat from core client for 30 sec - exiting 04:19:10 (6864): No heartbeat from core client for 30 sec - exiting 04:19:11 (6864): No heartbeat from core client for 30 sec - exiting 04:19:12 (6864): No heartbeat from core client for 30 sec - exiting 04:19:13 (6864): No heartbeat from core client for 30 sec - exiting 04:19:14 (6864): No heartbeat from core client for 30 sec - exiting 04:19:15 (6864): No heartbeat from core client for 30 sec - exiting 04:19:16 (6864): No heartbeat from core client for 30 sec - exiting 04:19:17 (6864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:26:40 (6244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4664, selfPID=4664, iMonCtr=1 Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 13:41:18 (5764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:22:59 (7172): No heartbeat from core client for 30 sec - exiting 00:23:00 (7172): No heartbeat from core client for 30 sec - exiting 00:23:01 (7172): No heartbeat from core client for 30 sec - exiting 00:23:02 (7172): No heartbeat from core client for 30 sec - exiting 00:23:03 (7172): No heartbeat from core client for 30 sec - exiting 00:23:04 (7172): No heartbeat from core client for 30 sec - exiting 00:23:05 (7172): No heartbeat from core client for 30 sec - exiting 00:23:06 (7172): No heartbeat from core client for 30 sec - exiting 00:23:07 (7172): No heartbeat from core client for 30 sec - exiting 00:23:08 (7172): No heartbeat from core client for 30 sec - exiting 00:23:09 (7172): No heartbeat from core client for 30 sec - exiting 00:23:10 (7172): No heartbeat from core client for 30 sec - exiting 00:23:11 (7172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... 06:46:13 (4780): No heartbeat from core client for 30 sec - exiting 06:46:21 (4780): No heartbeat from core client for 30 sec - exiting 06:46:22 (4780): No heartbeat from core client for 30 sec - exiting 06:46:23 (4780): No heartbeat from core client for 30 sec - exiting 06:46:24 (4780): No heartbeat from core client for 30 sec - exiting 06:46:25 (4780): No heartbeat from core client for 30 sec - exiting 06:46:26 (4780): No heartbeat from core client for 30 sec - exiting 06:46:27 (4780): No heartbeat from core client for 30 sec - exiting 06:46:29 (4780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:46:30 (4780): No heartbeat from core client for 30 sec - exiting 06:46:31 (4780): No heartbeat from core client for 30 sec - exiting 06:46:32 (4780): No heartbeat from core client for 30 sec - exiting 06:46:33 (4780): No heartbeat from core client for 30 sec - exiting 06:46:35 (4780): No heartbeat from core client for 30 sec - exiting 06:46:37 (4780): No heartbeat from core client for 30 sec - exiting 06:46:38 (4780): No heartbeat from core client for 30 sec - exiting 06:46:40 (4780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:45:43 (3292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:58:36 (5996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:23:02 (5760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:23:48 (4472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:28:53 (1132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:34:03 (4776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 15:21:51 (3628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:45:15 (3584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:18:44 (1092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:21:12 (1400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:08:28 (5984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 10:03:57 (5916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... C12:25:10 (1992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:25:11 (1992): No heartbeat from core client for 30 sec - exiting 12:25:12 (1992): No heartbeat from core client for 30 sec - exiting 12:53:38 (4620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:53:39 (4620): No heartbeat from core client for 30 sec - exiting Model crashed: U_MODEL: Illegal combination of submodels tmp/pipe_dummy Model crashed: U_MODEL: Illegal combination of submodels tmp/pipe_dummy Model crashed: U_MODEL: Illegal combination of submodels tmp/pipe_dummy Model crashed: U_MODEL: Illegal combination of submodels tmp/pipe_dummy Model crashed: U_MODEL: Illegal combination of submodels tmp/pipe_dummy Model crashed: U_MODEL: Illegal combination of submodels tmp/pipe_dummy Sorry, too many model crashes! :-( 12:57:06 (1344): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
17 Dec 2010 18:42:36	1077167	11748178	famous_v96z_999_200_006697681_4	898,586	385,192	0.4287
17 Dec 2010 15:29:12	1077167	11748178	famous_v96z_999_200_006697681_4	889,226	381,094	0.4286
17 Dec 2010 12:12:29	1077167	11748178	famous_v96z_999_200_006697681_4	879,866	377,076	0.4286
17 Dec 2010 10:34:23	1077167	11748178	famous_v96z_999_200_006697681_4	870,506	372,839	0.4283
16 Dec 2010 22:02:09	1077167	11748178	famous_v96z_999_200_006697681_4	861,146	368,463	0.4279
16 Dec 2010 20:45:15	1077167	11748178	famous_v96z_999_200_006697681_4	851,786	364,510	0.4279
16 Dec 2010 19:38:40	1077167	11748178	famous_v96z_999_200_006697681_4	842,426	360,510	0.4279
16 Dec 2010 18:49:08	1077167	11748178	famous_v96z_999_200_006697681_4	833,066	356,523	0.4280
16 Dec 2010 18:41:58	1077167	11748178	famous_v96z_999_200_006697681_4	823,706	352,517	0.4280
16 Dec 2010 16:09:57	1077167	11748178	famous_v96z_999_200_006697681_4	814,346	348,377	0.4278
16 Dec 2010 15:00:24	1077167	11748178	famous_v96z_999_200_006697681_4	804,986	344,302	0.4277
16 Dec 2010 13:52:34	1077167	11748178	famous_v96z_999_200_006697681_4	795,626	340,592	0.4281
16 Dec 2010 09:32:58	1077167	11748178	famous_v96z_999_200_006697681_4	786,266	336,226	0.4276
16 Dec 2010 09:32:58	1077167	11748178	famous_v96z_999_200_006697681_4	776,906	332,121	0.4275
16 Dec 2010 00:04:16	1077167	11748178	famous_v96z_999_200_006697681_4	767,546	328,173	0.4276
15 Dec 2010 23:10:48	1077167	11748178	famous_v96z_999_200_006697681_4	758,186	324,208	0.4276
15 Dec 2010 20:54:46	1077167	11748178	famous_v96z_999_200_006697681_4	748,826	320,130	0.4275
15 Dec 2010 20:18:15	1077167	11748178	famous_v96z_999_200_006697681_4	739,466	316,017	0.4274
15 Dec 2010 20:12:21	1077167	11748178	famous_v96z_999_200_006697681_4	730,106	312,072	0.4274
15 Dec 2010 17:04:30	1077167	11748178	famous_v96z_999_200_006697681_4	720,746	308,050	0.4274