Task 15928132

Name	hadcm3n_4g1f_2020_40_008406613_0
Workunit	8557469
Created	20 Aug 2013, 6:56:39 UTC
Sent	20 Aug 2013, 7:05:37 UTC
Report deadline	19 Nov 2013, 14:32:48 UTC
Received	7 Sep 2013, 19:30:39 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1284796
Run time	11 days 4 hours 22 min
CPU time	8 days 2 hours 21 min 38 sec
Validate state	Invalid
Credit	5,287.68
Device peak FLOPS	2.69 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> Устройство не опознает команду. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:00:16 (5968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 00:14:50 (12116): No heartbeat from core client for 30 sec - exiting 00:14:51 (12116): No heartbeat from core client for 30 sec - exiting 00:14:52 (12116): No heartbeat from core client for 30 sec - exiting 00:14:53 (12116): No heartbeat from core client for 30 sec - exiting 00:14:54 (12116): No heartbeat from core client for 30 sec - exiting 00:14:55 (12116): No heartbeat from core client for 30 sec - exiting 00:14:56 (12116): No heartbeat from core client for 30 sec - exiting 00:14:57 (12116): No heartbeat from core client for 30 sec - exiting 00:14:58 (12116): No heartbeat from core client for 30 sec - exiting 00:14:59 (12116): No heartbeat from core client for 30 sec - exiting 00:15:00 (12116): No heartbeat from core client for 30 sec - exiting 00:15:01 (12116): No heartbeat from core client for 30 sec - exiting 00:15:02 (12116): No heartbeat from core client for 30 sec - exiting 00:15:03 (12116): No heartbeat from core client for 30 sec - exiting 00:15:04 (12116): No heartbeat from core client for 30 sec - exiting 00:15:05 (12116): No heartbeat from core client for 30 sec - exiting 00:15:06 (12116): No heartbeat from core client for 30 sec - exiting 00:15:07 (12116): No heartbeat from core client for 30 sec - exiting 00:15:08 (12116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:15:09 (12116): No heartbeat from core client for 30 sec - exiting 03:48:10 (2348): No heartbeat from core client for 30 sec - exiting 03:48:11 (2348): No heartbeat from core client for 30 sec - exiting 03:48:12 (2348): No heartbeat from core client for 30 sec - exiting 03:48:13 (2348): No heartbeat from core client for 30 sec - exiting 03:48:14 (2348): No heartbeat from core client for 30 sec - exiting 03:48:15 (2348): No heartbeat from core client for 30 sec - exiting 03:48:16 (2348): No heartbeat from core client for 30 sec - exiting 03:48:17 (2348): No heartbeat from core client for 30 sec - exiting 03:48:18 (2348): No heartbeat from core client for 30 sec - exiting 03:48:19 (2348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:56:44 (5760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:37:03 (10424): No heartbeat from core client for 30 sec - exiting 00:37:04 (10424): No heartbeat from core client for 30 sec - exiting 00:37:05 (10424): No heartbeat from core client for 30 sec - exiting 00:37:06 (10424): No heartbeat from core client for 30 sec - exiting 00:37:07 (10424): No heartbeat from core client for 30 sec - exiting 00:37:08 (10424): No heartbeat from core client for 30 sec - exiting 00:37:09 (10424): No heartbeat from core client for 30 sec - exiting 00:37:10 (10424): No heartbeat from core client for 30 sec - exiting 00:37:11 (10424): No heartbeat from core client for 30 sec - exiting 00:37:12 (10424): No heartbeat from core client for 30 sec - exiting 00:37:13 (10424): No heartbeat from core client for 30 sec - exiting 00:37:14 (10424): No heartbeat from core client for 30 sec - exiting 00:37:15 (10424): No heartbeat from core client for 30 sec - exiting 00:37:16 (10424): No heartbeat from core client for 30 sec - exiting 00:37:17 (10424): No heartbeat from core client for 30 sec - exiting 00:37:18 (10424): No heartbeat from core client for 30 sec - exiting 00:37:19 (10424): No heartbeat from core client for 30 sec - exiting 00:37:20 (10424): No heartbeat from core client for 30 sec - exiting 00:37:21 (10424): No heartbeat from core client for 30 sec - exiting 00:37:22 (10424): No heartbeat from core client for 30 sec - exiting 00:37:23 (10424): No heartbeat from core client for 30 sec - exiting 00:37:24 (10424): No heartbeat from core client for 30 sec - exiting 00:37:25 (10424): No heartbeat from core client for 30 sec - exiting 00:37:26 (10424): No heartbeat from core client for 30 sec - exiting 00:37:27 (10424): No heartbeat from core client for 30 sec - exiting 00:37:28 (10424): No heartbeat from core client for 30 sec - exiting 00:37:29 (10424): No heartbeat from core client for 30 sec - exiting 00:37:30 (10424): No heartbeat from core client for 30 sec - exiting 00:37:31 (10424): No heartbeat from core client for 30 sec - exiting 00:37:32 (10424): No heartbeat from core client for 30 sec - exiting 00:37:33 (10424): No heartbeat from core client for 30 sec - exiting 00:37:34 (10424): No heartbeat from core client for 30 sec - exiting 00:37:35 (10424): No heartbeat from core client for 30 sec - exiting 00:37:36 (10424): No heartbeat from core client for 30 sec - exiting 00:37:37 (10424): No heartbeat from core client for 30 sec - exiting 00:37:38 (10424): No heartbeat from core client for 30 sec - exiting 00:37:39 (10424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 01:02:25 (8004): No heartbeat from core client for 30 sec - exiting 01:02:26 (8004): No heartbeat from core client for 30 sec - exiting 01:02:27 (8004): No heartbeat from core client for 30 sec - exiting 01:02:28 (8004): No heartbeat from core client for 30 sec - exiting 01:02:29 (8004): No heartbeat from core client for 30 sec - exiting 01:02:30 (8004): No heartbeat from core client for 30 sec - exiting 01:02:31 (8004): No heartbeat from core client for 30 sec - exiting 01:02:32 (8004): No heartbeat from core client for 30 sec - exiting 01:02:33 (8004): No heartbeat from core client for 30 sec - exiting 01:02:34 (8004): No heartbeat from core client for 30 sec - exiting 01:02:35 (8004): No heartbeat from core client for 30 sec - exiting 01:02:36 (8004): No heartbeat from core client for 30 sec - exiting 01:02:37 (8004): No heartbeat from core client for 30 sec - exiting 01:02:38 (8004): No heartbeat from core client for 30 sec - exiting 01:02:39 (8004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:40:05 (11636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:59:00 (14688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:01:01 (15116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:34:37 (5340): No heartbeat from core client for 30 sec - exiting 17:34:38 (5340): No heartbeat from core client for 30 sec - exiting 17:34:39 (5340): No heartbeat from core client for 30 sec - exiting 17:34:40 (5340): No heartbeat from core client for 30 sec - exiting 17:34:41 (5340): No heartbeat from core client for 30 sec - exiting 17:34:42 (5340): No heartbeat from core client for 30 sec - exiting 17:34:43 (5340): No heartbeat from core client for 30 sec - exiting 17:34:44 (5340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:41:59 (2096): No heartbeat from core client for 30 sec - exiting 19:42:00 (2096): No heartbeat from core client for 30 sec - exiting 19:42:01 (2096): No heartbeat from core client for 30 sec - exiting 19:42:02 (2096): No heartbeat from core client for 30 sec - exiting 19:42:03 (2096): No heartbeat from core client for 30 sec - exiting 19:42:04 (2096): No heartbeat from core client for 30 sec - exiting 19:42:05 (2096): No heartbeat from core client for 30 sec - exiting 19:42:06 (2096): No heartbeat from core client for 30 sec - exiting 19:42:07 (2096): No heartbeat from core client for 30 sec - exiting 19:42:08 (2096): No heartbeat from core client for 30 sec - exiting 19:42:09 (2096): No heartbeat from core client for 30 sec - exiting 19:42:10 (2096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:42:46 (5940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:34:18 (8004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:48:13 (12128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:57:13 (5540): No heartbeat from core client for 30 sec - exiting 16:57:14 (5540): No heartbeat from core client for 30 sec - exiting 16:57:15 (5540): No heartbeat from core client for 30 sec - exiting 16:57:16 (5540): No heartbeat from core client for 30 sec - exiting 16:57:17 (5540): No heartbeat from core client for 30 sec - exiting 16:57:18 (5540): No heartbeat from core client for 30 sec - exiting 16:57:19 (5540): No heartbeat from core client for 30 sec - exiting 16:57:20 (5540): No heartbeat from core client for 30 sec - exiting 16:57:21 (5540): No heartbeat from core client for 30 sec - exiting 16:57:22 (5540): No heartbeat from core client for 30 sec - exiting 16:57:23 (5540): No heartbeat from core client for 30 sec - exiting 16:57:24 (5540): No heartbeat from core client for 30 sec - exiting 16:57:25 (5540): No heartbeat from core client for 30 sec - exiting 16:57:26 (5540): No heartbeat from core client for 30 sec - exiting 16:57:27 (5540): No heartbeat from core client for 30 sec - exiting 16:57:28 (5540): No heartbeat from core client for 30 sec - exiting 16:57:29 (5540): No heartbeat from core client for 30 sec - exiting 16:57:30 (5540): No heartbeat from core client for 30 sec - exiting 16:57:31 (5540): No heartbeat from core client for 30 sec - exiting 16:57:32 (5540): No heartbeat from core client for 30 sec - exiting 16:57:33 (5540): No heartbeat from core client for 30 sec - exiting 16:57:34 (5540): No heartbeat from core client for 30 sec - exiting 16:57:35 (5540): No heartbeat from core client for 30 sec - exiting 16:57:37 (5540): No heartbeat from core client for 30 sec - exiting 16:57:38 (5540): No heartbeat from core client for 30 sec - exiting 16:57:39 (5540): No heartbeat from core client for 30 sec - exiting 16:57:40 (5540): No heartbeat from core client for 30 sec - exiting 16:57:41 (5540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:23:45 (6048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 15:01:37 (24416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:23:01 (16848): No heartbeat from core client for 30 sec - exiting 20:23:02 (16848): No heartbeat from core client for 30 sec - exiting 20:23:03 (16848): No heartbeat from core client for 30 sec - exiting 20:23:04 (16848): No heartbeat from core client for 30 sec - exiting 20:23:05 (16848): No heartbeat from core client for 30 sec - exiting 20:23:06 (16848): No heartbeat from core client for 30 sec - exiting 20:23:07 (16848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:23:08 (16848): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=28776, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:59:45 (6076): No heartbeat from core client for 30 sec - exiting 06:59:46 (6076): No heartbeat from core client for 30 sec - exiting 06:59:47 (6076): No heartbeat from core client for 30 sec - exiting 06:59:48 (6076): No heartbeat from core client for 30 sec - exiting 06:59:49 (6076): No heartbeat from core client for 30 sec - exiting 06:59:50 (6076): No heartbeat from core client for 30 sec - exiting 06:59:51 (6076): No heartbeat from core client for 30 sec - exiting 06:59:52 (6076): No heartbeat from core client for 30 sec - exiting 06:59:53 (6076): No heartbeat from core client for 30 sec - exiting 06:59:54 (6076): No heartbeat from core client for 30 sec - exiting 06:59:55 (6076): No heartbeat from core client for 30 sec - exiting 06:59:56 (6076): No heartbeat from core client for 30 sec - exiting 06:59:57 (6076): No heartbeat from core client for 30 sec - exiting 06:59:58 (6076): No heartbeat from core client for 30 sec - exiting 06:59:59 (6076): No heartbeat from core client for 30 sec - exiting 07:00:00 (6076): No heartbeat from core client for 30 sec - exiting 07:00:01 (6076): No heartbeat from core client for 30 sec - exiting 07:00:02 (6076): No heartbeat from core client for 30 sec - exiting 07:00:03 (6076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:20:59 (14128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:36:49 (4712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Sep 2013 18:10:21	1284796	15928132	hadcm3n_4g1f_2020_40_008406613_0	440,640	666,893	1.5135
06 Sep 2013 04:40:37	1284796	15928132	hadcm3n_4g1f_2020_40_008406613_0	414,720	627,941	1.5141
05 Sep 2013 04:47:11	1284796	15928132	hadcm3n_4g1f_2020_40_008406613_0	388,800	589,254	1.5156
04 Sep 2013 03:54:33	1284796	15928132	hadcm3n_4g1f_2020_40_008406613_0	362,880	551,503	1.5198
03 Sep 2013 06:54:42	1284796	15928132	hadcm3n_4g1f_2020_40_008406613_0	336,960	513,616	1.5243
01 Sep 2013 23:25:21	1284796	15928132	hadcm3n_4g1f_2020_40_008406613_0	311,040	474,152	1.5244
01 Sep 2013 05:48:07	1284796	15928132	hadcm3n_4g1f_2020_40_008406613_0	285,120	434,308	1.5232
31 Aug 2013 10:15:26	1284796	15928132	hadcm3n_4g1f_2020_40_008406613_0	259,200	393,896	1.5197
30 Aug 2013 20:13:02	1284796	15928132	hadcm3n_4g1f_2020_40_008406613_0	233,280	353,929	1.5172
29 Aug 2013 19:14:58	1284796	15928132	hadcm3n_4g1f_2020_40_008406613_0	207,360	313,844	1.5135
27 Aug 2013 23:45:17	1284796	15928132	hadcm3n_4g1f_2020_40_008406613_0	181,440	272,995	1.5046
26 Aug 2013 16:21:01	1284796	15928132	hadcm3n_4g1f_2020_40_008406613_0	155,520	232,752	1.4966
25 Aug 2013 17:29:53	1284796	15928132	hadcm3n_4g1f_2020_40_008406613_0	129,600	193,819	1.4955
24 Aug 2013 23:41:23	1284796	15928132	hadcm3n_4g1f_2020_40_008406613_0	103,680	153,469	1.4802
24 Aug 2013 05:07:14	1284796	15928132	hadcm3n_4g1f_2020_40_008406613_0	77,760	113,545	1.4602
23 Aug 2013 11:08:35	1284796	15928132	hadcm3n_4g1f_2020_40_008406613_0	51,840	75,719	1.4606
21 Aug 2013 10:42:15	1284796	15928132	hadcm3n_4g1f_2020_40_008406613_0	25,920	39,119	1.5092