Task 15801937

Name	hadcm3n_o4ij_2020_40_008373480_0
Workunit	8524339
Created	29 May 2013, 19:12:33 UTC
Sent	29 May 2013, 19:13:49 UTC
Report deadline	29 Aug 2013, 2:41:00 UTC
Received	17 Jun 2013, 20:35:43 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1205594
Run time	5 days 14 hours 21 min 55 sec
CPU time	4 days 6 hours 18 min 8 sec
Validate state	Invalid
Credit	2,799.36
Device peak FLOPS	3.05 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> Устройство не опознает команду. (0x16) - exit code 22 (0x16) </message> <stderr_txt> 14:49:54 (1700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:49:55 (1700): No heartbeat from core client for 30 sec - exiting 15:13:38 (3996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:58:02 (4192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3648, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:55:12 (1952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:38:52 (4668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:47:24 (4020): No heartbeat from core client for 30 sec - exiting 06:47:25 (4020): No heartbeat from core client for 30 sec - exiting 06:47:26 (4020): No heartbeat from core client for 30 sec - exiting 06:47:27 (4020): No heartbeat from core client for 30 sec - exiting 06:47:28 (4020): No heartbeat from core client for 30 sec - exiting 06:47:29 (4020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:47:30 (4020): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:20:12 (4332): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:08:16 (2960): No heartbeat from core client for 30 sec - exiting 08:08:17 (2960): No heartbeat from core client for 30 sec - exiting 08:08:18 (2960): No heartbeat from core client for 30 sec - exiting 08:08:19 (2960): No heartbeat from core client for 30 sec - exiting 08:08:20 (2960): No heartbeat from core client for 30 sec - exiting 08:08:21 (2960): No heartbeat from core client for 30 sec - exiting 08:08:22 (2960): No heartbeat from core client for 30 sec - exiting 08:08:23 (2960): No heartbeat from core client for 30 sec - exiting 08:08:24 (2960): No heartbeat from core client for 30 sec - exiting 08:08:25 (2960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:48:12 (15564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:01:49 (15996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:50:17 (1552): No heartbeat from core client for 30 sec - exiting 07:50:18 (1552): No heartbeat from core client for 30 sec - exiting 07:50:19 (1552): No heartbeat from core client for 30 sec - exiting 07:50:20 (1552): No heartbeat from core client for 30 sec - exiting 07:50:21 (1552): No heartbeat from core client for 30 sec - exiting 07:50:22 (1552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:59:33 (5468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:26:55 (5124): No heartbeat from core client for 30 sec - exiting 21:26:56 (5124): No heartbeat from core client for 30 sec - exiting 21:26:57 (5124): No heartbeat from core client for 30 sec - exiting 21:26:58 (5124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:30:28 (2368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:33:19 (5336): No heartbeat from core client for 30 sec - exiting 21:33:20 (5336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:01:41 (4132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:54:16 (5096): No heartbeat from core client for 30 sec - exiting 20:22:49 (4176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:44:38 (468): No heartbeat from core client for 30 sec - exiting 20:44:39 (468): No heartbeat from core client for 30 sec - exiting 20:44:40 (468): No heartbeat from core client for 30 sec - exiting 20:44:41 (468): No heartbeat from core client for 30 sec - exiting 20:44:42 (468): No heartbeat from core client for 30 sec - exiting 20:44:43 (468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:01:01 (3872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:34:59 (4312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Model crashed: INITDUMP: Wrong no of ocean prognostic fields tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
14 Jun 2013 08:57:37	1205594	15801937	hadcm3n_o4ij_2020_40_008373480_0	233,280	337,988	1.4489
09 Jun 2013 23:33:32	1205594	15801937	hadcm3n_o4ij_2020_40_008373480_0	207,360	299,370	1.4437
09 Jun 2013 07:34:15	1205594	15801937	hadcm3n_o4ij_2020_40_008373480_0	181,440	261,388	1.4406
06 Jun 2013 12:49:40	1205594	15801937	hadcm3n_o4ij_2020_40_008373480_0	155,520	224,803	1.4455
04 Jun 2013 13:52:08	1205594	15801937	hadcm3n_o4ij_2020_40_008373480_0	129,600	189,014	1.4584
03 Jun 2013 07:37:41	1205594	15801937	hadcm3n_o4ij_2020_40_008373480_0	103,680	151,316	1.4595
01 Jun 2013 07:33:02	1205594	15801937	hadcm3n_o4ij_2020_40_008373480_0	77,760	112,337	1.4447
31 May 2013 18:13:24	1205594	15801937	hadcm3n_o4ij_2020_40_008373480_0	51,840	75,003	1.4468
30 May 2013 20:13:49	1205594	15801937	hadcm3n_o4ij_2020_40_008373480_0	25,920	38,264	1.4762