Task 15610792

Name	hadcm3n_4ac4_1940_40_008301240_1
Workunit	8452375
Created	16 Feb 2013, 22:34:42 UTC
Sent	16 Feb 2013, 22:35:15 UTC
Report deadline	19 May 2013, 6:02:26 UTC
Received	19 Feb 2013, 3:15:30 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1237982
Run time	1 days 23 hours 29 min 28 sec
CPU time	1 days 2 hours 27 min 8 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	3.69 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5968, iMonCtr=1 Model crash detected, will try to restart... 15:04:25 (6028): No heartbeat from core client for 30 sec - exiting 15:04:27 (6028): No heartbeat from core client for 30 sec - exiting 15:04:28 (6028): No heartbeat from core client for 30 sec - exiting 15:04:29 (6028): No heartbeat from core client for 30 sec - exiting 15:04:30 (6028): No heartbeat from core client for 30 sec - exiting 15:04:31 (6028): No heartbeat from core client for 30 sec - exiting 15:04:32 (6028): No heartbeat from core client for 30 sec - exiting 15:04:33 (6028): No heartbeat from core client for 30 sec - exiting 15:04:34 (6028): No heartbeat from core client for 30 sec - exiting 15:04:35 (6028): No heartbeat from core client for 30 sec - exiting 15:04:36 (6028): No heartbeat from core client for 30 sec - exiting 15:04:37 (6028): No heartbeat from core client for 30 sec - exiting 15:04:38 (6028): No heartbeat from core client for 30 sec - exiting 15:04:39 (6028): No heartbeat from core client for 30 sec - exiting 15:04:40 (6028): No heartbeat from core client for 30 sec - exiting 15:04:41 (6028): No heartbeat from core client for 30 sec - exiting 15:04:42 (6028): No heartbeat from core client for 30 sec - exiting 15:04:43 (6028): No heartbeat from core client for 30 sec - exiting 15:04:44 (6028): No heartbeat from core client for 30 sec - exiting 15:04:45 (6028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
19 Feb 2013 00:26:23	1237982	15610792	hadcm3n_4ac4_1940_40_008301240_1	259,200	161,300	0.6223
18 Feb 2013 19:47:56	1237982	15610792	hadcm3n_4ac4_1940_40_008301240_1	233,280	145,045	0.6218
18 Feb 2013 15:05:33	1237982	15610792	hadcm3n_4ac4_1940_40_008301240_1	207,360	128,905	0.6216
18 Feb 2013 10:18:39	1237982	15610792	hadcm3n_4ac4_1940_40_008301240_1	181,440	112,721	0.6213
18 Feb 2013 06:07:44	1237982	15610792	hadcm3n_4ac4_1940_40_008301240_1	155,520	96,510	0.6206
18 Feb 2013 00:06:18	1237982	15610792	hadcm3n_4ac4_1940_40_008301240_1	129,600	80,321	0.6198
17 Feb 2013 20:18:58	1237982	15610792	hadcm3n_4ac4_1940_40_008301240_1	103,680	64,241	0.6196
17 Feb 2013 15:40:39	1237982	15610792	hadcm3n_4ac4_1940_40_008301240_1	77,760	48,303	0.6212
17 Feb 2013 10:17:14	1237982	15610792	hadcm3n_4ac4_1940_40_008301240_1	51,840	32,160	0.6204
17 Feb 2013 05:26:19	1237982	15610792	hadcm3n_4ac4_1940_40_008301240_1	25,920	16,138	0.6226