Task 17309180

Name	hadcm3n_sap8_1940_40_009109096_1
Workunit	9239432
Created	27 Oct 2014, 4:42:10 UTC
Sent	27 Oct 2014, 4:53:55 UTC
Report deadline	26 Jan 2015, 12:21:06 UTC
Received	6 Nov 2014, 12:21:57 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1060244
Run time	8 days 12 hours 32 min 19 sec
CPU time	6 days 23 hours 20 min 48 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.24 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <message> (unknown error) - exit code 193 (0xc1) </message> <stderr_txt> 16:46:27 (8296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:24:06 (2776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:24:07 (2776): No heartbeat from core client for 30 sec - exiting 21:24:08 (2776): No heartbeat from core client for 30 sec - exiting 21:24:09 (2776): No heartbeat from core client for 30 sec - exiting 21:24:10 (2776): No heartbeat from core client for 30 sec - exiting 21:24:11 (2776): No heartbeat from core client for 30 sec - exiting 21:24:12 (2776): No heartbeat from core client for 30 sec - exiting 21:24:13 (2776): No heartbeat from core client for 30 sec - exiting 21:24:14 (2776): No heartbeat from core client for 30 sec - exiting 21:24:15 (2776): No heartbeat from core client for 30 sec - exiting 21:24:16 (2776): No heartbeat from core client for 30 sec - exiting 06:31:25 (8224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:31:26 (8224): No heartbeat from core client for 30 sec - exiting 06:31:27 (8224): No heartbeat from core client for 30 sec - exiting 06:31:28 (8224): No heartbeat from core client for 30 sec - exiting 06:31:29 (8224): No heartbeat from core client for 30 sec - exiting 06:31:30 (8224): No heartbeat from core client for 30 sec - exiting 06:31:31 (8224): No heartbeat from core client for 30 sec - exiting 06:31:32 (8224): No heartbeat from core client for 30 sec - exiting 06:31:33 (8224): No heartbeat from core client for 30 sec - exiting 06:31:34 (8224): No heartbeat from core client for 30 sec - exiting 06:31:35 (8224): No heartbeat from core client for 30 sec - exiting 10:31:23 (12032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:48:37 (2464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:19:30 (9152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:26:29 (5480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:26:30 (5480): No heartbeat from core client for 30 sec - exiting 06:26:31 (5480): No heartbeat from core client for 30 sec - exiting 06:26:32 (5480): No heartbeat from core client for 30 sec - exiting 06:26:33 (5480): No heartbeat from core client for 30 sec - exiting 06:26:34 (5480): No heartbeat from core client for 30 sec - exiting 06:26:35 (5480): No heartbeat from core client for 30 sec - exiting 06:26:36 (5480): No heartbeat from core client for 30 sec - exiting 06:26:37 (5480): No heartbeat from core client for 30 sec - exiting 06:26:38 (5480): No heartbeat from core client for 30 sec - exiting 06:26:39 (5480): No heartbeat from core client for 30 sec - exiting 13:24:29 (1876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:24:30 (1876): No heartbeat from core client for 30 sec - exiting 13:24:31 (1876): No heartbeat from core client for 30 sec - exiting 13:24:32 (1876): No heartbeat from core client for 30 sec - exiting 13:24:33 (1876): No heartbeat from core client for 30 sec - exiting 13:24:34 (1876): No heartbeat from core client for 30 sec - exiting 13:24:35 (1876): No heartbeat from core client for 30 sec - exiting 13:24:36 (1876): No heartbeat from core client for 30 sec - exiting 13:24:37 (1876): No heartbeat from core client for 30 sec - exiting 13:24:38 (1876): No heartbeat from core client for 30 sec - exiting 13:24:39 (1876): No heartbeat from core client for 30 sec - exiting 17:40:03 (1716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:17:53 (7332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 23:56:59 (3144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:47:45 (8704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:24:32 (2076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:24:33 (2076): No heartbeat from core client for 30 sec - exiting 02:29:14 (7412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:01:32 (3948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:52:14 (8004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:42:54 (8372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:33:40 (8472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:24:48 (5584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:24:49 (5584): No heartbeat from core client for 30 sec - exiting 13:24:50 (5584): No heartbeat from core client for 30 sec - exiting 13:24:51 (5584): No heartbeat from core client for 30 sec - exiting 13:24:52 (5584): No heartbeat from core client for 30 sec - exiting 13:24:53 (5584): No heartbeat from core client for 30 sec - exiting 13:24:54 (5584): No heartbeat from core client for 30 sec - exiting 13:24:55 (5584): No heartbeat from core client for 30 sec - exiting 13:24:56 (5584): No heartbeat from core client for 30 sec - exiting 13:24:57 (5584): No heartbeat from core client for 30 sec - exiting 13:24:58 (5584): No heartbeat from core client for 30 sec - exiting 21:42:33 (6932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:42:34 (6932): No heartbeat from core client for 30 sec - exiting 01:52:04 (10728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:25:16 (10704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:24:49 (4324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:24:50 (4324): No heartbeat from core client for 30 sec - exiting 17:24:51 (4324): No heartbeat from core client for 30 sec - exiting 17:24:52 (4324): No heartbeat from core client for 30 sec - exiting 17:24:53 (4324): No heartbeat from core client for 30 sec - exiting 17:24:54 (4324): No heartbeat from core client for 30 sec - exiting 17:24:55 (4324): No heartbeat from core client for 30 sec - exiting 17:24:56 (4324): No heartbeat from core client for 30 sec - exiting 17:24:57 (4324): No heartbeat from core client for 30 sec - exiting 17:24:58 (4324): No heartbeat from core client for 30 sec - exiting 17:24:59 (4324): No heartbeat from core client for 30 sec - exiting 04:09:16 (8232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:09:17 (8232): No heartbeat from core client for 30 sec - exiting 10:20:23 (3676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:20:24 (3676): No heartbeat from core client for 30 sec - exiting 10:20:25 (3676): No heartbeat from core client for 30 sec - exiting 10:20:26 (3676): No heartbeat from core client for 30 sec - exiting 10:20:27 (3676): No heartbeat from core client for 30 sec - exiting 10:20:28 (3676): No heartbeat from core client for 30 sec - exiting 10:20:29 (3676): No heartbeat from core client for 30 sec - exiting 10:20:31 (3676): No heartbeat from core client for 30 sec - exiting 10:20:32 (3676): No heartbeat from core client for 30 sec - exiting 10:20:33 (3676): No heartbeat from core client for 30 sec - exiting 10:20:34 (3676): No heartbeat from core client for 30 sec - exiting 11:27:49 (4012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:39:16 (9376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:28:09 (4072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:28:10 (4072): No heartbeat from core client for 30 sec - exiting 13:28:12 (4072): No heartbeat from core client for 30 sec - exiting 13:28:13 (4072): No heartbeat from core client for 30 sec - exiting 13:28:14 (4072): No heartbeat from core client for 30 sec - exiting 13:28:15 (4072): No heartbeat from core client for 30 sec - exiting 13:28:16 (4072): No heartbeat from core client for 30 sec - exiting 13:28:17 (4072): No heartbeat from core client for 30 sec - exiting 13:28:18 (4072): No heartbeat from core client for 30 sec - exiting 13:28:19 (4072): No heartbeat from core client for 30 sec - exiting 13:28:20 (4072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:30:32 (6920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77353FA9 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=12252, selfPID=12252, iMonCtr=1 Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x773543E0 read attempt to address 0x00000004 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_sap8_1940_40_009109096/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Nov 2014 05:47:04	1060244	17309180	hadcm3n_sap8_1940_40_009109096_1	259,200	592,422	2.2856
05 Nov 2014 03:08:06	1060244	17309180	hadcm3n_sap8_1940_40_009109096_1	233,280	535,675	2.2963
03 Nov 2014 20:25:12	1060244	17309180	hadcm3n_sap8_1940_40_009109096_1	207,360	477,723	2.3038
02 Nov 2014 22:28:02	1060244	17309180	hadcm3n_sap8_1940_40_009109096_1	181,440	414,193	2.2828
02 Nov 2014 00:58:32	1060244	17309180	hadcm3n_sap8_1940_40_009109096_1	155,520	350,540	2.2540
31 Oct 2014 14:36:58	1060244	17309180	hadcm3n_sap8_1940_40_009109096_1	129,600	288,127	2.2232
30 Oct 2014 18:11:32	1060244	17309180	hadcm3n_sap8_1940_40_009109096_1	103,680	228,452	2.2034
29 Oct 2014 18:44:57	1060244	17309180	hadcm3n_sap8_1940_40_009109096_1	77,760	166,725	2.1441
28 Oct 2014 19:30:32	1060244	17309180	hadcm3n_sap8_1940_40_009109096_1	51,840	106,654	2.0574
27 Oct 2014 22:26:29	1060244	17309180	hadcm3n_sap8_1940_40_009109096_1	25,920	53,402	2.0603