Task 17796599

Name	hadcm3n_saeh_1980_40_009466904_0
Workunit	9548647
Created	15 Jan 2015, 16:49:28 UTC
Sent	16 Jan 2015, 21:11:40 UTC
Report deadline	18 Apr 2015, 4:38:51 UTC
Received	23 Mar 2015, 4:49:50 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1293786
Run time	21 days 12 hours 58 min 45 sec
CPU time	10 days 13 hours 6 min 5 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.03 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> (unknown error) - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:39:12 (7812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=13392, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 00:11:17 (3084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 14:52:48 (8804): No heartbeat from core client for 30 sec - exiting 14:52:49 (8804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:26:51 (12976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:26:53 (12976): No heartbeat from core client for 30 sec - exiting 19:26:54 (12976): No heartbeat from core client for 30 sec - exiting 19:26:55 (12976): No heartbeat from core client for 30 sec - exiting 00:27:17 (11280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:27:19 (11280): No heartbeat from core client for 30 sec - exiting 02:03:37 (7128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:57:21 (6508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:22:02 (9568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:22:03 (9568): No heartbeat from core client for 30 sec - exiting CCPDN Monitor - Quit request from BOINC... 11:08:23 (6492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3772, iMonCtr=1 Model crash detected, will try to restart... 17:50:09 (516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:17:20 (2112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:32:22 (5216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:32:23 (5216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 18:20:35 (10376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7788, iMonCtr=1 Model crash detected, will try to restart... 09:01:14 (6736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:16:47 (11744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 03:04:01 (8208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:04:02 (8208): No heartbeat from core client for 30 sec - exiting 03:04:03 (8208): No heartbeat from core client for 30 sec - exiting 06:53:21 (10400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:10:54 (7100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:13:38 (2132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:13:25 (7640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:19:34 (12652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:09:54 (14352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:25:01 (5772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:16:19 (7756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 02:29:14 (14900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1740, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3560, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8112, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 08:50:41 (7788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:58:31 (1904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:32:50 (3680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:06:24 (7784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:24:31 (5792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:24:32 (5792): No heartbeat from core client for 30 sec - exiting 22:22:02 (11748): No heartbeat from core client for 30 sec - exiting 22:22:03 (11748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x773B3AC3 read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_saeh_1980_40_009466904/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
22 Mar 2015 04:50:10	1293786	17796599	hadcm3n_saeh_1980_40_009466904_0	259,200	911,152	3.5152
20 Mar 2015 15:40:19	1293786	17796599	hadcm3n_saeh_1980_40_009466904_0	233,280	813,590	3.4876
18 Mar 2015 14:28:32	1293786	17796599	hadcm3n_saeh_1980_40_009466904_0	207,360	723,314	3.4882
16 Mar 2015 02:29:50	1293786	17796599	hadcm3n_saeh_1980_40_009466904_0	181,440	633,834	3.4934
01 Mar 2015 08:03:11	1293786	17796599	hadcm3n_saeh_1980_40_009466904_0	155,520	542,521	3.4884
25 Feb 2015 19:09:28	1293786	17796599	hadcm3n_saeh_1980_40_009466904_0	129,600	449,246	3.4664
22 Feb 2015 07:45:08	1293786	17796599	hadcm3n_saeh_1980_40_009466904_0	103,680	363,184	3.5029
19 Feb 2015 04:15:25	1293786	17796599	hadcm3n_saeh_1980_40_009466904_0	77,760	276,412	3.5547
16 Feb 2015 11:06:10	1293786	17796599	hadcm3n_saeh_1980_40_009466904_0	51,840	181,504	3.5012
10 Feb 2015 03:38:59	1293786	17796599	hadcm3n_saeh_1980_40_009466904_0	25,920	88,078	3.3981