Task 15806833

Name	hadcm3n_n650_1920_40_008377409_0
Workunit	8528268
Created	30 May 2013, 11:45:10 UTC
Sent	30 May 2013, 11:48:40 UTC
Report deadline	29 Aug 2013, 19:15:51 UTC
Received	18 Jun 2013, 8:12:33 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1097360
Run time	5 days 3 hours 51 min 9 sec
CPU time	4 days 16 hours 22 min 48 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	3.02 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> (unknown error) - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:58:38 (13060): No heartbeat from core client for 30 sec - exiting 08:58:39 (13060): No heartbeat from core client for 30 sec - exiting 08:58:40 (13060): No heartbeat from core client for 30 sec - exiting 08:58:41 (13060): No heartbeat from core client for 30 sec - exiting 08:58:42 (13060): No heartbeat from core client for 30 sec - exiting 08:58:43 (13060): No heartbeat from core client for 30 sec - exiting 08:58:44 (13060): No heartbeat from core client for 30 sec - exiting 08:58:45 (13060): No heartbeat from core client for 30 sec - exiting 08:58:46 (13060): No heartbeat from core client for 30 sec - exiting 08:58:47 (13060): No heartbeat from core client for 30 sec - exiting 08:58:48 (13060): No heartbeat from core client for 30 sec - exiting 08:58:49 (13060): No heartbeat from core client for 30 sec - exiting 08:58:50 (13060): No heartbeat from core client for 30 sec - exiting 08:58:51 (13060): No heartbeat from core client for 30 sec - exiting 08:58:52 (13060): No heartbeat from core client for 30 sec - exiting 08:58:53 (13060): No heartbeat from core client for 30 sec - exiting 08:58:54 (13060): No heartbeat from core client for 30 sec - exiting 08:58:55 (13060): No heartbeat from core client for 30 sec - exiting 08:59:09 (13060): No heartbeat from core client for 30 sec - exiting 08:59:10 (13060): No heartbeat from core client for 30 sec - exiting 08:59:11 (13060): No heartbeat from core client for 30 sec - exiting 08:59:12 (13060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:28:31 (5512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=26688, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 14:05:43 (2652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7292, iMonCtr=1 Model crash detected, will try to restart... 23:05:43 (6304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=712, iMonCtr=1 Model crash detected, will try to restart... 22:21:01 (804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5280, iMonCtr=1 Model crash detected, will try to restart... 23:32:39 (6780): No heartbeat from core client for 30 sec - exiting 23:32:40 (6780): No heartbeat from core client for 30 sec - exiting 23:32:41 (6780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2356, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 16:22:37 (3768): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 16:52:43 (2972): No heartbeat from core client for 30 sec - exiting 16:52:44 (2972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77E03AB3 read attempt to address 0x403E7F90 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77E03AB3 read attempt to address 0x403E7F90 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_n650_1920_40_008377409/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
17 Jun 2013 22:58:41	1097360	15806833	hadcm3n_n650_1920_40_008377409_0	259,200	398,112	1.5359
17 Jun 2013 10:11:35	1097360	15806833	hadcm3n_n650_1920_40_008377409_0	233,280	358,665	1.5375
15 Jun 2013 18:12:17	1097360	15806833	hadcm3n_n650_1920_40_008377409_0	207,360	319,798	1.5422
14 Jun 2013 10:53:30	1097360	15806833	hadcm3n_n650_1920_40_008377409_0	181,440	280,544	1.5462
13 Jun 2013 14:26:03	1097360	15806833	hadcm3n_n650_1920_40_008377409_0	155,520	240,581	1.5469
12 Jun 2013 14:06:04	1097360	15806833	hadcm3n_n650_1920_40_008377409_0	129,600	200,919	1.5503
09 Jun 2013 14:41:59	1097360	15806833	hadcm3n_n650_1920_40_008377409_0	103,680	161,737	1.5600
06 Jun 2013 18:56:06	1097360	15806833	hadcm3n_n650_1920_40_008377409_0	77,760	122,691	1.5778
04 Jun 2013 18:56:15	1097360	15806833	hadcm3n_n650_1920_40_008377409_0	51,840	82,951	1.6001
02 Jun 2013 21:44:05	1097360	15806833	hadcm3n_n650_1920_40_008377409_0	25,920	42,376	1.6349