Task 15458176

Name	hadcm3n_zh6a_1880_40_008248477_2
Workunit	8403601
Created	23 Nov 2012, 16:31:58 UTC
Sent	23 Nov 2012, 16:36:29 UTC
Report deadline	23 Feb 2013, 0:03:40 UTC
Received	23 Dec 2012, 20:58:32 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1075479
Run time	4 days 8 hours 45 min 58 sec
CPU time	4 days 2 hours 47 min 16 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	3.14 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.33</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5968, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4556, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4248, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5068, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4652, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5372, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5628, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6132, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2568, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=528, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1324, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1472, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2008, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3788, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4072, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4560, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4316, iMonCtr=1 Model crash detected, will try to restart... 07:09:09 (5812): No heartbeat from core client for 30 sec - exiting 07:09:10 (5812): No heartbeat from core client for 30 sec - exiting 07:09:11 (5812): No heartbeat from core client for 30 sec - exiting 07:09:12 (5812): No heartbeat from core client for 30 sec - exiting 07:09:13 (5812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1820, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2956, iMonCtr=1 Model crash detected, will try to restart... CController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2684, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2460, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2268, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77265EAB read attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... Cannot serialize file G:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_zh6a_1880_40_008248477/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 Dec 2012 21:00:40	1075479	15458176	hadcm3n_zh6a_1880_40_008248477_2	259,200	355,627	1.3720
16 Dec 2012 23:47:59	1075479	15458176	hadcm3n_zh6a_1880_40_008248477_2	233,280	317,416	1.3607
14 Dec 2012 15:49:47	1075479	15458176	hadcm3n_zh6a_1880_40_008248477_2	207,360	282,867	1.3641
13 Dec 2012 21:37:05	1075479	15458176	hadcm3n_zh6a_1880_40_008248477_2	181,440	247,385	1.3635
13 Dec 2012 21:37:05	1075479	15458176	hadcm3n_zh6a_1880_40_008248477_2	155,520	209,601	1.3477
07 Dec 2012 15:33:09	1075479	15458176	hadcm3n_zh6a_1880_40_008248477_2	129,600	176,036	1.3583
04 Dec 2012 21:56:53	1075479	15458176	hadcm3n_zh6a_1880_40_008248477_2	103,680	141,726	1.3670
02 Dec 2012 21:01:24	1075479	15458176	hadcm3n_zh6a_1880_40_008248477_2	77,760	105,980	1.3629
28 Nov 2012 21:04:04	1075479	15458176	hadcm3n_zh6a_1880_40_008248477_2	51,840	69,961	1.3496
25 Nov 2012 23:48:12	1075479	15458176	hadcm3n_zh6a_1880_40_008248477_2	25,920	34,458	1.3294