Task 14292399

Name	hadcm3n_yfok_1980_40_007834442_0
Workunit	7989554
Created	19 Mar 2012, 16:21:37 UTC
Sent	19 Mar 2012, 16:37:00 UTC
Report deadline	19 Jun 2012, 0:04:11 UTC
Received	1 May 2012, 6:34:00 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1301249
Run time	30 days 4 hours 43 min 50 sec
CPU time	24 days 6 hours 34 min 4 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	2.11 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.25</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:40:50 (5180): Can't acquire lockfile (32) - waiting 35s 10:41:21 (3144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:40:08 (5184): Can't acquire lockfile (32) - waiting 35s 00:40:37 (5180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:13:51 (7092): Can't acquire lockfile (32) - waiting 35s 02:13:59 (6616): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 23:34:36 (7224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:34:37 (7224): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 02:29:34 (7388): Can't acquire lockfile (32) - waiting 35s 02:29:58 (6060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... error: cannot delete old C:/ProgramData/BOINC/projects/climateprediction.net/txf/Bookman-Demi.txf error: cannot delete old C:/ProgramData/BOINC/projects/climateprediction.net/txf/Bookman-Light.txf error: cannot delete old C:/ProgramData/BOINC/projects/climateprediction.net/txf/AvantGarde-BookOblique.txf error: cannot delete old C:/ProgramData/BOINC/projects/climateprediction.net/txf/Times-BoldItalic.txf error: cannot delete old C:/ProgramData/BOINC/projects/climateprediction.net/txf/Helvetica-Bold.txf error: cannot delete old C:/ProgramData/BOINC/projects/climateprediction.net/txf/NewCenturySchlbk-BoldItalic.txf error: cannot create C:/ProgramData/BOINC/projects/climateprediction.net/txf/Times-Roman.txf error: cannot delete old C:/ProgramData/BOINC/projects/climateprediction.net/txf/NewCenturySchlbk-Roman.txf error: cannot delete old C:/ProgramData/BOINC/projects/climateprediction.net/txf/Times-Italic.txf error: cannot delete old C:/ProgramData/BOINC/projects/climateprediction.net/txf/NewCenturySchlbk-Bold.txf error: cannot delete old C:/ProgramData/BOINC/projects/climateprediction.net/txf/Palatino-Italic.txf error: cannot delete old C:/ProgramData/BOINC/projects/climateprediction.net/txf/Palatino-Bold.txf 00:01:35 (6064): Can't acquire lockfile (32) - waiting 35s 00:01:47 (4044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:44:32 (2780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:44:33 (2780): No heartbeat from core client for 30 sec - exiting 03:44:35 (2780): No heartbeat from core client for 30 sec - exiting 03:44:36 (2780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:44:55 (4500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:44:56 (4500): No heartbeat from core client for 30 sec - exiting 17:44:58 (4500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:08:50 (5732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 14:08:44 (5640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5616, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 forrtl: The requested operation cannot be performed on a file with a user-mapped section open. Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4440, iMonCtr=1 Model crash detected, will try to restart... forrtl: The requested operation cannot be performed on a file with a user-mapped section open. Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:47:12 (4072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x772D71A8 read attempt to address 0x40D409B0 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x777D3AB3 read attempt to address 0x40D409B8 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_yfok_1980_40_007834442/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 Apr 2012 15:46:07	1211033	14292399	hadcm3n_yfok_1980_40_007834442_0	1,036,800	2,096,567	2.0222
29 Apr 2012 15:46:07	1211033	14292399	hadcm3n_yfok_1980_40_007834442_0	1,010,880	2,043,781	2.0218
28 Apr 2012 06:48:53	1211033	14292399	hadcm3n_yfok_1980_40_007834442_0	984,960	1,991,399	2.0218
26 Apr 2012 23:45:27	1211033	14292399	hadcm3n_yfok_1980_40_007834442_0	959,040	1,938,196	2.0210
26 Apr 2012 23:45:27	1211033	14292399	hadcm3n_yfok_1980_40_007834442_0	933,120	1,885,036	2.0201
25 Apr 2012 07:00:22	1211033	14292399	hadcm3n_yfok_1980_40_007834442_0	907,200	1,831,687	2.0191
25 Apr 2012 03:36:20	1211033	14292399	hadcm3n_yfok_1980_40_007834442_0	881,280	1,856,695	2.1068
23 Apr 2012 14:31:07	1211033	14292399	hadcm3n_yfok_1980_40_007834442_0	855,360	1,803,822	2.1088
22 Apr 2012 22:19:13	1211033	14292399	hadcm3n_yfok_1980_40_007834442_0	829,440	1,751,039	2.1111
22 Apr 2012 03:49:32	1211033	14292399	hadcm3n_yfok_1980_40_007834442_0	803,520	1,696,325	2.1111
21 Apr 2012 09:22:00	1211033	14292399	hadcm3n_yfok_1980_40_007834442_0	777,600	1,642,157	2.1118
20 Apr 2012 14:56:16	1211033	14292399	hadcm3n_yfok_1980_40_007834442_0	751,680	1,588,079	2.1127
19 Apr 2012 22:14:33	1211033	14292399	hadcm3n_yfok_1980_40_007834442_0	725,760	1,534,582	2.1144
19 Apr 2012 06:46:52	1211033	14292399	hadcm3n_yfok_1980_40_007834442_0	699,840	1,481,400	2.1168
18 Apr 2012 11:10:55	1211033	14292399	hadcm3n_yfok_1980_40_007834442_0	673,920	1,425,058	2.1146
17 Apr 2012 17:13:15	1211033	14292399	hadcm3n_yfok_1980_40_007834442_0	648,000	1,367,311	2.1100
16 Apr 2012 20:08:13	1205573	14292399	hadcm3n_yfok_1980_40_007834442_0	622,080	1,309,316	2.1047
16 Apr 2012 00:54:30	1205573	14292399	hadcm3n_yfok_1980_40_007834442_0	596,160	1,250,400	2.0974
15 Apr 2012 03:49:03	1205573	14292399	hadcm3n_yfok_1980_40_007834442_0	570,240	1,192,847	2.0918
14 Apr 2012 11:08:52	1205573	14292399	hadcm3n_yfok_1980_40_007834442_0	544,320	1,137,186	2.0892