Task 13948628

Name	hadam3p_pnw_6vku_2002_1_007692224_0
Workunit	7847332
Created	20 Jan 2012, 20:33:13 UTC
Sent	20 Jan 2012, 20:33:20 UTC
Report deadline	2 Jan 2013, 1:53:20 UTC
Received	15 Aug 2012, 18:47:37 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1044903
Run time	6 days 4 hours 59 min 39 sec
CPU time	5 days 2 hours 42 min 3 sec
Validate state	Invalid
Credit	2,505.24
Device peak FLOPS	2.31 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <stderr_txt> CreateFile error 32 when trying set file time CPDN Monitor - Quit request from BOINC... Regional Worker:12:49:39 (2100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:15:28 (5708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6080, selfPID=6080, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5036, selfPID=5036, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:21:02 (5160): No heartbeat from core client for 30 sec - exiting 16:21:10 (5160): No heartbeat from core client for 30 sec - exiting 16:21:11 (5160): No heartbeat from core client for 30 sec - exiting 16:21:12 (5160): No heartbeat from core client for 30 sec - exiting 16:21:13 (5160): No heartbeat from core client for 30 sec - exiting 16:21:14 (5160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:03:50 (4468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:31:47 (5464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:12:06 (6008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:30:51 (2944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5820, selfPID=5820, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:04:20 (5024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=116, selfPID=116, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 09:33:51 (6072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5156, selfPID=5156, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:26:47 (4876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:30:37 (4936): No heartbeat from core client for 30 sec - exiting 17:30:38 (4936): No heartbeat from core client for 30 sec - exiting 17:30:39 (4936): No heartbeat from core client for 30 sec - exiting 17:30:40 (4936): No heartbeat from core client for 30 sec - exiting 17:30:41 (4936): No heartbeat from core client for 30 sec - exiting 17:30:42 (4936): No heartbeat from core client for 30 sec - exiting 17:30:43 (4936): No heartbeat from core client for 30 sec - exiting 17:30:44 (4936): No heartbeat from core client for 30 sec - exiting 17:30:45 (4936): No heartbeat from core client for 30 sec - exiting 17:30:46 (4936): No heartbeat from core client for 30 sec - exiting 17:30:47 (4936): No heartbeat from core client for 30 sec - exiting 17:30:48 (4936): No heartbeat from core client for 30 sec - exiting 17:30:49 (4936): No heartbeat from core client for 30 sec - exiting 17:30:50 (4936): No heartbeat from core client for 30 sec - exiting 17:30:51 (4936): No heartbeat from core client for 30 sec - exiting 17:30:52 (4936): No heartbeat from core client for 30 sec - exiting 17:30:53 (4936): No heartbeat from core client for 30 sec - exiting 17:30:54 (4936): No heartbeat from core client for 30 sec - exiting 17:30:55 (4936): No heartbeat from core client for 30 sec - exiting 17:30:56 (4936): No heartbeat from core client for 30 sec - exiting 17:30:57 (4936): No heartbeat from core client for 30 sec - exiting 17:30:58 (4936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3132, selfPID=3132, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3132, selfPID=592, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2696, selfPID=2696, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5316, selfPID=5316, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:43:07 (5932): No heartbeat from core client for 30 sec - exiting 09:43:09 (5932): No heartbeat from core client for 30 sec - exiting 09:43:10 (5932): No heartbeat from core client for 30 sec - exiting 09:43:11 (5932): No heartbeat from core client for 30 sec - exiting 09:43:12 (5932): No heartbeat from core client for 30 sec - exiting 09:43:13 (5932): No heartbeat from core client for 30 sec - exiting 09:43:14 (5932): No heartbeat from core client for 30 sec - exiting 09:43:15 (5932): No heartbeat from core client for 30 sec - exiting 09:43:16 (5932): No heartbeat from core client for 30 sec - exiting 09:43:17 (5932): No heartbeat from core client for 30 sec - exiting 09:43:18 (5932): No heartbeat from core client for 30 sec - exiting 09:43:20 (5932): No heartbeat from core client for 30 sec - exiting 09:43:21 (5932): No heartbeat from core client for 30 sec - exiting 09:43:22 (5932): No heartbeat from core client for 30 sec - exiting 09:43:23 (5932): No heartbeat from core client for 30 sec - exiting 09:43:24 (5932): No heartbeat from core client for 30 sec - exiting 09:43:25 (5932): No heartbeat from core client for 30 sec - exiting 09:43:26 (5932): No heartbeat from core client for 30 sec - exiting 09:43:27 (5932): No heartbeat from core client for 30 sec - exiting 09:43:28 (5932): No heartbeat from core client for 30 sec - exiting 09:43:29 (5932): No heartbeat from core client for 30 sec - exiting 09:43:30 (5932): No heartbeat from core client for 30 sec - exiting 09:43:32 (5932): No heartbeat from core client for 30 sec - exiting 09:43:33 (5932): No heartbeat from core client for 30 sec - exiting 09:43:34 (5932): No heartbeat from core client for 30 sec - exiting 09:43:35 (5932): No heartbeat from core client for 30 sec - exiting 09:43:36 (5932): No heartbeat from core client for 30 sec - exiting 09:43:37 (5932): No heartbeat from core client for 30 sec - exiting 09:43:38 (5932): No heartbeat from core client for 30 sec - exiting 09:43:39 (5932): No heartbeat from core client for 30 sec - exiting 09:43:40 (5932): No heartbeat from core client for 30 sec - exiting 09:43:41 (5932): No heartbeat from core client for 30 sec - exiting 09:43:43 (5932): No heartbeat from core client for 30 sec - exiting 09:43:44 (5932): No heartbeat from core client for 30 sec - exiting 09:43:45 (5932): No heartbeat from core client for 30 sec - exiting 09:43:46 (5932): No heartbeat from core client for 30 sec - exiting 09:43:47 (5932): No heartbeat from core client for 30 sec - exiting 09:43:48 (5932): No heartbeat from core client for 30 sec - exiting 09:43:49 (5932): No heartbeat from core client for 30 sec - exiting 09:43:50 (5932): No heartbeat from core client for 30 sec - exiting 09:43:51 (5932): No heartbeat from core client for 30 sec - exiting 09:43:52 (5932): No heartbeat from core client for 30 sec - exiting 09:43:53 (5932): No heartbeat from core client for 30 sec - exiting 09:43:55 (5932): No heartbeat from core client for 30 sec - exiting 09:43:56 (5932): No heartbeat from core client for 30 sec - exiting 09:43:57 (5932): No heartbeat from core client for 30 sec - exiting 09:43:58 (5932): No heartbeat from core client for 30 sec - exiting 09:43:59 (5932): No heartbeat from core client for 30 sec - exiting 09:44:00 (5932): No heartbeat from core client for 30 sec - exiting 09:44:01 (5932): No heartbeat from core client for 30 sec - exiting 09:44:02 (5932): No heartbeat from core client for 30 sec - exiting 09:44:03 (5932): No heartbeat from core client for 30 sec - exiting 09:44:04 (5932): No heartbeat from core client for 30 sec - exiting 09:44:06 (5932): No heartbeat from core client for 30 sec - exiting 09:44:07 (5932): No heartbeat from core client for 30 sec - exiting 09:44:08 (5932): No heartbeat from core client for 30 sec - exiting 09:44:09 (5932): No heartbeat from core client for 30 sec - exiting 09:44:10 (5932): No heartbeat from core client for 30 sec - exiting 09:44:11 (5932): No heartbeat from core client for 30 sec - exiting 09:44:12 (5932): No heartbeat from core client for 30 sec - exiting 09:44:13 (5932): No heartbeat from core client for 30 sec - exiting 09:44:14 (5932): No heartbeat from core client for 30 sec - exiting 09:44:15 (5932): No heartbeat from core client for 30 sec - exiting 09:44:16 (5932): No heartbeat from core client for 30 sec - exiting 09:44:18 (5932): No heartbeat from core client for 30 sec - exiting 09:44:19 (5932): No heartbeat from core client for 30 sec - exiting 09:44:20 (5932): No heartbeat from core client for 30 sec - exiting 09:44:21 (5932): No heartbeat from core client for 30 sec - exiting 09:44:22 (5932): No heartbeat from core client for 30 sec - exiting 09:44:23 (5932): No heartbeat from core client for 30 sec - exiting 09:44:24 (5932): No heartbeat from core client for 30 sec - exiting 09:44:25 (5932): No heartbeat from core client for 30 sec - exiting 09:44:26 (5932): No heartbeat from core client for 30 sec - exiting 09:44:27 (5932): No heartbeat from core client for 30 sec - exiting 09:44:29 (5932): No heartbeat from core client for 30 sec - exiting 09:44:30 (5932): No heartbeat from core client for 30 sec - exiting 09:44:31 (5932): No heartbeat from core client for 30 sec - exiting 09:44:32 (5932): No heartbeat from core client for 30 sec - exiting 09:44:33 (5932): No heartbeat from core client for 30 sec - exiting 09:44:34 (5932): No heartbeat from core client for 30 sec - exiting 09:44:35 (5932): No heartbeat from core client for 30 sec - exiting 09:44:36 (5932): No heartbeat from core client for 30 sec - exiting 09:44:37 (5932): No heartbeat from core client for 30 sec - exiting 09:44:38 (5932): No heartbeat from core client for 30 sec - exiting 09:44:40 (5932): No heartbeat from core client for 30 sec - exiting 09:44:41 (5932): No heartbeat from core client for 30 sec - exiting 09:44:42 (5932): No heartbeat from core client for 30 sec - exiting 09:44:43 (5932): No heartbeat from core client for 30 sec - exiting 09:44:44 (5932): No heartbeat from core client for 30 sec - exiting 09:44:45 (5932): No heartbeat from core client for 30 sec - exiting 09:44:46 (5932): No heartbeat from core client for 30 sec - exiting 09:44:47 (5932): No heartbeat from core client for 30 sec - exiting 09:44:48 (5932): No heartbeat from core client for 30 sec - exiting 09:44:49 (5932): No heartbeat from core client for 30 sec - exiting 09:44:50 (5932): No heartbeat from core client for 30 sec - exiting 09:44:52 (5932): No heartbeat from core client for 30 sec - exiting 09:44:53 (5932): No heartbeat from core client for 30 sec - exiting 09:44:54 (5932): No heartbeat from core client for 30 sec - exiting 09:44:55 (5932): No heartbeat from core client for 30 sec - exiting 09:44:56 (5932): No heartbeat from core client for 30 sec - exiting 09:44:57 (5932): No heartbeat from core client for 30 sec - exiting 09:44:58 (5932): No heartbeat from core client for 30 sec - exiting 09:44:59 (5932): No heartbeat from core client for 30 sec - exiting 09:45:00 (5932): No heartbeat from core client for 30 sec - exiting 09:45:01 (5932): No heartbeat from core client for 30 sec - exiting 09:45:02 (5932): No heartbeat from core client for 30 sec - exiting 09:45:04 (5932): No heartbeat from core client for 30 sec - exiting 09:45:05 (5932): No heartbeat from core client for 30 sec - exiting 09:45:06 (5932): No heartbeat from core client for 30 sec - exiting 09:45:08 (5932): No heartbeat from core client for 30 sec - exiting 09:45:09 (5932): No heartbeat from core client for 30 sec - exiting 09:45:10 (5932): No heartbeat from core client for 30 sec - exiting 09:45:11 (5932): No heartbeat from core client for 30 sec - exiting 09:45:13 (5932): No heartbeat from core client for 30 sec - exiting 09:45:14 (5932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:45:15 (5932): No heartbeat from core client for 30 sec - exiting 09:45:17 (5932): No heartbeat from core client for 30 sec - exiting 09:45:21 (5932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5668, selfPID=5668, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:47:36 (3856): No heartbeat from core client for 30 sec - exiting 17:47:37 (3856): No heartbeat from core client for 30 sec - exiting 17:47:38 (3856): No heartbeat from core client for 30 sec - exiting 17:47:39 (3856): No heartbeat from core client for 30 sec - exiting 17:47:40 (3856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3848, selfPID=3848, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1260, selfPID=1260, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=3296, iMonCtr=1 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4244, selfPID=4120, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 10 Called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_pnw_6vku_2002_1_007692224_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_6vku_2002_1_007692224_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Jul 2012 12:40:58	1044903	13948628	hadam3p_pnw_6vku_2002_1_007692224_0	115,296	422,314	3.6629
02 Jul 2012 15:33:34	1044903	13948628	hadam3p_pnw_6vku_2002_1_007692224_0	103,776	383,545	3.6959
26 May 2012 06:52:56	1044903	13948628	hadam3p_pnw_6vku_2002_1_007692224_0	92,256	340,907	3.6952
02 May 2012 18:42:10	1044903	13948628	hadam3p_pnw_6vku_2002_1_007692224_0	80,736	298,322	3.6950
27 Mar 2012 17:36:08	1044903	13948628	hadam3p_pnw_6vku_2002_1_007692224_0	69,216	259,639	3.7511
11 Mar 2012 17:30:42	1044903	13948628	hadam3p_pnw_6vku_2002_1_007692224_0	57,696	218,034	3.7790
04 Mar 2012 13:33:40	1044903	13948628	hadam3p_pnw_6vku_2002_1_007692224_0	46,176	176,365	3.8194
03 Mar 2012 14:36:07	1044903	13948628	hadam3p_pnw_6vku_2002_1_007692224_0	34,656	133,414	3.8497
27 Feb 2012 20:30:27	1044903	13948628	hadam3p_pnw_6vku_2002_1_007692224_0	23,136	90,152	3.8966
15 Feb 2012 18:12:25	1044903	13948628	hadam3p_pnw_6vku_2002_1_007692224_0	11,616	48,582	4.1823