Task 15173465

Name	hadam3p_saf_1fhw_1979_1_006947916_1
Workunit	7151232
Created	22 Aug 2012, 14:58:43 UTC
Sent	22 Aug 2012, 15:01:51 UTC
Report deadline	4 Aug 2013, 20:21:51 UTC
Received	23 Jun 2013, 11:10:33 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1151771
Run time	4 days 8 hours 57 min 45 sec
CPU time
Validate state	Invalid
Credit	1,122.82
Device peak FLOPS	1.91 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Southern Africa v6.09 windows_intelx86
Stderr	<core_client_version>7.0.25</core_client_version> <![CDATA[ <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4244, selfPID=2572, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3404, selfPID=4128, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3748, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1360, selfPID=1380, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4476, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4744, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3108, iMonCtr=2 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:01:58 (3088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2432, selfPID=4380, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5000, iMonCtr=2 20:01:40 (4348): No heartbeat from core client for 30 sec - exiting 20:01:41 (4348): No heartbeat from core client for 30 sec - exiting 20:01:42 (4348): No heartbeat from core client for 30 sec - exiting 20:01:43 (4348): No heartbeat from core client for 30 sec - exiting 20:01:44 (4348): No heartbeat from core client for 30 sec - exiting 20:01:45 (4348): No heartbeat from core client for 30 sec - exiting 20:01:46 (4348): No heartbeat from core client for 30 sec - exiting 20:01:47 (4348): No heartbeat from core client for 30 sec - exiting 20:01:48 (4348): No heartbeat from core client for 30 sec - exiting 20:01:49 (4348): No heartbeat from core client for 30 sec - exiting 20:01:50 (4348): No heartbeat from core client for 30 sec - exiting 20:01:51 (4348): No heartbeat from core client for 30 sec - exiting 20:01:52 (4348): No heartbeat from core client for 30 sec - exiting 20:01:53 (4348): No heartbeat from core client for 30 sec - exiting 20:01:54 (4348): No heartbeat from core client for 30 sec - exiting 20:01:55 (4348): No heartbeat from core client for 30 sec - exiting 20:01:56 (4348): No heartbeat from core client for 30 sec - exiting 20:01:57 (4348): No heartbeat from core client for 30 sec - exiting 20:01:58 (4348): No heartbeat from core client for 30 sec - exiting 20:01:59 (4348): No heartbeat from core client for 30 sec - exiting 20:02:00 (4348): No heartbeat from core client for 30 sec - exiting 20:02:01 (4348): No heartbeat from core client for 30 sec - exiting 20:02:02 (4348): No heartbeat from core client for 30 sec - exiting 20:02:03 (4348): No heartbeat from core client for 30 sec - exiting 20:02:04 (4348): No heartbeat from core client for 30 sec - exiting 20:02:05 (4348): No heartbeat from core client for 30 sec - exiting 20:02:06 (4348): No heartbeat from core client for 30 sec - exiting 20:02:07 (4348): No heartbeat from core client for 30 sec - exiting 20:02:08 (4348): No heartbeat from core client for 30 sec - exiting 20:02:09 (4348): No heartbeat from core client for 30 sec - exiting 20:02:10 (4348): No heartbeat from core client for 30 sec - exiting 20:02:11 (4348): No heartbeat from core client for 30 sec - exiting 20:02:12 (4348): No heartbeat from core client for 30 sec - exiting 20:02:13 (4348): No heartbeat from core client for 30 sec - exiting 20:02:14 (4348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_saf_1fhw_1979_1_006947916_1_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_1fhw_1979_1_006947916_1_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_1fhw_1979_1_006947916_1_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_1fhw_1979_1_006947916_1_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_1fhw_1979_1_006947916_1_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_saf_1fhw_1979_1_006947916_1_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
14 May 2013 15:31:08	1151771	15173465	hadam3p_saf_1fhw_1979_1_006947916_1	69,216	265,373	3.8340
21 Apr 2013 16:20:53	1151771	15173465	hadam3p_saf_1fhw_1979_1_006947916_1	57,696	222,065	3.8489
03 Feb 2013 20:22:44	1151771	15173465	hadam3p_saf_1fhw_1979_1_006947916_1	46,176	177,849	3.8515
16 Dec 2012 15:56:02	1151771	15173465	hadam3p_saf_1fhw_1979_1_006947916_1	34,656	133,545	3.8534
20 Oct 2012 14:52:22	1151771	15173465	hadam3p_saf_1fhw_1979_1_006947916_1	23,140	89,149	3.8526
20 Oct 2012 13:22:05	1151771	15173465	hadam3p_saf_1fhw_1979_1_006947916_1	23,136	88,572	3.8283
27 Sep 2012 10:39:34	1151771	15173465	hadam3p_saf_1fhw_1979_1_006947916_1	11,616	44,499	3.8308