Task 15116639

Name	hadam3p_pnw_33l4_1980_1_008143296_1
Workunit	8298410
Created	14 Aug 2012, 10:20:36 UTC
Sent	14 Aug 2012, 10:43:52 UTC
Report deadline	27 Jul 2013, 16:03:52 UTC
Received	12 Sep 2012, 8:29:32 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	194 (0x000000C2) EXIT_ABORTED_BY_CLIENT
Computer ID	1140498
Run time	2 days 12 hours 43 min 11 sec
CPU time	2 days 4 hours 44 min 10 sec
Validate state	Invalid
Credit	1,253.67
Device peak FLOPS	2.73 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> Got ack for job that's till active </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8576, selfPID=8576, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 01:17:17 (8088): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1004, selfPID=1004, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6568, selfPID=6568, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:52:33 (2772): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6804, selfPID=6804, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=9624, selfPID=9624, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4636, selfPID=4636, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 02:32:13 (9596): No heartbeat from core client for 30 sec - exiting 02:32:14 (9596): No heartbeat from core client for 30 sec - exiting 02:32:15 (9596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7804, selfPID=7804, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8412, selfPID=8412, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4172, selfPID=4172, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8284, selfPID=8284, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8404CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5700, selfPID=5700, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:54:41 (9476): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3240, selfPID=3240, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6080, selfPID=6080, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=15460, selfPID=15460, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=13544, selfPID=13544, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 01:18:47 (13804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8420, selfPID=8420, iMonCtr=2 22:00:34 (1308): No heartbeat from core client for 30 sec - exiting 22:00:36 (1308): No heartbeat from core client for 30 sec - exiting 22:00:37 (1308): No heartbeat from core client for 30 sec - exiting 22:00:38 (1308): No heartbeat from core client for 30 sec - exiting 22:00:39 (1308): No heartbeat from core client for 30 sec - exiting 22:00:40 (1308): No heartbeat from core client for 30 sec - exiting 22:00:41 (1308): No heartbeat from core client for 30 sec - exiting 22:00:42 (1308): No heartbeat from core client for 30 sec - exiting 22:00:43 (1308): No heartbeat from core client for 30 sec - exiting 22:00:44 (1308): No heartbeat from core client for 30 sec - exiting 22:00:45 (1308): No heartbeat from core client for 30 sec - exiting 22:00:46 (1308): No heartbeat from core client for 30 sec - exiting 22:00:47 (1308): No heartbeat from core client for 30 sec - exiting 22:00:48 (1308): No heartbeat from core client for 30 sec - exiting 22:00:49 (1308): No heartbeat from core client for 30 sec - exiting 22:00:50 (1308): No heartbeat from core client for 30 sec - exiting 22:00:51 (1308): No heartbeat from core client for 30 sec - exiting 22:00:52 (1308): No heartbeat from core client for 30 sec - exiting 22:00:53 (1308): No heartbeat from core client for 30 sec - exiting 22:00:54 (1308): No heartbeat from core client for 30 sec - exiting 22:00:55 (1308): No heartbeat from core client for 30 sec - exiting 22:00:56 (1308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=13132, selfPID=13132, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:58:09 (7368): No heartbeat from core client for 30 sec - exiting 01:58:10 (7368): No heartbeat from core client for 30 sec - exiting 01:58:11 (7368): No heartbeat from core client for 30 sec - exiting 01:58:12 (7368): No heartbeat from core client for 30 sec - exiting 01:58:13 (7368): No heartbeat from core client for 30 sec - exiting 01:58:14 (7368): No heartbeat from core client for 30 sec - exiting 01:58:15 (7368): No heartbeat from core client for 30 sec - exiting 01:58:16 (7368): No heartbeat from core client for 30 sec - exiting 01:58:17 (7368): No heartbeat from core client for 30 sec - exiting 01:58:18 (7368): No heartbeat from core client for 30 sec - exiting 01:58:19 (7368): No heartbeat from core client for 30 sec - exiting 01:58:20 (7368): No heartbeat from core client for 30 sec - exiting 01:58:21 (7368): No heartbeat from core client for 30 sec - exiting 01:58:22 (7368): No heartbeat from core client for 30 sec - exiting 01:58:23 (7368): No heartbeat from core client for 30 sec - exiting 01:58:24 (7368): No heartbeat from core client for 30 sec - exiting 01:58:25 (7368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:26:53 (3968): No heartbeat from core client for 30 sec - exiting 02:26:54 (3968): No heartbeat from core client for 30 sec - exiting 02:26:55 (3968): No heartbeat from core client for 30 sec - exiting 02:26:56 (3968): No heartbeat from core client for 30 sec - exiting 02:26:57 (3968): No heartbeat from core client for 30 sec - exiting 02:26:58 (3968): No heartbeat from core client for 30 sec - exiting 02:26:59 (3968): No heartbeat from core client for 30 sec - exiting 02:27:00 (3968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3260, selfPID=3260, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=684, selfPID=684, iMonCtr=2 03:07:19 (7940): No heartbeat from core client for 30 sec - exiting 03:07:20 (7940): No heartbeat from core client for 30 sec - exiting 03:07:21 (7940): No heartbeat from core client for 30 sec - exiting 03:07:22 (7940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7584, selfPID=7584, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7136, selfPID=7136, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:58:27 (8172): No heartbeat from core client for 30 sec - exiting 03:58:28 (8172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7692, selfPID=7692, iMonCtr=2 04:10:26 (7012): No heartbeat from core client for 30 sec - exiting 04:10:27 (7012): No heartbeat from core client for 30 sec - exiting 04:10:28 (7012): No heartbeat from core client for 30 sec - exiting 04:10:29 (7012): No heartbeat from core client for 30 sec - exiting 04:10:30 (7012): No heartbeat from core client for 30 sec - exiting 04:10:31 (7012): No heartbeat from core client for 30 sec - exiting 04:10:32 (7012): No heartbeat from core client for 30 sec - exiting 04:10:33 (7012): No heartbeat from core client for 30 sec - exiting 04:10:34 (7012): No heartbeat from core client for 30 sec - exiting 04:10:35 (7012): No heartbeat from core client for 30 sec - exiting 04:10:36 (7012): No heartbeat from core client for 30 sec - exiting 04:10:37 (7012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 04:30:30 (5048): No heartbeat from core client for 30 sec - exiting 04:30:32 (5048): No heartbeat from core client for 30 sec - exiting 04:30:33 (5048): No heartbeat from core client for 30 sec - exiting 04:30:34 (5048): No heartbeat from core client for 30 sec - exiting 04:30:35 (5048): No heartbeat from core client for 30 sec - exiting 04:30:36 (5048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:00:50 (8788): No heartbeat from core client for 30 sec - exiting 22:00:51 (8788): No heartbeat from core client for 30 sec - exiting 22:00:53 (8788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4688, selfPID=4688, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8236, selfPID=8236, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=8016, selfPID=8016, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3804, selfPID=3804, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7636, selfPID=7636, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=920, selfPID=920, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7952, selfPID=7952, iMonCtr=2 03:18:51 (7544): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7348, selfPID=7348, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:36:46 (5888): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6232, selfPID=6232, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:57:47 (8268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 02:26:43 (8624): No heartbeat from core client for 30 sec - exiting 02:26:44 (8624): No heartbeat from core client for 30 sec - exiting 02:26:45 (8624): No heartbeat from core client for 30 sec - exiting 02:26:46 (8624): No heartbeat from core client for 30 sec - exiting 02:26:47 (8624): No heartbeat from core client for 30 sec - exiting 02:26:48 (8624): No heartbeat from core client for 30 sec - exiting 02:26:49 (8624): No heartbeat from core client for 30 sec - exiting 02:26:50 (8624): No heartbeat from core client for 30 sec - exiting 02:26:51 (8624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 32 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/xaakm.pipe_dummy 2048 Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 5 zip error: Output file write failure (write error on zip file) Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
09 Sep 2012 05:39:23	1140498	15116639	hadam3p_pnw_33l4_1980_1_008143296_1	57,696	159,831	2.7702
08 Sep 2012 20:51:53	1140498	15116639	hadam3p_pnw_33l4_1980_1_008143296_1	46,176	128,637	2.7858
08 Sep 2012 11:52:25	1140498	15116639	hadam3p_pnw_33l4_1980_1_008143296_1	34,656	96,792	2.7929
29 Aug 2012 08:55:27	1140498	15116639	hadam3p_pnw_33l4_1980_1_008143296_1	23,136	64,489	2.7874
19 Aug 2012 15:35:51	1140498	15116639	hadam3p_pnw_33l4_1980_1_008143296_1	11,616	31,955	2.7509