Task 13538783

Name	hadcm3n_ygvo_1900_40_007516553_1
Workunit	7714028
Created	28 Oct 2011, 12:47:49 UTC
Sent	22 Nov 2011, 20:52:40 UTC
Report deadline	22 Feb 2012, 4:19:51 UTC
Received	7 Dec 2011, 17:37:39 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1181044
Run time	6 days 15 hours 48 min 21 sec
CPU time	5 days 15 hours 22 min 10 sec
Validate state	Invalid
Credit	2,177.28
Device peak FLOPS	2.14 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.12.33</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:53:01 (1657): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:54:21 (25558): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:55:57 (25625): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:59:13 (25704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:01:46 (25844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:04:33 (25956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:07:45 (26081): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:10:07 (26218): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:13:20 (26332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:16:42 (26469): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:19:09 (26614): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:21:55 (26721): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:24:47 (26876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:27:45 (27050): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:30:37 (27228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:33:09 (27403): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:36:22 (27556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:39:39 (27742): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:42:16 (27956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:45:06 (28113): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:48:12 (28294): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:50:39 (28470): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:53:35 (28617): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:56:06 (28790): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:59:27 (28940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:02:08 (29135): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:04:59 (29300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:08:16 (29465): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:11:18 (29656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:14:30 (29842): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:17:01 (30025): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:19:27 (30176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:22:08 (30319): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:24:34 (30474): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:27:05 (30618): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:30:11 (30767): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:33:22 (30947): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:36:00 (31137): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:38:56 (31291): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:42:08 (31469): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:44:43 (31651): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:48:04 (31811): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:50:47 (32001): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:53:58 (32157): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:56:48 (32346): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:59:34 (32507): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:02:36 (32674): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:05:28 (391): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:08:28 (565): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:10:59 (739): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:49:35 (2120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 23:02:15 (2086): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:32:31 (2183): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:24:27 (16026): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:25:52 (18450): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:27:44 (18517): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:30:11 (18602): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 20:31:20 (1651): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:31:21 (1651): No heartbeat from core client for 30 sec - exiting 20:31:22 (1651): No heartbeat from core client for 30 sec - exiting 20:31:23 (1651): No heartbeat from core client for 30 sec - exiting 20:31:24 (1651): No heartbeat from core client for 30 sec - exiting 20:31:25 (1651): No heartbeat from core client for 30 sec - exiting 20:31:26 (1651): No heartbeat from core client for 30 sec - exiting 20:31:27 (1651): No heartbeat from core client for 30 sec - exiting 20:31:28 (1651): No heartbeat from core client for 30 sec - exiting 20:31:29 (1651): No heartbeat from core client for 30 sec - exiting 20:31:30 (1651): No heartbeat from core client for 30 sec - exiting 20:31:31 (1651): No heartbeat from core client for 30 sec - exiting 20:31:32 (1651): No heartbeat from core client for 30 sec - exiting 20:31:33 (1651): No heartbeat from core client for 30 sec - exiting 20:31:34 (1651): No heartbeat from core client for 30 sec - exiting 20:31:35 (1651): No heartbeat from core client for 30 sec - exiting 20:31:36 (1651): No heartbeat from core client for 30 sec - exiting 20:31:37 (1651): No heartbeat from core client for 30 sec - exiting 20:31:38 (1651): No heartbeat from core client for 30 sec - exiting 20:31:39 (1651): No heartbeat from core client for 30 sec - exiting 20:31:40 (1651): No heartbeat from core client for 30 sec - exiting 20:31:41 (1651): No heartbeat from core client for 30 sec - exiting 20:31:42 (1651): No heartbeat from core client for 30 sec - exiting 20:31:43 (1651): No heartbeat from core client for 30 sec - exiting 20:31:44 (1651): No heartbeat from core client for 30 sec - exiting 20:31:45 (1651): No heartbeat from core client for 30 sec - exiting 20:31:46 (1651): No heartbeat from core client for 30 sec - exiting 20:32:27 (1651): No heartbeat from core client for 30 sec - exiting 20:32:33 (1651): No heartbeat from core client for 30 sec - exiting 23:16:20 (31141): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:33:51 (6344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 23:39:29 (2169): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:40:20 (2169): No heartbeat from core client for 30 sec - exiting 23:40:21 (2169): No heartbeat from core client for 30 sec - exiting 23:40:22 (2169): No heartbeat from core client for 30 sec - exiting 23:40:23 (2169): No heartbeat from core client for 30 sec - exiting 23:40:24 (2169): No heartbeat from core client for 30 sec - exiting 23:40:25 (2169): No heartbeat from core client for 30 sec - exiting 23:40:26 (2169): No heartbeat from core client for 30 sec - exiting 23:40:27 (2169): No heartbeat from core client for 30 sec - exiting 23:40:28 (2169): No heartbeat from core client for 30 sec - exiting 23:40:29 (2169): No heartbeat from core client for 30 sec - exiting 23:40:30 (2169): No heartbeat from core client for 30 sec - exiting 23:40:31 (2169): No heartbeat from core client for 30 sec - exiting 23:40:32 (2169): No heartbeat from core client for 30 sec - exiting 23:40:33 (2169): No heartbeat from core client for 30 sec - exiting 23:40:34 (2169): No heartbeat from core client for 30 sec - exiting 23:40:35 (2169): No heartbeat from core client for 30 sec - exiting 23:40:36 (2169): No heartbeat from core client for 30 sec - exiting 23:40:37 (2169): No heartbeat from core client for 30 sec - exiting 23:40:38 (2169): No heartbeat from core client for 30 sec - exiting 23:40:39 (2169): No heartbeat from core client for 30 sec - exiting 23:40:40 (2169): No heartbeat from core client for 30 sec - exiting 23:40:41 (2169): No heartbeat from core client for 30 sec - exiting 23:40:42 (2169): No heartbeat from core client for 30 sec - exiting 23:40:43 (2169): No heartbeat from core client for 30 sec - exiting 23:40:44 (2169): No heartbeat from core client for 30 sec - exiting 23:40:45 (2169): No heartbeat from core client for 30 sec - exiting 23:40:46 (2169): No heartbeat from core client for 30 sec - exiting 23:40:47 (2169): No heartbeat from core client for 30 sec - exiting 23:40:48 (2169): No heartbeat from core client for 30 sec - exiting 23:40:49 (2169): No heartbeat from core client for 30 sec - exiting 23:40:50 (2169): No heartbeat from core client for 30 sec - exiting 23:40:51 (2169): No heartbeat from core client for 30 sec - exiting 23:40:52 (2169): No heartbeat from core client for 30 sec - exiting 23:40:53 (2169): No heartbeat from core client for 30 sec - exiting 23:40:54 (2169): No heartbeat from core client for 30 sec - exiting 23:40:55 (2169): No heartbeat from core client for 30 sec - exiting 23:40:56 (2169): No heartbeat from core client for 30 sec - exiting 23:40:57 (2169): No heartbeat from core client for 30 sec - exiting 23:40:58 (2169): No heartbeat from core client for 30 sec - exiting 23:40:59 (2169): No heartbeat from core client for 30 sec - exiting 23:41:00 (2169): No heartbeat from core client for 30 sec - exiting 23:41:01 (2169): No heartbeat from core client for 30 sec - exiting 23:41:02 (2169): No heartbeat from core client for 30 sec - exiting 23:41:03 (2169): No heartbeat from core client for 30 sec - exiting 23:41:09 (2169): No heartbeat from core client for 30 sec - exiting 23:41:10 (2169): No heartbeat from core client for 30 sec - exiting 23:41:11 (2169): No heartbeat from core client for 30 sec - exiting 23:41:12 (2169): No heartbeat from core client for 30 sec - exiting 23:41:13 (2169): No heartbeat from core client for 30 sec - exiting 23:41:14 (2169): No heartbeat from core client for 30 sec - exiting 23:41:16 (2169): No heartbeat from core client for 30 sec - exiting 23:41:20 (2169): No heartbeat from core client for 30 sec - exiting 23:41:21 (2169): No heartbeat from core client for 30 sec - exiting 23:41:22 (2169): No heartbeat from core client for 30 sec - exiting 23:41:23 (2169): No heartbeat from core client for 30 sec - exiting 23:41:24 (2169): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:43:37 (2272): No heartbeat from core client for 30 sec - exiting 23:44:14 (2272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 18:12:13 (1723): No heartbeat from core client for 30 sec - exiting 18:12:14 (1723): No heartbeat from core client for 30 sec - exiting 18:12:15 (1723): No heartbeat from core client for 30 sec - exiting 18:12:16 (1723): No heartbeat from core client for 30 sec - exiting 18:12:17 (1723): No heartbeat from core client for 30 sec - exiting 18:12:18 (1723): No heartbeat from core client for 30 sec - exiting 18:12:19 (1723): No heartbeat from core client for 30 sec - exiting 18:12:20 (1723): No heartbeat from core client for 30 sec - exiting 18:12:21 (1723): No heartbeat from core client for 30 sec - exiting 18:12:22 (1723): No heartbeat from core client for 30 sec - exiting 18:12:23 (1723): No heartbeat from core client for 30 sec - exiting 18:12:24 (1723): No heartbeat from core client for 30 sec - exiting 18:12:25 (1723): No heartbeat from core client for 30 sec - exiting 18:12:26 (1723): No heartbeat from core client for 30 sec - exiting 18:12:27 (1723): No heartbeat from core client for 30 sec - exiting 18:12:28 (1723): No heartbeat from core client for 30 sec - exiting 18:12:29 (1723): No heartbeat from core client for 30 sec - exiting 18:12:30 (1723): No heartbeat from core client for 30 sec - exiting 18:12:31 (1723): No heartbeat from core client for 30 sec - exiting 18:12:32 (1723): No heartbeat from core client for 30 sec - exiting 18:12:33 (1723): No heartbeat from core client for 30 sec - exiting 18:12:34 (1723): No heartbeat from core client for 30 sec - exiting 18:12:35 (1723): No heartbeat from core client for 30 sec - exiting 18:12:36 (1723): No heartbeat from core client for 30 sec - exiting 18:12:37 (1723): No heartbeat from core client for 30 sec - exiting 18:12:38 (1723): No heartbeat from core client for 30 sec - exiting 18:12:39 (1723): No heartbeat from core client for 30 sec - exiting 18:12:40 (1723): No heartbeat from core client for 30 sec - exiting 18:12:41 (1723): No heartbeat from core client for 30 sec - exiting 18:12:42 (1723): No heartbeat from core client for 30 sec - exiting 18:12:43 (1723): No heartbeat from core client for 30 sec - exiting 18:12:44 (1723): No heartbeat from core client for 30 sec - exiting 18:12:45 (1723): No heartbeat from core client for 30 sec - exiting 18:12:46 (1723): No heartbeat from core client for 30 sec - exiting 18:12:47 (1723): No heartbeat from core client for 30 sec - exiting 18:12:48 (1723): No heartbeat from core client for 30 sec - exiting 18:12:49 (1723): No heartbeat from core client for 30 sec - exiting 18:12:50 (1723): No heartbeat from core client for 30 sec - exiting 18:12:51 (1723): No heartbeat from core client for 30 sec - exiting 18:12:52 (1723): No heartbeat from core client for 30 sec - exiting 18:12:53 (1723): No heartbeat from core client for 30 sec - exiting 18:12:54 (1723): No heartbeat from core client for 30 sec - exiting 18:12:55 (1723): No heartbeat from core client for 30 sec - exiting 18:12:56 (1723): No heartbeat from core client for 30 sec - exiting 18:12:57 (1723): No heartbeat from core client for 30 sec - exiting 18:12:58 (1723): No heartbeat from core client for 30 sec - exiting 18:12:59 (1723): No heartbeat from core client for 30 sec - exiting 18:13:00 (1723): No heartbeat from core client for 30 sec - exiting 18:13:01 (1723): No heartbeat from core client for 30 sec - exiting 18:13:02 (1723): No heartbeat from core client for 30 sec - exiting 18:13:03 (1723): No heartbeat from core client for 30 sec - exiting 18:13:04 (1723): No heartbeat from core client for 30 sec - exiting 18:13:05 (1723): No heartbeat from core client for 30 sec - exiting 18:13:06 (1723): No heartbeat from core client for 30 sec - exiting 18:13:07 (1723): No heartbeat from core client for 30 sec - exiting 18:13:08 (1723): No heartbeat from core client for 30 sec - exiting 18:13:09 (1723): No heartbeat from core client for 30 sec - exiting 18:13:10 (1723): No heartbeat from core client for 30 sec - exiting 18:13:11 (1723): No heartbeat from core client for 30 sec - exiting 18:13:12 (1723): No heartbeat from core client for 30 sec - exiting 18:13:13 (1723): No heartbeat from core client for 30 sec - exiting 18:13:14 (1723): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:23:26 (28402): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 SETPOS: Seek Failed: No space left on device SETPOS: Unit 42 to Word Address 14213120 Failed with Error Code -1 Model crashed: SETPOS: Unit 42 to Word Address 14213120 Failed with Error Code -1 forrtl: No space left on device forrtl: severe (38): error during write, unit 6, file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_ygvo_1900_40_007516553/dataout/stdout_um.txt Image PC Routine Line Source hadcm3n_um_6.07_i 0848EB7D Unknown Unknown Unknown hadcm3n_um_6.07_i 0848D975 Unknown Unknown Unknown hadcm3n_um_6.07_i 0845F3CF Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F90D Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F257 Unknown Unknown Unknown hadcm3n_um_6.07_i 08451069 Unknown Unknown Unknown hadcm3n_um_6.07_i 0822DB4A Unknown Unknown Unknown hadcm3n_um_6.07_i 0818A767 Unknown Unknown Unknown hadcm3n_um_6.07_i 0818D749 Unknown Unknown Unknown hadcm3n_um_6.07_i 08391957 Unknown Unknown Unknown hadcm3n_um_6.07_i 0838F8B7 Unknown Unknown Unknown hadcm3n_um_6.07_i 0839BDF8 Unknown Unknown Unknown libc.so.6 F75BC0F3 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=28833, iMonCtr=1 Model crash detected, will try to restart... forrtl: No space left on device forrtl: severe (38): error during write, unit 6, file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_ygvo_1900_40_007516553/dataout/stdout_um.txt Image PC Routine Line Source hadcm3n_um_6.07_i 0848EB7D Unknown Unknown Unknown hadcm3n_um_6.07_i 0848D975 Unknown Unknown Unknown hadcm3n_um_6.07_i 0845F3CF Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F90D Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F257 Unknown Unknown Unknown hadcm3n_um_6.07_i 08450E2C Unknown Unknown Unknown hadcm3n_um_6.07_i 0844E937 Unknown Unknown Unknown hadcm3n_um_6.07_i 0822D868 Unknown Unknown Unknown hadcm3n_um_6.07_i 0818A767 Unknown Unknown Unknown hadcm3n_um_6.07_i 0818D749 Unknown Unknown Unknown hadcm3n_um_6.07_i 08391957 Unknown Unknown Unknown hadcm3n_um_6.07_i 0838F8B7 Unknown Unknown Unknown hadcm3n_um_6.07_i 0839BDF8 Unknown Unknown Unknown libc.so.6 F75E90F3 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=28833, iMonCtr=1 Model crash detected, will try to restart... forrtl: No space left on device forrtl: severe (38): error during write, unit 6, file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_ygvo_1900_40_007516553/dataout/stdout_um.txt Image PC Routine Line Source hadcm3n_um_6.07_i 0848EB7D Unknown Unknown Unknown hadcm3n_um_6.07_i 0848D975 Unknown Unknown Unknown hadcm3n_um_6.07_i 0845F3CF Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F90D Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F257 Unknown Unknown Unknown hadcm3n_um_6.07_i 08450E2C Unknown UnkCalled boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Dec 2011 10:22:14	1181044	13538783	hadcm3n_ygvo_1900_40_007516553_1	181,440	464,528	2.5602
05 Dec 2011 20:15:06	1181044	13538783	hadcm3n_ygvo_1900_40_007516553_1	155,520	397,575	2.5564
03 Dec 2011 21:01:41	1181044	13538783	hadcm3n_ygvo_1900_40_007516553_1	129,600	331,169	2.5553
01 Dec 2011 19:48:04	1181044	13538783	hadcm3n_ygvo_1900_40_007516553_1	103,680	264,807	2.5541
27 Nov 2011 19:30:31	1181044	13538783	hadcm3n_ygvo_1900_40_007516553_1	77,760	199,109	2.5606
25 Nov 2011 13:32:10	1181044	13538783	hadcm3n_ygvo_1900_40_007516553_1	51,840	132,692	2.5596
24 Nov 2011 07:16:11	1181044	13538783	hadcm3n_ygvo_1900_40_007516553_1	25,920	64,987	2.5072