climateprediction.net home page
Task 14099037

Task 14099037

Name hadcm3n_yi3q_1940_40_007752324_0
Workunit 7907433
Created 15 Feb 2012, 19:28:51 UTC
Sent 15 Feb 2012, 19:29:03 UTC
Report deadline 17 May 2012, 2:56:14 UTC
Received 8 Mar 2012, 0:31:41 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
Computer ID 901180
Run time 17 days 6 hours 19 min 30 sec
CPU time 17 days 6 hours 19 min 30 sec
Validate state Invalid
Credit 9,331.20
Device peak FLOPS 2.61 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr
<core_client_version>6.2.18</core_client_version>
<![CDATA[
<message>
too many exit(0)s
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
20:12:38 (5672): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
21:35:43 (3120): No heartbeat from core client for 30 sec - exiting
21:35:44 (3120): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
22:26:48 (7792): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:26:50 (7792): No heartbeat from core client for 30 sec - exiting
22:26:51 (7792): No heartbeat from core client for 30 sec - exiting
22:36:40 (6772): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:40:39 (6780): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:42:18 (9092): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
10:02:33 (8036): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
19:56:43 (6552): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
BUFFIN: C I/O Error feof - Unit 63 - Return code = 16
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 65 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
CPDN Monitor - Quit request from BOINC...
BUFFIN: C I/O Error feof - Unit 65 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
02:26:49 (3560): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
BUFFIN: C I/O Error feof - Unit 65 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 65 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 65 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 65 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 65 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 65 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
01:28:25 (8604): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:28:27 (8604): No heartbeat from core client for 30 sec - exiting
01:29:12 (8492): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
00:07:13 (7772): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:57:32 (8516): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:58:31 (9912): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:06:57 (3472): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:07:43 (8580): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:42:23 (9896): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
19:01:55 (10740): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
21:29:13 (4148): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:33:20 (10828): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
02:02:15 (9316): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
02:11:46 (4028): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:12:54 (10292): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:37:27 (11192): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:36:12 (10700): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:53:25 (11120): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
21:55:43 (10872): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
BUFFIN: C I/O Error feof - Unit 63 - Return code = 16
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 65 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
Error converting file to netcdf: dataout/yi3qko.pjf1c10
Error converting file to netcdf: dataout/yi3qko.pif1c10
Error converting file to netcdf: dataout/yi3qko.pff1c10
Error converting file to netcdf: dataout/yi3qka.phf1c10
Error converting file to netcdf: dataout/yi3qka.pgf1c10
Error converting file to netcdf: dataout/yi3qka.pef1c10
Error converting file to netcdf: dataout/yi3qka.pdf1c10
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
01:03:13 (11892): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:32:12 (11940): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
01:24:55 (13196): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
22:08:24 (12764): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
22:20:46 (12660): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
01:47:25 (6212): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
16:22:37 (1444): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
04:50:36 (3484): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:37:19 (8036): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
01:22:45 (7500): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:22:46 (7500): No heartbeat from core client for 30 sec - exiting
09:32:53 (7552): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
00:34:21 (8644): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:55:25 (3716): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:56:12 (2612): No heartbeat from core client for 30 sec - exiting
00:56:13 (2612): No heartbeat from core client for 30 sec - exiting
00:56:14 (2612): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
22:49:19 (1828): No heartbeat from core client for 30 sec - exiting
22:49:20 (1828): No heartbeat from core client for 30 sec - exiting
22:49:22 (1828): No heartbeat from core client for 30 sec - exiting
22:49:23 (1828): No heartbeat from core client for 30 sec - exiting
22:49:24 (1828): No heartbeat from core client for 30 sec - exiting
22:49:25 (1828): No heartbeat from core client for 30 sec - exiting
22:49:26 (1828): No heartbeat from core client for 30 sec - exiting
22:49:27 (1828): No heartbeat from core client for 30 sec - exiting
22:49:28 (1828): No heartbeat from core client for 30 sec - exiting
22:49:29 (1828): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x778B2AB1 read attempt to address 0x40BCD96E

Engaging BOINC Windows Runtime Debugger...

18:00:45 (8028): Can't acquire lockfile (32) - waiting 35s
18:01:20 (8028): Can't acquire lockfile (32) - exiting
18:01:20 (8028): Error: The process cannot access the file because it is being used by another process. (0x20)
18:01:20 (7076): Can't acquire lockfile (32) - waiting 35s
18:01:55 (7076): Can't acquire lockfile (32) - exiting
18:01:55 (7076): Error: The process cannot access the file because it is being used by another process. (0x20)
18:01:57 (4452): Can't acquire lockfile (32) - waiting 35s
18:02:32 (4452): Can't acquire lockfile (32) - exiting
18:02:32 (4452): Error: The process cannot access the file because it is being used by another process. (0x20)
18:02:33 (7832): Can't acquire lockfile (32) - waiting 35s
18:03:08 (7832): Can't acquire lockfile (32) - exiting
18:03:08 (7832): Error: The process cannot access the file because it is being used by another process. (0x20)
18:03:09 (7820): Can't acquire lockfile (32) - waiting 35s
18:03:44 (7820): Can't acquire lockfile (32) - exiting
18:03:44 (7820): Error: The process cannot access the file because it is being used by another process. (0x20)
18:03:45 (7996): Can't acquire lockfile (32) - waiting 35s
18:04:20 (7996): Can't acquire lockfile (32) - exiting
18:04:20 (7996): Error: The process cannot access the file because it is being used by another process. (0x20)
18:04:21 (2720): Can't acquire lockfile (32) - waiting 35s
18:04:56 (2720): Can't acquire lockfile (32) - exiting
18:04:56 (2720): Error: The process cannot access the file because it is being used by another process. (0x20)
18:04:57 (7376): Can't acquire lockfile (32) - waiting 35s
18:05:32 (7376): Can't acquire lockfile (32) - exiting
18:05:32 (7376): Error: The process cannot access the file because it is being used by another process. (0x20)
18:05:33 (8072): Can't acquire lockfile (32) - waiting 35s
18:06:08 (8072): Can't acquire lockfile (32) - exiting
18:06:08 (8072): Error: The process cannot access the file because it is being used by another process. (0x20)
18:06:09 (7776): Can't acquire lockfile (32) - waiting 35s
18:06:44 (7776): Can't acquire lockfile (32) - exiting
18:06:44 (7776): Error: The process cannot access the file because it is being used by another process. (0x20)
18:06:45 (7336): Can't acquire lockfile (32) - waiting 35s
18:07:20 (7336): Can't acquire lockfile (32) - exiting
18:07:20 (7336): Error: The process cannot access the file because it is being used by another process. (0x20)
18:07:21 (7040): Can't acquire lockfile (32) - waiting 35s
18:07:56 (7040): Can't acquire lockfile (32) - exiting
18:07:56 (7040): Error: The process cannot access the file because it is being used by another process. (0x20)
18:07:56 (7992): Can't acquire lockfile (32) - waiting 35s
18:08:31 (7992): Can't acquire lockfile (32) - exiting
18:08:31 (7992): Error: The process cannot access the file because it is being used by another process. (0x20)
18:08:31 (4828): Can't acquire lockfile (32) - waiting 35s
18:09:06 (4828): Can't acquire lockfile (32) - exiting
18:09:06 (4828): Error: The process cannot access the file because it is being used by another process. (0x20)
18:09:07 (7660): Can't acquire lockfile (32) - waiting 35s
18:09:42 (7660): Can't acquire lockfile (32) - exiting
18:09:42 (7660): Error: The process cannot access the file because it is being used by another process. (0x20)
18:09:43 (7916): Can't acquire lockfile (32) - waiting 35s
18:10:18 (7916): Can't acquire lockfile (32) - exiting
18:10:18 (7916): Error: The process cannot access the file because it is being used by another process. (0x20)
18:10:19 (7880): Can't acquire lockfile (32) - waiting 35s
18:10:54 (7880): Can't acquire lockfile (32) - exiting
18:10:54 (7880): Error: The process cannot access the file because it is being used by another process. (0x20)
18:10:56 (7284): Can't acquire lockfile (32) - waiting 35s
18:11:31 (7284): Can't acquire lockfile (32) - exiting
18:11:31 (7284): Error: The process cannot access the file because it is being used by another process. (0x20)
18:11:31 (5488): Can't acquire lockfile (32) - waiting 35s
18:12:06 (5488): Can't acquire lockfile (32) - exiting
18:12:06 (5488): Error: The process cannot access the file because it is being used by another process. (0x20)
18:12:07 (4936): Can't acquire lockfile (32) - waiting 35s
18:12:42 (4936): Can't acquire lockfile (32) - exiting
18:12:42 (4936): Error: The process cannot access the file because it is being used by another process. (0x20)
18:12:42 (8120): Can't acquire lockfile (32) - waiting 35s
18:13:17 (8120): Can't acquire lockfile (32) - exiting
18:13:17 (8120): Error: The process cannot access the file because it is being used by another process. (0x20)
18:13:18 (7716): Can't acquire lockfile (32) - waiting 35s
18:13:53 (7716): Can't acquire lockfile (32) - exiting
18:13:53 (7716): Error: The process cannot access the file because it is being used by another process. (0x20)
18:13:54 (2160): Can't acquire lockfile (32) - waiting 35s
18:14:29 (2160): Can't acquire lockfile (32) - exiting
18:14:29 (2160): Error: The process cannot access the file because it is being used by another process. (0x20)
18:14:30 (5032): Can't acquire lockfile (32) - waiting 35s
18:15:05 (5032): Can't acquire lockfile (32) - exiting
18:15:05 (5032): Error: The process cannot access the file because it is being used by another process. (0x20)
18:15:06 (7680): Can't acquire lockfile (32) - waiting 35s
18:15:41 (7680): Can't acquire lockfile (32) - exiting
18:15:41 (7680): Error: The process cannot access the file because it is being used by another process. (0x20)
18:15:42 (7244): Can't acquire lockfile (32) - waiting 35s
18:16:17 (7244): Can't acquire lockfile (32) - exiting
18:16:17 (7244): Error: The process cannot access the file because it is being used by another process. (0x20)
18:16:18 (7356): Can't acquire lockfile (32) - waiting 35s
18:16:53 (7356): Can't acquire lockfile (32) - exiting
18:16:53 (7356): Error: The process cannot access the file because it is being used by another process. (0x20)
18:16:54 (604): Can't acquire lockfile (32) - waiting 35s
18:17:29 (604): Can't acquire lockfile (32) - exiting
18:17:29 (604): Error: The process cannot access the file because it is being used by another process. (0x20)
18:17:30 (6384): Can't acquire lockfile (32) - waiting 35s
18:18:05 (6384): Can't acquire lockfile (32) - exiting
18:18:05 (6384): Error: The process cannot access the file because it is being used by another process. (0x20)
18:18:05 (4588): Can't acquire lockfile (32) - waiting 35s
18:18:40 (4588): Can't acquire lockfile (32) - exiting
18:18:40 (4588): Error: The process cannot access the file because it is being used by another process. (0x20)
18:18:41 (6996): Can't acquire lockfile (32) - waiting 35s
18:19:16 (6996): Can't acquire lockfile (32) - exiting
18:19:16 (6996): Error: The process cannot access the file because it is being used by another process. (0x20)
18:19:17 (6244): Can't acquire lockfile (32) - waiting 35s
18:19:52 (6244): Can't acquire lockfile (32) - exiting
18:19:52 (6244): Error: The process cannot access the file because it is being used by another process. (0x20)
18:19:54 (5688): Can't acquire lockfile (32) - waiting 35s
18:20:29 (5688): Can't acquire lockfile (32) - exiting
18:20:29 (5688): Error: The process cannot access the file because it is being used by another process. (0x20)
18:20:30 (6188): Can't acquire lockfile (32) - waiting 35s
18:21:05 (6188): Can't acquire lockfile (32) - exiting
18:21:05 (6188): Error: The process cannot access the file because it is being used by another process. (0x20)
18:21:05 (6644): Can't acquire lockfile (32) - waiting 35s
18:21:40 (6644): Can't acquire lockfile (32) - exiting
18:21:40 (6644): Error: The process cannot access the file because it is being used by another process. (0x20)
18:21:41 (5360): Can't acquire lockfile (32) - waiting 35s
18:22:16 (5360): Can't acquire lockfile (32) - exiting
18:22:16 (5360): Error: The process cannot access the file because it is being used by another process. (0x20)
18:22:17 (6836): Can't acquire lockfile (32) - waiting 35s
18:22:52 (6836): Can't acquire lockfile (32) - exiting
18:22:52 (6836): Error: The process cannot access the file because it is being used by another process. (0x20)
18:22:53 (7408): Can't acquire lockfile (32) - waiting 35s
18:23:28 (7408): Can't acquire lockfile (32) - exiting
18:23:28 (7408): Error: The process cannot access the file because it is being used by another process. (0x20)
18:23:29 (7204): Can't acquire lockfile (32) - waiting 35s
18:24:04 (7204): Can't acquire lockfile (32) - exiting
18:24:04 (7204): Error: The process cannot access the file because it is being used by another process. (0x20)
18:24:05 (5416): Can't acquire lockfile (32) - waiting 35s
18:24:40 (5416): Can't acquire lockfile (32) - exiting
18:24:40 (5416): Error: The process cannot access the file because it is being used by another process. (0x20)
18:24:41 (7816): Can't acquire lockfile (32) - waiting 35s
18:25:16 (7816): Can't acquire lockfile (32) - exiting
18:25:16 (7816): Error: The process cannot access the file because it is being used by another process. (0x20)
18:25:17 (8040): Can't acquire lockfile (32) - waiting 35s
18:25:52 (8040): Can't acquire lockfile (32) - exiting
18:25:52 (8040): Error: The process cannot access the file because it is being used by another process. (0x20)
18:25:53 (1068): Can't acquire lockfile (32) - waiting 35s
18:26:28 (1068): Can't acquire lockfile (32) - exiting
18:26:28 (1068): Error: The process cannot access the file because it is being used by another process. (0x20)
18:26:29 (1812): Can't acquire lockfile (32) - waiting 35s
18:27:04 (1812): Can't acquire lockfile (32) - exiting
18:27:04 (1812): Error: The process cannot access the file because it is being used by another process. (0x20)
18:27:04 (7548): Can't acquire lockfile (32) - waiting 35s
18:27:39 (7548): Can't acquire lockfile (32) - exiting
18:27:39 (7548): Error: The process cannot access the file because it is being used by another process. (0x20)
18:27:40 (3256): Can't acquire lockfile (32) - waiting 35s
18:28:15 (3256): Can't acquire lockfile (32) - exiting
18:28:15 (3256): Error: The process cannot access the file because it is being used by another process. (0x20)
18:28:17 (7900): Can't acquire lockfile (32) - waiting 35s
18:28:52 (7900): Can't acquire lockfile (32) - exiting
18:28:52 (7900): Error: The process cannot access the file because it is being used by another process. (0x20)
18:28:53 (7632): Can't acquire lockfile (32) - waiting 35s
18:29:28 (7632): Can't acquire lockfile (32) - exiting
18:29:28 (7632): Error: The process cannot access the file because it is being used by another process. (0x20)
18:29:28 (6336): Can't acquire lockfile (32) - waiting 35s
18:30:03 (6336): Can't acquire lockfile (32) - exiting
18:30:03 (6336): Error: The process cannot access the file because it is being used by another process. (0x20)
18:30:04 (8036): Can't acquire lockfile (32) - waiting 35s
18:30:39 (8036): Can't acquire lockfile (32) - exiting
18:30:39 (8036): Error: The process cannot access the file because it is being used by another process. (0x20)
18:30:39 (7368): Can't acquire lockfile (32) - waiting 35s
18:31:14 (7368): Can't acquire lockfile (32) - exiting
18:31:14 (7368): Error: The process cannot access the file because it is being used by another process. (0x20)
18:31:15 (3040): Can't acquire lockfile (32) - waiting 35s
18:31:50 (3040): Can't acquire lockfile (32) - exiting
18:31:50 (3040): Error: The process cannot access the file because it is being used by another process. (0x20)
18:31:51 (2988): Can't acquire lockfile (32) - waiting 35s
18:32:26 (2988): Can't acquire lockfile (32) - exiting
18:32:26 (2988): Error: The process cannot access the file because it is being used by another process. (0x20)
18:32:27 (7364): Can't acquire lockfile (32) - waiting 35s
18:33:02 (7364): Can't acquire lockfile (32) - exiting
18:33:02 (7364): Error: The process cannot access the file because it is being used by another process. (0x20)
18:33:03 (7520): Can't acquire lockfile (32) - waiting 35s
18:33:38 (7520): Can't acquire lockfile (32) - exiting
18:33:38 (7520): Error: The process cannot access the file because it is being used by another process. (0x20)
18:33:40 (7340): Can't acquire lockfile (32) - waiting 35s
18:34:15 (7340): Can't acquire lockfile (32) - exiting
18:34:15 (7340): Error: The process cannot access the file because it is being used by another process. (0x20)
18:34:16 (6172): Can't acquire lockfile (32) - waiting 35s
18:34:51 (6172): Can't acquire lockfile (32) - exiting
18:34:51 (6172): Error: The process cannot access the file because it is being used by another process. (0x20)
18:34:52 (2248): Can't acquire lockfile (32) - waiting 35s
18:35:27 (2248): Can't acquire lockfile (32) - exiting
18:35:27 (2248): Error: The process cannot access the file because it is being used by another process. (0x20)
18:35:27 (6904): Can't acquire lockfile (32) - waiting 35s
18:36:02 (6904): Can't acquire lockfile (32) - exiting
18:36:02 (6904): Error: The process cannot access the file because it is being used by another process. (0x20)
18:36:02 (4596): Can't acquire lockfile (32) - waiting 35s
18:36:37 (4596): Can't acquire lockfile (32) - exiting
18:36:37 (4596): Error: The process cannot access the file because it is being used by another process. (0x20)
18:36:38 (4680): Can't acquire lockfile (32) - waiting 35s
18:37:13 (4680): Can't acquire lockfile (32) - exiting
18:37:13 (4680): Error: The process cannot access the file because it is being used by another process. (0x20)
18:37:14 (7656): Can't acquire lockfile (32) - waiting 35s
18:37:49 (7656): Can't acquire lockfile (32) - exiting
18:37:49 (7656): Error: The process cannot access the file because it is being used by another process. (0x20)
18:37:50 (7792): Can't acquire lockfile (32) - waiting 35s
18:38:25 (7792): Can't acquire lockfile (32) - exiting
18:38:25 (7792): Error: The process cannot access the file because it is being used by another process. (0x20)
18:38:26 (7104): Can't acquire lockfile (32) - waiting 35s
18:39:01 (7104): Can't acquire lockfile (32) - exiting
18:39:01 (7104): Error: The process cannot access the file because it is being used by another process. (0x20)
18:39:02 (7588): Can't acquire lockfile (32) - waiting 35s
18:39:37 (7588): Can't acquire lockfile (32) - exiting
18:39:37 (7588): Error: The process cannot access the file because it is being used by another process. (0x20)
18:39:37 (7128): Can't acquire lockfile (32) - waiting 35s
18:40:12 (7128): Can't acquire lockfile (32) - exiting
18:40:12 (7128): Error: The process cannot access the file because it is being used by another process. (0x20)
18:40:13 (8100): Can't acquire lockfile (32) - waiting 35s
18:40:48 (8100): Can't acquire lockfile (32) - exiting
18:40:48 (8100): Error: The process cannot access the file because it is being used by another process. (0x20)
18:40:48 (7808): Can't acquire lockfile (32) - waiting 35s
18:41:23 (7808): Can't acquire lockfile (32) - exiting
18:41:23 (7808): Error: The process cannot access the file because it is being used by another process. (0x20)
18:41:23 (7876): Can't acquire lockfile (32) - waiting 35s
18:41:58 (7876): Can't acquire lockfile (32) - exiting
18:41:58 (7876): Error: The process cannot access the file because it is being used by another process. (0x20)
18:41:59 (7796): Can't acquire lockfile (32) - waiting 35s
18:42:34 (7796): Can't acquire lockfile (32) - exiting
18:42:34 (7796): Error: The process cannot access the file because it is being used by another process. (0x20)
18:42:35 (6324): Can't acquire lockfile (32) - waiting 35s
18:43:10 (6324): Can't acquire lockfile (32) - exiting
18:43:10 (6324): Error: The process cannot access the file because it is being used by another process. (0x20)
18:43:11 (2012): Can't acquire lockfile (32) - waiting 35s
18:43:46 (2012): Can't acquire lockfile (32) - exiting
18:43:46 (2012): Error: The process cannot access the file because it is being used by another process. (0x20)
18:43:47 (7176): Can't acquire lockfile (32) - waiting 35s
18:44:22 (7176): Can't acquire lockfile (32) - exiting
18:44:22 (7176): Error: The process cannot access the file because it is being used by another process. (0x20)
18:44:23 (1936): Can't acquire lockfile (32) - waiting 35s
18:44:58 (1936): Can't acquire lockfile (32) - exiting
18:44:58 (1936): Error: The process cannot access the file because it is being used by another process. (0x20)
18:44:59 (7888): Can't acquire lockfile (32) - waiting 35s
18:45:34 (7888): Can't acquire lockfile (32) - exiting
18:45:34 (7888): Error: The process cannot access the file because it is being used by another process. (0x20)
18:45:35 (7440): Can't acquire lockfile (32) - waiting 35s
18:46:10 (7440): Can't acquire lockfile (32) - exiting
18:46:10 (7440): Error: The process cannot access the file because it is being used by another process. (0x20)
18:46:12 (8096): Can't acquire lockfile (32) - waiting 35s
18:46:47 (8096): Can't acquire lockfile (32) - exiting
18:46:47 (8096): Error: The process cannot access the file because it is being used by another process. (0x20)
18:46:47 (7560): Can't acquire lockfile (32) - waiting 35s
18:47:22 (7560): Can't acquire lockfile (32) - exiting
18:47:22 (7560): Error: The process cannot access the file because it is being used by another process. (0x20)
18:47:23 (5672): Can't acquire lockfile (32) - waiting 35s
18:47:58 (5672): Can't acquire lockfile (32) - exiting
18:47:58 (5672): Error: The process cannot access the file because it is being used by another process. (0x20)
18:47:59 (7412): Can't acquire lockfile (32) - waiting 35s
18:48:34 (7412): Can't acquire lockfile (32) - exiting
18:48:34 (7412): Error: The process cannot access the file because it is being used by another process. (0x20)
18:48:34 (4836): Can't acquire lockfile (32) - waiting 35s
18:49:09 (4836): Can't acquire lockfile (32) - exiting
18:49:09 (4836): Error: The process cannot access the file because it is being used by another process. (0x20)
18:49:10 (8056): Can't acquire lockfile (32) - waiting 35s
18:49:45 (8056): Can't acquire lockfile (32) - exiting
18:49:45 (8056): Error: The process cannot access the file because it is being used by another process. (0x20)
18:49:46 (7488): Can't acquire lockfile (32) - waiting 35s
18:50:21 (7488): Can't acquire lockfile (32) - exiting
18:50:21 (7488): Error: The process cannot access the file because it is being used by another process. (0x20)
18:50:22 (3964): Can't acquire lockfile (32) - waiting 35s
18:50:57 (3964): Can't acquire lockfile (32) - exiting
18:50:57 (3964): Error: The process cannot access the file because it is being used by another process. (0x20)
18:50:57 (7212): Can't acquire lockfile (32) - waiting 35s
18:51:32 (7212): Can't acquire lockfile (32) - exiting
18:51:32 (7212): Error: The process cannot access the file because it is being used by another process. (0x20)
18:51:35 (1184): Can't acquire lockfile (32) - waiting 35s
18:52:10 (1184): Can't acquire lockfile (32) - exiting
18:52:10 (1184): Error: The process cannot access the file because it is being used by another process. (0x20)
18:52:10 (6292): Can't acquire lockfile (32) - waiting 35s
18:52:45 (6292): Can't acquire lockfile (32) - exiting
18:52:45 (6292): Error: The process cannot access the file because it is being used by another process. (0x20)
18:52:46 (7316): Can't acquire lockfile (32) - waiting 35s
18:53:21 (7316): Can't acquire lockfile (32) - exiting
18:53:21 (7316): Error: The process cannot access the file because it is being used by another process. (0x20)
18:53:22 (7604): Can't acquire lockfile (32) - waiting 35s
18:53:57 (7604): Can't acquire lockfile (32) - exiting
18:53:57 (7604): Error: The process cannot access the file because it is being used by another process. (0x20)
18:53:58 (3340): Can't acquire lockfile (32) - waiting 35s
18:54:33 (3340): Can't acquire lockfile (32) - exiting
18:54:33 (3340): Error: The process cannot access the file because it is being used by another process. (0x20)
18:54:34 (7696): Can't acquire lockfile (32) - waiting 35s
18:55:09 (7696): Can't acquire lockfile (32) - exiting
18:55:09 (7696): Error: The process cannot access the file because it is being used by another process. (0x20)
18:55:10 (5516): Can't acquire lockfile (32) - waiting 35s
18:55:45 (5516): Can't acquire lockfile (32) - exiting
18:55:45 (5516): Error: The process cannot access the file because it is being used by another process. (0x20)
18:55:46 (6508): Can't acquire lockfile (32) - waiting 35s
18:56:21 (6508): Can't acquire lockfile (32) - exiting
18:56:21 (6508): Error: The process cannot access the file because it is being used by another process. (0x20)
18:56:22 (6788): Can't acquire lockfile (32) - waiting 35s
18:56:57 (6788): Can't acquire lockfile (32) - exiting
18:56:57 (6788): Error: The process cannot access the file because it is being used by another process. (0x20)
18:56:58 (6540): Can't acquire lockfile (32) - waiting 35s
18:57:33 (6540): Can't acquire lockfile (32) - exiting
18:57:33 (6540): Error: The process cannot access the file because it is being used by another process. (0x20)
18:57:34 (8156): Can't acquire lockfile (32) - waiting 35s
18:58:09 (8156): Can't acquire lockfile (32) - exiting
18:58:09 (8156): Error: The process cannot access the file because it is being used by another process. (0x20)
18:58:10 (6380): Can't acquire lockfile (32) - waiting 35s
18:58:45 (6380): Can't acquire lockfile (32) - exiting
18:58:45 (6380): Error: The process cannot access the file because it is being used by another process. (0x20)
18:58:46 (6228): Can't acquire lockfile (32) - waiting 35s
18:59:21 (6228): Can't acquire lockfile (32) - exiting
18:59:21 (6228): Error: The process cannot access the file because it is being used by another process. (0x20)
18:59:22 (7272): Can't acquire lockfile (32) - waiting 35s
18:59:57 (7272): Can't acquire lockfile (32) - exiting
18:59:57 (7272): Error: The process cannot access the file because it is being used by another process. (0x20)
18:59:58 (5484): Can't acquire lockfile (32) - waiting 35s
19:00:33 (5484): Can't acquire lockfile (32) - exiting
19:00:33 (5484): Error: The process cannot access the file because it is being used by another process. (0x20)
19:00:34 (7908): Can't acquire lockfile (32) - waiting 35s
19:01:09 (7908): Can't acquire lockfile (32) - exiting
19:01:09 (7908): Error: The process cannot access the file because it is being used by another process. (0x20)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
07 Mar 2012 12:27:53 901180 14099037 hadcm3n_yi3q_1940_40_007752324_0 777,600 1,457,754 1.8747
07 Mar 2012 00:42:13 901180 14099037 hadcm3n_yi3q_1940_40_007752324_0 751,680 1,414,420 1.8817
06 Mar 2012 09:15:34 901180 14099037 hadcm3n_yi3q_1940_40_007752324_0 725,760 1,369,637 1.8872
05 Mar 2012 19:16:27 901180 14099037 hadcm3n_yi3q_1940_40_007752324_0 699,840 1,325,720 1.8943
05 Mar 2012 06:09:43 901180 14099037 hadcm3n_yi3q_1940_40_007752324_0 673,920 1,283,059 1.9039
04 Mar 2012 15:10:23 901180 14099037 hadcm3n_yi3q_1940_40_007752324_0 648,000 1,239,613 1.9130
04 Mar 2012 00:55:04 901180 14099037 hadcm3n_yi3q_1940_40_007752324_0 622,080 1,196,145 1.9228
03 Mar 2012 11:22:31 901180 14099037 hadcm3n_yi3q_1940_40_007752324_0 596,160 1,153,003 1.9340
02 Mar 2012 23:38:54 901180 14099037 hadcm3n_yi3q_1940_40_007752324_0 570,240 1,110,403 1.9473
02 Mar 2012 10:13:08 901180 14099037 hadcm3n_yi3q_1940_40_007752324_0 544,320 1,067,482 1.9611
01 Mar 2012 20:47:47 901180 14099037 hadcm3n_yi3q_1940_40_007752324_0 518,400 1,024,391 1.9761
01 Mar 2012 08:35:50 901180 14099037 hadcm3n_yi3q_1940_40_007752324_0 492,480 981,328 1.9926
29 Feb 2012 17:35:45 901180 14099037 hadcm3n_yi3q_1940_40_007752324_0 466,560 937,294 2.0089
29 Feb 2012 02:08:27 901180 14099037 hadcm3n_yi3q_1940_40_007752324_0 440,640 893,427 2.0276
28 Feb 2012 12:26:22 901180 14099037 hadcm3n_yi3q_1940_40_007752324_0 414,720 849,803 2.0491
27 Feb 2012 20:14:45 901180 14099037 hadcm3n_yi3q_1940_40_007752324_0 388,800 806,127 2.0734
27 Feb 2012 05:33:09 901180 14099037 hadcm3n_yi3q_1940_40_007752324_0 362,880 762,276 2.1006
26 Feb 2012 09:34:08 901180 14099037 hadcm3n_yi3q_1940_40_007752324_0 336,960 718,602 2.1326
25 Feb 2012 19:44:05 901180 14099037 hadcm3n_yi3q_1940_40_007752324_0 311,040 675,070 2.1704
25 Feb 2012 04:36:05 901180 14099037 hadcm3n_yi3q_1940_40_007752324_0 285,120 630,866 2.2126


©2024 climateprediction.net