climateprediction.net home page
Task 13018030

Task 13018030

Name hadcm3n_t5br_1940_40_007313170_0
Workunit 7510600
Created 28 Jun 2011, 6:22:07 UTC
Sent 28 Jun 2011, 6:24:40 UTC
Report deadline 27 Sep 2011, 13:51:51 UTC
Received 7 Sep 2011, 21:35:55 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 977046
Run time 14 days 23 hours 30 min 52 sec
CPU time 14 days 0 hours 59 min 50 sec
Validate state Invalid
Credit 3,110.40
Device peak FLOPS 2.11 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr
<core_client_version>6.6.28</core_client_version>
<![CDATA[
<message>
 - exit code 193 (0xc1)
</message>
<stderr_txt>
10:07:33 (5056): No heartbeat from core client for 30 sec - exiting
10:07:34 (5056): No heartbeat from core client for 30 sec - exiting
10:07:35 (5056): No heartbeat from core client for 30 sec - exiting
10:07:36 (5056): No heartbeat from core client for 30 sec - exiting
10:07:37 (5056): No heartbeat from core client for 30 sec - exiting
10:07:38 (5056): No heartbeat from core client for 30 sec - exiting
10:07:39 (5056): No heartbeat from core client for 30 sec - exiting
10:07:40 (5056): No heartbeat from core client for 30 sec - exiting
10:07:41 (5056): No heartbeat from core client for 30 sec - exiting
10:07:43 (5056): No heartbeat from core client for 30 sec - exiting
10:07:44 (5056): No heartbeat from core client for 30 sec - exiting
10:07:45 (5056): No heartbeat from core client for 30 sec - exiting
10:07:46 (5056): No heartbeat from core client for 30 sec - exiting
10:07:47 (5056): No heartbeat from core client for 30 sec - exiting
10:07:48 (5056): No heartbeat from core client for 30 sec - exiting
10:07:49 (5056): No heartbeat from core client for 30 sec - exiting
10:07:50 (5056): No heartbeat from core client for 30 sec - exiting
10:07:51 (5056): No heartbeat from core client for 30 sec - exiting
10:07:52 (5056): No heartbeat from core client for 30 sec - exiting
10:07:53 (5056): No heartbeat from core client for 30 sec - exiting
10:07:55 (5056): No heartbeat from core client for 30 sec - exiting
10:07:56 (5056): No heartbeat from core client for 30 sec - exiting
10:07:57 (5056): No heartbeat from core client for 30 sec - exiting
10:07:58 (5056): No heartbeat from core client for 30 sec - exiting
10:07:59 (5056): No heartbeat from core client for 30 sec - exiting
10:08:00 (5056): No heartbeat from core client for 30 sec - exiting
10:08:01 (5056): No heartbeat from core client for 30 sec - exiting
10:08:02 (5056): No heartbeat from core client for 30 sec - exiting
10:08:03 (5056): No heartbeat from core client for 30 sec - exiting
10:08:04 (5056): No heartbeat from core client for 30 sec - exiting
10:08:05 (5056): No heartbeat from core client for 30 sec - exiting
10:08:07 (5056): No heartbeat from core client for 30 sec - exiting
10:08:08 (5056): No heartbeat from core client for 30 sec - exiting
10:08:09 (5056): No heartbeat from core client for 30 sec - exiting
10:08:10 (5056): No heartbeat from core client for 30 sec - exiting
10:08:11 (5056): No heartbeat from core client for 30 sec - exiting
10:08:12 (5056): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:08:13 (5056): No heartbeat from core client for 30 sec - exiting
10:08:14 (5056): No heartbeat from core client for 30 sec - exiting
10:08:15 (5056): No heartbeat from core client for 30 sec - exiting
10:08:16 (5056): No heartbeat from core client for 30 sec - exiting
10:08:17 (5056): No heartbeat from core client for 30 sec - exiting
10:08:18 (5056): No heartbeat from core client for 30 sec - exiting
10:08:20 (5056): No heartbeat from core client for 30 sec - exiting
10:08:21 (5056): No heartbeat from core client for 30 sec - exiting
10:08:22 (5056): No heartbeat from core client for 30 sec - exiting
10:08:23 (5056): No heartbeat from core client for 30 sec - exiting
10:08:24 (5056): No heartbeat from core client for 30 sec - exiting
08:51:27 (5380): No heartbeat from core client for 30 sec - exiting
08:51:28 (5380): No heartbeat from core client for 30 sec - exiting
08:51:29 (5380): No heartbeat from core client for 30 sec - exiting
08:51:30 (5380): No heartbeat from core client for 30 sec - exiting
08:51:31 (5380): No heartbeat from core client for 30 sec - exiting
08:51:32 (5380): No heartbeat from core client for 30 sec - exiting
08:51:33 (5380): No heartbeat from core client for 30 sec - exiting
08:51:34 (5380): No heartbeat from core client for 30 sec - exiting
08:51:36 (5380): No heartbeat from core client for 30 sec - exiting
08:51:37 (5380): No heartbeat from core client for 30 sec - exiting
08:51:38 (5380): No heartbeat from core client for 30 sec - exiting
08:51:39 (5380): No heartbeat from core client for 30 sec - exiting
08:51:40 (5380): No heartbeat from core client for 30 sec - exiting
08:51:41 (5380): No heartbeat from core client for 30 sec - exiting
08:51:42 (5380): No heartbeat from core client for 30 sec - exiting
08:51:43 (5380): No heartbeat from core client for 30 sec - exiting
08:51:44 (5380): No heartbeat from core client for 30 sec - exiting
08:51:45 (5380): No heartbeat from core client for 30 sec - exiting
08:51:46 (5380): No heartbeat from core client for 30 sec - exiting
08:51:47 (5380): No heartbeat from core client for 30 sec - exiting
08:51:49 (5380): No heartbeat from core client for 30 sec - exiting
08:51:50 (5380): No heartbeat from core client for 30 sec - exiting
08:51:51 (5380): No heartbeat from core client for 30 sec - exiting
08:51:52 (5380): No heartbeat from core client for 30 sec - exiting
08:51:53 (5380): No heartbeat from core client for 30 sec - exiting
08:51:54 (5380): No heartbeat from core client for 30 sec - exiting
08:51:55 (5380): No heartbeat from core client for 30 sec - exiting
08:51:56 (5380): No heartbeat from core client for 30 sec - exiting
08:51:57 (5380): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:52:59 (6124): No heartbeat from core client for 30 sec - exiting
08:53:00 (6124): No heartbeat from core client for 30 sec - exiting
08:53:01 (6124): No heartbeat from core client for 30 sec - exiting
08:53:02 (6124): No heartbeat from core client for 30 sec - exiting
08:53:03 (6124): No heartbeat from core client for 30 sec - exiting
08:53:05 (6124): No heartbeat from core client for 30 sec - exiting
08:53:06 (6124): No heartbeat from core client for 30 sec - exiting
08:53:07 (6124): No heartbeat from core client for 30 sec - exiting
08:53:08 (6124): No heartbeat from core client for 30 sec - exiting
08:53:09 (6124): No heartbeat from core client for 30 sec - exiting
08:53:10 (6124): No heartbeat from core client for 30 sec - exiting
08:53:11 (6124): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:53:12 (6124): No heartbeat from core client for 30 sec - exiting
10:19:25 (6140): No heartbeat from core client for 30 sec - exiting
10:19:26 (6140): No heartbeat from core client for 30 sec - exiting
10:19:27 (6140): No heartbeat from core client for 30 sec - exiting
10:19:29 (6140): No heartbeat from core client for 30 sec - exiting
10:19:30 (6140): No heartbeat from core client for 30 sec - exiting
10:19:31 (6140): No heartbeat from core client for 30 sec - exiting
10:19:32 (6140): No heartbeat from core client for 30 sec - exiting
10:19:33 (6140): No heartbeat from core client for 30 sec - exiting
10:19:34 (6140): No heartbeat from core client for 30 sec - exiting
10:19:35 (6140): No heartbeat from core client for 30 sec - exiting
10:19:36 (6140): No heartbeat from core client for 30 sec - exiting
10:19:37 (6140): No heartbeat from core client for 30 sec - exiting
10:19:38 (6140): No heartbeat from core client for 30 sec - exiting
10:19:40 (6140): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:00:50 (4056): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5948, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1036, iMonCtr=1
Model crash detected, will try to restart...
BUFFIN: C I/O Error feof - Unit 63 - Return code = 16
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 65 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
Error converting file to netcdf: dataout/t5brko.pje9c10
Error converting file to netcdf: dataout/t5brko.pie9c10
Error converting file to netcdf: dataout/t5brko.pfe9c10
Error converting file to netcdf: dataout/t5brka.phe9c10
Error converting file to netcdf: dataout/t5brka.pge9c10
Error converting file to netcdf: dataout/t5brka.pee9c10
Error converting file to netcdf: dataout/t5brka.pde9c10
10:05:19 (5872): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:08:29 (5520): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3148, iMonCtr=1
Model crash detected, will try to restart...
15:10:05 (5176): No heartbeat from core client for 30 sec - exiting
15:10:07 (5176): No heartbeat from core client for 30 sec - exiting
15:10:08 (5176): No heartbeat from core client for 30 sec - exiting
15:10:09 (5176): No heartbeat from core client for 30 sec - exiting
15:10:10 (5176): No heartbeat from core client for 30 sec - exiting
15:10:11 (5176): No heartbeat from core client for 30 sec - exiting
15:10:12 (5176): No heartbeat from core client for 30 sec - exiting
15:10:13 (5176): No heartbeat from core client for 30 sec - exiting
15:10:14 (5176): No heartbeat from core client for 30 sec - exiting
15:10:15 (5176): No heartbeat from core client for 30 sec - exiting
15:10:16 (5176): No heartbeat from core client for 30 sec - exiting
15:10:17 (5176): No heartbeat from core client for 30 sec - exiting
15:10:18 (5176): No heartbeat from core client for 30 sec - exiting
15:10:20 (5176): No heartbeat from core client for 30 sec - exiting
15:10:21 (5176): No heartbeat from core client for 30 sec - exiting
15:10:22 (5176): No heartbeat from core client for 30 sec - exiting
15:10:23 (5176): No heartbeat from core client for 30 sec - exiting
15:10:24 (5176): No heartbeat from core client for 30 sec - exiting
15:10:25 (5176): No heartbeat from core client for 30 sec - exiting
15:10:26 (5176): No heartbeat from core client for 30 sec - exiting
15:10:27 (5176): No heartbeat from core client for 30 sec - exiting
15:10:29 (5176): No heartbeat from core client for 30 sec - exiting
15:10:30 (5176): No heartbeat from core client for 30 sec - exiting
15:10:31 (5176): No heartbeat from core client for 30 sec - exiting
15:10:32 (5176): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:17:35 (4512): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Called boinc_finish
08:55:11 (5400): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
11:44:09 (4996): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:49:57 (5576): No heartbeat from core client for 30 sec - exiting
12:49:58 (5576): No heartbeat from core client for 30 sec - exiting
12:49:59 (5576): No heartbeat from core client for 30 sec - exiting
12:50:00 (5576): No heartbeat from core client for 30 sec - exiting
12:50:01 (5576): No heartbeat from core client for 30 sec - exiting
12:50:02 (5576): No heartbeat from core client for 30 sec - exiting
12:50:03 (5576): No heartbeat from core client for 30 sec - exiting
12:50:04 (5576): No heartbeat from core client for 30 sec - exiting
12:50:05 (5576): No heartbeat from core client for 30 sec - exiting
12:50:07 (5576): No heartbeat from core client for 30 sec - exiting
12:50:08 (5576): No heartbeat from core client for 30 sec - exiting
12:50:09 (5576): No heartbeat from core client for 30 sec - exiting
12:50:10 (5576): No heartbeat from core client for 30 sec - exiting
12:50:11 (5576): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:51:16 (5944): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:48:43 (5304): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:50:21 (5872): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:52:00 (5980): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5384, iMonCtr=1
Model crash detected, will try to restart...
15:05:34 (4148): No heartbeat from core client for 30 sec - exiting
15:05:35 (4148): No heartbeat from core client for 30 sec - exiting
15:05:36 (4148): No heartbeat from core client for 30 sec - exiting
15:05:38 (4148): No heartbeat from core client for 30 sec - exiting
15:05:39 (4148): No heartbeat from core client for 30 sec - exiting
15:05:40 (4148): No heartbeat from core client for 30 sec - exiting
15:05:41 (4148): No heartbeat from core client for 30 sec - exiting
15:05:42 (4148): No heartbeat from core client for 30 sec - exiting
15:05:43 (4148): No heartbeat from core client for 30 sec - exiting
15:05:44 (4148): No heartbeat from core client for 30 sec - exiting
15:05:45 (4148): No heartbeat from core client for 30 sec - exiting
15:05:46 (4148): No heartbeat from core client for 30 sec - exiting
15:05:47 (4148): No heartbeat from core client for 30 sec - exiting
15:05:49 (4148): No heartbeat from core client for 30 sec - exiting
15:05:50 (4148): No heartbeat from core client for 30 sec - exiting
15:05:51 (4148): No heartbeat from core client for 30 sec - exiting
15:05:52 (4148): No heartbeat from core client for 30 sec - exiting
15:05:53 (4148): No heartbeat from core client for 30 sec - exiting
15:05:54 (4148): No heartbeat from core client for 30 sec - exiting
15:05:55 (4148): No heartbeat from core client for 30 sec - exiting
15:05:56 (4148): No heartbeat from core client for 30 sec - exiting
15:05:57 (4148): No heartbeat from core client for 30 sec - exiting
15:05:58 (4148): No heartbeat from core client for 30 sec - exiting
15:05:59 (4148): No heartbeat from core client for 30 sec - exiting
15:06:01 (4148): No heartbeat from core client for 30 sec - exiting
15:06:02 (4148): No heartbeat from core client for 30 sec - exiting
15:06:03 (4148): No heartbeat from core client for 30 sec - exiting
15:06:04 (4148): No heartbeat from core client for 30 sec - exiting
15:06:05 (4148): No heartbeat from core client for 30 sec - exiting
15:06:06 (4148): No heartbeat from core client for 30 sec - exiting
15:06:07 (4148): No heartbeat from core client for 30 sec - exiting
15:06:08 (4148): No heartbeat from core client for 30 sec - exiting
15:06:09 (4148): No heartbeat from core client for 30 sec - exiting
15:06:10 (4148): No heartbeat from core client for 30 sec - exiting
15:06:11 (4148): No heartbeat from core client for 30 sec - exiting
15:06:13 (4148): No heartbeat from core client for 30 sec - exiting
15:06:14 (4148): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:06:15 (4148): No heartbeat from core client for 30 sec - exiting
15:06:16 (4148): No heartbeat from core client for 30 sec - exiting
15:06:17 (4148): No heartbeat from core client for 30 sec - exiting
15:06:18 (4148): No heartbeat from core client for 30 sec - exiting
15:06:19 (4148): No heartbeat from core client for 30 sec - exiting
15:06:20 (4148): No heartbeat from core client for 30 sec - exiting
15:06:21 (4148): No heartbeat from core client for 30 sec - exiting
15:06:22 (4148): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x779B6E0F read attempt to address 0x40CF7487

Engaging BOINC Windows Runtime Debugger...

Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_t5br_1940_40_007313170/dataout/shmem_restart.day
Signal 11 received, exiting...
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
26 Jul 2011 22:56:14 977046 13018030 hadcm3n_t5br_1940_40_007313170_0 259,200 599,706 2.3137
25 Jul 2011 18:08:06 977046 13018030 hadcm3n_t5br_1940_40_007313170_0 233,280 539,335 2.3120
25 Jul 2011 17:27:53 977046 13018030 hadcm3n_t5br_1940_40_007313170_0 207,360 479,625 2.3130
25 Jul 2011 17:27:53 977046 13018030 hadcm3n_t5br_1940_40_007313170_0 181,440 419,559 2.3124
25 Jul 2011 17:27:53 977046 13018030 hadcm3n_t5br_1940_40_007313170_0 155,520 359,039 2.3086
08 Jul 2011 22:30:29 977046 13018030 hadcm3n_t5br_1940_40_007313170_0 129,600 298,939 2.3066
07 Jul 2011 15:43:49 977046 13018030 hadcm3n_t5br_1940_40_007313170_0 103,680 238,348 2.2989
07 Jul 2011 15:43:49 977046 13018030 hadcm3n_t5br_1940_40_007313170_0 77,760 178,409 2.2944
29 Jun 2011 22:15:31 977046 13018030 hadcm3n_t5br_1940_40_007313170_0 51,840 119,142 2.2983
28 Jun 2011 23:33:59 977046 13018030 hadcm3n_t5br_1940_40_007313170_0 25,920 59,595 2.2992


©2024 climateprediction.net