climateprediction.net home page
Task 16330187

Task 16330187

Name hadcm3n_7m1g_1980_40_008439847_4
Workunit 8590703
Created 4 Mar 2014, 9:56:24 UTC
Sent 4 Mar 2014, 9:57:03 UTC
Report deadline 5 Sep 2023, 15:17:03 UTC
Received 14 Mar 2014, 12:39:00 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1282508
Run time 8 days 14 hours 46 min 5 sec
CPU time 7 days 23 hours 51 min 43 sec
Validate state Invalid
Credit 7,153.92
Device peak FLOPS 1.92 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>7.0.65</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
11:34:51 (4875): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
11:46:49 (13822): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:46:50 (13822): No heartbeat from core client for 30 sec - exiting
11:46:51 (13822): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
11:48:34 (14427): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
11:51:40 (14466): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
11:54:34 (14718): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
12:03:08 (14782): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:07:59 (15346): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
12:16:02 (15481): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
12:20:15 (15998): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:21:53 (16214): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:21:54 (16214): No heartbeat from core client for 30 sec - exiting
12:21:55 (16214): No heartbeat from core client for 30 sec - exiting
12:21:56 (16214): No heartbeat from core client for 30 sec - exiting
12:22:40 (16307): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:22:45 (16307): No heartbeat from core client for 30 sec - exiting
12:22:46 (16307): No heartbeat from core client for 30 sec - exiting
12:22:47 (16307): No heartbeat from core client for 30 sec - exiting
12:22:48 (16307): No heartbeat from core client for 30 sec - exiting
12:22:49 (16307): No heartbeat from core client for 30 sec - exiting
12:22:50 (16307): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
12:25:46 (16349): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:25:50 (16349): No heartbeat from core client for 30 sec - exiting
12:25:51 (16349): No heartbeat from core client for 30 sec - exiting
12:25:52 (16349): No heartbeat from core client for 30 sec - exiting
12:25:53 (16349): No heartbeat from core client for 30 sec - exiting
12:25:54 (16349): No heartbeat from core client for 30 sec - exiting
12:28:25 (16596): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:28:26 (16596): No heartbeat from core client for 30 sec - exiting
12:28:27 (16596): No heartbeat from core client for 30 sec - exiting
12:28:28 (16596): No heartbeat from core client for 30 sec - exiting
12:28:29 (16596): No heartbeat from core client for 30 sec - exiting
12:28:30 (16596): No heartbeat from core client for 30 sec - exiting
12:28:31 (16596): No heartbeat from core client for 30 sec - exiting
12:28:32 (16596): No heartbeat from core client for 30 sec - exiting
12:28:33 (16596): No heartbeat from core client for 30 sec - exiting
12:28:34 (16596): No heartbeat from core client for 30 sec - exiting
12:29:36 (16709): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:34:21 (16825): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
12:36:54 (17005): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:37:44 (17144): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:37:45 (17144): No heartbeat from core client for 30 sec - exiting
12:37:46 (17144): No heartbeat from core client for 30 sec - exiting
12:37:47 (17144): No heartbeat from core client for 30 sec - exiting
12:37:48 (17144): No heartbeat from core client for 30 sec - exiting
12:37:49 (17144): No heartbeat from core client for 30 sec - exiting
12:37:50 (17144): No heartbeat from core client for 30 sec - exiting
12:37:51 (17144): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
12:57:04 (17186): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:57:05 (17186): No heartbeat from core client for 30 sec - exiting
12:57:06 (17186): No heartbeat from core client for 30 sec - exiting
12:57:07 (17186): No heartbeat from core client for 30 sec - exiting
12:57:08 (17186): No heartbeat from core client for 30 sec - exiting
12:57:09 (17186): No heartbeat from core client for 30 sec - exiting
12:57:10 (17186): No heartbeat from core client for 30 sec - exiting
12:57:11 (17186): No heartbeat from core client for 30 sec - exiting
12:57:12 (17186): No heartbeat from core client for 30 sec - exiting
12:57:13 (17186): No heartbeat from core client for 30 sec - exiting
12:57:14 (17186): No heartbeat from core client for 30 sec - exiting
12:57:15 (17186): No heartbeat from core client for 30 sec - exiting
12:58:18 (18209): No heartbeat from core client for 30 sec - exiting
12:58:19 (18209): No heartbeat from core client for 30 sec - exiting
12:58:20 (18209): No heartbeat from core client for 30 sec - exiting
12:58:21 (18209): No heartbeat from core client for 30 sec - exiting
12:58:22 (18209): No heartbeat from core client for 30 sec - exiting
12:58:23 (18209): No heartbeat from core client for 30 sec - exiting
12:58:24 (18209): No heartbeat from core client for 30 sec - exiting
12:58:25 (18209): No heartbeat from core client for 30 sec - exiting
12:58:26 (18209): No heartbeat from core client for 30 sec - exiting
12:58:27 (18209): No heartbeat from core client for 30 sec - exiting
12:58:28 (18209): No heartbeat from core client for 30 sec - exiting
12:58:29 (18209): No heartbeat from core client for 30 sec - exiting
12:58:30 (18209): No heartbeat from core client for 30 sec - exiting
12:58:31 (18209): No heartbeat from core client for 30 sec - exiting
12:58:32 (18209): No heartbeat from core client for 30 sec - exiting
12:58:33 (18209): No heartbeat from core client for 30 sec - exiting
12:58:34 (18209): No heartbeat from core client for 30 sec - exiting
12:58:35 (18209): No heartbeat from core client for 30 sec - exiting
12:58:36 (18209): No heartbeat from core client for 30 sec - exiting
12:58:37 (18209): No heartbeat from core client for 30 sec - exiting
12:58:38 (18209): No heartbeat from core client for 30 sec - exiting
12:58:39 (18209): No heartbeat from core client for 30 sec - exiting
12:58:40 (18209): No heartbeat from core client for 30 sec - exiting
12:58:41 (18209): No heartbeat from core client for 30 sec - exiting
12:58:42 (18209): No heartbeat from core client for 30 sec - exiting
12:58:43 (18209): No heartbeat from core client for 30 sec - exiting
12:58:44 (18209): No heartbeat from core client for 30 sec - exiting
12:58:45 (18209): No heartbeat from core client for 30 sec - exiting
12:58:46 (18209): No heartbeat from core client for 30 sec - exiting
12:58:47 (18209): No heartbeat from core client for 30 sec - exiting
12:58:48 (18209): No heartbeat from core client for 30 sec - exiting
12:58:49 (18209): No heartbeat from core client for 30 sec - exiting
12:58:50 (18209): No heartbeat from core client for 30 sec - exiting
12:58:51 (18209): No heartbeat from core client for 30 sec - exiting
12:58:52 (18209): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:00:59 (18369): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
13:04:21 (18470): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:04:22 (18470): No heartbeat from core client for 30 sec - exiting
13:04:23 (18470): No heartbeat from core client for 30 sec - exiting
13:04:24 (18470): No heartbeat from core client for 30 sec - exiting
13:04:25 (18470): No heartbeat from core client for 30 sec - exiting
13:04:26 (18470): No heartbeat from core client for 30 sec - exiting
13:04:27 (18470): No heartbeat from core client for 30 sec - exiting
13:04:28 (18470): No heartbeat from core client for 30 sec - exiting
13:04:29 (18470): No heartbeat from core client for 30 sec - exiting
13:04:30 (18470): No heartbeat from core client for 30 sec - exiting
13:04:31 (18470): No heartbeat from core client for 30 sec - exiting
13:04:32 (18470): No heartbeat from core client for 30 sec - exiting
13:04:33 (18470): No heartbeat from core client for 30 sec - exiting
13:04:34 (18470): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 15 received, exiting...
Called boinc_finish
Signal 15 received, exiting...
Called boinc_finish
Signal 15 received, exiting...
Called boinc_finish
16:21:34 (3337): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Signal 15 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
Signal 15 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
Signal 15 received, exiting...
Called boinc_finish
Signal 15 received, exiting...
Called boinc_finish
10:16:43 (20574): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

SETPOS: Seek Failed: Invalid argument
SETPOS: Unit 69 to Word Address -198 Failed with Error Code -1

Model crashed: SETPOS: Unit 69 to Word Address -198 Failed with Error Code -1

SETPOS: Seek Failed: Invalid argument
SETPOS: Unit 69 to Word Address -198 Failed with Error Code -1

Model crashed: SETPOS: Unit 69 to Word Address -198 Failed with Error Code -1

SETPOS: Seek Failed: Invalid argument
SETPOS: Unit 69 to Word Address -198 Failed with Error Code -1

Model crashed: SETPOS: Unit 69 to Word Address -198 Failed with Error Code -1

SETPOS: Seek Failed: Invalid argument
SETPOS: Unit 69 to Word Address -198 Failed with Error Code -1

Model crashed: SETPOS: Unit 69 to Word Address -198 Failed with Error Code -1

SETPOS: Seek Failed: Invalid argument
SETPOS: Unit 69 to Word Address -198 Failed with Error Code -1

Model crashed: SETPOS: Unit 69 to Word Address -198 Failed with Error Code -1

SETPOS: Seek Failed: Invalid argument
SETPOS: Unit 69 to Word Address -198 Failed with Error Code -1

Model crashed: SETPOS: Unit 69 to Word Address -198 Failed with Error Code -1
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
14 Mar 2014 02:52:56 1282508 16330187 hadcm3n_7m1g_1980_40_008439847_4 596,160 669,151 1.1224
13 Mar 2014 18:10:01 1282508 16330187 hadcm3n_7m1g_1980_40_008439847_4 570,240 639,643 1.1217
13 Mar 2014 09:48:15 1282508 16330187 hadcm3n_7m1g_1980_40_008439847_4 544,320 610,009 1.1207
12 Mar 2014 23:30:56 1282508 16330187 hadcm3n_7m1g_1980_40_008439847_4 518,400 580,610 1.1200
12 Mar 2014 14:37:27 1282508 16330187 hadcm3n_7m1g_1980_40_008439847_4 492,480 551,505 1.1199
12 Mar 2014 05:52:07 1282508 16330187 hadcm3n_7m1g_1980_40_008439847_4 466,560 522,358 1.1196
11 Mar 2014 21:09:24 1282508 16330187 hadcm3n_7m1g_1980_40_008439847_4 440,640 493,245 1.1194
11 Mar 2014 13:06:11 1282508 16330187 hadcm3n_7m1g_1980_40_008439847_4 414,720 464,062 1.1190
11 Mar 2014 03:38:20 1282508 16330187 hadcm3n_7m1g_1980_40_008439847_4 388,800 434,791 1.1183
10 Mar 2014 18:55:17 1282508 16330187 hadcm3n_7m1g_1980_40_008439847_4 362,880 405,374 1.1171
10 Mar 2014 10:51:15 1282508 16330187 hadcm3n_7m1g_1980_40_008439847_4 336,960 376,166 1.1164
10 Mar 2014 01:12:57 1282508 16330187 hadcm3n_7m1g_1980_40_008439847_4 311,040 347,106 1.1160
09 Mar 2014 16:36:47 1282508 16330187 hadcm3n_7m1g_1980_40_008439847_4 285,120 318,028 1.1154
09 Mar 2014 08:05:44 1282508 16330187 hadcm3n_7m1g_1980_40_008439847_4 259,200 288,914 1.1146
08 Mar 2014 13:21:16 1282508 16330187 hadcm3n_7m1g_1980_40_008439847_4 233,280 260,295 1.1158
08 Mar 2014 04:58:45 1282508 16330187 hadcm3n_7m1g_1980_40_008439847_4 207,360 231,833 1.1180
07 Mar 2014 20:35:38 1282508 16330187 hadcm3n_7m1g_1980_40_008439847_4 181,440 202,980 1.1187
07 Mar 2014 12:09:06 1282508 16330187 hadcm3n_7m1g_1980_40_008439847_4 155,520 173,987 1.1187
06 Mar 2014 07:27:03 1282508 16330187 hadcm3n_7m1g_1980_40_008439847_4 129,600 149,632 1.1546
05 Mar 2014 23:04:27 1282508 16330187 hadcm3n_7m1g_1980_40_008439847_4 103,680 119,544 1.1530


©2024 climateprediction.net