climateprediction.net home page
Task 15560359

Task 15560359

Name hadcm3n_o3vh_2140_40_008269223_3
Workunit 8424347
Created 29 Jan 2013, 6:21:09 UTC
Sent 29 Jan 2013, 6:21:15 UTC
Report deadline 30 Apr 2013, 13:48:26 UTC
Received 18 Mar 2013, 10:02:36 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1265369
Run time 45 days 18 hours 10 min 59 sec
CPU time 6 days 13 hours 24 min 49 sec
Validate state Invalid
Credit 9,331.20
Device peak FLOPS 3.72 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
01:23:54 (9199): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:24:54 (11096): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:26:36 (11116): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:28:18 (11137): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:30:02 (11157): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:31:44 (11177): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:33:26 (11197): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:35:08 (11217): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:36:26 (11237): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:37:05 (11257): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:38:49 (11273): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:40:30 (11297): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:42:10 (11313): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:43:52 (11337): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:45:36 (11357): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:47:16 (11377): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:49:00 (11397): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:50:40 (11413): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	05:31:31 PM	No files match the supplied pattern.
MainError:	05:31:31 PM	No files match the supplied pattern.
MainError:	06:56:18 AM	No files match the supplied pattern.
MainError:	06:56:18 AM	No files match the supplied pattern.
MainError:	08:51:55 PM	No files match the supplied pattern.
MainError:	08:51:55 PM	No files match the supplied pattern.
MainError:	10:20:20 AM	No files match the supplied pattern.
MainError:	10:20:20 AM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	11:20:30 PM	No files match the supplied pattern.
MainError:	11:20:30 PM	No files match the supplied pattern.
MainError:	12:14:46 AM	No files match the supplied pattern.
MainError:	12:14:46 AM	No files match the supplied pattern.
MainError:	01:39:12 AM	No files match the supplied pattern.
MainError:	01:39:12 AM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	02:36:30 PM	No files match the supplied pattern.
MainError:	02:36:30 PM	No files match the supplied pattern.
MainError:	03:40:38 AM	No files match the supplied pattern.
MainError:	03:40:38 AM	No files match the supplied pattern.
MainError:	05:01:44 PM	No files match the supplied pattern.
MainError:	05:01:44 PM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: dataout/o3vhka.ph11c10
Error converting file to netcdf: dataout/o3vhka.pg11c10
Error converting file to netcdf: dataout/o3vhka.pe11c10
MainError:	06:45:46 AM	No files match the supplied pattern.
MainError:	06:45:46 AM	No files match the supplied pattern.

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: Numerical result out of range
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: Numerical result out of range
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: Numerical result out of range
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: Numerical result out of range
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: Numerical result out of range
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
18 Mar 2013 06:53:10 1265369 15560359 hadcm3n_o3vh_2140_40_008269223_3 777,600 1,009,159 1.2978
16 Mar 2013 17:06:08 1265369 15560359 hadcm3n_o3vh_2140_40_008269223_3 751,680 975,075 1.2972
15 Mar 2013 03:47:07 1265369 15560359 hadcm3n_o3vh_2140_40_008269223_3 725,760 941,192 1.2968
13 Mar 2013 14:40:22 1265369 15560359 hadcm3n_o3vh_2140_40_008269223_3 699,840 907,319 1.2965
12 Mar 2013 01:44:31 1265369 15560359 hadcm3n_o3vh_2140_40_008269223_3 673,920 873,549 1.2962
10 Mar 2013 12:22:23 1265369 15560359 hadcm3n_o3vh_2140_40_008269223_3 648,000 839,683 1.2958
08 Mar 2013 23:24:54 1265369 15560359 hadcm3n_o3vh_2140_40_008269223_3 622,080 805,891 1.2955
07 Mar 2013 10:26:24 1265369 15560359 hadcm3n_o3vh_2140_40_008269223_3 596,160 772,025 1.2950
05 Mar 2013 20:57:02 1265369 15560359 hadcm3n_o3vh_2140_40_008269223_3 570,240 738,109 1.2944
04 Mar 2013 07:03:00 1265369 15560359 hadcm3n_o3vh_2140_40_008269223_3 544,320 703,937 1.2932
02 Mar 2013 17:40:35 1265369 15560359 hadcm3n_o3vh_2140_40_008269223_3 518,400 669,972 1.2924
01 Mar 2013 05:31:42 1265369 15560359 hadcm3n_o3vh_2140_40_008269223_3 492,480 636,373 1.2922
27 Feb 2013 16:55:59 1265369 15560359 hadcm3n_o3vh_2140_40_008269223_3 466,560 602,627 1.2916
26 Feb 2013 04:13:50 1265369 15560359 hadcm3n_o3vh_2140_40_008269223_3 440,640 568,717 1.2907
24 Feb 2013 15:36:16 1265369 15560359 hadcm3n_o3vh_2140_40_008269223_3 414,720 534,999 1.2900
23 Feb 2013 02:40:49 1265369 15560359 hadcm3n_o3vh_2140_40_008269223_3 388,800 501,083 1.2888
21 Feb 2013 14:10:29 1265369 15560359 hadcm3n_o3vh_2140_40_008269223_3 362,880 467,365 1.2879
19 Feb 2013 20:08:10 1265369 15560359 hadcm3n_o3vh_2140_40_008269223_3 336,960 433,602 1.2868
17 Feb 2013 14:45:28 1265369 15560359 hadcm3n_o3vh_2140_40_008269223_3 311,040 399,542 1.2845
15 Feb 2013 23:52:00 1265369 15560359 hadcm3n_o3vh_2140_40_008269223_3 285,120 365,609 1.2823


©2024 climateprediction.net