climateprediction.net home page
Task 15580697

Task 15580697

Name hadcm3n_o0uj_2140_40_008269647_2
Workunit 8424771
Created 2 Feb 2013, 17:59:01 UTC
Sent 2 Feb 2013, 17:59:20 UTC
Report deadline 5 May 2013, 1:26:31 UTC
Received 21 Feb 2013, 0:27:17 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1260007
Run time 18 days 2 hours 13 min 15 sec
CPU time 11 days 3 hours 13 min 6 sec
Validate state Invalid
Credit 9,331.20
Device peak FLOPS 2.53 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr
<core_client_version>7.0.28</core_client_version>
<![CDATA[
<message>
The device does not recognize the command. (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
00:58:40 (6648): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
05:10:14 (5316): No heartbeat from core client for 30 sec - exiting
05:10:15 (5316): No heartbeat from core client for 30 sec - exiting
05:10:16 (5316): No heartbeat from core client for 30 sec - exiting
05:10:17 (5316): No heartbeat from core client for 30 sec - exiting
05:10:18 (5316): No heartbeat from core client for 30 sec - exiting
05:10:19 (5316): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	09:32:50 PM	No files match the supplied pattern.
MainError:	09:32:50 PM	No files match the supplied pattern.
MainError:	11:38:52 AM	No files match the supplied pattern.
MainError:	11:38:52 AM	No files match the supplied pattern.
MainError:	01:47:29 AM	No files match the supplied pattern.
MainError:	01:47:29 AM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	04:03:08 PM	No files match the supplied pattern.
MainError:	04:03:08 PM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	06:21:10 AM	No files match the supplied pattern.
MainError:	06:21:10 AM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	08:35:14 PM	No files match the supplied pattern.
MainError:	08:35:14 PM	No files match the supplied pattern.
MainError:	10:53:39 AM	No files match the supplied pattern.
MainError:	10:53:39 AM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	02:30:04 AM	No files match the supplied pattern.
MainError:	02:30:04 AM	No files match the supplied pattern.
MainError:	06:21:12 PM	No files match the supplied pattern.
MainError:	06:21:12 PM	No files match the supplied pattern.
MainError:	08:44:26 AM	No files match the supplied pattern.
MainError:	08:44:26 AM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: dataout/o0ujka.ph11c10
Error converting file to netcdf: dataout/o0ujka.pg11c10
Error converting file to netcdf: dataout/o0ujka.pe11c10
MainError:	11:04:35 PM	No files match the supplied pattern.
MainError:	11:04:35 PM	No files match the supplied pattern.
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
20 Feb 2013 23:07:27 1260007 15580697 hadcm3n_o0uj_2140_40_008269647_2 777,600 1,488,344 1.9140
20 Feb 2013 08:48:06 1260007 15580697 hadcm3n_o0uj_2140_40_008269647_2 751,680 1,438,698 1.9140
19 Feb 2013 18:25:05 1260007 15580697 hadcm3n_o0uj_2140_40_008269647_2 725,760 1,388,788 1.9136
19 Feb 2013 02:31:53 1260007 15580697 hadcm3n_o0uj_2140_40_008269647_2 699,840 1,338,425 1.9125
18 Feb 2013 10:53:47 1260007 15580697 hadcm3n_o0uj_2140_40_008269647_2 673,920 1,288,125 1.9114
17 Feb 2013 20:39:22 1260007 15580697 hadcm3n_o0uj_2140_40_008269647_2 648,000 1,238,653 1.9115
17 Feb 2013 06:21:30 1260007 15580697 hadcm3n_o0uj_2140_40_008269647_2 622,080 1,189,210 1.9117
16 Feb 2013 16:05:49 1260007 15580697 hadcm3n_o0uj_2140_40_008269647_2 596,160 1,139,712 1.9118
16 Feb 2013 01:47:29 1260007 15580697 hadcm3n_o0uj_2140_40_008269647_2 570,240 1,090,242 1.9119
15 Feb 2013 11:42:41 1260007 15580697 hadcm3n_o0uj_2140_40_008269647_2 544,320 1,040,597 1.9117
14 Feb 2013 21:34:12 1260007 15580697 hadcm3n_o0uj_2140_40_008269647_2 518,400 991,120 1.9119
14 Feb 2013 05:30:02 1260007 15580697 hadcm3n_o0uj_2140_40_008269647_2 492,480 941,627 1.9120
13 Feb 2013 14:45:30 1260007 15580697 hadcm3n_o0uj_2140_40_008269647_2 466,560 891,321 1.9104
12 Feb 2013 22:44:09 1260007 15580697 hadcm3n_o0uj_2140_40_008269647_2 440,640 841,803 1.9104
12 Feb 2013 08:34:34 1260007 15580697 hadcm3n_o0uj_2140_40_008269647_2 414,720 792,462 1.9108
11 Feb 2013 18:06:42 1260007 15580697 hadcm3n_o0uj_2140_40_008269647_2 388,800 742,689 1.9102
11 Feb 2013 03:30:05 1260007 15580697 hadcm3n_o0uj_2140_40_008269647_2 362,880 693,023 1.9098
10 Feb 2013 13:15:12 1260007 15580697 hadcm3n_o0uj_2140_40_008269647_2 336,960 643,547 1.9099
09 Feb 2013 22:54:28 1260007 15580697 hadcm3n_o0uj_2140_40_008269647_2 311,040 593,282 1.9074
09 Feb 2013 08:01:38 1260007 15580697 hadcm3n_o0uj_2140_40_008269647_2 285,120 542,887 1.9041


©2024 climateprediction.net