climateprediction.net home page
Task 15544055

Task 15544055

Name hadcm3n_o2d1_2140_40_008282355_2
Workunit 8433490
Created 14 Jan 2013, 20:10:49 UTC
Sent 14 Jan 2013, 20:11:00 UTC
Report deadline 16 Apr 2013, 3:38:11 UTC
Received 29 Jan 2013, 18:21:18 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 971552
Run time 14 days 8 hours 39 min 58 sec
CPU time 7 days 15 hours 35 min 3 sec
Validate state Invalid
Credit 9,331.20
Device peak FLOPS 3.57 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-apple-darwin
Stderr
<core_client_version>7.0.31</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	09:22:52 AM	No files match the supplied pattern.
MainError:	09:22:52 AM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	08:47:17 PM	No files match the supplied pattern.
MainError:	08:47:17 PM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
22:38:57 (61764): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:39:00 (61764): No heartbeat from core client for 30 sec - exiting
22:39:01 (61764): No heartbeat from core client for 30 sec - exiting
22:39:02 (61764): No heartbeat from core client for 30 sec - exiting
22:39:03 (61764): No heartbeat from core client for 30 sec - exiting
22:39:04 (61764): No heartbeat from core client for 30 sec - exiting
22:39:05 (61764): No heartbeat from core client for 30 sec - exiting
22:39:06 (61764): No heartbeat from core client for 30 sec - exiting
22:39:07 (61764): No heartbeat from core client for 30 sec - exiting
22:39:08 (61764): No heartbeat from core client for 30 sec - exiting
22:39:09 (61764): No heartbeat from core client for 30 sec - exiting
22:39:10 (61764): No heartbeat from core client for 30 sec - exiting
22:39:11 (61764): No heartbeat from core client for 30 sec - exiting
22:39:12 (61764): No heartbeat from core client for 30 sec - exiting
22:39:13 (61764): No heartbeat from core client for 30 sec - exiting
22:39:14 (61764): No heartbeat from core client for 30 sec - exiting
22:39:15 (61764): No heartbeat from core client for 30 sec - exiting
22:39:16 (61764): No heartbeat from core client for 30 sec - exiting
22:39:17 (61764): No heartbeat from core client for 30 sec - exiting
22:39:18 (61764): No heartbeat from core client for 30 sec - exiting
22:39:19 (61764): No heartbeat from core client for 30 sec - exiting
22:39:20 (61764): No heartbeat from core client for 30 sec - exiting
22:39:22 (61764): No heartbeat from core client for 30 sec - exiting
22:39:23 (61764): No heartbeat from core client for 30 sec - exiting
22:39:24 (61764): No heartbeat from core client for 30 sec - exiting
22:39:25 (61764): No heartbeat from core client for 30 sec - exiting
22:39:26 (61764): No heartbeat from core client for 30 sec - exiting
22:39:27 (61764): No heartbeat from core client for 30 sec - exiting
22:39:28 (61764): No heartbeat from core client for 30 sec - exiting
22:39:29 (61764): No heartbeat from core client for 30 sec - exiting
22:39:30 (61764): No heartbeat from core client for 30 sec - exiting
22:39:31 (61764): No heartbeat from core client for 30 sec - exiting
22:39:32 (61764): No heartbeat from core client for 30 sec - exiting
22:39:33 (61764): No heartbeat from core client for 30 sec - exiting
22:39:34 (61764): No heartbeat from core client for 30 sec - exiting
22:39:35 (61764): No heartbeat from core client for 30 sec - exiting
22:39:36 (61764): No heartbeat from core client for 30 sec - exiting
22:39:37 (61764): No heartbeat from core client for 30 sec - exiting
22:39:38 (61764): No heartbeat from core client for 30 sec - exiting
22:39:39 (61764): No heartbeat from core client for 30 sec - exiting
22:39:40 (61764): No heartbeat from core client for 30 sec - exiting
22:39:41 (61764): No heartbeat from core client for 30 sec - exiting
22:39:42 (61764): No heartbeat from core client for 30 sec - exiting
22:39:43 (61764): No heartbeat from core client for 30 sec - exiting
22:39:44 (61764): No heartbeat from core client for 30 sec - exiting
22:39:45 (61764): No heartbeat from core client for 30 sec - exiting
22:39:46 (61764): No heartbeat from core client for 30 sec - exiting
22:39:47 (61764): No heartbeat from core client for 30 sec - exiting
22:39:48 (61764): No heartbeat from core client for 30 sec - exiting
22:39:49 (61764): No heartbeat from core client for 30 sec - exiting
22:39:50 (61764): No heartbeat from core client for 30 sec - exiting
22:39:51 (61764): No heartbeat from core client for 30 sec - exiting
22:39:52 (61764): No heartbeat from core client for 30 sec - exiting
22:39:53 (61764): No heartbeat from core client for 30 sec - exiting
22:39:54 (61764): No heartbeat from core client for 30 sec - exiting
22:39:55 (61764): No heartbeat from core client for 30 sec - exiting
22:39:56 (61764): No heartbeat from core client for 30 sec - exiting
22:39:57 (61764): No heartbeat from core client for 30 sec - exiting
22:39:58 (61764): No heartbeat from core client for 30 sec - exiting
22:39:59 (61764): No heartbeat from core client for 30 sec - exiting
22:40:00 (61764): No heartbeat from core client for 30 sec - exiting
22:40:01 (61764): No heartbeat from core client for 30 sec - exiting
22:40:03 (61764): No heartbeat from core client for 30 sec - exiting
22:40:04 (61764): No heartbeat from core client for 30 sec - exiting
22:40:05 (61764): No heartbeat from core client for 30 sec - exiting
22:40:06 (61764): No heartbeat from core client for 30 sec - exiting
22:40:07 (61764): No heartbeat from core client for 30 sec - exiting
22:40:08 (61764): No heartbeat from core client for 30 sec - exiting
22:40:09 (61764): No heartbeat from core client for 30 sec - exiting
22:40:10 (61764): No heartbeat from core client for 30 sec - exiting
MainError:	09:14:00 AM	No files match the supplied pattern.
MainError:	09:14:00 AM	No files match the supplied pattern.
MainError:	05:56:01 PM	No files match the supplied pattern.
MainError:	05:56:01 PM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	04:20:53 AM	No files match the supplied pattern.
MainError:	04:20:53 AM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	05:02:32 PM	No files match the supplied pattern.
MainError:	05:02:32 PM	No files match the supplied pattern.
MainError:	05:26:24 AM	No files match the supplied pattern.
MainError:	05:26:24 AM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	07:04:46 PM	No files match the supplied pattern.
MainError:	07:04:46 PM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	10:11:27 AM	No files match the supplied pattern.
MainError:	10:11:27 AM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	02:32:50 AM	No files match the supplied pattern.
MainError:	02:32:50 AM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: dataout/o2d1ka.ph11c10
Error converting file to netcdf: dataout/o2d1ka.pg11c10
Error converting file to netcdf: dataout/o2d1ka.pe11c10
MainError:	05:08:26 PM	No files match the supplied pattern.
MainError:	05:08:26 PM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: Result too large
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: Result too large
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: Result too large
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: Result too large
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: Result too large
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
29 Jan 2013 17:10:50 971552 15544055 hadcm3n_o2d1_2140_40_008282355_2 777,600 907,310 1.1668
29 Jan 2013 02:33:32 971552 15544055 hadcm3n_o2d1_2140_40_008282355_2 751,680 877,142 1.1669
28 Jan 2013 10:14:45 971552 15544055 hadcm3n_o2d1_2140_40_008282355_2 725,760 846,679 1.1666
27 Jan 2013 19:08:20 971552 15544055 hadcm3n_o2d1_2140_40_008282355_2 699,840 816,173 1.1662
27 Jan 2013 05:30:27 971552 15544055 hadcm3n_o2d1_2140_40_008282355_2 673,920 785,876 1.1661
26 Jan 2013 17:05:54 971552 15544055 hadcm3n_o2d1_2140_40_008282355_2 648,000 754,751 1.1647
26 Jan 2013 04:24:14 971552 15544055 hadcm3n_o2d1_2140_40_008282355_2 622,080 724,903 1.1653
25 Jan 2013 17:56:19 971552 15544055 hadcm3n_o2d1_2140_40_008282355_2 596,160 695,320 1.1663
25 Jan 2013 09:15:24 971552 15544055 hadcm3n_o2d1_2140_40_008282355_2 570,240 666,265 1.1684
24 Jan 2013 21:47:48 971552 15544055 hadcm3n_o2d1_2140_40_008282355_2 544,320 636,128 1.1687
24 Jan 2013 09:26:15 971552 15544055 hadcm3n_o2d1_2140_40_008282355_2 518,400 605,353 1.1677
23 Jan 2013 21:58:33 971552 15544055 hadcm3n_o2d1_2140_40_008282355_2 492,480 574,993 1.1675
23 Jan 2013 10:43:33 971552 15544055 hadcm3n_o2d1_2140_40_008282355_2 466,560 544,903 1.1679
22 Jan 2013 22:26:11 971552 15544055 hadcm3n_o2d1_2140_40_008282355_2 440,640 514,445 1.1675
22 Jan 2013 11:36:01 971552 15544055 hadcm3n_o2d1_2140_40_008282355_2 414,720 484,810 1.1690
22 Jan 2013 00:13:53 971552 15544055 hadcm3n_o2d1_2140_40_008282355_2 388,800 454,948 1.1701
21 Jan 2013 13:15:14 971552 15544055 hadcm3n_o2d1_2140_40_008282355_2 362,880 424,505 1.1698
21 Jan 2013 01:09:43 971552 15544055 hadcm3n_o2d1_2140_40_008282355_2 336,960 393,714 1.1684
20 Jan 2013 13:10:25 971552 15544055 hadcm3n_o2d1_2140_40_008282355_2 311,040 363,521 1.1687
20 Jan 2013 01:38:17 971552 15544055 hadcm3n_o2d1_2140_40_008282355_2 285,120 333,867 1.1710


©2024 climateprediction.net