climateprediction.net home page
Task 15800463

Task 15800463

Name hadcm3n_o31x_2140_40_008268967_4
Workunit 8424091
Created 29 May 2013, 6:29:10 UTC
Sent 29 May 2013, 6:30:22 UTC
Report deadline 28 Aug 2013, 13:57:33 UTC
Received 18 Jul 2013, 11:43:57 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1287694
Run time 16 days 12 hours 14 min 48 sec
CPU time 15 days 3 hours 37 min 7 sec
Validate state Invalid
Credit 9,331.20
Device peak FLOPS 1.99 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr
<core_client_version>7.0.64</core_client_version>
<![CDATA[
<message>
The device does not recognize the command.
 (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5744, iMonCtr=1
Model crash detected, will try to restart...
03:38:31 (5492): No heartbeat from core client for 30 sec - exiting
03:38:32 (5492): No heartbeat from core client for 30 sec - exiting
03:38:33 (5492): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	03:38:24 AM	No files match the supplied pattern.
MainError:	03:38:24 AM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	01:17:58 PM	No files match the supplied pattern.
MainError:	01:17:58 PM	No files match the supplied pattern.
MainError:	10:06:10 PM	No files match the supplied pattern.
MainError:	10:06:10 PM	No files match the supplied pattern.
MainError:	06:52:15 AM	No files match the supplied pattern.
MainError:	06:52:15 AM	No files match the supplied pattern.
MainError:	03:38:12 PM	No files match the supplied pattern.
MainError:	03:38:12 PM	No files match the supplied pattern.
MainError:	12:24:27 AM	No files match the supplied pattern.
MainError:	12:24:27 AM	No files match the supplied pattern.
MainError:	09:10:35 AM	No files match the supplied pattern.
MainError:	09:10:35 AM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	12:28:40 AM	No files match the supplied pattern.
MainError:	12:28:40 AM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	10:57:43 PM	No files match the supplied pattern.
MainError:	10:57:43 PM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
MainError:	10:52:38 AM	No files match the supplied pattern.
MainError:	10:52:38 AM	No files match the supplied pattern.
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Error converting file to netcdf: dataout/o31xka.ph11c10
Error converting file to netcdf: dataout/o31xka.pg11c10
Error converting file to netcdf: dataout/o31xka.pe11c10
MainError:	10:07:56 AM	No files match the supplied pattern.
MainError:	10:07:56 AM	No files match the supplied pattern.
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16

Model crashed: STWORK  : I/O error - PP fixed length header                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
23 Jul 2013 15:10:20 1237180 15800463 hadcm3n_o31x_2140_40_008268967_4 777,600 1,401,027 1.8017
23 Jul 2013 15:10:20 1237180 15800463 hadcm3n_o31x_2140_40_008268967_4 751,680 1,346,734 1.7916
11 Jul 2013 23:01:19 1237180 15800463 hadcm3n_o31x_2140_40_008268967_4 725,760 1,294,913 1.7842
11 Jul 2013 00:32:45 1237180 15800463 hadcm3n_o31x_2140_40_008268967_4 699,840 1,244,787 1.7787
10 Jul 2013 01:03:45 1237180 15800463 hadcm3n_o31x_2140_40_008268967_4 673,920 1,206,962 1.7910
10 Jul 2013 01:03:45 1237180 15800463 hadcm3n_o31x_2140_40_008268967_4 648,000 1,175,416 1.8139
10 Jul 2013 01:03:45 1237180 15800463 hadcm3n_o31x_2140_40_008268967_4 622,080 1,143,863 1.8388
10 Jul 2013 01:03:45 1237180 15800463 hadcm3n_o31x_2140_40_008268967_4 596,160 1,112,327 1.8658
10 Jul 2013 01:03:45 1237180 15800463 hadcm3n_o31x_2140_40_008268967_4 570,240 1,080,784 1.8953
10 Jul 2013 01:03:45 1237180 15800463 hadcm3n_o31x_2140_40_008268967_4 544,320 1,049,139 1.9274
10 Jul 2013 01:03:45 1237180 15800463 hadcm3n_o31x_2140_40_008268967_4 518,400 1,014,558 1.9571
10 Jul 2013 01:03:44 1237180 15800463 hadcm3n_o31x_2140_40_008268967_4 492,480 971,262 1.9722
03 Jul 2013 11:20:42 1237180 15800463 hadcm3n_o31x_2140_40_008268967_4 466,560 924,314 1.9811
02 Jul 2013 12:03:44 1237180 15800463 hadcm3n_o31x_2140_40_008268967_4 440,640 872,471 1.9800
02 Jul 2013 11:15:17 1237180 15800463 hadcm3n_o31x_2140_40_008268967_4 414,720 820,518 1.9785
02 Jul 2013 10:28:46 1237180 15800463 hadcm3n_o31x_2140_40_008268967_4 388,800 768,411 1.9764
02 Jul 2013 09:53:32 1237180 15800463 hadcm3n_o31x_2140_40_008268967_4 362,880 717,404 1.9770
28 Jun 2013 04:31:43 1237180 15800463 hadcm3n_o31x_2140_40_008268967_4 336,960 666,416 1.9777
26 Jun 2013 08:44:28 1237180 15800463 hadcm3n_o31x_2140_40_008268967_4 311,040 614,571 1.9759
25 Jun 2013 04:34:15 1237180 15800463 hadcm3n_o31x_2140_40_008268967_4 285,120 563,619 1.9768


©2024 climateprediction.net