climateprediction.net home page
Task 14654967

Task 14654967

Name hadcm3n_20do_1980_40_007957157_3
Workunit 8112269
Created 10 May 2012, 12:28:08 UTC
Sent 10 May 2012, 12:30:36 UTC
Report deadline 9 Aug 2012, 19:57:47 UTC
Received 30 May 2012, 9:27:42 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 942439
Run time 19 days 18 hours 2 min 18 sec
CPU time 19 days 5 hours 37 min 21 sec
Validate state Invalid
Credit 9,331.20
Device peak FLOPS 1.47 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>7.0.24</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
07:36:03 (2832): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:38:20 (3596): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
21:28:00 (3771): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
06:34:29 (2908): No heartbeat from core client for 30 sec - exiting
06:34:31 (2908): No heartbeat from core client for 30 sec - exiting
06:34:32 (2908): No heartbeat from core client for 30 sec - exiting
06:34:33 (2908): No heartbeat from core client for 30 sec - exiting
06:34:34 (2908): No heartbeat from core client for 30 sec - exiting
06:34:35 (2908): No heartbeat from core client for 30 sec - exiting
06:34:36 (2908): No heartbeat from core client for 30 sec - exiting
06:34:37 (2908): No heartbeat from core client for 30 sec - exiting
06:34:38 (2908): No heartbeat from core client for 30 sec - exiting
06:34:39 (2908): No heartbeat from core client for 30 sec - exiting
06:34:40 (2908): No heartbeat from core client for 30 sec - exiting
06:34:41 (2908): No heartbeat from core client for 30 sec - exiting
06:34:42 (2908): No heartbeat from core client for 30 sec - exiting
06:34:43 (2908): No heartbeat from core client for 30 sec - exiting
06:34:44 (2908): No heartbeat from core client for 30 sec - exiting
06:34:45 (2908): No heartbeat from core client for 30 sec - exiting
06:34:46 (2908): No heartbeat from core client for 30 sec - exiting
06:34:47 (2908): No heartbeat from core client for 30 sec - exiting
06:34:48 (2908): No heartbeat from core client for 30 sec - exiting
06:34:49 (2908): No heartbeat from core client for 30 sec - exiting
06:34:50 (2908): No heartbeat from core client for 30 sec - exiting
06:34:51 (2908): No heartbeat from core client for 30 sec - exiting
06:34:53 (2908): No heartbeat from core client for 30 sec - exiting
06:34:54 (2908): No heartbeat from core client for 30 sec - exiting
06:34:55 (2908): No heartbeat from core client for 30 sec - exiting
06:34:56 (2908): No heartbeat from core client for 30 sec - exiting
06:34:57 (2908): No heartbeat from core client for 30 sec - exiting
06:34:58 (2908): No heartbeat from core client for 30 sec - exiting
06:34:59 (2908): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:50:16 (3175): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_20do_1980_40_007957157/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_20do_1980_40_007957157/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_20do_1980_40_007957157/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_20do_1980_40_007957157/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_20do_1980_40_007957157/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_20do_1980_40_007957157/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_20do_1980_40_007957157/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_20do_1980_40_007957157/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_20do_1980_40_007957157/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_20do_1980_40_007957157/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_20do_1980_40_007957157/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_20do_1980_40_007957157/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
30 May 2012 09:30:10 942439 14654967 hadcm3n_20do_1980_40_007957157_3 777,600 1,661,868 2.1372
29 May 2012 15:54:32 942439 14654967 hadcm3n_20do_1980_40_007957157_3 751,680 1,608,773 2.1402
29 May 2012 00:13:46 942439 14654967 hadcm3n_20do_1980_40_007957157_3 725,760 1,555,046 2.1426
28 May 2012 09:25:42 942439 14654967 hadcm3n_20do_1980_40_007957157_3 699,840 1,502,041 2.1463
27 May 2012 18:50:17 942439 14654967 hadcm3n_20do_1980_40_007957157_3 673,920 1,449,635 2.1510
27 May 2012 04:03:34 942439 14654967 hadcm3n_20do_1980_40_007957157_3 648,000 1,396,866 2.1557
26 May 2012 13:26:39 942439 14654967 hadcm3n_20do_1980_40_007957157_3 622,080 1,344,776 2.1617
25 May 2012 22:15:56 942439 14654967 hadcm3n_20do_1980_40_007957157_3 596,160 1,291,183 2.1658
25 May 2012 05:48:34 942439 14654967 hadcm3n_20do_1980_40_007957157_3 570,240 1,236,270 2.1680
24 May 2012 14:53:09 942439 14654967 hadcm3n_20do_1980_40_007957157_3 544,320 1,180,386 2.1686
23 May 2012 22:41:22 942439 14654967 hadcm3n_20do_1980_40_007957157_3 518,400 1,124,673 2.1695
23 May 2012 06:49:20 942439 14654967 hadcm3n_20do_1980_40_007957157_3 492,480 1,068,641 2.1699
22 May 2012 15:13:02 942439 14654967 hadcm3n_20do_1980_40_007957157_3 466,560 1,013,166 2.1716
21 May 2012 21:38:24 942439 14654967 hadcm3n_20do_1980_40_007957157_3 440,640 957,011 2.1719
21 May 2012 03:05:46 942439 14654967 hadcm3n_20do_1980_40_007957157_3 414,720 901,130 2.1729
20 May 2012 11:19:39 942439 14654967 hadcm3n_20do_1980_40_007957157_3 388,800 844,744 2.1727
19 May 2012 18:35:46 942439 14654967 hadcm3n_20do_1980_40_007957157_3 362,880 783,122 2.1581
19 May 2012 01:56:31 942439 14654967 hadcm3n_20do_1980_40_007957157_3 336,960 725,188 2.1521
18 May 2012 11:54:33 942439 14654967 hadcm3n_20do_1980_40_007957157_3 311,040 669,814 2.1535
17 May 2012 18:51:34 942439 14654967 hadcm3n_20do_1980_40_007957157_3 285,120 614,897 2.1566


©2024 climateprediction.net