climateprediction.net home page
Task 15641487

Task 15641487

Name hadcm3n_3mzw_1980_40_008320038_2
Workunit 8471173
Created 26 Feb 2013, 14:41:38 UTC
Sent 26 Feb 2013, 14:41:52 UTC
Report deadline 28 May 2013, 22:09:03 UTC
Received 21 Mar 2013, 6:35:11 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1079343
Run time 14 days 20 hours 5 min 53 sec
CPU time 13 days 1 hours 27 min 54 sec
Validate state Invalid
Credit 6,220.80
Device peak FLOPS 2.65 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr
<core_client_version>7.0.28</core_client_version>
<![CDATA[
<message>
The device does not recognize the command. (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
20:32:08 (19680): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
21:28:40 (11656): No heartbeat from core client for 30 sec - exiting
21:28:41 (11656): No heartbeat from core client for 30 sec - exiting
21:28:43 (11656): No heartbeat from core client for 30 sec - exiting
21:28:44 (11656): No heartbeat from core client for 30 sec - exiting
21:28:45 (11656): No heartbeat from core client for 30 sec - exiting
21:28:46 (11656): No heartbeat from core client for 30 sec - exiting
21:28:47 (11656): No heartbeat from core client for 30 sec - exiting
21:28:48 (11656): No heartbeat from core client for 30 sec - exiting
21:28:49 (11656): No heartbeat from core client for 30 sec - exiting
21:28:50 (11656): No heartbeat from core client for 30 sec - exiting
21:28:51 (11656): No heartbeat from core client for 30 sec - exiting
21:28:52 (11656): No heartbeat from core client for 30 sec - exiting
21:28:53 (11656): No heartbeat from core client for 30 sec - exiting
21:28:55 (11656): No heartbeat from core client for 30 sec - exiting
21:28:56 (11656): No heartbeat from core client for 30 sec - exiting
21:28:57 (11656): No heartbeat from core client for 30 sec - exiting
21:28:58 (11656): No heartbeat from core client for 30 sec - exiting
21:28:59 (11656): No heartbeat from core client for 30 sec - exiting
21:29:00 (11656): No heartbeat from core client for 30 sec - exiting
21:29:01 (11656): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
BUFFIN: C I/O Error feof - Unit 63 - Return code = 16
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 65 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
Error converting file to netcdf: dataout/3mzwko.pji1c10
Error converting file to netcdf: dataout/3mzwko.pii1c10
Error converting file to netcdf: dataout/3mzwko.pfi1c10
Error converting file to netcdf: dataout/3mzwka.phi1c10
Error converting file to netcdf: dataout/3mzwka.pgi1c10
Error converting file to netcdf: dataout/3mzwka.pei1c10
Error converting file to netcdf: dataout/3mzwka.pdi1c10
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
00:41:52 (13496): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
10:00:36 (16100): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
19:17:06 (9160): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
19:03:18 (14208): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
15:56:42 (28668): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
11:45:33 (23300): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
16:52:29 (13396): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
22:34:16 (31380): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

zip error: Could not create output file (was replacing the original zip file)
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_3mzw_1980_40_008320038/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_3mzw_1980_40_008320038/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_3mzw_1980_40_008320038/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_3mzw_1980_40_008320038/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_3mzw_1980_40_008320038/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_3mzw_1980_40_008320038/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_3mzw_1980_40_008320038/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_3mzw_1980_40_008320038/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_3mzw_1980_40_008320038/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_3mzw_1980_40_008320038/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_3mzw_1980_40_008320038/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_3mzw_1980_40_008320038/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
21 Mar 2013 05:38:26 1079343 15641487 hadcm3n_3mzw_1980_40_008320038_2 518,400 1,128,523 2.1769
20 Mar 2013 06:26:26 1079343 15641487 hadcm3n_3mzw_1980_40_008320038_2 492,480 1,074,398 2.1816
19 Mar 2013 10:04:23 1079343 15641487 hadcm3n_3mzw_1980_40_008320038_2 466,560 1,018,746 2.1835
18 Mar 2013 13:35:07 1079343 15641487 hadcm3n_3mzw_1980_40_008320038_2 440,640 962,342 2.1840
17 Mar 2013 14:10:21 1079343 15641487 hadcm3n_3mzw_1980_40_008320038_2 414,720 905,313 2.1829
14 Mar 2013 02:48:06 1079343 15641487 hadcm3n_3mzw_1980_40_008320038_2 388,800 849,507 2.1849
12 Mar 2013 22:42:17 1079343 15641487 hadcm3n_3mzw_1980_40_008320038_2 362,880 794,135 2.1884
12 Mar 2013 06:40:57 1079343 15641487 hadcm3n_3mzw_1980_40_008320038_2 336,960 738,144 2.1906
10 Mar 2013 17:21:00 1079343 15641487 hadcm3n_3mzw_1980_40_008320038_2 311,040 682,590 2.1945
09 Mar 2013 11:58:01 1079343 15641487 hadcm3n_3mzw_1980_40_008320038_2 285,120 625,759 2.1947
08 Mar 2013 17:34:07 1079343 15641487 hadcm3n_3mzw_1980_40_008320038_2 259,200 568,591 2.1936
07 Mar 2013 12:32:06 1079343 15641487 hadcm3n_3mzw_1980_40_008320038_2 233,280 511,538 2.1928
06 Mar 2013 17:48:28 1079343 15641487 hadcm3n_3mzw_1980_40_008320038_2 207,360 454,671 2.1927
05 Mar 2013 22:33:17 1079343 15641487 hadcm3n_3mzw_1980_40_008320038_2 181,440 397,468 2.1906
05 Mar 2013 03:04:16 1079343 15641487 hadcm3n_3mzw_1980_40_008320038_2 155,520 340,109 2.1869
04 Mar 2013 08:23:20 1079343 15641487 hadcm3n_3mzw_1980_40_008320038_2 129,600 283,003 2.1837
03 Mar 2013 13:20:09 1079343 15641487 hadcm3n_3mzw_1980_40_008320038_2 103,680 226,334 2.1830
02 Mar 2013 17:40:37 1079343 15641487 hadcm3n_3mzw_1980_40_008320038_2 77,760 169,534 2.1802
01 Mar 2013 23:39:17 1079343 15641487 hadcm3n_3mzw_1980_40_008320038_2 51,840 112,607 2.1722
01 Mar 2013 06:31:55 1079343 15641487 hadcm3n_3mzw_1980_40_008320038_2 25,920 56,033 2.1618


©2024 climateprediction.net