climateprediction.net home page
Task 16296366

Task 16296366

Name hadcm3n_87ex_1980_40_008516112_0
Workunit 8663624
Created 26 Feb 2014, 16:18:11 UTC
Sent 26 Feb 2014, 16:30:22 UTC
Report deadline 28 May 2014, 23:57:33 UTC
Received 23 Mar 2014, 18:24:07 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1316488
Run time 15 days 20 hours 0 min 57 sec
CPU time 15 days 14 hours 18 min 54 sec
Validate state Invalid
Credit 10,886.40
Device peak FLOPS 3.08 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr 
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ex_1980_40_008516112/jobs/xabnk.ihist after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ex_1980_40_008516112/jobs/specsw after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ex_1980_40_008516112/jobs/speclw after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ex_1980_40_008516112/jobs/xabnk.ihist after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ex_1980_40_008516112/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ex_1980_40_008516112/dataout/ocean_restart.day after 11 attempts
forrtl: severe (24): end-of-file during read, unit 5, file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ex_1980_40_008516112/jobs/climate.cpdc
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0848EB7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0848D975  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0845F3CF  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F90D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F257  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  084399E4  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  083403FC  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0838F198  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0839BDF8  Unknown               Unknown  Unknown
libc.so.6          B75DDDA6  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0804CB11  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4113, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ex_1980_40_008516112/jobs/xabnk.ihist after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ex_1980_40_008516112/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ex_1980_40_008516112/dataout/ocean_restart.day after 11 attempts
forrtl: severe (24): end-of-file during read, unit 5, file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ex_1980_40_008516112/jobs/climate.cpdc
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0848EB7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0848D975  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0845F3CF  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F90D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F257  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  084399E4  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  083403FC  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0838F198  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0839BDF8  Unknown               Unknown  Unknown
libc.so.6          B7646DA6  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0804CB11  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4113, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ex_1980_40_008516112/jobs/xabnk.ihist after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ex_1980_40_008516112/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ex_1980_40_008516112/dataout/ocean_restart.day after 11 attempts
forrtl: severe (24): end-of-file during read, unit 5, file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ex_1980_40_008516112/jobs/climate.cpdc
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0848EB7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0848D975  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0845F3CF  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F90D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F257  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  084399E4  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  083403FC  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0838F198  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0839BDF8  Unknown               Unknown  Unknown
libc.so.6          B76B6DA6  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0804CB11  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4113, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ex_1980_40_008516112/jobs/xabnk.ihist after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ex_1980_40_008516112/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ex_1980_40_008516112/dataout/ocean_restart.day after 11 attempts
forrtl: severe (24): end-of-file during read, unit 5, file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ex_1980_40_008516112/jobs/climate.cpdc
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0848EB7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0848D975  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0845F3CF  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F90D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F257  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  084399E4  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  083403FC  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0838F198  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0839BDF8  Unknown               Unknown  Unknown
libc.so.6          B7688DA6  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0804CB11  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4113, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ex_1980_40_008516112/jobs/xabnk.ihist after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ex_1980_40_008516112/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ex_1980_40_008516112/dataout/ocean_restart.day after 11 attempts
forrtl: severe (24): end-of-file during read, unit 5, file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ex_1980_40_008516112/jobs/climate.cpdc
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0848EB7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0848D975  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0845F3CF  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F90D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F257  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  084399E4  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  083403FC  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0838F198  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0839BDF8  Unknown               Unknown  Unknown
libc.so.6          B7726DA6  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0804CB11  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4113, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ex_1980_40_008516112/jobs/xabnk.ihist after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ex_1980_40_008516112/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ex_1980_40_008516112/dataout/ocean_restart.day after 11 attempts
forrtl: severe (24): end-of-file during read, unit 5, file /var/lib/boinc/projects/climateprediction.net/hadcm3n_87ex_1980_40_008516112/jobs/climate.cpdc
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0848EB7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0848D975  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0845F3CF  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F90D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F257  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  084399E4  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  083403FC  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0838F198  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0839BDF8  Unknown               Unknown  Unknown
libc.so.6          B7653DA6  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0804CB11  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4113, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
22 Mar 2014 00:43:34 1316488 16296366 hadcm3n_87ex_1980_40_008516112_0 907,200 1,340,993 1.4782
20 Mar 2014 22:38:30 1316488 16296366 hadcm3n_87ex_1980_40_008516112_0 881,280 1,302,030 1.4774
20 Mar 2014 01:44:29 1316488 16296366 hadcm3n_87ex_1980_40_008516112_0 855,360 1,263,103 1.4767
19 Mar 2014 04:06:05 1316488 16296366 hadcm3n_87ex_1980_40_008516112_0 829,440 1,224,042 1.4757
18 Mar 2014 03:47:42 1316488 16296366 hadcm3n_87ex_1980_40_008516112_0 803,520 1,185,035 1.4748
17 Mar 2014 15:31:26 1316488 16296366 hadcm3n_87ex_1980_40_008516112_0 777,600 1,146,678 1.4746
16 Mar 2014 19:22:10 1316488 16296366 hadcm3n_87ex_1980_40_008516112_0 751,680 1,108,415 1.4746
16 Mar 2014 08:11:57 1316488 16296366 hadcm3n_87ex_1980_40_008516112_0 725,760 1,069,636 1.4738
15 Mar 2014 21:10:05 1316488 16296366 hadcm3n_87ex_1980_40_008516112_0 699,840 1,030,652 1.4727
15 Mar 2014 10:06:02 1316488 16296366 hadcm3n_87ex_1980_40_008516112_0 673,920 991,559 1.4713
14 Mar 2014 23:13:51 1316488 16296366 hadcm3n_87ex_1980_40_008516112_0 648,000 952,892 1.4705
14 Mar 2014 02:02:48 1316488 16296366 hadcm3n_87ex_1980_40_008516112_0 622,080 914,063 1.4694
13 Mar 2014 10:18:20 1316488 16296366 hadcm3n_87ex_1980_40_008516112_0 596,160 874,914 1.4676
12 Mar 2014 19:19:44 1316488 16296366 hadcm3n_87ex_1980_40_008516112_0 570,240 836,104 1.4662
12 Mar 2014 00:55:58 1316488 16296366 hadcm3n_87ex_1980_40_008516112_0 544,320 797,392 1.4649
11 Mar 2014 12:51:07 1316488 16296366 hadcm3n_87ex_1980_40_008516112_0 518,400 759,029 1.4642
10 Mar 2014 16:37:18 1316488 16296366 hadcm3n_87ex_1980_40_008516112_0 492,480 720,270 1.4625
09 Mar 2014 19:30:32 1316488 16296366 hadcm3n_87ex_1980_40_008516112_0 466,560 680,968 1.4596
09 Mar 2014 08:00:43 1316488 16296366 hadcm3n_87ex_1980_40_008516112_0 440,640 641,955 1.4569
08 Mar 2014 22:07:30 1316488 16296366 hadcm3n_87ex_1980_40_008516112_0 414,720 603,313 1.4547


©2024 climateprediction.net