climateprediction.net home page
Task 17975091

Task 17975091

Name hadam3pm2_i114_1959_10_009272474_1
Workunit 9365390
Created 23 Feb 2015, 19:20:55 UTC
Sent 10 Mar 2015, 2:13:22 UTC
Report deadline 20 Feb 2016, 7:33:22 UTC
Received 16 Mar 2015, 5:46:48 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1356434
Run time 5 days 17 hours 56 min 44 sec
CPU time 1 days 0 hours 29 min 6 sec
Validate state Invalid
Credit 6,405.28
Device peak FLOPS 3.97 GFLOPS
Application version UK Met Office HadAM3P (global only) with MOSES II landsurface scheme v7.03
i686-pc-linux-gnu
Stderr
<core_client_version>7.2.42</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
oa.pc|9dec.nc
oa.pc|0jan.nc
oa.pc|0feb.nc
oa.pc|0mar.nc
oa.pc|0apr.nc
oa.pc|0may.nc
oa.pc|0jun.nc
oa.pc|0jul.nc
oa.pc|0aug.nc
oa.pc|0sep.nc
oa.pc|0oct.nc
oa.pc|0nov.nc
oa.pe|9dec.nc
oa.pe|0jan.nc
oa.pe|0feb.nc
oa.pe|0mar.nc
oa.pe|0apr.nc
oa.pe|0may.nc
oa.pe|0jun.nc
oa.pe|0jul.nc
oa.pe|0aug.nc
oa.pe|0sep.nc
oa.pe|0oct.nc
oa.pe|0nov.nc
Suspended CPDN Monitor - Suspend request from BOINC...
oa.pc|0dec.nc
oa.pc|1jan.nc
oa.pc|1feb.nc
oa.pc|1mar.nc
oa.pc|1apr.nc
oa.pc|1may.nc
oa.pc|1jun.nc
oa.pc|1jul.nc
oa.pc|1aug.nc
oa.pc|1sep.nc
oa.pc|1oct.nc
oa.pc|1nov.nc
oa.pe|0dec.nc
oa.pe|1jan.nc
oa.pe|1feb.nc
oa.pe|1mar.nc
oa.pe|1apr.nc
oa.pe|1may.nc
oa.pe|1jun.nc
oa.pe|1jul.nc
oa.pe|1aug.nc
oa.pe|1sep.nc
oa.pe|1oct.nc
oa.pe|1nov.nc

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: go

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 
oa.pc|1dec.nc
oa.pc|2jan.nc
oa.pc|2feb.nc
oa.pc|2mar.nc
oa.pc|2apr.nc
oa.pc|2may.nc
oa.pc|2jun.nc
oa.pc|2jul.nc
oa.pc|2aug.nc
oa.pc|2sep.nc
oa.pc|2oct.nc
oa.pc|2nov.nc
oa.pe|1dec.nc
oa.pe|2jan.nc
oa.pe|2feb.nc
oa.pe|2mar.nc
oa.pe|2apr.nc
oa.pe|2may.nc
oa.pe|2jun.nc
oa.pe|2jul.nc
oa.pe|2aug.nc
oa.pe|2sep.nc
oa.pe|2oct.nc
oa.pe|2nov.nc

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write
BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 
forrtl: No space left on device
forrtl: severe (38): error during write, unit 6, file /var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_i114_1959_10_009272474/dataout/stdout_um.txt
Image              PC        Routine            Line        Source             
hadam3pm2_um_7.03  0845AB9D  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  08459995  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  0842865F  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  083E7E1D  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  083E7767  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  0841A2F9  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  08417BC7  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  08346323  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  082D4171  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  0832046D  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  0834C82D  Unknown               Unknown  Unknown
libc.so.6          F0D98A83  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=17465, iMonCtr=1
Model crash detected, will try to restart...

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: go

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: go

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: go

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: go

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: go

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: go

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: go

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: go

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: go

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: go

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 
oa.pc|2dec.nc
oa.pc|3jan.nc
oa.pc|3feb.nc
oa.pc|3mar.nc
oa.pc|3apr.nc
oa.pc|3may.nc
oa.pc|3jun.nc
oa.pc|3jul.nc
oa.pc|3aug.nc
oa.pc|3sep.nc
oa.pc|3oct.nc
oa.pc|3nov.nc
oa.pe|2dec.nc
oa.pe|3jan.nc
oa.pe|3feb.nc
oa.pe|3mar.nc
oa.pe|3apr.nc
oa.pe|3may.nc
oa.pe|3jun.nc
oa.pe|3jul.nc
oa.pe|3aug.nc
oa.pe|3sep.nc
oa.pe|3oct.nc
oa.pe|3nov.nc

BUFFOUTCPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: go

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: go

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: go

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: go

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: go

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: go

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: go

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: go

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: go

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: go

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: go

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashe07:44:57 (23012): called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
16 Mar 2015 04:05:02 1356434 17975091 hadam3pm2_i114_1959_10_009272474_1 221,828 88,175 0.3975
16 Mar 2015 02:55:21 1356434 17975091 hadam3pm2_i114_1959_10_009272474_1 218,948 113,096 0.5165
16 Mar 2015 00:58:49 1356434 17975091 hadam3pm2_i114_1959_10_009272474_1 216,068 108,617 0.5027
15 Mar 2015 23:53:33 1356434 17975091 hadam3pm2_i114_1959_10_009272474_1 213,188 104,085 0.4882
15 Mar 2015 22:53:18 1356434 17975091 hadam3pm2_i114_1959_10_009272474_1 210,308 99,452 0.4729
15 Mar 2015 10:24:38 1356434 17975091 hadam3pm2_i114_1959_10_009272474_1 201,668 85,171 0.4223
15 Mar 2015 09:24:19 1356434 17975091 hadam3pm2_i114_1959_10_009272474_1 198,788 80,340 0.4041
15 Mar 2015 07:23:36 1356434 17975091 hadam3pm2_i114_1959_10_009272474_1 195,908 75,493 0.3853
15 Mar 2015 06:22:54 1356434 17975091 hadam3pm2_i114_1959_10_009272474_1 193,028 70,500 0.3652
15 Mar 2015 05:21:46 1356434 17975091 hadam3pm2_i114_1959_10_009272474_1 190,148 65,393 0.3439
15 Mar 2015 03:31:03 1356434 17975091 hadam3pm2_i114_1959_10_009272474_1 187,268 60,172 0.3213
15 Mar 2015 02:23:01 1356434 17975091 hadam3pm2_i114_1959_10_009272474_1 184,388 55,158 0.2991
15 Mar 2015 01:22:12 1356434 17975091 hadam3pm2_i114_1959_10_009272474_1 181,508 50,419 0.2778
14 Mar 2015 23:21:33 1356434 17975091 hadam3pm2_i114_1959_10_009272474_1 178,628 45,679 0.2557
14 Mar 2015 22:21:15 1356434 17975091 hadam3pm2_i114_1959_10_009272474_1 175,748 40,661 0.2314
14 Mar 2015 16:14:29 1356434 17975091 hadam3pm2_i114_1959_10_009272474_1 164,228 21,009 0.1279
14 Mar 2015 14:28:55 1356434 17975091 hadam3pm2_i114_1959_10_009272474_1 161,348 16,203 0.1004
14 Mar 2015 12:28:16 1356434 17975091 hadam3pm2_i114_1959_10_009272474_1 158,468 11,358 0.0717
14 Mar 2015 11:27:57 1356434 17975091 hadam3pm2_i114_1959_10_009272474_1 155,588 6,569 0.0422
14 Mar 2015 10:27:37 1356434 17975091 hadam3pm2_i114_1959_10_009272474_1 152,708 1,633 0.0107


©2024 climateprediction.net