climateprediction.net home page
Task 17953914

Task 17953914

Name hadam3pm2_pehl_1991_10_009529074_0
Workunit 9610817
Created 13 Feb 2015, 16:48:41 UTC
Sent 10 Mar 2015, 6:21:27 UTC
Report deadline 20 Feb 2016, 11:41:27 UTC
Received 13 Mar 2015, 13:44:20 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1356434
Run time 3 days 6 hours 45 min 55 sec
CPU time 5 min 23 sec
Validate state Invalid
Credit 3,078.88
Device peak FLOPS 3.97 GFLOPS
Application version UK Met Office HadAM3P (global only) with MOSES II landsurface scheme v7.03
i686-pc-linux-gnu
Stderr 
<core_client_version>7.2.42</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
oa.pc|1dec.nc
oa.pc|2jan.nc
oa.pc|2feb.nc
oa.pc|2mar.nc
oa.pc|2apr.nc
oa.pc|2may.nc
oa.pc|2jun.nc
oa.pc|2jul.nc
oa.pc|2aug.nc
oa.pc|2sep.nc
oa.pc|2oct.nc
oa.pc|2nov.nc
oa.pe|1dec.nc
oa.pe|2jan.nc
oa.pe|2feb.nc
oa.pe|2mar.nc
oa.pe|2apr.nc
oa.pe|2may.nc
oa.pe|2jun.nc
oa.pe|2jul.nc
oa.pe|2aug.nc
oa.pe|2sep.nc
oa.pe|2oct.nc
oa.pe|2nov.nc
Suspended CPDN Monitor - Suspend request from BOINC...
oa.pc|2dec.nc
oa.pc|3jan.nc
oa.pc|3feb.nc
oa.pc|3mar.nc
oa.pc|3apr.nc
oa.pc|3may.nc
oa.pc|3jun.nc
oa.pc|3jul.nc
oa.pc|3aug.nc
oa.pc|3sep.nc
oa.pc|3oct.nc
oa.pc|3nov.nc
oa.pe|2dec.nc
oa.pe|3jan.nc
oa.pe|3feb.nc
oa.pe|3mar.nc
oa.pe|3apr.nc
oa.pe|3may.nc
oa.pe|3jun.nc
oa.pe|3jul.nc
oa.pe|3aug.nc
oa.pe|3sep.nc
oa.pe|3oct.nc
oa.pe|3nov.nc

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: go

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: go

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: go

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 
oa.pc|3dec.nc
oa.pc|4jan.nc
oa.pc|4feb.nc
oa.pc|4mar.nc
oa.pc|4apr.nc
oa.pc|4may.nc
oa.pc|4jun.nc
oa.pc|4jul.nc
oa.pc|4aug.nc
oa.pc|4sep.nc
oa.pc|4oct.nc
oa.pc|4nov.nc
oa.pe|3dec.nc
oa.pe|4jan.nc
oa.pe|4feb.nc
oa.pe|4mar.nc
oa.pe|4apr.nc
oa.pe|4may.nc
oa.pe|4jun.nc
oa.pe|4jul.nc
oa.pe|4aug.nc
oa.pe|4sep.nc
oa.pe|4oct.nc
oa.pe|4nov.nc

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: W
BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: go

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: go

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: 

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: go

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: go
forrtl: No space left on device
forrtl: severe (38): error during write, unit 6, file /var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_pehl_1991_10_009529074/dataout/stdout_um.txt
Image              PC        Routine            Line        Source             
hadam3pm2_um_7.03  0845AB9D  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  08459995  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  0842865F  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  083E7E1D  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  083E7767  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  0841A2F9  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  08417BC7  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  08346323  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  082D4171  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  0832046D  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  0834C82D  Unknown               Unknown  Unknown
libc.so.6          F0DA6A83  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=19752, iMonCtr=1
Model crash detected, will try to restart...
forrtl: No space left on device
forrtl: severe (38): error during write, unit 6, file /var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_pehl_1991_10_009529074/dataout/stdout_um.txt
Image              PC        Routine            Line        Source             
hadam3pm2_um_7.03  0845AB9D  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  08459995  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  0842865F  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  083E7E1D  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  083E7767  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  0841A2F9  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  08417BC7  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  08346323  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  082D4171  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  0832046D  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  0834C82D  Unknown               Unknown  Unknown
libc.so.6          F0CFFA83  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=19752, iMonCtr=1
Model crash detected, will try to restart...
forrtl: No space left on device
forrtl: severe (38): error during write, unit 6, file /var/lib/boinc-client/projects/climateprediction.net/hadam3pm2_pehl_1991_10_009529074/dataout/stdout_um.txt
Image              PC        Routine            Line        Source             
hadam3pm2_um_7.03  0845AB9D  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  08459995  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  0842865F  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  083E7E1D  Unknown               Unknown  Unknown
hadam3pm2_um_7.03  083E7767  U15:08:10 (19752): called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
13 Mar 2015 09:41:05 1356434 17953914 hadam3pm2_pehl_1991_10_009529074_0 106,628 14,370 0.1348
13 Mar 2015 06:38:52 1356434 17953914 hadam3pm2_pehl_1991_10_009529074_0 100,868 2,333 0.0231
13 Mar 2015 04:41:44 1356434 17953914 hadam3pm2_pehl_1991_10_009529074_0 97,988 47,550 0.4853
13 Mar 2015 02:38:22 1356434 17953914 hadam3pm2_pehl_1991_10_009529074_0 95,108 41,475 0.4361
13 Mar 2015 01:37:40 1356434 17953914 hadam3pm2_pehl_1991_10_009529074_0 92,228 35,460 0.3845
12 Mar 2015 23:36:41 1356434 17953914 hadam3pm2_pehl_1991_10_009529074_0 89,348 29,448 0.3296
12 Mar 2015 21:31:05 1356434 17953914 hadam3pm2_pehl_1991_10_009529074_0 86,468 23,477 0.2715
12 Mar 2015 20:30:46 1356434 17953914 hadam3pm2_pehl_1991_10_009529074_0 83,588 17,504 0.2094
12 Mar 2015 18:30:09 1356434 17953914 hadam3pm2_pehl_1991_10_009529074_0 80,708 11,533 0.1429
12 Mar 2015 17:29:51 1356434 17953914 hadam3pm2_pehl_1991_10_009529074_0 77,828 5,588 0.0718
12 Mar 2015 14:28:44 1356434 17953914 hadam3pm2_pehl_1991_10_009529074_0 74,948 165 0.0022
12 Mar 2015 12:28:03 1356434 17953914 hadam3pm2_pehl_1991_10_009529074_0 72,068 184,084 2.5543
12 Mar 2015 08:22:57 1356434 17953914 hadam3pm2_pehl_1991_10_009529074_0 66,308 170,064 2.5648
12 Mar 2015 06:21:08 1356434 17953914 hadam3pm2_pehl_1991_10_009529074_0 63,428 162,962 2.5692
12 Mar 2015 04:54:05 1356434 17953914 hadam3pm2_pehl_1991_10_009529074_0 60,548 155,852 2.5740
12 Mar 2015 02:18:21 1356434 17953914 hadam3pm2_pehl_1991_10_009529074_0 57,668 148,777 2.5799
12 Mar 2015 00:17:09 1356434 17953914 hadam3pm2_pehl_1991_10_009529074_0 54,788 141,752 2.5873
11 Mar 2015 22:16:31 1356434 17953914 hadam3pm2_pehl_1991_10_009529074_0 51,908 134,685 2.5947
11 Mar 2015 20:15:33 1356434 17953914 hadam3pm2_pehl_1991_10_009529074_0 49,028 127,673 2.6041
11 Mar 2015 18:14:55 1356434 17953914 hadam3pm2_pehl_1991_10_009529074_0 46,148 120,656 2.6145


©2024 climateprediction.net