climateprediction.net home page
Task 15503770

Task 15503770

Name hadcm3n_o6lt_2020_40_008270650_0
Workunit 8425774
Created 24 Dec 2012, 3:22:53 UTC
Sent 27 Dec 2012, 14:52:42 UTC
Report deadline 28 Mar 2013, 22:19:53 UTC
Received 8 Jan 2013, 22:18:11 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1260497
Run time 12 days 3 hours 6 min 41 sec
CPU time 1 min 24 sec
Validate state Invalid
Credit 5,598.72
Device peak FLOPS 2.56 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr 
<core_client_version>6.12.43</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1
forrtl: No space left on device
forrtl: severe (38): error during write, unit -1, file stdout
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0848EB7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0848D975  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0845F3CF  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F90D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F257  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  08450E2C  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0844E937  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  083009BD  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0838EDB1  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0839BDF8  Unknown               Unknown  Unknown
libc.so.6          F7617BE5  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0804CB11  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5637, iMonCtr=1
Model crash detected, will try to restart...

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1
forrtl: No space left on device
forrtl: severe (38): error during write, unit -1, file stdout
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0848EB7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0848D975  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0845F3CF  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F90D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F257  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  08450E2C  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0844E937  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  083009BD  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0838EDB1  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0839BDF8  Unknown               Unknown  Unknown
libc.so.6          F75D9BE5  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0804CB11  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5637, iMonCtr=1
Model crash detected, will try to restart...

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1
forrtl: No space left on device
forrtl: severe (38): error during write, unit -1, file stdout
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0848EB7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0848D975  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0845F3CF  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F90D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F257  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  08450E2C  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0844E937  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  083009BD  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0838EDB1  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0839BDF8  Unknown               Unknown  Unknown
libc.so.6          F75BBBE5  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0804CB11  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5637, iMonCtr=1
Model crash detected, will try to restart...

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1
forrtl: No space left on device
forrtl: severe (38): error during write, unit -1, file stdout
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0848EB7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0848D975  Unknown          Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5637, iMonCtr=1
Model crash detected, will try to restart...

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1
forrtl: No space left on device
forrtl: severe (38): error during write, unit -1, file stdout
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0848EB7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0848D975  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0845F3CF  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F90D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F257  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  08450E2C  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0844E937  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  083009BD  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0838EDB1  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0839BDF8  Unknown               Unknown  Unknown
libc.so.6          F7552BE5  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0804CB11  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5637, iMonCtr=1
Model crash detected, will try to restart...

SETPOS: Seek Failed: No space left on device
SETPOS: Unit 22 to Word Address 186368 Failed with Error Code -1

Model crashed: SETPOS: Unit 22 to Word Address 186368 Failed with Error Code -1
forrtl: No space left on device
forrtl: severe (38): error during write, unit 6, file /usr/bin/projects/climateprediction.net/hadcm3n_o6lt_2020_40_008270650/dataout/stdout_um.txt
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0848EB7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0848D975  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0845F3CF  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F90D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F257  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  08455448  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  08372172  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0837FE35  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0822B1DE  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0818A767  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0818D749  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  08391957  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0838F8B7  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0839BDF8  Unknown               Unknown  Unknown
libc.so.6          F75BEBE5  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0804CB11  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5637, iMonCtr=1
Model crash detected, will try to restart...
forrtl: No space left on device
forrtl: severe (38): error during write, unit 6, file /usr/bin/projects/climateprediction.net/hadcm3n_o6lt_2020_40_008270650/dataout/stdout_um.txt
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0848EB7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0848D975  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0845F3CF  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F90D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F257  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  08451069  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0844E937  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0822B4FA  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0818A767  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0818D749  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  08391957  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0838F8B7  Unknown  Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
08 Jan 2013 08:57:05 1260497 15503770 hadcm3n_o6lt_2020_40_008270650_0 466,560 522,549 1.1200
07 Jan 2013 17:32:31 1260497 15503770 hadcm3n_o6lt_2020_40_008270650_0 440,640 467,382 1.0607
07 Jan 2013 02:14:37 1260497 15503770 hadcm3n_o6lt_2020_40_008270650_0 414,720 412,329 0.9942
06 Jan 2013 10:56:36 1260497 15503770 hadcm3n_o6lt_2020_40_008270650_0 388,800 357,395 0.9192
05 Jan 2013 19:40:40 1260497 15503770 hadcm3n_o6lt_2020_40_008270650_0 362,880 302,362 0.8332
05 Jan 2013 04:19:48 1260497 15503770 hadcm3n_o6lt_2020_40_008270650_0 336,960 247,382 0.7342
04 Jan 2013 13:26:23 1260497 15503770 hadcm3n_o6lt_2020_40_008270650_0 311,040 192,258 0.6181
03 Jan 2013 21:37:12 1260497 15503770 hadcm3n_o6lt_2020_40_008270650_0 285,120 137,169 0.4811
03 Jan 2013 06:40:30 1260497 15503770 hadcm3n_o6lt_2020_40_008270650_0 259,200 82,263 0.3174
02 Jan 2013 15:11:33 1260497 15503770 hadcm3n_o6lt_2020_40_008270650_0 233,280 27,359 0.1173
01 Jan 2013 23:32:56 1260497 15503770 hadcm3n_o6lt_2020_40_008270650_0 207,360 111,022 0.5354
01 Jan 2013 07:56:11 1260497 15503770 hadcm3n_o6lt_2020_40_008270650_0 181,440 54,918 0.3027
31 Dec 2012 17:11:19 1260497 15503770 hadcm3n_o6lt_2020_40_008270650_0 155,520 93,573 0.6017
31 Dec 2012 01:11:50 1260497 15503770 hadcm3n_o6lt_2020_40_008270650_0 129,600 36,645 0.2828
30 Dec 2012 08:44:25 1260497 15503770 hadcm3n_o6lt_2020_40_008270650_0 103,680 234,174 2.2586
29 Dec 2012 16:22:29 1260497 15503770 hadcm3n_o6lt_2020_40_008270650_0 77,760 175,724 2.2598
29 Dec 2012 00:03:10 1260497 15503770 hadcm3n_o6lt_2020_40_008270650_0 51,840 117,157 2.2600
28 Dec 2012 07:34:08 1260497 15503770 hadcm3n_o6lt_2020_40_008270650_0 25,920 58,509 2.2573


©2024 climateprediction.net