Task 15917383

Name	hadcm3n_o3iw_2140_40_008270373_4
Workunit	8425497
Created	14 Aug 2013, 15:30:30 UTC
Sent	14 Aug 2013, 15:37:11 UTC
Report deadline	13 Nov 2013, 23:04:22 UTC
Received	20 Sep 2013, 13:11:18 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	361754
Run time	28 days 21 hours 8 min 57 sec
CPU time	28 days 18 hours 50 min 36 sec
Validate state	Invalid
Credit	8,087.04
Device peak FLOPS	0.95 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Suspended CPDN Monitor - Suspend request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Suspended CPDN Monitor - Suspend request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Suspended CPDN Monitor - Suspend request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Suspended CPDN Monitor - Suspend request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Suspended CPDN Monitor - Suspend request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Suspended CPDN Monitor - Suspend request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /home/adi/boinc/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) MainError: 03:08:35 AM No files match the supplied pattern. MainError: 03:08:35 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... MainError: 04:27:01 AM No files match the supplied pattern. MainError: 04:27:01 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... MainError: 05:50:30 AM No files match the supplied pattern. MainError: 05:50:30 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... MainError: 07:14:38 AM No files match the supplied pattern. MainError: 07:14:38 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... MainError: 08:36:22 AM No files match the supplied pattern. MainError: 08:36:22 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... MainError: 09:55:11 AM No files match the supplied pattern. MainError: 09:55:11 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... MainError: 11:09:20 AM No files match the supplied pattern. MainError: 11:09:20 AM No files match the supplied pattern. BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITHEAD: I/O error tmp/pipe_dummy 2048 forrtl: No space left on device forrtl: severe (38): error during write, unit 6, file /home/adi/boinc/projects/climateprediction.net/hadcm3n_o3iw_2140_40_008270373/dataout/stdout_um.txt Image PC Routine Line Source hadcm3n_um_6.07_i 0848EB7D Unknown Unknown Unknown hadcm3n_um_6.07_i 0848D975 Unknown Unknown Unknown hadcm3n_um_6.07_i 0845F3CF Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F90D Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F257 Unknown Unknown Unknown hadcm3n_um_6.07_i 08451069 Unknown Unknown Unknown hadcm3n_um_6.07_i 0844E937 Unknown Unknown Unknown hadcm3n_um_6.07_i 0836D10D Unknown Unknown Unknown hadcm3n_um_6.07_i 082EB086 Unknown Unknown Unknown hadcm3n_um_6.07_i 0838F66D Unknown Unknown Unknown hadcm3n_um_6.07_i 0839BDF8 Unknown Unknown Unknown libc.so.6 00BD6EBC Unknown Unknown Unknown hadcm3n_um_6.07_i 0804CB11 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7365, iMonCtr=1 Model crash detected, will try to restart... forrtl: No space left on device forrtl: severe (38): error during write, unit 6, file /home/adi/boinc/projects/climateprediction.net/hadcm3n_o3iw_2140_40_008270373/dataout/stdout_um.txt Image PC Routine Line Source hadcm3n_um_6.07_i 0848EB7D Unknown Unknown Unknown hadcm3n_um_6.07_i 0848D975 Unknown Unknown Unknown hadcm3n_um_6.07_i 0845F3CF Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F90D Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F257 Unknown Unknown Unknown hadcm3n_um_6.07_i 08451069 Unknown Unknown Unknown hadcm3n_um_6.07_i 0844E937 Unknown Unknown Unknown hadcm3n_um_6.07_i 0836D10D Unknown Unknown Unknown hadcm3n_um_6.07_i 082EB086 Unknown Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
20 Sep 2013 11:09:59	361754	15917383	hadcm3n_o3iw_2140_40_008270373_4	673,920	2,479,856	3.6797
19 Sep 2013 09:57:37	361754	15917383	hadcm3n_o3iw_2140_40_008270373_4	648,000	2,389,147	3.6870
18 Sep 2013 08:38:04	361754	15917383	hadcm3n_o3iw_2140_40_008270373_4	622,080	2,298,344	3.6946
17 Sep 2013 07:42:42	361754	15917383	hadcm3n_o3iw_2140_40_008270373_4	596,160	2,207,317	3.7026
16 Sep 2013 06:46:01	361754	15917383	hadcm3n_o3iw_2140_40_008270373_4	570,240	2,116,288	3.7112
15 Sep 2013 04:42:47	361754	15917383	hadcm3n_o3iw_2140_40_008270373_4	544,320	2,025,218	3.7206
14 Sep 2013 03:40:50	361754	15917383	hadcm3n_o3iw_2140_40_008270373_4	518,400	1,934,391	3.7315
13 Sep 2013 02:39:39	361754	15917383	hadcm3n_o3iw_2140_40_008270373_4	492,480	1,843,939	3.7442
12 Sep 2013 01:41:36	361754	15917383	hadcm3n_o3iw_2140_40_008270373_4	466,560	1,753,201	3.7577
10 Sep 2013 23:28:25	361754	15917383	hadcm3n_o3iw_2140_40_008270373_4	440,640	1,662,479	3.7729
09 Sep 2013 22:04:47	361754	15917383	hadcm3n_o3iw_2140_40_008270373_4	414,720	1,571,254	3.7887
08 Sep 2013 20:45:17	361754	15917383	hadcm3n_o3iw_2140_40_008270373_4	388,800	1,480,474	3.8078
07 Sep 2013 19:22:18	361754	15917383	hadcm3n_o3iw_2140_40_008270373_4	362,880	1,389,559	3.8293
06 Sep 2013 18:50:31	361754	15917383	hadcm3n_o3iw_2140_40_008270373_4	336,960	1,298,531	3.8537
05 Sep 2013 16:41:11	361754	15917383	hadcm3n_o3iw_2140_40_008270373_4	311,040	1,207,533	3.8822
04 Sep 2013 08:46:42	361754	15917383	hadcm3n_o3iw_2140_40_008270373_4	285,120	1,092,009	3.8300
03 Sep 2013 01:42:36	361754	15917383	hadcm3n_o3iw_2140_40_008270373_4	259,200	981,968	3.7885
01 Sep 2013 18:33:23	361754	15917383	hadcm3n_o3iw_2140_40_008270373_4	233,280	875,857	3.7545
31 Aug 2013 14:02:21	361754	15917383	hadcm3n_o3iw_2140_40_008270373_4	207,360	773,710	3.7312
30 Aug 2013 10:08:42	361754	15917383	hadcm3n_o3iw_2140_40_008270373_4	181,440	673,632	3.7127