Task 15516975

Name	hadcm3n_o2xy_2140_40_008270236_4
Workunit	8425360
Created	29 Dec 2012, 15:48:08 UTC
Sent	29 Dec 2012, 15:55:02 UTC
Report deadline	30 Mar 2013, 23:22:13 UTC
Received	6 Mar 2013, 5:22:15 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1078336
Run time	30 days 16 hours 31 min 51 sec
CPU time	21 days 19 hours 59 min 5 sec
Validate state	Invalid
Credit	9,331.20
Device peak FLOPS	1.86 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.10.56</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Error: XML file: /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_o2xy_2140_40_008270236/datain/varlevs.xml error in XML or file could not be opened. Error converting file to netcdf: dataout/o2xyko.piz0c10 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 07:25:38 PM No files match the supplied pattern. MainError: 07:25:39 PM No files match the supplied pattern. Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... MainError: 05:47:52 PM No files match the supplied pattern. MainError: 05:47:52 PM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 05:29:26 PM No files match the supplied pattern. MainError: 05:29:26 PM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 08:37:49 AM No files match the supplied pattern. MainError: 08:37:49 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 06:20:32 PM No files match the supplied pattern. MainError: 06:20:32 PM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... MainError: 03:54:25 PM No files match the supplied pattern. MainError: 03:54:25 PM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 07:25:31 PM No files match the supplied pattern. MainError: 07:25:31 PM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 02:02:40 AM No files match the supplied pattern. MainError: 02:02:40 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 08:41:27 AM No files match the supplied pattern. MainError: 08:41:27 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 03:50:26 PM No files match the supplied pattern. MainError: 03:50:27 PM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Error converting file to netcdf: dataout/o2xyko.pj09c10 Error converting file to netcdf: dataout/o2xyko.pi09c10 Error converting file to netcdf: dataout/o2xyko.pf09c10 Error converting file to netcdf: dataout/o2xyka.ph11c10 Error converting file to netcdf: dataout/o2xyka.pg11c10 Error converting file to netcdf: dataout/o2xyka.pe11c10 MainError: 05:21:09 AM No files match the supplied pattern. MainError: 05:21:09 AM No files match the supplied pattern. SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.8 build 10K549 Tue Mar 5 21:21:10 2013 Thread 0 Crashed: 0 hadcm3n_6.07_i686-apple-darwin 0x0001d3a5 _swapn4b + 21 1 hadcm3n_6.07_i686-apple-darwin 0x00020602 _ncx_getn_float_float + 34 2 hadcm3n_6.07_i686-apple-darwin 0x00027264 _getNCvx_float_float + 228 3 hadcm3n_6.07_i686-apple-darwin 0x000294e3 _getNCv_float + 467 4 hadcm3n_6.07_i686-apple-darwin 0x0002f733 _nc_get_var_float + 355 5 hadcm3n_6.07_i686-apple-darwin 0x0000b927 __Z12annual_cyclePKSt6vectorISsSaISsEEPKcii + 3177 6 hadcm3n_6.07_i686-apple-darwin 0x0000d36b __Z12decadalMeansiPKc + 957 7 hadcm3n_6.07_i686-apple-darwin 0x000067ff __Z9doCM3Procv + 185 8 hadcm3n_6.07_i686-apple-darwin 0x0000791c __Z8mainLoopv + 410 9 hadcm3n_6.07_i686-apple-darwin 0x000087c7 __Z6workerv + 2989 10 hadcm3n_6.07_i686-apple-darwin 0x00008aa9 _main + 491 11 hadcm3n_6.07_i686-apple-darwin 0x00002676 start + 54 Thread 1: 0 libSystem.B.dylib 0x985b5c0e _mach_wait_until + 10 1 libSystem.B.dylib 0x9863d429 _nanosleep + 345 2 libSystem.B.dylib 0x9863d2ca _usleep + 61 3 hadcm3n_6.07_i686-apple-darwin 0x00071a7c __Z11boinc_sleepd + 188 4 hadcm3n_6.07_i686-apple-darwin 0x00067282 __Z12timer_threadPv + 78 5 libSystem.B.dylib 0x985e3259 __pthread_start + 345 6 libSystem.B.dylib 0x985e30de _thread_start + 34 Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8f6c8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x93fff /Library/Application Support/BOINC Data/slots/3/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin 0x91f4e000 - 0x91f5cfff /usr/lib/libz.1.dylib 0x91f5d000 - 0x91fc7fff /usr/lib/libstdc++.6.dylib 0x985b5000 - 0x9875cfff /usr/lib/libSystem.B.dylib 0x9896a000 - 0x9896dfff /usr/lib/system/libmathCommon.A.dylib Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Mar 2013 05:25:02	1078336	15516975	hadcm3n_o2xy_2140_40_008270236_4	777,600	1,886,342	2.4259
04 Mar 2013 15:50:43	1078336	15516975	hadcm3n_o2xy_2140_40_008270236_4	751,680	1,819,078	2.4200
03 Mar 2013 08:45:55	1078336	15516975	hadcm3n_o2xy_2140_40_008270236_4	725,760	1,750,330	2.4117
02 Mar 2013 02:05:21	1078336	15516975	hadcm3n_o2xy_2140_40_008270236_4	699,840	1,681,362	2.4025
28 Feb 2013 19:41:33	1078336	15516975	hadcm3n_o2xy_2140_40_008270236_4	673,920	1,612,552	2.3928
27 Feb 2013 15:55:45	1078336	15516975	hadcm3n_o2xy_2140_40_008270236_4	648,000	1,544,037	2.3828
26 Feb 2013 18:21:54	1078336	15516975	hadcm3n_o2xy_2140_40_008270236_4	622,080	1,475,224	2.3714
25 Feb 2013 08:39:42	1078336	15516975	hadcm3n_o2xy_2140_40_008270236_4	596,160	1,407,176	2.3604
23 Feb 2013 17:31:31	1078336	15516975	hadcm3n_o2xy_2140_40_008270236_4	570,240	1,340,261	2.3503
22 Feb 2013 17:51:21	1078336	15516975	hadcm3n_o2xy_2140_40_008270236_4	544,320	1,269,210	2.3317
21 Feb 2013 19:36:30	1078336	15516975	hadcm3n_o2xy_2140_40_008270236_4	518,400	1,238,668	2.3894
20 Feb 2013 14:00:21	1078336	15516975	hadcm3n_o2xy_2140_40_008270236_4	492,480	1,170,488	2.3767
22 Jan 2013 17:16:15	1078336	15516975	hadcm3n_o2xy_2140_40_008270236_4	466,560	1,102,885	2.3639
21 Jan 2013 19:27:06	1078336	15516975	hadcm3n_o2xy_2140_40_008270236_4	440,640	1,030,009	2.3375
20 Jan 2013 21:18:03	1078336	15516975	hadcm3n_o2xy_2140_40_008270236_4	414,720	957,045	2.3077
19 Jan 2013 23:32:45	1078336	15516975	hadcm3n_o2xy_2140_40_008270236_4	388,800	884,135	2.2740
19 Jan 2013 01:43:39	1078336	15516975	hadcm3n_o2xy_2140_40_008270236_4	362,880	811,131	2.2353
18 Jan 2013 04:03:46	1078336	15516975	hadcm3n_o2xy_2140_40_008270236_4	336,960	738,239	2.1909
17 Jan 2013 06:09:03	1078336	15516975	hadcm3n_o2xy_2140_40_008270236_4	311,040	665,217	2.1387
16 Jan 2013 08:22:29	1078336	15516975	hadcm3n_o2xy_2140_40_008270236_4	285,120	592,387	2.0777