climateprediction.net home page
Task 15688566

Task 15688566

Name hadcm3n_u2sf_2020_40_008338399_0
Workunit 8489260
Created 28 Mar 2013, 11:18:25 UTC
Sent 28 Mar 2013, 11:18:42 UTC
Report deadline 27 Jun 2013, 18:45:53 UTC
Received 19 May 2013, 8:40:21 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1063076
Run time 14 days 14 hours 1 min 37 sec
CPU time 11 days 22 hours 23 min 33 sec
Validate state Invalid
Credit 11,197.44
Device peak FLOPS 3.59 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-apple-darwin
Stderr 
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...

Model crashed: TEMPHIST: Failed in OPEN of history file                                                                                                                                                                                                                        tmp/pipe_dummy                                                                  2048    
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

Model crashed: TEMPHIST: Failed in OPEN of history file                                                                                                                                                                                                                        tmp/pipe_dummy                                                                  2048    
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

Model crashed: TEMPHIST: Failed in OPEN of history file                                                                                                                                                                                                                        tmp/pipe_dummy                                                                  2048    
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.8 build 10K549
Sat May 18 09:10:00 2013

Thread 0 Crashed:
0   libSystem.B.dylib                   0x951f1c5a ___kill + 10
1   libSystem.B.dylib                   0x952845a5 _raise + 26
2   libSystem.B.dylib                   0x9529a6e4 _abort + 93
3   hadcm3n_um_6.07_i686-apple-darwin   0x00336cff _um_setup + 127
4   hadcm3n_um_6.07_i686-apple-darwin   0x00389b71 _um_shell + 3953
5   hadcm3n_um_6.07_i686-apple-darwin   0x000048e1 _main + 1153
6   hadcm3n_um_6.07_i686-apple-darwin   0x000027fb __start + 209
7   hadcm3n_um_6.07_i686-apple-darwin   0x00002729 start + 41

Thread 1:
0   libSystem.B.dylib                   0x95190c0e _mach_wait_until + 10
1   libSystem.B.dylib                   0x95218429 _nanosleep + 345
2   libSystem.B.dylib                   0x952182ca _usleep + 61
3   hadcm3n_um_6.07_i686-apple-darwin   0x00442ec0 __Z11boinc_sleepd + 188
4   hadcm3n_um_6.07_i686-apple-darwin   0x0043865e __Z12timer_threadPv + 78
5   libSystem.B.dylib                   0x951be259 __pthread_start + 345
6   libSystem.B.dylib                   0x951be0de _thread_start + 34

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc968 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x93d1b000 - 0x93d29fff /usr/lib/libz.1.dylib
0x95190000 - 0x95337fff /usr/lib/libSystem.B.dylib
0x97e5e000 - 0x97e61fff /usr/lib/system/libmathCommon.A.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=199, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.8 build 10K549
Sat May 18 09:10:03 2013

Thread 0 Crashed:
0   libSystem.B.dylib                   0x951f1c5a ___kill + 10
1   libSystem.B.dylib                   0x952845a5 _raise + 26
2   libSystem.B.dylib                   0x9529a6e4 _abort + 93
3   hadcm3n_um_6.07_i686-apple-darwin   0x00336cff _um_setup + 127
4   hadcm3n_um_6.07_i686-apple-darwin   0x00389b71 _um_shell + 3953
5   hadcm3n_um_6.07_i686-apple-darwin   0x000048e1 _main + 1153
6   hadcm3n_um_6.07_i686-apple-darwin   0x000027fb __start + 209
7   hadcm3n_um_6.07_i686-apple-darwin   0x00002729 start + 41

Thread 1:
0   libSystem.B.dylib                   0x95190c0e _mach_wait_until + 10
1   libSystem.B.dylib                   0x95218429 _nanosleep + 345
2   libSystem.B.dylib                   0x952182ca _usleep + 61
3   hadcm3n_um_6.07_i686-apple-darwin   0x00442ec0 __Z11boinc_sleepd + 188
4   hadcm3n_um_6.07_i686-apple-darwin   0x0043865e __Z12timer_threadPv + 78
5   libSystem.B.dylib                   0x951be259 __pthread_start + 345
6   libSystem.B.dylib                   0x951be0de _thread_start + 34

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc968 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x93d1b000 - 0x93d29fff /usr/lib/libz.1.dylib
0x95190000 - 0x95337fff /usr/lib/libSystem.B.dylib
0x97e5e000 - 0x97e61fff /usr/lib/system/libmathCommon.A.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=199, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.8 build 10K549
Sat May 18 09:10:06 2013

Thread 0 Crashed:
0   libSystem.B.dylib                   0x951f1c5a ___kill + 10
1   libSystem.B.dylib                   0x952845a5 _raise + 26
2   libSystem.B.dylib                   0x9529a6e4 _abort + 93
3   hadcm3n_um_6.07_i686-apple-darwin   0x00336cff _um_setup + 127
4   hadcm3n_um_6.07_i686-apple-darwin   0x00389b71 _um_shell + 3953
5   hadcm3n_um_6.07_i686-apple-darwin   0x000048e1 _main + 1153
6   hadcm3n_um_6.07_i686-apple-darwin   0x000027fb __start + 209
7   hadcm3n_um_6.07_i686-apple-darwin   0x00002729 start + 41

Thread 1:
0   libSystem.B.dylib                   0x95190c0e _mach_wait_until + 10
1   libSystem.B.dylib                   0x95218429 _nanosleep + 345
2   libSystem.B.dylib                   0x952182ca _usleep + 61
3   hadcm3n_um_6.07_i686-apple-darwin   0x00442ec0 __Z11boinc_sleepd + 188
4   hadcm3n_um_6.07_i686-apple-darwin   0x0043865e __Z12timer_threadPv + 78
5   libSystem.B.dylib                   0x951be259 __pthread_start + 345
6   libSystem.B.dylib                   0x951be0de _thread_start + 34

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc968 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x93d1b000 - 0x93d29fff /usr/lib/libz.1.dylib
0x95190000 - 0x95337fff /usr/lib/libSystem.B.dylib
0x97e5e000 - 0x97e61fff /usr/lib/system/libmathCommon.A.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=199, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.8 build 10K549
Sat May 18 09:10:09 2013

Thread 0 Crashed:
CPDN Monitor - Quit request from BOINC...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.8 build 10K549
Sat May 18 10:14:06 2013

Thread 0 Crashed:
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.8 build 10K549
Sun May 19 02:02:47 2013

Thread 0 Crashed:
0   libSystem.B.dylib                   0x951f1c5a ___kill + 10
1   libSystem.B.dylib                   0x952845a5 _raise + 26
2   libSystem.B.dylib                   0x9529a6e4 _abort + 93
3   hadcm3n_um_6.07_i686-apple-darwin   0x00336cff _um_setup + 127
4   hadcm3n_um_6.07_i686-apple-darwin   0x00389b71 _um_shell + 3953
5   hadcm3n_um_6.07_i686-apple-darwin   0x000048e1 _main + 1153
6   hadcm3n_um_6.07_i686-apple-darwin   0x000027fb __start + 209
7   hadcm3n_um_6.07_i686-apple-darwin   0x00002729 start + 41

Thread 1:
0   libSystem.B.dylib                   0x95190c0e _mach_wait_until + 10
1   libSystem.B.dylib                   0x95218429 _nanosleep + 345
2   libSystem.B.dylib                   0x952182ca _usleep + 61
3   hadcm3n_um_6.07_i686-apple-darwin   0x00442ec0 __Z11boinc_sleepd + 188
4   hadcm3n_um_6.07_i686-apple-darwin   0x0043865e __Z12timer_threadPv + 78
5   libSystem.B.dylib                   0x951be259 __pthread_start + 345
6   libSystem.B.dylib                   0x951be0de _thread_start + 34

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc968 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x93d1b000 - 0x93d29fff /usr/lib/libz.1.dylib
0x95190000 - 0x95337fff /usr/lib/libSystem.B.dylib
0x97e5e000 - 0x97e61fff /usr/lib/system/libmathCommon.A.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7352, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.8 build 10K549
Sun May 19 02:02:50 2013

Thread 0 Crashed:
0   libSystem.B.dylib                   0x951f1c5a ___kill + 10
1   libSystem.B.dylib                   0x952845a5 _raise + 26
2   libSystem.B.dylib                   0x9529a6e4 _abort + 93
3   hadcm3n_um_6.07_i686-apple-darwin   0x00336cff _um_setup + 127
4   hadcm3n_um_6.07_i686-apple-darwin   0x00389b71 _um_shell + 3953
5   hadcm3n_um_6.07_i686-apple-darwin   0x000048e1 _main + 1153
6   hadcm3n_um_6.07_i686-apple-darwin   0x000027fb __start + 209
7   hadcm3n_um_6.07_i686-apple-darwin   0x00002729 start + 41

Thread 1:
0   libSystem.B.dylib                   0x95190c0e _mach_wait_until + 10
1   libSystem.B.dylib                   0x95218429 _nanosleep + 345
2   libSystem.B.dylib                   0x952182ca _usleep + 61
3   hadcm3n_um_6.07_i686-apple-darwin   0x00442ec0 __Z11boinc_sleepd + 188
4   hadcm3n_um_6.07_i686-apple-darwin   0x0043865e __Z12timer_threadPv + 78
5   libSystem.B.dylib                   0x951be259 __pthread_start + 345
6   libSystem.B.dylib                   0x951be0de _thread_start + 34

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc968 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x93d1b000 - 0x93d29fff /usr/lib/libz.1.dylib
0x95190000 - 0x95337fff /usr/lib/libSystem.B.dylib
0x97e5e000 - 0x97e61fff /usr/lib/system/libmathCommon.A.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7352, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.8 build 10K549
Sun May 19 02:02:53 2013

Thread 0 Crashed:
0   libSystem.B.dylib                   0x951f1c5a ___kill + 10
1   libSystem.B.dylib                   0x952845a5 _raise + 26
2   libSystem.B.dylib                   0x9529a6e4 _abort + 93
3   hadcm3n_um_6.07_i686-apple-darwin   0x00336cff _um_setup + 127
4   hadcm3n_um_6.07_i686-apple-darwin   0x00389b71 _um_shell + 3953
5   hadcm3n_um_6.07_i686-apple-darwin   0x000048e1 _main + 1153
6   hadcm3n_um_6.07_i686-apple-darwin   0x000027fb __start + 209
7   hadcm3n_um_6.07_i686-apple-darwin   0x00002729 start + 41

Thread 1:
0   libSystem.B.dylib                   0x95190c0e _mach_wait_until + 10
1   libSystem.B.dylib                   0x95218429 _nanosleep + 345
2   libSystem.B.dylib                   0x952182ca _usleep + 61
3   hadcm3n_um_6.07_i686-apple-darwin   0x00442ec0 __Z11boinc_sleepd + 188
4   hadcm3n_um_6.07_i686-apple-darwin   0x0043865e __Z12timer_threadPv + 78
5   libSystem.B.dylib                   0x951be259 __pthread_start + 345
6   libSystem.B.dylib                   0x951be0de _thread_start + 34

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc968 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x93d1b000 - 0x93d29fff /usr/lib/libz.1.dylib
0x95190000 - 0x95337fff /usr/lib/libSystem.B.dylib
0x97e5e000 - 0x97e61fff /usr/lib/system/libmathCommon.A.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7352, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
18 May 2013 08:08:20 1063076 15688566 hadcm3n_u2sf_2020_40_008338399_0 933,120 1,019,487 1.0926
17 May 2013 22:29:30 1063076 15688566 hadcm3n_u2sf_2020_40_008338399_0 907,200 988,647 1.0898
17 May 2013 13:27:10 1063076 15688566 hadcm3n_u2sf_2020_40_008338399_0 881,280 957,877 1.0869
16 May 2013 18:40:43 1063076 15688566 hadcm3n_u2sf_2020_40_008338399_0 855,360 927,091 1.0839
16 May 2013 00:39:19 1063076 15688566 hadcm3n_u2sf_2020_40_008338399_0 829,440 896,272 1.0806
15 May 2013 13:57:20 1063076 15688566 hadcm3n_u2sf_2020_40_008338399_0 803,520 864,505 1.0759
15 May 2013 03:53:49 1063076 15688566 hadcm3n_u2sf_2020_40_008338399_0 777,600 833,100 1.0714
14 May 2013 00:35:37 1063076 15688566 hadcm3n_u2sf_2020_40_008338399_0 751,680 801,799 1.0667
30 Apr 2013 01:08:06 1063076 15688566 hadcm3n_u2sf_2020_40_008338399_0 725,760 770,126 1.0611
28 Apr 2013 19:37:16 1063076 15688566 hadcm3n_u2sf_2020_40_008338399_0 699,840 746,331 1.0664
28 Apr 2013 00:58:41 1063076 15688566 hadcm3n_u2sf_2020_40_008338399_0 673,920 715,198 1.0613
27 Apr 2013 14:00:13 1063076 15688566 hadcm3n_u2sf_2020_40_008338399_0 648,000 684,350 1.0561
27 Apr 2013 04:11:36 1063076 15688566 hadcm3n_u2sf_2020_40_008338399_0 622,080 653,283 1.0502
25 Apr 2013 17:56:59 1063076 15688566 hadcm3n_u2sf_2020_40_008338399_0 596,160 622,403 1.0440
20 Apr 2013 14:15:28 1063076 15688566 hadcm3n_u2sf_2020_40_008338399_0 570,240 591,837 1.0379
20 Apr 2013 04:12:28 1063076 15688566 hadcm3n_u2sf_2020_40_008338399_0 544,320 560,503 1.0297
18 Apr 2013 08:46:15 1063076 15688566 hadcm3n_u2sf_2020_40_008338399_0 518,400 529,749 1.0219
17 Apr 2013 23:01:06 1063076 15688566 hadcm3n_u2sf_2020_40_008338399_0 492,480 499,129 1.0135
17 Apr 2013 13:50:11 1063076 15688566 hadcm3n_u2sf_2020_40_008338399_0 466,560 468,310 1.0038
13 Apr 2013 05:52:34 1063076 15688566 hadcm3n_u2sf_2020_40_008338399_0 440,640 436,739 0.9911


©2024 climateprediction.net