climateprediction.net home page
Task 12912940

Task 12912940

Name hadcm3n_p39y_1900_40_007221830_2
Workunit 7420070
Created 31 May 2011, 3:32:09 UTC
Sent 31 May 2011, 3:32:13 UTC
Report deadline 30 Aug 2011, 10:59:24 UTC
Received 18 Jul 2011, 5:04:01 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1078336
Run time 19 days 18 hours 37 min 48 sec
CPU time 13 days 7 hours 29 min 29 sec
Validate state Invalid
Credit 6,531.84
Device peak FLOPS 1.88 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-apple-darwin
Stderr 
<core_client_version>6.10.56</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...

Model crashed: TEMPHIST: Failed in OPEN of history file                                                                                                                                                                                                                        tmp/pipe_dummy                                                                  2048    
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.8 build 10K540
Sun Jul  3 20:30:25 2011

Thread 0 Crashed:
CPDN Monitor - Quit request from BOINC...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.8 build 10K540
Mon Jul  4 22:08:19 2011

Thread 0 Crashed:
0   libSystem.B.dylib                   0x956fdc5a ___kill + 10
1   libSystem.B.dylib                   0x957905a5 _raise + 26
2   libSystem.B.dylib                   0x957a66e4 _abort + 93
3   hadcm3n_um_6.07_i686-apple-darwin   0x00336cff _um_setup + 127
4   hadcm3n_um_6.07_i686-apple-darwin   0x00389b71 _um_shell + 3953
5   hadcm3n_um_6.07_i686-apple-darwin   0x000048e1 _main + 1153
6   hadcm3n_um_6.07_i686-apple-darwin   0x000027fb __start + 209
7   hadcm3n_um_6.07_i686-apple-darwin   0x00002729 start + 41

Thread 1:
0   libSystem.B.dylib                   0x9569cc0e _mach_wait_until + 10
1   libSystem.B.dylib                   0x95724429 _nanosleep + 345
2   libSystem.B.dylib                   0x957242ca _usleep + 61
3   hadcm3n_um_6.07_i686-apple-darwin   0x00442ec0 __Z11boinc_sleepd + 188
4   hadcm3n_um_6.07_i686-apple-darwin   0x0043865e __Z12timer_threadPv + 78
5   libSystem.B.dylib                   0x956ca259 __pthread_start + 345
6   libSystem.B.dylib                   0x956ca0de _thread_start + 34

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc948 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x9568d000 - 0x9569bfff /usr/lib/libz.1.dylib
0x9569c000 - 0x95843fff /usr/lib/libSystem.B.dylib
0x97676000 - 0x97679fff /usr/lib/system/libmathCommon.A.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=32110, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.8 build 10K540
Mon Jul  4 22:08:22 2011

Thread 0 Crashed:
0   libSystem.B.dylib                   0x956fdc5a ___kill + 10
1   libSystem.B.dylib                   0x957905a5 _raise + 26
2   libSystem.B.dylib                   0x957a66e4 _abort + 93
3   hadcm3n_um_6.07_i686-apple-darwin   0x00336cff _um_setup + 127
4   hadcm3n_um_6.07_i686-apple-darwin   0x00389b71 _um_shell + 3953
5   hadcm3n_um_6.07_i686-apple-darwin   0x000048e1 _main + 1153
6   hadcm3n_um_6.07_i686-apple-darwin   0x000027fb __start + 209
7   hadcm3n_um_6.07_i686-apple-darwin   0x00002729 start + 41

Thread 1:
0   libSystem.B.dylib                   0x9569cc0e _mach_wait_until + 10
1   libSystem.B.dylib                   0x95724429 _nanosleep + 345
2   libSystem.B.dylib                   0x957242ca _usleep + 61
3   hadcm3n_um_6.07_i686-apple-darwin   0x00442ec0 __Z11boinc_sleepd + 188
4   hadcm3n_um_6.07_i686-apple-darwin   0x0043865e __Z12timer_threadPv + 78
5   libSystem.B.dylib                   0x956ca259 __pthread_start + 345
6   libSystem.B.dylib                   0x956ca0de _thread_start + 34

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc948 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x9568d000 - 0x9569bfff /usr/lib/libz.1.dylib
0x9569c000 - 0x95843fff /usr/lib/libSystem.B.dylib
0x97676000 - 0x97679fff /usr/lib/system/libmathCommon.A.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=32110, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.8 build 10K540
Mon Jul  4 22:08:27 2011

Thread 0 Crashed:
0   libSystem.B.dylib                   0x956fdc5a ___kill + 10
1   libSystem.B.dylib                   0x957905a5 _raise + 26
2   libSystem.B.dylib                   0x957a66e4 _abort + 93
3   hadcm3n_um_6.07_i686-apple-darwin   0x00336cff _um_setup + 127
4   hadcm3n_um_6.07_i686-apple-darwin   0x00389b71 _um_shell + 3953
5   hadcm3n_um_6.07_i686-apple-darwin   0x000048e1 _main + 1153
6   hadcm3n_um_6.07_i686-apple-darwin   0x000027fb __start + 209
7   hadcm3n_um_6.07_i686-apple-darwin   0x00002729 start + 41

Thread 1:
0   libSystem.B.dylib                   0x9569cc0e _mach_wait_until + 10
1   libSystem.B.dylib                   0x95724429 _nanosleep + 345
2   libSystem.B.dylib                   0x957242ca _usleep + 61
3   hadcm3n_um_6.07_i686-apple-darwin   0x00442ec0 __Z11boinc_sleepd + 188
4   hadcm3n_um_6.07_i686-apple-darwin   0x0043865e __Z12timer_threadPv + 78
5   libSystem.B.dylib                   0x956ca259 __pthread_start + 345
6   libSystem.B.dylib                   0x956ca0de _thread_start + 34

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc948 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x9568d000 - 0x9569bfff /usr/lib/libz.1.dylib
0x9569c000 - 0x95843fff /usr/lib/libSystem.B.dylib
0x97676000 - 0x97679fff /usr/lib/system/libmathCommon.A.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=32110, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.8 build 10K540
Mon Jul  4 22:08:31 2011

Thread 0 Crashed:
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.8 build 10K540
Sat Jul 16 22:03:31 2011

Thread 0 Crashed:
0   libSystem.B.dylib                   0x956fdc5a ___kill + 10
1   libSystem.B.dylib                   0x957905a5 _raise + 26
2   libSystem.B.dylib                   0x957a66e4 _abort + 93
3   hadcm3n_um_6.07_i686-apple-darwin   0x00336cff _um_setup + 127
4   hadcm3n_um_6.07_i686-apple-darwin   0x00389b71 _um_shell + 3953
5   hadcm3n_um_6.07_i686-apple-darwin   0x000048e1 _main + 1153
6   hadcm3n_um_6.07_i686-apple-darwin   0x000027fb __start + 209
7   hadcm3n_um_6.07_i686-apple-darwin   0x00002729 start + 41

Thread 1:
0   libSystem.B.dylib                   0x9569cc0e _mach_wait_until + 10
1   libSystem.B.dylib                   0x95724429 _nanosleep + 345
2   libSystem.B.dylib                   0x957242ca _usleep + 61
3   hadcm3n_um_6.07_i686-apple-darwin   0x00442ec0 __Z11boinc_sleepd + 188
4   hadcm3n_um_6.07_i686-apple-darwin   0x0043865e __Z12timer_threadPv + 78
5   libSystem.B.dylib                   0x956ca259 __pthread_start + 345
6   libSystem.B.dylib                   0x956ca0de _thread_start + 34

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc948 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x9568d000 - 0x9569bfff /usr/lib/libz.1.dylib
0x9569c000 - 0x95843fff /usr/lib/libSystem.B.dylib
0x97676000 - 0x97679fff /usr/lib/system/libmathCommon.A.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=27580, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.8 build 10K540
Sat Jul 16 22:03:34 2011

Thread 0 Crashed:
0   libSystem.B.dylib                   0x956fdc5a ___kill + 10
1   libSystem.B.dylib                   0x957905a5 _raise + 26
2   libSystem.B.dylib                   0x957a66e4 _abort + 93
3   hadcm3n_um_6.07_i686-apple-darwin   0x00336cff _um_setup + 127
4   hadcm3n_um_6.07_i686-apple-darwin   0x00389b71 _um_shell + 3953
5   hadcm3n_um_6.07_i686-apple-darwin   0x000048e1 _main + 1153
6   hadcm3n_um_6.07_i686-apple-darwin   0x000027fb __start + 209
7   hadcm3n_um_6.07_i686-apple-darwin   0x00002729 start + 41

Thread 1:
0   libSystem.B.dylib                   0x9569cc0e _mach_wait_until + 10
1   libSystem.B.dylib                   0x95724429 _nanosleep + 345
2   libSystem.B.dylib                   0x957242ca _usleep + 61
3   hadcm3n_um_6.07_i686-apple-darwin   0x00442ec0 __Z11boinc_sleepd + 188
4   hadcm3n_um_6.07_i686-apple-darwin   0x0043865e __Z12timer_threadPv + 78
5   libSystem.B.dylib                   0x956ca259 __pthread_start + 345
6   libSystem.B.dylib                   0x956ca0de _thread_start + 34

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc948 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x9568d000 - 0x9569bfff /usr/lib/libz.1.dylib
0x9569c000 - 0x95843fff /usr/lib/libSystem.B.dylib
0x97676000 - 0x97679fff /usr/lib/system/libmathCommon.A.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=27580, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.8 build 10K540
Sat Jul 16 22:03:37 2011

Thread 0 Crashed:
0   libSystem.B.dylib                   0x956fdc5a ___kill + 10
1   libSystem.B.dylib                   0x957905a5 _raise + 26
2   libSystem.B.dylib                   0x957a66e4 _abort + 93
3   hadcm3n_um_6.07_i686-apple-darwin   0x00336cff _um_setup + 127
4   hadcm3n_um_6.07_i686-apple-darwin   0x00389b71 _um_shell + 3953
5   hadcm3n_um_6.07_i686-apple-darwin   0x000048e1 _main + 1153
6   hadcm3n_um_6.07_i686-apple-darwin   0x000027fb __start + 209
7   hadcm3n_um_6.07_i686-apple-darwin   0x00002729 start + 41

Thread 1:
0   libSystem.B.dylib                   0x9569cc0e _mach_wait_until + 10
1   libSystem.B.dylib                   0x95724429 _nanosleep + 345
2   libSystem.B.dylib                   0x957242ca _usleep + 61
3   hadcm3n_um_6.07_i686-apple-darwin   0x00442ec0 __Z11boinc_sleepd + 188
4   hadcm3n_um_6.07_i686-apple-darwin   0x0043865e __Z12timer_threadPv + 78
5   libSystem.B.dylib                   0x956ca259 __pthread_start + 345
6   libSystem.B.dylib                   0x956ca0de _thread_start + 34

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc948 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x9568d000 - 0x9569bfff /usr/lib/libz.1.dylib
0x9569c000 - 0x95843fff /usr/lib/libSystem.B.dylib
0x97676000 - 0x97679fff /usr/lib/system/libmathCommon.A.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=27580, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
03 Jul 2011 21:30:53 1078336 12912940 hadcm3n_p39y_1900_40_007221830_2 544,320 1,136,531 2.0880
02 Jul 2011 14:29:19 1078336 12912940 hadcm3n_p39y_1900_40_007221830_2 518,400 1,065,558 2.0555
01 Jul 2011 08:03:24 1078336 12912940 hadcm3n_p39y_1900_40_007221830_2 492,480 996,154 2.0227
30 Jun 2011 04:07:48 1078336 12912940 hadcm3n_p39y_1900_40_007221830_2 466,560 926,275 1.9853
29 Jun 2011 07:37:55 1078336 12912940 hadcm3n_p39y_1900_40_007221830_2 440,640 856,873 1.9446
28 Jun 2011 04:46:40 1078336 12912940 hadcm3n_p39y_1900_40_007221830_2 414,720 787,203 1.8982
27 Jun 2011 06:28:11 1078336 12912940 hadcm3n_p39y_1900_40_007221830_2 388,800 717,718 1.8460
24 Jun 2011 20:21:50 1078336 12912940 hadcm3n_p39y_1900_40_007221830_2 362,880 650,860 1.7936
24 Jun 2011 20:21:50 1078336 12912940 hadcm3n_p39y_1900_40_007221830_2 336,960 582,007 1.7272
24 Jun 2011 20:21:50 1078336 12912940 hadcm3n_p39y_1900_40_007221830_2 311,040 509,474 1.6380
19 Jun 2011 22:05:39 1078336 12912940 hadcm3n_p39y_1900_40_007221830_2 285,120 437,206 1.5334
10 Jun 2011 12:50:41 1078336 12912940 hadcm3n_p39y_1900_40_007221830_2 259,200 365,896 1.4116
09 Jun 2011 12:46:55 1078336 12912940 hadcm3n_p39y_1900_40_007221830_2 233,280 292,903 1.2556
08 Jun 2011 13:03:51 1078336 12912940 hadcm3n_p39y_1900_40_007221830_2 207,360 220,276 1.0623
07 Jun 2011 13:27:25 1078336 12912940 hadcm3n_p39y_1900_40_007221830_2 181,440 147,712 0.8141
06 Jun 2011 13:49:01 1078336 12912940 hadcm3n_p39y_1900_40_007221830_2 155,520 75,051 0.4826
05 Jun 2011 14:12:42 1078336 12912940 hadcm3n_p39y_1900_40_007221830_2 129,600 2,476 0.0191
04 Jun 2011 14:37:21 1078336 12912940 hadcm3n_p39y_1900_40_007221830_2 103,680 290,733 2.8041
03 Jun 2011 14:46:12 1078336 12912940 hadcm3n_p39y_1900_40_007221830_2 77,760 218,105 2.8048
02 Jun 2011 15:02:05 1078336 12912940 hadcm3n_p39y_1900_40_007221830_2 51,840 145,633 2.8093


©2024 climateprediction.net