climateprediction.net home page
Task 11869792

Task 11869792

Name famous_v14n_1999_200_006721223_0
Workunit 6924473
Created 6 Sep 2010, 3:07:45 UTC
Sent 9 Sep 2010, 16:04:29 UTC
Report deadline 9 Dec 2010, 23:31:40 UTC
Received 11 Sep 2010, 22:03:09 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 844607
Run time 16 hours 30 min 41 sec
CPU time 16 hours 3 min 4 sec
Validate state Invalid
Credit 1,173.59
Device peak FLOPS 3.11 GFLOPS
Application version UK Met Office FAMOUS v6.11
i686-apple-darwin
Stderr
<core_client_version>6.10.17</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
om BOINC...
SIGSEGV: segmentation violation

Crashed executable name: famous_um_6.11_i686-apple-darwin
built using BOINC library version 6.11.1
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.4 build 10F569
Mon Aug 30 09:50:46 2010

sh: /usr/bin/atos: No such file or directory
  0  0x0048fdcf    1  0x0049054a    2  0x900781fb    3  0xffffffff    4  0x0134e6b3    5  0x0134d44f    6  0x003f5826    7  0x00450bd8    8  0x004698c0    9  0x000026b6   10  0x000025dd  
Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffd47c edx: 0x900120fa
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffd4b8 esp: 0xbfffd47c
   ss: 0x0000001f efl: 0x00000206 eip: 0x900120fa  cs: 0x00000007
   ds: 0x0000001f  es: 0x0000001f  fs: 0x00000000  gs: 0x00000037

Binary Images Description:
    0x1000 -   0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin
 0x12a9000 -  0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_ud37_1799_200_006649806/lib/libsvml.dylib
 0x131c000 -  0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_ud37_1799_200_006649806/lib/libifcoremt.dylib
 0x13fc000 -  0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_ud37_1799_200_006649806/lib/libimf.dylib
 0x1669000 -  0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_ud37_1799_200_006649806/lib/libirc.dylib
0x90011000 - 0x901b7fff /usr/lib/libSystem.B.dylib
0x95689000 - 0x95697fff /usr/lib/libz.1.dylib
0x975b1000 - 0x975b4fff /usr/lib/system/libmathCommon.A.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=45968, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation

Crashed executable name: famous_um_6.11_i686-apple-darwin
built using BOINC library version 6.11.1
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.4 build 10F569
Wed Sep  1 00:58:57 2010

sh: /usr/bin/atos: No such file or directory
  0  0x0048fdcf    1  0x0049054a    2  0x900781fb    3  0xffffffff    4  0x0134e6b3    5  0x0134d44f    6  0x002eeac6    7  0x003f55ea    8  0x00452abd    9  0x004698c0   10  0x000026b6   11  0x000025dd  
Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc3ec edx: 0x900120fa
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc428 esp: 0xbfffc3ec
   ss: 0x0000001f efl: 0x00000206 eip: 0x900120fa  cs: 0x00000007
   ds: 0x0000001f  es: 0x0000001f  fs: 0x00000000  gs: 0x00000037

Binary Images Description:
    0x1000 -   0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin
 0x12a9000 -  0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_ud37_1799_200_006649806/lib/libsvml.dylib
 0x131c000 -  0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_ud37_1799_200_006649806/lib/libifcoremt.dylib
 0x13fc000 -  0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_ud37_1799_200_006649806/lib/libimf.dylib
 0x1669000 -  0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_ud37_1799_200_006649806/lib/libirc.dylib
0x90011000 - 0x901b7fff /usr/lib/libSystem.B.dylib
0x95689000 - 0x95697fff /usr/lib/libz.1.dylib
0x975b1000 - 0x975b4fff /usr/lib/system/libmathCommon.A.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1173, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation

Crashed executable name: famous_um_6.11_i686-apple-darwin
built using BOINC library version 6.11.1
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.4 build 10F569
Wed Sep  1 01:52:36 2010

sh: /usr/bin/atos: No such file or directory
  0  0x0048fdcf    1  0x0049054a    2  0x900781fb    3  0xffffffff    4  0x0134e6b3    5  0x0134d44f    6  0x003f5826    7  0x00450bd8    8  0x004698c0    9  0x000026b6   10  0x000025dd  
Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffd47c edx: 0x900120fa
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffd4b8 esp: 0xbfffd47c
   ss: 0x0000001f efl: 0x00000206 eip: 0x900120fa  cs: 0x00000007
   ds: 0x0000001f  es: 0x0000001f  fs: 0x00000000  gs: 0x00000037

Binary Images Description:
    0x1000 -   0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin
 0x12a9000 -  0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_ud37_1799_200_006649806/lib/libsvml.dylib
 0x131c000 -  0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_ud37_1799_200_006649806/lib/libifcoremt.dylib
 0x13fc000 -  0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_ud37_1799_200_006649806/lib/libimf.dylib
 0x1669000 -  0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_ud37_1799_200_006649806/lib/libirc.dylib
0x90011000 - 0x901b7fff /usr/lib/libSystem.B.dylib
0x95689000 - 0x95697fff /usr/lib/libz.1.dylib
0x975b1000 - 0x975b4fff /usr/lib/system/libmathCommon.A.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2369, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation

Crashed executable name: famous_um_6.11_i686-apple-darwin
built using BOINC library version 6.11.1
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.4 build 10F569
Thu Sep  2 10:08:35 2010

sh: /usr/bin/atos: No such file or directory
  0  0x0048fdcf    1  0x0049054a    2  0x900781fb    3  0xffffffff    4  0x0134e6b3    5  0x0134d44f    6  0x002eeac6    7  0x003f55ea    8  0x00452abd    9  0x004698c0   10  0x000026b6   11  0x000025dd  
Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc3ec edx: 0x900120fa
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc428 esp: 0xbfffc3ec
   ss: 0x0000001f efl: 0x00000206 eip: 0x900120fa  cs: 0x00000007
   ds: 0x0000001f  es: 0x0000001f  fs: 0x00000000  gs: 0x00000037

Binary Images Description:
    0x1000 -   0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin
 0x12a9000 -  0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_ud37_1799_200_006649806/lib/libsvml.dylib
 0x131c000 -  0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_ud37_1799_200_006649806/lib/libifcoremt.dylib
 0x13fc000 -  0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_ud37_1799_200_006649806/lib/libimf.dylib
 0x1669000 -  0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_ud37_1799_200_006649806/lib/libirc.dylib
0x90011000 - 0x901b7fff /usr/lib/libSystem.B.dylib
0x95689000 - 0x95697fff /usr/lib/libz.1.dylib
0x975b1000 - 0x975b4fff /usr/lib/system/libmathCommon.A.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1133, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation

Crashed executable name: famous_um_6.11_i686-apple-darwin
built using BOINC library version 6.11.1
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.4 build 10F569
Thu Sep  2 18:13:09 2010

sh: /usr/bin/atos: No such file or directory
  0  0x0048fdcf    1  0x0049054a    2  0x900781fb    3  0xffffffff    4  0x0134e6b3    5  0x0134d44f    6  0x002eeac6    7  0x003f55ea    8  0x00452abd    9  0x004698c0   10  0x000026b6   11  0x000025dd  
Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc3ec edx: 0x900120fa
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc428 esp: 0xbfffc3ec
   ss: 0x0000001f efl: 0x00000206 eip: 0x900120fa  cs: 0x00000007
   ds: 0x0000001f  es: 0x0000001f  fs: 0x00000000  gs: 0x00000037

Binary Images Description:
    0x1000 -   0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin
 0x12a9000 -  0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_ud37_1799_200_006649806/lib/libsvml.dylib
 0x131c000 -  0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_ud37_1799_200_006649806/lib/libifcoremt.dylib
 0x13fc000 -  0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_ud37_1799_200_006649806/lib/libimf.dylib
 0x1669000 -  0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_ud37_1799_200_006649806/lib/libirc.dylib
0x90011000 - 0x901b7fff /usr/lib/libSystem.B.dylib
0x95689000 - 0x95697fff /usr/lib/libz.1.dylib
0x975b1000 - 0x975b4fff /usr/lib/system/libmathCommon.A.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=17103, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
 (2809): called boinc_finish
[2010- 9- 5  0:51:36:] :: BOINC:: Initializing ... ok.
[2010- 9- 5  0:51:36:] :: BOINC :: boinc_init()
BOINC:: Setting up shared resources ... ok.
BOINC:: Setting up semaphores ... ok.
BOINC:: Updating status ... ok.
BOINC:: Registering timer callback... ok.
BOINC:: Worker initialized successfully. 
Registering options.. 
Registered extra options.
Initializing broker options ...
Registered extra options.
Initializing core...
Initializing options.... ok 
Options::initialize()
Options::adding_options()
Options::initialize() Check specs.
Options::initialize()  End reached
Loaded options.... ok 
Processed options.... ok 
Initializing random generators... ok 
Initialization complete. 
Setting WU description ...
Unpacking zip data: ../../projects/boinc.bakerlab.org_rosetta/minirosetta_database_rev36507.zip
Unpacking WU data ...
Unpacking data: ../../projects/boinc.bakerlab.org_rosetta/yfsong_lr5_jorj_combined_torsion_it05_run01_A.zip
Unpacking data: ../../projects/boinc.bakerlab.org_rosetta/lr5_2vik.out.zip
Setting database description ...
Setting up checkpointing ...
Setting up graphics native ...
BOINC:: Worker startup. 
Starting watchdog...
Watchdog active.
Fullatom mode .. 
FILE_LOCK::unlock(): close failed.: Bad file descriptor
[2010- 9- 5  1:50:22:] :: BOINC:: Initializing ... ok.
[2010- 9- 5  1:50:22:] :: BOINC :: boinc_init()
BOINC:: Setting up shared resources ... ok.
BOINC:: Setting up semaphores ... ok.
BOINC:: Updating status ... ok.
BOINC:: Registering timer callback... ok.
BOINC:: Worker initialized successfully. 
Registering options.. 
Registered extra options.
Initializing broker options ...
Registered extra options.
Initializing core...
Initializing options.... ok 
Options::initialize()
Options::adding_options()
Options::initialize() Check specs.
Options::initialize()  End reached
Loaded options.... ok 
Processed options.... ok 
Initializing random generators... ok 
Initialization complete. 
Setting WU description ...
Unpacking zip data: ../../projects/boinc.bakerlab.org_rosetta/minirosetta_database_rev36507.zip
Unpacking WU data ...
Unpacking data: ../../projects/boinc.bakerlab.org_rosetta/yfsong_lr5_jorj_combined_torsion_it05_run01_A.zip
Unpacking data: ../../projects/boinc.bakerlab.org_rosetta/lr5_2vik.out.zip
Setting database description ...
Setting up checkpointing ...
Setting up graphics native ...
BOINC:: Worker startup. 
Starting watchdog...
Watchdog active.
Fullatom mode .. 
Continuing computation from checkpoint: chk_F_00005_0001872_0_0001_FastRelax__chk1_fa ... success! 
Continuing computation from checkpoint: chk_F_00005_0001872_0_0001_FastRelax__chk2_fa ... success! 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
======================================================
DONE ::    23 starting structures  10505.1 cpu seconds
This process generated     23 decoys from      23 attempts
======================================================

BOINC :: Watchdog shutting down...
BOINC :: BOINC support services shutting down cleanly ...
called boinc_finish
[2010- 9- 5  4:58:22:] :: BOINC:: Initializing ... ok.
[2010- 9- 5  4:58:22:] :: BOINC :: boinc_init()
BOINC:: Setting up shared resources ... ok.
BOINC:: Setting up semaphores ... ok.
BOINC:: Updating status ... ok.
BOINC:: Registering timer callback... ok.
BOINC:: Worker initialized successfully. 
Registering options.. 
Registered extra options.
Initializing broker options ...
Registered extra options.
Initializing core...
Initializing options.... ok 
Options::initialize()
Options::adding_options()
Options::initialize() Check specs.
Options::initialize()  End reached
Loaded options.... ok 
Processed options.... ok 
Initializing random generators... ok 
Initialization complete. 
Setting WU description ...
Unpacking zip data: ../../projects/boinc.bakerlab.org_rosetta/minirosetta_database_rev36507.zip
Setting database description ...
Setting up checkpointing ...
Setting up graphics native ...
Setting up folding (abrelax) ...
Beginning folding (abrelax) ... 
BOINC:: Worker startup. 
Starting watchdog...
Watchdog active.
Starting work on structure: _00001
Starting work on structure: _00002
Starting work on structure: _00003
Starting work on structure: _00004
Starting work on structure: _00005
Starting work on structure: _00006
Starting work on structure: _00007
Starting work on structure: _00008
Starting work on structure: _00009
Starting work on structure: _00010
Starting work on structure: _00011
Starting work on structure: _00012
Starting work on structure: _00013
======================================================
DONE ::     1 starting structures  10413.3 cpu seconds
This process generated     13 decoys from      13 attempts
======================================================

BOINC :: Watchdog shutting down...
BOINC :: BOINC support services shutting down cleanly ...
called boinc_finish
[2010- 9- 5  8: 4: 3:] :: BOINC:: Initializing ... ok.
[2010- 9- 5  8: 4: 3:] :: BOINC :: boinc_init()
BOINC:: Setting up shared resources ... ok.
BOINC:: Setting up semaphores ... ok.
BOINC:: Updating status ... ok.
BOINC:: Registering timer callback... ok.
BOINC:: Worker initialized successfully. 
Registering options.. 
Registered extra options.
Initializing broker options ...
Registered extra options.
Initializing core...
Initializing options.... ok 
Options::initialize()
Options::adding_options()
Options::initialize() Check specs.
Options::initialize()  End reached
Loaded options.... ok 
Processed options.... ok 
Initializing random generators... ok 
Initialization complete. 
Setting WU description ...
Unpacking zip data: ../../projects/boinc.bakerlab.org_rosetta/minirosetta_database_rev36507.zip
Unpacking WU data ...
Unpacking data: ../../projects/boinc.bakerlab.org_rosetta/yfsong_lrm_jorj_combined_torsion_it06_run01_A.zip
Unpacking data: ../../projects/boinc.bakerlab.org_rosetta/lr5_2h28.fix.out.zip
Setting database description ...
Setting up checkpointing ...
Setting up graphics native ...
BOINC:: Worker startup. 
Starting watchdog...
Watchdog active.
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
======================================================
DONE ::    49 starting structures  10664.8 cpu seconds
This process generated     49 decoys from      49 attempts
======================================================

BOINC :: Watchdog shutting down...
BOINC :: BOINC support services shutting down cleanly ...
called boinc_finish
[2010- 9- 5 11: 2: 5:] :: BOINC:: Initializing ... ok.
[2010- 9- 5 11: 2: 5:] :: BOINC :: boinc_init()
BOINC:: Setting up shared resources ... ok.
BOINC:: Setting up semaphores ... ok.
BOINC:: Updating status ... ok.
BOINC:: Registering timer callback... ok.
BOINC:: Worker initialized successfully. 
Registering options.. 
Registered extra options.
Initializing broker options ...
Registered extra options.
Initializing core...
Initializing options.... ok 
Options::initialize()
Options::adding_options()
Options::initialize() Check specs.
Options::initialize()  End reached
Loaded options.... ok 
Processed options.... ok 
Initializing random generators... ok 
Initialization complete. 
Setting WU description ...
Unpacking zip data: ../../projects/boinc.bakerlab.org_rosetta/minirosetta_database_rev36507.zip
Setting database description ...
Setting up checkpointing ...
Setting up graphics native ...
Setting up folding (abrelax) ...
Beginning folding (abrelax) ... 
BOINC:: Worker startup. 
Starting watchdog...
Watchdog active.
Starting work on structure: _00001
Starting work on structure: _00002
Starting work on structure: _00003
Starting work on structure: _00004
Starting work on structure: _00005
Starting work on structure: _00006
Starting work on structure: _00007
FILE_LOCK::unlock(): close failed.: Bad file descriptor
[2010- 9- 5 21:51:19:] :: BOINC:: Initializing ... ok.
[2010- 9- 5 21:51:19:] :: BOINC :: boinc_init()
BOINC:: Setting up shared resources ... ok.
BOINC:: Setting up semaphores ... ok.
BOINC:: Updating status ... ok.
BOINC:: Registering timer callback... ok.
BOINC:: Worker initialized successfully. 
Registering options.. 
Registered extra options.
Initializing broker options ...
Registered extra options.
Initializing core...
Initializing options.... ok 
Options::initialize()
Options::adding_options()
Options::initialize() Check specs.
Options::initialize()  End reached
Loaded options.... ok 
Processed options.... ok 
Initializing random generators... ok 
Initialization complete. 
Setting WU description ...
Unpacking zip data: ../../projects/boinc.bakerlab.org_rosetta/minirosetta_database_rev36507.zip
Setting database description ...
Setting up checkpointing ...
Setting up graphics native ...
Setting up folding (abrelax) ...
Beginning folding (abrelax) ... 
BOINC:: Worker startup. 
Starting watchdog...
Watchdog active.
Starting work on structure: _00007
Continuing computation from checkpoint: chk_S_00000007_ClassicAbinitio__stage_1 ... success! 
Continuing computation from checkpoint: chk_S_00000007_ClassicAbinitio__stage_2 ... success! 
Continuing computation from checkpoint: chk_S_00000007_ClassicAbinitio__stage_3_iter1_1 ... success! 
Continuing computation from checkpoint: chk_S_00000007_ClassicAbinitio__stage_3_iter1_2 ... success! 
Continuing computation from checkpoint: chk_S_00000007_ClassicAbinitio__stage_3_iter1_3 ... success! 
Continuing computation from checkpoint: chk_S_00000007_ClassicAbinitio__stage_3_iter1_4 ... success! 
Continuing computation from checkpoint: chk_S_00000007_ClassicAbinitio__stage_3_iter1_5 ... success! 
Continuing computation from checkpoint: chk_S_00000007_ClassicAbinitio__stage_3_iter1_6 ... success! 
Continuing computation from checkpoint: chk_S_00000007_ClassicAbinitio__stage_3_iter1_7 ... success! 
Continuing computation from checkpoint: chk_S_00000007_ClassicAbinitio__stage_3_iter1_8 ... success! 
Continuing computation from checkpoint: chk_S_00000007_ClassicAbinitio__stage_3_iter1_9 ... success! 
Continuing computation from checkpoint: chk_S_00000007_ClassicAbinitio__stage_3_iter1_10 ... success! 
Continuing computation from checkpoint: chk_S_00000007_ClassicAbinitio__stage4_kk_1 ... success! 
[2010- 9- 5 22: 9:52:] :: BOINC:: Initializing ... ok.
[2010- 9- 5 22: 9:52:] :: BOINC :: boinc_init()
BOINC:: Setting up shared resources ... ok.
BOINC:: Setting up semaphores ... ok.
BOINC:: Updating status ... ok.
BOINC:: Registering timer callback... ok.
BOINC:: Worker initialized successfully. 
Registering options.. 
Registered extra options.
Initializing broker options ...
Registered extra options.
Initializing core...
Initializing options.... ok 
Options::initialize()
Options::adding_options()
Options::initialize() Check specs.
Options::initialize()  End reached
Loaded options.... ok 
Processed options.... ok 
Initializing random generators... ok 
Initialization complete. 
Setting WU description ...
Unpacking zip data: ../../projects/boinc.bakerlab.org_rosetta/minirosetta_database_rev36507.zip
Setting database description ...
Setting up checkpointing ...
Setting up graphics native ...
Setting up folding (abrelax) ...
Beginning folding (abrelax) ... 
BOINC:: Worker startup. 
Starting watchdog...
Watchdog active.
Starting work on structure: _00007
Continuing computation from checkpoint: chk_S_00000007_ClassicAbinitio__stage_1 ... success! 
Continuing computation from checkpoint: chk_S_00000007_ClassicAbinitio__stage_2 ... success! 
Continuing computation from checkpoint: chk_S_00000007_ClassicAbinitio__stage_3_iter1_1 ... success! 
Continuing computation from checkpoint: chk_S_00000007_ClassicAbinitio__stage_3_iter1_2 ... success! 
Continuing computation from checkpoint: chk_S_00000007_ClassicAbinitio__stage_3_iter1_3 ... success! 
Continuing computation from checkpoint: chk_S_00000007_ClassicAbinitio__stage_3_iter1_4 ... success! 
Continuing computation from checkpoint: chk_S_00000007_ClassicAbinitio__stage_3_iter1_5 ... success! 
Continuing computation from checkpoint: chk_S_00000007_ClassicAbinitio__stage_3_iter1_6 ... success! 
Continuing computation from checkpoint: chk_S_00000007_ClassicAbinitio__stage_3_iter1_7 ... success! 
Continuing computation from checkpoint: chk_S_00000007_ClassicAbinitio__stage_3_iter1_8 ... success! 
Continuing computation from checkpoint: chk_S_00000007_ClassicAbinitio__stage_3_iter1_9 ... success! 
Continuing computation from checkpoint: chk_S_00000007_ClassicAbinitio__stage_3_iter1_10 ... success! 
Continuing computation from checkpoint: chk_S_00000007_ClassicAbinitio__stage4_kk_1 ... success! 
FILE_LOCK::unlock(): close failed.: Bad file descriptor
[2010- 9- 5 23: 9:11:] :: BOINC:: Initializing ... ok.
[2010- 9- 5 23: 9:11:] :: BOINC :: boinc_init()
BOINC:: Setting up shared resources ... ok.
BOINC:: Setting up semaphores ... ok.
BOINC:: Updating status ... ok.
BOINC:: Registering timer callback... ok.
BOINC:: Worker initialized successfully. 
Registering options.. 
Registered extra options.
Initializing broker options ...
Registered extra options.
Initializing core...
Initializing options.... ok 
Options::initialize()
Options::adding_options()
Options::initialize() Check specs.
Options::initialize()  End reached
Loaded options.... ok 
Processed options.... ok 
Initializing random generators... ok 
Initialization complete. 
Setting WU description ...
Unpacking zip data: ../../projects/boinc.bakerlab.org_rosetta/minirosetta_database_rev36507.zip
Setting database description ...
Setting up checkpointing ...
Setting up graphics native ...
Setting up folding (abrelax) ...
Beginning folding (abrelax) ... 
BOINC:: Worker startup. 
Starting watchdog...
Watchdog active.
Starting work on structure: _00007
Continuing computation from checkpoint: chk_S_00000007_ClassicAbinitio__stage_1 ... success! 
Continuing computation from checkpoint: chk_S_00000007_ClassicAbinitio__stage_2 ... success! 
Continuing computation from checkpoint: chk_S_00000007_ClassicAbinitio__stage_3_iter1_1 ... success! 
Continuing computation from checkpoint: chk_S_00000007_ClassicAbinitio__stage_3_iter1_2 ... success! 
Continuing computation from checkpoint: chk_S_00000007_ClassicAbinitio__stage_3_iter1_3 ... success! 
Continuing computation from checkpoint: chk_S_00000007_ClassicAbinitio__stage_3_iter1_4 ... success! 
Continuing computation from checkpoint: chk_S_00000007_ClassicAbinitio__stage_3_iter1_5 ... success! 
Continuing computation from checkpoint: chk_S_00000007_ClassicAbinitio__stage_3_iter1_6 ... success! 
Continuing computation from checkpoint: chk_S_00000007_ClassicAbinitio__stage_3_iter1_7 ... success! 
Continuing computation from checkpoint: chk_S_00000007_ClassicAbinitio__stage_3_iter1_8 ... success! 
Continuing computation from checkpoint: chk_S_00000007_ClassicAbinitio__stage_3_iter1_9 ... success! 
Continuing computation from checkpoint: chk_S_00000007_ClassicAbinitio__stage_3_iter1_10 ... success! 
Continuing computation from checkpoint: chk_S_00000007_ClassicAbinitio__stage4_kk_1 ... success! 
Continuing computation from checkpoint: chk_S_00000007_ClassicAbinitio__stage4_kk_2 ... success! 
Continuing computation from checkpoint: chk_S_00000007_ClassicAbinitio__stage4_kk_3 ... success! 
Starting work on structure: _00008
Starting work on structure: _00009
Starting work on structure: _00010
Starting work on structure: _00011
Starting work on structure: _00012
Starting work on structure: _00013
Starting work on structure: _00014
======================================================
DONE ::     1 starting structures  10657.7 cpu seconds
This process generated     14 decoys from      14 attempts
======================================================

BOINC :: Watchdog shutting down...
BOINC :: BOINC support services shutting down cleanly ...
called boinc_finish
[2010- 9- 6  0:51: 4:] :: BOINC:: Initializing ... ok.
[2010- 9- 6  0:51: 4:] :: BOINC :: boinc_init()
BOINC:: Setting up shared resources ... ok.
BOINC:: Setting up semaphores ... ok.
BOINC:: Updating status ... ok.
BOINC:: Registering timer callback... ok.
BOINC:: Worker initialized successfully. 
Registering options.. 
Registered extra options.
Initializing broker options ...
Registered extra options.
Initializing core...
Initializing options.... ok 
Options::initialize()
Options::adding_options()
Options::initialize() Check specs.
Options::initialize()  End reached
Loaded options.... ok 
Processed options.... ok 
Initializing random generators... ok 
Initialization complete. 
Setting WU description ...
Unpacking zip data: ../../projects/boinc.bakerlab.org_rosetta/minirosetta_database_rev36507.zip
Unpacking WU data ...
Unpacking data: ../../projects/boinc.bakerlab.org_rosetta/yfsong_lrm_ghoo_sc12_run01_A.zip
Unpacking data: ../../projects/boinc.bakerlab.org_rosetta/lr10_1cc8.fix.out.zip
Setting database description ...
Setting up checkpointing ...
Setting up graphics native ...
BOINC:: Worker startup. 
Starting watchdog...
Watchdog active.
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
FILE_LOCK::unlock(): close failed.: Bad file descriptor
[2010- 9- 6  1:53:41:] :: BOINC:: Initializing ... ok.
[2010- 9- 6  1:53:41:] :: BOINC :: boinc_init()
BOINC:: Setting up shared resources ... ok.
BOINC:: Setting up semaphores ... ok.
BOINC:: Updating status ... ok.
BOINC:: Registering timer callback... ok.
BOINC:: Worker initialized successfully. 
Registering options.. 
Registered extra options.
Initializing broker options ...
Registered extra options.
Initializing core...
Initializing options.... ok 
Options::initialize()
Options::adding_options()
Options::initialize() Check specs.
Options::initialize()  End reached
Loaded options.... ok 
Processed options.... ok 
Initializing random generators... ok 
Initialization complete. 
Setting WU description ...
Unpacking zip data: ../../projects/boinc.bakerlab.org_rosetta/minirosetta_database_rev36507.zip
Unpacking WU data ...
Unpacking data: ../../projects/boinc.bakerlab.org_rosetta/yfsong_lrm_ghoo_sc12_run01_A.zip
Unpacking data: ../../projects/boinc.bakerlab.org_rosetta/lr10_1cc8.fix.out.zip
Setting database description ...
Setting up checkpointing ...
Setting up graphics native ...
BOINC:: Worker startup. 
Starting watchdog...
Watchdog active.
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
FILE_LOCK::unlock(): close failed.: Bad file descriptor
[2010- 9- 7 14:11:12:] :: BOINC:: Initializing ... ok.
[2010- 9- 7 14:11:12:] :: BOINC :: boinc_init()
BOINC:: Setting up shared resources ... ok.
BOINC:: Setting up semaphores ... ok.
BOINC:: Updating status ... ok.
BOINC:: Registering timer callback... ok.
BOINC:: Worker initialized successfully. 
Registering options.. 
Registered extra options.
Initializing broker options ...
Registered extra options.
Initializing core...
Initializing options.... ok 
Options::initialize()
Options::adding_options()
Options::initialize() Check specs.
Options::initialize()  End reached
Loaded options.... ok 
Processed options.... ok 
Initializing random generators... ok 
Initialization complete. 
Setting WU description ...
Unpacking zip data: ../../projects/boinc.bakerlab.org_rosetta/minirosetta_database_rev36507.zip
Unpacking WU data ...
Unpacking data: ../../projects/boinc.bakerlab.org_rosetta/yfsong_lrm_ghoo_sc12_run01_A.zip
Unpacking data: ../../projects/boinc.bakerlab.org_rosetta/lr10_1cc8.fix.out.zip
Setting database description ...
Setting up checkpointing ...
Setting up graphics native ...
BOINC:: Worker startup. 
Starting watchdog...
Watchdog active.
Fullatom mode .. 
Fullatom mode .. 
======================================================
DONE ::   112 starting structures  7648.99 cpu seconds
This process generated    112 decoys from     112 attempts
======================================================

BOINC :: Watchdog shutting down...
BOINC :: BOINC support services shutting down cleanly ...
called boinc_finish
[2010- 9- 7 14:15: 0:] :: BOINC:: Initializing ... ok.
[2010- 9- 7 14:15: 0:] :: BOINC :: boinc_init()
BOINC:: Setting up shared resources ... ok.
BOINC:: Setting up semaphores ... ok.
BOINC:: Updating status ... ok.
BOINC:: Registering timer callback... ok.
BOINC:: Worker initialized successfully. 
Registering options.. 
Registered extra options.
Initializing broker options ...
Registered extra options.
Initializing core...
Initializing options.... ok 
Options::initialize()
Options::adding_options()
Options::initialize() Check specs.
Options::initialize()  End reached
Loaded options.... ok 
Processed options.... ok 
Initializing random generators... ok 
Initialization complete. 
Setting WU description ...
Unpacking zip data: ../../projects/boinc.bakerlab.org_rosetta/minirosetta_database_rev36507.zip
Unpacking WU data ...
Unpacking data: ../../projects/boinc.bakerlab.org_rosetta/yfsong_lrm_jorj_combined_torsion_it06_run01_A.zip
Unpacking data: ../../projects/boinc.bakerlab.org_rosetta/lr10_2fls.fix.out.zip
Setting database description ...
Setting up checkpointing ...
Setting up graphics native ...

ERROR: Unable to open weights. Neither  ./dslf_weights.wts nor dslf_weights.wts nor minirosetta_database/scoring/weights/dslf_weights.wts exist
ERROR:: Exit from: src/core/scoring/ScoreFunctionFactory.cc line: 178
BOINC:: Error reading and gzipping output datafile: default.out
called boinc_finish
[2010- 9- 7 14:15:46:] :: BOINC:: Initializing ... ok.
[2010- 9- 7 14:15:46:] :: BOINC :: boinc_init()
BOINC:: Setting up shared resources ... ok.
BOINC:: Setting up semaphores ... ok.
BOINC:: Updating status ... ok.
BOINC:: Registering timer callback... ok.
BOINC:: Worker initialized successfully. 
Registering options.. 
Registered extra options.
Initializing broker options ...
Registered extra options.
Initializing core...
Initializing options.... ok 
Options::initialize()
Options::adding_options()
Options::initialize() Check specs.
Options::initialize()  End reached
Loaded options.... ok 
Processed options.... ok 
Initializing random generators... ok 
Initialization complete. 
Setting WU description ...
Unpacking zip data: ../../projects/boinc.bakerlab.org_rosetta/minirosetta_database_rev36507.zip
Setting database description ...
Setting up checkpointing ...
Setting up graphics native ...
Setting up folding (abrelax) ...
Beginning folding (abrelax) ... 
BOINC:: Worker startup. 
Starting watchdog...
Watchdog active.
Starting work on structure: _00001
Starting work on structure: _00002
Starting work on structure: _00003
Starting work on structure: _00004
Starting work on structure: _00005
Starting work on structure: _00006
Starting work on structure: _00007
Starting work on structure: _00008
Starting work on structure: _00009
Starting work on structure: _00010
Starting work on structure: _00011
Starting work on structure: _00012
FILE_LOCK::unlock(): close failed.: Bad file descriptor
[2010- 9- 9  0:32:51:] :: BOINC:: Initializing ... ok.
[2010- 9- 9  0:32:51:] :: BOINC :: boinc_init()
BOINC:: Setting up shared resources ... ok.
BOINC:: Setting up semaphores ... ok.
BOINC:: Updating status ... ok.
BOINC:: Registering timer callback... ok.
BOINC:: Worker initialized successfully. 
Registering options.. 
Registered extra options.
Initializing broker options ...
Registered extra options.
Initializing core...
Initializing options.... ok 
Options::initialize()
Options::adding_options()
Options::initialize() Check specs.
Options::initialize()  End reached
Loaded options.... ok 
Processed options.... ok 
Initializing random generators... ok 
Initialization complete. 
Setting WU description ...
Unpacking zip data: ../../projects/boinc.bakerlab.org_rosetta/minirosetta_database_rev36507.zip
Setting database description ...
Setting up checkpointing ...
Setting up graphics native ...
Setting up folding (abrelax) ...
Beginning folding (abrelax) ... 
BOINC:: Worker startup. 
Starting watchdog...
Watchdog active.
Starting work on structure: _00012
Starting work on structure: _00013
Starting work on structure: _00014
Starting work on structure: _00015
Starting work on structure: _00016
FILE_LOCK::unlock(): close failed.: Bad file descriptor
[2010- 9- 9  1:49:55:] :: BOINC:: Initializing ... ok.
[2010- 9- 9  1:49:55:] :: BOINC :: boinc_init()
BOINC:: Setting up shared resources ... ok.
BOINC:: Setting up semaphores ... ok.
BOINC:: Updating status ... ok.
BOINC:: Registering timer callback... ok.
BOINC:: Worker initialized successfully. 
Registering options.. 
Registered extra options.
Initializing broker options ...
Registered extra options.
Initializing core...
Initializing options.... ok 
Options::initialize()
Options::adding_options()
Options::initialize() Check specs.
Options::initialize()  End reached
Loaded options.... ok 
Processed options.... ok 
Initializing random generators... ok 
Initialization complete. 
Setting WU description ...
Unpacking zip data: ../../projects/boinc.bakerlab.org_rosetta/minirosetta_database_rev36507.zip
Setting database description ...
Setting up checkpointing ...
Setting up graphics native ...
Setting up folding (abrelax) ...
Beginning folding (abrelax) ... 
BOINC:: Worker startup. 
Starting watchdog...
Watchdog active.
Starting work on structure: _00016
Continuing computation from checkpoint: chk_S_00000016_ClassicAbinitio__stage_1 ... success! 
Continuing computation from checkpoint: chk_S_00000016_ClassicAbinitio__stage_2 ... success! 
Continuing computation from checkpoint: chk_S_00000016_ClassicAbinitio__stage_3_iter1_1 ... success! 
Continuing computation from checkpoint: chk_S_00000016_ClassicAbinitio__stage_3_iter1_2 ... success! 
Continuing computation from checkpoint: chk_S_00000016_ClassicAbinitio__stage_3_iter1_3 ... success! 
Continuing computation from checkpoint: chk_S_00000016_ClassicAbinitio__stage_3_iter1_4 ... success! 
Continuing computation from checkpoint: chk_S_00000016_ClassicAbinitio__stage_3_iter1_5 ... success! 
Continuing computation from checkpoint: chk_S_00000016_ClassicAbinitio__stage_3_iter1_6 ... success! 
Continuing computation from checkpoint: chk_S_00000016_ClassicAbinitio__stage_3_iter1_7 ... success! 
Continuing computation from checkpoint: chk_S_00000016_ClassicAbinitio__stage_3_iter1_8 ... success! 
Continuing computation from checkpoint: chk_S_00000016_ClassicAbinitio__stage_3_iter1_9 ... success! 
Continuing computation from checkpoint: chk_S_00000016_ClassicAbinitio__stage_3_iter1_10 ... success! 
Continuing computation from checkpoint: chk_S_00000016_ClassicAbinitio__stage4_kk_1 ... success! 
Continuing computation from checkpoint: chk_S_00000016_ClassicAbinitio__stage4_kk_2 ... success! 
Continuing computation from checkpoint: chk_S_00000016_ClassicAbinitio__stage4_kk_3 ... success! 
Continuing computation from checkpoint: chk_stage_1_ClassicRelax__S_00000016_fa ... success! 
Starting work on structure: _00017
Starting work on structure: _00018
Starting work on structure: _00019
Starting work on structure: _00020
Starting work on structure: _00021
Starting work on structure: _00022
Starting work on structure: _00023
Starting work on structure: _00024
Starting work on structure: _00025
Starting work on structure: _00026
Starting work on structure: _00027
Starting work on structure: _00028
Starting work on structure: _00029
Starting work on structure: _00030
FILE_LOCK::unlock(): close failed.: Bad file descriptor
[2010- 9- 9  3:44:54:] :: BOINC:: Initializing ... ok.
[2010- 9- 9  3:44:54:] :: BOINC :: boinc_init()
BOINC:: Setting up shared resources ... ok.
BOINC:: Setting up semaphores ... ok.
BOINC:: Updating status ... ok.
BOINC:: Registering timer callback... ok.
BOINC:: Worker initialized successfully. 
Registering options.. 
Registered extra options.
Initializing broker options ...
Registered extra options.
Initializing core...
Initializing options.... ok 
Options::initialize()
Options::adding_options()
Options::initialize() Check specs.
Options::initialize()  End reached
Loaded options.... ok 
Processed options.... ok 
Initializing random generators... ok 
Initialization complete. 
Setting WU description ...
Unpacking zip data: ../../projects/boinc.bakerlab.org_rosetta/minirosetta_database_rev36507.zip
Setting database description ...
Setting up checkpointing ...
Setting up graphics native ...
Setting up folding (abrelax) ...
Beginning folding (abrelax) ... 
BOINC:: Worker startup. 
Starting watchdog...
Watchdog active.
Starting work on structure: _00030
Continuing computation from checkpoint: chk_S_00000030_ClassicAbinitio__stage_1 ... success! 
Continuing computation from checkpoint: chk_S_00000030_ClassicAbinitio__stage_2 ... success! 
Continuing computation from checkpoint: chk_S_00000030_ClassicAbinitio__stage_3_iter1_1 ... success! 
Continuing computation from checkpoint: chk_S_00000030_ClassicAbinitio__stage_3_iter1_2 ... success! 
Continuing computation from checkpoint: chk_S_00000030_ClassicAbinitio__stage_3_iter1_3 ... success! 
Continuing computation from checkpoint: chk_S_00000030_ClassicAbinitio__stage_3_iter1_4 ... success! 
Continuing computation from checkpoint: chk_S_00000030_ClassicAbinitio__stage_3_iter1_5 ... success! 
Continuing computation from checkpoint: chk_S_00000030_ClassicAbinitio__stage_3_iter1_6 ... success! 
Continuing computation from checkpoint: chk_S_00000030_ClassicAbinitio__stage_3_iter1_7 ... success! 
Continuing computation from checkpoint: chk_S_00000030_ClassicAbinitio__stage_3_iter1_8 ... success! 
Continuing computation from checkpoint: chk_S_00000030_ClassicAbinitio__stage_3_iter1_9 ... success! 
Continuing computation from checkpoint: chk_S_00000030_ClassicAbinitio__stage_3_iter1_10 ... success! 
Continuing computation from checkpoint: chk_S_00000030_ClassicAbinitio__stage4_kk_1 ... success! 
Continuing computation from checkpoint: chk_S_00000030_ClassicAbinitio__stage4_kk_2 ... success! 
Continuing computation from checkpoint: chk_S_00000030_ClassicAbinitio__stage4_kk_3 ... success! 
FILE_LOCK::unlock(): close failed.: Bad file descriptor
[2010- 9- 9  4:46:36:] :: BOINC:: Initializing ... ok.
[2010- 9- 9  4:46:36:] :: BOINC :: boinc_init()
BOINC:: Setting up shared resources ... ok.
BOINC:: Setting up semaphores ... ok.
BOINC:: Updating status ... ok.
BOINC:: Registering timer callback... ok.
BOINC:: Worker initialized successfully. 
Registering options.. 
Registered extra options.
Initializing broker options ...
Registered extra options.
Initializing core...
Initializing options.... ok 
Options::initialize()
Options::adding_options()
Options::initialize() Check specs.
Options::initialize()  End reached
Loaded options.... ok 
Processed options.... ok 
Initializing random generators... ok 
Initialization complete. 
Setting WU description ...
Unpacking zip data: ../../projects/boinc.bakerlab.org_rosetta/minirosetta_database_rev36507.zip
Setting database description ...
Setting up checkpointing ...
Setting up graphics native ...
Setting up folding (abrelax) ...
Beginning folding (abrelax) ... 
BOINC:: Worker startup. 
Starting watchdog...
Watchdog active.
Starting work on structure: _00030
Continuing computation from checkpoint: chk_S_00000030_ClassicAbinitio__stage_1 ... success! 
Continuing computation from checkpoint: chk_S_00000030_ClassicAbinitio__stage_2 ... success! 
Continuing computation from checkpoint: chk_S_00000030_ClassicAbinitio__stage_3_iter1_1 ... success! 
Continuing computation from checkpoint: chk_S_00000030_ClassicAbinitio__stage_3_iter1_2 ... success! 
Continuing computation from checkpoint: chk_S_00000030_ClassicAbinitio__stage_3_iter1_3 ... success! 
Continuing computation from checkpoint: chk_S_00000030_ClassicAbinitio__stage_3_iter1_4 ... success! 
Continuing computation from checkpoint: chk_S_00000030_ClassicAbinitio__stage_3_iter1_5 ... success! 
Continuing computation from checkpoint: chk_S_00000030_ClassicAbinitio__stage_3_iter1_6 ... success! 
Continuing computation from checkpoint: chk_S_00000030_ClassicAbinitio__stage_3_iter1_7 ... success! 
Continuing computation from checkpoint: chk_S_00000030_ClassicAbinitio__stage_3_iter1_8 ... success! 
Continuing computation from checkpoint: chk_S_00000030_ClassicAbinitio__stage_3_iter1_9 ... success! 
Continuing computation from checkpoint: chk_S_00000030_ClassicAbinitio__stage_3_iter1_10 ... success! 
Continuing computation from checkpoint: chk_S_00000030_ClassicAbinitio__stage4_kk_1 ... success! 
Continuing computation from checkpoint: chk_S_00000030_ClassicAbinitio__stage4_kk_2 ... success! 
Continuing computation from checkpoint: chk_S_00000030_ClassicAbinitio__stage4_kk_3 ... success! 
Starting work on structure: _00031
Starting work on structure: _00032
Starting work on structure: _00033
Starting work on structure: _00034
Starting work on structure: _00035
Starting work on structure: _00036
Starting work on structure: _00037
Starting work on structure: _00038
Starting work on structure: _00039
Starting work on structure: _00040
Starting work on structure: _00041
Starting work on structure: _00042
Starting work on structure: _00043
Starting work on structure: _00044
Starting work on structure: _00045
Starting work on structure: _00046
Starting work on structure: _00047
Starting work on structure: _00048
Starting work on structure: _00049
Starting work on structure: _00050
======================================================
DONE ::     1 starting structures  10595.8 cpu seconds
This process generated     50 decoys from      50 attempts
======================================================

BOINC :: Watchdog shutting down...
BOINC :: BOINC support services shutting down cleanly ...
called boinc_finish
[2010- 9- 9  6: 3:12:] :: BOINC:: Initializing ... ok.
[2010- 9- 9  6: 3:12:] :: BOINC :: boinc_init()
BOINC:: Setting up shared resources ... ok.
BOINC:: Setting up semaphores ... ok.
BOINC:: Updating status ... ok.
BOINC:: Registering timer callback... ok.
BOINC:: Worker initialized successfully. 
Registering options.. 
Registered extra options.
Initializing broker options ...
Registered extra options.
Initializing core...
Initializing options.... ok 
Options::initialize()
Options::adding_options()
Options::initialize() Check specs.
Options::initialize()  End reached
Loaded options.... ok 
Processed options.... ok 
Initializing random generators... ok 
Initialization complete. 
Setting WU description ...
Unpacking zip data: ../../projects/boinc.bakerlab.org_rosetta/minirosetta_database_rev36507.zip
Unpacking WU data ...
Unpacking data: ../../projects/boinc.bakerlab.org_rosetta/yfsong_lrm_ophs_combined_torsion_it07_run01_A.zip
Unpacking data: ../../projects/boinc.bakerlab.org_rosetta/lr8_1a19.fix.out.zip
Setting database description ...
Setting up checkpointing ...
Setting up graphics native ...
BOINC:: Worker startup. 
Starting watchdog...
Watchdog active.
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
Fullatom mode .. 
======================================================
DONE ::    64 starting structures  10755.3 cpu seconds
This process generated     64 decoys from      64 attempts
======================================================

BOINC :: Watchdog shutting down...
BOINC :: BOINC support services shutting down cleanly ...
called boinc_finish
[2010- 9- 9  9: 5: 5:] :: BOINC:: Initializing ... ok.
[2010- 9- 9  9: 5: 5:] :: BOINC :: boinc_init()
BOINC:: Setting up shared resources ... ok.
BOINC:: Setting up semaphores ... ok.
BOINC:: Updating status ... ok.
BOINC:: Registering timer callback... ok.
BOINC:: Worker initialized successfully. 
Registering options.. 
Registered extra options.
Initializing broker options ...
Registered extra options.
Initializing core...
Initializing options.... ok 
Options::initialize()
Options::adding_options()
Options::initialize() Check specs.
Options::initialize()  End reached
Loaded options.... ok 
Processed options.... ok 
Initializing random generators... ok 
Initialization complete. 
Setting WU description ...
Unpacking zip data: ../../projects/boinc.bakerlab.org_rosetta/minirosetta_database_rev36507.zip
Setting database description ...
Setting up checkpointing ...
Setting up graphics native ...
Setting up folding (abrelax) ...
Beginning folding (abrelax) ... 
BOINC:: Worker startup. 
Starting watchdog...
Watchdog active.
Starting work on structure: _00001
Starting work on structure: _00002
Starting work on structure: _00003
Starting work on structure: _00004
Starting work on structure: _00005
Starting work on structure: _00006
Starting work on structure: _00007
Starting work on structure: _00008
Starting work on structure: _00009
Starting work on structure: _00010
Starting work on structure: _00011
Starting work on structure: _00012
Starting work on structure: _00013
Starting work on structure: _00014
Starting work on structure: _00015
Starting work on structure: _00016
Starting work on structure: _00017
Starting work on structure: _00018
======================================================
DONE ::     1 starting structures  10332.9 cpu seconds
This process generated     18 decoys from      18 attempts
======================================================

BOINC :: Watchdog shutting down...
BOINC :: BOINC support services shutting down cleanly ...
called boinc_finish
SIGSEGV: segmentation violation

Crashed executable name: famous_um_6.11_i686-apple-darwin
built using BOINC library version 6.11.1
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.4 build 10F569
Fri Sep 10 01:06:23 2010

sh: /usr/bin/atos: No such file or directory
  0  0x0048fdcf    1  0x0049054a    2  0x900781fb    3  0xffffffff    4  0x0134e6b3    5  0x0134d44f    6  0x003f5826    7  0x00450bd8    8  0x004698c0    9  0x000026b6   10  0x000025dd  
Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffd47c edx: 0x900120fa
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffd4b8 esp: 0xbfffd47c
   ss: 0x0000001f efl: 0x00000206 eip: 0x900120fa  cs: 0x00000007
   ds: 0x0000001f  es: 0x0000001f  fs: 0x00000000  gs: 0x00000037

Binary Images Description:
    0x1000 -   0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin
 0x12a9000 -  0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v14n_1999_200_006721223/lib/libsvml.dylib
 0x131c000 -  0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v14n_1999_200_006721223/lib/libifcoremt.dylib
 0x13fc000 -  0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v14n_1999_200_006721223/lib/libimf.dylib
 0x1669000 -  0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v14n_1999_200_006721223/lib/libirc.dylib
0x90011000 - 0x901b7fff /usr/lib/libSystem.B.dylib
0x95689000 - 0x95697fff /usr/lib/libz.1.dylib
0x975b1000 - 0x975b4fff /usr/lib/system/libmathCommon.A.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3361, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation

Crashed executable name: famous_um_6.11_i686-apple-darwin
built using BOINC library version 6.11.1
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.4 build 10F569
Fri Sep 10 01:06:25 2010

sh: /usr/bin/atos: No such file or directory
  0  0x0048fdcf    1  0x0049054a    2  0x900781fb    3  0xffffffff    4  0x0134e6b3    5  0x0134d44f    6  0x002eeac6    7  0x003f55ea    8  0x00452abd    9  0x004698c0   10  0x000026b6   11  0x000025dd  
Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc3ec edx: 0x900120fa
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc428 esp: 0xbfffc3ec
   ss: 0x0000001f efl: 0x00000206 eip: 0x900120fa  cs: 0x00000007
   ds: 0x0000001f  es: 0x0000001f  fs: 0x00000000  gs: 0x00000037

Binary Images Description:
    0x1000 -   0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin
 0x12a9000 -  0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v14n_1999_200_006721223/lib/libsvml.dylib
 0x131c000 -  0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v14n_1999_200_006721223/lib/libifcoremt.dylib
 0x13fc000 -  0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v14n_1999_200_006721223/lib/libimf.dylib
 0x1669000 -  0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v14n_1999_200_006721223/lib/libirc.dylib
0x90011000 - 0x901b7fff /usr/lib/libSystem.B.dylib
0x95689000 - 0x95697fff /usr/lib/libz.1.dylib
0x975b1000 - 0x975b4fff /usr/lib/system/libmathCommon.A.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3361, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation

Crashed executable name: famous_um_6.11_i686-apple-darwin
built using BOINC library version 6.11.1
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.4 build 10F569
Sat Sep 11 23:13:19 2010

sh: /usr/bin/atos: No such file or directory
  0  0x0048fdcf    1  0x0049054a    2  0x992b31fb    3  0xffffffff    4  0x0134e6b3    5  0x0134d44f    6  0x003f5826    7  0x00450bd8    8  0x004698c0    9  0x000026b6   10  0x000025dd  
Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffd47c edx: 0x9924d0fa
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffd4b8 esp: 0xbfffd47c
   ss: 0x0000001f efl: 0x00000206 eip: 0x9924d0fa  cs: 0x00000007
   ds: 0x0000001f  es: 0x0000001f  fs: 0x00000000  gs: 0x00000037

Binary Images Description:
    0x1000 -   0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin
 0x12a9000 -  0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v14n_1999_200_006721223/lib/libsvml.dylib
 0x131c000 -  0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v14n_1999_200_006721223/lib/libifcoremt.dylib
 0x13fc000 -  0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v14n_1999_200_006721223/lib/libimf.dylib
 0x1669000 -  0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v14n_1999_200_006721223/lib/libirc.dylib
0x96096000 - 0x960a4fff /usr/lib/libz.1.dylib
0x9924c000 - 0x993f2fff /usr/lib/libSystem.B.dylib
0x997c0000 - 0x997c3fff /usr/lib/system/libmathCommon.A.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1132, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation

Crashed executable name: famous_um_6.11_i686-apple-darwin
built using BOINC library version 6.11.1
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.4 build 10F569
Sun Sep 12 05:29:35 2010

sh: /usr/bin/atos: No such file or directory
  0  0x0048fdcf    1  0x0049054a    2  0x992b31fb    3  0xffffffff    4  0x0134e6b3    5  0x0134d44f    6  0x003f5826    7  0x00450bd8    8  0x004698c0    9  0x000026b6   10  0x000025dd  
Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffd47c edx: 0x9924d0fa
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffd4b8 esp: 0xbfffd47c
   ss: 0x0000001f efl: 0x00000206 eip: 0x9924d0fa  cs: 0x00000007
   ds: 0x0000001f  es: 0x0000001f  fs: 0x00000000  gs: 0x00000037

Binary Images Description:
    0x1000 -   0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin
 0x12a9000 -  0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v14n_1999_200_006721223/lib/libsvml.dylib
 0x131c000 -  0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v14n_1999_200_006721223/lib/libifcoremt.dylib
 0x13fc000 -  0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v14n_1999_200_006721223/lib/libimf.dylib
 0x1669000 -  0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v14n_1999_200_006721223/lib/libirc.dylib
0x96096000 - 0x960a4fff /usr/lib/libz.1.dylib
0x9924c000 - 0x993f2fff /usr/lib/libSystem.B.dylib
0x997c0000 - 0x997c3fff /usr/lib/system/libmathCommon.A.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10157, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation

Crashed executable name: famous_um_6.11_i686-apple-darwin
built using BOINC library version 6.11.1
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.4 build 10F569
Sun Sep 12 05:50:01 2010

sh: /usr/bin/atos: No such file or directory
  0  0x0048fdcf    1  0x0049054a    2  0x992b31fb    3  0xffffffff    4  0x0134e6b3    5  0x0134d44f    6  0x002eeac6    7  0x003f55ea    8  0x00452abd    9  0x004698c0   10  0x000026b6   11  0x000025dd  
Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc3ec edx: 0x9924d0fa
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc428 esp: 0xbfffc3ec
   ss: 0x0000001f efl: 0x00000206 eip: 0x9924d0fa  cs: 0x00000007
   ds: 0x0000001f  es: 0x0000001f  fs: 0x00000000  gs: 0x00000037

Binary Images Description:
    0x1000 -   0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin
 0x12a9000 -  0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v14n_1999_200_006721223/lib/libsvml.dylib
 0x131c000 -  0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v14n_1999_200_006721223/lib/libifcoremt.dylib
 0x13fc000 -  0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v14n_1999_200_006721223/lib/libimf.dylib
 0x1669000 -  0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v14n_1999_200_006721223/lib/libirc.dylib
0x96096000 - 0x960a4fff /usr/lib/libz.1.dylib
0x9924c000 - 0x993f2fff /usr/lib/libSystem.B.dylib
0x997c0000 - 0x997c3fff /usr/lib/system/libmathCommon.A.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10673, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...

Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED.                                                                                                                                                                                                                     tmp/pipe_dummy                                                                  

Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED.                                                                                                                                                                                                                     tmp/pipe_dummy                                                                  

Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED.                                                                                                                                                                                                                     tmp/pipe_dummy                                                                  

Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED.                                                                                                                                                                                                                     tmp/pipe_dummy                                                                  
SIGSEGV: segmentation violation

Crashed executable name: famous_um_6.11_i686-apple-darwin
built using BOINC library version 6.11.1
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.4 build 10F569
Sun Sep 12 07:00:45 2010

sh: /usr/bin/atos: No such file or directory
  0  0x0048fdcf    1  0x0049054a    2  0x992b31fb    3  0xffffffff    4  0x0134e6b3    5  0x0134d44f    6  0x002eeac6    7  0x003f55ea    8  0x00452abd    9  0x004698c0   10  0x000026b6   11  0x000025dd  
Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc42c edx: 0x9924d0fa
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc468 esp: 0xbfffc42c
   ss: 0x0000001f efl: 0x00000206 eip: 0x9924d0fa  cs: 0x00000007
   ds: 0x0000001f  es: 0x0000001f  fs: 0x00000000  gs: 0x00000037

Binary Images Description:
    0x1000 -   0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin
 0x12a9000 -  0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v14n_1999_200_006721223/lib/libsvml.dylib
 0x131c000 -  0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v14n_1999_200_006721223/lib/libifcoremt.dylib
 0x13fc000 -  0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v14n_1999_200_006721223/lib/libimf.dylib
 0x1669000 -  0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v14n_1999_200_006721223/lib/libirc.dylib
0x96096000 - 0x960a4fff /usr/lib/libz.1.dylib
0x9924c000 - 0x993f2fff /usr/lib/libSystem.B.dylib
0x997c0000 - 0x997c3fff /usr/lib/system/libmathCommon.A.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10769, iMonCtr=1
Model crash detected, will try to restart...

Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED.                                                                                                                                                                                                                     tmp/pipe_dummy                                                                  
Sorry, too many model crashes! :-(
 (10769): called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
11 Sep 2010 21:42:28 844607 11869792 famous_v14n_1999_200_006721223_0 355,706 56,563 0.1590
11 Sep 2010 21:15:52 844607 11869792 famous_v14n_1999_200_006721223_0 346,346 55,010 0.1588
11 Sep 2010 20:38:09 844607 11869792 famous_v14n_1999_200_006721223_0 336,986 53,459 0.1586
11 Sep 2010 19:16:51 844607 11869792 famous_v14n_1999_200_006721223_0 327,626 51,956 0.1586
11 Sep 2010 18:49:34 844607 11869792 famous_v14n_1999_200_006721223_0 318,266 50,455 0.1585
11 Sep 2010 18:27:32 844607 11869792 famous_v14n_1999_200_006721223_0 308,906 48,969 0.1585
11 Sep 2010 18:00:45 844607 11869792 famous_v14n_1999_200_006721223_0 299,546 47,462 0.1584
11 Sep 2010 17:34:40 844607 11869792 famous_v14n_1999_200_006721223_0 290,186 45,955 0.1584
11 Sep 2010 17:08:05 844607 11869792 famous_v14n_1999_200_006721223_0 280,826 44,428 0.1582
11 Sep 2010 16:46:18 844607 11869792 famous_v14n_1999_200_006721223_0 271,466 42,927 0.1581
11 Sep 2010 16:20:07 844607 11869792 famous_v14n_1999_200_006721223_0 262,106 41,426 0.1581
11 Sep 2010 15:53:47 844607 11869792 famous_v14n_1999_200_006721223_0 252,746 39,959 0.1581
11 Sep 2010 15:27:32 844607 11869792 famous_v14n_1999_200_006721223_0 243,386 38,487 0.1581
11 Sep 2010 15:05:48 844607 11869792 famous_v14n_1999_200_006721223_0 234,026 37,015 0.1582
11 Sep 2010 14:38:57 844607 11869792 famous_v14n_1999_200_006721223_0 224,666 35,559 0.1583
10 Sep 2010 02:54:16 844607 11869792 famous_v14n_1999_200_006721223_0 215,306 34,112 0.1584
10 Sep 2010 02:27:41 844607 11869792 famous_v14n_1999_200_006721223_0 205,946 32,667 0.1586
10 Sep 2010 02:05:53 844607 11869792 famous_v14n_1999_200_006721223_0 196,586 31,229 0.1589
10 Sep 2010 01:39:10 844607 11869792 famous_v14n_1999_200_006721223_0 187,226 29,661 0.1584
10 Sep 2010 01:09:34 844607 11869792 famous_v14n_1999_200_006721223_0 177,866 28,085 0.1579


©2024 climateprediction.net