Task 11913444

Name	hadsm3dhet2_u3ec_006725919_11
Workunit	6929262
Created	20 Sep 2010, 20:34:21 UTC
Sent	20 Sep 2010, 20:42:05 UTC
Report deadline	3 Sep 2011, 2:02:05 UTC
Received	4 Nov 2010, 17:12:31 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	844607
Run time	9 days 8 hours 17 min 49 sec
CPU time	8 days 22 hours 19 min 19 sec
Validate state	Invalid
Credit	5,160.66
Device peak FLOPS	3.11 GFLOPS
Application version	UK Met Office HadSM3 Slab Model v6.09 i686-apple-darwin
Stderr	<core_client_version>6.10.17</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> b3 5 0x0134d44f 6 0x002eeac6 7 0x003f55ea 8 0x00452abd 9 0x004698c0 10 0x000026b6 11 0x000025dd Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc3ec edx: 0x9924d0fa edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc428 esp: 0xbfffc3ec ss: 0x0000001f efl: 0x00000206 eip: 0x9924d0fa cs: 0x00000007 ds: 0x0000001f es: 0x0000001f fs: 0x00000000 gs: 0x00000037 Binary Images Description: 0x1000 - 0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin 0x12a9000 - 0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v2sv_1999_200_006689397/lib/libsvml.dylib 0x131c000 - 0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v2sv_1999_200_006689397/lib/libifcoremt.dylib 0x13fc000 - 0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v2sv_1999_200_006689397/lib/libimf.dylib 0x1669000 - 0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v2sv_1999_200_006689397/lib/libirc.dylib 0x96096000 - 0x960a4fff /usr/lib/libz.1.dylib 0x9924c000 - 0x993f2fff /usr/lib/libSystem.B.dylib 0x997c0000 - 0x997c3fff /usr/lib/system/libmathCommon.A.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=32182, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Crashed executable name: famous_um_6.11_i686-apple-darwin built using BOINC library version 6.11.1 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.4 build 10F569 Thu Sep 23 01:17:14 2010 sh: /usr/bin/atos: No such file or directory 0 0x0048fdcf 1 0x0049054a 2 0x992b31fb 3 0xffffffff 4 0x0134e6b3 5 0x0134d44f 6 0x002eeac6 7 0x003f55ea 8 0x00452abd 9 0x004698c0 10 0x000026b6 11 0x000025dd Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc3ec edx: 0x9924d0fa edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc428 esp: 0xbfffc3ec ss: 0x0000001f efl: 0x00000206 eip: 0x9924d0fa cs: 0x00000007 ds: 0x0000001f es: 0x0000001f fs: 0x00000000 gs: 0x00000037 Binary Images Description: 0x1000 - 0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin 0x12a9000 - 0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v2sv_1999_200_006689397/lib/libsvml.dylib 0x131c000 - 0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v2sv_1999_200_006689397/lib/libifcoremt.dylib 0x13fc000 - 0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v2sv_1999_200_006689397/lib/libimf.dylib 0x1669000 - 0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_v2sv_1999_200_006689397/lib/libirc.dylib 0x96096000 - 0x960a4fff /usr/lib/libz.1.dylib 0x9924c000 - 0x993f2fff /usr/lib/libSystem.B.dylib 0x997c0000 - 0x997c3fff /usr/lib/system/libmathCommon.A.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1104, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 (3146): called boinc_finish [2010- 9-23 7:34:46:] :: BOINC:: Initializing ... ok. [2010- 9-23 7:34:46:] :: BOINC :: boinc_init() BOINC:: Setting up shared resources ... ok. BOINC:: Setting up semaphores ... ok. BOINC:: Updating status ... ok. BOINC:: Registering timer callback... ok. BOINC:: Worker initialized successfully. Registering options.. Registered extra options. Initializing broker options ... Registered extra options. Initializing core... Initializing options.... ok Options::initialize() Options::adding_options() Options::initialize() Check specs. Options::initialize() End reached Loaded options.... ok Processed options.... ok Initializing random generators... ok Initialization complete. Setting WU description ... Unpacking zip data: ../../projects/boinc.bakerlab.org_rosetta/minirosetta_database_rev36507.zip Setting database description ... Setting up checkpointing ... Setting up graphics native ... Setting up folding (abrelax) ... Beginning folding (abrelax) ... BOINC:: Worker startup. Starting watchdog... Watchdog active. Starting work on structure: _00001 Starting work on structure: _00002 Starting work on structure: _00003 Starting work on structure: _00004 Starting work on structure: _00005 Starting work on structure: _00006 Starting work on structure: _00007 Starting work on structure: _00008 Starting work on structure: _00009 Starting work on structure: _00010 Starting work on structure: _00011 Starting work on structure: _00012 FILE_LOCK::unlock(): close failed.: Bad file descriptor [2010- 9-24 0:51:29:] :: BOINC:: Initializing ... ok. [2010- 9-24 0:51:29:] :: BOINC :: boinc_init() BOINC:: Setting up shared resources ... ok. BOINC:: Setting up semaphores ... ok. BOINC:: Updating status ... ok. BOINC:: Registering timer callback... ok. BOINC:: Worker initialized successfully. Registering options.. Registered extra options. Initializing broker options ... Registered extra options. Initializing core... Initializing options.... ok Options::initialize() Options::adding_options() Options::initialize() Check specs. Options::initialize() End reached Loaded options.... ok Processed options.... ok Initializing random generators... ok Initialization complete. Setting WU description ... Unpacking zip data: ../../projects/boinc.bakerlab.org_rosetta/minirosetta_database_rev36507.zip Setting database description ... Setting up checkpointing ... Setting up graphics native ... Setting up folding (abrelax) ... Beginning folding (abrelax) ... BOINC:: Worker startup. Starting watchdog... Watchdog active. Starting work on structure: _00012 Continuing computation from checkpoint: chk_S_00000012_ClassicAbinitio__stage_1 ... success! Continuing computation from checkpoint: chk_S_00000012_ClassicAbinitio__stage_2 ... success! Continuing computation from checkpoint: chk_S_00000012_ClassicAbinitio__stage_3_iter1_1 ... success! Continuing computation from checkpoint: chk_S_00000012_ClassicAbinitio__stage_3_iter1_2 ... success! Continuing computation from checkpoint: chk_S_00000012_ClassicAbinitio__stage_3_iter1_3 ... success! Continuing computation from checkpoint: chk_S_00000012_ClassicAbinitio__stage_3_iter1_4 ... success! Continuing computation from checkpoint: chk_S_00000012_ClassicAbinitio__stage_3_iter1_5 ... success! Continuing computation from checkpoint: chk_S_00000012_ClassicAbinitio__stage_3_iter1_6 ... success! Continuing computation from checkpoint: chk_S_00000012_ClassicAbinitio__stage_3_iter1_7 ... success! FILE_LOCK::unlock(): close failed.: Bad file descriptor [2010- 9-24 5:12: 6:] :: BOINC:: Initializing ... ok. [2010- 9-24 5:12: 6:] :: BOINC :: boinc_init() BOINC:: Setting up shared resources ... ok. BOINC:: Setting up semaphores ... ok. BOINC:: Updating status ... ok. BOINC:: Registering timer callback... ok. BOINC:: Worker initialized successfully. Registering options.. Registered extra options. Initializing broker options ... Registered extra options. Initializing core... Initializing options.... ok Options::initialize() Options::adding_options() Options::initialize() Check specs. Options::initialize() End reached Loaded options.... ok Processed options.... ok Initializing random generators... ok Initialization complete. Setting WU description ... Unpacking zip data: ../../projects/boinc.bakerlab.org_rosetta/minirosetta_database_rev36507.zip Setting database description ... Setting up checkpointing ... Setting up graphics native ... Setting up folding (abrelax) ... Beginning folding (abrelax) ... BOINC:: Worker startup. Starting watchdog... Watchdog active. Starting work on structure: _00012 Continuing computation from checkpoint: chk_S_00000012_ClassicAbinitio__stage_1 ... success! Continuing computation from checkpoint: chk_S_00000012_ClassicAbinitio__stage_2 ... success! Continuing computation from checkpoint: chk_S_00000012_ClassicAbinitio__stage_3_iter1_1 ... success! Continuing computation from checkpoint: chk_S_00000012_ClassicAbinitio__stage_3_iter1_2 ... success! Continuing computation from checkpoint: chk_S_00000012_ClassicAbinitio__stage_3_iter1_3 ... success! Continuing computation from checkpoint: chk_S_00000012_ClassicAbinitio__stage_3_iter1_4 ... success! Continuing computation from checkpoint: chk_S_00000012_ClassicAbinitio__stage_3_iter1_5 ... success! Continuing computation from checkpoint: chk_S_00000012_ClassicAbinitio__stage_3_iter1_6 ... success! Continuing computation from checkpoint: chk_S_00000012_ClassicAbinitio__stage_3_iter1_7 ... success! FILE_LOCK::unlock(): close failed.: Bad file descriptor [2010- 9-24 5:18:24:] :: BOINC:: Initializing ... ok. [2010- 9-24 5:18:24:] :: BOINC :: boinc_init() BOINC:: Setting up shared resources ... ok. BOINC:: Setting up semaphores ... ok. BOINC:: Updating status ... ok. BOINC:: Registering timer callback... ok. BOINC:: Worker initialized successfully. Registering options.. Registered extra options. Initializing broker options ... Registered extra options. Initializing core... Initializing options.... ok Options::initialize() Options::adding_options() Options::initialize() Check specs. Options::initialize() End reached Loaded options.... ok Processed options.... ok Initializing random generators... ok Initialization complete. Setting WU description ... Unpacking zip data: ../../projects/boinc.bakerlab.org_rosetta/minirosetta_database_rev36507.zip Setting database description ... Setting up checkpointing ... Setting up graphics native ... Setting up folding (abrelax) ... Beginning folding (abrelax) ... BOINC:: Worker startup. Starting watchdog... Watchdog active. Starting work on structure: _00012 Continuing computation from checkpoint: chk_S_00000012_ClassicAbinitio__stage_1 ... success! Continuing computation from checkpoint: chk_S_00000012_ClassicAbinitio__stage_2 ... success! Continuing computation from checkpoint: chk_S_00000012_ClassicAbinitio__stage_3_iter1_1 ... success! Continuing computation from checkpoint: chk_S_00000012_ClassicAbinitio__stage_3_iter1_2 ... success! Continuing computation from checkpoint: chk_S_00000012_ClassicAbinitio__stage_3_iter1_3 ... success! Continuing computation from checkpoint: chk_S_00000012_ClassicAbinitio__stage_3_iter1_4 ... success! Continuing computation from checkpoint: chk_S_00000012_ClassicAbinitio__stage_3_iter1_5 ... success! Continuing computation from checkpoint: chk_S_00000012_ClassicAbinitio__stage_3_iter1_6 ... success! Continuing computation from checkpoint: chk_S_00000012_ClassicAbinitio__stage_3_iter1_7 ... success! Continuing computation from checkpoint: chk_S_00000012_ClassicAbinitio__stage_3_iter1_8 ... success! Continuing computation from checkpoint: chk_S_00000012_ClassicAbinitio__stage_3_iter1_9 ... success! Continuing computation from checkpoint: chk_S_00000012_ClassicAbinitio__stage_3_iter1_10 ... success! Continuing computation from checkpoint: chk_S_00000012_ClassicAbinitio__stage4_kk_1 ... success! FILE_LOCK::unlock(): close failed.: Bad file descriptor [2010- 9-24 10: 7: 0:] :: BOINC:: Initializing ... ok. [2010- 9-24 10: 7: 0:] :: BOINC :: boinc_init() BOINC:: Setting up shared resources ... ok. BOINC:: Setting up semaphores ... ok. BOINC:: Updating status ... ok. BOINC:: Registering timer callback... ok. BOINC:: Worker initialized successfully. Registering options.. Registered extra options. Initializing broker options ... Registered extra options. Initializing core... Initializing options.... ok Options::initialize() Options::adding_options() Options::initialize() Check specs. Options::initialize() End reached Loaded options.... ok Processed options.... ok Initializing random generators... ok Initialization complete. Setting WU description ... Unpacking zip data: ../../projects/boinc.bakerlab.org_rosetta/minirosetta_database_rev36507.zip Setting database description ... Setting up checkpointing ... Setting up graphics native ... Setting up folding (abrelax) ... Beginning folding (abrelax) ... BOINC:: Worker startup. Starting watchdog... Watchdog active. Starting work on structure: _00012 Continuing computation from checkpoint: chk_S_00000012_ClassicAbinitio__stage_1 ... success! Continuing computation from checkpoint: chk_S_00000012_ClassicAbinitio__stage_2 ... success! Continuing computation from checkpoint: chk_S_00000012_ClassicAbinitio__stage_3_iter1_1 ... success! Continuing computation from checkpoint: chk_S_00000012_ClassicAbinitio__stage_3_iter1_2 ... success! Continuing computation from checkpoint: chk_S_00000012_ClassicAbinitio__stage_3_iter1_3 ... success! Continuing computation from checkpoint: chk_S_00000012_ClassicAbinitio__stage_3_iter1_4 ... success! Continuing computation from checkpoint: chk_S_00000012_ClassicAbinitio__stage_3_iter1_5 ... success! Continuing computation from checkpoint: chk_S_00000012_ClassicAbinitio__stage_3_iter1_6 ... success! Continuing computation from checkpoint: chk_S_00000012_ClassicAbinitio__stage_3_iter1_7 ... success! Continuing computation from checkpoint: chk_S_00000012_ClassicAbinitio__stage_3_iter1_8 ... success! Continuing computation from checkpoint: chk_S_00000012_ClassicAbinitio__stage_3_iter1_9 ... success! Continuing computation from checkpoint: chk_S_00000012_ClassicAbinitio__stage_3_iter1_10 ... success! Continuing computation from checkpoint: chk_S_00000012_ClassicAbinitio__stage4_kk_1 ... success! Starting work on structure: _00013 [2010- 9-24 10:19:25:] :: BOINC:: Initializing ... ok. [2010- 9-24 10:19:25:] :: BOINC :: boinc_init() BOINC:: Setting up shared resources ... ok. BOINC:: Setting up semaphores ... ok. BOINC:: Updating status ... ok. BOINC:: Registering timer callback... ok. BOINC:: Worker initialized successfully. Registering options.. Registered extra options. Initializing broker options ... Registered extra options. Initializing core... Initializing options.... ok Options::initialize() Options::adding_options() Options::initialize() Check specs. Options::initialize() End reached Loaded options.... ok Processed options.... ok Initializing random generators... ok Initialization complete. Setting WU description ... Unpacking zip data: ../../projects/boinc.bakerlab.org_rosetta/minirosetta_database_rev36507.zip Setting database description ... Setting up checkpointing ... Setting up graphics native ... Setting up folding (abrelax) ... Beginning folding (abrelax) ... BOINC:: Worker startup. Starting watchdog... Watchdog active. Starting work on structure: _00013 Continuing computation from checkpoint: chk_S_00000013_ClassicAbinitio__stage_1 ... success! Continuing computation from checkpoint: chk_S_00000013_ClassicAbinitio__stage_2 ... success! Continuing computation from checkpoint: chk_S_00000013_ClassicAbinitio__stage_3_iter1_1 ... success! Continuing computation from checkpoint: chk_S_00000013_ClassicAbinitio__stage_3_iter1_2 ... success! Continuing computation from checkpoint: chk_S_00000013_ClassicAbinitio__stage_3_iter1_3 ... success! ====================================================== DONE :: 1 starting structures 10533.7 cpu seconds This process generated 13 decoys from 13 attempts ====================================================== BOINC :: Watchdog shutting down... BOINC :: BOINC support services shutting down cleanly ... called boinc_finish [2010- 9-24 10:31:39:] :: BOINC:: Initializing ... ok. [2010- 9-24 10:31:39:] :: BOINC :: boinc_init() BOINC:: Setting up shared resources ... ok. BOINC:: Setting up semaphores ... ok. BOINC:: Updating status ... ok. BOINC:: Registering timer callback... ok. BOINC:: Worker initialized successfully. Registering options.. Registered extra options. Initializing broker options ... Registered extra options. Initializing core... Initializing options.... ok Options::initialize() Options::adding_options() Options::initialize() Check specs. Options::initialize() End reached Loaded options.... ok Processed options.... ok Initializing random generators... ok Initialization complete. Setting WU description ... Unpacking zip data: ../../projects/boinc.bakerlab.org_rosetta/minirosetta_database_rev36507.zip Setting database description ... Setting up checkpointing ... Setting up graphics native ... Setting up folding (abrelax) ... Beginning folding (abrelax) ... BOINC:: Worker startup. Starting watchdog... Watchdog active. Starting work on structure: _00001 Starting work on structure: _00002 FILE_LOCK::unlock(): close failed.: Bad file descriptor [2010- 9-25 0:26:50:] :: BOINC:: Initializing ... ok. [2010- 9-25 0:26:50:] :: BOINC :: boinc_init() BOINC:: Setting up shared resources ... ok. BOINC:: Setting up semaphores ... ok. BOINC:: Updating status ... ok. BOINC:: Registering timer callback... ok. BOINC:: Worker initialized successfully. Registering options.. Registered extra options. Initializing broker options ... Registered extra options. Initializing core... Initializing options.... ok Options::initialize() Options::adding_options() Options::initialize() Check specs. Options::initialize() End reached Loaded options.... ok Processed options.... ok Initializing random generators... ok Initialization complete. Setting WU description ... Unpacking zip data: ../../projects/boinc.bakerlab.org_rosetta/minirosetta_database_rev36507.zip Setting database description ... Setting up checkpointing ... Setting up graphics native ... Setting up folding (abrelax) ... Beginning folding (abrelax) ... BOINC:: Worker startup. Starting watchdog... Watchdog active. Starting work on structure: _00002 Continuing computation from checkpoint: chk_S_00000002_ClassicAbinitio__stage_1 ... success! Continuing computation from checkpoint: chk_S_00000002_ClassicAbinitio__stage_2 ... success! Continuing computation from checkpoint: chk_S_00000002_ClassicAbinitio__stage_3_iter1_1 ... success! Continuing computation from checkpoint: chk_S_00000002_ClassicAbinitio__stage_3_iter1_2 ... success! Continuing computation from checkpoint: chk_S_00000002_ClassicAbinitio__stage_3_iter1_3 ... success! Continuing computation from checkpoint: chk_S_00000002_ClassicAbinitio__stage_3_iter1_4 ... success! Continuing computation from checkpoint: chk_S_00000002_ClassicAbinitio__stage_3_iter1_5 ... success! Continuing computation from checkpoint: chk_S_00000002_ClassicAbinitio__stage_3_iter1_6 ... success! Continuing computation from checkpoint: chk_S_00000002_ClassicAbinitio__stage_3_iter1_7 ... success! [2010- 9-25 0:37:10:] :: BOINC:: Initializing ... ok. [2010- 9-25 0:37:10:] :: BOINC :: boinc_init() BOINC:: Setting up shared resources ... ok. BOINC:: Setting up semaphores ... ok. BOINC:: Updating status ... ok. BOINC:: Registering timer callback... ok. BOINC:: Worker initialized successfully. Registering options.. Registered extra options. Initializing broker options ... Registered extra options. Initializing core... Initializing options.... ok Options::initialize() Options::adding_options() Options::initialize() Check specs. Options::initialize() End reached Loaded options.... ok Processed options.... ok Initializing random generators... ok Initialization complete. Setting WU description ... Unpacking zip data: ../../projects/boinc.bakerlab.org_rosetta/minirosetta_database_rev36507.zip Setting database description ... Setting up checkpointing ... Setting up graphics native ... Setting up folding (abrelax) ... Beginning folding (abrelax) ... BOINC:: Worker startup. Starting watchdog... Watchdog active. Starting work on structure: _00002 Continuing computation from checkpoint: chk_S_00000002_ClassicAbinitio__stage_1 ... success! Continuing computation from checkpoint: chk_S_00000002_ClassicAbinitio__stage_2 ... success! Continuing computation from checkpoint: chk_S_00000002_ClassicAbinitio__stage_3_iter1_1 ... success! Continuing computation from checkpoint: chk_S_00000002_ClassicAbinitio__stage_3_iter1_2 ... success! Continuing computation from checkpoint: chk_S_00000002_ClassicAbinitio__stage_3_iter1_3 ... success! Continuing computation from checkpoint: chk_S_00000002_ClassicAbinitio__stage_3_iter1_4 ... success! Continuing computation from checkpoint: chk_S_00000002_ClassicAbinitio__stage_3_iter1_5 ... success! Continuing computation from checkpoint: chk_S_00000002_ClassicAbinitio__stage_3_iter1_6 ... success! Continuing computation from checkpoint: chk_S_00000002_ClassicAbinitio__stage_3_iter1_7 ... success! Continuing computation from checkpoint: chk_S_00000002_ClassicAbinitio__stage_3_iter1_8 ... success! Continuing computation from checkpoint: chk_S_00000002_ClassicAbinitio__stage_3_iter1_9 ... success! Continuing computation from checkpoint: chk_S_00000002_ClassicAbinitio__stage_3_iter1_10 ... success! Starting work on structure: _00003 FILE_LOCK::unlock(): close failed.: Bad file descriptor [2010- 9-25 1:35: 2:] :: BOINC:: Initializing ... ok. [2010- 9-25 1:35: 2:] :: BOINC :: boinc_init() BOINC:: Setting up shared resources ... ok. BOINC:: Setting up semaphores ... ok. BOINC:: Updating status ... ok. BOINC:: Registering timer callback... ok. BOINC:: Worker initialized successfully. Registering options.. Registered extra options. Initializing broker options ... Registered extra options. Initializing core... Initializing options.... ok Options::initialize() Options::adding_options() Options::initialize() Check specs. Options::initialize() End reached Loaded options.... ok Processed options.... ok Initializing random generators... ok Initialization complete. Setting WU description ... Unpacking zip data: ../../projects/boinc.bakerlab.org_rosetta/minirosetta_database_rev36507.zip Setting database description ... Setting up checkpointing ... Setting up graphics native ... Setting up folding (abrelax) ... Beginning folding (abrelax) ... BOINC:: Worker startup. Starting watchdog... Watchdog active. Starting work on structure: _00003 Starting work on structure: _00004 Starting work on structure: _00005 Starting work on structure: _00006 Starting work on structure: _00007 Starting work on structure: _00008 Starting work on structure: _00009 FILE_LOCK::unlock(): close failed.: Bad file descriptor [2010- 9-25 3:32:35:] :: BOINC:: Initializing ... ok. [2010- 9-25 3:32:35:] :: BOINC :: boinc_init() BOINC:: Setting up shared resources ... ok. BOINC:: Setting up semaphores ... ok. BOINC:: Updating status ... ok. BOINC:: Registering timer callback... ok. BOINC:: Worker initialized successfully. Registering options.. Registered extra options. Initializing broker options ... Registered extra options. Initializing core... Initializing options.... ok Options::initialize() Options::adding_options() Options::initialize() Check specs. Options::initialize() End reached Loaded options.... ok Processed options.... ok Initializing random generators... ok Initialization complete. Setting WU description ... Unpacking zip data: ../../projects/boinc.bakerlab.org_rosetta/minirosetta_database_rev36507.zip Setting database description ... Setting up checkpointing ... Setting up graphics native ... Setting up folding (abrelax) ... Beginning folding (abrelax) ... BOINC:: Worker startup. Starting watchdog... Watchdog active. Starting work on structure: _00009 Starting work on structure: _00010 Starting work on structure: _00011 Starting work on structure: _00012 ====================================================== DONE :: 1 starting structures 10120.5 cpu seconds This process generated 12 decoys from 12 attempts ====================================================== BOINC :: Watchdog shutting down... BOINC :: BOINC support services shutting down cleanly ... called boinc_finish [2010- 9-25 4:34:24:] :: BOINC:: Initializing ... ok. [2010- 9-25 4:34:24:] :: BOINC :: boinc_init() BOINC:: Setting up shared resources ... ok. BOINC:: Setting up semaphores ... ok. BOINC:: Updating status ... ok. BOINC:: Registering timer callback... ok. BOINC:: Worker initialized successfully. Registering options.. Registered extra options. Initializing broker options ... Registered extra options. Initializing core... Initializing options.... ok Options::initialize() Options::adding_options() Options::initialize() Check specs. Options::initialize() End reached Loaded options.... ok Processed options.... ok Initializing random generators... ok Initialization complete. Setting WU description ... Unpacking zip data: ../../projects/boinc.bakerlab.org_rosetta/minirosetta_database_rev36507.zip Setting database description ... Setting up checkpointing ... Setting up graphics native ... Setting up folding (abrelax) ... Beginning folding (abrelax) ... BOINC:: Worker startup. Starting watchdog... Watchdog active. Starting work on structure: _00001 Starting work on structure: _00002 Starting work on structure: _00003 Starting work on structure: _00004 Starting work on structure: _00005 Starting work on structure: _00006 Starting work on structure: _00007 Starting work on structure: _00008 Starting work on structure: _00009 Starting work on structure: _00010 Starting work on structure: _00011 Starting work on structure: _00012 Starting work on structure: _00013 ====================================================== DONE :: 1 starting structures 10201.9 cpu seconds This process generated 13 decoys from 13 attempts ====================================================== BOINC :: Watchdog shutting down... BOINC :: BOINC support services shutting down cleanly ... called boinc_finish [2010- 9-25 7:28: 7:] :: BOINC:: Initializing ... ok. [2010- 9-25 7:28: 7:] :: BOINC :: boinc_init() BOINC:: Setting up shared resources ... ok. BOINC:: Setting up semaphores ... ok. BOINC:: Updating status ... ok. BOINC:: Registering timer callback... ok. BOINC:: Worker initialized successfully. Registering options.. Registered extra options. Initializing broker options ... Registered extra options. Initializing core... Initializing options.... ok Options::initialize() Options::adding_options() Options::initialize() Check specs. Options::initialize() End reached Loaded options.... ok Processed options.... ok Initializing random generators... ok Initialization complete. Setting WU description ... Unpacking zip data: ../../projects/boinc.bakerlab.org_rosetta/minirosetta_database_rev36507.zip Setting database description ... Setting up checkpointing ... Setting up graphics native ... Setting up folding (abrelax) ... Beginning folding (abrelax) ... BOINC:: Worker startup. Starting watchdog... Watchdog active. Starting work on structure: _00001 Starting work on structure: _00002 Starting work on structure: _00003 Starting work on structure: _00004 Starting work on structure: _00005 Starting work on structure: _00006 Starting work on structure: _00007 Starting work on structure: _00008 Starting work on structure: _00009 Starting work on structure: _00010 Starting work on structure: _00011 Starting work on structure: _00012 Starting work on structure: _00013 ====================================================== DONE :: 1 starting structures 10464.9 cpu seconds This process generated 13 decoys from 13 attempts ====================================================== BOINC :: Watchdog shutting down... BOINC :: BOINC support services shutting down cleanly ... called boinc_finish [2010- 9-25 10:22:47:] :: BOINC:: Initializing ... ok. [2010- 9-25 10:22:47:] :: BOINC :: boinc_init() BOINC:: Setting up shared resources ... ok. BOINC:: Setting up semaphores ... ok. BOINC:: Updating status ... ok. BOINC:: Registering timer callback... ok. BOINC:: Worker initialized successfully. Registering options.. Registered extra options. Initializing broker options ... Registered extra options. Initializing core... Initializing options.... ok Options::initialize() Options::adding_options() Options::initialize() Check specs. Options::initialize() End reached Loaded options.... ok Processed options.... ok Initializing random generators... ok Initialization complete. Setting WU description ... Unpacking zip data: ../../projects/boinc.bakerlab.org_rosetta/minirosetta_database_rev36507.zip Setting database description ... Setting up checkpointing ... Setting up graphics native ... Setting up folding (abrelax) ... Beginning folding (abrelax) ... BOINC:: Worker startup. Starting watchdog... Watchdog active. Starting work on structure: _00001 Starting work on structure: _00002 Starting work on structure: _00003 Starting work on structure: _00004 Starting work on structure: _00005 Starting work on structure: _00006 Starting work on structure: _00007 Starting work on structure: _00008 Starting work on structure: _00009 Starting work on structure: _00010 Starting work on structure: _00011 Starting work on structure: _00012 Starting work on structure: _00013 Starting work on structure: _00014 Starting work on structure: _00015 Starting work on structure: _00016 Starting work on structure: _00017 Starting work on structure: _00018 Starting work on structure: _00019 Starting work on structure: _00020 Starting work on structure: _00021 Starting work on structure: _00022 Starting work on structure: _00023 Starting work on structure: _00024 Starting work on structure: _00025 Starting work on structure: _00026 Starting work on structure: _00027 Starting work on structure: _00028 Starting work on structure: _00029 Starting work on structure: _00030 FILE_LOCK::unlock(): close failed.: Bad file descriptor [2010- 9-25 15:35:15:] :: BOINC:: Initializing ... ok. [2010- 9-25 15:35:15:] :: BOINC :: boinc_init() BOINC:: Setting up shared resources ... ok. BOINC:: Setting up semaphores ... ok. BOINC:: Updating status ... ok. BOINC:: Registering timer callback... ok. BOINC:: Worker initialized successfully. Registering options.. Registered extra options. Initializing broker options ... Registered extra options. Initializing core... Initializing options.... ok Options::initialize() Options::adding_options() Options::initialize() Check specs. Options::initialize() End reached Loaded options.... ok Processed options.... ok Initializing random generators... ok Initialization complete. Setting WU description ... Unpacking zip data: ../../projects/boinc.bakerlab.org_rosetta/minirosetta_database_rev36507.zip Setting database description ... Setting up checkpointing ... Setting up graphics native ... Setting up folding (abrelax) ... Beginning folding (abrelax) ... BOINC:: Worker startup. Starting watchdog... Watchdog active. Starting work on structure: _00030 Continuing computation from checkpoint: chk_S_00000030_ClassicAbinitio__stage_1 ... success! Continuing computation from checkpoint: chk_S_00000030_ClassicAbinitio__stage_2 ... success! Continuing computation from checkpoint: chk_S_00000030_ClassicAbinitio__stage_3_iter1_1 ... success! Continuing computation from checkpoint: chk_S_00000030_ClassicAbinitio__stage_3_iter1_2 ... success! Continuing computation from checkpoint: chk_S_00000030_ClassicAbinitio__stage_3_iter1_3 ... success! Continuing computation from checkpoint: chk_S_00000030_ClassicAbinitio__stage_3_iter1_4 ... success! Continuing computation from checkpoint: chk_S_00000030_ClassicAbinitio__stage_3_iter1_5 ... success! Continuing computation from checkpoint: chk_S_00000030_ClassicAbinitio__stage_3_iter1_6 ... success! Continuing computation from checkpoint: chk_S_00000030_ClassicAbinitio__stage_3_iter1_7 ... success! Continuing computation from checkpoint: chk_S_00000030_ClassicAbinitio__stage_3_iter1_8 ... success! Starting work on structure: _00031 Starting work on structure: _00032 Starting work on structure: _00033 Starting work on structure: _00034 Starting work on structure: _00035 Starting work on structure: _00036 FILE_LOCK::unlock(): close failed.: Bad file descriptor [2010- 9-25 16: 5:35:] :: BOINC:: Initializing ... ok. [2010- 9-25 16: 5:35:] :: BOINC :: boinc_init() BOINC:: Setting up shared resources ... ok. BOINC:: Setting up semaphores ... ok. BOINC:: Updating status ... ok. BOINC:: Registering timer callback... ok. BOINC:: Worker initialized successfully. Registering options.. Registered extra options. Initializing broker options ... Registered extra options. Initializing core... Initializing options.... ok Options::initialize() Options::adding_options() Options::initialize() Check specs. Options::initialize() End reached Loaded options.... ok Processed options.... ok Initializing random generators... ok Initialization complete. Setting WU description ... Unpacking zip data: ../../projects/boinc.bakerlab.org_rosetta/minirosetta_database_rev36507.zip Setting database description ... Setting up checkpointing ... Setting up graphics native ... Setting up folding (abrelax) ... Beginning folding (abrelax) ... BOINC:: Worker startup. Starting watchdog... Watchdog active. Starting work on structure: _00036 Continuing computation from checkpoint: chk_S_00000036_ClassicAbinitio__stage_1 ... success! Continuing computation from checkpoint: chk_S_00000036_ClassicAbinitio__stage_2 ... success! Continuing computation from checkpoint: chk_S_00000036_ClassicAbinitio__stage_3_iter1_1 ... success! Continuing computation from checkpoint: chk_S_00000036_ClassicAbinitio__stage_3_iter1_2 ... success! Continuing computation from checkpoint: chk_S_00000036_ClassicAbinitio__stage_3_iter1_3 ... success! Continuing computation from checkpoint: chk_S_00000036_ClassicAbinitio__stage_3_iter1_4 ... success! Continuing computation from checkpoint: chk_S_00000036_ClassicAbinitio__stage_3_iter1_5 ... success! Continuing computation from checkpoint: chk_S_00000036_ClassicAbinitio__stage_3_iter1_6 ... success! Continuing computation from checkpoint: chk_S_00000036_ClassicAbinitio__stage_3_iter1_7 ... success! Continuing computation from checkpoint: chk_S_00000036_ClassicAbinitio__stage_3_iter1_8 ... success! Continuing computation from checkpoint: chk_S_00000036_ClassicAbinitio__stage_3_iter1_9 ... success! Continuing computation from checkpoint: chk_S_00000036_ClassicAbinitio__stage_3_iter1_10 ... success! Continuing computation from checkpoint: chk_S_00000036_ClassicAbinitio__stage4_kk_1 ... success! Continuing computation from checkpoint: chk_S_00000036_ClassicAbinitio__stage4_kk_2 ... success! Continuing computation from checkpoint: chk_S_00000036_ClassicAbinitio__stage4_kk_3 ... success! Starting work on structure: _00037 Starting work on structure: _00038 Starting work on structure: _00039 ====================================================== DONE :: 1 starting structures 10621.9 cpu seconds This process generated 39 decoys from 39 attempts ====================================================== BOINC :: Watchdog shutting down... BOINC :: BOINC support services shutting down cleanly ... called boinc_finish [2010- 9-25 16:19:21:] :: BOINC:: Initializing ... ok. [2010- 9-25 16:19:21:] :: BOINC :: boinc_init() BOINC:: Setting up shared resources ... ok. BOINC:: Setting up semaphores ... ok. BOINC:: Updating status ... ok. BOINC:: Registering timer callback... ok. BOINC:: Worker initialized successfully. Registering options.. Registered extra options. Initializing broker options ... Registered extra options. Initializing core... Initializing options.... ok Options::initialize() Options::adding_options() Options::initialize() Check specs. Options::initialize() End reached Loaded options.... ok Processed options.... ok Initializing random generators... ok Initialization complete. Setting WU description ... Unpacking zip data: ../../projects/boinc.bakerlab.org_rosetta/minirosetta_database_rev36507.zip Setting database description ... Setting up checkpointing ... Setting up graphics native ... Setting up folding (abrelax) ... Beginning folding (abrelax) ... BOINC:: Worker startup. Starting watchdog... Watchdog active. Starting work on structure: _00001 Starting work on structure: _00002 Starting work on structure: _00003 FILE_LOCK::unlock(): close failed.: Bad file descriptor [2010- 9-25 16:58:11:] :: BOINC:: Initializing ... ok. [2010- 9-25 16:58:11:] :: BOINC :: boinc_init() BOINC:: Setting up shared resources ... ok. BOINC:: Setting up semaphores ... ok. BOINC:: Updating status ... ok. BOINC:: Registering timer callback... ok. BOINC:: Worker initialized successfully. Registering options.. Registered extra options. Initializing broker options ... Registered extra options. Initializing core... Initializing options.... ok Options::initialize() Options::adding_options() Options::initialize() Check specs. Options::initialize() End reached Loaded options.... ok Processed options.... ok Initializing random generators... ok Initialization complete. Setting WU description ... Unpacking zip data: ../../projects/boinc.bakerlab.org_rosetta/minirosetta_database_rev36507.zip Setting database description ... Setting up checkpointing ... Setting up graphics native ... Setting up folding (abrelax) ... Beginning folding (abrelax) ... BOINC:: Worker startup. Starting watchdog... Watchdog active. Starting work on structure: _00003 Continuing computation from checkpoint: chk_S_00000003_ClassicAbinitio__stage_1 ... success! Continuing computation from checkpoint: chk_S_00000003_ClassicAbinitio__stage_2 ... success! Continuing computation from checkpoint: chk_S_00000003_ClassicAbinitio__stage_3_iter1_1 ... success! Continuing computation from checkpoint: chk_S_00000003_ClassicAbinitio__stage_3_iter1_2 ... success! Continuing computation from checkpoint: chk_S_00000003_ClassicAbinitio__stage_3_iter1_3 ... success! Continuing computation from checkpoint: chk_S_00000003_ClassicAbinitio__stage_3_iter1_4 ... success! Continuing computation from checkpoint: chk_S_00000003_ClassicAbinitio__stage_3_iter1_5 ... success! Continuing computation from checkpoint: chk_S_00000003_ClassicAbinitio__stage_3_iter1_6 ... success! Continuing computation from checkpoint: chk_S_00000003_ClassicAbinitio__stage_3_iter1_7 ... success! Starting work on structure: _00004 Starting work on structure: _00005 Starting work on structure: _00006 Starting work on structure: _00007 FILE_LOCK::unlock(): close failed.: Bad file descriptor [2010- 9-25 18:44:24:] :: BOINC:: Initializing ... ok. [2010- 9-25 18:44:24:] :: BOINC :: boinc_init() BOINC:: Setting up shared resources ... ok. BOINC:: Setting up semaphores ... ok. BOINC:: Updating status ... ok. BOINC:: Registering timer callback... ok. BOINC:: Worker initialized successfully. Registering options.. Registered extra options. Initializing broker options ... Registered extra options. Initializing core... Initializing options.... ok Options::initialize() Options::adding_options() Options::initialize() Check specs. Options::initialize() End reached Loaded options.... ok Processed options.... ok Initializing random generators... ok Initialization complete. Setting WU description ... Unpacking zip data: ../../projects/boinc.bakerlab.org_rosetta/minirosetta_database_rev36507.zip Setting database description ... Setting up checkpointing ... Setting up graphics native ... Setting up folding (abrelax) ... Beginning folding (abrelax) ... BOINC:: Worker startup. Starting watchdog... Watchdog active. Starting work on structure: _00007 Continuing computation from checkpoint: chk_S_00000007_ClassicAbinitio__stage_1 ... success! Continuing computation from checkpoint: chk_S_00000007_ClassicAbinitio__stage_2 ... success! Continuing computation from checkpoint: chk_S_00000007_ClassicAbinitio__stage_3_iter1_1 ... success! Continuing computation from checkpoint: chk_S_00000007_ClassicAbinitio__stage_3_iter1_2 ... success! Continuing computation from checkpoint: chk_S_00000007_ClassicAbinitio__stage_3_iter1_3 ... success! Starting work on structure: _00008 FILE_LOCK::unlock(): close failed.: Bad file descriptor [2010- 9-25 19:35:52:] :: BOINC:: Initializing ... ok. [2010- 9-25 19:35:52:] :: BOINC :: boinc_init() BOINC:: Setting up shared resources ... ok. BOINC:: Setting up semaphores ... ok. BOINC:: Updating status ... ok. BOINC:: Registering timer callback... ok. BOINC:: Worker initialized successfully. Registering options.. Registered extra options. Initializing broker options ... Registered extra options. Initializing core... Initializing options.... ok Options::initialize() Options::adding_options() Options::initialize() Check specs. Options::initialize() End reached Loaded options.... ok Processed options.... ok Initializing random generators... ok Initialization complete. Setting WU description ... Unpacking zip data: ../../projects/boinc.bakerlab.org_rosetta/minirosetta_database_rev36507.zip Setting database description ... Setting up checkpointing ... Setting up graphics native ... Setting up folding (abrelax) ... Beginning folding (abrelax) ... BOINC:: Worker startup. Starting watchdog... Watchdog active. Starting work on structure: _00008 Continuing computation from checkpoint: chk_S_00000008_ClassicAbinitio__stage_1 ... success! Continuing computation from checkpoint: chk_S_00000008_ClassicAbinitio__stage_2 ... success! Continuing computation from checkpoint: chk_S_00000008_ClassicAbinitio__stage_3_iter1_1 ... success! Continuing computation from checkpoint: chk_S_00000008_ClassicAbinitio__stage_3_iter1_2 ... success! Continuing computation from checkpoint: chk_S_00000008_ClassicAbinitio__stage_3_iter1_3 ... success! FILE_LOCK::unlock(): close failed.: Bad file descriptor [2010- 9-25 19:49:20:] :: BOINC:: Initializing ... ok. [2010- 9-25 19:49:20:] :: BOINC :: boinc_init() BOINC:: Setting up shared resources ... ok. BOINC:: Setting up semaphores ... ok. BOINC:: Updating status ... ok. BOINC:: Registering timer callback... ok. BOINC:: Worker initialized successfully. Registering options.. Registered extra options. Initializing broker options ... Registered extra options. Initializing core... Initializing options.... ok Options::initialize() Options::adding_options() Options::initialize() Check specs. Options::initialize() End reached Loaded options.... ok Processed options.... ok Initializing random generators... ok Initialization complete. Setting WU description ... Unpacking zip data: ../../projects/boinc.bakerlab.org_rosetta/minirosetta_database_rev36507.zip [2010- 9-25 19:59:25:] :: BOINC:: Initializing ... ok. [2010- 9-25 19:59:25:] :: BOINC :: boinc_init() BOINC:: Setting up shared resources ... ok. BOINC:: Setting up semaphores ... ok. BOINC:: Updating status ... ok. BOINC:: Registering timer callback... ok. BOINC:: Worker initialized successfully. Registering options.. Registered extra options. Initializing broker options ... Registered extra options. Initializing core... Initializing options.... ok Options::initialize() Options::adding_options() Options::initialize() Check specs. Options::initialize() End reached Loaded options.... ok Processed options.... ok Initializing random generators... ok Initialization complete. Setting WU description ... Unpacking zip data: ../../projects/boinc.bakerlab.org_rosetta/minirosetta_database_rev36507.zip Setting database description ... Setting up checkpointing ... Setting up graphics native ... Setting up folding (abrelax) ... Beginning folding (abrelax) ... BOINC:: Worker startup. Starting watchdog... Watchdog active. Starting work on structure: _00008 Continuing computation from checkpoint: chk_S_00000008_ClassicAbinitio__stage_1 ... success! Continuing computation from checkpoint: chk_S_00000008_ClassicAbinitio__stage_2 ... success! Continuing computation from checkpoint: chk_S_00000008_ClassicAbinitio__stage_3_iter1_1 ... success! Continuing computation from checkpoint: chk_S_00000008_ClassicAbinitio__stage_3_iter1_2 ... success! Continuing computation from checkpoint: chk_S_00000008_ClassicAbinitio__stage_3_iter1_3 ... success! Continuing computation from checkpoint: chk_S_00000008_ClassicAbinitio__stage_3_iter1_4 ... success! Continuing computation from checkpoint: chk_S_00000008_ClassicAbinitio__stage_3_iter1_5 ... success! Continuing computation from checkpoint: chk_S_00000008_ClassicAbinitio__stage_3_iter1_6 ... success! Continuing computation from checkpoint: chk_S_00000008_ClassicAbinitio__stage_3_iter1_7 ... success! Continuing computation from checkpoint: chk_S_00000008_ClassicAbinitio__stage_3_iter1_8 ... success! Continuing computation from checkpoint: chk_S_00000008_ClassicAbinitio__stage_3_iter1_9 ... success! Continuing computation from checkpoint: chk_S_00000008_ClassicAbinitio__stage_3_iter1_10 ... success! Continuing computation from checkpoint: chk_S_00000008_ClassicAbinitio__stage4_kk_1 ... success! Continuing computation from checkpoint: chk_S_00000008_ClassicAbinitio__stage4_kk_2 ... success! Continuing computation from checkpoint: chk_S_00000008_ClassicAbinitio__stage4_kk_3 ... success! Continuing computation from checkpoint: chk_S_00000008_FastRelax__chk1_fa ... success! Continuing computation from checkpoint: chk_S_00000008_FastRelax__chk2_fa ... success! Continuing computation from checkpoint: chk_S_00000008_FastRelax__chk3_fa ... success! Continuing computation from checkpoint: chk_S_00000008_FastRelax__chk4_fa ... success! Starting work on structure: _00009 Starting work on structure: _00010 Starting work on structure: _00011 Starting work on structure: _00012 ====================================================== DONE :: 1 starting structures 10458 cpu seconds This process generated 12 decoys from 12 attempts ====================================================== BOINC :: Watchdog shutting down... BOINC :: BOINC support services shutting down cleanly ... called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. MainError: 03:17:36 PM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. MainError: 03:23:57 PM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: Model crashed: Model crashed: Model crashed: Model crashed: Model crashed: Sorry, too many model crashes! :-( called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
04 Nov 2010 04:44:32	844607	11913444	hadsm3dhet2_u3ec_006725919_11	43,208	764,455	1.3610
04 Nov 2010 04:44:32	844607	11913444	hadsm3dhet2_u3ec_006725919_11	32,406	755,179	1.3708
01 Nov 2010 23:29:32	844607	11913444	hadsm3dhet2_u3ec_006725919_11	21,604	745,688	1.3806
01 Nov 2010 19:02:58	844607	11913444	hadsm3dhet2_u3ec_006725919_11	10,802	735,168	1.3889
01 Nov 2010 15:24:53	844607	11913444	hadsm3dhet2_u3ec_006725919_11	259,248	724,743	1.3978
01 Nov 2010 06:31:36	844607	11913444	hadsm3dhet2_u3ec_006725919_11	248,446	715,620	1.4095
01 Nov 2010 04:24:15	844607	11913444	hadsm3dhet2_u3ec_006725919_11	237,644	705,368	1.4196
31 Oct 2010 21:32:59	844607	11913444	hadsm3dhet2_u3ec_006725919_11	226,842	695,450	1.4307
31 Oct 2010 16:23:34	844607	11913444	hadsm3dhet2_u3ec_006725919_11	216,040	685,201	1.4417
30 Oct 2010 23:51:27	844607	11913444	hadsm3dhet2_u3ec_006725919_11	205,238	675,774	1.4549
30 Oct 2010 12:21:35	844607	11913444	hadsm3dhet2_u3ec_006725919_11	194,436	665,705	1.4673
28 Oct 2010 23:47:01	844607	11913444	hadsm3dhet2_u3ec_006725919_11	183,634	656,249	1.4818
28 Oct 2010 18:44:11	844607	11913444	hadsm3dhet2_u3ec_006725919_11	172,832	646,671	1.4966
28 Oct 2010 14:22:38	844607	11913444	hadsm3dhet2_u3ec_006725919_11	162,030	637,185	1.5125
28 Oct 2010 11:49:09	844607	11913444	hadsm3dhet2_u3ec_006725919_11	151,228	628,270	1.5306
28 Oct 2010 09:20:16	844607	11913444	hadsm3dhet2_u3ec_006725919_11	140,426	619,482	1.5500
28 Oct 2010 03:40:20	844607	11913444	hadsm3dhet2_u3ec_006725919_11	129,624	609,266	1.5668
27 Oct 2010 23:20:39	844607	11913444	hadsm3dhet2_u3ec_006725919_11	118,822	600,179	1.5875
27 Oct 2010 20:31:49	844607	11913444	hadsm3dhet2_u3ec_006725919_11	108,020	590,436	1.6076
27 Oct 2010 17:45:11	844607	11913444	hadsm3dhet2_u3ec_006725919_11	97,218	580,655	1.6289