climateprediction.net home page
Task 12391010

Task 12391010

Name famous_wcdp_599_200_007061116_0
Workunit 7264416
Created 17 Dec 2010, 13:26:43 UTC
Sent 17 Dec 2010, 16:13:34 UTC
Report deadline 18 Mar 2011, 23:40:45 UTC
Received 19 Mar 2011, 22:00:08 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1121181
Run time 6 days 0 hours 19 min 36 sec
CPU time 4 days 20 hours 43 min 33 sec
Validate state Invalid
Credit 1,328.00
Device peak FLOPS 1.60 GFLOPS
Application version UK Met Office FAMOUS v6.11
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
      
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Suspended CPDN Monitor - Suspend request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
CPDN Monitor - Quit request from BOINC...
Signal 15 received, exiting...
 (4010): called boinc_finish
CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
CPDN Monitor - Quit request from BOINC...
 (4063): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Signal 15 received, exiting...
 (6920): called boinc_finish

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
CPDN Monitor - Quit request from BOINC...
 (4200): Can't acquire lockfile (-154) - waiting 35s
 (4200): Can't acquire lockfile (-154) - exiting
 (4223): Can't acquire lockfile (-154) - waiting 35s
 (4223): Can't acquire lockfile (-154) - exiting
 (4295): Can't acquire lockfile (-154) - waiting 35s
 (4295): Can't acquire lockfile (-154) - exiting
 (4369): Can't acquire lockfile (-154) - waiting 35s
 (4369): Can't acquire lockfile (-154) - exiting
 (7636): Can't acquire lockfile (-154) - waiting 35s
 (7636): Can't acquire lockfile (-154) - exiting
 (7656): Can't acquire lockfile (-154) - waiting 35s
 (7656): Can't acquire lockfile (-154) - exiting
 (7658): Can't acquire lockfile (-154) - waiting 35s
 (7658): Can't acquire lockfile (-154) - exiting
 (7670): Can't acquire lockfile (-154) - waiting 35s
 (7670): Can't acquire lockfile (-154) - exiting
 (7710): Can't acquire lockfile (-154) - waiting 35s

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
 (7710): Can't acquire lockfile (-154) - exiting
 (7714): Can't acquire lockfile (-154) - waiting 35s
 (7714): Can't acquire lockfile (-154) - exiting
 (7739): Can't acquire lockfile (-154) - waiting 35s
 (7739): Can't acquire lockfile (-154) - exiting
 (7748): Can't acquire lockfile (-154) - waiting 35s
 (7748): Can't acquire lockfile (-154) - exiting
 (7761): Can't acquire lockfile (-154) - waiting 35s
 (7761): Can't acquire lockfile (-154) - exiting
 (9501): Can't acquire lockfile (-154) - waiting 35s
 (9501): Can't acquire lockfile (-154) - exiting
 (10123): Can't acquire lockfile (-154) - waiting 35s
 (10123): Can't acquire lockfile (-154) - exiting
 (10157): Can't acquire lockfile (-154) - waiting 35s
 (10157): Can't acquire lockfile (-154) - exiting
 (10173): Can't acquire lockfile (-154) - waiting 35s
 (10173): Can't acquire lockfile (-154) - exiting
 (10205): Can't acquire lockfile (-154) - waiting 35s
 (10205): Can't acquire lockfile (-154) - exiting
 (10208): Can't acquire lockfile (-154) - waiting 35s
 (10208): Can't acquire lockfile (-154) - exiting
 (10285): Can't acquire lockfile (-154) - waiting 35s
 (10285): Can't acquire lockfile (-154) - exiting
 (10320): Can't acquire lockfile (-154) - waiting 35s
 (10320): Can't acquire lockfile (-154) - exiting
 (10350): Can't acquire lockfile (-154) - waiting 35s
 (10350): Can't acquire lockfile (-154) - exiting
 (10374): Can't acquire lockfile (-154) - waiting 35s
 (10374): Can't acquire lockfile (-154) - exiting
 (10391): Can't acquire lockfile (-154) - waiting 35s
 (10391): Can't acquire lockfile (-154) - exiting
 (10441): Can't acquire lockfile (-154) - waiting 35s
 (10441): Can't acquire lockfile (-154) - exiting
 (10462): Can't acquire lockfile (-154) - waiting 35s
 (10462): Can't acquire lockfile (-154) - exiting
 (10472): Can't acquire lockfile (-154) - waiting 35s
 (10472): Can't acquire lockfile (-154) - exiting
 (10477): Can't acquire lockfile (-154) - waiting 35s
 (10477): Can't acquire lockfile (-154) - exiting
 (10486): Can't acquire lockfile (-154) - waiting 35s
 (10486): Can't acquire lockfile (-154) - exiting
 (10489): Can't acquire lockfile (-154) - waiting 35s
 (10489): Can't acquire lockfile (-154) - exiting
 (10493): Can't acquire lockfile (-154) - waiting 35s
 (10493): Can't acquire lockfile (-154) - exiting
 (10495): Can't acquire lockfile (-154) - waiting 35s
 (10495): Can't acquire lockfile (-154) - exiting
 (10521): Can't acquire lockfile (-154) - waiting 35s
 (10521): Can't acquire lockfile (-154) - exiting
 (10534): Can't acquire lockfile (-154) - waiting 35s
 (10534): Can't acquire lockfile (-154) - exiting
 (10566): Can't acquire lockfile (-154) - waiting 35s
 (10566): Can't acquire lockfile (-154) - exiting
 (10571): Can't acquire lockfile (-154) - waiting 35s
 (10571): Can't acquire lockfile (-154) - exiting
 (10621): Can't acquire lockfile (-154) - waiting 35s
 (10621): Can't acquire lockfile (-154) - exiting
 (10674): Can't acquire lockfile (-154) - waiting 35s
 (10674): Can't acquire lockfile (-154) - exiting
 (10683): Can't acquire lockfile (-154) - waiting 35s

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
 (10683): Can't acquire lockfile (-154) - exiting
 (10706): Can't acquire lockfile (-154) - waiting 35s
 (10706): Can't acquire lockfile (-154) - exiting
 (10728): Can't acquire lockfile (-154) - waiting 35s
 (10728): Can't acquire lockfile (-154) - exiting
 (10763): Can't acquire lockfile (-154) - waiting 35s
 (10763): Can't acquire lockfile (-154) - exiting
 (10769): Can't acquire lockfile (-154) - waiting 35s
 (10769): Can't acquire lockfile (-154) - exiting
 (10771): Can't acquire lockfile (-154) - waiting 35s
 (10771): Can't acquire lockfile (-154) - exiting
 (10775): Can't acquire lockfile (-154) - waiting 35s

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
 (10775): Can't acquire lockfile (-154) - exiting
 (10833): Can't acquire lockfile (-154) - waiting 35s
 (10833): Can't acquire lockfile (-154) - exiting
 (10876): Can't acquire lockfile (-154) - waiting 35s
 (10876): Can't acquire lockfile (-154) - exiting
 (10881): Can't acquire lockfile (-154) - waiting 35s
 (10881): Can't acquire lockfile (-154) - exiting
 (10891): Can't acquire lockfile (-154) - waiting 35s
 (10891): Can't acquire lockfile (-154) - exiting
 (10944): Can't acquire lockfile (-154) - waiting 35s
 (10944): Can't acquire lockfile (-154) - exiting
 (10972): Can't acquire lockfile (-154) - waiting 35s
 (10972): Can't acquire lockfile (-154) - exiting
 (10988): Can't acquire lockfile (-154) - waiting 35s
 (10988): Can't acquire lockfile (-154) - exiting
 (10990): Can't acquire lockfile (-154) - waiting 35s
 (10990): Can't acquire lockfile (-154) - exiting
 (11037): Can't acquire lockfile (-154) - waiting 35s
 (11037): Can't acquire lockfile (-154) - exiting
 (11054): Can't acquire lockfile (-154) - waiting 35s
 (11054): Can't acquire lockfile (-154) - exiting
 (11063): Can't acquire lockfile (-154) - waiting 35s
 (11063): Can't acquire lockfile (-154) - exiting
 (11066): Can't acquire lockfile (-154) - waiting 35s
 (11066): Can't acquire lockfile (-154) - exiting
 (11075): Can't acquire lockfile (-154) - waiting 35s
 (11075): Can't acquire lockfile (-154) - exiting
 (11087): Can't acquire lockfile (-154) - waiting 35s
 (11087): Can't acquire lockfile (-154) - exiting
 (11100): Can't acquire lockfile (-154) - waiting 35s
 (11100): Can't acquire lockfile (-154) - exiting
 (11586): Can't acquire lockfile (-154) - waiting 35s
 (11586): Can't acquire lockfile (-154) - exiting
 (11775): Can't acquire lockfile (-154) - waiting 35s
 (11775): Can't acquire lockfile (-154) - exiting
 (11779): Can't acquire lockfile (-154) - waiting 35s
 (11779): Can't acquire lockfile (-154) - exiting
 (11845): Can't acquire lockfile (-154) - waiting 35s
 (11845): Can't acquire lockfile (-154) - exiting
 (11861): Can't acquire lockfile (-154) - waiting 35s
 (11861): Can't acquire lockfile (-154) - exiting
 (11863): Can't acquire lockfile (-154) - waiting 35s
 (11863): Can't acquire lockfile (-154) - exiting
 (11865): Can't acquire lockfile (-154) - waiting 35s
 (11865): Can't acquire lockfile (-154) - exiting
 (11868): Can't acquire lockfile (-154) - waiting 35s
 (11868): Can't acquire lockfile (-154) - exiting
 (11870): Can't acquire lockfile (-154) - waiting 35s
 (11870): Can't acquire lockfile (-154) - exiting
 (11872): Can't acquire lockfile (-154) - waiting 35s
 (11872): Can't acquire lockfile (-154) - exiting
 (11874): Can't acquire lockfile (-154) - waiting 35s
 (11874): Can't acquire lockfile (-154) - exiting
 (11876): Can't acquire lockfile (-154) - waiting 35s
 (11876): Can't acquire lockfile (-154) - exiting
 (11878): Can't acquire lockfile (-154) - waiting 35s
 (11878): Can't acquire lockfile (-154) - exiting
 (11880): Can't acquire lockfile (-154) - waiting 35s
 (11880): Can't acquire lockfile (-154) - exiting
 (11882): Can't acquire lockfile (-154) - waiting 35s
 (11882): Can't acquire lockfile (-154) - exiting
 (11906): Can't acquire lockfile (-154) - waiting 35s
 (11906): Can't acquire lockfile (-154) - exiting
 (11908): Can't acquire lockfile (-154) - waiting 35s
 (11908): Can't acquire lockfile (-154) - exiting
 (11910): Can't acquire lockfile (-154) - waiting 35s
 (11910): Can't acquire lockfile (-154) - exiting
 (11915): Can't acquire lockfile (-154) - waiting 35s
 (11915): Can't acquire lockfile (-154) - exiting
 (11918): Can't acquire lockfile (-154) - waiting 35s
 (11918): Can't acquire lockfile (-154) - exiting
 (11920): Can't acquire lockfile (-154) - waiting 35s
 (11920): Can't acquire lockfile (-154) - exiting
 (11925): Can't acquire lockfile (-154) - waiting 35s
 (11925): Can't acquire lockfile (-154) - exiting
 (11927): Can't acquire lockfile (-154) - waiting 35s
 (11927): Can't acquire lockfile (-154) - exiting
 (11929): Can't acquire lockfile (-154) - waiting 35s
 (11929): Can't acquire lockfile (-154) - exiting
 (11931): Can't acquire lockfile (-154) - waiting 35s
 (11931): Can't acquire lockfile (-154) - exiting
 (11933): Can't acquire lockfile (-154) - waiting 35s
 (11933): Can't acquire lockfile (-154) - exiting
 (11935): Can't acquire lockfile (-154) - waiting 35s
 (11935): Can't acquire lockfile (-154) - exiting
 (11937): Can't acquire lockfile (-154) - waiting 35s
 (11937): Can't acquire lockfile (-154) - exiting
 (11941): Can't acquire lockfile (-154) - waiting 35s
 (11941): Can't acquire lockfile (-154) - exiting
 (11944): Can't acquire lockfile (-154) - waiting 35s
 (11944): Can't acquire lockfile (-154) - exiting
 (11953): Can't acquire lockfile (-154) - waiting 35s
 (11953): Can't acquire lockfile (-154) - exiting
 (11956): Can't acquire lockfile (-154) - waiting 35s
 (11956): Can't acquire lockfile (-154) - exiting
 (11962): Can't acquire lockfile (-154) - waiting 35s
 (11962): Can't acquire lockfile (-154) - exiting
 (11973): Can't acquire lockfile (-154) - waiting 35s
 (11973): Can't acquire lockfile (-154) - exiting
 (11979): Can't acquire lockfile (-154) - waiting 35s
 (11979): Can't acquire lockfile (-154) - exiting
 (11981): Can't acquire lockfile (-154) - waiting 35s
 (11981): Can't acquire lockfile (-154) - exiting
 (11989): Can't acquire lockfile (-154) - waiting 35s
 (11989): Can't acquire lockfile (-154) - exiting
 (11991): Can't acquire lockfile (-154) - waiting 35s
 (11991): Can't acquire lockfile (-154) - exiting
 (11999): Can't acquire lockfile (-154) - waiting 35s
 (11999): Can't acquire lockfile (-154) - exiting
 (12004): Can't acquire lockfile (-154) - waiting 35s
 (12004): Can't acquire lockfile (-154) - exiting
 (12009): Can't acquire lockfile (-154) - waiting 35s
 (12009): Can't acquire lockfile (-154) - exiting
 (12038): Can't acquire lockfile (-154) - waiting 35s
 (12038): Can't acquire lockfile (-154) - exiting
 (12040): Can't acquire lockfile (-154) - waiting 35s
 (12040): Can't acquire lockfile (-154) - exiting
 (12046): Can't acquire lockfile (-154) - waiting 35s
 (12046): Can't acquire lockfile (-154) - exiting
 (12049): Can't acquire lockfile (-154) - waiting 35s
 (12049): Can't acquire lockfile (-154) - exiting
 (12052): Can't acquire lockfile (-154) - waiting 35s
 (12052): Can't acquire lockfile (-154) - exiting
 (12054): Can't acquire lockfile (-154) - waiting 35s
 (12054): Can't acquire lockfile (-154) - exiting
 (12061): Can't acquire lockfile (-154) - waiting 35s
 (12061): Can't acquire lockfile (-154) - exiting
 (12064): Can't acquire lockfile (-154) - waiting 35s
 (12064): Can't acquire lockfile (-154) - exiting
 (12068): Can't acquire lockfile (-154) - waiting 35s
 (12068): Can't acquire lockfile (-154) - exiting
 (12078): Can't acquire lockfile (-154) - waiting 35s
 (12078): Can't acquire lockfile (-154) - exiting
 (12081): Can't acquire lockfile (-154) - waiting 35s
 (12081): Can't acquire lockfile (-154) - exiting
 (12085): Can't acquire lockfile (-154) - waiting 35s
 (12085): Can't acquire lockfile (-154) - exiting
 (12090): Can't acquire lockfile (-154) - waiting 35s
 (12090): Can't acquire lockfile (-154) - exiting
 (12092): Can't acquire lockfile (-154) - waiting 35s
 (12092): Can't acquire lockfile (-154) - exiting
 (12094): Can't acquire lockfile (-154) - waiting 35s
 (12094): Can't acquire lockfile (-154) - exiting
 (12101): Can't acquire lockfile (-154) - waiting 35s
 (12101): Can't acquire lockfile (-154) - exiting
 (12103): Can't acquire lockfile (-154) - waiting 35s
 (12103): Can't acquire lockfile (-154) - exiting
 (12106): Can't acquire lockfile (-154) - waiting 35s
 (12106): Can't acquire lockfile (-154) - exiting
 (12111): Can't acquire lockfile (-154) - waiting 35s
 (12111): Can't acquire lockfile (-154) - exiting
 (12115): Can't acquire lockfile (-154) - waiting 35s
 (12115): Can't acquire lockfile (-154) - exiting
 (12117): Can't acquire lockfile (-154) - waiting 35s
 (12117): Can't acquire lockfile (-154) - exiting
 (12119): Can't acquire lockfile (-154) - waiting 35s
 (12119): Can't acquire lockfile (-154) - exiting
 (12127): Can't acquire lockfile (-154) - waiting 35s
 (12127): Can't acquire lockfile (-154) - exiting
 (12130): Can't acquire lockfile (-154) - waiting 35s
 (12130): Can't acquire lockfile (-154) - exiting
 (12133): Can't acquire lockfile (-154) - waiting 35s
 (12133): Can't acquire lockfile (-154) - exiting
 (12157): Can't acquire lockfile (-154) - waiting 35s
 (12157): Can't acquire lockfile (-154) - exiting
 (12162): Can't acquire lockfile (-154) - waiting 35s
 (12162): Can't acquire lockfile (-154) - exiting
 (12164): Can't acquire lockfile (-154) - waiting 35s
 (12164): Can't acquire lockfile (-154) - exiting
 (12167): Can't acquire lockfile (-154) - waiting 35s
 (12167): Can't acquire lockfile (-154) - exiting
 (12175): Can't acquire lockfile (-154) - waiting 35s
 (12175): Can't acquire lockfile (-154) - exiting
 (12178): Can't acquire lockfile (-154) - waiting 35s
 (12178): Can't acquire lockfile (-154) - exiting
 (12182): Can't acquire lockfile (-154) - waiting 35s
 (12182): Can't acquire lockfile (-154) - exiting
 (12186): Can't acquire lockfile (-154) - waiting 35s
 (12186): Can't acquire lockfile (-154) - exiting
 (12188): Can't acquire lockfile (-154) - waiting 35s
 (12188): Can't acquire lockfile (-154) - exiting
 (12192): Can't acquire lockfile (-154) - waiting 35s
 (12192): Can't acquire lockfile (-154) - exiting
 (12194): Can't acquire lockfile (-154) - waiting 35s
 (12194): Can't acquire lockfile (-154) - exiting
 (12201): Can't acquire lockfile (-154) - waiting 35s
 (12201): Can't acquire lockfile (-154) - exiting
 (12203): Can't acquire lockfile (-154) - waiting 35s
 (12203): Can't acquire lockfile (-154) - exiting
 (12205): Can't acquire lockfile (-154) - waiting 35s
 (12205): Can't acquire lockfile (-154) - exiting
 (12210): Can't acquire lockfile (-154) - waiting 35s
 (12210): Can't acquire lockfile (-154) - exiting
 (12212): Can't acquire lockfile (-154) - waiting 35s
 (12212): Can't acquire lockfile (-154) - exiting
 (12214): Can't acquire lockfile (-154) - waiting 35s
 (12214): Can't acquire lockfile (-154) - exiting
 (12216): Can't acquire lockfile (-154) - waiting 35s
 (12216): Can't acquire lockfile (-154) - exiting
 (12224): Can't acquire lockfile (-154) - waiting 35s
 (12224): Can't acquire lockfile (-154) - exiting
 (12226): Can't acquire lockfile (-154) - waiting 35s
 (12226): Can't acquire lockfile (-154) - exiting
 (12230): Can't acquire lockfile (-154) - waiting 35s
 (12230): Can't acquire lockfile (-154) - exiting
 (12242): Can't acquire lockfile (-154) - waiting 35s
 (12242): Can't acquire lockfile (-154) - exiting
 (12244): Can't acquire lockfile (-154) - waiting 35s
 (12244): Can't acquire lockfile (-154) - exiting
 (12246): Can't acquire lockfile (-154) - waiting 35s
 (12246): Can't acquire lockfile (-154) - exiting
 (12257): Can't acquire lockfile (-154) - waiting 35s
 (12257): Can't acquire lockfile (-154) - exiting
 (12281): Can't acquire lockfile (-154) - waiting 35s
 (12281): Can't acquire lockfile (-154) - exiting
 (12283): Can't acquire lockfile (-154) - waiting 35s
 (12283): Can't acquire lockfile (-154) - exiting
 (12285): Can't acquire lockfile (-154) - waiting 35s
 (12285): Can't acquire lockfile (-154) - exiting
 (12291): Can't acquire lockfile (-154) - waiting 35s
 (12291): Can't acquire lockfile (-154) - exiting
 (12293): Can't acquire lockfile (-154) - waiting 35s
 (12293): Can't acquire lockfile (-154) - exiting
 (12295): Can't acquire lockfile (-154) - waiting 35s
 (12295): Can't acquire lockfile (-154) - exiting
 (12307): Can't acquire lockfile (-154) - waiting 35s
 (12307): Can't acquire lockfile (-154) - exiting
 (12309): Can't acquire lockfile (-154) - waiting 35s
 (12309): Can't acquire lockfile (-154) - exiting
 (12312): Can't acquire lockfile (-154) - waiting 35s
 (12312): Can't acquire lockfile (-154) - exiting
 (12314): Can't acquire lockfile (-154) - waiting 35s

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
 (12314): Can't acquire lockfile (-154) - exiting
 (12321): Can't acquire lockfile (-154) - waiting 35s
 (12321): Can't acquire lockfile (-154) - exiting
 (12325): Can't acquire lockfile (-154) - waiting 35s
 (12325): Can't acquire lockfile (-154) - exiting
 (12327): Can't acquire lockfile (-154) - waiting 35s
 (12327): Can't acquire lockfile (-154) - exiting
 (12336): Can't acquire lockfile (-154) - waiting 35s
 (12336): Can't acquire lockfile (-154) - exiting
 (12347): Can't acquire lockfile (-154) - waiting 35s
 (12347): Can't acquire lockfile (-154) - exiting
 (12349): Can't acquire lockfile (-154) - waiting 35s
 (12349): Can't acquire lockfile (-154) - exiting
 (12359): Can't acquire lockfile (-154) - waiting 35s
 (12359): Can't acquire lockfile (-154) - exiting
 (12361): Can't acquire lockfile (-154) - waiting 35s
 (12361): Can't acquire lockfile (-154) - exiting
 (12367): Can't acquire lockfile (-154) - waiting 35s
 (12367): Can't acquire lockfile (-154) - exiting
 (12369): Can't acquire lockfile (-154) - waiting 35s
 (12369): Can't acquire lockfile (-154) - exiting
 (12376): Can't acquire lockfile (-154) - waiting 35s
 (12376): Can't acquire lockfile (-154) - exiting
 (12378): Can't acquire lockfile (-154) - waiting 35s
 (12378): Can't acquire lockfile (-154) - exiting
 (12387): Can't acquire lockfile (-154) - waiting 35s
 (12387): Can't acquire lockfile (-154) - exiting
 (12389): Can't acquire lockfile (-154) - waiting 35s
 (12389): Can't acquire lockfile (-154) - exiting
 (12392): Can't acquire lockfile (-154) - waiting 35s
 (12392): Can't acquire lockfile (-154) - exiting
 (12397): Can't acquire lockfile (-154) - waiting 35s
 (12397): Can't acquire lockfile (-154) - exiting
 (12422): Can't acquire lockfile (-154) - waiting 35s
 (12422): Can't acquire lockfile (-154) - exiting
 (12426): Can't acquire lockfile (-154) - waiting 35s
 (12426): Can't acquire lockfile (-154) - exiting
 (12428): Can't acquire lockfile (-154) - waiting 35s
 (12428): Can't acquire lockfile (-154) - exiting
 (12434): Can't acquire lockfile (-154) - waiting 35s
 (12434): Can't acquire lockfile (-154) - exiting
 (12436): Can't acquire lockfile (-154) - waiting 35s
 (12436): Can't acquire lockfile (-154) - exiting
 (12440): Can't acquire lockfile (-154) - waiting 35s
 (12440): Can't acquire lockfile (-154) - exiting
 (12442): Can't acquire lockfile (-154) - waiting 35s
 (12442): Can't acquire lockfile (-154) - exiting
 (12445): Can't acquire lockfile (-154) - waiting 35s
 (12445): Can't acquire lockfile (-154) - exiting
 (12447): Can't acquire lockfile (-154) - waiting 35s
 (12447): Can't acquire lockfile (-154) - exiting
 (12449): Can't acquire lockfile (-154) - waiting 35s
 (12449): Can't acquire lockfile (-154) - exiting
 (12451): Can't acquire lockfile (-154) - waiting 35s
 (12451): Can't acquire lockfile (-154) - exiting
 (12453): Can't acquire lockfile (-154) - waiting 35s
 (12453): Can't acquire lockfile (-154) - exiting
 (12455): Can't acquire lockfile (-154) - waiting 35s
 (12455): Can't acquire lockfile (-154) - exiting
 (12457): Can't acquire lockfile (-154) - waiting 35s
 (12457): Can't acquire lockfile (-154) - exiting
 (12462): Can't acquire lockfile (-154) - waiting 35s
 (12462): Can't acquire lockfile (-154) - exiting
 (12464): Can't acquire lockfile (-154) - waiting 35s
 (12464): Can't acquire lockfile (-154) - exiting
 (12470): Can't acquire lockfile (-154) - waiting 35s
 (12470): Can't acquire lockfile (-154) - exiting
 (12473): Can't acquire lockfile (-154) - waiting 35s
 (12473): Can't acquire lockfile (-154) - exiting
 (12493): Can't acquire lockfile (-154) - waiting 35s
CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
CPDN Monitor - Quit request from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 60 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 61 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Sorry, too many model crashes! :-(
 (5400): called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
12 Mar 2011 23:53:08 1121181 12391010 famous_wcdp_599_200_007061116_0 402,506 414,831 1.0306
12 Mar 2011 21:03:32 1121181 12391010 famous_wcdp_599_200_007061116_0 393,146 405,187 1.0306
12 Mar 2011 17:58:45 1121181 12391010 famous_wcdp_599_200_007061116_0 383,786 395,892 1.0315
12 Mar 2011 13:48:04 1121181 12391010 famous_wcdp_599_200_007061116_0 374,426 386,594 1.0325
12 Mar 2011 10:56:35 1121181 12391010 famous_wcdp_599_200_007061116_0 365,066 377,345 1.0336
11 Mar 2011 22:21:32 1121181 12391010 famous_wcdp_599_200_007061116_0 355,706 366,840 1.0313
11 Mar 2011 19:43:02 1121181 12391010 famous_wcdp_599_200_007061116_0 346,346 356,775 1.0301
11 Mar 2011 17:12:25 1121181 12391010 famous_wcdp_599_200_007061116_0 336,986 347,386 1.0309
11 Mar 2011 14:57:25 1121181 12391010 famous_wcdp_599_200_007061116_0 327,626 336,985 1.0286
11 Mar 2011 14:57:25 1121181 12391010 famous_wcdp_599_200_007061116_0 318,266 327,320 1.0284
11 Mar 2011 14:57:25 1121181 12391010 famous_wcdp_599_200_007061116_0 308,906 318,229 1.0302
27 Feb 2011 20:34:36 1121181 12391010 famous_wcdp_599_200_007061116_0 299,546 308,468 1.0298
27 Feb 2011 15:42:46 1121181 12391010 famous_wcdp_599_200_007061116_0 290,186 297,946 1.0267
27 Feb 2011 15:42:46 1121181 12391010 famous_wcdp_599_200_007061116_0 280,826 288,283 1.0266
26 Feb 2011 22:52:07 1121181 12391010 famous_wcdp_599_200_007061116_0 271,466 279,009 1.0278
26 Feb 2011 19:45:54 1121181 12391010 famous_wcdp_599_200_007061116_0 262,106 269,218 1.0271
20 Feb 2011 19:52:52 1121181 12391010 famous_wcdp_599_200_007061116_0 252,746 259,943 1.0285
20 Feb 2011 17:09:52 1121181 12391010 famous_wcdp_599_200_007061116_0 243,386 250,622 1.0297
20 Feb 2011 14:07:14 1121181 12391010 famous_wcdp_599_200_007061116_0 234,026 240,738 1.0287
12 Feb 2011 18:33:46 1121181 12391010 famous_wcdp_599_200_007061116_0 224,666 230,328 1.0252


©2024 climateprediction.net