climateprediction.net home page
Task 11588648

Task 11588648

Name famous_r204_799_200_006666615_1
Workunit 6869987
Created 22 Jun 2010, 10:51:13 UTC
Sent 27 Jun 2010, 2:22:14 UTC
Report deadline 26 Sep 2010, 9:49:25 UTC
Received 27 Jun 2010, 17:55:14 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 922557
Run time 6 hours 30 min 54 sec
CPU time 6 hours 30 min 54 sec
Validate state Invalid
Credit 61.85
Device peak FLOPS 1.61 GFLOPS
Application version UK Met Office FAMOUS v6.11
i686-pc-linux-gnu
Stderr
<core_client_version>5.10.45</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
Starting work on result famous_r204_799_200_006666615_1...
Starting model in /home/jsc/BOINC/projects/climateprediction.net...
Unzipping global model data file...
Unzipping workunit data file...
Created shared memory region key = 123100 of size 743572 bytes (version 608)
Copying files for startup...
In pre_initialise_phase (part 1 of 3)
In initialise_phase (part 2 of 3)
In startup_phase (part 3 of 3)
Copying model control files...
Starting model ID famous_r204_799_200_006666615   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 123100 /home/jsc/BOINC/slots/0
Program launched with process id # 28350
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_r204_799_200_006666615 - PH 1 TS 0000001 A - 01/12/0799 01:00 - H:M:S=0000:00:00 AVG= 0.55 DLT= 0.55

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_r204_799_200_006666615   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 123100 /home/jsc/BOINC/slots/0
Program launched with process id # 28496
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_r204_799_200_006666615 - PH 1 TS 0000391 A - 16/12/0799 01:00 - H:M:S=0000:09:21 AVG= 1.44 DLT= 1.75
famous_r204_799_200_006666615 - PH 1 TS 0000781 A - 01/01/0800 01:00 - H:M:S=0000:14:16 AVG= 1.10 DLT= 1.32

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_r204_799_200_006666615   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 123100 /home/jsc/BOINC/slots/0
Program launched with process id # 28846
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_r204_799_200_006666615 - PH 1 TS 0001171 A - 16/01/0800 01:00 - H:M:S=0000:20:22 AVG= 1.04 DLT= 1.45

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_r204_799_200_006666615   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 123100 /home/jsc/BOINC/slots/0
Program launched with process id # 29171
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 2...
Starting model ID famous_r204_799_200_006666615   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 123100 /home/jsc/BOINC/slots/0
Program launched with process id # 29304
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 3...
Starting model ID famous_r204_799_200_006666615   Phase 1
Program launched with process id # 29395
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 123100 /home/jsc/BOINC/slots/0
famous_r204_799_200_006666615 - PH 1 TS 0001561 A - 01/02/0800 01:00 - H:M:S=0000:35:25 AVG= 1.36 DLT= 1.62
famous_r204_799_200_006666615 - PH 1 TS 0001951 A - 16/02/0800 01:00 - H:M:S=0000:40:19 AVG= 1.24 DLT= 1.53

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_r204_799_200_006666615   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 123100 /home/jsc/BOINC/slots/0
Program launched with process id # 29705
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 2...
Starting model ID famous_r204_799_200_006666615   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 123100 /home/jsc/BOINC/slots/0
Program launched with process id # 29774
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_r204_799_200_006666615 - PH 1 TS 0002341 A - 01/03/0800 01:00 - H:M:S=0000:50:16 AVG= 1.29 DLT= 1.70

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_r204_799_200_006666615   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 123100 /home/jsc/BOINC/slots/0
Program launched with process id # 29975
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_r204_799_200_006666615 - PH 1 TS 0002731 A - 16/03/0800 01:00 - H:M:S=0000:56:42 AVG= 1.25 DLT= 1.19
famous_r204_799_200_006666615 - PH 1 TS 0003121 A - 01/04/0800 01:00 - H:M:S=0001:01:38 AVG= 1.18 DLT= 1.37
famous_r204_799_200_006666615 - PH 1 TS 0003511 A - 16/04/0800 01:00 - H:M:S=0001:06:33 AVG= 1.14 DLT= 1.37
famous_r204_799_200_006666615 - PH 1 TS 0003901 A - 01/05/0800 01:00 - H:M:S=0001:11:38 AVG= 1.10 DLT= 1.75

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_r204_799_200_006666615   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 123100 /home/jsc/BOINC/slots/0
Program launched with process id # 30690
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_r204_799_200_006666615 - PH 1 TS 0004291 A - 16/05/0800 01:00 - H:M:S=0001:19:50 AVG= 1.12 DLT= 1.36
famous_r204_799_200_006666615 - PH 1 TS 0004681 A - 01/06/0800 01:00 - H:M:S=0001:24:51 AVG= 1.09 DLT= 1.65

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_r204_799_200_006666615   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 123100 /home/jsc/BOINC/slots/0
Program launched with process id # 31105
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 2...
Starting model ID famous_r204_799_200_006666615   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 123100 /home/jsc/BOINC/slots/0
Program launched with process id # 31208
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_r204_799_200_006666615 - PH 1 TS 0005071 A - 16/06/0800 01:00 - H:M:S=0001:34:51 AVG= 1.12 DLT= 1.56
famous_r204_799_200_006666615 - PH 1 TS 0005461 A - 01/07/0800 01:00 - H:M:S=0001:39:48 AVG= 1.10 DLT= 1.65
famous_r204_799_200_006666615 - PH 1 TS 0005851 A - 16/07/0800 01:00 - H:M:S=0001:44:51 AVG= 1.08 DLT= 1.27
famous_r204_799_200_006666615 - PH 1 TS 0006241 A - 01/08/0800 01:00 - H:M:S=0001:49:44 AVG= 1.05 DLT= 1.25
famous_r204_799_200_006666615 - PH 1 TS 0006631 A - 16/08/0800 01:00 - H:M:S=0001:54:41 AVG= 1.04 DLT= 1.35

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_r204_799_200_006666615   Phase 1
Program launched with process id # 32270
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 123100 /home/jsc/BOINC/slots/0
famous_r204_799_200_006666615 - PH 1 TS 0006631 A - 16/08/0800 01:00 - H:M:S=0001:54:51 AVG= 1.04 DLT= 0.00
famous_r204_799_200_006666615 - PH 1 TS 0007021 A - 01/09/0800 01:00 - H:M:S=0001:59:52 AVG= 1.02 DLT= 1.31
famous_r204_799_200_006666615 - PH 1 TS 0007411 A - 16/09/0800 01:00 - H:M:S=0002:04:56 AVG= 1.01 DLT= 1.58
famous_r204_799_200_006666615 - PH 1 TS 0007801 A - 01/10/0800 01:00 - H:M:S=0002:10:03 AVG= 1.00 DLT= 1.50
famous_r204_799_200_006666615 - PH 1 TS 0008191 A - 16/10/0800 01:00 - H:M:S=0002:15:09 AVG= 0.99 DLT= 1.67
famous_r204_799_200_006666615 - PH 1 TS 0008581 A - 01/11/0800 01:00 - H:M:S=0002:20:09 AVG= 0.98 DLT= 1.97
famous_r204_799_200_006666615 - PH 1 TS 0008971 A - 16/11/0800 01:00 - H:M:S=0002:25:09 AVG= 0.97 DLT= 1.47

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_r204_799_200_006666615   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 123100 /home/jsc/BOINC/slots/0
Program launched with process id # 1234
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 2...
Starting model ID famous_r204_799_200_006666615   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 123100 /home/jsc/BOINC/slots/0
Program launched with process id # 1291
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Trickling yearly means for 800
Building file list for 800 in dataout -- 4 entries
Creating trickle file trickle_famous_r204_799_200_006666615_1_800.zip for upload...
famous_r204_799_200_006666615 - PH 1 TS 0009361 A - 01/12/0800 01:00 - H:M:S=0002:34:20 AVG= 0.99 DLT= 1.62
famous_r204_799_200_006666615 - PH 1 TS 0009751 A - 16/12/0800 01:00 - H:M:S=0002:39:16 AVG= 0.98 DLT= 1.86
famous_r204_799_200_006666615 - PH 1 TS 0010141 A - 01/01/0801 01:00 - H:M:S=0002:44:14 AVG= 0.97 DLT= 1.38

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_r204_799_200_006666615   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 123100 /home/jsc/BOINC/slots/0
Program launched with process id # 2048
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 2...
Starting model ID famous_r204_799_200_006666615   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 123100 /home/jsc/BOINC/slots/0
Program launched with process id # 2104
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 3...
Starting model ID famous_r204_799_200_006666615   Phase 1
Program launched with process id # 2215
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 123100 /home/jsc/BOINC/slots/0
famous_r204_799_200_006666615 - PH 1 TS 0010531 A - 16/01/0801 01:00 - H:M:S=0002:54:29 AVG= 0.99 DLT= 1.39
famous_r204_799_200_006666615 - PH 1 TS 0010921 A - 01/02/0801 01:00 - H:M:S=0002:59:30 AVG= 0.99 DLT= 1.56
famous_r204_799_200_006666615 - PH 1 TS 0011311 A - 16/02/0801 01:00 - H:M:S=0003:04:26 AVG= 0.98 DLT= 1.39
famous_r204_799_200_006666615 - PH 1 TS 0011701 A - 01/03/0801 01:00 - H:M:S=0003:09:28 AVG= 0.97 DLT= 1.53
famous_r204_799_200_006666615 - PH 1 TS 0012091 A - 16/03/0801 01:00 - H:M:S=0003:14:27 AVG= 0.96 DLT= 1.32
famous_r204_799_200_006666615 - PH 1 TS 0012481 A - 01/04/0801 01:00 - H:M:S=0003:19:29 AVG= 0.96 DLT= 1.63
famous_r204_799_200_006666615 - PH 1 TS 0012871 A - 16/04/0801 01:00 - H:M:S=0003:24:27 AVG= 0.95 DLT= 1.64
famous_r204_799_200_006666615 - PH 1 TS 0013261 A - 01/05/0801 01:00 - H:M:S=0003:29:26 AVG= 0.95 DLT= 1.79
famous_r204_799_200_006666615 - PH 1 TS 0013651 A - 16/05/0801 01:00 - H:M:S=0003:34:24 AVG= 0.94 DLT= 1.29
famous_r204_799_200_006666615 - PH 1 TS 0014041 A - 01/06/0801 01:00 - H:M:S=0003:39:27 AVG= 0.94 DLT= 1.51
famous_r204_799_200_006666615 - PH 1 TS 0014431 A - 16/06/0801 01:00 - H:M:S=0003:44:31 AVG= 0.93 DLT= 1.62

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_r204_799_200_006666615   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 123100 /home/jsc/BOINC/slots/0
Program launched with process id # 4713
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 2...
Starting model ID famous_r204_799_200_006666615   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 123100 /home/jsc/BOINC/slots/0
Program launched with process id # 4886
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 3...
Starting model ID famous_r204_799_200_006666615   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 123100 /home/jsc/BOINC/slots/0
Program launched with process id # 5045
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 4...
Starting model ID famous_r204_799_200_006666615   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 123100 /home/jsc/BOINC/slots/0
Program launched with process id # 5119
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 5...
Starting model ID famous_r204_799_200_006666615   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 123100 /home/jsc/BOINC/slots/0
Program launched with process id # 5299
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_r204_799_200_006666615 - PH 1 TS 0014821 A - 01/07/0801 01:00 - H:M:S=0004:05:12 AVG= 0.99 DLT= 1.54
famous_r204_799_200_006666615 - PH 1 TS 0015211 A - 16/07/0801 01:00 - H:M:S=0004:10:12 AVG= 0.99 DLT= 1.23
famous_r204_799_200_006666615 - PH 1 TS 0015601 A - 01/08/0801 01:00 - H:M:S=0004:15:08 AVG= 0.98 DLT= 1.69

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_r204_799_200_006666615   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 123100 /home/jsc/BOINC/slots/0
Program launched with process id # 6077
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 2...
Starting model ID famous_r204_799_200_006666615   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 123100 /home/jsc/BOINC/slots/0
Program launched with process id # 6143
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 3...
Starting model ID famous_r204_799_200_006666615   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 123100 /home/jsc/BOINC/slots/0
Program launched with process id # 6198
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_r204_799_200_006666615 - PH 1 TS 0015991 A - 16/08/0801 01:00 - H:M:S=0004:24:47 AVG= 0.99 DLT= 1.55
famous_r204_799_200_006666615 - PH 1 TS 0016381 A - 01/09/0801 01:00 - H:M:S=0004:29:45 AVG= 0.99 DLT= 1.53
famous_r204_799_200_006666615 - PH 1 TS 0016771 A - 16/09/0801 01:00 - H:M:S=0004:34:43 AVG= 0.98 DLT= 1.47
famous_r204_799_200_006666615 - PH 1 TS 0017161 A - 01/10/0801 01:00 - H:M:S=0004:39:40 AVG= 0.98 DLT= 1.71

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_r204_799_200_006666615   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 123100 /home/jsc/BOINC/slots/0
Program launched with process id # 7158
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_r204_799_200_006666615 - PH 1 TS 0017551 A - 16/10/0801 01:00 - H:M:S=0004:46:43 AVG= 0.98 DLT= 1.31
famous_r204_799_200_006666615 - PH 1 TS 0017941 A - 01/11/0801 01:00 - H:M:S=0004:51:45 AVG= 0.98 DLT= 1.71
famous_r204_799_200_006666615 - PH 1 TS 0018331 A - 16/11/0801 01:00 - H:M:S=0004:56:44 AVG= 0.97 DLT= 1.22
Trickling yearly means for 801
Building file list for 801 in dataout -- 4 entries
Creating trickle file trickle_famous_r204_799_200_006666615_1_801.zip for upload...
famous_r204_799_200_006666615 - PH 1 TS 0018721 A - 01/12/0801 01:00 - H:M:S=0005:01:44 AVG= 0.97 DLT= 1.71

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_r204_799_200_006666615   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 123100 /home/jsc/BOINC/slots/0
Program launched with process id # 8169
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 60 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 61 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
famous_r204_799_200_006666615 - PH 1 TS 0019111 A - 16/12/0801 01:00 - H:M:S=0005:09:59 AVG= 0.97 DLT= 1.30
famous_r204_799_200_006666615 - PH 1 TS 0019501 A - 01/01/0802 01:00 - H:M:S=0005:14:49 AVG= 0.97 DLT= 1.37
famous_r204_799_200_006666615 - PH 1 TS 0019891 A - 16/01/0802 01:00 - H:M:S=0005:19:46 AVG= 0.96 DLT= 1.29

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_r204_799_200_006666615   Phase 1
Program launched with process id # 8830
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 123100 /home/jsc/BOINC/slots/0
famous_r204_799_200_006666615 - PH 1 TS 0020281 A - 01/02/0802 01:00 - H:M:S=0005:26:03 AVG= 0.96 DLT= 1.41
famous_r204_799_200_006666615 - PH 1 TS 0020671 A - 16/02/0802 01:00 - H:M:S=0005:30:57 AVG= 0.96 DLT= 1.30
famous_r204_799_200_006666615 - PH 1 TS 0021061 A - 01/03/0802 01:00 - H:M:S=0005:35:55 AVG= 0.96 DLT= 1.48

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_r204_799_200_006666615   Phase 1
Program launched with process id # 9546
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 123100 /home/jsc/BOINC/slots/0
famous_r204_799_200_006666615 - PH 1 TS 0021451 A - 16/03/0802 01:00 - H:M:S=0005:41:42 AVG= 0.96 DLT= 1.44
famous_r204_799_200_006666615 - PH 1 TS 0021841 A - 01/04/0802 01:00 - H:M:S=0005:46:42 AVG= 0.95 DLT= 1.43
famous_r204_799_200_006666615 - PH 1 TS 0022231 A - 16/04/0802 01:00 - H:M:S=0005:51:43 AVG= 0.95 DLT= 1.62
famous_r204_799_200_006666615 - PH 1 TS 0022621 A - 01/05/0802 01:00 - H:M:S=0005:56:43 AVG= 0.95 DLT= 1.39
famous_r204_799_200_006666615 - PH 1 TS 0023011 A - 16/05/0802 01:00 - H:M:S=0006:01:44 AVG= 0.94 DLT= 1.65
famous_r204_799_200_006666615 - PH 1 TS 0023401 A - 01/06/0802 01:00 - H:M:S=0006:06:49 AVG= 0.94 DLT= 1.57
famous_r204_799_200_006666615 - PH 1 TS 0023791 A - 16/06/0802 01:00 - H:M:S=0006:11:59 AVG= 0.94 DLT= 1.43

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_r204_799_200_006666615   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 123100 /home/jsc/BOINC/slots/0
Program launched with process id # 11301
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_r204_799_200_006666615 - PH 1 TS 0024181 A - 01/07/0802 01:00 - H:M:S=0006:20:32 AVG= 0.94 DLT= 1.60
famous_r204_799_200_006666615 - PH 1 TS 0024571 A - 16/07/0802 01:00 - H:M:S=0006:25:34 AVG= 0.94 DLT= 1.54

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_r204_799_200_006666615   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 123100 /home/jsc/BOINC/slots/0
Program launched with process id # 11921
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 2...
Starting model ID famous_r204_799_200_006666615   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 123100 /home/jsc/BOINC/slots/0
Program launched with process id # 11978
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 3...
Starting model ID famous_r204_799_200_006666615   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 123100 /home/jsc/BOINC/slots/0
Program launched with process id # 11989
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 4...
Starting model ID famous_r204_799_200_006666615   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 123100 /home/jsc/BOINC/slots/0
Program launched with process id # 12010
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 5...
Starting model ID famous_r204_799_200_006666615   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 123100 /home/jsc/BOINC/slots/0
Program launched with process id # 12076
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Sorry, too many model crashes! :-(
Model restart required...
Sorry, too many model crashes! :-(
Cleaning up from the run...
 (28348): called boinc_finish
Detaching shared memory...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
27 Jun 2010 14:14:34 922557 11588648 famous_r204_799_200_006666615_1 18,746 18,104 0.9658
27 Jun 2010 08:23:27 922557 11588648 famous_r204_799_200_006666615_1 9,386 9,260 0.9866


©2024 climateprediction.net