climateprediction.net home page
Task 13244874

Task 13244874

Name hadam3p_eu_2t72_1971_1_007400161_0
Workunit 7597591
Created 14 Aug 2011, 5:24:56 UTC
Sent 14 Aug 2011, 5:25:07 UTC
Report deadline 26 Jul 2012, 10:45:07 UTC
Received 21 Sep 2011, 8:51:44 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1016212
Run time 10 days 14 hours 22 min 20 sec
CPU time 6 days 15 hours 17 min 25 sec
Validate state Workunit error - check skipped
Credit 2,386.39
Device peak FLOPS 1.72 GFLOPS
Application version UK Met Office HadAM3P-HadRM3P Europe v6.09
windows_intelx86
Stderr
<core_client_version>6.6.38</core_client_version>
<![CDATA[
<stderr_txt>
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4428, iMonCtr=2
Model crash detected, will try to restart...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5984, iMonCtr=2
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6120, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=284, selfPID=4984, iMonCtr=1
Model crash detected, will try to restart...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5224, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5904, selfPID=5004, iMonCtr=1
Model crash detected, will try to restart...
05:22:09 (5120): No heartbeat from core client for 30 sec - exiting
05:22:10 (5120): No heartbeat from core client for 30 sec - exiting
05:22:11 (5120): No heartbeat from core client for 30 sec - exiting
05:22:12 (5120): No heartbeat from core client for 30 sec - exiting
05:22:13 (5120): No heartbeat from core client for 30 sec - exiting
05:22:14 (5120): No heartbeat from core client for 30 sec - exiting
05:22:15 (5120): No heartbeat from core client for 30 sec - exiting
05:22:16 (5120): No heartbeat from core client for 30 sec - exiting
05:22:17 (5120): No heartbeat from core client for 30 sec - exiting
05:22:18 (5120): No heartbeat from core client for 30 sec - exiting
05:22:19 (5120): No heartbeat from core client for 30 sec - exiting
05:22:20 (5120): No heartbeat from core client for 30 sec - exiting
05:22:21 (5120): No heartbeat from core client for 30 sec - exiting
05:22:22 (5120): No heartbeat from core client for 30 sec - exiting
05:22:23 (5120): No heartbeat from core client for 30 sec - exiting
05:22:24 (5120): No heartbeat from core client for 30 sec - exiting
05:22:25 (5120): No heartbeat from core client for 30 sec - exiting
05:22:26 (5120): No heartbeat from core client for 30 sec - exiting
05:22:27 (5120): No heartbeat from core client for 30 sec - exiting
05:22:28 (5120): No heartbeat from core client for 30 sec - exiting
05:22:29 (5120): No heartbeat from core client for 30 sec - exiting
05:22:30 (5120): No heartbeat from core client for 30 sec - exiting
05:22:31 (5120): No heartbeat from core client for 30 sec - exiting
05:22:32 (5120): No heartbeat from core client for 30 sec - exiting
05:22:33 (5120): No heartbeat from core client for 30 sec - exiting
05:22:34 (5120): No heartbeat from core client for 30 sec - exiting
05:22:36 (5120): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4332, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6140, iMonCtr=2
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5276, selfPID=6120, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1444, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4156, selfPID=5804, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5008, iMonCtr=2
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2056, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1584, selfPID=5728, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
22:03:29 (5320): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:03:30 (5320): No heartbeat from core client for 30 sec - exiting
22:03:31 (5320): No heartbeat from core client for 30 sec - exiting
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5176, iMonCtr=2
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
CGntroller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4132, iMonCtr=2
Model crash detected, will try to restart...
lobal Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4900, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5788, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5744, iMonCtr=2
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5244, iMonCtr=2
Model crash detected, will try to restart...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4228, iMonCtr=2
Leaving CPDN_Main::Monitor...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4980, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4880, selfPID=6116, iMonCtr=1
Model crash detected, will try to restart...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2700, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5704, iMonCtr=2
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5212, iMonCtr=2
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4300, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5360, iMonCtr=2
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4444, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5348, iMonCtr=2
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5636, iMonCtr=2
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4164, iMonCtr=2
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5056, iMonCtr=2
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5068, iMonCtr=2
Model crash detected, will try to restart...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3992, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5848, iMonCtr=2
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5264, iMonCtr=2
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
17:16:06 (5332): No heartbeat from core client for 30 sec - exiting
17:16:07 (5332): No heartbeat from core client for 30 sec - exiting
17:16:08 (5332): No heartbeat from core client for 30 sec - exiting
17:16:09 (5332): No heartbeat from core client for 30 sec - exiting
17:16:10 (5332): No heartbeat from core client for 30 sec - exiting
17:16:11 (5332): No heartbeat from core client for 30 sec - exiting
17:16:12 (5332): No heartbeat from core client for 30 sec - exiting
17:16:13 (5332): No heartbeat from core client for 30 sec - exiting
17:16:15 (5332): No heartbeat from core client for 30 sec - exiting
17:16:16 (5332): No heartbeat from core client for 30 sec - exiting
17:16:17 (5332): No heartbeat from core client for 30 sec - exiting
17:16:18 (5332): No heartbeat from core client for 30 sec - exiting
17:16:19 (5332): No heartbeat from core client for 30 sec - exiting
17:16:20 (5332): No heartbeat from core client for 30 sec - exiting
17:16:21 (5332): No heartbeat from core client for 30 sec - exiting
17:16:22 (5332): No heartbeat from core client for 30 sec - exiting
17:16:23 (5332): No heartbeat from core client for 30 sec - exiting
17:16:24 (5332): No heartbeat from core client for 30 sec - exiting
17:16:25 (5332): No heartbeat from core client for 30 sec - exiting
17:16:27 (5332): No heartbeat from core client for 30 sec - exiting
17:16:28 (5332): No heartbeat from core client for 30 sec - exiting
17:16:29 (5332): No heartbeat from core client for 30 sec - exiting
17:16:30 (5332): No heartbeat from core client for 30 sec - exiting
17:16:31 (5332): No heartbeat from core client for 30 sec - exiting
17:16:32 (5332): No heartbeat from core client for 30 sec - exiting
17:16:33 (5332): No heartbeat from core client for 30 sec - exiting
17:16:34 (5332): No heartbeat from core client for 30 sec - exiting
17:16:35 (5332): No heartbeat from core client for 30 sec - exiting
17:16:36 (5332): No heartbeat from core client for 30 sec - exiting
17:16:37 (5332): No heartbeat from core client for 30 sec - exiting
17:16:39 (5332): No heartbeat from core client for 30 sec - exiting
17:16:40 (5332): No heartbeat from core client for 30 sec - exiting
17:16:41 (5332): No heartbeat from core client for 30 sec - exiting
17:16:42 (5332): No heartbeat from core client for 30 sec - exiting
17:16:43 (5332): No heartbeat from core client for 30 sec - exiting
17:16:44 (5332): No heartbeat from core client for 30 sec - exiting
17:16:45 (5332): No heartbeat from core client for 30 sec - exiting
17:16:46 (5332): No heartbeat from core client for 30 sec - exiting
17:16:47 (5332): No heartbeat from core client for 30 sec - exiting
17:16:48 (5332): No heartbeat from core client for 30 sec - exiting
17:16:50 (5332): No heartbeat from core client for 30 sec - exiting
17:16:51 (5332): No heartbeat from core client for 30 sec - exiting
17:16:52 (5332): No heartbeat from core client for 30 sec - exiting
17:16:53 (5332): No heartbeat from core client for 30 sec - exiting
17:16:54 (5332): No heartbeat from core client for 30 sec - exiting
17:16:55 (5332): No heartbeat from core client for 30 sec - exiting
17:16:56 (5332): No heartbeat from core client for 30 sec - exiting
17:16:57 (5332): No heartbeat from core client for 30 sec - exiting
17:16:58 (5332): No heartbeat from core client for 30 sec - exiting
17:16:59 (5332): No heartbeat from core client for 30 sec - exiting
17:17:00 (5332): No heartbeat from core client for 30 sec - exiting
17:17:02 (5332): No heartbeat from core client for 30 sec - exiting
17:17:03 (5332): No heartbeat from core client for 30 sec - exiting
17:17:04 (5332): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CGlobal Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5500, iMonCtr=2
ontroller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5844, iMonCtr=2
Model crash detected, will try to restart...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2108, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4092, selfPID=5312, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5176, iMonCtr=2
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3492, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5920, iMonCtr=2
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3220, selfPID=6004, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
CGntroller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5504, iMonCtr=2
Model crash detected, will try to restart...
lobal Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5612, iMonCtr=2
Leaving CPDN_Main::Monitor...
23:26:13 (5180): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5472, selfPID=5468, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5736, iMonCtr=2
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3108, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5204, iMonCtr=2
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5720, iMonCtr=2
Model crash detected, will try to restart...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2644, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5596, iMonCtr=2
Model crash detected, will try to restart...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2604, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5872, iMonCtr=2
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
22:57:35 (5028): No heartbeat from core client for 30 sec - exiting
22:57:36 (5028): No heartbeat from core client for 30 sec - exiting
22:57:37 (5028): No heartbeat from core client for 30 sec - exiting
22:57:38 (5028): No heartbeat from core client for 30 sec - exiting
22:57:39 (5028): No heartbeat from core client for 30 sec - exiting
22:57:40 (5028): No heartbeat from core client for 30 sec - exiting
22:57:41 (5028): No heartbeat from core client for 30 sec - exiting
22:57:42 (5028): No heartbeat from core client for 30 sec - exiting
22:57:43 (5028): No heartbeat from core client for 30 sec - exiting
22:57:44 (5028): No heartbeat from core client for 30 sec - exiting
22:57:45 (5028): No heartbeat from core client for 30 sec - exiting
22:57:47 (5028): No heartbeat from core client for 30 sec - exiting
22:57:48 (5028): No heartbeat from core client for 30 sec - exiting
22:57:49 (5028): No heartbeat from core client for 30 sec - exiting
22:57:50 (5028): No heartbeat from core client for 30 sec - exiting
22:57:51 (5028): No heartbeat from core client for 30 sec - exiting
22:57:52 (5028): No heartbeat from core client for 30 sec - exiting
22:57:53 (5028): No heartbeat from core client for 30 sec - exiting
22:57:54 (5028): No heartbeat from core client for 30 sec - exiting
22:57:55 (5028): No heartbeat from core client for 30 sec - exiting
22:57:57 (5028): No heartbeat from core client for 30 sec - exiting
22:57:58 (5028): No heartbeat from core client for 30 sec - exiting
22:57:59 (5028): No heartbeat from core client for 30 sec - exiting
22:58:00 (5028): No heartbeat from core client for 30 sec - exiting
22:58:01 (5028): No heartbeat from core client for 30 sec - exiting
22:58:02 (5028): No heartbeat from core client for 30 sec - exiting
22:58:03 (5028): No heartbeat from core client for 30 sec - exiting
22:58:04 (5028): No heartbeat from core client for 30 sec - exiting
22:58:05 (5028): No heartbeat from core client for 30 sec - exiting
22:58:06 (5028): No heartbeat from core client for 30 sec - exiting
22:58:08 (5028): No heartbeat from core client for 30 sec - exiting
22:58:09 (5028): No heartbeat from core client for 30 sec - exiting
22:58:10 (5028): No heartbeat from core client for 30 sec - exiting
22:58:11 (5028): No heartbeat from core client for 30 sec - exiting
22:58:12 (5028): No heartbeat from core client for 30 sec - exiting
22:58:13 (5028): No heartbeat from core client for 30 sec - exiting
22:58:14 (5028): No heartbeat from core client for 30 sec - exiting
22:58:15 (5028): No heartbeat from core client for 30 sec - exiting
22:58:16 (5028): No heartbeat from core client for 30 sec - exiting
22:58:17 (5028): No heartbeat from core client for 30 sec - exiting
22:58:18 (5028): No heartbeat from core client for 30 sec - exiting
22:58:20 (5028): No heartbeat from core client for 30 sec - exiting
22:58:21 (5028): No heartbeat from core client for 30 sec - exiting
22:58:22 (5028): No heartbeat from core client for 30 sec - exiting
22:58:23 (5028): No heartbeat from core client for 30 sec - exiting
22:58:24 (5028): No heartbeat from core client for 30 sec - exiting
22:58:25 (5028): No heartbeat from core client for 30 sec - exiting
22:58:26 (5028): No heartbeat from core client for 30 sec - exiting
22:58:27 (5028): No heartbeat from core client for 30 sec - exiting
22:58:28 (5028): No heartbeat from core client for 30 sec - exiting
22:58:29 (5028): No heartbeat from core client for 30 sec - exiting
22:58:30 (5028): No heartbeat from core client for 30 sec - exiting
22:58:32 (5028): No heartbeat from core client for 30 sec - exiting
22:58:33 (5028): No heartbeat from core client for 30 sec - exiting
22:58:34 (5028): No heartbeat from core client for 30 sec - exiting
22:58:35 (5028): No heartbeat from core client for 30 sec - exiting
22:58:36 (5028): No heartbeat from core client for 30 sec - exiting
22:58:37 (5028): No heartbeat from core client for 30 sec - exiting
22:58:38 (5028): No heartbeat from core client for 30 sec - exiting
22:58:39 (5028): No heartbeat from core client for 30 sec - exiting
22:58:40 (5028): No heartbeat from core client for 30 sec - exiting
22:58:41 (5028): No heartbeat from core client for 30 sec - exiting
22:58:43 (5028): No heartbeat from core client for 30 sec - exiting
22:58:44 (5028): No heartbeat from core client for 30 sec - exiting
22:58:45 (5028): No heartbeat from core client for 30 sec - exiting
22:58:46 (5028): No heartbeat from core client for 30 sec - exiting
22:58:47 (5028): No heartbeat from core client for 30 sec - exiting
22:58:48 (5028): No heartbeat from core client for 30 sec - exiting
22:58:49 (5028): No heartbeat from core client for 30 sec - exiting
22:58:50 (5028): No heartbeat from core client for 30 sec - exiting
22:58:51 (5028): No heartbeat from core client for 30 sec - exiting
22:58:53 (5028): No heartbeat from core client for 30 sec - exiting
22:58:54 (5028): No heartbeat from core client for 30 sec - exiting
22:58:55 (5028): No heartbeat from core client for 30 sec - exiting
22:58:56 (5028): No heartbeat from core client for 30 sec - exiting
22:58:57 (5028): No heartbeat from core client for 30 sec - exiting
22:58:58 (5028): No heartbeat from core client for 30 sec - exiting
22:58:59 (5028): No heartbeat from core client for 30 sec - exiting
22:59:00 (5028): No heartbeat from core client for 30 sec - exiting
22:59:01 (5028): No heartbeat from core client for 30 sec - exiting
22:59:02 (5028): No heartbeat from core client for 30 sec - exiting
22:59:04 (5028): No heartbeat from core client for 30 sec - exiting
22:59:05 (5028): No heartbeat from core client for 30 sec - exiting
22:59:06 (5028): No heartbeat from core client for 30 sec - exiting
22:59:07 (5028): No heartbeat from core client for 30 sec - exiting
22:59:08 (5028): No heartbeat from core client for 30 sec - exiting
22:59:09 (5028): No heartbeat from core client for 30 sec - exiting
22:59:10 (5028): No heartbeat from core client for 30 sec - exiting
22:59:11 (5028): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
06:50:35 (5108): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:50:36 (5108): No heartbeat from core client for 30 sec - exiting
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3668, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1604, selfPID=5764, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5604, iMonCtr=2
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5480, iMonCtr=2
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4432, selfPID=5916, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6100, iMonCtr=2
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
05:58:57 (5592): No heartbeat from core client for 30 sec - exiting
05:58:58 (5592): No heartbeat from core client for 30 sec - exiting
05:58:59 (5592): No heartbeat from core client for 30 sec - exiting
05:59:00 (5592): No heartbeat from core client for 30 sec - exiting
05:59:01 (5592): No heartbeat from core client for 30 sec - exiting
05:59:02 (5592): No heartbeat from core client for 30 sec - exiting
05:59:03 (5592): No heartbeat from core client for 30 sec - exiting
05:59:04 (5592): No heartbeat from core client for 30 sec - exiting
05:59:05 (5592): No heartbeat from core client for 30 sec - exiting
05:59:07 (5592): No heartbeat from core client for 30 sec - exiting
05:59:08 (5592): No heartbeat from core client for 30 sec - exiting
05:59:09 (5592): No heartbeat from core client for 30 sec - exiting
05:59:10 (5592): No heartbeat from core client for 30 sec - exiting
05:59:11 (5592): No heartbeat from core client for 30 sec - exiting
05:59:12 (5592): No heartbeat from core client for 30 sec - exiting
05:59:13 (5592): No heartbeat from core client for 30 sec - exiting
05:59:14 (5592): No heartbeat from core client for 30 sec - exiting
05:59:15 (5592): No heartbeat from core client for 30 sec - exiting
05:59:16 (5592): No heartbeat from core client for 30 sec - exiting
05:59:18 (5592): No heartbeat from core client for 30 sec - exiting
05:59:19 (5592): No heartbeat from core client for 30 sec - exiting
05:59:20 (5592): No heartbeat from core client for 30 sec - exiting
05:59:21 (5592): No heartbeat from core client for 30 sec - exiting
05:59:22 (5592): No heartbeat from core client for 30 sec - exiting
05:59:23 (5592): No heartbeat from core client for 30 sec - exiting
05:59:24 (5592): No heartbeat from core client for 30 sec - exiting
05:59:25 (5592): No heartbeat from core client for 30 sec - exiting
05:59:26 (5592): No heartbeat from core client for 30 sec - exiting
05:59:27 (5592): No heartbeat from core client for 30 sec - exiting
05:59:28 (5592): No heartbeat from core client for 30 sec - exiting
05:59:30 (5592): No heartbeat from core client for 30 sec - exiting
05:59:31 (5592): No heartbeat from core client for 30 sec - exiting
05:59:32 (5592): No heartbeat from core client for 30 sec - exiting
05:59:33 (5592): No heartbeat from core client for 30 sec - exiting
05:59:34 (5592): No heartbeat from core client for 30 sec - exiting
05:59:35 (5592): No heartbeat from core client for 30 sec - exiting
05:59:36 (5592): No heartbeat from core client for 30 sec - exiting
05:59:37 (5592): No heartbeat from core client for 30 sec - exiting
05:59:38 (5592): No heartbeat from core client for 30 sec - exiting
05:59:39 (5592): No heartbeat from core client for 30 sec - exiting
05:59:41 (5592): No heartbeat from core client for 30 sec - exiting
05:59:42 (5592): No heartbeat from core client for 30 sec - exiting
05:59:43 (5592): No heartbeat from core client for 30 sec - exiting
05:59:44 (5592): No heartbeat from core client for 30 sec - exiting
05:59:45 (5592): No heartbeat from core client for 30 sec - exiting
05:59:46 (5592): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4200, iMonCtr=2
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2872, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4276, iMonCtr=2
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5756, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4536, selfPID=5748, iMonCtr=1
Model crash detected, will try to restart...
CGntroller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5540, iMonCtr=2
Model crash detected, will try to restart...
lobal Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6100, iMonCtr=2
Leaving CPDN_Main::Monitor...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3072, iMonCtr=2
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4052, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5104, iMonCtr=2
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2224, selfPID=5984, iMonCtr=1
Model crash detected, will try to restart...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4292, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5916, iMonCtr=2
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4300, selfPID=5868, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5332, iMonCtr=2
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
GCobao Worker:: C CPDN PDN process it s notruuning,nning, exiting, bRetVal = 1, checkPID=0, selfPID=4676, iMon
Model 
crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4824, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6092, iMonCtr=2
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5924, iMonCtr=2
Model crash detected, will try to restart...
06:07:48 (5244): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4716, selfPID=4716, iMonCtr=2
06:07:49 (5244): No heartbeat from core client for 30 sec - exiting
06:07:50 (5244): No heartbeat from core client for 30 sec - exiting
06:07:52 (5244): No heartbeat from core client for 30 sec - exiting
06:07:53 (5244): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5924, iMonCtr=2
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2028, iMonCtr=2
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3392, selfPID=5396, iMonCtr=1
Model crash detected, will try to restart...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2060, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6016, iMonCtr=2
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4620, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5748, selfPID=5256, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4608, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6008, iMonCtr=2
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4104, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5912, selfPID=5408, iMonCtr=1
Model crash detected, will try to restart...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3660, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5148, iMonCtr=2
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
CGntrlller:: CPDN :: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3180, iM
Model cr
ash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1380, iMonCtr=2
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5988, iMonCtr=2
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
17:44:04 (6016): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:44:05 (6016): No heartbeat from core client for 30 sec - exiting
17:44:07 (6016): No heartbeat from core client for 30 sec - exiting
06:57:27 (5172): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7660, iMonCtr=2
Model crash detected, will try to restart...
18:17:45 (5512): No heartbeat from core client for 30 sec - exiting
18:17:46 (5512): No heartbeat from core client for 30 sec - exiting
18:17:47 (5512): No heartbeat from core client for 30 sec - exiting
18:17:48 (5512): No heartbeat from core client for 30 sec - exiting
18:17:49 (5512): No heartbeat from core client for 30 sec - exiting
18:17:50 (5512): No heartbeat from core client for 30 sec - exiting
18:17:51 (5512): No heartbeat from core client for 30 sec - exiting
18:17:53 (5512): No heartbeat from core client for 30 sec - exiting
18:17:54 (5512): No heartbeat from core client for 30 sec - exiting
18:17:55 (5512): No heartbeat from core client for 30 sec - exiting
18:17:56 (5512): No heartbeat from core client for 30 sec - exiting
18:17:57 (5512): No heartbeat from core client for 30 sec - exiting
18:17:58 (5512): No heartbeat from core client for 30 sec - exiting
18:17:59 (5512): No heartbeat from core client for 30 sec - exiting
18:18:00 (5512): No heartbeat from core client for 30 sec - exiting
18:18:01 (5512): No heartbeat from core client for 30 sec - exiting
18:18:04 (5512): No heartbeat from core client for 30 sec - exiting
18:18:05 (5512): No heartbeat from core client for 30 sec - exiting
18:18:06 (5512): No heartbeat from core client for 30 sec - exiting
18:18:07 (5512): No heartbeat from core client for 30 sec - exiting
18:18:08 (5512): No heartbeat from core client for 30 sec - exiting
18:18:10 (5512): No heartbeat from core client for 30 sec - exiting
18:18:11 (5512): No heartbeat from core client for 30 sec - exiting
18:18:12 (5512): No heartbeat from core client for 30 sec - exiting
18:18:13 (5512): No heartbeat from core client for 30 sec - exiting
18:18:14 (5512): No heartbeat from core client for 30 sec - exiting
18:18:15 (5512): No heartbeat from core client for 30 sec - exiting
18:18:16 (5512): No heartbeat from core client for 30 sec - exiting
18:18:17 (5512): No heartbeat from core client for 30 sec - exiting
18:18:18 (5512): No heartbeat from core client for 30 sec - exiting
18:18:19 (5512): No heartbeat from core client for 30 sec - exiting
18:18:21 (5512): No heartbeat from core client for 30 sec - exiting
18:18:22 (5512): No heartbeat from core client for 30 sec - exiting
18:18:23 (5512): No heartbeat from core client for 30 sec - exiting
18:18:24 (5512): No heartbeat from core client for 30 sec - exiting
18:18:25 (5512): No heartbeat from core client for 30 sec - exiting
18:18:26 (5512): No heartbeat from core client for 30 sec - exiting
18:18:27 (5512): No heartbeat from core client for 30 sec - exiting
18:18:28 (5512): No heartbeat from core client for 30 sec - exiting
18:18:29 (5512): No heartbeat from core client for 30 sec - exiting
18:18:30 (5512): No heartbeat from core client for 30 sec - exiting
18:18:31 (5512): No heartbeat from core client for 30 sec - exiting
18:18:33 (5512): No heartbeat from core client for 30 sec - exiting
18:18:34 (5512): No heartbeat from core client for 30 sec - exiting
18:18:35 (5512): No heartbeat from core client for 30 sec - exiting
18:18:36 (5512): No heartbeat from core client for 30 sec - exiting
18:18:37 (5512): No heartbeat from core client for 30 sec - exiting
18:18:38 (5512): No heartbeat from core client for 30 sec - exiting
18:18:39 (5512): No heartbeat from core client for 30 sec - exiting
18:18:40 (5512): No heartbeat from core client for 30 sec - exiting
18:18:41 (5512): No heartbeat from core client for 30 sec - exiting
18:18:42 (5512): No heartbeat from core client for 30 sec - exiting
18:18:43 (5512): No heartbeat from core client for 30 sec - exiting
18:18:45 (5512): No heartbeat from core client for 30 sec - exiting
18:18:46 (5512): No heartbeat from core client for 30 sec - exiting
18:18:47 (5512): No heartbeat from core client for 30 sec - exiting
18:18:48 (5512): No heartbeat from core client for 30 sec - exiting
18:18:49 (5512): No heartbeat from core client for 30 sec - exiting
18:18:50 (5512): No heartbeat from core client for 30 sec - exiting
18:18:51 (5512): No heartbeat from core client for 30 sec - exiting
18:18:52 (5512): No heartbeat from core client for 30 sec - exiting
18:18:53 (5512): No heartbeat from core client for 30 sec - exiting
18:18:54 (5512): No heartbeat from core client for 30 sec - exiting
18:18:55 (5512): No heartbeat from core client for 30 sec - exiting
18:18:57 (5512): No heartbeat from core client for 30 sec - exiting
18:18:58 (5512): No heartbeat from core client for 30 sec - exiting
18:18:59 (5512): No heartbeat from core client for 30 sec - exiting
18:19:00 (5512): No heartbeat from core client for 30 sec - exiting
18:19:01 (5512): No heartbeat from core client for 30 sec - exiting
18:19:02 (5512): No heartbeat from core client for 30 sec - exiting
18:19:03 (5512): No heartbeat from core client for 30 sec - exiting
18:19:04 (5512): No heartbeat from core client for 30 sec - exiting
18:19:05 (5512): No heartbeat from core client for 30 sec - exiting
18:19:06 (5512): No heartbeat from core client for 30 sec - exiting
18:19:08 (5512): No heartbeat from core client for 30 sec - exiting
18:19:09 (5512): No heartbeat from core client for 30 sec - exiting
18:19:10 (5512): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1164, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6096, selfPID=4640, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
07:04:32 (5956): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:04:33 (5956): No heartbeat from core client for 30 sec - exiting
07:04:34 (5956): No heartbeat from core client for 30 sec - exiting
07:04:35 (5956): No heartbeat from core client for 30 sec - exiting
07:04:36 (5956): No heartbeat from core client for 30 sec - exiting
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5536, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5564, selfPID=5344, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5096, iMonCtr=2
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1472, iMonCtr=2
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5540, iMonCtr=2
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6052, iMonCtr=2
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5772, iMonCtr=2
Model crash detected, will try to restart...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3536, iMonCtr=2
Leaving CPDN_Main::Monitor...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6020, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2372, iMonCtr=2
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
17:43:04 (5232): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4628, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5728, selfPID=5620, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
05:28:34 (5308): No heartbeat from core client for 30 sec - exiting
05:28:35 (5308): No heartbeat from core client for 30 sec - exiting
05:28:36 (5308): No heartbeat from core client for 30 sec - exiting
05:28:37 (5308): No heartbeat from core client for 30 sec - exiting
05:28:39 (5308): No heartbeat from core client for 30 sec - exiting
05:28:40 (5308): No heartbeat from core client for 30 sec - exiting
05:28:41 (5308): No heartbeat from core client for 30 sec - exiting
05:28:42 (5308): No heartbeat from core client for 30 sec - exiting
05:28:43 (5308): No heartbeat from core client for 30 sec - exiting
05:28:44 (5308): No heartbeat from core client for 30 sec - exiting
05:28:45 (5308): No heartbeat from core client for 30 sec - exiting
05:28:46 (5308): No heartbeat from core client for 30 sec - exiting
05:28:47 (5308): No heartbeat from core client for 30 sec - exiting
05:28:48 (5308): No heartbeat from core client for 30 sec - exiting
05:28:50 (5308): No heartbeat from core client for 30 sec - exiting
05:28:51 (5308): No heartbeat from core client for 30 sec - exiting
05:28:52 (5308): No heartbeat from core client for 30 sec - exiting
05:28:53 (5308): No heartbeat from core client for 30 sec - exiting
05:28:54 (5308): No heartbeat from core client for 30 sec - exiting
05:28:55 (5308): No heartbeat from core client for 30 sec - exiting
05:28:56 (5308): No heartbeat from core client for 30 sec - exiting
05:28:57 (5308): No heartbeat from core client for 30 sec - exiting
05:28:58 (5308): No heartbeat from core client for 30 sec - exiting
05:29:00 (5308): No heartbeat from core client for 30 sec - exiting
05:29:01 (5308): No heartbeat from core client for 30 sec - exiting
05:29:02 (5308): No heartbeat from core client for 30 sec - exiting
05:29:03 (5308): No heartbeat from core client for 30 sec - exiting
05:29:04 (5308): No heartbeat from core client for 30 sec - exiting
05:29:05 (5308): No heartbeat from core client for 30 sec - exiting
05:29:06 (5308): No heartbeat from core client for 30 sec - exiting
05:29:07 (5308): No heartbeat from core client for 30 sec - exiting
05:29:08 (5308): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2540, selfPID=6024, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5404, iMonCtr=2
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4936, iMonCtr=2
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5844, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5572, selfPID=5292, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5956, iMonCtr=2
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1508, selfPID=5176, iMonCtr=1
Model crash detected, will try to restart...
15:57:04 (5320): No heartbeat from core client for 30 sec - exiting
15:57:05 (5320): No heartbeat from core client for 30 sec - exiting
15:57:06 (5320): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4200, iMonCtr=2
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1464, selfPID=5960, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5980, iMonCtr=2
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
21 Sep 2011 07:50:48 1016212 13244874 hadam3p_eu_2t72_1971_1_007400161_0 138,336 572,410 4.1378
18 Sep 2011 07:00:00 1016212 13244874 hadam3p_eu_2t72_1971_1_007400161_0 126,816 523,364 4.1270
14 Sep 2011 07:24:58 1016212 13244874 hadam3p_eu_2t72_1971_1_007400161_0 115,296 472,664 4.0996
12 Sep 2011 06:42:51 1016212 13244874 hadam3p_eu_2t72_1971_1_007400161_0 103,782 426,466 4.1092
12 Sep 2011 05:46:11 1016212 13244874 hadam3p_eu_2t72_1971_1_007400161_0 103,776 425,690 4.1020
06 Sep 2011 16:11:41 1016212 13244874 hadam3p_eu_2t72_1971_1_007400161_0 92,256 376,800 4.0843
04 Sep 2011 12:30:12 1016212 13244874 hadam3p_eu_2t72_1971_1_007400161_0 80,736 327,594 4.0576
01 Sep 2011 08:44:48 1016212 13244874 hadam3p_eu_2t72_1971_1_007400161_0 69,216 278,484 4.0234
29 Aug 2011 10:12:30 1016212 13244874 hadam3p_eu_2t72_1971_1_007400161_0 57,696 229,259 3.9736
25 Aug 2011 15:13:51 1016212 13244874 hadam3p_eu_2t72_1971_1_007400161_0 46,176 178,871 3.8737
23 Aug 2011 06:00:28 1016212 13244874 hadam3p_eu_2t72_1971_1_007400161_0 34,666 129,144 3.7254
22 Aug 2011 19:51:42 1016212 13244874 hadam3p_eu_2t72_1971_1_007400161_0 34,660 128,405 3.7047
22 Aug 2011 18:05:34 1016212 13244874 hadam3p_eu_2t72_1971_1_007400161_0 34,656 127,705 3.6849
20 Aug 2011 08:22:58 1016212 13244874 hadam3p_eu_2t72_1971_1_007400161_0 23,136 78,344 3.3862
17 Aug 2011 07:16:20 1016212 13244874 hadam3p_eu_2t72_1971_1_007400161_0 11,616 28,896 2.4876


©2024 climateprediction.net