climateprediction.net home page
Task 14070101

Task 14070101

Name hadam3p_pnw_35kb_1969_1_007187363_1
Workunit 7385645
Created 6 Feb 2012, 12:09:56 UTC
Sent 6 Feb 2012, 14:09:54 UTC
Report deadline 18 Jan 2013, 19:29:54 UTC
Received 9 Mar 2012, 17:06:55 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1118820
Run time 3 days 6 hours 53 min 16 sec
CPU time 3 days 6 hours 24 min 8 sec
Validate state Invalid
Credit 1,754.30
Device peak FLOPS 2.58 GFLOPS
Application version UK Met Office HadAM3P-HadRM3P Pacific North West v6.09
windows_intelx86
Stderr
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4504, selfPID=4504, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3180, selfPID=3180, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4648, selfPID=4648, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=764, selfPID=764, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
08:03:17 (1092): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4380, selfPID=4380, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3848, selfPID=3848, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4968, selfPID=4968, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not runnCPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1808, selfPID=1808, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
RegCPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4620, selfPID=4620, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5868, selfPID=5868, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
07:35:35 (1220): Can't acquire lockfile (32) - waiting 35s
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4488, selfPID=4488, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
RegCPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
19:07:15 (5432): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
09:56:11 (3596): No heartbeat from core client for 30 sec - exiting
09:56:12 (3596): No heartbeat from core client for 30 sec - exiting
09:56:14 (3596): No heartbeat from core client for 30 sec - exiting
09:56:15 (3596): No heartbeat from core client for 30 sec - exiting
09:56:16 (3596): No heartbeat from core client for 30 sec - exiting
09:56:17 (3596): No heartbeat from core client for 30 sec - exiting
09:56:18 (3596): No heartbeat from core client for 30 sec - exiting
09:56:19 (3596): No heartbeat from core client for 30 sec - exiting
09:56:20 (3596): No heartbeat from core client for 30 sec - exiting
09:56:21 (3596): No heartbeat from core client for 30 sec - exiting
09:56:22 (3596): No heartbeat from core client for 30 sec - exiting
09:56:23 (3596): No heartbeat from core client for 30 sec - exiting
09:56:25 (3596): No heartbeat from core client for 30 sec - exiting
09:56:26 (3596): No heartbeat from core client for 30 sec - exiting
09:56:27 (3596): No heartbeat from core client for 30 sec - exiting
09:56:28 (3596): No heartbeat from core client for 30 sec - exiting
09:56:29 (3596): No heartbeat from core client for 30 sec - exiting
09:56:30 (3596): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:56:31 (3596): No heartbeat from core client for 30 sec - exiting
09:56:32 (3596): No heartbeat from core client for 30 sec - exiting
09:56:33 (3596): No heartbeat from core client for 30 sec - exiting
09:56:35 (3596): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6056, selfPID=6056, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
08:59:13 (2876): No heartbeat from core client for 30 sec - exiting
08:59:15 (2876): No heartbeat from core client for 30 sec - exiting
08:59:16 (2876): No heartbeat from core client for 30 sec - exiting
08:59:17 (2876): No heartbeat from core client for 30 sec - exiting
08:59:18 (2876): No heartbeat from core client for 30 sec - exiting
08:59:19 (2876): No heartbeat from core client for 30 sec - exiting
08:59:20 (2876): No heartbeat from core client for 30 sec - exiting
08:59:21 (2876): No heartbeat from core client for 30 sec - exiting
08:59:22 (2876): No heartbeat from core client for 30 sec - exiting
08:59:24 (2876): No heartbeat from core client for 30 sec - exiting
08:59:25 (2876): No heartbeat from core client for 30 sec - exiting
08:59:26 (2876): No heartbeat from core client for 30 sec - exiting
08:59:27 (2876): No heartbeat from core client for 30 sec - exiting
08:59:28 (2876): No heartbeat from core client for 30 sec - exiting
08:59:29 (2876): No heartbeat from core client for 30 sec - exiting
08:59:30 (2876): No heartbeat from core client for 30 sec - exiting
08:59:31 (2876): No heartbeat from core client for 30 sec - exiting
08:59:32 (2876): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5212, selfPID=5212, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4588, selfPID=4588, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6076, selfPID=6076, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1788, selfPID=1788, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
08:57:46 (3936): No heartbeat from core client for 30 sec - exiting
08:57:47 (3936): No heartbeat from core client for 30 sec - exiting
08:57:48 (3936): No heartbeat from core client for 30 sec - exiting
08:57:50 (3936): No heartbeat from core client for 30 sec - exiting
08:57:51 (3936): No heartbeat from core client for 30 sec - exiting
08:57:52 (3936): No heartbeat from core client for 30 sec - exiting
08:57:53 (3936): No heartbeat from core client for 30 sec - exiting
08:57:54 (3936): No heartbeat from core client for 30 sec - exiting
08:57:55 (3936): No heartbeat from core client for 30 sec - exiting
08:57:56 (3936): No heartbeat from core client for 30 sec - exiting
08:57:57 (3936): No heartbeat from core client for 30 sec - exiting
08:57:58 (3936): No heartbeat from core client for 30 sec - exiting
08:57:59 (3936): No heartbeat from core client for 30 sec - exiting
08:58:00 (3936): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:58:02 (3936): No heartbeat from core client for 30 sec - exiting
08:58:03 (3936): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5332, selfPID=5332, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
12:02:00 (2500): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
13:19:11 (340): No heartbeat from core client for 30 sec - exiting
13:19:12 (340): No heartbeat from core client for 30 sec - exiting
13:19:13 (340): No heartbeat from core client for 30 sec - exiting
13:19:14 (340): No heartbeat from core client for 30 sec - exiting
13:19:15 (340): No heartbeat from core client for 30 sec - exiting
13:19:16 (340): No heartbeat from core client for 30 sec - exiting
13:19:18 (340): No heartbeat from core client for 30 sec - exiting
13:19:19 (340): No heartbeat from core client for 30 sec - exiting
13:19:20 (340): No heartbeat from core client for 30 sec - exiting
13:19:21 (340): No heartbeat from core client for 30 sec - exiting
13:19:22 (340): No heartbeat from core client for 30 sec - exiting
13:19:23 (340): No heartbeat from core client for 30 sec - exiting
13:19:24 (340): No heartbeat from core client for 30 sec - exiting
13:19:25 (340): No heartbeat from core client for 30 sec - exiting
13:19:26 (340): No heartbeat from core client for 30 sec - exiting
13:19:27 (340): No heartbeat from core client for 30 sec - exiting
13:19:29 (340): No heartbeat from core client for 30 sec - exiting
13:19:30 (340): No heartbeat from core client for 30 sec - exiting
13:19:31 (340): No heartbeat from core client for 30 sec - exiting
13:19:32 (340): No heartbeat from core client for 30 sec - exiting
13:19:33 (340): No heartbeat from core client for 30 sec - exiting
13:19:34 (340): No heartbeat from core client for 30 sec - exiting
13:19:36 (340): No heartbeat from core client for 30 sec - exiting
13:19:37 (340): No heartbeat from core client for 30 sec - exiting
13:19:38 (340): No heartbeat from core client for 30 sec - exiting
13:19:39 (340): No heartbeat from core client for 30 sec - exiting
13:19:40 (340): No heartbeat from core client for 30 sec - exiting
13:19:41 (340): No heartbeat from core client for 30 sec - exiting
13:19:42 (340): No heartbeat from core client for 30 sec - exiting
13:19:43 (340): No heartbeat from core client for 30 sec - exiting
13:19:44 (340): No heartbeat from core client for 30 sec - exiting
13:19:46 (340): No heartbeat from core client for 30 sec - exiting
13:19:47 (340): No heartbeat from core client for 30 sec - exiting
13:19:48 (340): No heartbeat from core client for 30 sec - exiting
13:19:49 (340): No heartbeat from core client for 30 sec - exiting
13:19:50 (340): No heartbeat from core client for 30 sec - exiting
13:19:51 (340): No heartbeat from core client for 30 sec - exiting
13:19:52 (340): No heartbeat from core client for 30 sec - exiting
13:19:54 (340): No heartbeat from core client for 30 sec - exiting
13:19:55 (340): No heartbeat from core client for 30 sec - exiting
13:19:56 (340): No heartbeat from core client for 30 sec - exiting
13:19:57 (340): No heartbeat from core client for 30 sec - exiting
13:19:58 (340): No heartbeat from core client for 30 sec - exiting
13:19:59 (340): No heartbeat from core client for 30 sec - exiting
13:20:00 (340): No heartbeat from core client for 30 sec - exiting
13:20:01 (340): No heartbeat from core client for 30 sec - exiting
13:20:02 (340): No heartbeat from core client for 30 sec - exiting
13:20:03 (340): No heartbeat from core client for 30 sec - exiting
13:20:04 (340): No heartbeat from core client for 30 sec - exiting
13:20:06 (340): No heartbeat from core client for 30 sec - exiting
13:20:07 (340): No heartbeat from core client for 30 sec - exiting
13:20:08 (340): No heartbeat from core client for 30 sec - exiting
13:20:09 (340): No heartbeat from core client for 30 sec - exiting
13:20:10 (340): No heartbeat from core client for 30 sec - exiting
13:20:11 (340): No heartbeat from core client for 30 sec - exiting
13:20:12 (340): No heartbeat from core client for 30 sec - exiting
13:20:13 (340): No heartbeat from core client for 30 sec - exiting
13:20:14 (340): No heartbeat from core client for 30 sec - exiting
13:20:15 (340): No heartbeat from core client for 30 sec - exiting
13:20:17 (340): No heartbeat from core client for 30 sec - exiting
13:20:18 (340): No heartbeat from core client for 30 sec - exiting
13:20:19 (340): No heartbeat from core client for 30 sec - exiting
13:20:20 (340): No heartbeat from core client for 30 sec - exiting
13:20:21 (340): No heartbeat from core client for 30 sec - exiting
13:20:22 (340): No heartbeat from core client for 30 sec - exiting
13:20:23 (340): No heartbeat from core client for 30 sec - exiting
13:20:25 (340): No heartbeat from core client for 30 sec - exiting
13:20:26 (340): No heartbeat from core client for 30 sec - exiting
13:20:27 (340): No heartbeat from core client for 30 sec - exiting
13:20:28 (340): No heartbeat from core client for 30 sec - exiting
13:20:29 (340): No heartbeat from core client for 30 sec - exiting
13:20:30 (340): No heartbeat from core client for 30 sec - exiting
13:20:31 (340): No heartbeat from core client for 30 sec - exiting
13:20:32 (340): No heartbeat from core client for 30 sec - exiting
13:20:33 (340): No heartbeat from core client for 30 sec - exiting
13:20:34 (340): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:20:36 (340): No heartbeat from core client for 30 sec - exiting
13:20:37 (340): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4296, selfPID=4296, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
07:50:55 (2996): No heartbeat from core client for 30 sec - exiting
07:50:56 (2996): No heartbeat from core client for 30 sec - exiting
07:50:57 (2996): No heartbeat from core client for 30 sec - exiting
07:50:58 (2996): No heartbeat from core client for 30 sec - exiting
07:50:59 (2996): No heartbeat from core client for 30 sec - exiting
07:51:00 (2996): No heartbeat from core client for 30 sec - exiting
07:51:02 (2996): No heartbeat from core client for 30 sec - exiting
07:51:03 (2996): No heartbeat from core client for 30 sec - exiting
07:51:04 (2996): No heartbeat from core client for 30 sec - exiting
07:51:05 (2996): No heartbeat from core client for 30 sec - exiting
07:51:06 (2996): No heartbeat from core client for 30 sec - exiting
07:51:07 (2996): No heartbeat from core client for 30 sec - exiting
07:51:08 (2996): No heartbeat from core client for 30 sec - exiting
07:51:09 (2996): No heartbeat from core client for 30 sec - exiting
07:51:10 (2996): No heartbeat from core client for 30 sec - exiting
07:51:11 (2996): No heartbeat from core client for 30 sec - exiting
07:51:12 (2996): No heartbeat from core client for 30 sec - exiting
07:51:14 (2996): No heartbeat from core client for 30 sec - exiting
07:51:15 (2996): No heartbeat from core client for 30 sec - exiting
07:51:16 (2996): No heartbeat from core client for 30 sec - exiting
07:51:17 (2996): No heartbeat from core client for 30 sec - exiting
07:51:18 (2996): No heartbeat from core client for 30 sec - exiting
07:51:19 (2996): No heartbeat from core client for 30 sec - exiting
07:51:20 (2996): No heartbeat from core client for 30 sec - exiting
07:51:22 (2996): No heartbeat from core client for 30 sec - exiting
07:51:23 (2996): No heartbeat from core client for 30 sec - exiting
07:51:24 (2996): No heartbeat from core client for 30 sec - exiting
07:51:25 (2996): No heartbeat from core client for 30 sec - exiting
07:51:26 (2996): No heartbeat from core client for 30 sec - exiting
07:51:27 (2996): No heartbeat from core client for 30 sec - exiting
07:51:29 (2996): No heartbeat from core client for 30 sec - exiting
07:51:30 (2996): No heartbeat from core client for 30 sec - exiting
07:51:31 (2996): No heartbeat from core client for 30 sec - exiting
07:51:33 (2996): No heartbeat from core client for 30 sec - exiting
07:51:34 (2996): No heartbeat from core client for 30 sec - exiting
07:51:35 (2996): No heartbeat from core client for 30 sec - exiting
07:51:36 (2996): No heartbeat from core client for 30 sec - exiting
07:51:37 (2996): No heartbeat from core client for 30 sec - exiting
07:51:38 (2996): No heartbeat from core client for 30 sec - exiting
07:51:39 (2996): No heartbeat from core client for 30 sec - exiting
07:51:40 (2996): No heartbeat from core client for 30 sec - exiting
07:51:41 (2996): No heartbeat from core client for 30 sec - exiting
07:51:42 (2996): No heartbeat from core client for 30 sec - exiting
07:51:44 (2996): No heartbeat from core client for 30 sec - exiting
07:51:45 (2996): No heartbeat from core client for 30 sec - exiting
07:51:46 (2996): No heartbeat from core client for 30 sec - exiting
07:51:47 (2996): No heartbeat from core client for 30 sec - exiting
07:51:48 (2996): No heartbeat from core client for 30 sec - exiting
07:51:49 (2996): No heartbeat from core client for 30 sec - exiting
07:51:50 (2996): No heartbeat from core client for 30 sec - exiting
07:51:51 (2996): No heartbeat from core client for 30 sec - exiting
07:51:52 (2996): No heartbeat from core client for 30 sec - exiting
07:51:54 (2996): No heartbeat from core client for 30 sec - exiting
07:51:55 (2996): No heartbeat from core client for 30 sec - exiting
07:51:56 (2996): No heartbeat from core client for 30 sec - exiting
07:51:57 (2996): No heartbeat from core client for 30 sec - exiting
07:51:58 (2996): No heartbeat from core client for 30 sec - exiting
07:51:59 (2996): No heartbeat from core client for 30 sec - exiting
07:52:00 (2996): No heartbeat from core client for 30 sec - exiting
07:52:01 (2996): No heartbeat from core client for 30 sec - exiting
07:52:02 (2996): No heartbeat from core client for 30 sec - exiting
07:52:03 (2996): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:52:04 (2996): No heartbeat from core client for 30 sec - exiting
07:52:06 (2996): No heartbeat from core client for 30 sec - exiting
07:52:07 (2996): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
07:42:59 (2332): No heartbeat from core client for 30 sec - exiting
07:43:00 (2332): No heartbeat from core client for 30 sec - exiting
07:43:01 (2332): No heartbeat from core client for 30 sec - exiting
07:43:03 (2332): No heartbeat from core client for 30 sec - exiting
07:43:04 (2332): No heartbeat from core client for 30 sec - exiting
07:43:05 (2332): No heartbeat from core client for 30 sec - exiting
07:43:06 (2332): No heartbeat from core client for 30 sec - exiting
07:43:07 (2332): No heartbeat from core client for 30 sec - exiting
07:43:08 (2332): No heartbeat from core client for 30 sec - exiting
07:43:09 (2332): No heartbeat from core client for 30 sec - exiting
07:43:10 (2332): No heartbeat from core client for 30 sec - exiting
07:43:11 (2332): No heartbeat from core client for 30 sec - exiting
07:43:12 (2332): No heartbeat from core client for 30 sec - exiting
07:43:13 (2332): No heartbeat from core client for 30 sec - exiting
07:43:15 (2332): No heartbeat from core client for 30 sec - exiting
07:43:16 (2332): No heartbeat from core client for 30 sec - exiting
07:43:17 (2332): No heartbeat from core client for 30 sec - exiting
07:43:18 (2332): No heartbeat from core client for 30 sec - exiting
07:43:19 (2332): No heartbeat from core client for 30 sec - exiting
07:43:20 (2332): No heartbeat from core client for 30 sec - exiting
07:43:21 (2332): No heartbeat from core client for 30 sec - exiting
07:43:22 (2332): No heartbeat from core client for 30 sec - exiting
07:43:24 (2332): No heartbeat from core client for 30 sec - exiting
07:43:25 (2332): No heartbeat from core client for 30 sec - exiting
07:43:26 (2332): No heartbeat from core client for 30 sec - exiting
07:43:27 (2332): No heartbeat from core client for 30 sec - exiting
07:43:28 (2332): No heartbeat from core client for 30 sec - exiting
07:43:29 (2332): No heartbeat from core client for 30 sec - exiting
07:43:30 (2332): No heartbeat from core client for 30 sec - exiting
07:43:31 (2332): No heartbeat from core client for 30 sec - exiting
07:43:32 (2332): No heartbeat from core client for 30 sec - exiting
07:43:34 (2332): No heartbeat from core client for 30 sec - exiting
07:43:35 (2332): No heartbeat from core client for 30 sec - exiting
07:43:36 (2332): No heartbeat from core client for 30 sec - exiting
07:43:37 (2332): No heartbeat from core client for 30 sec - exiting
07:43:38 (2332): No heartbeat from core client for 30 sec - exiting
07:43:39 (2332): No heartbeat from core client for 30 sec - exiting
07:43:40 (2332): No heartbeat from core client for 30 sec - exiting
07:43:41 (2332): No heartbeat from core client for 30 sec - exiting
07:43:42 (2332): No heartbeat from core client for 30 sec - exiting
07:43:43 (2332): No heartbeat from core client for 30 sec - exiting
07:43:44 (2332): No heartbeat from core client for 30 sec - exiting
07:43:46 (2332): No heartbeat from core client for 30 sec - exiting
07:43:47 (2332): No heartbeat from core client for 30 sec - exiting
07:43:48 (2332): No heartbeat from core client for 30 sec - exiting
07:43:49 (2332): No heartbeat from core client for 30 sec - exiting
07:43:50 (2332): No heartbeat from core client for 30 sec - exiting
07:43:51 (2332): No heartbeat from core client for 30 sec - exiting
07:43:52 (2332): No heartbeat from core client for 30 sec - exiting
07:43:53 (2332): No heartbeat from core client for 30 sec - exiting
07:43:54 (2332): No heartbeat from core client for 30 sec - exiting
07:43:55 (2332): No heartbeat from core client for 30 sec - exiting
07:43:57 (2332): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:43:58 (2332): No heartbeat from core client for 30 sec - exiting
07:43:59 (2332): No heartbeat from core client for 30 sec - exiting
07:44:00 (2332): No heartbeat from core client for 30 sec - exiting
07:44:01 (2332): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4476, selfPID=4476, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1868, selfPID=1868, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4532, selfPID=4532, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
09:02:17 (2068): No heartbeat from core client for 30 sec - exiting
09:02:18 (2068): No heartbeat from core client for 30 sec - exiting
09:02:19 (2068): No heartbeat from core client for 30 sec - exiting
09:02:20 (2068): No heartbeat from core client for 30 sec - exiting
09:02:21 (2068): No heartbeat from core client for 30 sec - exiting
09:02:22 (2068): No heartbeat from core client for 30 sec - exiting
09:02:23 (2068): No heartbeat from core client for 30 sec - exiting
09:02:25 (2068): No heartbeat from core client for 30 sec - exiting
09:02:26 (2068): No heartbeat from core client for 30 sec - exiting
09:02:27 (2068): No heartbeat from core client for 30 sec - exiting
09:02:28 (2068): No heartbeat from core client for 30 sec - exiting
09:02:29 (2068): No heartbeat from core client for 30 sec - exiting
09:02:30 (2068): No heartbeat from core client for 30 sec - exiting
09:02:31 (2068): No heartbeat from core client for 30 sec - exiting
09:02:32 (2068): No heartbeat from core client for 30 sec - exiting
09:02:33 (2068): No heartbeat from core client for 30 sec - exiting
09:02:34 (2068): No heartbeat from core client for 30 sec - exiting
09:02:36 (2068): No heartbeat from core client for 30 sec - exiting
09:02:37 (2068): No heartbeat from core client for 30 sec - exiting
09:02:38 (2068): No heartbeat from core client for 30 sec - exiting
09:02:39 (2068): No heartbeat from core client for 30 sec - exiting
09:02:40 (2068): No heartbeat from core client for 30 sec - exiting
09:02:41 (2068): No heartbeat from core client for 30 sec - exiting
09:02:42 (2068): No heartbeat from core client for 30 sec - exiting
09:02:44 (2068): No heartbeat from core client for 30 sec - exiting
09:02:45 (2068): No heartbeat from core client for 30 sec - exiting
09:02:47 (2068): No heartbeat from core client for 30 sec - exiting
09:02:48 (2068): No heartbeat from core client for 30 sec - exiting
09:02:49 (2068): No heartbeat from core client for 30 sec - exiting
09:02:51 (2068): No heartbeat from core client for 30 sec - exiting
09:02:52 (2068): No heartbeat from core client for 30 sec - exiting
09:02:53 (2068): No heartbeat from core client for 30 sec - exiting
09:02:54 (2068): No heartbeat from core client for 30 sec - exiting
09:02:55 (2068): No heartbeat from core client for 30 sec - exiting
09:02:56 (2068): No heartbeat from core client for 30 sec - exiting
09:02:57 (2068): No heartbeat from core client for 30 sec - exiting
09:02:58 (2068): No heartbeat from core client for 30 sec - exiting
09:02:59 (2068): No heartbeat from core client for 30 sec - exiting
09:03:00 (2068): No heartbeat from core client for 30 sec - exiting
09:03:02 (2068): No heartbeat from core client for 30 sec - exiting
09:03:03 (2068): No heartbeat from core client for 30 sec - exiting
09:03:04 (2068): No heartbeat from core client for 30 sec - exiting
09:03:05 (2068): No heartbeat from core client for 30 sec - exiting
09:03:06 (2068): No heartbeat from core client for 30 sec - exiting
09:03:07 (2068): No heartbeat from core client for 30 sec - exiting
09:03:08 (2068): No heartbeat from core client for 30 sec - exiting
09:03:09 (2068): No heartbeat from core client for 30 sec - exiting
09:03:10 (2068): No heartbeat from core client for 30 sec - exiting
09:03:11 (2068): No heartbeat from core client for 30 sec - exiting
09:03:13 (2068): No heartbeat from core client for 30 sec - exiting
09:03:14 (2068): No heartbeat from core client for 30 sec - exiting
09:03:15 (2068): No heartbeat from core client for 30 sec - exiting
09:03:16 (2068): No heartbeat from core client for 30 sec - exiting
09:03:17 (2068): No heartbeat from core client for 30 sec - exiting
09:03:18 (2068): No heartbeat from core client for 30 sec - exiting
09:03:19 (2068): No heartbeat from core client for 30 sec - exiting
09:03:20 (2068): No heartbeat from core client for 30 sec - exiting
09:03:21 (2068): No heartbeat from core client for 30 sec - exiting
09:03:22 (2068): No heartbeat from core client for 30 sec - exiting
09:03:23 (2068): No heartbeat from core client for 30 sec - exiting
09:03:25 (2068): No heartbeat from core client for 30 sec - exiting
09:03:26 (2068): No heartbeat from core client for 30 sec - exiting
09:03:27 (2068): No heartbeat from core client for 30 sec - exiting
09:03:28 (2068): No heartbeat from core client for 30 sec - exiting
09:03:29 (2068): No heartbeat from core client for 30 sec - exiting
09:03:30 (2068): No heartbeat from core client for 30 sec - exiting
09:03:31 (2068): No heartbeat from core client for 30 sec - exiting
09:03:32 (2068): No heartbeat from core client for 30 sec - exiting
09:03:33 (2068): No heartbeat from core client for 30 sec - exiting
09:03:34 (2068): No heartbeat from core client for 30 sec - exiting
09:03:36 (2068): No heartbeat from core client for 30 sec - exiting
09:03:37 (2068): No heartbeat from core client for 30 sec - exiting
09:03:38 (2068): No heartbeat from core client for 30 sec - exiting
09:03:39 (2068): No heartbeat from core client for 30 sec - exiting
09:03:40 (2068): No heartbeat from core client for 30 sec - exiting
09:03:41 (2068): No heartbeat from core client for 30 sec - exiting
09:03:42 (2068): No heartbeat from core client for 30 sec - exiting
09:03:43 (2068): No heartbeat from core client for 30 sec - exiting
09:03:44 (2068): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:03:45 (2068): No heartbeat from core client for 30 sec - exiting
09:03:47 (2068): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
RegionCPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4240, selfPID=4240, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4888, selfPID=4888, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2900, selfPID=2900, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2600, selfPID=2600, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
10:30:54 (1788): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
08:58:13 (3744): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2532, selfPID=2532, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2984, selfPID=2984, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5656, selfPID=5656, iMonCtr=2
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
10:12:27 (4836): Can't acquire lockfile (32) - waiting 35s
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
forrtl: Access is denied.

forrtl: severe (38): error during write, unit 8, file T:\BOINC\projects\climateprediction.net\hadam3p_pnw_35kb_1969_1_007187363\tmp\xaakm.pipe_dummy

Image              PC        Routine            Line        Source             
hadam3p_pnw_um_6.  0076A39A  Unknown               Unknown  Unknown
hadam3p_pnw_um_6.  007676C8  Unknown               Unknown  Unknown
hadam3p_pnw_um_6.  00712CD0  Unknown               Unknown  Unknown
hadam3p_pnw_um_6.  00711E9A  Unknown               Unknown  Unknown
hadam3p_pnw_um_6.  006EAA9D  Unknown               Unknown  Unknown
hadam3p_pnw_um_6.  0068F27C  Unknown               Unknown  Unknown
hadam3p_pnw_um_6.  00409BD2  Unknown               Unknown  Unknown
hadam3p_pnw_um_6.  0074E638  Unknown               Unknown  Unknown
kernel32.dll       7C817077  Unknown               Unknown  Unknown
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=852, selfPID=852, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=852, selfPID=2308, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
Regional yearly means requires 12 input files got 7
No Process Handle
Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=732, iMonCtr=2
Called boinc_finish

</stderr_txt>
<message>
<file_xfer_error>
  <file_name>hadam3p_pnw_35kb_1969_1_007187363_1_8.zip</file_name>
  <error_code>-161</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>hadam3p_pnw_35kb_1969_1_007187363_1_9.zip</file_name>
  <error_code>-161</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>hadam3p_pnw_35kb_1969_1_007187363_1_10.zip</file_name>
  <error_code>-161</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>hadam3p_pnw_35kb_1969_1_007187363_1_11.zip</file_name>
  <error_code>-161</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>hadam3p_pnw_35kb_1969_1_007187363_1_12.zip</file_name>
  <error_code>-161</error_code>
</file_xfer_error>

</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
07 Mar 2012 13:50:20 1118820 14070101 hadam3p_pnw_35kb_1969_1_007187363_1 80,736 260,815 3.2305
29 Feb 2012 14:03:09 1118820 14070101 hadam3p_pnw_35kb_1969_1_007187363_1 69,216 223,503 3.2291
27 Feb 2012 14:03:23 1118820 14070101 hadam3p_pnw_35kb_1969_1_007187363_1 57,696 186,618 3.2345
16 Feb 2012 23:35:36 1118820 14070101 hadam3p_pnw_35kb_1969_1_007187363_1 46,176 149,482 3.2372
14 Feb 2012 23:59:36 1118820 14070101 hadam3p_pnw_35kb_1969_1_007187363_1 34,656 112,406 3.2435
14 Feb 2012 13:26:42 1118820 14070101 hadam3p_pnw_35kb_1969_1_007187363_1 23,154 75,331 3.2535
14 Feb 2012 02:04:55 1118820 14070101 hadam3p_pnw_35kb_1969_1_007187363_1 23,136 74,764 3.2315
10 Feb 2012 19:19:29 1118820 14070101 hadam3p_pnw_35kb_1969_1_007187363_1 11,616 37,760 3.2507


©2024 climateprediction.net