climateprediction.net home page
Task 21352390

Task 21352390

Name wah2_global_e00s_200412_145_766_011654400_0
Workunit 11654400
Created 4 Nov 2018, 19:52:01 UTC
Sent 4 Nov 2018, 19:57:10 UTC
Report deadline 18 Oct 2019, 1:17:10 UTC
Received 5 Nov 2018, 2:07:52 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1382290
Run time 3 hours 14 min 22 sec
CPU time 3 hours 4 min 36 sec
Validate state Invalid
Credit 194.40
Device peak FLOPS 3.90 GFLOPS
Application version Weather At Home 2 (wah2) v8.24
windows_intelx86
Peak working set size 238.38 MB
Peak swap size 173.98 MB
Peak disk usage 50.67 MB
Stderr
<core_client_version>7.14.2</core_client_version>
<![CDATA[
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Single Instruction Executed (0x80000004) at address 0x0108D03F

Engaging BOINC Windows Runtime Debugger...



********************


BOINC Windows Runtime Debugger Version 7.7.0


Dump Timestamp    : 11/05/18 02:23:12
Install Directory : 
Data Directory    : D:\Boinc\National Instruments Downloads\Boinc
Project Symstore  : 
LoadLibraryA( D:\Boinc\National Instruments Downloads\Boinc\dbghelp.dll ): GetLastError = 126
Loaded Library    : dbghelp.dll
LoadLibraryA( D:\Boinc\National Instruments Downloads\Boinc\symsrv.dll ): GetLastError = 126
LoadLibraryA( symsrv.dll ): GetLastError = 126
LoadLibraryA( D:\Boinc\National Instruments Downloads\Boinc\srcsrv.dll ): GetLastError = 126
LoadLibraryA( srcsrv.dll ): GetLastError = 126
LoadLibraryA( D:\Boinc\National Instruments Downloads\Boinc\version.dll ): GetLastError = 126
Loaded Library    : version.dll
Debugger Engine   : 4.0.5.0
Symbol Search Path: D:\Boinc\National Instruments Downloads\Boinc\projects\climateprediction.net\wah2_global_e00s_200412_145_766_011654400;D:\Boinc\National Instruments Downloads\Boinc\projects\climateprediction.net


ModLoad: 0000000000e10000 0000000000f87000 D:\Boinc\National Instruments Downloads\Boinc\projects\climateprediction.net\wah2am3m2_um_8.24_windows_intelx86.exe (-nosymbols- Symbols Loaded)
    Linked PDB Filename   : F:\cpdn\cpdn\cpdnboinc\monitor\win_build\WAH2 Release\wah2am3m2.pdb

ModLoad: 0000000077b90000 0000000000190000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.17134.376) (-exported- Symbols Loaded)
    Linked PDB Filename   : wntdll.pdb
    File Version          : 10.0.17134.346 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17134.346

ModLoad: 0000000074810000 00000000000e0000 C:\WINDOWS\System32\KERNEL32.DLL (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernel32.pdb
    File Version          : 10.0.17134.376 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17134.376

ModLoad: 0000000074620000 00000000001e4000 C:\WINDOWS\System32\KERNELBASE.dll (6.2.17134.319) (-exported- Symbols Loaded)
    Linked PDB Filename   : wkernelbase.pdb
    File Version          : 10.0.17134.376 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17134.376

ModLoad: 0000000076820000 000000000018d000 C:\WINDOWS\System32\USER32.dll (6.2.17134.376) (-exported- Symbols Loaded)
    Linked PDB Filename   : wuser32.pdb
    File Version          : 10.0.17134.346 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17134.346

ModLoad: 0000000077a80000 0000000000017000 C:\WINDOWS\System32\win32u.dll (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : wwin32u.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 00000000767f0000 0000000000022000 C:\WINDOWS\System32\GDI32.dll (6.2.17134.285) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32.pdb
    File Version          : 10.0.17134.285 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.285

ModLoad: 0000000076200000 0000000000164000 C:\WINDOWS\System32\gdi32full.dll (6.2.17134.345) (-exported- Symbols Loaded)
    Linked PDB Filename   : wgdi32full.pdb
    File Version          : 10.0.17134.345 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.345

ModLoad: 0000000076390000 000000000007d000 C:\WINDOWS\System32\msvcp_win.dll (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcp_win.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 0000000074970000 000000000011e000 C:\WINDOWS\System32\ucrtbase.dll (6.2.17134.319) (-exported- Symbols Loaded)
    Linked PDB Filename   : ucrtbase.pdb
    File Version          : 10.0.17134.319 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.319

ModLoad: 0000000077790000 0000000000078000 C:\WINDOWS\System32\ADVAPI32.dll (6.2.17134.319) (-exported- Symbols Loaded)
    Linked PDB Filename   : advapi32.pdb
    File Version          : 10.0.17134.346 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17134.346

ModLoad: 00000000766a0000 00000000000bf000 C:\WINDOWS\System32\msvcrt.dll (7.0.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : msvcrt.pdb
    File Version          : 7.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 7.0.17134.1

ModLoad: 0000000077a30000 0000000000044000 C:\WINDOWS\System32\sechost.dll (6.2.17134.319) (-exported- Symbols Loaded)
    Linked PDB Filename   : sechost.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 0000000076410000 00000000000c0000 C:\WINDOWS\System32\RPCRT4.dll (6.2.17134.112) (-exported- Symbols Loaded)
    Linked PDB Filename   : wrpcrt4.pdb
    File Version          : 10.0.17134.346 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Betriebssystem Microsoft&#174; Windows&#174;
    Product Version       : 10.0.17134.346

ModLoad: 0000000074450000 0000000000020000 C:\WINDOWS\System32\SspiCli.dll (6.2.17134.376) (-exported- Symbols Loaded)
    Linked PDB Filename   : wsspicli.pdb
    File Version          : 10.0.17134.376 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.376

ModLoad: 0000000074440000 000000000000a000 C:\WINDOWS\System32\CRYPTBASE.dll (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : cryptbase.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 0000000076e70000 0000000000058000 C:\WINDOWS\System32\bcryptPrimitives.dll (6.2.17134.345) (-exported- Symbols Loaded)
    Linked PDB Filename   : bcryptprimitives.pdb
    File Version          : 10.0.17134.345 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.345

ModLoad: 00000000748f0000 0000000000019000 C:\WINDOWS\System32\imagehlp.dll (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : imagehlp.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 0000000076670000 0000000000026000 C:\WINDOWS\System32\IMM32.DLL (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : wimm32.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 0000000072af0000 0000000000182000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : dbghelp.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1

ModLoad: 00000000740d0000 0000000000008000 C:\WINDOWS\SYSTEM32\version.dll (6.2.17134.1) (-exported- Symbols Loaded)
    Linked PDB Filename   : version.pdb
    File Version          : 10.0.17134.1 (WinBuild.160101.0800)
    Company Name          : Microsoft Corporation
    Product Name          : Microsoft&#174; Windows&#174; Operating System
    Product Version       : 10.0.17134.1



*** Dump of the Process Statistics: ***

- I/O Operations Counters -
Read: 28460, Write: 0, Other 67568

- I/O Transfers Counters -
Read: 0, Write: 5174, Other 0

- Paged Pool Usage -
QuotaPagedPoolUsage: 264368, QuotaPeakPagedPoolUsage: 264480
QuotaNonPagedPoolUsage: 8624, QuotaPeakNonPagedPoolUsage: 9312

- Virtual Memory Usage -
VirtualSize: 1086398464, PeakVirtualSize: 1963524096

- Pagefile Usage -
PagefileUsage: 183750656, PeakPagefileUsage: 183750656

- Working Set Size -
WorkingSetSize: 235515904, PeakWorkingSetSize: 250089472, PageFaultCount: 101614

*** Dump of thread ID 11712 (state: Waiting): ***

- Information -
Status: Wait Reason: UserRequest, , Kernel Time: 106875000.000000, User Time: 65526091776.000000, Wait Time: 1922035.000000

- Unhandled Exception Record -
Reason: Single Instruction Executed (0x80000004) at address 0x0108D03F

- Registers -
eax=0000008b ebx=1071b014 ecx=000000c1 edx=00000304 esi=011a0408 edi=10737df0
eip=0108d03f esp=10708dbc ebp=1071b008
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000202

- Callstack -
ChildEBP RetAddr  Args to Child
1071b008 0106d699 bedc1270 10738214 0106d699 134bf1ac wah2am3m2_um_8.24_windows_intel!+0x0 
10738208 01063b77 1077fca8 1078bbbc 01063b77 134bf1ac wah2am3m2_um_8.24_windows_intel!+0x0 
1078bba8 00f7bea6 10986a88 107a113c 10986a88 107c9e50 wah2am3m2_um_8.24_windows_intel!+0x0 
107af9b0 00fe4c78 134bf1ac 0144041c 01d5c14c 10983440 wah2am3m2_um_8.24_windows_intel!+0x0 
10858528 00eecd4c 108b5368 10967470 00eecd4c 134bf1ac wah2am3m2_um_8.24_windows_intel!+0x0 
10967468 00f49469 10a1720c 00f49469 134bf1ac 10a17188 wah2am3m2_um_8.24_windows_intel!+0x0 
10a171f8 00fc5c91 00cef1b0 011b59a4 01d5c108 11662900 wah2am3m2_um_8.24_windows_intel!+0x0 
10a1720c 00fc5c91 134bf1ac 7839f2dc 01d5fda8 10cd751c wah2am3m2_um_8.24_windows_intel!+0x0 
11662900 01097a3b 11662c40 11873e90 1188fc30 118ab9d0 wah2am3m2_um_8.24_windows_intel!+0x0 
121490d8 010aacfd 01d5c2a0 01d5c148 01d5c160 12165190 wah2am3m2_um_8.24_windows_intel!+0x0 
121652b0 010df40a 134befc8 134befcc 134befd0 134befd4 wah2am3m2_um_8.24_windows_intel!+0x0 
134bef48 010e1474 011ff8fc 011ff900 134befc8 134befcc wah2am3m2_um_8.24_windows_intel!+0x0 
134bf408 00e197f4 00500000 00133c99 00133d0e 00133d38 wah2am3m2_um_8.24_windows_intel!+0x0 
00000000 00000000 00000000 00000000 00000000 00000000 wah2am3m2_um_8.24_windows_intel!+0x0 

*** Dump of thread ID 9376 (state: Waiting): ***

- Information -
Status: Wait Reason: ExecutionDelay, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 1922032.000000

- Registers -
eax=010ec9b0 ebx=00000000 ecx=00000000 edx=00000000 esi=00000000 edi=00000001
eip=77bfa57c esp=7025f9f0 ebp=7025fa54
cs=0023  ss=002b  ds=002b  es=002b  fs=0053  gs=002b             efl=00000216

- Callstack -
ChildEBP RetAddr  Args to Child
7025fa54 747270af 00000064 00000000 7025fc94 010ec9d4 ntdll!NtDelayExecution+0x0 
7025fa64 010ec9d4 00000064 010ec9b0 010ec9b0 00000000 KERNELBASE!Sleep+0x0 
7025fc94 74828484 00000000 74828460 f5d48598 7025fcf0 wah2am3m2_um_8.24_windows_intel!+0x0 
7025fca8 77bf302c 00000000 a1d0b75c 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 
7025fcf0 77bf2ffa ffffffff 77c0ec4a 00000000 00000000 ntdll!RtlValidSecurityDescriptor+0x0 
7025fd00 00000000 010ec9b0 00000000 00000000 00000000 ntdll!RtlValidSecurityDescriptor+0x0 


*** Debug Message Dump ****


*** Foreground Window Data ***
    Window Name      : 
    Window Class     : 
    Window Process ID: 0
    Window Thread ID : 0

Exiting...
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4300, selfPID=4300, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4300, selfPID=7936, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_ain::Monitor...
02:23:16 (7936): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_2.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_3.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_4.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_5.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_6.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_7.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_8.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_9.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_10.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_11.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_12.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_13.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_14.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_15.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_16.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_17.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_18.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_19.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_20.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_21.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_22.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_23.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_24.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_25.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_26.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_27.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_28.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_29.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_30.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_31.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_32.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_33.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_34.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_35.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_36.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_37.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_38.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_39.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_40.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_41.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_42.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_43.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_44.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_45.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_46.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_47.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_48.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_49.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_50.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_51.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_52.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_53.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_54.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_55.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_56.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_57.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_58.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_59.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_60.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_61.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_62.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_63.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_64.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_65.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_66.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_67.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_68.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_69.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_70.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_71.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_72.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_73.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_74.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_75.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_76.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_77.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_78.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_79.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_80.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_81.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_82.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_83.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_84.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_85.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_86.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_87.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_88.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_89.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_90.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_91.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_92.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_93.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_94.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_95.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_96.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_97.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_98.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_99.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_100.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_101.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_102.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_103.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_104.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_105.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_106.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_107.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_108.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_109.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_110.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_111.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_112.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_113.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_114.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_115.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_116.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_117.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_118.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_119.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_120.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_121.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_122.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_123.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_124.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_125.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_126.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_127.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_128.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_129.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_130.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_131.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_132.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_133.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_134.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_135.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_136.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_137.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_138.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_139.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_140.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_141.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_142.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_143.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_144.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_145.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_global_e00s_200412_145_766_011654400_0_r1223144491_restart.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
05 Nov 2018 01:11:30 1382290 21352390 wah2_global_e00s_200412_145_766_011654400_0 2,947 9,096 3.0865


©2024 climateprediction.net