Task 19449703

Name	hadam3p_afr50_bqur_201412_12_372_010410445_1
Workunit	10410445
Created	23 Mar 2016, 8:47:24 UTC
Sent	23 Mar 2016, 10:10:35 UTC
Report deadline	5 Mar 2017, 15:30:35 UTC
Received	17 Apr 2016, 16:33:13 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	15 (0x0000000F) Unknown error code
Computer ID	1347848
Run time	1 days 22 hours 40 min 3 sec
CPU time	1 days 20 hours 57 min 42 sec
Validate state	Invalid
Credit	5,243.70
Device peak FLOPS	3.95 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Africa v7.22 windows_intelx86
Stderr	<core_client_version>7.6.22</core_client_version> <![CDATA[ <message> Het systeem kan het opgegeven station niet vinden. (0xf) - exit code 15 (0xf) </message> <stderr_txt> 14:36:34 (5452): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 13:05:48 (972): start_timer_thread(): CreateThread() failed, errno 0 18:53:51 (3476): start_timer_thread(): CreateThread() failed, errno 0 23:07:48 (8112): start_timer_thread(): CreateThread() failed, errno 0 23:07:50 (8812): start_timer_thread(): CreateThread() failed, errno 0 09:47:06 (5568): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 13:42:06 (9184): start_timer_thread(): CreateThread() failed, errno 0 13:42:08 (3392): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 16:17:08 (9224): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 17:11:18 (3744): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 12:42:38 (4500): start_timer_thread(): CreateThread() failed, errno 0 12:42:40 (8756): start_timer_thread(): CreateThread() failed, errno 0 17:04:32 (1164): start_timer_thread(): CreateThread() failed, errno 0 17:04:33 (7408): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 11:20:52 (7972): start_timer_thread(): CreateThread() failed, errno 0 11:20:54 (2580): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 16:05:18 (2800): start_timer_thread(): CreateThread() failed, errno 0 16:05:19 (2212): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 17:12:01 (8280): start_timer_thread(): CreateThread() failed, errno 0 17:12:02 (5368): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:37:23 (4908): start_timer_thread(): CreateThread() failed, errno 0 21:37:24 (8280): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:21:19 (6684): start_timer_thread(): CreateThread() failed, errno 0 10:21:21 (7360): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 12:41:11 (9708): start_timer_thread(): CreateThread() failed, errno 0 12:41:12 (9800): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 13:32:30 (10180): start_timer_thread(): CreateThread() failed, errno 0 13:32:31 (9576): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 14:35:39 (4296): start_timer_thread(): CreateThread() failed, errno 0 14:35:40 (7216): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 14:59:44 (5632): start_timer_thread(): CreateThread() failed, errno 0 14:59:46 (9372): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 15:07:14 (6348): start_timer_thread(): CreateThread() failed, errno 0 15:07:15 (6560): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 16:01:43 (8668): start_timer_thread(): CreateThread() failed, errno 0 16:01:44 (7516): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:15:09 (3312): start_timer_thread(): CreateThread() failed, errno 0 18:15:11 (4928): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:04:02 (6516): start_timer_thread(): CreateThread() failed, errno 0 22:04:03 (4212): start_timer_thread(): CreateThread() failed, errno 0 09:50:08 (7000): start_timer_thread(): CreateThread() failed, errno 0 09:50:10 (9072): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:43:45 (7904): start_timer_thread(): CreateThread() failed, errno 0 13:43:47 (7732): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:50:09 (260): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:21:14 (9608): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 21:35:28 (7684): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Breakpoint Encountered (0x80000003) at address 0x012741E0 Engaging BOINC Windows Runtime Debugger... ****************** BOINC Windows Runtime Debugger Version 7.2.4 Dump Timestamp : 04/17/16 17:32:44 Install Directory : C:\Program Files (x86)\BOINC\ Data Directory : C:\ProgramData\BOINC Project Symstore : LoadLibraryA( C:\Program Files (x86)\BOINC\\dbghelp.dll ): GetLastError = 126 Loaded Library : dbghelp.dll LoadLibraryA( C:\Program Files (x86)\BOINC\\symsrv.dll ): GetLastError = 126 LoadLibraryA( symsrv.dll ): GetLastError = 126 LoadLibraryA( C:\Program Files (x86)\BOINC\\srcsrv.dll ): GetLastError = 126 LoadLibraryA( srcsrv.dll ): GetLastError = 126 LoadLibraryA( C:\Program Files (x86)\BOINC\\version.dll ): GetLastError = 126 Loaded Library : version.dll Debugger Engine : 4.0.5.0 Symbol Search Path: C:\ProgramData\BOINC\projects\climateprediction.net\hadam3p_afr50_bqur_201412_12_372_010410445;C:\ProgramData\BOINC\projects\climateprediction.net ModLoad: 0000000001010000 00000000008f2000 C:\ProgramData\BOINC\projects\climateprediction.net\hadam3p_afr_um_7.22_windows_intelx86.exe (-nosymbols- Symbols Loaded) Linked PDB Filename : G:\CPDN\cpdn\cpdn\cpdnboinc\monitor\win_build\Release\hadam3p.pdb ModLoad: 0000000077920000 000000000017b000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.10586.122) (-exported- Symbols Loaded) Linked PDB Filename : wntdll.pdb File Version : 10.0.10586.0 (th2_release.151029-1700) Company Name : Microsoft Corporation Product Name : Microsoft® Windows®-besturingssysteem Product Version : 10.0.10586.0 ModLoad: 00000000775e0000 00000000000e0000 C:\WINDOWS\SYSTEM32\KERNEL32.DLL (6.2.10586.0) (-exported- Symbols Loaded) Linked PDB Filename : wkernel32.pdb File Version : 10.0.10586.0 (th2_release.151029-1700) Company Name : Microsoft Corporation Product Name : Besturingssysteem Microsoft® Windows® Product Version : 10.0.10586.0 ModLoad: 0000000074d90000 000000000017e000 C:\WINDOWS\SYSTEM32\KERNELBASE.dll (6.2.10586.162) (-exported- Symbols Loaded) Linked PDB Filename : wkernelbase.pdb File Version : 10.0.10586.0 (th2_release.151029-1700) Company Name : Microsoft Corporation Product Name : Besturingssysteem Microsoft® Windows® Product Version : 10.0.10586.0 ModLoad: 00000000749a0000 0000000000147000 C:\WINDOWS\SYSTEM32\USER32.dll (6.2.10586.20) (-exported- Symbols Loaded) Linked PDB Filename : wuser32.pdb File Version : 10.0.10586.0 (th2_release.151029-1700) Company Name : Microsoft Corporation Product Name : Microsoft® Windows®-besturingssysteem Product Version : 10.0.10586.0 ModLoad: 0000000077790000 000000000014f000 C:\WINDOWS\SYSTEM32\GDI32.dll (6.2.10586.63) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32.pdb File Version : 10.0.10586.63 (th2_release.160104-1513) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.10586.63 ModLoad: 00000000746c0000 000000000007b000 C:\WINDOWS\SYSTEM32\ADVAPI32.dll (6.2.10586.63) (-exported- Symbols Loaded) Linked PDB Filename : advapi32.pdb File Version : 10.0.10586.0 (th2_release.151029-1700) Company Name : Microsoft Corporation Product Name : Besturingssysteem Microsoft® Windows® Product Version : 10.0.10586.0 ModLoad: 0000000074bd0000 00000000000be000 C:\WINDOWS\SYSTEM32\msvcrt.dll (7.0.10586.0) (-exported- Symbols Loaded) Linked PDB Filename : msvcrt.pdb File Version : 7.0.10586.0 (th2_release.151029-1700) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 7.0.10586.0 ModLoad: 0000000074670000 0000000000044000 C:\WINDOWS\SYSTEM32\sechost.dll (6.2.10586.0) (-exported- Symbols Loaded) Linked PDB Filename : sechost.pdb File Version : 10.0.10586.0 (th2_release.151029-1700) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.10586.0 ModLoad: 0000000075130000 00000000000ad000 C:\WINDOWS\SYSTEM32\RPCRT4.dll (6.2.10586.0) (-exported- Symbols Loaded) Linked PDB Filename : wrpcrt4.pdb File Version : 10.0.10586.0 (th2_release.151029-1700) Company Name : Microsoft Corporation Product Name : Besturingssysteem Microsoft® Windows® Product Version : 10.0.10586.0 ModLoad: 0000000074650000 000000000001e000 C:\WINDOWS\SYSTEM32\SspiCli.dll (6.2.10586.0) (-exported- Symbols Loaded) Linked PDB Filename : wsspicli.pdb File Version : 10.0.10586.0 (th2_release.151029-1700) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.10586.0 ModLoad: 0000000074640000 000000000000a000 C:\WINDOWS\SYSTEM32\CRYPTBASE.dll (6.2.10586.0) (-exported- Symbols Loaded) Linked PDB Filename : cryptbase.pdb File Version : 10.0.10586.0 (th2_release.151029-1700) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.10586.0 ModLoad: 0000000076f50000 0000000000058000 C:\WINDOWS\SYSTEM32\bcryptPrimitives.dll (6.2.10586.0) (-exported- Symbols Loaded) Linked PDB Filename : bcryptprimitives.pdb File Version : 10.0.10586.0 (th2_release.151029-1700) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.10586.0 ModLoad: 0000000074910000 000000000001b000 C:\WINDOWS\SYSTEM32\imagehlp.dll (6.2.10586.0) (-exported- Symbols Loaded) Linked PDB Filename : imagehlp.pdb File Version : 10.0.10586.0 (th2_release.151029-1700) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.10586.0 ModLoad: 00000000775b0000 000000000002b000 C:\WINDOWS\SYSTEM32\IMM32.DLL (6.2.10586.0) (-exported- Symbols Loaded) Linked PDB Filename : wimm32.pdb File Version : 10.0.10586.0 (th2_release.151029-1700) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.10586.0 ModLoad: 0000000000e00000 000000000013f000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.10586.0) (-exported- Symbols Loaded) Linked PDB Filename : dbghelp.pdb File Version : 10.0.10586.0 (th2_release.151029-1700) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.10586.0 ModLoad: 0000000074630000 0000000000008000 C:\WINDOWS\SYSTEM32\version.dll (6.2.10586.0) (-exported- Symbols Loaded) Linked PDB Filename : version.pdb File Version : 10.0.10586.0 (th2_release.151029-1700) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 10.0.10586.0 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 0, Write: 0, Other 0 - I/O Transfers Counters - Read: 0, Write: 0, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 0, QuotaPeakPagedPoolUsage: 0 QuotaNonPagedPoolUsage: 0, QuotaPeakNonPagedPoolUsage: 0 - Virtual Memory Usage - VirtualSize: 0, PeakVirtualSize: 0 - Pagefile Usage - PagefileUsage: 0, PeakPagefileUsage: 0 - Working Set Size - WorkingSetSize: 0, PeakWorkingSetSize: 0, PageFaultCount: 0 * Dump of thread ID 6184 (state: Initialized): * - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Unhandled Exception Record - Reason: Breakpoint Encountered (0x80000003) at address 0x012741E0 - Registers - eax=0140ec00 ebx=1106f920 ecx=000000cd edx=00000001 esi=00000001 edi=018baae0 eip=012741e0 esp=10de2c88 ebp=1106f918 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000203 - Callstack - ChildEBP RetAddr Args to Child 1106f918 01288e30 1106fb8c 01288e30 1291f440 013feea0 hadam3p_afr_um_7.22_windows_int!+0x0 1106fb78 01228464 0001b300 0140ec00 110a5f50 11ec6b50 hadam3p_afr_um_7.22_windows_int!+0x0 1106fb8c 01228464 01396be4 01396be4 01396b84 1108af50 hadam3p_afr_um_7.22_windows_int!+0x0 11ec6b50 0101c836 11ec6e40 120cb740 120e6a40 12101d40 hadam3p_afr_um_7.22_windows_int!+0x0 12903cf8 01064ef1 018d10a0 018cfba8 018cfbc0 1291f2c0 hadam3p_afr_um_7.22_windows_int!+0x0 1291f394 0108533a 1302f270 1302f274 1302f278 1302f27c hadam3p_afr_um_7.22_windows_int!+0x0 1302f208 0108632b 013c5574 013c5578 1302f270 1302f274 hadam3p_afr_um_7.22_windows_int!+0x0 1302f4a0 01019327 00fd9f80 01000000 00a142f1 00a1434f hadam3p_afr_um_7.22_windows_int!+0x0 00000000 00000000 00000000 00000000 00000000 00000000 hadam3p_afr_um_7.22_windows_int!+0x0 * Dump of thread ID 152 (state: Initialized): * - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Registers - eax=00000000 ebx=00a18348 ecx=00000000 edx=00000000 esi=00a18188 edi=00a14c60 eip=7799876c esp=2474f810 ebp=2474f9c8 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000212 - Callstack - ChildEBP RetAddr Args to Child 2474f9c8 775f38f4 00a14c60 775f38d0 e6d509a5 2474fa24 ntdll!NtWaitForWorkViaWorkerFactory+0x0 2474f9dc 77985de3 00a14c60 c92c5c39 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 2474fa24 77985dae ffffffff 779ab7c4 00000000 00000000 ntdll!RtlUnicodeStringToInteger+0x0 2474fa34 00000000 7794c6d0 00a14c60 00000000 00000000 ntdll!RtlUnicodeStringToInteger+0x0 * Dump of thread ID 5308 (state: Initialized): * - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Registers - eax=00000000 ebx=00a18fb8 ecx=00000000 edx=00000000 esi=00a18df8 edi=00a14c60 eip=7799876c esp=35e6f620 ebp=35e6f7d8 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000212 - Callstack - ChildEBP RetAddr Args to Child 35e6f7d8 775f38f4 00a14c60 775f38d0 f7470795 35e6f834 ntdll!NtWaitForWorkViaWorkerFactory+0x0 35e6f7ec 77985de3 00a14c60 d8be5e29 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 35e6f834 77985dae ffffffff 779ab7c4 00000000 00000000 ntdll!RtlUnicodeStringToInteger+0x0 35e6f844 00000000 7794c6d0 00a14c60 00000000 00000000 ntdll!RtlUnicodeStringToInteger+0x0 * Dump of thread ID 8244 (state: Initialized): * - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Registers - eax=00000000 ebx=00a19438 ecx=00000000 edx=00000000 esi=00a19278 edi=00a14c60 eip=7799876c esp=4758f708 ebp=4758f8c0 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 4758f8c0 775f38f4 00a14c60 775f38d0 85f908ad 4758f91c ntdll!NtWaitForWorkViaWorkerFactory+0x0 4758f8d4 77985de3 00a14c60 aa005f01 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 4758f91c 77985dae ffffffff 779ab7c4 00000000 00000000 ntdll!RtlUnicodeStringToInteger+0x0 4758f92c 00000000 7794c6d0 00a14c60 00000000 00000000 ntdll!RtlUnicodeStringToInteger+0x0 * Dump of thread ID 4196 (state: Initialized): * - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Registers - eax=012d2650 ebx=741cfb4c ecx=00000000 edx=00000000 esi=00000000 edi=00000001 eip=77996f1c esp=741cfb0c ebp=741cfb70 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000206 - Callstack - ChildEBP RetAddr Args to Child 741cfb70 74e4a6bf 00000064 00000000 741cfdb0 012d2674 ntdll!ZwDelayExecution+0x0 741cfb80 012d2674 00000064 012d2650 012d2650 00000000 KERNELBASE!Sleep+0x0 741cfdb0 775f38f4 00000000 775f38d0 b6bd0dbd 741cfe0c hadam3p_afr_um_7.22_windows_int!+0x0 741cfdc4 77985de3 00000000 99445811 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 741cfe0c 77985dae ffffffff 779ab7c4 00000000 00000000 ntdll!RtlUnicodeStringToInteger+0x0 741cfe1c 00000000 012d2650 00000000 00000000 00000000 ntdll!RtlUnicodeStringToInteger+0x0 * Debug Message Dump ** * Foreground Window Data *** Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=648, selfPID=648, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=648, selfPID=7228, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
17 Apr 2016 14:26:30	1347848	19449703	hadam3p_afr50_bqur_201412_12_372_010410445_1	57,899	156,755	2.7074
15 Apr 2016 12:50:30	1347848	19449703	hadam3p_afr50_bqur_201412_12_372_010410445_1	46,379	124,280	2.6797
11 Apr 2016 08:59:41	1347848	19449703	hadam3p_afr50_bqur_201412_12_372_010410445_1	34,859	92,889	2.6647
08 Apr 2016 18:57:44	1347848	19449703	hadam3p_afr50_bqur_201412_12_372_010410445_1	23,339	62,473	2.6768
04 Apr 2016 17:21:44	1347848	19449703	hadam3p_afr50_bqur_201412_12_372_010410445_1	11,819	32,224	2.7265