Hi
I'd be very grateful for any help with interpreting the following analysis from WinDbg. The problem is an ASP application hanging about once a day. The only solution is to manually recycle the application pool. The server is Windows 2003 and IIS6.
Many thanks in advance.
Here's the output:
0:000:x86> !analyze -v
*** WARNING: symbols timestamp is wrong 0x499007dc 0x49900d5a for ntdll.dll
*******************************************************************************
* *
* Exception Analysis *
* *
*******************************************************************************
*** ERROR: Symbol file could not be found. Defaulted to export symbols for hotlinkprot.dll -
*** ERROR: Symbol file could not be found. Defaulted to export symbols for ISAPI_Rewrite.dll -
*** ERROR: Symbol file could not be found. Defaulted to export symbols for mtbnotif.dll -
*** WARNING: symbols timestamp is wrong 0x474b83d7 0x474b8467 for asp.dll
*** WARNING: symbols timestamp is wrong 0x45d6cc1d 0x45d70ad8 for comsvcs.dll
*** ERROR: Symbol file could not be found. Defaulted to export symbols for fcgiext.dll -
FAULTING_IP:
+5befd80
00000000 ?? ???
EXCEPTION_RECORD: ffffffffffffffff -- (.exr 0xffffffffffffffff)
ExceptionAddress: 0000000000000000
ExceptionCode: 80000003 (Break instruction exception)
ExceptionFlags: 00000000
NumberParameters: 0
FAULTING_THREAD: 00000000000068c8
DEFAULT_BUCKET_ID: ZEROED_STACK
PROCESS_NAME: w3wp.exe
OVERLAPPED_MODULE: Address regions for 'activeds' and '輨' overlap
ERROR_CODE: (NTSTATUS) 0x80000003 - {EXCEPTION} Breakpoint A breakpoint has been reached.
EXCEPTION_CODE: (HRESULT) 0x80000003 (2147483651) - One or more arguments are invalid
MOD_LIST: <ANALYSIS/>
APPLICATION_VERIFIER_FLAGS: 0
PRIMARY_PROBLEM_CLASS: ZEROED_STACK
BUGCHECK_STR: APPLICATION_FAULT_ZEROED_STACK
LAST_CONTROL_TRANSFER: from 000000007d4d8c9e to 000000007d61c846
STACK_TEXT:
0014fc0c 7d4d8c9e 00000190 00000000 00000000 ntdll_7d600000!ZwWaitForSingleObject+0x15
0014fc7c 7d4d8c0d 00000190 ffffffff 00000000 kernel32!WaitForSingleObjectEx+0xac
0014fc90 5a364692 00000190 ffffffff 00000000 kernel32!WaitForSingleObject+0x12
0014fca0 5a366f27 003354c8 5a3af3dd 00000000 w3dt!WP_CONTEXT::RunMainThreadLoop+0x10
0014fca8 5a3af3dd 00000000 64711dcf 00000000 w3dt!UlAtqStartListen+0x2d
0014fcb8 5a3bc315 01001418 010013e4 010012d0 w3core!W3_SERVER::StartListen+0xbd
0014ff0c 0100187c 00000007 00333a30 00000000 w3core!UlW3Start+0x26e
0014ff44 01001a27 00000007 00333a30 003348c8 w3wp!wmain+0x22a
0014ffc0 7d4e7d42 00000000 00000000 fffdf000 w3wp!wmainCRTStartup+0x12f
0014fff0 00000000 010018f8 00000000 000000c8 kernel32!BaseProcessStart+0x28
STACK_COMMAND: ~0s; .ecxr ; kb
FOLLOWUP_IP:
ntdll_7d600000!ZwWaitForSingleObject+15
7d61c846 c20c00 ret 0Ch
SYMBOL_STACK_INDEX: 0
SYMBOL_NAME: ntdll!ZwWaitForSingleObject+15
FOLLOWUP_NAME: MachineOwner
MODULE_NAME: ntdll_7d600000
IMAGE_NAME: ntdll.dll
DEBUG_FLR_IMAGE_TIMESTAMP: 499007dc
FAILURE_BUCKET_ID: ZEROED_STACK_80000003_ntdll.dll!ZwWaitForSingleObject
BUCKET_ID: X64_APPLICATION_FAULT_ZEROED_STACK_ntdll!ZwWaitForSingleObject+15
WATSON_IBUCKET: 395708677
WATSON_IBUCKETTABLE: 1
WATSON_STAGEONE_URL:
watson.microsoft.com/StageOne/w3wp_exe/6...00000.htm?Retriage=1
Followup: MachineOwner
---------
0:000:x86> ~*k
. 0 Id: d04c.68c8 Suspend: 0 Teb: fffdb000 Unfrozen
ChildEBP RetAddr
0014fc0c 7d4d8c9e ntdll_7d600000!ZwWaitForSingleObject+0x15
0014fc7c 7d4d8c0d kernel32!WaitForSingleObjectEx+0xac
0014fc90 5a364692 kernel32!WaitForSingleObject+0x12
0014fca0 5a366f27 w3dt!WP_CONTEXT::RunMainThreadLoop+0x10
0014fca8 5a3af3dd w3dt!UlAtqStartListen+0x2d
0014fcb8 5a3bc315 w3core!W3_SERVER::StartListen+0xbd
0014ff0c 0100187c w3core!UlW3Start+0x26e
0014ff44 01001a27 w3wp!wmain+0x22a
0014ffc0 7d4e7d42 w3wp!wmainCRTStartup+0x12f
0014fff0 00000000 kernel32!BaseProcessStart+0x28
1 Id: d04c.1003c Suspend: 0 Teb: fffd8000 Unfrozen
ChildEBP RetAddr
0088fea4 7d63f521 ntdll_7d600000!ZwWaitForMultipleObjects+0x15
0088ff48 7d63f9a8 ntdll_7d600000!EtwpWaitForMultipleObjectsEx+0xf7
0088ffb8 7d4dfe37 ntdll_7d600000!EtwpEventPump+0x27f
0088ffec 00000000 kernel32!BaseThreadStart+0x34
2 Id: d04c.16cc Suspend: 0 Teb: fffd5000 Unfrozen
ChildEBP RetAddr
0104ffa0 7d634d89 ntdll_7d600000!NtDelayExecution+0x15
0104ffb8 7d4dfe37 ntdll_7d600000!RtlpTimerThread+0x47
0104ffec 00000000 kernel32!BaseThreadStart+0x34
3 Id: d04c.3c24 Suspend: 0 Teb: fffad000 Unfrozen
ChildEBP RetAddr
010cff74 7d62e159 ntdll_7d600000!ZwRemoveIoCompletion+0x15
010cffb8 7d4dfe37 ntdll_7d600000!RtlpWorkerThread+0x3d
010cffec 00000000 kernel32!BaseThreadStart+0x34
4 Id: d04c.11e0c Suspend: 0 Teb: fffaa000 Unfrozen
ChildEBP RetAddr
0116fd1c 7da3da80 ntdll_7d600000!ZwReplyWaitReceivePortEx+0x12
0116ff84 7da45eac rpcrt4!LRPC_ADDRESS::ReceiveLotsaCalls+0x198
0116ff8c 7da45dd0 rpcrt4!RecvLotsaCallsWrapper+0xd
0116ffac 7da45e94 rpcrt4!BaseCachedThreadRoutine+0x9d
0116ffb8 7d4dfe37 rpcrt4!ThreadStartRoutine+0x1b
0116ffec 00000000 kernel32!BaseThreadStart+0x34
5 Id: d04c.4ae0 Suspend: 0 Teb: fffa7000 Unfrozen
ChildEBP RetAddr
011eff0c 7d4d0ec9 ntdll_7d600000!NtDelayExecution+0x15
011eff74 7d4d14ef kernel32!SleepEx+0x68
011eff84 776bbb0f kernel32!Sleep+0xf
011eff90 776bbab4 ole32!CROIDTable::WorkerThreadLoop+0x14
011effac 776b1704 ole32!CRpcThread::WorkerLoop+0x26
011effb8 7d4dfe37 ole32!CRpcThreadCache::RpcWorkerThreadEntry+0x20
011effec 00000000 kernel32!BaseThreadStart+0x34
6 Id: d04c.f2e8 Suspend: 0 Teb: fffa4000 Unfrozen
ChildEBP RetAddr
013ef458 7d628698 ntdll_7d600000!ZwWaitForSingleObject+0x15
013ef494 7d628596 ntdll_7d600000!RtlpWaitOnCriticalSection+0x1a3
013ef4b4 67a86482 ntdll_7d600000!RtlEnterCriticalSection+0xa8
WARNING: Stack unwind information not available. Following frames may be wrong.
013ef594 7c4239cb hotlinkprot!TerminateFilter+0x5462
013ef5e4 fa375121 msvcp80!std::basic_string<char,std::char_traits<char>,std::allocator<char> >::assign+0x6a
00000000 00000000 0xfa375121
7 Id: d04c.4ce8 Suspend: 0 Teb: fffa1000 Unfrozen
ChildEBP RetAddr
0146f458 7d628698 ntdll_7d600000!ZwWaitForSingleObject+0x15
0146f494 7d628596 ntdll_7d600000!RtlpWaitOnCriticalSection+0x1a3
0146f4b4 67a86482 ntdll_7d600000!RtlEnterCriticalSection+0xa8
WARNING: Stack unwind information not available. Following frames may be wrong.
0146f594 7c4239cb hotlinkprot!TerminateFilter+0x5462
0146f5e4 fa4f5121 msvcp80!std::basic_string<char,std::char_traits<char>,std::allocator<char> >::assign+0x6a
00000000 00000000 0xfa4f5121
8 Id: d04c.2720 Suspend: 0 Teb: fff9e000 Unfrozen
ChildEBP RetAddr
014ef458 7d628698 ntdll_7d600000!ZwWaitForSingleObject+0x15
014ef494 7d628596 ntdll_7d600000!RtlpWaitOnCriticalSection+0x1a3
014ef4b4 67a86482 ntdll_7d600000!RtlEnterCriticalSection+0xa8
WARNING: Stack unwind information not available. Following frames may be wrong.
014ef594 7c4239cb hotlinkprot!TerminateFilter+0x5462
014ef5e4 fa475121 msvcp80!std::basic_string<char,std::char_traits<char>,std::allocator<char> >::assign+0x6a
00000000 00000000 0xfa475121
9 Id: d04c.553c Suspend: 0 Teb: fff9b000 Unfrozen
ChildEBP RetAddr
0156f458 7d628698 ntdll_7d600000!ZwWaitForSingleObject+0x15
0156f494 7d628596 ntdll_7d600000!RtlpWaitOnCriticalSection+0x1a3
0156f4b4 67a86482 ntdll_7d600000!RtlEnterCriticalSection+0xa8
WARNING: Stack unwind information not available. Following frames may be wrong.
0156f594 7c4239cb hotlinkprot!TerminateFilter+0x5462
0156f5e4 fa5f5121 msvcp80!std::basic_string<char,std::char_traits<char>,std::allocator<char> >::assign+0x6a
00000000 00000000 0xfa5f5121
10 Id: d04c.c510 Suspend: 0 Teb: fff98000 Unfrozen
ChildEBP Re