Unable to connect WinDbg to Vista 64bit SP1 target

Discussion:

(too old to reply)

Unable to connect WinDbg to Vista 64bit

2009-01-27 00:06:01 UTC

I'm unable to use WinDBG to connect through serial from my XP SP3 system
(debugger) to a remote Vista 64bit SP1 system (debuggee).

- I know the cable works fine, since I was able to do the opposite setup:
debug XP SP3 from the Vista 64 machine.
- I have the latest WinDbg version 6.10.0003.233 X86 installed on my XP
machine.
- I'm using the same settings on both machines: serial com1 baudrate=57600
- I verified that the com port number is correct on both machines.
- The debug port disappears from the device manager on my Vista machine when
I boot in debug mode, which seems to indicate that the port was grabbed by
the debugger.
- I'm getting some kind of traffic on the serial cable on my XP system when
I start Vista in debug mode. (used hyperterminal to verify this)
- I have tried several machines as debugger and I can't get the connection
to work.

Does anybody have an idea what I'm doing wrong ?

Here's also my Vista boot configuration:

Windows Boot Manager
--------------------
identifier {bootmgr}
device partition=D:
description Windows Boot Manager
locale en-US
inherit {globalsettings}
default {current}
resumeobject {a0744f8b-705a-11db-918f-0018716ebb75}
displayorder {ntldr}
{a0744f8a-705a-11db-918f-0018716ebb75}
{31d8ffc0-215a-11dd-9f4f-001cc4881bbf}
{current}
toolsdisplayorder {memdiag}
timeout 30

Windows Boot Loader
-------------------
identifier {31d8ffc0-215a-11dd-9f4f-001cc4881bbf}
device partition=C:
path \Windows\System32\winload.exe
description Vista Business 64
testsigning No
osdevice partition=C:
systemroot \WINDOWS
resumeobject {c5f56042-e98c-11dd-b2bc-806e6f6e6963}
detecthal No
usefirmwarepcisettings No
debug No

Windows Boot Loader
-------------------
identifier {572bcd56-ffa7-11d9-aae0-0007e994107d}

Windows Boot Loader
-------------------
identifier {current}
device partition=C:
path \windows\System32\winload.exe
description Vista 64 SP1 Debug Session
testsigning Yes
osdevice partition=C:
systemroot \windows
resumeobject {5f24d923-e989-11dd-a162-806e6f6e6963}
detecthal No
usefirmwarepcisettings No
debug Yes

Windows Boot Loader
-------------------
identifier {a0744f8a-705a-11db-918f-0018716ebb75}
device partition=D:
path \Windows\system32\winload.exe
description Vista Business 32
locale en-US
inherit {bootloadersettings}
recoverysequence {572bcd56-ffa7-11d9-aae0-0007e994107d}
recoveryenabled Yes
osdevice partition=D:
systemroot \Windows
resumeobject {a0744f8b-705a-11db-918f-0018716ebb75}
nx OptIn

Resume from Hibernate
---------------------
identifier {5f24d923-e989-11dd-a162-806e6f6e6963}
device partition=C:
path \windows\System32\winresume.exe
description Vista 64 SP1 Debug Session
inherit {resumeloadersettings}
filedevice partition=C:
filepath \hiberfil.sys
debugoptionenabled Yes

Resume from Hibernate
---------------------
identifier {a0744f8b-705a-11db-918f-0018716ebb75}
device partition=D:
path \Windows\system32\winresume.exe
description Windows Resume Application
locale en-US
inherit {resumeloadersettings}
filedevice partition=D:
filepath \hiberfil.sys
pae Yes
debugoptionenabled No

Resume from Hibernate
---------------------
identifier {c5f56042-e98c-11dd-b2bc-806e6f6e6963}
device partition=C:
path \Windows\System32\winresume.exe
description Vista Business 64
inherit {resumeloadersettings}
filedevice partition=C:
filepath \hiberfil.sys
debugoptionenabled No

Windows Memory Tester
---------------------
identifier {memdiag}
device partition=D:
path \boot\memtest.exe
description Windows Memory Diagnostic
locale en-US
inherit {globalsettings}
badmemoryaccess Yes

Windows Legacy OS Loader
------------------------
identifier {31d8ffc1-215a-11dd-9f4f-001cc4881bbf}
device partition=E:
path \ntldr
description Windows XP Professional

Windows Legacy OS Loader
------------------------
identifier {ntldr}
device partition=E:
path \ntldr
description Windows XP Professional

EMS Settings
------------
identifier {emssettings}
bootems Yes

Debugger Settings
-----------------
identifier {dbgsettings}
debugtype Serial
debugport 1
baudrate 57600

RAM Defects
-----------
identifier {badmemory}

Global Settings
---------------
identifier {globalsettings}
inherit {dbgsettings}
{emssettings}
{badmemory}

Boot Loader Settings
--------------------
identifier {bootloadersettings}
inherit {globalsettings}

Resume Loader Settings
----------------------
identifier {resumeloadersettings}
inherit {globalsettings}

Device options
--------------
identifier {ad6c7bc8-fa0f-11da-8ddf-0013200354d8}
description Ramdisk Device Options
ramdisksdidevice unknown
ramdisksdipath \boot.sdi

Aaron

2009-02-19 20:49:01 UTC

Permalink

You'll need to make sure you have the latest version of WinDbg. I had this
same problem with version 6.8 until I updated to 6.11. Now it's working as
expected.

Aaron

Post by Unable to connect WinDbg to Vista 64bit
I'm unable to use WinDBG to connect through serial from my XP SP3 system
(debugger) to a remote Vista 64bit SP1 system (debuggee).
debug XP SP3 from the Vista 64 machine.
- I have the latest WinDbg version 6.10.0003.233 X86 installed on my XP
machine.
- I'm using the same settings on both machines: serial com1 baudrate=57600
- I verified that the com port number is correct on both machines.
- The debug port disappears from the device manager on my Vista machine when
I boot in debug mode, which seems to indicate that the port was grabbed by
the debugger.
- I'm getting some kind of traffic on the serial cable on my XP system when
I start Vista in debug mode. (used hyperterminal to verify this)
- I have tried several machines as debugger and I can't get the connection
to work.
Does anybody have an idea what I'm doing wrong ?
Windows Boot Manager
--------------------
identifier {bootmgr}
description Windows Boot Manager
locale en-US
inherit {globalsettings}
default {current}
resumeobject {a0744f8b-705a-11db-918f-0018716ebb75}
displayorder {ntldr}
{a0744f8a-705a-11db-918f-0018716ebb75}
{31d8ffc0-215a-11dd-9f4f-001cc4881bbf}
{current}
toolsdisplayorder {memdiag}
timeout 30
Windows Boot Loader
-------------------
identifier {31d8ffc0-215a-11dd-9f4f-001cc4881bbf}
path \Windows\System32\winload.exe
description Vista Business 64
testsigning No
systemroot \WINDOWS
resumeobject {c5f56042-e98c-11dd-b2bc-806e6f6e6963}
detecthal No
usefirmwarepcisettings No
debug No
Windows Boot Loader
-------------------
identifier {572bcd56-ffa7-11d9-aae0-0007e994107d}
Windows Boot Loader
-------------------
identifier {current}
path \windows\System32\winload.exe
description Vista 64 SP1 Debug Session
testsigning Yes
systemroot \windows
resumeobject {5f24d923-e989-11dd-a162-806e6f6e6963}
detecthal No
usefirmwarepcisettings No
debug Yes
Windows Boot Loader
-------------------
identifier {a0744f8a-705a-11db-918f-0018716ebb75}
path \Windows\system32\winload.exe
description Vista Business 32
locale en-US
inherit {bootloadersettings}
recoverysequence {572bcd56-ffa7-11d9-aae0-0007e994107d}
recoveryenabled Yes
systemroot \Windows
resumeobject {a0744f8b-705a-11db-918f-0018716ebb75}
nx OptIn
Resume from Hibernate
---------------------
identifier {5f24d923-e989-11dd-a162-806e6f6e6963}
path \windows\System32\winresume.exe
description Vista 64 SP1 Debug Session
inherit {resumeloadersettings}
filepath \hiberfil.sys
debugoptionenabled Yes
Resume from Hibernate
---------------------
identifier {a0744f8b-705a-11db-918f-0018716ebb75}
path \Windows\system32\winresume.exe
description Windows Resume Application
locale en-US
inherit {resumeloadersettings}
filepath \hiberfil.sys
pae Yes
debugoptionenabled No
Resume from Hibernate
---------------------
identifier {c5f56042-e98c-11dd-b2bc-806e6f6e6963}
path \Windows\System32\winresume.exe
description Vista Business 64
inherit {resumeloadersettings}
filepath \hiberfil.sys
debugoptionenabled No
Windows Memory Tester
---------------------
identifier {memdiag}
path \boot\memtest.exe
description Windows Memory Diagnostic
locale en-US
inherit {globalsettings}
badmemoryaccess Yes
Windows Legacy OS Loader
------------------------
identifier {31d8ffc1-215a-11dd-9f4f-001cc4881bbf}
path \ntldr
description Windows XP Professional
Windows Legacy OS Loader
------------------------
identifier {ntldr}
path \ntldr
description Windows XP Professional
EMS Settings
------------
identifier {emssettings}
bootems Yes
Debugger Settings
-----------------
identifier {dbgsettings}
debugtype Serial
debugport 1
baudrate 57600
RAM Defects
-----------
identifier {badmemory}
Global Settings
---------------
identifier {globalsettings}
inherit {dbgsettings}
{emssettings}
{badmemory}
Boot Loader Settings
--------------------
identifier {bootloadersettings}
inherit {globalsettings}
Resume Loader Settings
----------------------
identifier {resumeloadersettings}
inherit {globalsettings}
Device options
--------------
identifier {ad6c7bc8-fa0f-11da-8ddf-0013200354d8}
description Ramdisk Device Options
ramdisksdidevice unknown
ramdisksdipath \boot.sdi

Santhosh

2009-02-27 17:48:09 UTC

Permalink

I had a similar problem with Vista 32 bit Target. Windbg could not connect,
but a kernel debugger (kd.exe) can connect. I upgraded to 6.11 from 6.8 and
it did not work.

The way, I got WinDbg to work is as follows,

Make the "Baud Rate" entry blank and specify only "Port" in the "Kernel
Debugging dialog" box which is shown as part of "File->Kernel Debug"

Post by Aaron
You'll need to make sure you have the latest version of WinDbg. I had this
same problem with version 6.8 until I updated to 6.11. Now it's working as
expected.
Aaron