winapp-ui-automation Skill
Inspect and interact with running Windows app UIs from the command line using UI Automation (UIA). Use when an AI agent or developer needs to inspect a UI element tree, find controls, take screenshots, click buttons, read or set text, or verify UI state in a running Windows app. Works with any framework WinUI 3, WPF, W Published by microsoft in winappCli.
What is winapp-ui-automation Skill?
Inspect and interact with running Windows app UIs from the command line using UI Automation (UIA). Use when an AI agent or developer needs to inspect a UI element tree, find controls, take screenshots, click buttons, read or set text, or verify UI state in a running Windows app. Works with any framework WinUI 3, WPF, W Published by microsoft in winappCli. This profile combines repository metadata with install, compatibility, and usage signals so developers can quickly decide whether it fits their agent workflow before opening the source repository.
Automated repository signals based on public metadata such as recency, license, installation evidence, and adoption. These are not a security audit or endorsement.
Key capabilities
- Includes SKILL.md support
- Reusable instructions support
- Browser automation
- Testing
- Design and media
- Research
- Browser automation use cases
Technical details
- Install or run with Copy skill directory
When to use winapp-ui-automation Skill
- Use it for browser automation.
- Use it for testing.
- Use it for design and media.
- Use it for research.
Built with
Editorial notes
Source
- Creator: microsoft
- Repository: microsoft/winappCli
- Skill file: .github/plugin/skills/winapp-cli/ui-automation/SKILL.md
What it does
Inspect and interact with running Windows app UIs from the command line using UI Automation (UIA). Use when an AI agent or developer needs to inspect a UI element tree, find controls, take screenshots, click buttons, read or set text, or verify UI state in a running Windows app. Works with any framework WinUI 3, WPF, W
Skill instructions
When to use - Inspecting a running Windows app's UI from the command line - AI agents interacting with Windows applications (clicking buttons, reading text, taking screenshots) - Verifying UI state during development or testing - Automating UI workflows without Playwright or Selenium - Debugging WinUI 3, WPF, WinForms, Win32, or Electron app UIs Prerequisites - For UIA mode (any app): No setup needed — works with any running Windows app - For input-injecting verbs (click, hover, drag, scroll --wheel, send-keys --via send-input): an unlocked, interactive desktop with the target window foregroundable. On a locked/secure desktop they fail fast with nointeractivedesktop. The UIA-pattern verbs (inspect, search, get-, wait-for, set-value, invoke, scroll --direction/--to, screenshot) are headless/locked-session friendly — prefer them in CI. Common patterns Discover and interact powershell See what's clickable, then screenshot for context winapp ui inspect -a myapp --interactive; winapp ui scr
Explore related resources
Frequently asked questions
What is winapp-ui-automation?
winapp-ui-automation is a open-source AI agent skill with Copy skill directory. Inspect and interact with running Windows app UIs from the command line using UI Automation (UIA).
Who is winapp-ui-automation best for?
winapp-ui-automation is best for reusing agent instructions, scripts, and references, browser automation workflows, testing workflows, design and media workflows.
How do I install winapp-ui-automation?
Install or run winapp-ui-automation using Copy skill directory. Check winapp-ui-automation for the latest setup command.
Is winapp-ui-automation actively maintained?
winapp-ui-automation may need a closer maintenance check before production use.
Auto-fetched from GitHub.
