← all repositories

askui/python-sdk

A Python SDK enabling AI agents to automate UI interactions across desktop, mobile, and embedded devices using vision-based element detection and multi-model LLM support.

545 stars Python AgentsComputer Vision
python-sdk
Velocity · 7d
+0.9
★ / day
Trend
steady
star history

AskUI Python SDK is an automation framework that allows AI agents to control desktop, mobile, and HMI devices through natural language instructions. The framework combines computer vision for UI element detection with LLM integration for intelligent decision-making, supporting models like Anthropic Claude and Google Gemini. It replaces brittle selectors with vision-based automation, enabling AI agents to execute complex multi-step workflows across platforms.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.