midscene
Midscene is a vision-based GUI agent and testing framework for end-to-end tests of web, mobile, and desktop apps. Describe interface actions and expected results in natural language, then use it to interact with screens and verify what users see.
Share on XLicense: MIT
Overview
Midscene is a vision-based GUI agent and testing framework for end-to-end tests of web, mobile, and desktop apps. Developers describe interface actions and expected results in natural language, and the agent uses screenshots to locate controls, interact with them, and check visible outcomes. Tests can be organized as YAML cases with Midscene Test or run through Agent APIs in existing Playwright tests. Generated HTML reports show screenshots, actions, and assertion results.
Key features
- Describe UI actions, waits, and assertions in natural language.
- Locate controls from screenshots and click, type, or scroll without maintaining selectors.
- Write YAML test cases with Midscene Test or use Agent APIs with Playwright.
- Inspect screenshots, actions, and assertion results in generated HTML reports.
Best for
Developers who want to test user-visible behavior across web, mobile, or desktop interfaces. Choose it when tests should describe what a user sees and does rather than rely on maintained selectors.
- Upstream
- web-infra-dev/midscene
- Fork on GitHub
- Guo-astro/midscene
- Upstream stars
- 15k
- Category
- Developer tools and infrastructure
- Language
- TypeScript
- License
- MIT
- Forked
- 2026-10-13
- Sync status
- Updated by last syncLast synced 2026-10-14
More in Developer tools and infrastructure
xtool builds, signs, and deploys iOS apps from SwiftPM on Linux, Windows, and macOS. It helps developers work on iOS apps without relying only on Xcode.
Forked 2026-10-12Last synced 2026-10-14License: MITDeveloper tools and infrastructureGitHub
A daily monitor for emerging AI model, product, tool, and repo names, helping SEO and content teams spot new search opportunities before keyword tools do.
Forked 2026-10-12Last synced 2026-10-14License: MITDeveloper tools and infrastructureGitHub
iPhone Use lets Codex control a real iPhone over USB through WebDriverAgent for app navigation, page reading, gestures, and text entry. It automates phone tasks and shows a live screen preview.
Forked 2026-10-11Last synced 2026-10-14License: MITDeveloper tools and infrastructureGitHub
AnyPS5 ports PS5 executables to Linux and Windows by converting them to native formats and providing system PRX libraries for dynamic linking. It is for running compatible games without emulation or a separate runtime process.
Forked 2026-10-11Last synced 2026-10-14License: GPL-2.0Developer tools and infrastructureGitHub