JoshuaALawrence/OpenControl

• click Click at a point: left/right/middle, single/double/triple.
• click_element Click a control by its [index] (moves the real mouse, or invokes it if off-screen).
• close_window Request a window to close (the app may prompt to save).
• copy_selection Copy the current selection and return the resulting clipboard text.
• double_click Double-click at a point.
• drag Press, drag, and release for sliders, selections, and drag-and-drop.
• find_elements Search a window's tree for controls by name and/or control type; returns usable indices.
• find_image_on_screen Find a template image via normalized cross-correlation; returns matches with centers.
• find_text Locate on-screen text and return matching words with clickable centers.
• focus_window Bring a window to the foreground and give it focus.
• get_active_window Return the foreground window's handle, title, and app.
• get_blocklist Show the user-configured application blocklist (read-only). Reports which apps are redacted from captures/OCR and refused for control. The …
• get_clipboard Read clipboard text.
• get_cursor_position Return the mouse position in physical screen pixels.
• get_element_at_point Identify the UI element under an image-space point.
• get_focused_element Return the control that currently holds keyboard focus.
• get_pixel_color Read the RGB/hex color of a pixel from the last screenshot.
• get_system_info Report host OS, CPU, memory, monitors, and virtual-screen size.
• get_ui_tree Dump an indexed accessibility tree as text (no screenshot) for a window or the whole desktop.
• hold_key Hold a set of keys down for a duration, then release.

view all →