Scan screen with mouse to find object

Technical support and scripting issues

Moderators: JRL, Dorian (MJT support)

Post Reply
retskoon
Newbie
Posts: 1
Joined: Fri Dec 27, 2024 8:49 pm

Scan screen with mouse to find object

Post by retskoon » Fri Dec 27, 2024 8:55 pm

Hello!

Is it possible with this app to have the mouse hover over all areas of the screen in order to find an object in a game and then determine what object the mouse is over when it displays its label, and if it matches a variable, to click that object?

Thanks for reading

User avatar
Dorian (MJT support)
Automation Wizard
Posts: 1414
Joined: Sun Nov 03, 2002 3:19 am

Re: Scan screen with mouse to find object

Post by Dorian (MJT support) » Sat Dec 28, 2024 1:19 pm

Games are notoriously challenging to automate, and Macro Scheduler isn't particularly designed to automate them. If a game can be run in Windowed mode, it's possible, but it will generally rely on mouse/keyboard, which may be very limiting.

Success depends on how easily the labels can be recognised. You could start with mouse moves and image recognition. Maybe even mouse moves and OCR if it's standard text.

I'd download the trial and experiment with it if I were you.

Post Reply
Sign up to our newsletter for free automation tips, tricks & discounts