Although it is generally better to use high level actions like Press Button or Resize Window, it is sometimes necessary to resort to looking at the screen for a specific image and responding appropriately (behaving differently if it exists, clicking on it, moving things to it, etc).

There are various actions (Move or Click Mouse, Find Image on Screen, conditions and collections that search the screen for a matching image.

• Specify the image to match

  • Paste an image into the image well
    (Use ⌘⌃⇧4 to Take a screenshot of part of your screen).
  • To view the image in the image well, click on it and press SPACE.
  • You can copy the image from the Image Well.
• Specify the amount of fuzziness allowed
  • Because of transparency and anti-aliasing almost all screen matches are fuzzy to some degree.
  • But usually about 20% is a good place to start.
• Optionally highlight Found Matches
  • This can be helpful in determining the right amount of fuzz to use.
  • It can also show when an image is being found in more than one location.
• Choose Where to Search for Image
  • All screens.
  • Main screen.
  • Specified screen (counting from the left).
  • Front window.
  • Window with a specified title.
  • Window with a title containing a given string.
  • Window with a title matching a given regular expression.
  • Specified window (counting from the frontmost window).
  • Specified area on the screen.

Remember when specifying the area, as with all numeric fields, the numbers can be calculations including functions, and the fields expand to allow for longer expressions as soon as you type something other than a number, so this allows very precise control of where you can match.