Skip to content

Condition ‐ Screen ‐ Image

Nain57 edited this page Jun 1, 2025 · 1 revision

Capture

When creating a new Image Condition, you will be prompted first to take a screenshot. This screenshot must contains what you want to verify during your Smart Scenario execution.

Once the screenshot is taken, this screen will be displayed, allowing you to crop it. You can resize the selector by dragging one of its side, move it by dragging its center, or control the zoom on the screenshot with a pinch to zoom gesture. When the selector is correctly placed, you can press validate to move to the Screen Condition configuration dialog.

This step is crucial in your Image Condition , as you need to get the ideal picture of what you want to detect. Here are a few tips:

❌ Don't
✅ Do
Image
Do not capture more than needed.
Bigger capture increase the size of your scenario on your device memory and increase the processing time during execution.

Image
Capture only what you want to detect.
Here, the white area wasn't providing any detection information and can be removed.


Image
Do not capture changing background.
Klick'r won't be able to detect the Gmail icon if it moves elsewhere on the screen or if the wallpaper changes.

Image
Capture only the static part that will be displayed the same in any condition.
Here, we ensure that the wallpaper is not visible in the capture, only the icon.

Image
Avoid very small capture with little shape information.
Klick'r is scalling down the images in order to process more quickly. If you provide really small conditions with few details, it will be a pixel mush once scalled down during processing and Klick'r won't be able to detect it.

Image
Try to always provide as much detection information as you can

Configuration

Once the capture is correctly defined, you can configure how Klick'r will detect and interpret your capture. Like any other element in your scenario, you can set a name in order to easily identify what this Image Condition is doing when you come back later for edition.

Visibility

Controls whether the capture must be visible on screen to fulfill the image condition.
  • Visible: The capture must appear on screen.
  • Hidden: The capture must not be visible on screen.

Detection Area

Controls on what part of the screen the capture should be detected. The detection area of an Image condition have an impact on the performance of your Smart Scenario, the bigger the area is, the slower the detection will be.

Exact:

Verify if the capture is visible or not at the position it was made. Basic usecase for item that stays at the same position, selected by default.

Whole Screen:

Verify if the capture is visible or not anywhere on the screen. Useful when tracking something that moves randomly. This is the slowest option, as this is the biggest research area possible.

In Area:

Verify if the capture is visible or not in a custom area. When selected, the Detection Area option become available, allowing you to select where the capture should be verified during the Smart Scenario execution.

Tolerated difference

The Tolerated Difference is the error margin you allow to Klick'r for this Screen Condition.

When Klick'r is detecting images on your screen, it does some pre-processing to the device screen image in order to perform the detection more quickly. By doing so, it lose some information and can rarely be 100% sure about its result. When providing whether a Screen Condition is visible or not, it also provide a confidence rate on its result. (This confidence rate can be seen in the Screen Condition testing menu)

For example, if you set a Tolerated Difference of 4%:

  • All result with a confidence rate over 96% (100 - 4) will be considered as detected.
  • All result with a confidence rate below 96% will be considered as not detected.

Keep in mind that your Smart Scenario Detection Resosution will impact the confidence rate of Klick'r, so if you change it, you probably want to check the result of your Screen Condition.

Clone this wiki locally