Overview
Benchmark Overview
Return to the benchmark section summary.
Detailed Report
E2E Results
Compare strategy guidance against the latest benchmark outcome.
Scenario Docs
Scenario Intent
Review what each scenario is intended to prove.
Schema
Scenario Schema
Inspect manifest structure and region-selection workflow.
Strategy Metadata
Strategy Summary
| Metric | Value |
|---|---|
| Engine | hybrid |
| Engine Match Rate | 57.5% |
| Other Engines Match Rate | 39.2% |
| Delta vs Others | 18.3 pts |
| Engine Rank | 1/7 |
| Benchmark Source | docs/bench/reports/find-on-screen-e2e.json |
Visual Examples
| Scenario | Example |
|---|---|
vector_ui_baseline |
![]() |
photo_clutter |
![]() |
repetitive_grid_camouflage |
![]() |
noise_stress_random |
![]() |
scale_rotate_sweep |
![]() |
perspective_skew_sweep |
![]() |
orb_feature_rich |
![]() |
template_control_exact |
![]() |
hybrid_gate_conflicts |
![]() |
multi_monitor_dpi_shift |
![]() |
Diversity Summary
| Metric | Value |
|---|---|
| Scenario Types | 10/10 |
| Resolution Groups | 4 |
| Scenarios Per Resolution | 10 |
| Expected Positive | 10 |
| Expected Negative | 0 |
Kinds
| Metric | Value |
|---|---|
hybrid_gate |
1 |
multi_monitor_dpi |
1 |
noise_stress |
1 |
orb_feature_rich |
1 |
perspective_skew |
1 |
photographic |
1 |
repetitive_grid |
1 |
scale_rotate |
1 |
template_control |
1 |
vector_ui |
1 |
Styles
| Metric | Value |
|---|---|
grid |
1 |
mixed |
4 |
noise |
1 |
orbtex |
1 |
photo |
1 |
ui |
1 |
vector |
1 |
Target Sources
| Metric | Value |
|---|---|
asset |
1 |
mixed |
4 |
synthetic |
5 |
Decoy Placements
| Metric | Value |
|---|---|
clustered |
1 |
grid |
3 |
mixed |
4 |
random |
2 |
Noise Types
| Metric | Value |
|---|---|
banding |
2 |
compression_blocks |
5 |
gaussian |
5 |
poisson |
1 |
salt_pepper |
1 |
Transform Coverage
| Metric | Value |
|---|---|
perspective_enabled |
3 |
rotate |
10 |
scale |
10 |
skew_x_nonzero |
8 |
skew_y_nonzero |
8 |
Scenario Intent
| Scenario ID | Kind | Style | Looking For |
|---|---|---|---|
vector_ui_baseline |
vector_ui |
vector |
vector_ui_baseline: vector_ui (positive=True, iou_min=0.92, area_max=1.25, partial=False, decoys=grid, occlusion=False) |
photo_clutter |
photographic |
photo |
photo_clutter: photographic (positive=True, iou_min=0.75, area_max=1.6, partial=True, decoys=mixed, occlusion=True) |
repetitive_grid_camouflage |
repetitive_grid |
grid |
repetitive_grid_camouflage: repetitive_grid (positive=True, iou_min=0.85, area_max=1.35, partial=False, decoys=grid, occlusion=False) |
noise_stress_random |
noise_stress |
noise |
noise_stress_random: noise_stress (positive=True, iou_min=0.7, area_max=1.8, partial=True, decoys=random, occlusion=True) |
scale_rotate_sweep |
scale_rotate |
mixed |
scale_rotate_sweep: scale_rotate (positive=True, iou_min=0.68, area_max=2.2, partial=True, decoys=mixed, occlusion=True) |
perspective_skew_sweep |
perspective_skew |
mixed |
perspective_skew_sweep: perspective_skew (positive=True, iou_min=0.66, area_max=2.4, partial=True, decoys=random, occlusion=True) |
orb_feature_rich |
orb_feature_rich |
orbtex |
orb_feature_rich: orb_feature_rich (positive=True, iou_min=0.64, area_max=2.0, partial=True, decoys=clustered, occlusion=True) |
template_control_exact |
template_control |
ui |
template_control_exact: template_control (positive=True, iou_min=0.95, area_max=1.15, partial=False, decoys=grid, occlusion=False) |
hybrid_gate_conflicts |
hybrid_gate |
mixed |
hybrid_gate_conflicts: hybrid_gate (positive=True, iou_min=0.72, area_max=1.9, partial=True, decoys=mixed, occlusion=True) |
multi_monitor_dpi_shift |
multi_monitor_dpi |
mixed |
multi_monitor_dpi_shift: multi_monitor_dpi (positive=True, iou_min=0.78, area_max=1.5, partial=False, decoys=mixed, occlusion=False) |
Scenario Configuration Details
vector_ui_baseline
- Kind:
vector_ui - Style:
vector - Target: source=
syntheticsize={'min': 48, 'max': 160}rotation={'min': 0, 'max': 180}assets=none - Background: palette=
ui_lightclutter=0.72continuous_canvas=True - Transforms: scale=
{'min': 0.9, 'max': 1.2}rotate={'min': -5, 'max': 5}perspective_enabled=Falseskew_x={'min': 0.0, 'max': 0.0}skew_y={'min': 0.0, 'max': 0.0} - Photometric: brightness=
{'min': -0.08, 'max': 0.08}contrast={'min': 0.9, 'max': 1.12}gamma={'min': 0.95, 'max': 1.06}blur={'min': 0.0, 'max': 0.6}jpeg_quality={'min': 88, 'max': 100}noise_types=compression_blocks - Decoys: enabled=
Truecount={'min': 14, 'max': 34}similarity={'min': 0.86, 'max': 0.97}placement=grid - Occlusion: enabled=
Falsecoverage={'min': 0.0, 'max': 0.0} - Expected: positive=
Trueiou_min=0.92area_ratio_max=1.25allow_partial=False
photo_clutter
- Kind:
photographic - Style:
photo - Target: source=
assetsize={'min': 56, 'max': 176}rotation={'min': -25, 'max': 25}assets=docs/bench/assets/photo/4256_clutter_crop_zoom.jpg, docs/bench/assets/photo/4256_clutter_cool_grain.jpg, docs/bench/assets/photo/4256_clutter_warm_soft.jpg, docs/bench/assets/photo/4256_clutter_lowlight.jpg, docs/bench/assets/photo/4256_clutter_highiso.jpg - Background: palette=
mixedclutter=0.88continuous_canvas=True - Transforms: scale=
{'min': 0.75, 'max': 1.35}rotate={'min': -20, 'max': 20}perspective_enabled=Falseskew_x={'min': -1.0, 'max': 1.0}skew_y={'min': -1.0, 'max': 1.0} - Photometric: brightness=
{'min': -0.2, 'max': 0.2}contrast={'min': 0.7, 'max': 1.4}gamma={'min': 0.8, 'max': 1.3}blur={'min': 0.0, 'max': 2.0}jpeg_quality={'min': 45, 'max': 100}noise_types=gaussian, poisson - Decoys: enabled=
Truecount={'min': 20, 'max': 56}similarity={'min': 0.8, 'max': 0.95}placement=mixed - Occlusion: enabled=
Truecoverage={'min': 0.0, 'max': 0.25} - Expected: positive=
Trueiou_min=0.75area_ratio_max=1.6allow_partial=True
repetitive_grid_camouflage
- Kind:
repetitive_grid - Style:
grid - Target: source=
syntheticsize={'min': 48, 'max': 160}rotation={'min': -15, 'max': 15}assets=none - Background: palette=
grayscaleclutter=0.96continuous_canvas=True - Transforms: scale=
{'min': 0.85, 'max': 1.2}rotate={'min': -15, 'max': 15}perspective_enabled=Falseskew_x={'min': -2.0, 'max': 2.0}skew_y={'min': -1.0, 'max': 1.0} - Photometric: brightness=
{'min': -0.12, 'max': 0.12}contrast={'min': 0.85, 'max': 1.2}gamma={'min': 0.9, 'max': 1.15}blur={'min': 0.0, 'max': 1.0}jpeg_quality={'min': 60, 'max': 100}noise_types=banding - Decoys: enabled=
Truecount={'min': 36, 'max': 120}similarity={'min': 0.9, 'max': 0.99}placement=grid - Occlusion: enabled=
Falsecoverage={'min': 0.0, 'max': 0.0} - Expected: positive=
Trueiou_min=0.85area_ratio_max=1.35allow_partial=False
noise_stress_random
- Kind:
noise_stress - Style:
noise - Target: source=
syntheticsize={'min': 64, 'max': 176}rotation={'min': -45, 'max': 45}assets=none - Background: palette=
grayscaleclutter=0.93continuous_canvas=True - Transforms: scale=
{'min': 0.7, 'max': 1.5}rotate={'min': -30, 'max': 30}perspective_enabled=Falseskew_x={'min': -2.0, 'max': 2.0}skew_y={'min': -2.0, 'max': 2.0} - Photometric: brightness=
{'min': -0.25, 'max': 0.25}contrast={'min': 0.65, 'max': 1.45}gamma={'min': 0.75, 'max': 1.35}blur={'min': 0.0, 'max': 2.2}jpeg_quality={'min': 40, 'max': 95}noise_types=compression_blocks, gaussian, salt_pepper - Decoys: enabled=
Truecount={'min': 24, 'max': 92}similarity={'min': 0.75, 'max': 0.94}placement=random - Occlusion: enabled=
Truecoverage={'min': 0.0, 'max': 0.35} - Expected: positive=
Trueiou_min=0.7area_ratio_max=1.8allow_partial=True
scale_rotate_sweep
- Kind:
scale_rotate - Style:
mixed - Target: source=
mixedsize={'min': 48, 'max': 180}rotation={'min': -180, 'max': 180}assets=none - Background: palette=
mixedclutter=0.82continuous_canvas=True - Transforms: scale=
{'min': 0.4, 'max': 2.2}rotate={'min': -180, 'max': 180}perspective_enabled=Falseskew_x={'min': -4.0, 'max': 4.0}skew_y={'min': -2.0, 'max': 2.0} - Photometric: brightness=
{'min': -0.16, 'max': 0.16}contrast={'min': 0.78, 'max': 1.28}gamma={'min': 0.85, 'max': 1.2}blur={'min': 0.0, 'max': 1.6}jpeg_quality={'min': 55, 'max': 100}noise_types=gaussian - Decoys: enabled=
Truecount={'min': 16, 'max': 44}similarity={'min': 0.8, 'max': 0.96}placement=mixed - Occlusion: enabled=
Truecoverage={'min': 0.0, 'max': 0.2} - Expected: positive=
Trueiou_min=0.68area_ratio_max=2.2allow_partial=True
perspective_skew_sweep
- Kind:
perspective_skew - Style:
mixed - Target: source=
mixedsize={'min': 56, 'max': 176}rotation={'min': -45, 'max': 45}assets=none - Background: palette=
mixedclutter=0.86continuous_canvas=True - Transforms: scale=
{'min': 0.75, 'max': 1.35}rotate={'min': -45, 'max': 45}perspective_enabled=Trueskew_x={'min': -10.0, 'max': 10.0}skew_y={'min': -4.0, 'max': 4.0} - Photometric: brightness=
{'min': -0.14, 'max': 0.14}contrast={'min': 0.8, 'max': 1.3}gamma={'min': 0.84, 'max': 1.24}blur={'min': 0.0, 'max': 1.5}jpeg_quality={'min': 55, 'max': 100}noise_types=compression_blocks - Decoys: enabled=
Truecount={'min': 14, 'max': 42}similarity={'min': 0.78, 'max': 0.95}placement=random - Occlusion: enabled=
Truecoverage={'min': 0.0, 'max': 0.28} - Expected: positive=
Trueiou_min=0.66area_ratio_max=2.4allow_partial=True
orb_feature_rich
- Kind:
orb_feature_rich - Style:
orbtex - Target: source=
syntheticsize={'min': 56, 'max': 176}rotation={'min': -180, 'max': 180}assets=none - Background: palette=
grayscaleclutter=0.9continuous_canvas=True - Transforms: scale=
{'min': 0.65, 'max': 1.7}rotate={'min': -180, 'max': 180}perspective_enabled=Trueskew_x={'min': -8.0, 'max': 8.0}skew_y={'min': -4.0, 'max': 4.0} - Photometric: brightness=
{'min': -0.15, 'max': 0.15}contrast={'min': 0.7, 'max': 1.5}gamma={'min': 0.8, 'max': 1.25}blur={'min': 0.0, 'max': 1.3}jpeg_quality={'min': 45, 'max': 100}noise_types=banding, gaussian - Decoys: enabled=
Truecount={'min': 22, 'max': 84}similarity={'min': 0.72, 'max': 0.93}placement=clustered - Occlusion: enabled=
Truecoverage={'min': 0.0, 'max': 0.18} - Expected: positive=
Trueiou_min=0.64area_ratio_max=2.0allow_partial=True
template_control_exact
- Kind:
template_control - Style:
ui - Target: source=
syntheticsize={'min': 48, 'max': 144}rotation={'min': 0, 'max': 0}assets=none - Background: palette=
ui_darkclutter=0.55continuous_canvas=True - Transforms: scale=
{'min': 1.0, 'max': 1.0}rotate={'min': 0.0, 'max': 0.0}perspective_enabled=Falseskew_x={'min': 0.0, 'max': 0.0}skew_y={'min': 0.0, 'max': 0.0} - Photometric: brightness=
{'min': -0.04, 'max': 0.04}contrast={'min': 0.95, 'max': 1.08}gamma={'min': 0.98, 'max': 1.04}blur={'min': 0.0, 'max': 0.3}jpeg_quality={'min': 95, 'max': 100}noise_types=none - Decoys: enabled=
Truecount={'min': 8, 'max': 24}similarity={'min': 0.85, 'max': 0.95}placement=grid - Occlusion: enabled=
Falsecoverage={'min': 0.0, 'max': 0.0} - Expected: positive=
Trueiou_min=0.95area_ratio_max=1.15allow_partial=False
hybrid_gate_conflicts
- Kind:
hybrid_gate - Style:
mixed - Target: source=
mixedsize={'min': 56, 'max': 176}rotation={'min': -60, 'max': 60}assets=none - Background: palette=
mixedclutter=0.92continuous_canvas=True - Transforms: scale=
{'min': 0.7, 'max': 1.6}rotate={'min': -80, 'max': 80}perspective_enabled=Trueskew_x={'min': -7.0, 'max': 7.0}skew_y={'min': -3.0, 'max': 3.0} - Photometric: brightness=
{'min': -0.2, 'max': 0.2}contrast={'min': 0.75, 'max': 1.35}gamma={'min': 0.82, 'max': 1.22}blur={'min': 0.0, 'max': 1.8}jpeg_quality={'min': 50, 'max': 100}noise_types=compression_blocks, gaussian - Decoys: enabled=
Truecount={'min': 24, 'max': 96}similarity={'min': 0.82, 'max': 0.99}placement=mixed - Occlusion: enabled=
Truecoverage={'min': 0.0, 'max': 0.3} - Expected: positive=
Trueiou_min=0.72area_ratio_max=1.9allow_partial=True - Hybrid Policy:
{'must_consider_all_engines': True, 'select_by': 'score_then_iou', 'fallback_order': ['orb', 'akaze', 'brisk', 'kaze', 'sift', 'template']}
multi_monitor_dpi_shift
- Kind:
multi_monitor_dpi - Style:
mixed - Target: source=
mixedsize={'min': 56, 'max': 176}rotation={'min': -30, 'max': 30}assets=none - Background: palette=
mixedclutter=0.8continuous_canvas=True - Transforms: scale=
{'min': 0.8, 'max': 1.3}rotate={'min': -25, 'max': 25}perspective_enabled=Falseskew_x={'min': -2.0, 'max': 2.0}skew_y={'min': -1.0, 'max': 1.0} - Photometric: brightness=
{'min': -0.1, 'max': 0.1}contrast={'min': 0.82, 'max': 1.18}gamma={'min': 0.9, 'max': 1.18}blur={'min': 0.0, 'max': 1.0}jpeg_quality={'min': 70, 'max': 100}noise_types=compression_blocks - Decoys: enabled=
Truecount={'min': 12, 'max': 36}similarity={'min': 0.82, 'max': 0.95}placement=mixed - Occlusion: enabled=
Falsecoverage={'min': 0.0, 'max': 0.0} - Expected: positive=
Trueiou_min=0.78area_ratio_max=1.5allow_partial=False - Monitor Selector:
{'mode': 'round_robin', 'monitor_ids': ['mon-0', 'mon-1']}
Raw Artifacts
| Artifact | Purpose | Link |
|---|---|---|
| Benchmark Overview | Latest benchmark section root. | Open |
| Detailed E2E Report | Compare strategy against measured results. | Open |
| Strategy JSON | Machine-readable strategy summary. | Open |
| Visual Gallery | Generated screenshots and summary boards. | Open |









