Skip to content
HALOWERK

Bildwerk

ui element map

Classical computer vision without a learned model, in a resource-limited child process: the background colour comes from a colour histogram, flat-coloured regions are labelled by flood fill (tolerance 10 per channel) and kept when their rows and columns span the bounding box (rectangles, rounded rectangles, frames); frames are merged with their interior. Text comes from Tesseract 5.3.4 (psm 11, sparse text; screenshot upscaled 2× when small) grouped into lines per container. Busy 16-px cells.

POST https://bild.halowerk.com/v1/ui-element-map

Inputs

Fields of the published input schema
FieldTypeRequiredDescription
image_base64stringNoThe screenshot (PNG, JPEG, WebP, GIF, TIFF or AVIF) as base64 or data: URL. Give either image_base64 or image_url.
image_urlstringNoPublic http(s) URL of the screenshot (PNG, JPEG, WebP, GIF, TIFF or AVIF), fetched once (at most 10 MB). Private and local addresses are refused.
languagestringNoTesseract language(s) for the text in the screenshot.
min_confidenceintegerNoMinimum Tesseract word confidence (0–100).
max_elementsintegerNo
Show full input schema
{
  "type": "object",
  "additionalProperties": false,
  "properties": {
    "image_base64": {
      "type": "string",
      "minLength": 16,
      "maxLength": 8000000,
      "description": "The screenshot (PNG, JPEG, WebP, GIF, TIFF or AVIF) as base64 or data: URL. Give either image_base64 or image_url."
    },
    "image_url": {
      "type": "string",
      "format": "uri",
      "maxLength": 2048,
      "description": "Public http(s) URL of the screenshot (PNG, JPEG, WebP, GIF, TIFF or AVIF), fetched once (at most 10 MB). Private and local addresses are refused."
    },
    "language": {
      "type": "string",
      "enum": [
        "eng",
        "deu",
        "eng+deu"
      ],
      "default": "eng",
      "description": "Tesseract language(s) for the text in the screenshot."
    },
    "min_confidence": {
      "type": "integer",
      "minimum": 0,
      "maximum": 95,
      "default": 40,
      "description": "Minimum Tesseract word confidence (0–100)."
    },
    "max_elements": {
      "type": "integer",
      "minimum": 1,
      "maximum": 1000,
      "default": 300
    }
  }
}

Open original schema

Published input example

{
  "image_base64": "iVBORw0KGgoAAAANSUhEUgAAAMgAAABACAYAAABfuzgrAAACz0lEQVR4nO3aMWpUURTG8azjrcAduAJX4A5cgWAb7CzT2lik1c5O0lrYWGppJQiKEoloUBSffA+P3Lm+HIbhmOt8+f/gkGTmzSQM95933yQHM4ALHYz+AYD/GYEACQIBEgQCJAgESBAIkCAQIEEgQIJAgASBAAkCARLlgUx33jIDB7UIxGxQi0DMBrUIxGxQi0DMBrUIxGxQi0DMBrUIxGxQi0DMBrUIxGxQi0DMBrUIxGxQi0DMBrUIxGxQyy6Q6/fezzfvny4fR3zvo5PPyxCIB4tArh2+mx89P5/Pzn9u/Cz6+jIXq8Ic+ToQSD2LQBTH3AShidvk9sMzAsFOLAIJt44/btz+4OmX+dmrb3+dRbSQI6S7jz8tZ6C4L7ZJEZXuXztu6rZUOp5A/FgFss12qj3bvHzzfflcH2PxxyJXWJqWjmvj6Ld08XyjXgcCqWcRiM4UQYv2yYuvy2/8G0cfNo6Lxf/69MefIBSVKJz2GD1P3KazQ9D9bWhtXPq+I18HAqlnEUgsdC38ns4CEUqEpEWtha6Jxa/HTt11RLulirNFBBJfK8Q4Rlu80a8DatkEEqOtjxZq+66WItF9/ZZp7We/6DoiHhuBhPg6eyyB7C+bQPrt1LTyGz22QPoYZ5B2CAS9vQ9EW5z59zVD/y5TH0gc215s6zG7BBIX5Nq2xTFxPTPidSCQf2PvA9ECj2uPuLDWQm0vmGMRt+886TYt9lj4ccy2gUQM8bcXxde+q0UgHvY+kKn5S3pP4fRv/Wor1l/Mt2eBbQOZunet9JxcpPuxCKSd+F+sfru1FtXadcsucY74vy8CuRx2gVz1QS0CMRvUIhCzQS0CMRvUIhCzQS0CMRvUIhCzQS0CMRvUIhCzQS0CMRvUIhCzQS0CMRvUIhCzQa3yQAAnBAIkCARIEAiQIBAgQSBAgkCABIEACQIBEgQCJAgESBAIkPgF575rvJbS+LgAAAAASUVORK5CYII=",
  "language": "eng"
}

Result & documentation

Machine-readable documentation of this hub

Source of this page: the published HALOWERK catalog. Updated: 2026-11-17 UTC.

More endpoints in this hub

All endpoints in this hub →