Skip to content
HALOWERK

Modellwerk

llm token byte boundaries

Return token boundary splits inside UTF8 characters and byte-coverage gaps for supplied offsets. Supplied data only; no model call or provider request.

POST https://modell.halowerk.com/v1/llm-token-byte-boundaries

Inputs

Fields of the published input schema
FieldTypeRequiredDescription
textstringYes
spansarrayYes
Show full input schema
{
  "type": "object",
  "properties": {
    "text": {
      "type": "string",
      "maxLength": 1024
    },
    "spans": {
      "type": "array",
      "items": {
        "type": "array",
        "items": {
          "type": "integer",
          "minimum": 0,
          "maximum": 8192
        },
        "maxItems": 2,
        "minItems": 2
      },
      "maxItems": 100,
      "minItems": 1
    }
  },
  "required": [
    "text",
    "spans"
  ],
  "additionalProperties": false
}

Open original schema

Published input example

{
  "text": "Preis €",
  "spans": [
    [
      0,
      6
    ],
    [
      6,
      9
    ]
  ]
}

Result & documentation

Machine-readable documentation of this hub

Source of this page: the published HALOWERK catalog. Updated: 2026-11-18 UTC.

More endpoints in this hub

All endpoints in this hub →