Skip to content
HALOWERK

Tonwerk

wer benchmark

Texts are normalised (NFKC, optional lower-casing and punctuation removal, whitespace collapsed) and aligned with a word-level Levenshtein alignment (unit costs). WER = (S + D + I) / N with N reference words; MER = (S + D + I) / (H + S + D + I); WIP = (H / N) · (H / P) with P hypothesis words; WIL = 1 − WIP (Morris, Maier and Green 2004, as in jiwer). CER is the character Levenshtein distance over the normalised texts including spaces, divided by the reference length. For a corpus the counts.

POST https://ton.halowerk.com/v1/wer-benchmark

Inputs

Fields of the published input schema
FieldTypeRequiredDescription
referencestringNoReference (ground-truth) transcript.
hypothesisstringNoTranscript to score.
pairsarrayNoAlternative: a corpus of reference/hypothesis pairs (at most 50000 characters in total).
lowercasebooleanNo
remove_punctuationbooleanNo
include_alignmentbooleanNoReturn the word alignment (single pair only, at most 500 operations).
Show full input schema
{
  "type": "object",
  "additionalProperties": false,
  "properties": {
    "reference": {
      "type": "string",
      "minLength": 1,
      "maxLength": 10000,
      "description": "Reference (ground-truth) transcript."
    },
    "hypothesis": {
      "type": "string",
      "maxLength": 10000,
      "description": "Transcript to score."
    },
    "pairs": {
      "type": "array",
      "minItems": 1,
      "maxItems": 100,
      "items": {
        "type": "object",
        "additionalProperties": false,
        "required": [
          "reference",
          "hypothesis"
        ],
        "properties": {
          "id": {
            "type": "string",
            "maxLength": 64
          },
          "reference": {
            "type": "string",
            "minLength": 1,
            "maxLength": 10000
          },
          "hypothesis": {
            "type": "string",
            "maxLength": 10000
          }
        }
      },
      "description": "Alternative: a corpus of reference/hypothesis pairs (at most 50000 characters in total)."
    },
    "lowercase": {
      "type": "boolean",
      "default": true
    },
    "remove_punctuation": {
      "type": "boolean",
      "default": true
    },
    "include_alignment": {
      "type": "boolean",
      "default": false,
      "description": "Return the word alignment (single pair only, at most 500 operations)."
    }
  }
}

Open original schema

Published input example

{
  "reference": "the cat sat on the mat",
  "hypothesis": "the cat sit on mat"
}

Result & documentation

Machine-readable documentation of this hub

Source of this page: the published HALOWERK catalog. Updated: 2026-11-17 UTC.

More endpoints in this hub

All endpoints in this hub →