Skip to content
HALOWERK

Researchwerk

evaluation annotator span alignment

Return greedy span overlap matches and label disagreements.

POST https://research.halowerk.com/v1/evaluation-annotator-span-alignment

Inputs

Fields of the published input schema
FieldTypeRequiredDescription
leftReferenceYes
rightReferenceYes
min_iounumberYes
Show full input schema
{
  "type": "object",
  "properties": {
    "left": {
      "$ref": "#/$defs/s0"
    },
    "right": {
      "$ref": "#/$defs/s0"
    },
    "min_iou": {
      "type": "number",
      "minimum": 0,
      "maximum": 1
    }
  },
  "required": [
    "left",
    "right",
    "min_iou"
  ],
  "additionalProperties": false,
  "$id": "urn:halowerk:w2:J3:input",
  "$defs": {
    "s0": {
      "type": "array",
      "items": {
        "$ref": "#/$defs/s1"
      },
      "maxItems": 50,
      "minItems": 0
    },
    "s1": {
      "type": "object",
      "properties": {
        "start": {
          "$ref": "#/$defs/s2"
        },
        "end": {
          "$ref": "#/$defs/s2"
        },
        "label": {
          "type": "string",
          "maxLength": 64,
          "minLength": 1
        }
      },
      "required": [
        "start",
        "end",
        "label"
      ],
      "additionalProperties": false
    },
    "s2": {
      "type": "integer",
      "minimum": 0,
      "maximum": 100000
    }
  }
}

Open original schema

Published input example

{
  "left": [
    {
      "start": 0,
      "end": 10,
      "label": "org"
    },
    {
      "start": 20,
      "end": 30,
      "label": "place"
    }
  ],
  "right": [
    {
      "start": 0,
      "end": 8,
      "label": "org"
    },
    {
      "start": 20,
      "end": 30,
      "label": "org"
    }
  ],
  "min_iou": 0.5
}

Result & documentation

Machine-readable documentation of this hub

Source of this page: the published HALOWERK catalog. Updated: 2026-11-18 UTC.

More endpoints in this hub

All endpoints in this hub โ†’