Skip to content
HALOWERK

Textwerk

corpus overlap

Text reuse detection with word shingles (Broder 1997): text and corpus documents are segmented into words (Unicode, NFKC, lower case); every run of n words (default 5) is hashed (32-bit FNV-1a) and compared through a hash index of the text. Matching shingles are chained along diagonals into maximal passages, verified word by word against hash collisions and kept from min_passage_words (default 8) words on; each passage reports start and end offsets in the text and in the document. Per.

POST https://text.halowerk.com/v1/corpus-overlap

Inputs

Fields of the published input schema
FieldTypeRequiredDescription
textstringYes
corpusarrayYes
shingle_wordsintegerNo
min_passage_wordsintegerNo
max_passages_per_documentintegerNo
Show full input schema
{
  "type": "object",
  "additionalProperties": false,
  "required": [
    "text",
    "corpus"
  ],
  "properties": {
    "text": {
      "type": "string",
      "minLength": 1,
      "maxLength": 500000
    },
    "corpus": {
      "type": "array",
      "minItems": 1,
      "maxItems": 500,
      "items": {
        "type": "object",
        "additionalProperties": false,
        "required": [
          "text"
        ],
        "properties": {
          "id": {
            "type": "string",
            "maxLength": 128
          },
          "text": {
            "type": "string",
            "minLength": 1,
            "maxLength": 1000000
          }
        }
      }
    },
    "shingle_words": {
      "type": "integer",
      "minimum": 3,
      "maximum": 12,
      "default": 5
    },
    "min_passage_words": {
      "type": "integer",
      "minimum": 3,
      "maximum": 200,
      "default": 8
    },
    "max_passages_per_document": {
      "type": "integer",
      "minimum": 1,
      "maximum": 200,
      "default": 20
    }
  }
}

Open original schema

Published input example

{
  "text": "Die Datenschutzerklärung erläutert, wie wir personenbezogene Daten verarbeiten und welche Rechte Sie haben.",
  "corpus": [
    {
      "id": "muster",
      "text": "Diese Seite erläutert, wie wir personenbezogene Daten verarbeiten und welche Rechte Sie haben, wenn Sie unseren Dienst nutzen."
    }
  ]
}

Result & documentation

Machine-readable documentation of this hub

Source of this page: the published HALOWERK catalog. Updated: 2026-11-17 UTC.

More endpoints in this hub

All endpoints in this hub →