Skip to content
HALOWERK

Formatwerk

warc create

Fetches the page through the HALOWERK fetch layer (public addresses only, redirects checked) after checking robots.txt, then writes WARC 1.1 records: warcinfo (software, format, robots policy), response (status line, headers, payload) with WARC-Block-Digest and WARC-Payload-Digest (sha1, base32), request (reconstructed GET with the headers this client sends) and a metadata record for redirects. Accept-Encoding: identity is requested so payloads are stored as sent; if a server still.

POST https://format.halowerk.com/v1/warc-create

Inputs

Fields of the published input schema
FieldTypeRequiredDescription
urlstringYesPublic http(s) URL to capture.
include_resourcesbooleanNoAlso capture up to four CSS/JS/image resources from the same host.
compressbooleanNoWrite .warc.gz (per-record gzip).
max_bytesintegerNoMaximum payload bytes per response (longer ones are marked WARC-Truncated).
Show full input schema
{
  "type": "object",
  "additionalProperties": false,
  "required": [
    "url"
  ],
  "properties": {
    "url": {
      "type": "string",
      "format": "uri",
      "maxLength": 2000,
      "description": "Public http(s) URL to capture."
    },
    "include_resources": {
      "type": "boolean",
      "default": false,
      "description": "Also capture up to four CSS/JS/image resources from the same host."
    },
    "compress": {
      "type": "boolean",
      "default": true,
      "description": "Write .warc.gz (per-record gzip)."
    },
    "max_bytes": {
      "type": "integer",
      "minimum": 10000,
      "maximum": 5000000,
      "default": 3000000,
      "description": "Maximum payload bytes per response (longer ones are marked WARC-Truncated)."
    }
  }
}

Open original schema

Published input example

{
  "url": "https://halowerk.com/"
}

Result & documentation

Machine-readable documentation of this hub

Source of this page: the published HALOWERK catalog. Updated: 2026-11-17 UTC.

More endpoints in this hub

All endpoints in this hub โ†’