Skip to content
HALOWERK

Modellwerk

tensor kv cache slot occupancy

Return physical KV-block sharing and unused token slots from a supplied sequence-to-block assignment.

POST https://modell.halowerk.com/v1/tensor-kv-cache-slot-occupancy

Inputs

Fields of the published input schema
FieldTypeRequiredDescription
block_tokensintegerYes
capacity_blocksintegerYes
sequencesarrayYes
Show full input schema
{
  "type": "object",
  "properties": {
    "block_tokens": {
      "type": "integer",
      "minimum": 1,
      "maximum": 1024
    },
    "capacity_blocks": {
      "type": "integer",
      "minimum": 1,
      "maximum": 1000000
    },
    "sequences": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "id": {
            "type": "string",
            "maxLength": 64,
            "minLength": 1
          },
          "tokens": {
            "type": "integer",
            "minimum": 0,
            "maximum": 1000000
          },
          "blocks": {
            "type": "array",
            "items": {
              "type": "integer",
              "minimum": 0,
              "maximum": 1000000
            },
            "maxItems": 1000,
            "minItems": 0
          }
        },
        "required": [
          "id",
          "tokens",
          "blocks"
        ],
        "additionalProperties": false
      },
      "maxItems": 100,
      "minItems": 0
    }
  },
  "required": [
    "block_tokens",
    "capacity_blocks",
    "sequences"
  ],
  "additionalProperties": false
}

Open original schema

Published input example

{
  "block_tokens": 4,
  "capacity_blocks": 10,
  "sequences": [
    {
      "id": "seq_A",
      "tokens": 5,
      "blocks": [
        0,
        1
      ]
    },
    {
      "id": "seq_B",
      "tokens": 4,
      "blocks": [
        0
      ]
    }
  ]
}

Result & documentation

Machine-readable documentation of this hub

Source of this page: the published HALOWERK catalog. Updated: 2026-11-18 UTC.

More endpoints in this hub

All endpoints in this hub โ†’