Aialignwerk
eval ordinal quadratic kappa
Return quadratic-weighted Cohen kappa and observed/expected disagreement from supplied ordinal ratings.
POST https://aialign.halowerk.com/v1/eval-ordinal-quadratic-kappaInputs
| Field | Type | Required | Description |
|---|---|---|---|
| levels | integer | Yes | |
| ratings | array | Yes |
Show full input schema
{
"type": "object",
"properties": {
"levels": {
"type": "integer",
"minimum": 2,
"maximum": 20
},
"ratings": {
"type": "array",
"items": {
"type": "object",
"properties": {
"first": {
"type": "integer",
"minimum": 0,
"maximum": 19
},
"second": {
"type": "integer",
"minimum": 0,
"maximum": 19
}
},
"required": [
"first",
"second"
],
"additionalProperties": false
},
"maxItems": 1000,
"minItems": 1
}
},
"required": [
"levels",
"ratings"
],
"additionalProperties": false
}Published input example
{
"levels": 3,
"ratings": [
{
"first": 0,
"second": 0
},
{
"first": 1,
"second": 1
},
{
"first": 2,
"second": 2
}
]
}Result & documentation
Machine-readable documentation of this hub
Source of this page: the published HALOWERK catalog. Updated: 2026-11-18 UTC.
More endpoints in this hub
- Aialignwerk0.005 USDC
agent collusion
POSThttps://aialign.halowerk.com/v1/agent-collusionRequires the same agents in each supplied round, computes each pair’s observed action agreement, expected agreement from marginal action frequencies and chance-corrected kappa, then flags high positive agreement against a supplied threshold
- Aialignwerk0.004 USDC
bias audit
POSThttps://aialign.halowerk.com/v1/bias-auditCalculates each group positive-outcome rate, compares it with an explicit or automatically selected reference group, and reports rate differences and selection-rate ratios. Aggregate disparity metrics do not establish discrimination, fairne
- Aialignwerk0.003 USDC
capability eval
POSThttps://aialign.halowerk.com/v1/capability-evalComputes weighted pass rates and weighted scores from caller-labeled test outcomes, with deterministic category summaries. It does not run tests, validate labels, measure untested capabilities or establish deployment safety; the result is o