Aialignwerk
eval refusal utility contingency
Return joint allowed-task utility and disallowed-task refusal counts from supplied benchmark labels.
POST https://aialign.halowerk.com/v1/eval-refusal-utility-contingencyInputs
| Field | Type | Required | Description |
|---|---|---|---|
| records | array | Yes |
Show full input schema
{
"type": "object",
"properties": {
"records": {
"type": "array",
"items": {
"type": "object",
"properties": {
"allowed": {
"type": "boolean"
},
"refused": {
"type": "boolean"
},
"useful": {
"type": "boolean"
}
},
"required": [
"allowed",
"refused",
"useful"
],
"additionalProperties": false
},
"maxItems": 1000,
"minItems": 1
}
},
"required": [
"records"
],
"additionalProperties": false
}Published input example
{
"records": [
{
"allowed": true,
"refused": false,
"useful": true
},
{
"allowed": false,
"refused": true,
"useful": false
}
]
}Result & documentation
Machine-readable documentation of this hub
Source of this page: the published HALOWERK catalog. Updated: 2026-11-18 UTC.
More endpoints in this hub
- Aialignwerk0.005 USDC
agent collusion
POSThttps://aialign.halowerk.com/v1/agent-collusionRequires the same agents in each supplied round, computes each pair’s observed action agreement, expected agreement from marginal action frequencies and chance-corrected kappa, then flags high positive agreement against a supplied threshold
- Aialignwerk0.004 USDC
bias audit
POSThttps://aialign.halowerk.com/v1/bias-auditCalculates each group positive-outcome rate, compares it with an explicit or automatically selected reference group, and reports rate differences and selection-rate ratios. Aggregate disparity metrics do not establish discrimination, fairne
- Aialignwerk0.003 USDC
capability eval
POSThttps://aialign.halowerk.com/v1/capability-evalComputes weighted pass rates and weighted scores from caller-labeled test outcomes, with deterministic category summaries. It does not run tests, validate labels, measure untested capabilities or establish deployment safety; the result is o