Answers
Answers
Short answers for an agent that is about to call Screwtape.ai. Each page answers one question in the first sentence.
- How do I verify an AI agent's output before returning it? — Send the task, the output and your evidence to a judge and branch on its verdict before you return anything. With Screwtape.ai that's one POST /v1/judge call.
- How do I detect false consensus in multi-agent voting? — False-consensus check: score how your agents agree, not just whether they agree. POST /v1/consensus returns false_consensus_risk low, medium or high for 2 to 16 answers.
- Is there an LLM-as-judge API with pay-per-call pricing? — Yes. Screwtape.ai's /v1/judge can be paid per call with x402 at $0.005 USDC on Base or Solana, with no account. Free keys get 100 calls per UTC day.
- What is an x402 judge API and how do I call one? — An x402 judge API answers unpaid requests with HTTP 402 and payment terms, then grades the agent output once the call is paid. Screwtape.ai charges $0.005 USDC on Base or Solana.
- How do I use a pass/retry/fail verdict in an agent loop? — Accept on pass, feed the judge's reasons back and retry on retry (with a cap), and stop on fail. Screwtape.ai's /v1/judge returns exactly these three verdicts.
- How can an AI agent get its own free API key? — POST /v1/signup with a 12-bit SHA-256 proof of work. Email and name are optional, no human approval is needed, and the key gives 100 calls per UTC day.
- How do I check an agent's answer against the source evidence? — Pass the retrieved passages as evidence to POST /v1/judge. The verdict and reasons say whether the output's claims are grounded in them.
- Is there an MCP tool that verifies an agent's answers? — Yes. Screwtape.ai's MCP server at https://screwtape.ai/mcp (Streamable HTTP) has judge and consensus tools, plus get_api_key. Registry name ai.screwtape/screwtape.
- Can I try an LLM judge API without signing up? — Yes. https://screwtape.ai/try/ runs judge and consensus in the browser: 3 calls per token (about 30 minutes) and 3 demo calls per network per UTC day.
- What's the difference between agreement_score and false_consensus_risk? — agreement_score measures how much the answers agree. false_consensus_risk says whether that agreement looks independent (low) or copied or thin (medium or high).
- What does engine mean in a Screwtape.ai verdict? — engine tells you what produced the verdict: llm (the configured model), deterministic (string checks, no model), or demo (the /try/ page).
- Does Screwtape.ai store the outputs I send it? — No, not unless you send retain: true with an API key. Retained calls expire after 24 hours and can be listed and deleted.
- What do 400, 401, 402 and 429 mean from the Screwtape.ai API? — 400 invalid request, 401 key not recognized, 402 payment required (send a key or pay with x402), 429 daily quota or rate limit.
- How do I validate several agents' answers before merging them? — Score the answers with POST /v1/consensus, then judge the consensus answer against evidence with POST /v1/judge. Accept only on low risk and a pass.