Giskard

EvaluationApache-2.0

Giskard tests LLM agents with checks, LLM judges and a scan for vulnerabilities and quality problems. Giskard publishes it as an open-source Python library, so the tests run inside the developer's own code and pipelines.

The README splits the project into installable parts: checks together with agents, llm and core parts, a scan extra, plus provider extras for model judges. The GitHub repository record is now named giskard-oss.

Pinout

  • MCP server: not checked yet
  • HTTP API: not checked yet
  • command line: not checked yet
  • Python SDK: supported, verified
  • TypeScript SDK: not checked yet
  • OpenAPI description: not checked yet
Where each pin comes from
InterfaceStatusSource we readRead on
MCP serverNot checked yet——
HTTP APINot checked yet——
Command lineNot checked yet——
Python SDKSupported, verifiedREADME, install (pip install giskard)
TypeScript SDKNot checked yet——
OpenAPI descriptionNot checked yet——

Facts

Facts about Giskard
LicenseApache-2.0. GitHub API, repository license field, read .
Main languagePython (as detected by GitHub). GitHub API, repository record, read .
PublisherGiskard-AI (GitHub organization). GitHub API, repository record, read .
Latest GitHub releasegiskard-agents/v1.0.6, published 2026-10-25. GitHub API, latest release, read .
Install extrasgiskard, giskard[scan], giskard[openai], giskard-checks. README in the repository, read .
License (README badge)Apache 2.0. README in the repository, read .
OfferingsGiskard Hub (UI and SDK) and Giskard Open Source (Python library). Giskard documentation, overview, read .
ScanNot installed by default; added with the scan extra (pip install "giskard[scan]"). Giskard documentation, overview, read .
Hub on-premiseOffered for mission-critical workloads in the public sector, per the FAQ of the home page. Giskard home page, FAQ, read .
Compliance stated by the vendorGDPR, SOC 2 Type II and HIPAA, as stated on the home page. Giskard home page, Compliance & Security, read .
Last commit. GitHub API, latest commit on the default branch of Giskard-AI/giskard-oss, read .

Limits

  • Judge-based checks such as groundedness call a model provider, so a provider extra and its API key are needed, per the README.

Strengths

  • Checks, scan and provider support are separate extras, so only the parts in use get installed.

Alternatives to Giskard

All evaluation tools for agents
  1. Open-core platform to trace, test and evaluate agents and coding assistants.

    Evaluation
  2. Framework for evaluating, testing and monitoring ML and LLM systems.

    Evaluation
  3. Framework for LLM evaluations from the UK AI Security Institute.

    Evaluation
  4. Command line tool and library to evaluate and red-team LLM apps and agents.

    Evaluation

Last check: . Method: public repository and docs read automatically, page and day written down. Next check due within 90 days. How we check

Is this your tool? Write to hello@agent-tools.directory from an address on its domain to correct a pin or a fact.