Guardrails AI

Type: company (open-source-led LLM guardrails / agent reliability vendor; acquired by Harvey) Sector: GenAI/LLM safety — runtime guardrails (validators), Guardrails Hub, Snowglobe agent simulation First seen: 2026-07 (watchlist mentions in scan notes) Last updated: 2026-09-10

Created 2026-09-10 from S-2026-09-09-harvey-acquires-guardrails-ai and S-2026-07-06-guardrails-hub-sunset-issue (daily AI-governance vendor-intelligence scan). Guardrails AI had appeared in prior scan notes only as a watchlist vendor with no in-window news; the July sunset notice and the 9 Sep acquisition are its first dated events in this vault.

Snapshot

Guardrails AI (San Francisco; co-founders Shreya Rajpal and Zayd Simjee) built an open-source guardrails framework for LLM applications — validators that detect policy violations, hallucinations and data leakage and can block outputs — distributed since 2024 via the Guardrails Hub, plus Snowglobe, a simulation environment in which synthetic users stress-test agent behaviour before release; Harvey describes the framework as downloaded 250,000+ times a month (vendor claim) [S-2026-09-09-harvey-acquires-guardrails-ai]. In July 2026 it announced the shutdown of the Hub installer, its private validator registry and its free hosted validator-inference servers, moving validators to plain PyPI packages [S-2026-07-06-guardrails-hub-sunset-issue]. On 9 September 2026 it was acquired by legal-AI platform Harvey, with the founders and team joining Harvey to work on Harvey’s own agents; no terms, and no statement on the future of the open-source framework or existing customers [S-2026-09-09-harvey-acquires-guardrails-ai]. It matters to this wiki as the second watchlist guardrail vendor (after Lakera) whose open-source/hosted assets were wound down around a change of control.

Positions / Claims they advance

  • “The hard part of shipping AI isn’t building the system, it’s knowing how it behaves on the inputs nobody thought to test” — positioning guardrails plus simulation as pre- and post-deployment agent-behaviour control [S-2026-09-09-harvey-acquires-guardrails-ai].
  • Hub validators were curated “albeit without guarantees”; hosted inference was free since 2024 and costly to run — the company’s own stated reasons for the sunset [S-2026-07-06-guardrails-hub-sunset-issue].
  • Investors: Zetta Venture Partners, Bloomberg Beta, Pear VC, Factory, Microsoft [S-2026-09-09-harvey-acquires-guardrails-ai].

Relationships

  • part-of → Harvey — acquired 9 Sep 2026 (Harvey’s fourth 2026 acquisition; Harvey has no vault page yet) [S-2026-09-09-harvey-acquires-guardrails-ai].
  • competes-with → Lakera — both GenAI guardrail watchlist vendors; both now absorbed by acquirers with OSS assets wound down or at risk [S-2026-09-09-harvey-acquires-guardrails-ai][S-2026-08-06-lakera-github-archived][inference].
  • relates-to → AI Governance Platforms — supplies the guardrail-vendor consolidation and OSS-dependency signal tracked there [S-2026-09-09-harvey-acquires-guardrails-ai].
  • relates-to → Vendor Lifecycle Events as Evidence-Continuity Risk — fifth named instance (hosted-service withdrawal + change of control) [S-2026-07-06-guardrails-hub-sunset-issue][S-2026-09-09-harvey-acquires-guardrails-ai].

Tracked changes

  • 2026-07-06 — GitHub issue #1560 announces migration of validators to public PyPI and shutdown of guardrails hub install, the private registry and hosted remote inference, hard cutoff stated as 6 Aug 2026 [S-2026-07-06-guardrails-hub-sunset-issue].
  • 2026-08 (6 or 25 Aug ⚠️ contested) — Hub / registry / hosted-inference shutdown per the notice; execution not independently confirmed [S-2026-07-06-guardrails-hub-sunset-issue][S-2026-09-09-harvey-acquires-guardrails-ai].
  • 2026-09-09 — Acquired by Harvey; founders and team join Harvey’s product and engineering organisation; no terms disclosed [S-2026-09-09-harvey-acquires-guardrails-ai].

Open Questions

  • Will the open-source framework and PyPI validator packages be maintained under Harvey, or archived as Lakera’s were? [S-2026-09-09-harvey-acquires-guardrails-ai]
  • Which regulated firms (if any) embedded Guardrails validators or the hosted inference endpoint in production GenAI controls, and what is their migration path? [S-2026-07-06-guardrails-hub-sunset-issue][inference]
  • Will Snowglobe survive as a product available outside Harvey? — unstated [S-2026-09-09-harvey-acquires-guardrails-ai].

Sources