Announcing our $14.5M Series A!
Read the blog post

Batch test re-runs and expanded integrations

Batch test re-runs and expanded integrations

We now support re-running tests in batch on Openlayer, so that you can recalculate results when new data is added retroactively. In addition, we’ve added a ton of new integrations – Ruby and Strands Agents SDKs, Gemini API and Copilot Studio integrations, and more – so that Openlayer fits in seamlessly with the workflows you’re already running. As always, we’ve made continuous improvements to the UI and docs, so your experience will be even smoother. Read the full list below.

Features

  • Platform
    Automatic threshold support for tests based on custom metrics
  • SDKs
    Openlayer Ruby SDK
  • Platform
    Custom time range selection for test execution
  • Platform
    Manual test re-runs
  • Platform
    New primary key uniqueness constraint test
  • Integrations
    Strands Agents SDK integration
  • Integrations
    Microsoft Copilot Studio integration
  • Integrations
    Google Gemini API integration
  • API
    API endpoints for retrieving test results and managing projects

Improvements

  • UI/UX
    Clearer trace visualizations
  • Platform
    More informative skipped test messages
  • Platform
    More reliable OpenTelemetry support
  • UI/UX
    Smoother Snowflake connection flow with support for views
  • Platform
    Simplified Databricks onboarding flow
  • Platform
    More robust directory sync configuration
  • Platform
    Better session and user tracking for GenAI projects
  • UI/UX
    Redesigned monitoring test results graph
  • Platform
    Characteristic Stability Index (CSI) as a drift detection method

Fixes

  • UI/UX
    Evidence type selection fixed when creating governance rules
  • Platform
    User email matching is no longer case-sensitive
  • SDKs
    Step detection in LangChain integration
  • SDKs
    Model output capture in Google ADK integration
  • SDKs
    Duplicate trace steps in LiteLLM tracer
$ openlayer push

Stop guessing. Ship with confidence.

The AI governance and observability platform

We value your privacy

We use cookies to enhance your browsing experience, serve personalized content, and analyze our traffic.