Announcing our $14.5M Series A!
Read the blog post

Support for tracking users and sessions, test tags, and more

 Support for tracking users and sessions, test tags, and more

In addition to traces, you can now track users and sessions in the Openlayer app. See the full session and record history for each user to better understand your system behavior. Head to the Data section in Openlayer today to set it up!

We’ve also improved our test page by adding tags to help you browse tests related to particular outcomes, such as agentic systems, safety, data drift, and even governance frameworks like the EU AI Act. We’ve also added support for creating your own custom tags to help you track and organize the tests you create.

Features

  • API
    Support for user-defined tags on tests and filtering based on these tags
  • API
    Support for batch LLM calls
  • API
    User sessions support for tracking traces
  • SDKs
    LiteLLM support
  • SDKs
    Guardrail system for Openlayer tracing to redact PII

Improvements

  • On-Prem
    AWS Signature version can be now set using the environment variable AWS_SIGNATURE_VERSION
  • API
    Version goals can now be filtered by whether they use validation or training datasets
  • On-Prem
    Openlayer is now compatible with the base Redis image for versions 8.2.1+
  • On-Prem
    Custom schema support for Postgres table connected to Openlayer
  • SDKs
    Python 3.13 support
  • SDKs
    Comprehensive extraction and multi-agent LangGraph workflow support
  • Docs
    Documentation additions around Databricks integration, Snowflake integration, Data Quality Monitoring, access groups, LiteLLM, guardrails, OpenAI Agents SDK integration, Bedrock integration, sessions, tests
  • Docs
    Documentation improvements around development/monitoring mode, observability, tracing, API key creation, project creation
  • Website
    Updated privacy policy
  • Website
    Added cookie policy page as well as banner

Fixes

  • UI/UX
    Fixed an issue around the data table edit view not expanding properly
  • UI/UX
    Fixed an issue where tests did not appear when there was no completed project version
$ openlayer push

Stop guessing. Ship with confidence.

The automated AI evaluation and monitoring platform.

We value your privacy

We use cookies to enhance your browsing experience, serve personalized content, and analyze our traffic.