Support for tracking users and sessions, test tags, and more
In addition to traces, you can now track users and sessions in the Openlayer app. See the full session and record history for each user to better understand your system behavior. Head to the Data section in Openlayer today to set it up!
We’ve also improved our test page by adding tags to help you browse tests related to particular outcomes, such as agentic systems, safety, data drift, and even governance frameworks like the EU AI Act. We’ve also added support for creating your own custom tags to help you track and organize the tests you create.
Features
- API. Support for user-defined tags on tests and filtering based on these tags
- API. Support for batch LLM calls
- API. User sessions support for tracking traces
- SDKs. LiteLLM support
- SDKs. Guardrail system for Openlayer tracing to redact PII
Improvements
- On-Prem. AWS Signature version can be now set using the environment variable AWS_SIGNATURE_VERSION
- API. Version goals can now be filtered by whether they use validation or training datasets
- On-Prem. Openlayer is now compatible with the base Redis image for versions 8.2.1+
- On-Prem. Custom schema support for Postgres table connected to Openlayer
- SDKs. Python 3.13 support
- SDKs. Comprehensive extraction and multi-agent LangGraph workflow support
- Docs. Documentation additions around Databricks integration, Snowflake integration, Data Quality Monitoring, access groups, LiteLLM, guardrails, OpenAI Agents SDK integration, Bedrock integration, sessions, tests
- Docs. Documentation improvements around development/monitoring mode, observability, tracing, API key creation, project creation
- Website. Updated privacy policy
- Website. Added cookie policy page as well as banner
Fixes
- UI/UX. Fixed an issue around the data table edit view not expanding properly
- UI/UX. Fixed an issue where tests did not appear when there was no completed project version
