We’re thrilled to announce a new and improved onboarding flow, designed to make your start with us even smoother. We’ve also completely redesigned the app navigation, making it more intuitive than ever.
You can now use several new consistency and integrity goals — fine-grained feature & label drift, dataset size-ratios, new category checks and more. These are described in more detail below.
You’ll also notice a range of improvements — new Slack and email notifications for monitoring projects, enhanced dark mode colors and improved transactional email deliverability. We’ve reorganized several features for ease of use, including the subpopulation filter flow and the performance goal page layout.
If you’re working in dev mode, check out the dedicated commit page where you can view all the commit’s metadata and download your models and data to use locally.
Stay tuned for more updates and join our Discord community to be a part of our ongoing development journey. 🚀👥
Features
•UI/UXNew and improved onboarding for monitoring mode
•UI/UXRedesigned app navigation
•EvalsNew goals (Column drift (consistency) — choose specific columns and specific test types to measure drift in production, Column values match (consistency) — specify a cohort that must have matching values for a set of features in both production and reference data, New categories (consistency) — check for new categories present for features in your production data, Size-ratio (consistency) — specify a required size ratio between your datasets, Character length (integrity) — enforce character limits on your text-based columns, Ill-formed rows for LLMs (integrity) — check that your input and output columns don’t contain ill-formed text)
•UI/UXDedicated commit page to view all commit metadata and download artifacts
Improvements
•IntegrationsUpdated Slack, email notifications in monitoring mode
•UI/UXColor improvements for dark mode
•UI/UXText no longer resets when toggling between block types in prompt playground
•UI/UXText highlight color is now standard blue for browsers
