Enhanced onboarding, redesigned navigation, and new goals
We’re thrilled to announce a new and improved onboarding flow, designed to make your start with us even smoother. We’ve also completely redesigned the app navigation, making it more intuitive than ever.
You can now use several new consistency and integrity goals — fine-grained feature & label drift, dataset size-ratios, new category checks and more. These are described in more detail below.
You’ll also notice a range of improvements — new Slack and email notifications for monitoring projects, enhanced dark mode colors and improved transactional email deliverability. We’ve reorganized several features for ease of use, including the subpopulation filter flow and the performance goal page layout.
If you’re working in dev mode, check out the dedicated commit page where you can view all the commit’s metadata and download your models and data to use locally.
Stay tuned for more updates and join our Discord community to be a part of our ongoing development journey. 🚀👥
Features
- UI/UXNew and improved onboarding for monitoring mode
- UI/UXRedesigned app navigation
- EvalsNew goals (Column drift (consistency) — choose specific columns and specific test types to measure drift in production, Column values match (consistency) — specify a cohort that must have matching values for a set of features in both production and reference data, New categories (consistency) — check for new categories present for features in your production data, Size-ratio (consistency) — specify a required size ratio between your datasets, Character length (integrity) — enforce character limits on your text-based columns, Ill-formed rows for LLMs (integrity) — check that your input and output columns don’t contain ill-formed text)
- UI/UXDedicated commit page to view all commit metadata and download artifacts
Improvements
- IntegrationsUpdated Slack, email notifications in monitoring mode
- UI/UXColor improvements for dark mode
- UI/UXText no longer resets when toggling between block types in prompt playground
- UI/UXText highlight color is now standard blue for browsers
- PlatformBetter transactional email deliverability
- UI/UXNavigate to notification settings directly from the notifications modal
- UI/UXImproved readability of prompt block content
- PerformanceVolume graphs in monitoring mode are more real-time
- CollaborationYou may now invite team members in the workspace dropdown
- UI/UXReorganized subpopulation filter flow
- UI/UXReorganized create performance goal page layout
- UI/UXImproved multi-select for subpopulation filters
- UI/UXRequesting an upgrade in-app now opens a new tab
- PlatformYou can now specify arbitrary column names in goal thresholds and subpopulation filters
Fixes
- UI/UXBack navigation didn’t maintain project mode
- PerformanceResidual plots were missing cohorts in performance diagnosis page
- UI/UXNull metric values would cause all metrics to appear empty
- UI/UXSample projects missing “sample” tag in projects page
- UI/UXIcon for comment in the activity log was incorrect
- UI/UXMetrics table was busted when missing subpopulation information
- PerformancePerformance and diagnostics page would freeze when using 1000s of classes
- UI/UXAggregate metrics would sometimes get cut off
- UI/UXFiltering project page by LLMs or tabular-regression would not work
- APIApp links returned by client API now navigate to the correct project mode
- PlatformAuto-conversion of input variables with spaces to underscores for inference
