We are thrilled to release the first edition of our company’s changelog, marking an exciting new chapter in our journey. We strive for transparency and constant improvement, and this changelog will serve as a comprehensive record of all the noteworthy updates, enhancements, and fixes that we are constantly shipping. With these releases, we aim to foster a tighter collaboration with all our amazing users, ensuring you are up to date on the progress we make and exciting features we introduce. So without further ado, let’s dive into the new stuff!
Features
•SecurityEnabled SSO (single sign-on) with Google
•TemplatesAdded sample projects to all workspaces
•CollaborationAdded support for mentioning users, goals, and commits in goal comments and descriptions — type @ to mention another user in your workspace, or # to mention a goal or commit
•Model uploadAdded the ability to upload “shell” models (just the predictions on a dataset) without the model binary (required for explainability, robustness, and text classification fairness goals)
•ProjectsAdded ROC AUC to available project metrics
•UI/UXAdded an overview page to browse and navigate to projects
•UI/UXAdded an in-app onboarding flow to help new users get setup with their workspace
•UI/UXAdded announcement bars for onboarding and workspace plan information
•EnterpriseIntegrated with Stripe for billing management
•UI/UXAdded marketing email notification settings
Improvements
•PerformanceOptimized network requests to dramatically improve page time-to-load and runtime performance
•UI/UXImproved the experience scrolling through dataset rows, especially for very large datasets
•TemplatesAdded more suggested subpopulations for performance goal creation
•UI/UXAdded more warning and error messages to forms
•UI/UXAdded loading indicators when submitting comments in goals
•CollaborationAllowed submitting comments via Cmd + Enter
•UI/UXImproved the color range for heatmap tiles and tokens in the performance goal creation page
•UI/UXUpdated wording of various labels throughout the app for clarity
•CollaborationAllowed specifying a role when inviting users to workspaces
•SecurityUpdated the design of the password reset and confirmation pages
•UI/UXUpdated the design of the in-app onboarding modal
•UI/UXSorted confusion matrix labels and predictions dropdown items alphabetically and enabled searching them
•UI/UXAdded the ability to expand and collapse the confusion matrix
Fixes
•PerformanceAdding filters with multiple tokens when creating performance goals for text classification projects would sometimes fail to show insights
•PerformanceAdding filters when creating performance goals in any project would sometimes fail to show insights
•SecurityUpdating passwords in-app would fail
•CollaborationNotifications mentioning users that were deleted from a workspace would show a malformed label rather than their name or username
•SecurityEmail was sometimes empty in the page notifying users an email was sent to confirm their account after signup
•UI/UXExplainability graph cells would sometimes overflow or become misaligned
•SecurityUsers were sometimes unexpectedly logged out
•PerformanceFeature drift insights were broken for tabular datasets containing completely empty features
•PerformanceFeature profile insights would fail to compute when encountering NaN values
•PerformanceToken cloud insights would fail to compute when encountering NaN values
•UI/UXCommits in the history view would sometimes have overflowing content
•UI/UXReplaying onboarding successively would start the flow at the last step
•PlatformSwitching between projects and workspaces would sometimes fail to redirect properly
•UI/UXConfusion matrix UI would break when missing column values
•UI/UXSorting the confusion matrix by subpopulation values wouldn’t apply
•PerformanceGoals would show as loading infinitely when missing results for the current commit
•UI/UXImproved the loading states for goal diagnosis modals
•UI/UXPerforming what-if on rows with null columns would break the table UI
•PerformanceUploading new commits that do not contain features used previously in the project as a subpopulation filter would cause unexpected behavior
•UI/UXFixed various UI bugs affecting graphs throughout the app
$ openlayer push
Stop guessing.
Ship with confidence.
The automated AI evaluation and monitoring platform.
