Trace every step of your requests
We’re thrilled to share with you the latest update to Openlayer: comprehensive tracing capabilities and enhanced request streaming with function calling support.
Now, you can trace every step of a request to gain detailed insights in Openlayer. This granular view helps you to debug and optimize performance.
Additionally, we’ve expanded our request streaming capabilities to include support for function calling. This means that requests you stream to Openlayer are no longer a black box, giving you improved control and flexibility.
Features
- •ObservabilityTracing (Trace every step of a request and view details, including latency and fun, Support for function calling in request streaming)ction inputs & outputs, in the UI,
- •IntegrationsAdded support for using Azure OpenAI models
Improvements
- •PerformanceImproved performance of the UI, including several networking optimizations
- •UI/UXToggle button color improvements to make it easier to understand which is selected
- •UI/UXImprovement to color of background behind modals
- •UI/UXColumn A mean / sum etc. grouped by column B values
- •UI/UXSurface generated question for answer relevancy metric
- •UI/UXEasily duplicate/fork test configurations
- •UI/UXEnable creating more tests without dismissing modal
- •UI/UXImproved design of request panel
- •UI/UXWarning displays in request pane when no prompt has been added
- •Project dashboardRequest panel can be closed with the Esc key
- •UI/UXNavigate through requests in the panel by using the arrow keys
- •UI/UXImproved design of prompt roles in prompt blocks
- •UI/UXAbility to copy values of blocks and columns in request page
- •TemplatesRAG tracing example added to Openlayer examples gallery
- •TemplatesAzure GPT example added to Openlayer examples gallery
- •PerformancePerformance improvement: only automatically load inference pipelines and project versions if the user is in the relevant mode
- •UI/UXRemove Intercom app which was not utilized and was blocking core UI components
- •UI/UXNavigation callout components now have dark-mode purple styling
- •UI/UXUpdate notification page titles in settings
- •UI/UXImprovements and bug fixes for rendering content and metadata in selected row pane
- •UI/UXUpdated copy icon
- •UI/UXUpdated inconsistent delete icons throughout the app
- •UI/UXRender inputs in row panel even when no prompt is available
- •UI/UXRender metric scores and explanation columns further left in tables so they are in view without scrolling
- •UI/UXUpdated format of date strings
- •UI/UXEnabled ability to collapse sections in row panels
- •UI/UXEnabled ability to collapse chat history blocks
Fixes
- •TemplatesIn-app Google Colab links were incorrect
- •UI/UXCheckboxes for suggested tests were not default selected
- •UI/UXGraph in test modal rendered too short sometimes
- •UI/UXPrompt roles did not render correctly when set to an unknown value
- •APIHandle cases where data contains non-utf8 codes
- •UI/UXCreate test pages overflow before enabling scroll
- •UI/UXTest modal overflows page
- •UI/UXBoolean values would not render in request pane metadata
- •UI/UXLabels in request pane overflowed improperly with long content
- •UI/UXTests rendered broken graphs when all results were skipped
- •PlatformInference pipelines did not automatically load
- •PlatformInference pipelines did not automatically update tests or requests
- •PlatformCommits did not automatically load nor update tests once processed
- •APIProjects did not automatically appear when added from API
- •SDKsAPI key and project name were not auto-filling in TypeScript code snippet for starting monitoring
- •UI/UXClicking to browse a commit always went to monitoring mode
- •UI/UXMonitoring test graphs did not show hovered results on initial load until refreshing
- •UI/UXOpening requests page showed no data until refreshed
- •PlatformColumn drift test wouldn’t run on non-feature columns
- •UI/UXTimeline page showed monitoring tests
- •UI/UXCheckboxes for suggested tests did not check properly on click
- •UI/UXMultiple copies of tests got created on successive clicks
- •UI/UXUnselected tests got created, and not all selected tests got created
- •PerformanceTests loaded for too long when skipped or unavailable
- •UI/UXCopy button rendered twice in code labels
- •UI/UXChat history input in row panels sometimes showed text editor