Trace every step of your requests
We’re thrilled to share with you the latest update to Openlayer: comprehensive tracing capabilities and enhanced request streaming with function calling support.
Now, you can trace every step of a request to gain detailed insights in Openlayer. This granular view helps you to debug and optimize performance.
Additionally, we’ve expanded our request streaming capabilities to include support for function calling. This means that requests you stream to Openlayer are no longer a black box, giving you improved control and flexibility.
Features
- •UITracing (Trace every step of a request and view details, including latency and fun, Support for function calling in request streaming)ction inputs & outputs, in the UI,
- •APIAdded support for using Azure OpenAI models
Improvements
- •PerformanceImproved performance of the UI, including several networking optimizations
- •UIToggle button color improvements to make it easier to understand which is selected
- •UIImprovement to color of background behind modals
- •UIColumn A mean / sum etc. grouped by column B values
- •UISurface generated question for answer relevancy metric
- •UIEasily duplicate/fork test configurations
- •UIEnable creating more tests without dismissing modal
- •UIImproved design of request panel
- •UIWarning displays in request pane when no prompt has been added
- •Project dashboardRequest panel can be closed with the Esc key
- •UINavigate through requests in the panel by using the arrow keys
- •UIImproved design of prompt roles in prompt blocks
- •UIAbility to copy values of blocks and columns in request page
- •TemplatesRAG tracing example added to Openlayer examples gallery
- •TemplatesAzure GPT example added to Openlayer examples gallery
- •PerformancePerformance improvement: only automatically load inference pipelines and project versions if the user is in the relevant mode
- •UIRemove Intercom app which was not utilized and was blocking core UI components
- •UINavigation callout components now have dark-mode purple styling
- •UIUpdate notification page titles in settings
- •UIImprovements and bug fixes for rendering content and metadata in selected row pane
- •UIUpdated copy icon
- •UIUpdated inconsistent delete icons throughout the app
- •UIRender inputs in row panel even when no prompt is available
- •UIRender metric scores and explanation columns further left in tables so they are in view without scrolling
- •UIUpdated format of date strings
- •UIEnabled ability to collapse sections in row panels
- •UIEnabled ability to collapse chat history blocks
Fixes
- •IntegrationsIn-app Google Colab links were incorrect
- •UICheckboxes for suggested tests were not default selected
- •UIGraph in test modal rendered too short sometimes
- •UIPrompt roles did not render correctly when set to an unknown value
- •APIHandle cases where data contains non-utf8 codes
- •UICreate test pages overflow before enabling scroll
- •UITest modal overflows page
- •UIBoolean values would not render in request pane metadata
- •UILabels in request pane overflowed improperly with long content
- •UITests rendered broken graphs when all results were skipped
- •PlatformInference pipelines did not automatically load
- •PlatformInference pipelines did not automatically update tests or requests
- •PlatformCommits did not automatically load nor update tests once processed
- •APIProjects did not automatically appear when added from API
- •SDKsAPI key and project name were not auto-filling in TypeScript code snippet for starting monitoring
- •UIClicking to browse a commit always went to monitoring mode
- •UIMonitoring test graphs did not show hovered results on initial load until refreshing
- •UIOpening requests page showed no data until refreshed
- •PlatformColumn drift test wouldn’t run on non-feature columns
- •UITimeline page showed monitoring tests
- •UICheckboxes for suggested tests did not check properly on click
- •UIMultiple copies of tests got created on successive clicks
- •UIUnselected tests got created, and not all selected tests got created
- •PerformanceTests loaded for too long when skipped or unavailable
- •UICopy button rendered twice in code labels
- •UIChat history input in row panels sometimes showed text editor