You can annotate the live data published to the Openlayer platform. This is useful to:
  • add human feedback to requests. For example, marking a request with 👍 or 👎 depending on whether the model behavior was satisfactory for that request.
  • add ground truths or metadata to requests or any intermediate step of a trace.
This page shows how to annotate data using the Openlayer platform UI. You can also do so via the Label Studio integration or with Openlayer’s SDKs.

​
Adding human feedback to a request

To add 👍/👎 human feedback to a request, navigate to the “Requests” page in the monitoring mode of your project. Requests page Then, click on a request to inspect it. In the upper right corner, you have the thumbs up/down buttons, which allow you to annotate the request. Add feedback On the requests data table, you will see the Feedback column added. Now, you can filter the data by the Feedback column either to export these rows for further analysis or to set up tests that only run on the data with certain feedback. Feedback column

​
Adding ground truths or metadata

To add ground truths or metadata to a request or any intermediate step of a trace, navigate to the “Requests” page in the monitoring mode of your project. Requests page Then, click on a request to inspect it. In all steps of a trace, you will see the option to add ground truths. Add ground truth Additionally, if you scroll down to the “Other fields” section, you can add metadata by clicking the “Add” button. On the requests data table, you will see the ground truths and/or metadata columns added. Now, you can filter the data using these columns for further analysis or to set up tests that rely on them.