Skip to content

feat(seer): Update seer docs #13448

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 10 commits into from
Apr 28, 2025
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion docs/product/issues/issue-details/index.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -40,7 +40,7 @@ A few tags are shown as a preview on the page, but to see more, you can either c

The first and last time the issue has been seen will be displayed here. These values will depend on your environment selection and will be updated if you change the environments. If you have releases set up, the first and last release where the issue was seen will be shown

The solutions hub contains features from [Sentry AI](/product/issues/issue-details/sentry-ai) that help you understand and fix issues.
The solutions hub contains features from [Sentry AI](/product/issues/issue-details/sentry-seer) that help you understand and fix issues.

If you have [issue tracking](/organization/integrations/issue-tracking) set up, integrations or linked issues will appear.

Expand Down
72 changes: 0 additions & 72 deletions docs/product/issues/issue-details/sentry-ai/index.mdx

This file was deleted.

76 changes: 76 additions & 0 deletions docs/product/issues/issue-details/sentry-seer/index.mdx
Original file line number Diff line number Diff line change
@@ -0,0 +1,76 @@
---
title: Sentry Seer
description: "Learn about Seer, Sentry's AI agent, and managing generative AI features."
sidebar_order: 50

---

Seer is Sentry's AI agent that powers a set of features built on generative AI and ML. You can find it in the **Solutions Hub** section of the issue details page after clicking on any error from the [**Issues**](https://sentry.io/orgredirect/organizations/:orgslug/issues/) page.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't see a header for solutions hub in the UI. Are we still going with that? I see the titled as Seer.


Once you've set up Seer, you'll be able to use the following features:

- [**Issue Summary**](#issue-summary): A quick summary of issue context to help you see what's going on
- [**Autofix**](#autofix): A collaborative workflow to find the root cause and solution of issues

<Alert>

Issue Summary and Autofix are currently in Beta, free of charge, for paid Sentry customers. Feedback is highly welcomed and can be submitted in-product or via email to [[email protected]](mailto:[email protected]).

</Alert>

## Issue Summary

The Issue Summary provides a quick overview of an issue by highlighting key insights taken from event and issue-level metadata. You'll see a quick overview of what's going wrong, a potential cause, and if relevant, insights from trace-connected issues, all in the Solutions Hub in the sidebar:

![Solutions Hub](./img/solutions-hub.png)

## Autofix

<Alert>

Autofix replaces Suggested Fix (an earlier feature that has been sunset).

</Alert>

**Autofix** uses Sentry's context (issue details, tracing data, and profiles), your codebase (integrated through GitHub), and its interactions with you to identify and reason through problems in your code. Autofix can identify the root cause and suggest a code change for fixing the issue and/or add unit tests for it.

When you start an Autofix run, you'll see the following screen, with an option to share any additional context:

![Autofix Start Screen](./img/autofix-start-screen.png)

Autofix will then analyze the issue and relevant code to help identify the root cause and a solution. You'll see a live stream of Autofix's thought process in real time as it works through the problem. Autofix will share key insights as they come up and you'll have the option to expand each. You'll see the event data and code that support Autofix conclusions, building a clear chain of reasoning back to the root cause.

While Autofix is reasoning through your problem, you can step in at any time to add context or feedback; collaboration tends to lead to the best results. If Autofix encounters gaps in its understanding, it will ask for your input.

The output will be a clearly defined root cause of the Sentry issue, and a detailed solution for how to resolve it:

![Autofix Insights](./img/autofix-qna.png)

You are free to edit or adjust this solution based on your own requirements and preferences. Once you are ready to proceed, you can select "Code It Up" to generate code resolving the bug. You have three options:

- Write a fix
- Write a unit test reproducing the issue
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this sounds like a remnant for when we had a dropdown. Now we let the user add/remove any steps they want. Maybe could be worded better?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

i'll comment on it for rachel, i'm not sure

- Write both

![Autofix Results](./img/autofix-results.png)

Once the coding step is complete, you can either create a Pull Request (PR) in GitHub directly from Autofix, or create a branch and checkout the code locally if you would like to iterate further.

## Data Processing for Generative AI

We use the data listed below to provide insights, analysis, and solutions for your review. Your data will not be used to train any Seer models without your express consent and AI-generated output from your data is shown only to you, not other customers. Seer is powered by generative AI models hosted by subprocessors identified on our [subprocessor list](https://sentry.io/legal/subprocessors/). Our subprocessors are only permitted to use the data as directed by us.

The data used for these features includes:

- Error messages
- Stack traces
- Sentry spans
- DOM interactions
- Profiles
- Relevant code from linked repositories

You can learn more about our data privacy practices [here](https://docs.sentry.io/security-legal-pii/security/ai-ml-policy/#use-of-identifying-data-for-generative-ai-features).

## Disabling Seer Features

If you don't find the Seer features useful and want to disable it for all users, you can do so in your organization's settings with the "Enable Seer Features" toggle [link]
77 changes: 24 additions & 53 deletions docs/security-legal-pii/security/ai-ml-policy.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -4,25 +4,19 @@ sidebar_order: 10
description: "Learn about Sentry's approach to AI/ML"
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

title needs to change to service data usage

---

<Alert>
These settings will be rolling out to users over the next few weeks.
</Alert>
## Delivering a better user experience

Throughout Sentry’s history, we’ve operated under a policy of [privacy by default](https://sentry.io/lp/privacy-by-default/). This same principle applies to our work in the Artificial Intelligence (AI) and Machine Learning (ML) space, where we want to be just as [transparent](https://blog.sentry.io/terms-of-service-update/) about what data we’re using and why.
Sentry processes your service data, the data you configure to be collected and reported to your Sentry instance, to provide our service to you. As Sentry's service has evolved, however, prior heuristics-based approaches cannot deliver the product value we've come to expect. To train and validate models for grouping, notifications, and workflow improvements, Sentry will need access to additional [service data](https://blog.sentry.io/terms-of-service-update/) to deliver a better user experience.

Sentry is at a juncture where prior heuristics-based approaches cannot sustain the demands of the product. For example, fingerprinting error events as part of creating groups, has gotten a lot more complicated with the rise of JavaScript and the use of extensions and third-party services.
You can update these settings within the "Service Data Usage" section of the Legal & Compliance page in [Sentry](https://sentry.io/orgredirect/organizations/:orgslug/settings/legal/), which is located within the "Usage & Billing" Settings.

To train and validate models for grouping, notifications, and workflow improvements, Sentry will need access to additional service data to deliver a better user experience.
### Use of non-identifying data

You can update these settings within the new “Service Data Usage” section of the Legal & Compliance page in [Sentry](https://sentry.io/orgredirect/organizations/:orgslug/settings/legal/), which is located within the “Usage & Billing” Settings.
In accordance with our Terms of Service, Sentry may use non-identifying elements of your service data for product improvement. For example, we may aggregate web vitals data to show your site's performance against a Sentry-built benchmark. The data accessed for the benchmark cannot be linked back to any particular project or customer, making it non-identifying.

## Use of Non-Identifying Data
### Use of aggregated identifying data

In accordance with our Terms of Service, Sentry may use non-identifying elements of your service data for product improvement. For example, we may aggregate web vitals data to show your site’s performance against a Sentry-built benchmark. The data accessed for the benchmark cannot be linked back to any particular project or customer, making it non-identifying.

## Use of Aggregated Identifying Data

For upcoming features like priority alerts or ML-based grouping, Sentry is asking for access to the following forms of service data:
For upcoming features like priority alerts or ML-based grouping, if authorized by you, Sentry may access the following forms of service data for product improvement:

- Error messages
- Stack traces
Expand All @@ -31,52 +25,29 @@ For upcoming features like priority alerts or ML-based grouping, Sentry is askin

## Use of Identifying Data for Generative AI Features

For upcoming features like Autofix that use Generative AI, Sentry is asking for access to the following forms of service data:
Sentry Seer powers our generative AI features like Autofix. To learn more about Seer features, including how you can manage Seer features, [see here](/product/issues/issue-details/sentry-seer/).

For Seer features, Sentry is asking for access to the following forms of service data to provide insights, analysis, and solutions for your review. Your data will not be used to train any Seer models without your express consent and AI-generated output from your data is shown only to you, not other customers.

- Error messages
- Stack traces
- Spans
- Sentry spans
- DOM interactions
- Relevant code to linked repositories
- Profiles
- Relevant code from linked repositories

All functionality leveraging RAG will require user opt-in. By opting in, you agree to our use of relevant stack trace and code from your linked repositories with generative AI models hosted by the feature-specific subprocessors identified on our [subprocessor list](https://sentry.io/legal/subprocessors/).

To ensure our BAA customers can remain HIPAA compliant and that data stays in your selected region, we will disable generative AI features in Sentry for all BAA customers and EU region customers by default where we are unable to flow-down necessary BAA terms or where data storage in the EU region is not available, as applicable.
To ensure that data is stored in your selected region, we will disable Seer features in Sentry for EU region customers by default where data storage in the EU region is not available.

## Data Access Summary

<table>
<tbody>
<tr>
<th>Access Type</th>
<th>Is the underlying data identifiable?</th>
<th>Will this data (or any output) be shared with others?</th>
<th>Will this data be used for training Sentry models?</th>
<th>Will this data be used to train 3rd party models?</th>
</tr>
<tr>
<th>Non-identifying data</th>
<td>No</td>
<td>Other Sentry customers</td>
<td>Yes</td>
<td>No</td>
</tr>
<tr>
<th>Aggregated identifying data</th>
<td>Yes</td>
<td>Sentry only</td>
<td>Yes</td>
<td>No</td>
</tr>
<tr>
<th>Identifying data for generative AI features</th>
<td>Yes</td>
<td>Approved feature-specific subprocessors</td>
<td>No</td>
<td>No</td>
</tr>
</tbody>
</table>
| **Access Type** | **Is the underlying data identifiable?** | **Who will this data (or any output) be shared with?** | **Will this data be used for training Sentry models?** | **Will this data be used to train 3rd party models?** |
|-------------------------------------------------|------------------------------------------|--------------------------------------------------------|--------------------------------------------------------|-------------------------------------------------------|
| **Non-identifying data** | No | Other Sentry customers* | Yes | No |
| **Aggregated identifying data** | Yes | Approved subprocessors | Yes | No |
| **Identifying data for generative AI features** | Yes | Approved subprocessors | No | No |


**In these cases we don't share the underlying data, only aggregations or output generated from the data.*

## Data Handling

Expand All @@ -86,6 +57,6 @@ In addition to the consent mechanisms mentioned above:
2. We'll apply the same deletion and retention rules to our training data as we do to the underlying service data. This means that if you delete service data, it will also be removed from our machine learning models automatically.
3. We'll scrub data for PII before it goes into any training set.
4. We'll ensure that the only service data presented in the output of any generative AI feature belongs to the customer using the feature.
5. We'll only use AI models built in-house, deployed in our production cloud, or provided by our existing trusted [third-party subprocessors](https://sentry.io/legal/subprocessors/) who have made contractual commitments that are consistent with the above.
5. We'll only use generative AI models built in-house, deployed in our production cloud, or provided by our existing trusted [third-party subprocessors](https://sentry.io/legal/subprocessors/) who have made contractual commitments that are consistent with the above.

We're confident that with these controls in place, we'll be able to use service data to improve our products through AI while at the same time protecting that data.
We're confident that with these controls in place, we'll be able to use service data to improve and provide our products through AI while at the same time protecting that data.
8 changes: 6 additions & 2 deletions src/middleware.ts
Original file line number Diff line number Diff line change
Expand Up @@ -2656,11 +2656,15 @@ const USER_DOCS_REDIRECTS: Redirect[] = [
},
{
from: '/product/issues/issue-details/suggested-fix/',
to: '/product/issues/issue-details/sentry-ai/',
to: '/product/issues/issue-details/sentry-seer/',
},
{
from: '/product/issues/issue-details/ai-suggested-solution/',
to: '/product/issues/issue-details/sentry-ai/',
to: '/product/issues/issue-details/sentry-seer/',
},
{
from: '/product/issues/issue-details/sentry-ai/',
to: '/product/issues/issue-details/sentry-seer/',
},
{
from: '/guides/grouping-and-fingerprints/',
Expand Down
Loading