-
-
Notifications
You must be signed in to change notification settings - Fork 1.6k
feat(seer): Update seer docs #13448
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat(seer): Update seer docs #13448
Changes from 1 commit
83da62a
984a1f8
5a2b55d
3f78a4f
45f9f80
0b1872b
d6ce864
7c7c944
fd3ff26
abc04f2
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
This file was deleted.
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,76 @@ | ||
--- | ||
title: Sentry Seer | ||
description: "Learn about Seer, Sentry's AI agent, and managing generative AI features." | ||
sidebar_order: 50 | ||
|
||
--- | ||
|
||
Seer is Sentry's AI agent that powers a set of features built on generative AI and ML. You can find it in the **Solutions Hub** section of the issue details page after clicking on any error from the [**Issues**](https://sentry.io/orgredirect/organizations/:orgslug/issues/) page. | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. I don't see a header for solutions hub in the UI. Are we still going with that? I see the titled as Seer. |
||
|
||
Once you've set up Seer, you'll be able to use the following features: | ||
|
||
- [**Issue Summary**](#issue-summary): A quick summary of issue context to help you see what's going on | ||
- [**Autofix**](#autofix): A collaborative workflow to find the root cause and solution of issues | ||
scttcper marked this conversation as resolved.
Show resolved
Hide resolved
|
||
|
||
<Alert> | ||
|
||
Issue Summary and Autofix are currently in Beta, free of charge, for paid Sentry customers. Feedback is highly welcomed and can be submitted in-product or via email to [[email protected]](mailto:[email protected]). | ||
|
||
</Alert> | ||
|
||
## Issue Summary | ||
|
||
The Issue Summary provides a quick overview of an issue by highlighting key insights taken from event and issue-level metadata. You'll see a quick overview of what's going wrong, a potential cause, and if relevant, insights from trace-connected issues, all in the Solutions Hub in the sidebar: | ||
|
||
 | ||
|
||
## Autofix | ||
|
||
<Alert> | ||
|
||
Autofix replaces Suggested Fix (an earlier feature that has been sunset). | ||
|
||
</Alert> | ||
|
||
**Autofix** uses Sentry's context (issue details, tracing data, and profiles), your codebase (integrated through GitHub), and its interactions with you to identify and reason through problems in your code. Autofix can identify the root cause and suggest a code change for fixing the issue and/or add unit tests for it. | ||
|
||
When you start an Autofix run, you'll see the following screen, with an option to share any additional context: | ||
|
||
 | ||
|
||
Autofix will then analyze the issue and relevant code to help identify the root cause and a solution. You'll see a live stream of Autofix's thought process in real time as it works through the problem. Autofix will share key insights as they come up and you'll have the option to expand each. You'll see the event data and code that support Autofix conclusions, building a clear chain of reasoning back to the root cause. | ||
|
||
While Autofix is reasoning through your problem, you can step in at any time to add context or feedback; collaboration tends to lead to the best results. If Autofix encounters gaps in its understanding, it will ask for your input. | ||
|
||
The output will be a clearly defined root cause of the Sentry issue, and a detailed solution for how to resolve it: | ||
|
||
 | ||
|
||
You are free to edit or adjust this solution based on your own requirements and preferences. Once you are ready to proceed, you can select "Code It Up" to generate code resolving the bug. You have three options: | ||
|
||
- Write a fix | ||
- Write a unit test reproducing the issue | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. this sounds like a remnant for when we had a dropdown. Now we let the user add/remove any steps they want. Maybe could be worded better? There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. i'll comment on it for rachel, i'm not sure |
||
- Write both | ||
|
||
 | ||
|
||
Once the coding step is complete, you can either create a Pull Request (PR) in GitHub directly from Autofix, or create a branch and checkout the code locally if you would like to iterate further. | ||
|
||
## Data Processing for Generative AI | ||
|
||
We use the data listed below to provide insights, analysis, and solutions for your review. Your data will not be used to train any Seer models without your express consent and AI-generated output from your data is shown only to you, not other customers. Seer is powered by generative AI models hosted by subprocessors identified on our [subprocessor list](https://sentry.io/legal/subprocessors/). Our subprocessors are only permitted to use the data as directed by us. | ||
|
||
The data used for these features includes: | ||
|
||
- Error messages | ||
- Stack traces | ||
- Sentry spans | ||
- DOM interactions | ||
- Profiles | ||
- Relevant code from linked repositories | ||
|
||
You can learn more about our data privacy practices [here](https://docs.sentry.io/security-legal-pii/security/ai-ml-policy/#use-of-identifying-data-for-generative-ai-features). | ||
|
||
## Disabling Seer Features | ||
|
||
If you don't find the Seer features useful and want to disable it for all users, you can do so in your organization's settings with the "Enable Seer Features" toggle [link] |
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -4,25 +4,19 @@ sidebar_order: 10 | |
description: "Learn about Sentry's approach to AI/ML" | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. title needs to change to service data usage |
||
--- | ||
|
||
<Alert> | ||
These settings will be rolling out to users over the next few weeks. | ||
</Alert> | ||
## Delivering a better user experience | ||
|
||
Throughout Sentry’s history, we’ve operated under a policy of [privacy by default](https://sentry.io/lp/privacy-by-default/). This same principle applies to our work in the Artificial Intelligence (AI) and Machine Learning (ML) space, where we want to be just as [transparent](https://blog.sentry.io/terms-of-service-update/) about what data we’re using and why. | ||
Sentry processes your service data, the data you configure to be collected and reported to your Sentry instance, to provide our service to you. As Sentry's service has evolved, however, prior heuristics-based approaches cannot deliver the product value we've come to expect. To train and validate models for grouping, notifications, and workflow improvements, Sentry will need access to additional [service data](https://blog.sentry.io/terms-of-service-update/) to deliver a better user experience. | ||
|
||
Sentry is at a juncture where prior heuristics-based approaches cannot sustain the demands of the product. For example, fingerprinting error events as part of creating groups, has gotten a lot more complicated with the rise of JavaScript and the use of extensions and third-party services. | ||
You can update these settings within the "Service Data Usage" section of the Legal & Compliance page in [Sentry](https://sentry.io/orgredirect/organizations/:orgslug/settings/legal/), which is located within the "Usage & Billing" Settings. | ||
|
||
To train and validate models for grouping, notifications, and workflow improvements, Sentry will need access to additional service data to deliver a better user experience. | ||
### Use of non-identifying data | ||
|
||
You can update these settings within the new “Service Data Usage” section of the Legal & Compliance page in [Sentry](https://sentry.io/orgredirect/organizations/:orgslug/settings/legal/), which is located within the “Usage & Billing” Settings. | ||
In accordance with our Terms of Service, Sentry may use non-identifying elements of your service data for product improvement. For example, we may aggregate web vitals data to show your site's performance against a Sentry-built benchmark. The data accessed for the benchmark cannot be linked back to any particular project or customer, making it non-identifying. | ||
|
||
## Use of Non-Identifying Data | ||
### Use of aggregated identifying data | ||
|
||
In accordance with our Terms of Service, Sentry may use non-identifying elements of your service data for product improvement. For example, we may aggregate web vitals data to show your site’s performance against a Sentry-built benchmark. The data accessed for the benchmark cannot be linked back to any particular project or customer, making it non-identifying. | ||
|
||
## Use of Aggregated Identifying Data | ||
|
||
For upcoming features like priority alerts or ML-based grouping, Sentry is asking for access to the following forms of service data: | ||
For upcoming features like priority alerts or ML-based grouping, if authorized by you, Sentry may access the following forms of service data for product improvement: | ||
|
||
- Error messages | ||
- Stack traces | ||
|
@@ -31,52 +25,29 @@ For upcoming features like priority alerts or ML-based grouping, Sentry is askin | |
|
||
## Use of Identifying Data for Generative AI Features | ||
|
||
For upcoming features like Autofix that use Generative AI, Sentry is asking for access to the following forms of service data: | ||
Sentry Seer powers our generative AI features like Autofix. To learn more about Seer features, including how you can manage Seer features, [see here](/product/issues/issue-details/sentry-seer/). | ||
|
||
For Seer features, Sentry is asking for access to the following forms of service data to provide insights, analysis, and solutions for your review. Your data will not be used to train any Seer models without your express consent and AI-generated output from your data is shown only to you, not other customers. | ||
|
||
- Error messages | ||
- Stack traces | ||
- Spans | ||
- Sentry spans | ||
- DOM interactions | ||
- Relevant code to linked repositories | ||
- Profiles | ||
- Relevant code from linked repositories | ||
|
||
All functionality leveraging RAG will require user opt-in. By opting in, you agree to our use of relevant stack trace and code from your linked repositories with generative AI models hosted by the feature-specific subprocessors identified on our [subprocessor list](https://sentry.io/legal/subprocessors/). | ||
|
||
To ensure our BAA customers can remain HIPAA compliant and that data stays in your selected region, we will disable generative AI features in Sentry for all BAA customers and EU region customers by default where we are unable to flow-down necessary BAA terms or where data storage in the EU region is not available, as applicable. | ||
To ensure that data is stored in your selected region, we will disable Seer features in Sentry for EU region customers by default where data storage in the EU region is not available. | ||
|
||
## Data Access Summary | ||
|
||
<table> | ||
<tbody> | ||
<tr> | ||
<th>Access Type</th> | ||
<th>Is the underlying data identifiable?</th> | ||
<th>Will this data (or any output) be shared with others?</th> | ||
<th>Will this data be used for training Sentry models?</th> | ||
<th>Will this data be used to train 3rd party models?</th> | ||
</tr> | ||
<tr> | ||
<th>Non-identifying data</th> | ||
<td>No</td> | ||
<td>Other Sentry customers</td> | ||
<td>Yes</td> | ||
<td>No</td> | ||
</tr> | ||
<tr> | ||
<th>Aggregated identifying data</th> | ||
<td>Yes</td> | ||
<td>Sentry only</td> | ||
<td>Yes</td> | ||
<td>No</td> | ||
</tr> | ||
<tr> | ||
<th>Identifying data for generative AI features</th> | ||
<td>Yes</td> | ||
<td>Approved feature-specific subprocessors</td> | ||
<td>No</td> | ||
<td>No</td> | ||
</tr> | ||
</tbody> | ||
</table> | ||
| **Access Type** | **Is the underlying data identifiable?** | **Who will this data (or any output) be shared with?** | **Will this data be used for training Sentry models?** | **Will this data be used to train 3rd party models?** | | ||
|-------------------------------------------------|------------------------------------------|--------------------------------------------------------|--------------------------------------------------------|-------------------------------------------------------| | ||
| **Non-identifying data** | No | Other Sentry customers* | Yes | No | | ||
| **Aggregated identifying data** | Yes | Approved subprocessors | Yes | No | | ||
| **Identifying data for generative AI features** | Yes | Approved subprocessors | No | No | | ||
|
||
|
||
**In these cases we don't share the underlying data, only aggregations or output generated from the data.* | ||
|
||
## Data Handling | ||
|
||
|
@@ -86,6 +57,6 @@ In addition to the consent mechanisms mentioned above: | |
2. We'll apply the same deletion and retention rules to our training data as we do to the underlying service data. This means that if you delete service data, it will also be removed from our machine learning models automatically. | ||
3. We'll scrub data for PII before it goes into any training set. | ||
4. We'll ensure that the only service data presented in the output of any generative AI feature belongs to the customer using the feature. | ||
5. We'll only use AI models built in-house, deployed in our production cloud, or provided by our existing trusted [third-party subprocessors](https://sentry.io/legal/subprocessors/) who have made contractual commitments that are consistent with the above. | ||
5. We'll only use generative AI models built in-house, deployed in our production cloud, or provided by our existing trusted [third-party subprocessors](https://sentry.io/legal/subprocessors/) who have made contractual commitments that are consistent with the above. | ||
|
||
We're confident that with these controls in place, we'll be able to use service data to improve our products through AI while at the same time protecting that data. | ||
We're confident that with these controls in place, we'll be able to use service data to improve and provide our products through AI while at the same time protecting that data. |
Uh oh!
There was an error while loading. Please reload this page.