Skip to content

Conversation

@bcoe
Copy link
Member

@bcoe bcoe commented Oct 29, 2024

DESCRIBE YOUR PR

Move insights to domain focused hierarchy from blob of views.

Screenshot 2024-10-29 at 11 23 47 AM Screenshot 2024-10-29 at 11 24 10 AM

IS YOUR CHANGE URGENT?

Help us prioritize incoming PRs by letting us know when the change needs to go live.

  • Urgent deadline (GA date, etc.): Early November for Launch week.

SLA

  • Teamwork makes the dream work, so please add a reviewer to your PRs.
  • Please give the docs team up to 1 week to review your PR unless you've added an urgent due date to it.
    Thanks in advance for your help!

PRE-MERGE CHECKLIST

Make sure you've checked the following before merging your changes:

  • Checked Vercel preview for correctness, including links
  • PR was reviewed and approved by any necessary SMEs (subject matter experts)
  • PR was reviewed and approved by a member of the Sentry docs team

LEGAL BOILERPLATE

Look, I get it. The entity doing business as "Sentry" was incorporated in the State of Delaware in 2015 as Functional Software, Inc. and is gonna need some rights from me in order to utilize my contributions in this here PR. So here's the deal: I retain all rights, title and interest in and to my contributions, and by keeping this boilerplate intact I confirm that Sentry can use, modify, copy, and redistribute my contributions, under Sentry's choice of terms.

EXTRA RESOURCES

@vercel
Copy link

vercel bot commented Oct 29, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
sentry-docs ✅ Ready (Inspect) Visit Preview 💬 Add feedback Nov 14, 2024 6:25pm
2 Skipped Deployments
Name Status Preview Comments Updated (UTC)
changelog ⬜️ Ignored (Inspect) Visit Preview Nov 14, 2024 6:25pm
develop-docs ⬜️ Ignored (Inspect) Visit Preview Nov 14, 2024 6:25pm

@bcoe
Copy link
Member Author

bcoe commented Oct 29, 2024

We shouldn't merge this until @DominikB2014's work is close to ready for GA.

@codecov
Copy link

codecov bot commented Oct 29, 2024

Bundle Report

Changes will increase total bundle size by 1.75kB (0.01%) ⬆️. This is within the configured threshold ✅

Detailed changes
Bundle name Size Change
sentry-docs-server-cjs 8.59MB 1.75kB (0.02%) ⬆️
sentry-docs-client-array-push 8.94MB 6 bytes (-0.0%) ⬇️

Copy link
Contributor

@DominikB2014 DominikB2014 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Lgtm!

Copy link
Contributor

@coolguyzone coolguyzone left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

All changes and redirects look good!

Copy link
Contributor

@lizokm lizokm left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks again for putting up this huge PR! Couple of notes:
-I think it would be good to combine the AI Performance + LLM Monitoring page (the same way you did for mobile). Otherwise, there's just not really enough content on the standalone page
-It would also be good to add screenshots of the overview pages (I can help with this.)
-I added a little bit more meat to the frontend/backend pages. If there's anything else you can think of to add, it would be good to make those pages a bit more meaty too

---
title: "AI Performance"
sidebar_order: 135
description: "Performance views for AI developers."
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
description: "Performance views for AI developers."
description: "Learn how to use Sentry's AI Performance tool to monitor LLM calls."

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Large Language Models are just one type of AI workflow that we happen to have concentrated on first. Another example where I could imagine us having some monitoring is generative image models (as an example).

Even though the AI page is a bit sparse, my preference would be to not use monitoring LLM calls as a synonym for AI.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That makes sense. Let me take another pass at adding a bit more context here...

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

How about: Learn how to use Sentry's AI Performance tool to get insights into things that may be affecting your application health, including critical LLM metrics.

We can make updates here as we add new AI capabilities. Feel free to update if you have a broader way to speak to this tools without specifically mentioning LLM.

Copy link
Contributor

@lizokm lizokm left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks so much for adding screenshots! I've made a few more tweaks and added a bit more content to the AI Perf page. It makes sense that you want to leave it more broad and not just have it be about LLMs. I think we're in good shape!

---
title: "AI Performance"
sidebar_order: 135
description: "Performance views for AI developers."
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

How about: Learn how to use Sentry's AI Performance tool to get insights into things that may be affecting your application health, including critical LLM metrics.

We can make updates here as we add new AI capabilities. Feel free to update if you have a broader way to speak to this tools without specifically mentioning LLM.

Copy link
Contributor

@lizokm lizokm left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just a few tiny tweaks, but it's looking good!


<Include name="feature-limited-on-team-retention.mdx" />

Sentry's [**Frontend Performance**](https://sentry.io/orgredirect/organizations/:orgslug/insights/backend/) page gives you an overview of the health of your application. You'll be able to see things like **Best Page Opportunities** (the improvements that would most help increase your performance score), your **Most Time-Consuming Assets**, **p50** and **p75 Duration**, and so on.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
Sentry's [**Frontend Performance**](https://sentry.io/orgredirect/organizations/:orgslug/insights/backend/) page gives you an overview of the health of your application. You'll be able to see things like **Best Page Opportunities** (the improvements that would most help increase your performance score), your **Most Time-Consuming Assets**, **p50** and **p75 Duration**, and so on.
Sentry's [**Frontend Performance**](https://sentry.io/orgredirect/organizations/:orgslug/insights/frontend/) page gives you an overview of the health of your application. You'll be able to see things like **Best Page Opportunities** (the improvements that would most help increase your performance score), your **Most Time-Consuming Assets**, **p50** and **p75 Duration**, and so on.

<Include name="feature-limited-on-team-retention.mdx" />

<Note>
Sentry’s frontend, backend, mobile, and AI performance insights (all under the [**Insights**](https://sentry.io/orgredirect/organizations/:orgslug/insights/) heading in Sentry), give you a clear summary of the telemetry and events impacting the performance of individual parts of your application. Each section shows a high-level overview of your application's health with widgets for "Best Page Opportunities" (improvement that will be most helpful for boosting your performance score), most time-consuming events, and so on. You can also drill deeper into specific workflows to see specific traces, errors, and releases. This helps you identify potential problems and spot trends, fix bugs, and ultimately boost application performance.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
Sentry’s frontend, backend, mobile, and AI performance insights (all under the [**Insights**](https://sentry.io/orgredirect/organizations/:orgslug/insights/) heading in Sentry), give you a clear summary of the telemetry and events impacting the performance of individual parts of your application. Each section shows a high-level overview of your application's health with widgets for "Best Page Opportunities" (improvement that will be most helpful for boosting your performance score), most time-consuming events, and so on. You can also drill deeper into specific workflows to see specific traces, errors, and releases. This helps you identify potential problems and spot trends, fix bugs, and ultimately boost application performance.
Sentry’s frontend, backend, mobile, and AI performance insights (all under the [**Insights**](https://sentry.io/orgredirect/organizations/:orgslug/insights/) heading in Sentry), give you a clear summary of the telemetry and events impacting the performance of individual parts of your application. Each section shows a high-level overview of your application's health with widgets for **Best Page Opportunities** (improvement that will be most helpful for boosting your performance score), most time-consuming events, and so on. You can also drill deeper into specific workflows to see specific traces, errors, and releases. This helps you identify potential problems and spot trends, fix bugs, and ultimately boost application performance.

Updating this so it's consistent with how we have it on other pages.


Sentry's [**AI Performance**](https://sentry.io/orgredirect/organizations/:orgslug/insights/ai/) page gives you an overview of the health of your application. You'll be able to see things like **Transactions Per Minute**, **p50** and **p75 Duration**, and so on.

You can also dive deeper into LLM Monitoring and get insights into critical LLM metrics, like token usage, to monitor and fix issues with AI pipelines. In addition to having a dedicated space to monitor AI performance, you can also look at Sentry's Insights tab to monitor backend, mobile, and frontend performance.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
You can also dive deeper into LLM Monitoring and get insights into critical LLM metrics, like token usage, to monitor and fix issues with AI pipelines. In addition to having a dedicated space to monitor AI performance, you can also look at Sentry's Insights tab to monitor backend, mobile, and frontend performance.
You can also dive deeper into LLM Monitoring and get insights into critical LLM metrics, like token usage, to monitor and fix issues with AI pipelines. In addition to having a dedicated space to monitor AI performance, you can also look at Sentry's **Insights** tab to monitor backend, mobile, and frontend performance.

Copy link
Contributor

@coolguyzone coolguyzone left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Everything looks good and works correctly, added a question about one of the page descriptions, besides that, good to go!

@bcoe bcoe merged commit 361fd80 into master Nov 14, 2024
13 checks passed
@bcoe bcoe deleted the domain-focused-insights branch November 14, 2024 19:21
@github-actions github-actions bot locked and limited conversation to collaborators Nov 30, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants