Add third-party tracing integration guide (MLflow) #330
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Signed-off-by: B-Step62 <[email protected]>
Author
|
@microsoft-github-policy-service agree company="Databricks" |
Contributor
|
Learn Build status updates of commit febd726:
|
| File | Status | Preview URL | Details |
|---|---|---|---|
| semantic-kernel/concepts/enterprise-readiness/observability/telemetry-with-mlflow.md | Details | ||
| semantic-kernel/concepts/enterprise-readiness/observability/TOC.yml | Details | ||
| agent-framework/user-guide/agents/agent-observability.md | 💡Suggestion | Details | |
| agent-framework/user-guide/workflows/observability.md | 💡Suggestion | Details | |
| semantic-kernel/concepts/enterprise-readiness/observability/index.md | 💡Suggestion | Details |
semantic-kernel/concepts/enterprise-readiness/observability/telemetry-with-mlflow.md
- Line 0, Column 0: [Warning: pivot-id-unused]
Pivot ID 'programming-language-csharp' is defined in 'programming-languages' group in 'zone-pivot-groups.yml', but not used. You must use all pivot IDs in a pivot group to avoid blank tabs. - Line 0, Column 0: [Warning: pivot-id-unused]
Pivot ID 'programming-language-java' is defined in 'programming-languages' group in 'zone-pivot-groups.yml', but not used. You must use all pivot IDs in a pivot group to avoid blank tabs. - Line 0, Column 0: [Suggestion: external-image]
Image 'https://mlflow.org/docs/latest/images/llms/tracing/semantic-kernel-tracing.png' references an external site. This poses a security risk and external images are unavailable in some environments. Reference an image file within the repo instead. - Line 0, Column 0: [Suggestion: filename-incomplete - See documentation]
The filename contains an incomplete word, misspelled word, acronym, or abbreviation that is disallowed. - Line 6, Column 11: [Suggestion: value-deprecated-replace - See documentation]
The 'ms.topic: conceptual' you used is now deprecated and can no longer be used. We suggest you replace it with 'ms.topic: article'.
semantic-kernel/concepts/enterprise-readiness/observability/TOC.yml
- Line 12, Column 9: [Warning: file-not-found - See documentation]
Invalid file link: 'mlflow.mdx'.
agent-framework/user-guide/agents/agent-observability.md
- Line 0, Column 0: [Suggestion: external-image]
Image 'https://mlflow.org/docs/latest/images/llms/tracing/microsoft-agent-framework-tracing.png' references an external site. This poses a security risk and external images are unavailable in some environments. Reference an image file within the repo instead.
agent-framework/user-guide/workflows/observability.md
- Line 0, Column 0: [Suggestion: external-image]
Image 'https://mlflow.org/docs/latest/images/llms/tracing/microsoft-agent-framework-tracing.png' references an external site. This poses a security risk and external images are unavailable in some environments. Reference an image file within the repo instead.
semantic-kernel/concepts/enterprise-readiness/observability/index.md
- Line 0, Column 0: [Suggestion: external-image]
Image 'https://mlflow.org/docs/latest/images/llms/tracing/semantic-kernel-tracing.png' references an external site. This poses a security risk and external images are unavailable in some environments. Reference an image file within the repo instead. - Line 6, Column 11: [Suggestion: value-deprecated-replace - See documentation]
The 'ms.topic: conceptual' you used is now deprecated and can no longer be used. We suggest you replace it with 'ms.topic: article'.
For more details, please refer to the build report.
Note: Your PR may contain errors or warnings or suggestions unrelated to the files you changed. This happens when external dependencies like GitHub alias, Microsoft alias, cross repo links are updated. Please use these instructions to resolve them.
Contributor
|
@B-Step62 Theer are some warnings and a merge conflict that need to be resolved |
Signed-off-by: B-Step62 <[email protected]>
Contributor
|
Learn Build status updates of commit 1d8063c:
|
| File | Status | Preview URL | Details |
|---|---|---|---|
| Details | |||
| semantic-kernel/concepts/enterprise-readiness/observability/telemetry-with-mlflow.md | Details | ||
| semantic-kernel/concepts/enterprise-readiness/observability/TOC.yml | Details | ||
| agent-framework/user-guide/observability.md | 💡Suggestion | Details | |
| agent-framework/user-guide/workflows/observability.md | 💡Suggestion | Details | |
| semantic-kernel/concepts/enterprise-readiness/observability/index.md | 💡Suggestion | Details | |
| agent-framework/user-guide/agents/agent-observability.md | ✅Succeeded |
- Line 0, Column 0: [Warning: redirected-file-not-removed - See documentation]
Redirected file 'user-guide/agents/agent-observability.md' are still in the repo. After adding a file to the redirection JSON file, you must delete the original file from the repo.
semantic-kernel/concepts/enterprise-readiness/observability/telemetry-with-mlflow.md
- Line 0, Column 0: [Warning: pivot-id-unused]
Pivot ID 'programming-language-csharp' is defined in 'programming-languages' group in 'zone-pivot-groups.yml', but not used. You must use all pivot IDs in a pivot group to avoid blank tabs. - Line 0, Column 0: [Warning: pivot-id-unused]
Pivot ID 'programming-language-java' is defined in 'programming-languages' group in 'zone-pivot-groups.yml', but not used. You must use all pivot IDs in a pivot group to avoid blank tabs. - Line 0, Column 0: [Suggestion: external-image]
Image 'https://mlflow.org/docs/latest/images/llms/tracing/semantic-kernel-tracing.png' references an external site. This poses a security risk and external images are unavailable in some environments. Reference an image file within the repo instead. - Line 0, Column 0: [Suggestion: filename-incomplete - See documentation]
The filename contains an incomplete word, misspelled word, acronym, or abbreviation that is disallowed.
semantic-kernel/concepts/enterprise-readiness/observability/TOC.yml
- Line 12, Column 9: [Warning: file-not-found - See documentation]
Invalid file link: 'mlflow.mdx'.
agent-framework/user-guide/observability.md
- Line 0, Column 0: [Suggestion: external-image]
Image 'https://mlflow.org/docs/latest/images/llms/tracing/microsoft-agent-framework-tracing.png' references an external site. This poses a security risk and external images are unavailable in some environments. Reference an image file within the repo instead.
agent-framework/user-guide/workflows/observability.md
- Line 0, Column 0: [Suggestion: external-image]
Image 'https://mlflow.org/docs/latest/images/llms/tracing/microsoft-agent-framework-tracing.png' references an external site. This poses a security risk and external images are unavailable in some environments. Reference an image file within the repo instead.
semantic-kernel/concepts/enterprise-readiness/observability/index.md
- Line 0, Column 0: [Suggestion: external-image]
Image 'https://mlflow.org/docs/latest/images/llms/tracing/semantic-kernel-tracing.png' references an external site. This poses a security risk and external images are unavailable in some environments. Reference an image file within the repo instead.
For more details, please refer to the build report.
Note: Your PR may contain errors or warnings or suggestions unrelated to the files you changed. This happens when external dependencies like GitHub alias, Microsoft alias, cross repo links are updated. Please use these instructions to resolve them.
Contributor
|
Learn Build status updates of commit 3e521b4:
|
| File | Status | Preview URL | Details |
|---|---|---|---|
| semantic-kernel/concepts/enterprise-readiness/observability/telemetry-with-mlflow.md | Details | ||
| semantic-kernel/concepts/enterprise-readiness/observability/TOC.yml | Details | ||
| agent-framework/user-guide/observability.md | 💡Suggestion | Details | |
| agent-framework/user-guide/workflows/observability.md | 💡Suggestion | Details | |
| semantic-kernel/concepts/enterprise-readiness/observability/index.md | 💡Suggestion | Details |
semantic-kernel/concepts/enterprise-readiness/observability/telemetry-with-mlflow.md
- Line 0, Column 0: [Warning: pivot-id-unused]
Pivot ID 'programming-language-csharp' is defined in 'programming-languages' group in 'zone-pivot-groups.yml', but not used. You must use all pivot IDs in a pivot group to avoid blank tabs. - Line 0, Column 0: [Warning: pivot-id-unused]
Pivot ID 'programming-language-java' is defined in 'programming-languages' group in 'zone-pivot-groups.yml', but not used. You must use all pivot IDs in a pivot group to avoid blank tabs. - Line 0, Column 0: [Suggestion: external-image]
Image 'https://mlflow.org/docs/latest/images/llms/tracing/semantic-kernel-tracing.png' references an external site. This poses a security risk and external images are unavailable in some environments. Reference an image file within the repo instead. - Line 0, Column 0: [Suggestion: filename-incomplete - See documentation]
The filename contains an incomplete word, misspelled word, acronym, or abbreviation that is disallowed.
semantic-kernel/concepts/enterprise-readiness/observability/TOC.yml
- Line 12, Column 9: [Warning: file-not-found - See documentation]
Invalid file link: 'mlflow.mdx'.
agent-framework/user-guide/observability.md
- Line 0, Column 0: [Suggestion: external-image]
Image 'https://mlflow.org/docs/latest/images/llms/tracing/microsoft-agent-framework-tracing.png' references an external site. This poses a security risk and external images are unavailable in some environments. Reference an image file within the repo instead.
agent-framework/user-guide/workflows/observability.md
- Line 0, Column 0: [Suggestion: external-image]
Image 'https://mlflow.org/docs/latest/images/llms/tracing/microsoft-agent-framework-tracing.png' references an external site. This poses a security risk and external images are unavailable in some environments. Reference an image file within the repo instead.
semantic-kernel/concepts/enterprise-readiness/observability/index.md
- Line 0, Column 0: [Suggestion: external-image]
Image 'https://mlflow.org/docs/latest/images/llms/tracing/semantic-kernel-tracing.png' references an external site. This poses a security risk and external images are unavailable in some environments. Reference an image file within the repo instead.
For more details, please refer to the build report.
Note: Your PR may contain errors or warnings or suggestions unrelated to the files you changed. This happens when external dependencies like GitHub alias, Microsoft alias, cross repo links are updated. Please use these instructions to resolve them.
Signed-off-by: B-Step62 <[email protected]>
Author
|
Hi @markwallace-microsoft, resolved the conflict and addressed comments from the auto review. |
Contributor
|
Learn Build status updates of commit 169155a:
|
| File | Status | Preview URL | Details |
|---|---|---|---|
| semantic-kernel/concepts/enterprise-readiness/observability/telemetry-with-mlflow.md | Details | ||
| semantic-kernel/concepts/enterprise-readiness/observability/TOC.yml | Details | ||
| agent-framework/user-guide/observability.md | 💡Suggestion | Details | |
| agent-framework/user-guide/workflows/observability.md | 💡Suggestion | Details | |
| semantic-kernel/concepts/enterprise-readiness/observability/index.md | 💡Suggestion | Details |
semantic-kernel/concepts/enterprise-readiness/observability/telemetry-with-mlflow.md
- Line 0, Column 0: [Warning: pivot-id-unused]
Pivot ID 'programming-language-csharp' is defined in 'programming-languages' group in 'zone-pivot-groups.yml', but not used. You must use all pivot IDs in a pivot group to avoid blank tabs. - Line 0, Column 0: [Warning: pivot-id-unused]
Pivot ID 'programming-language-java' is defined in 'programming-languages' group in 'zone-pivot-groups.yml', but not used. You must use all pivot IDs in a pivot group to avoid blank tabs. - Line 0, Column 0: [Suggestion: external-image]
Image 'https://mlflow.org/docs/latest/images/llms/tracing/semantic-kernel-tracing.png' references an external site. This poses a security risk and external images are unavailable in some environments. Reference an image file within the repo instead. - Line 0, Column 0: [Suggestion: filename-incomplete - See documentation]
The filename contains an incomplete word, misspelled word, acronym, or abbreviation that is disallowed.
semantic-kernel/concepts/enterprise-readiness/observability/TOC.yml
- Line 12, Column 9: [Warning: file-not-found - See documentation]
Invalid file link: 'telemetry-with-mlflow.mdx'.
agent-framework/user-guide/observability.md
- Line 0, Column 0: [Suggestion: external-image]
Image 'https://mlflow.org/docs/latest/images/llms/tracing/microsoft-agent-framework-tracing.png' references an external site. This poses a security risk and external images are unavailable in some environments. Reference an image file within the repo instead.
agent-framework/user-guide/workflows/observability.md
- Line 0, Column 0: [Suggestion: external-image]
Image 'https://mlflow.org/docs/latest/images/llms/tracing/microsoft-agent-framework-tracing.png' references an external site. This poses a security risk and external images are unavailable in some environments. Reference an image file within the repo instead.
semantic-kernel/concepts/enterprise-readiness/observability/index.md
- Line 0, Column 0: [Suggestion: external-image]
Image 'https://mlflow.org/docs/latest/images/llms/tracing/semantic-kernel-tracing.png' references an external site. This poses a security risk and external images are unavailable in some environments. Reference an image file within the repo instead.
For more details, please refer to the build report.
Note: Your PR may contain errors or warnings or suggestions unrelated to the files you changed. This happens when external dependencies like GitHub alias, Microsoft alias, cross repo links are updated. Please use these instructions to resolve them.
Signed-off-by: B-Step62 <[email protected]>
Contributor
|
Learn Build status updates of commit 7d3cf34:
|
| File | Status | Preview URL | Details |
|---|---|---|---|
| semantic-kernel/concepts/enterprise-readiness/observability/telemetry-with-mlflow.md | Details | ||
| agent-framework/user-guide/observability.md | 💡Suggestion | Details | |
| agent-framework/user-guide/workflows/observability.md | 💡Suggestion | Details | |
| semantic-kernel/concepts/enterprise-readiness/observability/index.md | 💡Suggestion | Details | |
| semantic-kernel/concepts/enterprise-readiness/observability/TOC.yml | ✅Succeeded |
semantic-kernel/concepts/enterprise-readiness/observability/telemetry-with-mlflow.md
- Line 0, Column 0: [Warning: pivot-id-unused]
Pivot ID 'programming-language-csharp' is defined in 'programming-languages' group in 'zone-pivot-groups.yml', but not used. You must use all pivot IDs in a pivot group to avoid blank tabs. - Line 0, Column 0: [Warning: pivot-id-unused]
Pivot ID 'programming-language-java' is defined in 'programming-languages' group in 'zone-pivot-groups.yml', but not used. You must use all pivot IDs in a pivot group to avoid blank tabs. - Line 0, Column 0: [Suggestion: external-image]
Image 'https://mlflow.org/docs/latest/images/llms/tracing/semantic-kernel-tracing.png' references an external site. This poses a security risk and external images are unavailable in some environments. Reference an image file within the repo instead. - Line 0, Column 0: [Suggestion: filename-incomplete - See documentation]
The filename contains an incomplete word, misspelled word, acronym, or abbreviation that is disallowed.
agent-framework/user-guide/observability.md
- Line 0, Column 0: [Suggestion: external-image]
Image 'https://mlflow.org/docs/latest/images/llms/tracing/microsoft-agent-framework-tracing.png' references an external site. This poses a security risk and external images are unavailable in some environments. Reference an image file within the repo instead.
agent-framework/user-guide/workflows/observability.md
- Line 0, Column 0: [Suggestion: external-image]
Image 'https://mlflow.org/docs/latest/images/llms/tracing/microsoft-agent-framework-tracing.png' references an external site. This poses a security risk and external images are unavailable in some environments. Reference an image file within the repo instead.
semantic-kernel/concepts/enterprise-readiness/observability/index.md
- Line 0, Column 0: [Suggestion: external-image]
Image 'https://mlflow.org/docs/latest/images/llms/tracing/semantic-kernel-tracing.png' references an external site. This poses a security risk and external images are unavailable in some environments. Reference an image file within the repo instead.
For more details, please refer to the build report.
Note: Your PR may contain errors or warnings or suggestions unrelated to the files you changed. This happens when external dependencies like GitHub alias, Microsoft alias, cross repo links are updated. Please use these instructions to resolve them.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Hi team!
Semantic Kernel and Agent Framework both supports OpenTelemetry tracing, which allows users to export traces to third party tracing providers like MLflow. We (MLflow maintainers) have received questions about how to setup tracing for Semantic Kernel and Agent Framework from multiple times, therefore we believe it is benefitial for users to have a guide in the official documentation. Many other agent authroing frameworks have similar 3P tracing page(s) in their documentation.
Note: I could not find how to run preview website, so only checked the format via naive markdown preview. Please let me know if there is a way to build and preview doc page locally.