Skip to content
This repository was archived by the owner on Sep 2, 2025. It is now read-only.

Commit b0e4c7f

Browse files
Merge pull request #1804 from splunk/urbiz-OD6094-cloud-logs
[6094]: Clean up logs in Cloud docs
2 parents 010817f + dbef389 commit b0e4c7f

File tree

10 files changed

+22
-659
lines changed

10 files changed

+22
-659
lines changed

gdi/get-data-in/connect/aws/aws-logs.rst

Lines changed: 5 additions & 415 deletions
Large diffs are not rendered by default.

gdi/get-data-in/connect/aws/aws-troubleshooting.rst

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@ Troubleshoot your AWS connection
88
:description: Resolve AWS policy and permissions conflicts in Splunk Observability Cloud.
99

1010

11-
If you experience issues when connecting Splunk Observability Cloud to your Amazon Web Services (AWS) account, they might be caused by conflicts between policies and permissions. See :ref:`aws-ts-logs` for specific log troubleshooting and :ref:`aws-ts-metric-streams` for issues specific to Metric Streams.
11+
If you experience issues when connecting Splunk Observability Cloud to your Amazon Web Services (AWS) account, they might be caused by conflicts between policies and permissions. See :ref:`aws-ts-metric-streams` for issues specific to Metric Streams.
1212

1313
.. caution:: Splunk is not responsible for data availability, and it can take up to several minutes (or longer, depending on your configuration) from the time you connect until you start seeing valid data from your account.
1414

gdi/get-data-in/connect/aws/aws-ts-logs.rst

Lines changed: 0 additions & 95 deletions
This file was deleted.

gdi/get-data-in/connect/aws/aws-ts-metric-streams.rst

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@ See the following topics when experiencing Metric Streams issues from AWS.
1111

1212
.. note::
1313

14-
See also :ref:`aws-troubleshooting` and :ref:`aws-ts-logs`.
14+
See also :ref:`aws-troubleshooting`.
1515

1616
I've enabled Metric Streams in my AWS integration but I do not see any metrics streaming in
1717
==================================================================================================

gdi/get-data-in/connect/aws/get-awstoc.rst

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -17,12 +17,11 @@ Connect AWS to Splunk Observability Cloud
1717
Connect Metric Streams from the AWS console <aws-console-ms>
1818
Connect to AWS using the Splunk API <aws-apiconfig>
1919
Connect to AWS with Terraform <aws-terraformconfig>
20-
Collect logs from AWS <aws-logs>
20+
Send AWS logs to Splunk Platform <aws-logs>
2121
CloudFormation templates <aws-cloudformation>
2222
Next steps <aws-post-install>
2323
Troubleshoot your AWS connection <aws-troubleshooting>
2424
Troubleshoot Metric Streams <aws-ts-metric-streams>
25-
Troubleshoot logs <aws-ts-logs>
2625
GetMetricStatistics API deprecation notice <aws-api-notice>
2726

2827
You have several data ingestion and connection methods when it comes to monitoring your Amazon Web Services (AWS) data in Splunk Observability Cloud.
Lines changed: 6 additions & 111 deletions
Original file line numberDiff line numberDiff line change
@@ -1,121 +1,16 @@
1-
21
.. _ingest-azure-log-data:
2+
.. _azure-logs:
33

44
*********************************************
5-
Send Azure logs to Splunk Log Observer
5+
Send Azure logs to Splunk Platform
66
*********************************************
77

88
.. meta::
9-
:description: Learn how to send logs from your Azure services to Splunk Observability Cloud and Splunk Log Observer using Azure Event Hub.
10-
11-
.. caution::
12-
13-
Splunk Log Observer is no longer available for new users. If you have a Log Observer entitlement, you must transition to Splunk Cloud Platform or Splunk Enterprise. Read more at :ref:`lo-transition`.
14-
15-
You can also use the Data Manager to send Azure logs to Splunk Platform. Learn how at :new-page:`Onboarding for Azure data in Data Manager <https://docs.splunk.com/Documentation/DM/1.8.2/User/StartConfigurationAzureAD>`.
16-
17-
You can send logs from Azure to Splunk Log Observer by deploying a function that prepares and sends log data to the Splunk HTTP Event Collector (HEC) endpoint. To get started, follow these instructions.
18-
19-
Prerequisites
20-
=================================================
21-
22-
To send logs from Azure to Splunk Observability Cloud, you need the following:
23-
24-
- Access to Log Observer in Splunk Observability Cloud. See :ref:`logs-logs`.
25-
- An ingest token in your organization. See :ref:`admin-org-tokens`.
26-
- An Event Hub namespace in Azure to use for logs forwarding. See Event Hub in the Azure documentation.
27-
28-
Create an event hub in Azure
29-
=================================================
30-
31-
Azure uses diagnostic settings to send data to Event Hubs. Each resource you want to monitor must have a diagnostic setting. Follow these steps to configure an event hub for each use case:
32-
33-
#. In Azure, go to :guilabel:`Event Hubs` and select :guilabel:`Create`.
34-
35-
#. Select your Event Hub namespace.
36-
37-
#. Set the name of the event hub to one of the following values depending on which logs you want to forward:
38-
39-
.. tabs::
40-
41-
.. tab:: Activity logs
42-
43-
Event Hub name: ``insights-activity-logs``
44-
45-
.. note:: If you set a different hub name, update the function application settings to use the right name.
46-
47-
.. tab:: Microsoft Entra ID logs (formerly Azure Active Directory)
48-
49-
Event Hub name: ``insights-logs-aad``
50-
51-
.. note:: If you set a different hub name, update the function application settings to use the right name.
52-
53-
.. tab:: Diagnostics logs
54-
55-
Event Hub name: ``insights-logs-diag``
56-
57-
.. note:: If you set a different hub name, update the function application settings to use the right name.
58-
59-
.. tab:: Metrics data
60-
61-
Event Hub name: ``insights-metrics-pt1m``
62-
63-
.. note:: If you set a different hub name, update the function application settings to use the right name.
64-
65-
#. Set the number of partitions. Use at least 4 partitions.
66-
67-
#. Select :guilabel:`Create`.
68-
69-
Configure diagnostic settings to send logs
70-
===================================================
71-
72-
After you've created the event hub, follow these steps to activate diagnostic settings:
73-
74-
#. In Azure, select the resource.
75-
76-
#. Select :guilabel:`Monitoring`, then :guilabel:` Diagnostic settings`.
77-
78-
#. Create a new setting or edit an existing setting.
79-
80-
#. Select the events you want to log.
81-
82-
#. Select :guilabel:`Stream to an event hub` and select the event hub you've created.
83-
84-
#. Select :guilabel:`Save`.
85-
86-
Set up the forwarding function in Azure
87-
==================================================
88-
89-
To deploy the Azure function, click the following button:
90-
91-
.. raw:: html
92-
93-
<a href="https://portal.azure.com/#blade/Microsoft_Azure_CreateUIDef/CustomDeploymentBlade/uri/https%3A%2F%2Fraw.githubusercontent.com%2Fsplunk%2Fazure-functions-splunk%2Fmaster%2Fevent-hubs-hec%2Fdeploy%2FazureDeploy.json/createUIDefinitionUri/https%3A%2F%2Fraw.githubusercontent.com%2Fsplunk%2Fazure-functions-splunk%2Fmaster%2Fevent-hubs-hec%2Fdeploy%2FazureDeploy.portal.json" target="_blank"><img src="https://aka.ms/deploytoazurebutton"/></a>
94-
95-
In the :guilabel:`Function App Settings` section, enter the following details:
96-
97-
.. list-table::
98-
:header-rows: 1
99-
:widths: 40, 60
100-
:width: 100%
101-
102-
* - Setting
103-
- Value
104-
* - Event Hub Namespace
105-
- The namespace that contains the event hub you've created.
106-
* - Splunk HEC Endpoint
107-
- ``https://ingest.<realm>.signalfx.com/v1/log`` where ``<realm>`` is your Splunk Observability Cloud realm. See :ref:`splunk-hec-exporter` for more information.
108-
* - Splunk HEC Token
109-
- Your Splunk Observability Cloud ingest token. See :ref:`admin-org-tokens`.
110-
111-
.. include:: /_includes/realm-note.rst
9+
:description: Learn how to send logs from your Azure services to Splunk.
11210

113-
Security considerations
114-
===================================================
11+
Log collection is not available in Splunk Observability Cloud.
11512

116-
Azure encrypts settings by default. For increased security, you can transfer one or more of settings to a Key Vault. See the Key Vault documentation in the Azure docs for more information.
13+
Instead, you can use the Data Manager to send your Azure logs to Splunk Platform. Learn how at :new-page:`Onboarding for Azure data in Data Manager <https://docs.splunk.com/Documentation/DM/1.8.2/User/StartConfigurationAzureAD>`. To query logs, use Log Observer Connect. See more at :ref:`logs-intro-logconnect`.
11714

118-
Additional resources
119-
==================================================
15+
If you have a Log Observer entitlement, you must transition to Splunk Cloud Platform or Splunk Enterprise. Read more at :ref:`lo-transition`.
12016

121-
For examples and additional information, see :new-page:`https://github.com/splunk/azure-functions-splunk/tree/master/event-hubs-hec <https://github.com/splunk/azure-functions-splunk/tree/master/event-hubs-hec>` on GitHub.

gdi/get-data-in/connect/azure/azure.rst

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@ Connect to Azure and send data to Splunk Observability Cloud
1111
:hidden:
1212

1313
Azure metrics <azure-metrics>
14-
Azure logs <azure-logs-ingestion>
14+
Send Azure logs to Splunk Platform <azure-logs-ingestion>
1515

1616
Splunk Observability Cloud provides an integration with Microsoft Azure, lets you travel through Azure entities, and includes built-in dashboards to help you monitor Azure services.
1717

gdi/get-data-in/connect/gcp/gcp-logs.rst

Lines changed: 5 additions & 31 deletions
Original file line numberDiff line numberDiff line change
@@ -2,43 +2,17 @@
22
.. _ingest-gcp-log-data:
33

44
********************************************************
5-
Ingest Google Cloud Platform log data
5+
Send GCP logs to Splunk Platform
66
********************************************************
77

88
.. meta::
9-
:description: Send Google Could Platform / GCP logs to Splunk Observability Cloud.
9+
:description: Send Google Could Platform / GCP logs to Splunk.
1010

11-
.. toctree::
12-
:hidden:
11+
Log collection is not available in Splunk Observability Cloud.
1312

14-
.. caution::
13+
Instead, you can use the Data Manager to send your GCP logs to Splunk Platform. Learn how at :new-page:`Onboard GCP in Data Manager <https://docs.splunk.com/Documentation/DM/1.8.2/User/GCPAbout>`. To query logs, use Log Observer Connect. See more at :ref:`logs-intro-logconnect`.
1514

16-
Splunk Log Observer is no longer available for new users. If you have a Log Observer entitlement, you must transition to Splunk Cloud Platform or Splunk Enterprise. Read more at :ref:`lo-transition`.
15+
If you have a Log Observer entitlement, you must transition to Splunk Cloud Platform or Splunk Enterprise. Read more at :ref:`lo-transition`.
1716

18-
You can also use the Data Manager to send GCP logs to Splunk Platform. Learn how at :new-page:`Onboard GCP in Data Manager <https://docs.splunk.com/Documentation/DM/1.8.2/User/GCPAbout>`.
19-
20-
To send GCP logging data to Splunk Observability Cloud's Log Observer, create a Pub/Sub subscription and use the :new-page:`Pub/Sub to Splunk Dataflow template <https://cloud.google.com/dataflow/docs/guides/templates/provided-streaming#cloudpubsubtosplunk>` to create a Dataflow job. The Dataflow job takes messages from the Pub/Sub subscription, converts payloads into Splunk HTTP Event Collector (HEC) event format, and forwards them to Splunk Observability Cloud, where the whole event (JSON payload and its information) is ingested.
21-
22-
Splunk Observability Cloud only supports push-based GCP log export. To learn more, see :new-page:`Scenarios for exporting Cloud Logging data: Splunk <https://cloud.google.com/architecture/exporting-stackdriver-logging-for-splunk>`.
23-
24-
Ingest logs from GCP
25-
=================================================
26-
27-
To send GCP logs to Splunk Observability Cloud:
28-
29-
#. Use the example ``gcloud`` command provided in :new-page:`Option A: Stream logs using Pub/Sub to Splunk Dataflow <https://cloud.google.com/architecture/exporting-stackdriver-logging-for-splunk#deploy_splunk_dataflow_template>`.
30-
31-
#. Apply the with the following changes:
32-
33-
- Change the token in the sample syntax (``token=your-splunk-hec-token``) to a Splunk Observability Cloud organization access token with ingest permission. For more information about organization access tokens, see :ref:`admin-org-tokens`.
34-
35-
- Change the URL in the sample syntax (``url=your-splunk-hec-url``) to point to the real-time log data ingest endpoint for Splunk Observability Cloud: ``https://ingest.{REALM}.signalfx.com/v1/log``.
36-
37-
Manage delivery failures
38-
------------------------------------------------
39-
40-
Any response code that is not 2xx, including throttling, indicates a message delivery failure.
41-
42-
If message delivery fails, see how to handle delivery failures of log exports to Splunk using Dataflow at :new-page:`GCP documentation <https://cloud.google.com/architecture/deploying-production-ready-log-exports-to-splunk-using-dataflow#replay_failed_messages>`.
4317

4418

gdi/get-data-in/connect/gcp/gcp.rst

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@ Connect to Google Cloud Platform
1111
:hidden:
1212

1313
GCP metrics <gcp-metrics>
14-
GCP logs <gcp-logs>
14+
Send GCP logs to Splunk Platform <gcp-logs>
1515

1616
With a Google Cloud Platform (GCP) integration in Splunk Observability Cloud, you can track your Google Cloud Monitoring metrics and monitor your GCP services in one place. To configure a GCP integration with Splunk Infrastructure Monitoring, check the prerequisites and follow the instructions on this document. You can also :ref:`use the API <gcp-api>` to connect to GCP.
1717

0 commit comments

Comments
 (0)