Skip to content
Merged
Show file tree
Hide file tree
Changes from 9 commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion blog-service/2024-06-24-manage.md
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@ import useBaseUrl from '@docusaurus/useBaseUrl';

In November 2020, we introduced Ingest Budgets V2, offering greater flexibility and granularity in metadata and fields within the ingest budget definition. Despite this update, existing V1 budgets continued to function as originally defined while only allowing V2 budgets for all new configurations going forward.

**On September 9. 2024**, Sumo Logic will deprecate and remove the existing V1 Ingest Budgets that remain defined in customer instances.
V1 Ingest Budgets are deprecated, and **On September 9. 2024**, Sumo Logic will remove the existing V1 Ingest Budgets that remain defined in customer instances.

To ensure uninterrupted service, review your current ingest budgets under [**Ingest Budgets**](/docs/manage/ingestion-volume/ingest-budgets/daily-volume#manage-ingest-budgets). Identify any budgets tagged as V1 and, if still needed, [edit and upgrade them to V2](/docs/manage/ingestion-volume/ingest-budgets/daily-volume/#versions) before the deprecation date.

Expand Down
13 changes: 8 additions & 5 deletions cid-redirects.json
Original file line number Diff line number Diff line change
Expand Up @@ -1344,7 +1344,7 @@
"/07Sumo-Logic-Apps/Partner_Integrations": "/docs/integrations/partner-integrations",
"/07Sumo-Logic-Apps/08Reference-Information-for-Sumo-Logic-Apps/Supported-Data-Formats": "/docs/get-started/system-requirements",
"/APIs": "/docs/api",
"/APIs/Ingest_Budget_Management_API": "/docs/api/ingest-budget-v1",
"/APIs/Ingest_Budget_Management_API": "/docs/api/ingest-budget-v2",
"/APIs/Access_Keys_Management_API": "/docs/api/access-keys",
"/APIs/Account_Management_API": "/docs/api/account-management",
"/APIs/Alerts-API": "/docs/api",
Expand Down Expand Up @@ -1381,6 +1381,7 @@
"/APIs/Metrics-API": "/docs/api/metrics",
"/APIs/Metrics-API/About-Metrics-API": "/docs/api/metrics",
"/APIs/Metrics_Query_API": "/docs/api/metrics-query",
"/docs/api/ingest-budget-v1": "/docs/api/ingest-budget-v2",
"/APIs/Ingest_Budget_Management_API_V2": "/docs/api/ingest-budget-v2",
"/APIs/General-API-Information/API-Authentication": "/docs/api/getting-started",
"/APIs/General_API_Information/API_Authentication": "/docs/api/getting-started",
Expand Down Expand Up @@ -3164,11 +3165,11 @@
"/Manage/Ingestion-and-Volume/Data_Volume_Index/Log_and_Tracing_Data_Volume_Index": "/docs/manage/ingestion-volume/data-volume-index/log-tracing-data-volume-index",
"/Manage/Ingestion-and-Volume/Data_Volume_Index/Metrics_Data_Volume_Index": "/docs/manage/ingestion-volume/data-volume-index/metrics-data-volume-index",
"/Manage/Ingestion-and-Volume/Enable-and-Manage-the-Data-Volume-Index": "/docs/manage/ingestion-volume/data-volume-index",
"/Manage/Ingestion-and-Volume/Ingest_Budgets/Assign_Collector_to_Ingest_Budget": "/docs/manage/ingestion-volume/ingest-budgets/daily-volume/assign-collector-ingest-budget",
"/Manage/Ingestion-and-Volume/Ingest_Budgets/Assign_Collector_to_Ingest_Budget": "/docs/manage/ingestion-volume/ingest-budgets/daily-volume",
"/Manage/Ingestion-and-Volume/Monitor_Ingestion_and_Receive_Alerts": "/docs/manage/ingestion-volume/monitor-ingestion-receive-alerts",
"/Manage/Ingestion-and-Volume/Monitor-Ingestion-and-Receive-Alerts": "/docs/manage/ingestion-volume/monitor-ingestion-receive-alerts",
"/Manage/Ingestion-and-Volume/Ingest_Budgets/Ingest_Budgets_Quick_Start_Tutorial": "/docs/manage/ingestion-volume/ingest-budgets/daily-volume/quickstart",
"/docs/manage/ingestion-volume/ingest-budgets/quickstart": "/docs/manage/ingestion-volume/ingest-budgets/daily-volume/quickstart",
"/Manage/Ingestion-and-Volume/Ingest_Budgets/Ingest_Budgets_Quick_Start_Tutorial": "/docs/manage/ingestion-volume/ingest-budgets/daily-volume",
"/docs/manage/ingestion-volume/ingest-budgets/quickstart": "/docs/manage/ingestion-volume/ingest-budgets/daily-volume",
"/Manage/Partitions": "/docs/manage/partitions",
"/manage/partitions_and-data_tiers/data_tiers": "/docs/manage/partitions/data-tiers",
"/Manage/Partitions/About-Partitions": "/docs/manage/partitions",
Expand Down Expand Up @@ -3740,7 +3741,9 @@
"/Beta/Grant_Access_to_Data_in_Audit_Indexes": "/docs/manage/users-roles/roles/create-manage-roles",
"/Beta/Health_Events": "/docs/manage/health-events",
"/Beta/Ingest_Budgets": "/docs/manage/ingestion-volume/ingest-budgets",
"/docs/manage/ingestion-volume/ingest-budgets/assign-collector-ingest-budget": "/docs/manage/ingestion-volume/ingest-budgets/daily-volume/assign-collector-ingest-budget",
"/docs/manage/ingestion-volume/ingest-budgets/assign-collector-ingest-budget": "/docs/manage/ingestion-volume/ingest-budgets/daily-volume",
"/docs/manage/ingestion-volume/ingest-budgets/daily-volume/assign-collector-ingest-budget": "/docs/manage/ingestion-volume/ingest-budgets/daily-volume",
"/docs/manage/ingestion-volume/ingest-budgets/daily-volume/quickstart": "/docs/manage/ingestion-volume/ingest-budgets/daily-volume",
"/Beta/Installation_Tokens": "/docs/manage/security/installation-tokens",
"/Beta/Metadata_Ingest_Budgets": "/docs/manage/ingestion-volume/ingest-budgets/daily-volume",
"/Beta/Metrics-Rules": "/docs/metrics/metric-rules-editor",
Expand Down
5 changes: 0 additions & 5 deletions docs/api/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -100,11 +100,6 @@ To connect with other Sumo Logic users, post feedback, or ask a question, visit
<a href="/docs/api/health-events"><img src={useBaseUrl('img/icons/company-value/heart-wellness.png')} alt="Thumbnail icon" width="50"/><h4>Health Events</h4></a>
</div>
</div>
<div className="box smallbox card">
<div className="container">
<a href="/docs/api/ingest-budget-v1"><img src={useBaseUrl('img/icons/operations/data-volume.png')} alt="Thumbnail icon" width="50"/><h4>Ingest Budget V1</h4></a>
</div>
</div>
<div className="box smallbox card">
<div className="container">
<a href="/docs/api/ingest-budget-v2"><img src={useBaseUrl('img/icons/operations/data-volume.png')} alt="Thumbnail icon" width="50"/><h4>Ingest Budget V2</h4></a>
Expand Down
55 changes: 0 additions & 55 deletions docs/api/ingest-budget-v1.md

This file was deleted.

6 changes: 2 additions & 4 deletions docs/api/ingest-budget-v2.md
Original file line number Diff line number Diff line change
Expand Up @@ -13,10 +13,8 @@ import ApiRoles from '../reuse/api-roles.md';

The Ingest Budget Management V2 APIs allow you to manage metadata-based [ingest budgets](/docs/manage/ingestion-volume/ingest-budgets) (with a scope) from HTTP endpoints.

You can use [V1 APIs](/docs/api/ingest-budget-v1) to manage ingest budgets with a Field Value.

:::note
[V1 budgets](/docs/api/ingest-budget-v1) will be deprecated September 16, 2024.
Ingest Budget Management V1 APIs have been removed and are no longer supported.
:::

## Prerequisites
Expand Down Expand Up @@ -52,4 +50,4 @@ You can use [V1 APIs](/docs/api/ingest-budget-v1) to manage ingest budgets with

-->

To manage ingest budgets, you must have the **Manage Ingest Budgets** role capability. Enabling this will automatically enable the **Manage Collectors** capability. The Manage Collectors capability on its own permits the re-assignment of budgets to different Collectors, but not creating or deleting them. For more information, see [Ingest Budgets](/docs/manage/ingestion-volume/ingest-budgets).
To manage ingest budgets, you must have the **Manage Ingest Budgets** role capability. Enabling this will automatically enable the **Manage Collectors** capability. The Manage Collectors capability on its own permits the re-assignment of budgets to different Collectors, but not creating or deleting them. For more information, see [Ingest Budgets](/docs/manage/ingestion-volume/ingest-budgets).
1 change: 0 additions & 1 deletion docs/get-started/quickstart.md
Original file line number Diff line number Diff line change
Expand Up @@ -155,6 +155,5 @@ Contact us at the [Sumo Dojo Slack](https://sumodojo.slack.com/) or [submit a su
* [Choosing a Sumo Logic Collector and Source](/docs/send-data/choose-collector-source/)
* [Kubernetes Quickstart](/docs/observability/kubernetes/quickstart). Get up and running with the Sumo Logic Kubernetes solution in minutes.
* [Traces Quickstart](/docs/apm/traces/quickstart). This guide demonstrates how to measure application microservice performance.
* [Ingest Budgets Quickstart](/docs/manage/ingestion-volume/ingest-budgets/daily-volume/quickstart). Learn how to create and use Ingest Budgets.

See more quickstart tutorials in the [Sumo Logic Training Portal](/docs/get-started/training-certification-faq/#how-do-i-access-the-training-portal).
Original file line number Diff line number Diff line change
@@ -1,9 +1,15 @@
---
slug: /manage/ingestion-volume/ingest-budgets/daily-volume
id: daily-volume
title: Daily Volume
description: Control the capacity of daily log ingestion volume sent to Sumo Logic from Collectors.
---

import useBaseUrl from '@docusaurus/useBaseUrl';

:::note
If you want to use APIs to manage ingest budgeting, you must use [Ingest Budget Management V2 APIs](/docs/api/ingest-budget-v2/). Ingest Budget Management V1 APIs have been removed and are no longer supported.
:::

Ingest budgets control the daily volume of log data sent to Sumo Logic. Log data can be assigned to an ingest budget that defines a daily log capacity limit. The capacity is tracked based on the combined volume from all sources of log data. When an ingest budget's capacity is reached you can have Sumo Logic stop collecting the log data assigned to it to control costs.

Ingest budgets automatically reset their capacity utilization tracking every 24 hours based on the time and time zone you specify. For example, you can schedule an ingest budget to refresh every day at 02:00 in the America/Los_Angeles time zone. You can manually [reset an ingest budget](#reset-ingest-budget) at any time.
Expand Down Expand Up @@ -42,25 +48,7 @@ For example, a **Scope** expression like `_sourceCategory=/dev/catalog/*` im

See more [budget assignment examples](#budget-assignment-examples) below and review the [rules](#rules) above.

## Versions

There are two versions of ingest budgets:

* V1 ingest budgets are older and have a **Field Value** for Collector assignment. They are shown with a **V1** in the **Name** cell.<br/> ![v1 budget tag.png](/img/manage/ingestion-volume/v1-budget-tag.png)
* V2 ingest budgets provide you the ability to assign budgets to your log data by either [Fields](/docs/manage/fields) or the following [built in metadata](/docs/search/get-started-with-search/search-basics/built-in-metadata) fields, `_collector`, `_source`, `_sourceCategory`, `_sourceHost`, and `_sourceName`.


## Migrating V1 budgets to V2

* You can edit an existing **V1** budget by providing a **scope** to change it to a **V2** budget that is metadata-based.
* V2 budgets are manageable with the [Ingest Budget Management **V2** API](/docs/api/ingest-budget-v2).
* V1 budgets will be deprecated on September 16, 2024.


Stopping collection differences:

* First version ingest budgets take around 30 seconds to stop collecting when capacity is reached. We recommend setting a soft limit that is lower than your needed hard limit.
* Second version ingest budgets drop data instantly once capacity is reached.
[V2 ingest budgets](/docs/api/ingest-budget-v2/) provide you the ability to assign budgets to your log data by either [fields](/docs/manage/fields) or the following [built in metadata](/docs/search/get-started-with-search/search-basics/built-in-metadata) fields, `_collector`, `_source`, `_sourceCategory`, `_sourceHost`, and `_sourceName`.

## Source type behavior

Expand All @@ -72,18 +60,17 @@ A few Sources on Hosted Collectors behave differently when instructed to stop co

## Tools

* [Ingest Budget Management API V2](/docs/api/ingest-budget-v1.md)
* [Ingest Budget Management API V1](/docs/api/ingest-budget-v2.md)
* [Ingest Budget Management API V2](/docs/api/ingest-budget-v2.md)
* Terraform provider: [sumologic_ingest_budget_v2](https://registry.terraform.io/providers/SumoLogic/sumologic/latest/docs/resources/ingest_budget_v2)

## Manage ingest budgets

Use the **Ingest Budgets** page to manage your ingest budgets.
Use the **Ingest Budgets** page to manage your ingest budgets.

[**Classic UI**](/docs/get-started/sumo-logic-ui-classic). To access the Ingest Budgets page, in the main Sumo Logic menu select **Manage Data > Collection > Ingest Budgets**.

[**Classic UI**](/docs/get-started/sumo-logic-ui-classic). To access the Ingest Budgets page, in the main Sumo Logic menu select **Manage Data > Collection > Ingest Budgets**.
[**New UI**](/docs/get-started/sumo-logic-ui/). To access the Ingest Budgets page, in the top menu select **Configuration**, and then under **Data Collection** select **Ingest Budget**. You can also click the **Go To...** menu at the top of the screen and select **Ingest Budget**.

[**New UI**](/docs/get-started/sumo-logic-ui/). To access the Ingest Budgets page, in the top menu select **Configuration**, and then under **Data Collection** select **Ingest Budget**. You can also click the **Go To...** menu at the top of the screen and select **Ingest Budget**.


![metadata ingest budgetspage.png](/img/manage/ingestion-volume/metadata-ingest-budgets-page.png)

Expand Down Expand Up @@ -117,7 +104,7 @@ When hovering over a row in the Ingest Budgets table there are icons that appear

#### Create ingest budget

1. [**Classic UI**](/docs/get-started/sumo-logic-ui-classic). In the main Sumo Logic menu, select **Manage Data > Collection > Ingest Budgets**. <br/>[**New UI**](/docs/get-started/sumo-logic-ui). In the top menu select **Configuration**, and then under **Data Collection** select **Ingest Budget**. You can also click the **Go To...** menu at the top of the screen and select **Ingest Budget**.
1. [**Classic UI**](/docs/get-started/sumo-logic-ui-classic). In the main Sumo Logic menu, select **Manage Data > Collection > Ingest Budgets**. <br/>[**New UI**](/docs/get-started/sumo-logic-ui). In the top menu select **Configuration**, and then under **Data Collection** select **Ingest Budget**. You can also click the **Go To...** menu at the top of the screen and select **Ingest Budget**.
1. Click the **+ Add Budget** button on the top right of the table. A panel named **Create Ingest Budget** appears to the right of the Ingest Budgets table.
1. Provide the following information, all fields are required except Description.

Expand Down Expand Up @@ -146,7 +133,7 @@ When hovering over a row in the Ingest Budgets table there are icons that appear

You can manually reset a budget at any time to set its capacity utilization tracking to zero. This won't affect the next scheduled reset time and can be done as many times as needed.

1. [**Classic UI**](/docs/get-started/sumo-logic-ui-classic). In the main Sumo Logic menu, select **Manage Data > Collection > Ingest Budgets**. <br/>[**New UI**](/docs/get-started/sumo-logic-ui). In the top menu select **Configuration**, and then under **Data Collection** select **Ingest Budget**. You can also click the **Go To...** menu at the top of the screen and select **Ingest Budget**.
1. [**Classic UI**](/docs/get-started/sumo-logic-ui-classic). In the main Sumo Logic menu, select **Manage Data > Collection > Ingest Budgets**. <br/>[**New UI**](/docs/get-started/sumo-logic-ui). In the top menu select **Configuration**, and then under **Data Collection** select **Ingest Budget**. You can also click the **Go To...** menu at the top of the screen and select **Ingest Budget**.
1. In the table find the ingest budget you want to reset and click the row to open its details pane.
1. Click the **Reset** button.

Expand Down Expand Up @@ -296,23 +283,3 @@ _index=sumologic_system_events "IngestBudget"
| where eventType = "Health-Change" AND resourceType = "IngestBudget" and severity="Warning"
```

import useBaseUrl from '@docusaurus/useBaseUrl';

## Guide contents

In this section, we'll introduce the following concepts:

<div className="box-wrapper">
<div className="box smallbox card">
<div className="container">
<a href="/docs/manage/ingestion-volume/ingest-budgets/daily-volume/assign-collector-ingest-budget"><img src={useBaseUrl('img/icons/operations/data-volume.png')} alt="icon" width="40"/><h4>Assign Collector to Ingest Budget</h4></a>
<p>Learn how to assign a Collector to an Ingest Budget.</p>
</div>
</div>
<div className="box smallbox card">
<div className="container">
<a href="/docs/manage/ingestion-volume/ingest-budgets/daily-volume/quickstart"><img src={useBaseUrl('img/icons/operations/data-volume.png')} alt="icon" width="40"/><h4>Ingest Budgets Quickstart Tutorial</h4></a>
<p>Learn how to create and use Ingest Budgets.</p>
</div>
</div>
</div>
Loading
Loading