You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/planetary-computer/troubleshooting-ingestion.md
+11-11Lines changed: 11 additions & 11 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -13,7 +13,7 @@ ms.date: 06/16/2025
13
13
14
14
# Troubleshooting data ingestion in Microsoft Planetary Computer Pro
15
15
16
-
Data ingestion issues in Microsoft Planetary Computer Pro GeoCatalog typically fall into two categories: access permission problems and STAC validation errors. This article helps you identify and resolve these common ingestion failures.
16
+
Data ingestion issues in Microsoft Planetary Computer Pro GeoCatalog typically fall into two categories: access permission problems and STAC (SpatioTemporal Asset Catalog) validation errors. This article helps you identify and resolve these common ingestion failures.
17
17
18
18
## Prerequisites
19
19
@@ -31,17 +31,17 @@ Data ingestion workflows fail with specific [error codes](./error-codes-ingestio
31
31
32
32
## Identifying Errors during Ingestion
33
33
34
-
For [Single Item Ingestion](./ingestion-overview#single-item-ingestion), if an ingestion error occurs, the error code will be returned by the API response or in the user interface.
34
+
For [Single Item Ingestion](./ingestion-overview#single-item-ingestion), if an ingestion error occurs, the API response or user interface returns the error code.
35
35
36
-
For [Bulk Ingestion](./ingestion-overview/#bulk-ingestion), the errors can be different for each of the individual STAC Items you have attempted to ingest. To see the individual errors, navigate to the Azure portal and locate the **Diagnostic Settings** for your Geocatalog resource. Here, you can enable **Ingestion Logs.**
36
+
For [Bulk Ingestion](./ingestion-overview/#bulk-ingestion), the errors can be different for each of the individual STAC Items. To see the individual errors, navigate to the Azure portal and locate the **Diagnostic Settings** for your GeoCatalog resource. Here, you can enable **Ingestion Logs.**
37
37
38
38
[](media/ingestion-diagnostic-settings.png#lightbox)
39
39
40
40
Once logging is enabled, attempt your ingestion again. If the ingestion fails, go to the diagnostic endpoint you specified to review the errors.
41
41
42
42
## Cause 1: GeoCatalog can't access source data
43
43
44
-
The GeoCatalog service lacks the necessary permissions to read your STAC metadata (for example, `catalog.json`) and the associated data assets (for example, GeoTIFF files). This is because a valid [ingestion source](./ingestion-source.md)hasn't been configured for the storage location. This applies to both the metadata files and the asset files, which may be in different locations.
44
+
The GeoCatalog service lacks the necessary permissions to read your STAC metadata (for example, `catalog.json`) and the associated data assets (for example, GeoTIFF files). This error is because a valid [ingestion source](./ingestion-source.md)isn't configured for the storage location. Ingestion sources must be configured for both the metadata files and the asset files if they're configured in different locations.
@@ -58,7 +58,7 @@ The GeoCatalog service lacks the necessary permissions to read your STAC metadat
58
58
- Check that the managed identity is associated with your GeoCatalog
59
59
60
60
For SAS tokens:
61
-
- Verify the token hasn't expired
61
+
- Verify the token isn't expired
62
62
- Ensure the token has `read` and `list` permissions
63
63
- Confirm the token is scoped to the correct container
64
64
@@ -78,24 +78,24 @@ After verifying and correcting the ingestion source configuration, try the inges
78
78
79
79
## Cause 2: STAC metadata validation failed
80
80
81
-
The ingestion service strictly enforces the [STAC specification](./stac-overview.md). Your ingestion will fail if your STAC Catalog, Collection, or Item JSONs don't conform to the standard or meet specific GeoCatalog requirements.
81
+
The ingestion service strictly enforces the [STAC specification](./stac-overview.md). Your ingestion fails if your STAC Catalog, Collection, or Item JSONs don't conform to the standard or meet specific GeoCatalog requirements.
82
82
83
83
### Solution 2.1: Fix invalid STAC format and values
84
84
85
-
1.**Validate Locally:** Before ingesting, use a library like `pystac` to validate your STAC objects. This can catch many common formatting issues.
85
+
1.**Validate Locally:** Before ingesting, use a library like `pystac` to validate your STAC objects. This approach can catch many common formatting issues before ingesting data.
86
86
2.**Check Required Fields:**
87
87
* Ensure all mandatory STAC fields are present in your metadata.
88
88
* For single-item ingestion, the STAC Item JSON **must** include the `collection` field, with its value set to the ID of the target collection in your GeoCatalog.
89
89
3.**Format Datetime:** Verify that all `datetime` fields conform to the [ISO 8601](https://en.wikipedia.org/wiki/ISO_8601) standard (for example, `YYYY-MM-DDTHH:MM:SSZ`). The `pystac` library provides utilities to format datetimes correctly.
90
90
4.**Check for Invalid Characters and Lengths:**
91
-
* STAC Collection IDs, Item IDs, and Asset keys must not contain the following characters: `-`, `_`, `+`, `(`, `)`, and `.`.
92
-
* Item IDs must be less than 150 characters.
93
-
* Asset keys must be less than 256 characters.
91
+
* STAC `Collection IDs`, `Item IDs`, and `Asset keys` must not contain the following characters: `-`, `_`, `+`, `(`, `)`, and `.`.
92
+
*`Item IDs` must be fewer than 150 characters.
93
+
*`Asset keys` must be fewer than 256 characters.
94
94
5.**Retry Ingestion:** After correcting the STAC metadata, try the ingestion again.
95
95
96
96
### Solution 2.2: Simplify STAC extensions
97
97
98
-
1.**Identify Extensions:** Check if your STAC Items use any [STAC extensions](https://stac-extensions.github.io/). While powerful, they add complexity to validation, and many are not finalized.
98
+
1.**Identify Extensions:** Check if your STAC Items use any [STAC extensions](https://stac-extensions.github.io/). While powerful, they add complexity to validation, and many aren't in a finalized status.
99
99
2.**Remove Non-Essential Extensions:** If you suspect an extension is causing a `StacValidationFailed` error, try removing it from your STAC Item's `stac_extensions` list and any associated fields.
100
100
3.**Re-validate and Retry:** Validate the simplified STAC Item locally, then retry the ingestion.
0 commit comments