Skip to content

Commit 4eafd01

Browse files
authored
Merge pull request #301405 from prasadko/planetary-computer-pro-ingestion-troubleshooting-update
Ingestion Troubleshooting and Error Codes
2 parents 3277a5f + 169f21c commit 4eafd01

20 files changed

+354
-21
lines changed

.gitignore

Lines changed: 112 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -46,3 +46,115 @@ articles/planetary-computer/image_syntax_checker.py
4646
articles/planetary-computer/image-file-fixer.py
4747
articles/planetary-computer/orphaned-media.py
4848
articles/planetary-computer/orphaned_media_files.txt
49+
articles/planetary-computer/naip-airports.md
50+
articles/planetary-computer/sentinel-2-l2a-grindavik.md
51+
articles/planetary-computer/temp_editor.md
52+
articles/planetary-computer/umbra-sar.md
53+
articles/planetary-computer/geocatalog_configs/buildingfootprint/mosaics.json
54+
articles/planetary-computer/geocatalog_configs/buildingfootprint/render-options.json
55+
articles/planetary-computer/geocatalog_configs/buildingfootprint/stac.json
56+
articles/planetary-computer/geocatalog_configs/buildingfootprint/tile-settings.json
57+
articles/planetary-computer/geocatalog_configs/ecmwf-forecast/mosaics.json
58+
articles/planetary-computer/geocatalog_configs/ecmwf-forecast/render-options.json
59+
articles/planetary-computer/geocatalog_configs/ecmwf-forecast/stac.json
60+
articles/planetary-computer/geocatalog_configs/ecmwf-forecast/tile-settings.json
61+
articles/planetary-computer/geocatalog_configs/esa-cci-lc/mosaics.json
62+
articles/planetary-computer/geocatalog_configs/esa-cci-lc/render-options.json
63+
articles/planetary-computer/geocatalog_configs/esa-cci-lc/stac.json
64+
articles/planetary-computer/geocatalog_configs/esa-cci-lc/tile-settings.json
65+
articles/planetary-computer/geocatalog_configs/esa-cci-lc-netcdf/mosaics.json
66+
articles/planetary-computer/geocatalog_configs/esa-cci-lc-netcdf/render-options.json
67+
articles/planetary-computer/geocatalog_configs/esa-cci-lc-netcdf/stac.json
68+
articles/planetary-computer/geocatalog_configs/esa-cci-lc-netcdf/tile-settings.json
69+
articles/planetary-computer/geocatalog_configs/fws-nwi/mosaics.json
70+
articles/planetary-computer/geocatalog_configs/fws-nwi/stac.json
71+
articles/planetary-computer/geocatalog_configs/fws-nwi/tile-settings.json
72+
articles/planetary-computer/geocatalog_configs/fws-nwi-tutorial-943/mosaics.json
73+
articles/planetary-computer/geocatalog_configs/fws-nwi-tutorial-943/stac.json
74+
articles/planetary-computer/geocatalog_configs/fws-nwi-tutorial-943/tile-settings.json
75+
articles/planetary-computer/geocatalog_configs/fws-nwi-tutorial-97/mosaics.json
76+
articles/planetary-computer/geocatalog_configs/fws-nwi-tutorial-97/stac.json
77+
articles/planetary-computer/geocatalog_configs/fws-nwi-tutorial-97/tile-settings.json
78+
articles/planetary-computer/geocatalog_configs/GEBCO_bathymetry/mosaics.json
79+
articles/planetary-computer/geocatalog_configs/GEBCO_bathymetry/render-options.json
80+
articles/planetary-computer/geocatalog_configs/GEBCO_bathymetry/stac.json
81+
articles/planetary-computer/geocatalog_configs/GEBCO_bathymetry/tile-settings.json
82+
articles/planetary-computer/geocatalog_configs/goes-glm/mosaics.json
83+
articles/planetary-computer/geocatalog_configs/goes-glm/stac.json
84+
articles/planetary-computer/geocatalog_configs/goes-glm/tile-settings.json
85+
articles/planetary-computer/geocatalog_configs/guam-dem/mosaics.json
86+
articles/planetary-computer/geocatalog_configs/guam-dem/render-options.json
87+
articles/planetary-computer/geocatalog_configs/guam-dem/stac.json
88+
articles/planetary-computer/geocatalog_configs/guam-dem/tile-settings.json
89+
articles/planetary-computer/geocatalog_configs/LA-Fires/mosaics.json
90+
articles/planetary-computer/geocatalog_configs/LA-Fires/render-options.json
91+
articles/planetary-computer/geocatalog_configs/LA-Fires/stac.json
92+
articles/planetary-computer/geocatalog_configs/LA-Fires/tile-settings.json
93+
articles/planetary-computer/geocatalog_configs/meta-population/render-options.json
94+
articles/planetary-computer/geocatalog_configs/meta-population/stac.json
95+
articles/planetary-computer/geocatalog_configs/meta-population/tile-settings.json
96+
articles/planetary-computer/geocatalog_configs/modis-14A1-061/mosaics.json
97+
articles/planetary-computer/geocatalog_configs/modis-14A1-061/stac.json
98+
articles/planetary-computer/geocatalog_configs/modis-14A1-061/tile-settings.json
99+
articles/planetary-computer/geocatalog_configs/modis-21A2-061/mosaics.json
100+
articles/planetary-computer/geocatalog_configs/modis-21A2-061/stac.json
101+
articles/planetary-computer/geocatalog_configs/modis-21A2-061/tile-settings.json
102+
articles/planetary-computer/geocatalog_configs/monrovia-drone/mosaics.json
103+
articles/planetary-computer/geocatalog_configs/monrovia-drone/render-options.json
104+
articles/planetary-computer/geocatalog_configs/monrovia-drone/stac.json
105+
articles/planetary-computer/geocatalog_configs/monrovia-drone/tile-settings.json
106+
articles/planetary-computer/geocatalog_configs/naip-airports/mosaics.json
107+
articles/planetary-computer/geocatalog_configs/naip-airports/render-options.json
108+
articles/planetary-computer/geocatalog_configs/naip-airports/stac.json
109+
articles/planetary-computer/geocatalog_configs/naip-airports/tile-settings.json
110+
articles/planetary-computer/geocatalog_configs/NAIP_Duplin_NC/mosaics.json
111+
articles/planetary-computer/geocatalog_configs/NAIP_Duplin_NC/render-options.json
112+
articles/planetary-computer/geocatalog_configs/NAIP_Duplin_NC/stac.json
113+
articles/planetary-computer/geocatalog_configs/NAIP_Duplin_NC/tile-settings.json
114+
articles/planetary-computer/geocatalog_configs/nasa-nex-gddp-cmip6/mosaics.json
115+
articles/planetary-computer/geocatalog_configs/nasa-nex-gddp-cmip6/render-options.json
116+
articles/planetary-computer/geocatalog_configs/nasa-nex-gddp-cmip6/stac.json
117+
articles/planetary-computer/geocatalog_configs/nasa-nex-gddp-cmip6/tile-settings.json
118+
articles/planetary-computer/geocatalog_configs/ndvi_diff/mosaics.json
119+
articles/planetary-computer/geocatalog_configs/ndvi_diff/render-options.json
120+
articles/planetary-computer/geocatalog_configs/ndvi_diff/stac.json
121+
articles/planetary-computer/geocatalog_configs/ndvi_diff/tile-settings.json
122+
articles/planetary-computer/geocatalog_configs/noaa-climate-normals-netcdf/mosaics.json
123+
articles/planetary-computer/geocatalog_configs/noaa-climate-normals-netcdf/render-options.json
124+
articles/planetary-computer/geocatalog_configs/noaa-climate-normals-netcdf/stac.json
125+
articles/planetary-computer/geocatalog_configs/noaa-climate-normals-netcdf/tile-settings.json
126+
articles/planetary-computer/geocatalog_configs/noaa-hrrr-sfc-conus/mosaics.json
127+
articles/planetary-computer/geocatalog_configs/noaa-hrrr-sfc-conus/stac.json
128+
articles/planetary-computer/geocatalog_configs/noaa-hrrr-sfc-conus/tile-settings.json
129+
articles/planetary-computer/geocatalog_configs/noaa-hrrr-sfc-conus-test/mosaics.json
130+
articles/planetary-computer/geocatalog_configs/noaa-hrrr-sfc-conus-test/stac.json
131+
articles/planetary-computer/geocatalog_configs/noaa-hrrr-sfc-conus-test/tile-settings.json
132+
articles/planetary-computer/geocatalog_configs/noaa-mrms-qpe-1h-pass1/render-options.json
133+
articles/planetary-computer/geocatalog_configs/noaa-mrms-qpe-1h-pass1/stac.json
134+
articles/planetary-computer/geocatalog_configs/noaa-mrms-qpe-1h-pass1/tile-settings.json
135+
articles/planetary-computer/geocatalog_configs/potsdam-aerial/mosaics.json
136+
articles/planetary-computer/geocatalog_configs/potsdam-aerial/render-options.json
137+
articles/planetary-computer/geocatalog_configs/potsdam-aerial/stac.json
138+
articles/planetary-computer/geocatalog_configs/potsdam-aerial/tile-settings.json
139+
articles/planetary-computer/geocatalog_configs/sentinel-2-l2a-tutorial-231/mosaics.json
140+
articles/planetary-computer/geocatalog_configs/sentinel-2-l2a-tutorial-231/render-options.json
141+
articles/planetary-computer/geocatalog_configs/sentinel-2-l2a-tutorial-231/stac.json
142+
articles/planetary-computer/geocatalog_configs/sentinel-2-l2a-tutorial-231/tile-settings.json
143+
articles/planetary-computer/geocatalog_configs/sentinel-2-l2a_Grindavik/mosaics.json
144+
articles/planetary-computer/geocatalog_configs/sentinel-2-l2a_Grindavik/render-options.json
145+
articles/planetary-computer/geocatalog_configs/sentinel-2-l2a_Grindavik/stac.json
146+
articles/planetary-computer/geocatalog_configs/sentinel-2-l2a_Grindavik/tile-settings.json
147+
articles/planetary-computer/geocatalog_configs/umbra-sar/mosaics.json
148+
articles/planetary-computer/geocatalog_configs/umbra-sar/render-options.json
149+
articles/planetary-computer/geocatalog_configs/umbra-sar/stac.json
150+
articles/planetary-computer/geocatalog_configs/umbra-sar/tile-settings.json
151+
articles/planetary-computer/geocatalog_configs/umbra-sar-airplanes/mosaics.json
152+
articles/planetary-computer/geocatalog_configs/umbra-sar-airplanes/render-options.json
153+
articles/planetary-computer/geocatalog_configs/umbra-sar-airplanes/stac.json
154+
articles/planetary-computer/geocatalog_configs/umbra-sar-airplanes/tile-settings.json
155+
articles/planetary-computer/geocatalog_configs/umbra-sar-ships/mosaics.json
156+
articles/planetary-computer/geocatalog_configs/umbra-sar-ships/render-options.json
157+
articles/planetary-computer/geocatalog_configs/umbra-sar-ships/stac.json
158+
articles/planetary-computer/geocatalog_configs/umbra-sar-ships/tile-settings.json
159+
articles/planetary-computer/helper-content/collection-config-scraper.py
160+
articles/planetary-computer/helper-content/generate_collection_docs.py

articles/planetary-computer/TOC.yml

Lines changed: 7 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@
1111
- name: Supported data types
1212
href: supported-data-types.md
1313
expanded: true
14-
- name: Deploy & setup
14+
- name: Deploy & set up
1515
items:
1616
- name: Get started with Microsoft Planetary Computer Pro
1717
href: get-started-planetary-computer.md
@@ -37,7 +37,7 @@
3737
href: ingestion-overview.md
3838
- name: Ingestion sources
3939
href: ingestion-source.md
40-
- name: Setup an ingestion source using managed identity through the UI
40+
- name: Set up an ingestion source using managed identity through the UI
4141
href: set-up-ingestion-credentials-managed-identity.md
4242
- name: Set up ingestion source using SAS tokens
4343
href: set-up-ingestion-credentials-sas-tokens.md
@@ -47,8 +47,12 @@
4747
href: create-stac-item.md
4848
- name: Add a STAC item to a collection
4949
href: add-stac-item-to-collection.md
50-
- name: Bulk ingest data
50+
- name: Bulk ingestion
5151
href: bulk-ingestion-api.md
52+
- name: Troubleshooting ingestion
53+
href: troubleshooting-ingestion.md
54+
- name: Error codes from ingestion
55+
href: error-codes-ingestion.md
5256
- name: Configure collections for visualization
5357
items:
5458
- name: Collection configuration overview

articles/planetary-computer/add-stac-item-to-collection.md

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -115,9 +115,8 @@ while True:
115115
if status not in {"Pending", "Running"}:
116116
break
117117
time.sleep(5)
118-
```
119118

120-
Once the items are ingested, use the `/stac/collections/{collection_id}/items` or `/stac/search` endpoints to get a paginated list of items, including your newly ingested items.
119+
Once the items are ingested, use the `/stac/collections/{collection_id}/items` or `/stac/search` endpoints to get a paginated list of items, including your newly ingested items. If the ingestion fails or you encounter errors, consult the [troubleshooting guide](./troubleshooting-ingestion.md) and the [list of error codes](./error-codes-ingestion.md).
121120

122121
```python
123122
items_response = requests.get(
@@ -174,3 +173,5 @@ Now that you added a few items, you should configure the data for visualization.
174173
- [Quickstart: Ingest data using the Microsoft Planetary Computer Pro web interface](./ingest-via-web-interface.md)
175174
- [Ingest data into Microsoft Planetary Computer Pro](./ingestion-overview.md)
176175
- [Ingestion source for Microsoft Planetary Computer Pro](./ingestion-source.md)
176+
- [Troubleshooting data ingestion](./troubleshooting-ingestion.md)
177+
- [Error codes: Microsoft Planetary Computer Pro ingestion](./error-codes-ingestion.md)

articles/planetary-computer/bulk-ingestion-api.md

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -315,7 +315,7 @@ In this final step, we're using the ingestion API to initiate a bulk ingestion w
315315
else:
316316
print(f"Failed to create ingestion run: {wf_response.text}")
317317
318-
Once the workflow is complete, you can query, retrieve, or visualize your geospatial data using the GeoCatalog STAC or data APIs, or with the Data Explorer.
318+
Once the workflow is complete, you can query, retrieve, or visualize your geospatial data using the GeoCatalog STAC or data APIs, or with the Data Explorer. If you encounter issues, refer to the [troubleshooting guide](./troubleshooting-ingestion.md) or the list of [ingestion error codes](./error-codes-ingestion.md).
319319
320320
## Clean up resources
321321
@@ -348,3 +348,5 @@ Now that you added a few items, you should configure the data for visualization.
348348
- [Quickstart: Ingest data using the Microsoft Planetary Computer Pro web interface](./ingest-via-web-interface.md)
349349
- [Ingest data into Microsoft Planetary Computer Pro](./ingestion-overview.md)
350350
- [Ingestion source for Microsoft Planetary Computer Pro](./ingestion-source.md)
351+
- [Troubleshooting data ingestion](./troubleshooting-ingestion.md)
352+
- [Error codes: Microsoft Planetary Computer Pro ingestion](./error-codes-ingestion.md)

articles/planetary-computer/create-stac-item.md

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -324,6 +324,9 @@ When pointed to a COG file, `rio-stac` automatically extracts and organizes esse
324324

325325
This automation significantly reduces the manual work needed to create valid STAC Items and ensures consistency in metadata
326326

327+
> [!NOTE]
328+
> GeoCatalog has limitations on characters that can be used in STAC Item IDs and Asset keys. Ensure that your IDs don't contain the following characters: `-`, `_`, `+`, `(`, `)`, and `.`. You may need to modify the `item_id` generation logic to replace or remove these characters from your filenames.
329+
327330
```python
328331
from rio_stac import create_stac_item
329332
from rasterio.io import MemoryFile

0 commit comments

Comments
 (0)