Skip to content

Quick and harmless fix to help with alternate OpenSearch schemas #553

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
tloubrieu-jpl wants to merge 11 commits into
base: main
Choose a base branch
from
+272 −98
Open

Quick and harmless fix to help with alternate OpenSearch schemas #553

Show file tree
Hide file tree
Changes from 5 commits
Commits
Show all changes
11 commits
Select commit Hold shift + click to select a range
f98b9c2
make datetime fields constants in the DatabaseLogic
Dec 8, 2025
9268b46
update obsolete comment
Dec 9, 2025
7696e58
Merge branch 'main' into for_other_os_schema
Dec 9, 2025
310a25d
update CHANGELOG, lint fix
Dec 9, 2025
8a2f3cc
Merge branch 'main' into for_other_os_schema
jonhealy1 Dec 9, 2025
c84db16
fix forgotten nested properties management, extend changes to elastic…
Dec 12, 2025
da4e915
Merge branch 'for_other_os_schema' of https://github.com/tloubrieu-jp…
Dec 12, 2025
80298af
Merge branch 'main' into for_other_os_schema
jonhealy1 Dec 12, 2025
2a43305
make filter fields environment variables, update the README accordingly
Dec 13, 2025
5a01692
resolve README conflict
Dec 13, 2025
fa8fbce
Merge branch 'main' into for_other_os_schema
jonhealy1 Dec 14, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions CHANGELOG.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,8 +13,11 @@ and this project adheres to [Semantic Versioning](http://semver.org/spec/v2.0.0.
- Added DELETE `/catalogs/{catalog_id}/collections/{collection_id}` endpoint to support removing collections from catalogs. When a collection belongs to multiple catalogs, it removes only the specified catalog from the collection's parent_ids. When a collection belongs to only one catalog, the collection is deleted entirely. [#554](https://github.com/stac-utils/stac-fastapi-elasticsearch-opensearch/pull/554)
- Added `parent_ids` internal field to collections to support multi-catalog hierarchies. Collections can now belong to multiple catalogs, with parent catalog IDs stored in this field for efficient querying and management. [#554](https://github.com/stac-utils/stac-fastapi-elasticsearch-opensearch/pull/554)


### Changed

- Have opensearch datetime, geometry and collections fields defined as constant strings [#553](https://github.com/stac-utils/stac-fastapi-elasticsearch-opensearch/pull/553)

### Fixed

- Fix unawaited coroutine in `stac_fastapi.core.core`. [#551](https://github.com/stac-utils/stac-fastapi-elasticsearch-opensearch/pull/551)
Expand Down
61 changes: 47 additions & 14 deletions stac_fastapi/opensearch/stac_fastapi/opensearch/database_logic.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -154,6 +154,15 @@ def __attrs_post_init__(self):

aggregation_mapping: Dict[str, Dict[str, Any]] = AGGREGATION_MAPPING

# constants for field names
# they are used in multiple methods
# and could be overwritten in subclasses used with alternate opensearch mappings.
PROPERTIES_DATETIME_FIELD = "properties.datetime"
PROPERTIES_START_DATETIME_FIELD = "properties.start_datetime"
PROPERTIES_END_DATETIME_FIELD = "properties.end_datetime"
COLLECTION_FIELD = "collection"
GEOMETRY_FIELD = "geometry"

"""CORE LOGIC"""

async def get_all_collections(
Expand Down Expand Up @@ -436,7 +445,9 @@ def apply_ids_filter(search: Search, item_ids: List[str]):
@staticmethod
def apply_collections_filter(search: Search, collection_ids: List[str]):
"""Database logic to search a list of STAC collection ids."""
return search.filter("terms", collection=collection_ids)
return search.filter(
"terms", **{DatabaseLogic.COLLECTION_FIELD: collection_ids}
)

@staticmethod
def apply_free_text_filter(search: Search, free_text_queries: Optional[List[str]]):
Expand Down Expand Up @@ -488,7 +499,7 @@ def apply_datetime_filter(
Q(
"bool",
filter=[
Q("exists", field="properties.datetime"),
Q("exists", field=DatabaseLogic.PROPERTIES_DATETIME_FIELD),
Q(
"term",
**{"properties__datetime": datetime_search["eq"]},
Expand All @@ -497,10 +508,18 @@ def apply_datetime_filter(
),
Q(
"bool",
must_not=[Q("exists", field="properties.datetime")],
must_not=[
Q("exists", field=DatabaseLogic.PROPERTIES_DATETIME_FIELD)
],
filter=[
Q("exists", field="properties.start_datetime"),
Q("exists", field="properties.end_datetime"),
Q(
"exists",
field=DatabaseLogic.PROPERTIES_START_DATETIME_FIELD,
),
Q(
"exists",
field=DatabaseLogic.PROPERTIES_END_DATETIME_FIELD,
),
Q(
"range",
properties__start_datetime={
Expand All @@ -522,7 +541,7 @@ def apply_datetime_filter(
Q(
"bool",
filter=[
Q("exists", field="properties.datetime"),
Q("exists", field=DatabaseLogic.PROPERTIES_DATETIME_FIELD),
Q(
"range",
properties__datetime={
Expand All @@ -534,10 +553,18 @@ def apply_datetime_filter(
),
Q(
"bool",
must_not=[Q("exists", field="properties.datetime")],
must_not=[
Q("exists", field=DatabaseLogic.PROPERTIES_DATETIME_FIELD)
],
filter=[
Q("exists", field="properties.start_datetime"),
Q("exists", field="properties.end_datetime"),
Q(
"exists",
field=DatabaseLogic.PROPERTIES_START_DATETIME_FIELD,
),
Q(
"exists",
field=DatabaseLogic.PROPERTIES_END_DATETIME_FIELD,
),
Q(
"range",
properties__start_datetime={
Expand All @@ -563,8 +590,11 @@ def apply_datetime_filter(
filter_query = Q(
"bool",
filter=[
Q("exists", field="properties.start_datetime"),
Q("exists", field="properties.end_datetime"),
Q(
"exists",
field=DatabaseLogic.PROPERTIES_START_DATETIME_FIELD,
),
Q("exists", field=DatabaseLogic.PROPERTIES_END_DATETIME_FIELD),
Q(
"range",
properties__start_datetime={"lte": datetime_search["eq"]},
Expand All @@ -579,8 +609,11 @@ def apply_datetime_filter(
filter_query = Q(
"bool",
filter=[
Q("exists", field="properties.start_datetime"),
Q("exists", field="properties.end_datetime"),
Q(
"exists",
field=DatabaseLogic.PROPERTIES_START_DATETIME_FIELD,
),
Q("exists", field=DatabaseLogic.PROPERTIES_END_DATETIME_FIELD),
Q(
"range",
properties__start_datetime={"lte": datetime_search["lte"]},
Expand Down Expand Up @@ -612,7 +645,7 @@ def apply_bbox_filter(search: Search, bbox: List):
Q(
{
"geo_shape": {
"geometry": {
DatabaseLogic.GEOMETRY_FIELD: {
"shape": {
"type": "polygon",
"coordinates": bbox2polygon(*bbox),
Expand Down