Enhancement: Improve Sentinel-2 tile selection logic in demo config generation

[bishesh16]

Description

The current implementation of generate_config_json function in the demo config generation needs enhancement in how it selects Sentinel-2 tiles. The function currently doesn't optimally select tiles based on quality metrics.

Current Behavior

The function at sagemaker_pipelines/embedding_generation/scripts/consolidate.py (lines 207-231) doesn't properly consider:

• Cloud coverage metrics
• NoData properties
• Different monthly variations

Proposed Enhancement

Improve the tile selection logic to:

Better utilize cloud_cover property from Sentinel-2 tiles
Consider NoData metrics in the selection process
Implement proper handling of different months for better temporal coverage
Select best image per month when choosing images from different years
Select tiles that provide optimal quality for the demo

Expected Outcome

More reliable and higher quality tile selection for demo configuration generation, resulting in better demonstration of change detection captured by foundation models.

Type

• Enhancement
• Bug
• Documentation

This enhancement will improve the overall quality of demonstrations by ensuring the best available Sentinel-2 tiles are selected.