This is awesome, @migurski. /cc @jonahadkins

Quality Gate passed

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
82.3% Coverage on New Code
1.7% Duplication on New Code

See analysis details on SonarQube Cloud

COPY (
    SELECT *
    FROM read_parquet(
        's3://overturemaps-us-west-2/release/2025-12-17.0/**/*.parquet',
        hive_partitioning=1, filename=1, union_by_name=1
    )
    WHERE theme IN ('transportation', 'places', 'base', 'buildings', 'divisions')
      AND bbox.xmin <= -121
      AND bbox.xmax >= -123
      AND bbox.ymin <= 38
      AND bbox.ymax >= 37
) TO 'data/sources/bay-area.parquet' (FORMAT PARQUET);

Curious, how long does this take for you to download? From how long it takes it seems to require some enumeration over the overture .parquet files

I am just downloading the entire December release now with something like:

aws s3 cp --no-sign-request --recursive s3://overturemaps-us-west-2/release/2025-12-17.0/ .

With about 10 MiB/s it is a bit pedestrian but if the whole thing is only roughly 500 GB then the download should still complete within 14 hours. Sometimes those downloads also get faster over time. Let's see...

Thanks for making the online demo @migurski! The first thing that I saw when opening it was the Emirate Kush Cargo Airport in the middle of Oakland. According to the overture explorer this POI has a confidence score of roughly 63 percent. To experiment with thresholding it might make sense to temporarily add the confidence score in the tiles and then we could add a slider to the frontend and change the maplibre style with a filter or so based on the slider value.

I am just downloading the entire December release now with something like:

aws s3 cp --no-sign-request --recursive s3://overturemaps-us-west-2/release/2025-12-17.0/ .

With about 10 MiB/s it is a bit pedestrian but if the whole thing is only roughly 500 GB then the download should still complete within 14 hours. Sometimes those downloads also get faster over time. Let's see...

Try the DuckDB sample code in the description! The OMS Parquet files are already clustered spatially, and small areas can take just minutes to extract.

COPY (
    SELECT *
    FROM read_parquet(
        's3://overturemaps-us-west-2/release/2025-12-17.0/**/*.parquet',
        hive_partitioning=1, filename=1, union_by_name=1
    )
    WHERE theme IN ('transportation', 'places', 'base', 'buildings', 'divisions')
      AND bbox.xmin <= -121
      AND bbox.xmax >= -123
      AND bbox.ymin <= 38
      AND bbox.ymax >= 37
) TO 'data/sources/bay-area.parquet' (FORMAT PARQUET);

Curious, how long does this take for you to download? From how long it takes it seems to require some enumeration over the overture .parquet files

For me, about a minute or two.

Thanks for making the online demo @migurski! The first thing that I saw when opening it was the Emirate Kush Cargo Airport in the middle of Oakland. According to the overture explorer this POI has a confidence score of roughly 63 percent. To experiment with thresholding it might make sense to temporarily add the confidence score in the tiles and then we could add a slider to the frontend and change the maplibre style with a filter or so based on the slider value.

I agree, and incorporating QRank and confidence would be a good way to improve the POI quality since we don't have way areas or building heights like in OSM.

I was able to run a local build of Zürich:

I have a local copy now of the roughly 500 GB overture data.
Is it possible to run this on the full Overture data planet-wide?

@msbarry uses the following I think to read a parquet directory:

https://github.com/onthegomap/planetiler-examples/blob/8901f77284712fd8f8f35f3fface712962d6287c/Overture.java#L42-L46