0.3.3

PgOSM Flex 0.3.3 Release Notes

Docker runtime improvements

• Properly sets PGOSM_DATE env var for historic loads. #169

0.3.2

PgOSM Flex 0.3.2 Release Notes

Data improvements

• Improve road layers for routing access control #161

Docker runtime improvements

• Docker removes -latest files post-run #166
• Output .sql includes date #162
• Use psycopg3 instead of psycopg2 #165
• Fix bug with historic date but missing data #163

0.3.1

PgOSM Flex 0.3.1 Release Notes

Data improvements

• Include ski lifts in public transport - #145
• Other public transport improvements - #157, #140
• Track language in table osm.pgosm_flex - #154
• Improve Quality Control queries - #157

Other improvements

• Add --skip-dump flag to Docker runtime - #148
• Docker images auto-built in Docker Hub - Fixed #132

0.3.0

PgOSM Flex 0.3.0 Release Notes

⚠️ Breaking Change

Docker image now uses Python script instead of Bash script (#147). Should be functionally equivalent but usage has changed slightly. Review readme for latest instructions.

This overhaul enables improvements in the short term (#131, #150, #148) and more to come in the long term.

Thank you jacopofar for your help!

Data improvements

• Improve handling of ref #144
• Fixed: public transport has ref now #143

Other improvements

• Output filename includes region now - #131
• Makefile to aid development/testing - #150
• Improve Comments #142

0.2.1

PgOSM Flex 0.2.1 Release Notes

This release is paired with osm2pgsql v1.5.0. Before this release there wasn't a recent combination of tagged releases between this project and osm2pgsql that worked.

⚠️ Breaking change: Data type handling in osm2pgsql

Fixed to match in #137

Bump required osm2pgsql version

Requires osm2pgsql v1.5.0

Data related improvements

• Add public transport layer (point/line/polygon) - #115

Backend related

• Docker can process parent region, not only sub-regions - #135

0.2.0

PgOSM Flex 0.2.0 Release Notes

This release includes data quality improvements along with a major overhaul to the in-Docker process. The improvements in Docker are tied to recent improvements to osm2pgsql.

A big part of the improvements in this release are related to the underlying improvements in osm2pgsql made in the master branch after the osm2pgsql v1.4.2 release. Those changes include a major overhaul of the middle processing, making the RAM requirements a) significantly lower, and b) predictable. See the blog post OpenStreetMap to PostGIS is getting lighter for more. This key improvement cascaded into a new open source API (https://osm2pgsql-tuner.com/) to provide recommended osm2pgsql commands for a given amount of system RAM and the size of the PBF being processed. This allowed the script in Docker to be reworked to determine the combination of osm2pgsql switches to use for processing (--slim, --drop, --flat-nodes, --cache) instead of always using --slim --drop --cache=N>0.

Multiple regions were tested and found to run 10-40% faster than the previous script. Previously the recommendation for the Docker image was to avoid for 2+ GB PBF files, now the Docker image makes it easy and fast for all PBF sizes tested so far.

⚠️ Breaking change: Docker Exec - Different 3rd Param

The Docker exec command had a change in the 3rd parameter. Previously the 3rd parameter set the cache value for osm2pgsql (in MB), it now expects the system RAM (in GB!) to use to determine the osm2pgsql command to run. This example command sets the system RAM to 8 GB.

docker exec -it \
    -e POSTGRES_PASSWORD=mysecretpassword -e POSTGRES_USER=postgres \
    pgosm bash docker/run_pgosm_flex.sh \
    north-america/us \
    district-of-columbia \
    8 \
    run-all

⚠️ Breaking change: JSON handling in osm2pgsql

The osm2pgsql project built in automatic JSON handling when table columns are declared as JSON/JSONB. This required remove
the Lua JSON script that was previously added.

Bump required osm2pgsql version

The two breaking changes listed mean this version of PgOSM Flex requires a currently non-tagged release of osm2pgsql. In the future when the osm2pgsql version following 1.4.2 is released, this project will pin to that for the minimum version. With the improvements described above, the new recommended way to use PgOSM Flex is to use the Docker image to handle the processing. Using Docker makes the version of osm2pgsql installed a non-issue.

If you are using osm2pgsql installed on a server, you must install the latest master branch of osm2pgsql. The instructions in MANUAL-STEPS-RUN.md cover this install.

Data related improvements

• Infrastructure improvements - Add line, polygon types, plus generic utility keys - #133
• Add road_polygon to handle elevators #127
• Improve wheelchair from simple boolean to match OSM defined values #117 / #125
• Add door/entrance to Layers Building and Indoor (#108 / #121)
• Fixed Bench processing bug - #119
• Additional amenity keys included, code improvements - #110, #114, #120
• Add relations to building layer #109 / #111

Backend related

• Docker uses dynamic osm2pgsql command via osm2pgsql-tuner.com API (BREAKING CHANGE) - #129
• Swapped JSON to osm2pgsql built-in support (BREAKING CHANGE) #122
• Testing / QC - #112 / #116

0.1.5

PgOSM-Flex 0.1.5 Release Notes

Data related

• Add postcode column, multiple layers #106
• Update address to include postcode, multiple layers #106
• Add historic tag to POI layer #105, #107
• Add relations to POI layer #107
• Fix POI to exclude buildings with empty string (side effect from change in helpers.lua) #107

Backend related

• Improve quality control queries RE missing features #106
• Swapped JSON implementation to supported project, improved tags import performance was bonus #88

0.1.4

New

• PGOSM_LANGUAGE environment variable to set preferred language for name columns (#93)

Updated

• Building layer includes osm_subtype column #97 / #99
• Building layer includes Address-only objects (#97)
• Add missing osm_type column to vbuilding_all (#98)
• Documentation improvements (#96)

0.1.3

New

• Docker script auto builds nested polygon data w/ env var to override (#91)

Updated

• Moved address calculation to helpers.lua - Greatly improved quality of final address (#92, #95)
• Fixed typos in comments (#94)

0.1.2

Updated

• Shop layer includes additional amenity features #84
• Improved documentation & comments #81, #84
• Move address concatenation to generated column #82
• Docker script checks for Postgres service ready #86

New

• Docker run script handles OSM file dates (#85/#80)
• POI layer via Mat view (#63/#89)