Releases: onthegomap/planetiler
v0.4.0
What's Changed
This release improves performance and reduces memory requirements:
- Generating a map of the world on a high-end machine (64 cpu/128GB RAM) now takes as little as 47 minutes instead of an hour
- You can now run with as little as 32GB of RAM instead of 128 using
--storage=mmap
to store temporary data in memory-mapped files
To run this release from Java, download the attached planetiler.jar, or from docker use ghcr.io/onthegomap/planetiler:0.4.0
.
There is ongoing discussion about the project in the #planetiler channel on OSM-US slack. If you are interested in joining, get an invite here!
Performance Improvements
- Custom PBF parsing by @msbarry in #82
- Memory-mapped file improvements by @msbarry in #103
- Node location cache: off-heap storage and “array” implementation that supports parallel inserts by @msbarry in #131
- Offload multipolygon storage to disk (reduce memory usage by 10-15gb) by @msbarry in #141
Improvements and Bug Fixes
- Log thread stats by @msbarry in #85
- Download automatically from quickstart by @msbarry in #93
- Warn when running with insufficient memory or disk space by @msbarry in #73
- Log direct memory usage by @msbarry in #108
- Retry wikidata requests by @msbarry in #115
- Use newer lake centerlines from @acalcutt by @msbarry in #116
- Check disk space and memory only with OSM input file by @wipfli in #138
- Read shapefiles in UTF-8 mode by @wipfli in #137
- Handle more than one centerline for a lake by @msbarry in #139
- Update README.md by @SomeoneElseOSM in #140
- Allow changing Basemap Base-Url by @boldtrn in #143
- Improve name:latin logic by @msbarry in #147
- Don't get transportation_name ref values from minor networks by @msbarry in #148
- Linting - spelling, tiny cleanups by @nyurik in #150
- 0.4.0 tweaks by @msbarry in #153
Contributor Improvements
- Support for each loop in workers by @msbarry in #83
- Add intellij file settings instructions on Linux by @wipfli in #89
- Update adoptium links by @wipfli in #94
- Remove graphhopper dependency by @msbarry in #101
- Test for --free-osm-after-read by @msbarry in #107
- Migrate to eclipse formatter to support multiple IDEs by @msbarry in #122
Dependencies
Once again, @dependabot has been busy keeping dependencies up-to-date.
Dependency upgrades in this release
- Bump geotools.version from 26.2 to 26.3 by @dependabot in #84
- Bump commonmark from 0.18.1 to 0.18.2 by @dependabot in #96
- Bump actions/setup-node from 2 to 3 by @dependabot in #95
- Bump log4j.version from 2.17.1 to 2.17.2 by @dependabot in #100
- Bump guava from 31.0.1-jre to 31.1-jre by @dependabot in #102
- Bump actions/checkout from 2 to 3 by @dependabot in #106
- Bump jackson.version from 2.13.1 to 2.13.2 by @dependabot in #121
- Bump msgpack-core from 0.9.0 to 0.9.1 by @dependabot in #123
- Bump mockito-core from 4.3.1 to 4.4.0 by @dependabot in #130
- Bump spotless-maven-plugin from 2.21.0 to 2.22.0 by @dependabot in #151
- Bump jib-maven-plugin from 3.2.0 to 3.2.1 by @dependabot in #152
New Contributors
- @wipfli made their first contribution in #89
- @SomeoneElseOSM made their first contribution in #140
- @boldtrn made their first contribution in #143
- @nyurik made their first contribution in #150
Full Changelog: v0.3.0...v0.4.0
v0.3.0
What's Changed
This release upgrades the basemap profile to be compatible with OpenMapTiles v3.13 (#49). People also started using the project a bit and discovered a few bugs that are fixed in this release. Keep 'em coming!
To run this release from Java, download the attached planetiler.jar, or from docker use ghcr.io/onthegomap/planetiler:0.3.0
.
Also there is ongoing discussion about the project in the #planetiler channel on OSM-US slack. If you are interested in joining, get an invite here!
Improvements and Bug Fixes
- Upgrade planetiler-basemap to be compatible with OpenMapTiles 3.13 by @msbarry in #49
- Add hooks for preprocessing nodes and ways by @msbarry in #56 (needed for highway junctions in basemap profile)
- Include route relations without a network type by @msbarry in #68
- Treat boundary and land_area relation types as multipolygons by @msbarry in #50
- Fix pedestrian area polygons by @msbarry in #63
- Fix unit tests in other locales by @msbarry in #64
- Gracefully handle exceptions from profiles by @msbarry in #65
- Handle highways with man_made=bridge by @msbarry in #66
- Fix service/man_made npe by @msbarry in #72
Dependencies
Once again, @dependabot has been busy keeping dependencies up-to-date.
Dependency upgrades in this release
- Bump log4j.version from 2.17.0 to 2.17.1 by @dependabot in #44
- Bump reproducible-build-maven-plugin from 0.14 to 0.15 by @dependabot in #45
- Bump maven-deploy-plugin from 3.0.0-M1 to 3.0.0-M2 by @dependabot in #48
- Bump maven-jar-plugin from 3.2.0 to 3.2.1 by @dependabot in #52
- Bump maven-jar-plugin from 3.2.1 to 3.2.2 by @dependabot in #53
- Bump slf4j-api from 1.7.32 to 1.7.33 by @dependabot in #55
- Bump jib-maven-plugin from 3.1.4 to 3.2.0 by @dependabot in #57
- Bump geotools.version from 26.1 to 26.2 by @dependabot in #58
- Bump mockito-core from 4.2.0 to 4.3.0 by @dependabot in #59
- Bump mockito-core from 4.3.0 to 4.3.1 by @dependabot in #60
- Bump slf4j-api from 1.7.33 to 1.7.35 by @dependabot in #62
- Bump prometheus.version from 0.14.1 to 0.15.0 by @dependabot in #71
- Bump slf4j-api from 1.7.35 to 1.7.36 by @dependabot in #75
- Bump maven-javadoc-plugin from 3.3.1 to 3.3.2 by @dependabot in #76
- Bump actions/github-script from 5 to 6 by @dependabot in #79
Full Changelog: v0.2.0...v0.3.0
v0.2.0
What's Changed
Flatmap has been renamed to "Planetiler" (#40) to better convey what the project does, and to be more unique and easy to find. Thanks to @danlarkin for the name suggestion!
Starting with version 0.2.0, planetiler releases are available from maven central. To use as a library (see the example project) add this dependency to your java project:
<dependency>
<groupId>com.onthegomap.planetiler</groupId>
<artifactId>planetiler-core</artifactId>
<version>0.2.0</version>
</dependency>
Other User-Facing Improvements
- Smaller Monaco extract snippets by @msbarry in #5
- Follow redirects from downloader by @msbarry in #23
- Switch from temurin jdk to jre by @msbarry in #41
- Build arm64 container by @msbarry in #17
Internal Improvements
- Run generate test from CI by @msbarry in #37
- Change example run from CI by @msbarry in #28
- Use maven cache for regenerate CI by @msbarry in #42
- Switch from github maven packages to maven central by @msbarry in #7
Dependencies
@dependabot has been busy keeping dependencies on their latest versions. Notably, log4j has been upgraded to version 2.17.0 to mitigate Log4Shell vulnerability (CVE-2021-44228).
Other dependency upgrades
- Bump icu4j from 69.1 to 70.1 by @dependabot in #10
- Bump geotools.version from 26.0 to 26.1 by @dependabot in #19
- Bump mockito-core from 4.0.0 to 4.1.0 by @dependabot in #20
- Bump junit.version from 5.8.1 to 5.8.2 by @dependabot in #22
- Bump commonmark from 0.18.0 to 0.18.1 by @dependabot in #24
- Bump log4j.version from 2.14.1 to 2.15.0 by @dependabot in #27
- Bump prometheus.version from 0.12.0 to 0.13.0 by @dependabot in #29
- Bump log4j-api from 2.15.0 to 2.16.0 in /flatmap-core by @dependabot in #30
- Bump junit-jupiter-api from 5.8.1 to 5.8.2 in /flatmap-examples by @dependabot in #32
- Bump snakeyaml from 1.29 to 1.30 by @dependabot in #33
- Bump mockito-core from 4.1.0 to 4.2.0 by @dependabot in #34
- Bump log4j-api from 2.16.0 to 2.17.0 in /flatmap-core by @dependabot in #35
- Bump jackson.version from 2.13.0 to 2.13.1 by @dependabot in #38
- Bump prometheus.version from 0.13.0 to 0.14.1 by @dependabot in #39
Full Changelog: v0.1.0...v0.2.0
v0.1.0
Initial flatmap release, see the README for more details.
To run using Java 16 or later:
wget https://github.com/onthegomap/flatmap/releases/download/v0.1.0/flatmap.jar
java -Xmx1g -jar flatmap.jar --download --area=monaco
Or using docker:
docker run -e JAVA_TOOL_OPTIONS="-Xmx1g" -v "$(pwd)/data":/data ghcr.io/onthegomap/flatmap:0.1.0 --download --area=monaco
Attached are logs and VisualVM profile from running flatmap over the planet-211011.osm.pbf snapshot from the AWS Registry of Open Data on a Digital Ocean memory-optimized droplet with 16 vCPUs and 128GB RAM in 3h21m.
v0.1.0-pre2
What's Changed
Full Changelog: v0.1.0-pre1...v0.1.0-pre2
v0.1.0-pre1
Initial test release.